UCL  IRIS
Institutional Research Information Service
UCL Logo
Please report any queries concerning the funding data grouped in the sections named "Externally Awarded" or "Internally Disbursed" (shown on the profile page) to your Research Finance Administrator. Your can find your Research Finance Administrator at https://www.ucl.ac.uk/finance/research/rs-contacts.php by entering your department
Please report any queries concerning the student data shown on the profile page to:

Email: portico-services@ucl.ac.uk

Help Desk: http://www.ucl.ac.uk/ras/portico/helpdesk
Publication Detail
Practical lossless compression with latent variables using bits back coding
  • Publication Type:
    Conference
  • Authors:
    Townsend J, Bird T, Barber D
  • Publication date:
    09/05/2019
  • Pagination:
    1, 13
  • Published proceedings:
    7th International Conference on Learning Representations, ICLR 2019
  • Status:
    Published
  • Name of conference:
    ICLR 2019: International Conference on Learning Representations
  • Conference place:
    New Orleans, Louisiana, United States
  • Conference start date:
    06/05/2019
  • Conference finish date:
    09/05/2019
Abstract
© 7th International Conference on Learning Representations, ICLR 2019. All Rights Reserved. Deep latent variable models have seen recent success in many data domains. Lossless compression is an application of these models which, despite having the potential to be highly useful, has yet to be implemented in a practical manner. We present 'Bits Back with ANS' (BB-ANS), a scheme to perform lossless compression with latent variable models at a near optimal rate. We demonstrate this scheme by using it to compress the MNIST dataset with a variational auto-encoder model (VAE), achieving compression rates superior to standard methods with only a simple VAE. Given that the scheme is highly amenable to parallelization, we conclude that with a sufficiently high quality generative model this scheme could be used to achieve substantial improvements in compression rate with acceptable running time. We make our implementation available open source at https://github.com/bits-back/bits-back.
Publication data is maintained in RPS. Visit https://rps.ucl.ac.uk
 More search options
UCL Researchers
Author
Dept of Computer Science
University College London - Gower Street - London - WC1E 6BT Tel:+44 (0)20 7679 2000

© UCL 1999–2011

Search by