[Alemi et al., 2017]
Alexander A. Alemi, Ian Fischer, Joshua V. Dillon, and Kevin Murphy.
Deep variational information bottleneck.
In Int. Conf. Learn. Repr., 2017.
URL <https://openreview.net/forum?id=HyxQzBceg>.

[Blei et al., 2017]
David M. Blei, Alp Kucukelbir, and Jon D. McAuliffe.
Variational inference: A review for statisticians.
J. Am. Stat. Assoc., 1120 (518):0 859–877,

[Cover and Thomas, 2006]
Thomas M. Cover and Joy A. Thomas.
Elements of Information Theory.
Wiley, New York, second edition, 2006.

[Cuff, 2013]
Paul Cuff.
Distributed channel synthesis.
IEEE Trans. Inf. Theory, 590 (11):0
7071–7096, November 2013.

[Damianou et al., 2012]
Andreas Damianou, Carl Ek, Michalis Titsias, and Neil Lawrence.
Manifold relevance determination.
In Proc. Int. Conf. Mach. Learn., 2012.

[Ek et al., 2008]
Carl Henrik Ek, Jon Rihan, Philip HS Torr, Grégory Rogez, and Neil D
Ambiguity modeling in latent spaces.
In Int. Workshop Mach. Learn. Multimodal Interaction, pages
62–73. Springer, 2008.

[El Gamal and Kim, 2011]
Abbas El Gamal and Young-Han Kim.
Network Information Theory.
Cambridge University Press, Cambridge, 2011.

[Higgins et al., 2017]
Irina Higgins, Loic Matthey, Arka Pal, Christopher Burgess, Xavier Glorot,
Matthew Botvinick, Shakir Mohamed, and Alexander Lerchner.
Beta-VAE: Learning basic visual concepts with a constrained
variational framework.
In Int. Conf. Learn. Repr., 2017.
URL <https://openreview.net/forum?id=Sy2fzU9gl>.

[Kingma and Ba, 2014]
Diederik P Kingma and Jimmy Ba.
Adam: A method for stochastic optimization.
arXiv preprint arXiv:1412.6980, 2014.

[Kingma and Welling, 2014]
Diederik P. Kingma and Max Welling.
Auto-encoding variational Bayes.
In Int. Conf. Learn. Repr., 2014.
URL <https://openreview.net/forum?id=33X9fd2-9FyZd>.

[Kingma et al., 2014]
Diederik P Kingma, Shakir Mohamed, Danilo Jimenez Rezende, and Max Welling.
Semi-supervised learning with deep generative models.
In Adv. Neural Info. Proc. Syst., pages 3581–3589, 2014.

[LeCun, 1998]
Yann LeCun.
The MNIST database of handwritten digits.
<http://yann. lecun. com/exdb/mnist/>, 1998.

[LeCun et al., 1998]
Yann LeCun, Léon Bottou, Yoshua Bengio, and Patrick Haffner.
Gradient-based learning applied to document recognition.
Proceedings of the IEEE, 860 (11):0
2278–2324, 1998.

[Liu et al., 2015]
Ziwei Liu, Ping Luo, Xiaogang Wang, and Xiaoou Tang.
Deep learning face attributes in the wild.
In Proceedings of the IEEE international conference on computer
vision, pages 3730–3738, 2015.

[Maaløe et al., 2016]
Lars Maaløe, Casper Kaae Sønderby, Søren Kaae Sønderby, and Ole Winther.
Auxiliary deep generative models.
In Proc. Int. Conf. Mach. Learn., pages 1445–1453, 2016.

[Netzer et al., 2011]
Yuval Netzer, Tao Wang, Adam Coates, Alessandro Bissacco, Bo Wu, and Andrew Y
Reading digits in natural images with unsupervised feature learning.
In NIPS Workshop on Deep Learning and Unsupervised Feature
Learning, 2011.

[Pu et al., 2017]
Yuchen Pu, Weiyao Wang, Ricardo Henao, Liqun Chen, Zhe Gan, Chunyuan Li, and
Lawrence Carin.
Adversarial symmetric variational autoencoder.
In Advances in Neural Information Processing Systems, pages
4330–4339, 2017.

[Rezende and Mohamed, 2015]
Danilo Rezende and Shakir Mohamed.
Variational inference with normalizing flows.
In Proc. Int. Conf. Mach. Learn., pages 1530–1538, 2015.

[Rezende et al., 2014]
Danilo Jimenez Rezende, Shakir Mohamed, and Daan Wierstra.
Stochastic backpropagation and approximate inference in deep
generative models.
In Proc. Int. Conf. Mach. Learn., pages 1278–1286, 2014.

[Rubinstein and Kroese, 2016]
Reuven Y Rubinstein and Dirk P Kroese.
Simulation and the Monte Carlo method, volume 10.
John Wiley & Sons, 2016.

[Salzmann et al., 2010]
Mathieu Salzmann, Carl Henrik Ek, Raquel Urtasun, and Trevor Darrell.
Factorized orthogonal latent spaces.
In Int. Conf. Artif. Int. Stat., pages 701–708, 2010.

[Shon et al., 2006]
Aaron Shon, Keith Grochow, Aaron Hertzmann, and Rajesh P Rao.
Learning shared latent structure for image synthesis and robotic
In Adv. Neural Info. Proc. Syst., pages 1233–1240, 2006.

[Shu et al., 2017]
Rui Shu, Hung H. Bui, and Mohammad Ghavamzadeh.
Bottleneck conditional density estimation.
In Proc. Int. Conf. Mach. Learn., pages 3164–3172, 2017.

[Sohn et al., 2015]
Kihyuk Sohn, Honglak Lee, and Xinchen Yan.
Learning structured output representation using deep conditional
generative models.
In Adv. Neural Info. Proc. Syst., pages 3483–3491, 2015.

[Suzuki et al., 2016]
Masahiro Suzuki, Kotaro Nakayama, and Yutaka Matsuo.
Joint multimodal learning with deep generative models.
arXiv preprint arXiv:1611.01891, 2016.

[Tishby et al., 1999]
Naftali Tishby, Fernando C Pereira, and William Bialek.
The information bottleneck method.
In Proc. 37th Ann. Allerton Conf. Comm. Control Comput., pages
368–377, 1999.

[Vedantam et al., 2018]
Ramakrishna Vedantam, Ian Fischer, Jonathan Huang, and Kevin Murphy.
Generative models of visually grounded imagination.
In Int. Conf. Learn. Repr., 2018.
URL <https://openreview.net/forum?id=HkCsm6lRb>.

[Wang et al., 2016]
Weiran Wang, Xinchen Yan, Honglak Lee, and Karen Livescu.
Deep variational canonical correlation analysis.
arXiv preprint arXiv:1610.03454, 2016.

[Wyner, 1975]
Aaron Wyner.
The common information of two dependent random variables.
IEEE Trans. Inf. Theory, 210 (2):0 163–179,

[Xu and Raginsky, 2017]
Aolin Xu and Maxim Raginsky.
Information-theoretic analysis of generalization capability of
learning algorithms.
In Adv. Neural Info. Proc. Syst., pages 2524–2533, 2017.

[Zhao et al., 2018]
Shengjia Zhao, Jiaming Song, and Stefano Ermon.
The information autoencoding family: A lagrangian perspective on
latent variable generative models.
In Proc. Uncertain. Artif. Intell., pages 1031–1041, 2018.