RIKEN Center for Advanced Intelligence Project Approximate Bayesian Inference Team
Team Leader: Mohammad Emtiyaz Khan (Ph.D.)
Humans, animals, and other living beings have a natural ability to autonomously learn throughout their lives and quickly adapt to their surroundings, but AI lack such abilities. Our goal is to bridge such gaps between the learning of living-beings and AI. We are machine learning researchers with an expertise in areas such as approximate inference, Bayesian statistics, continuous optimization, information geometry etc. We work on a variety of learning problems, especially those involving supervised, continual, active, federated, online, and reinforcement learning. Currently, we are developing algorithms which enable computers to autonomously learn to perceive, act, and reason throughout their lives.
Main Research Fields
- Computer Science
- Machine Learning
- Artificial Intelligence
Pan, P., Swaroop, S., Immer, A., Eschenhagen, R., Turner, R. and Khan, M. E.
"Continual deep learning by functional regularization of the memorable past"
Advances in Neural Information Processing Systems, to appear (2020).
Alquier, P. and Ridgway, J.
"Concentration of tempered posteriors and of their variational approximations"
Annals of Statistics, 48(3), pp. 1375-1497 (2020).
Tomasev, N. et al.
"AI For social good: unlocking the opportunity for positive impact"
Nature communications, 11, 2468 (2020).
Meng, X., Bachmann, R. and Khan, M. E.
"Training binary neural networks using the Bayesian Learning rule"
Proceedings of the 37th International Conference on Machine Learning, PMLR 119, pp. 6852-6861, (2020).
Chérief-Abdellatif, B.-E. and Alquier, P.
"MMD-Bayes: Bayesian estimation with Maximum Mean Discrepancy"
Proceedings of The 2nd Symposium on Advances in Approximate Bayesian Inference, PMLR 118, pp. 1-21 (2020).
Osawa, K., Swaroop, S., Khan, M. E., Jain, A., Eschenhagen, R., Turner, R. E. and Yokota, R.
"Practical Deep Learning with Bayesian Principles"
Advances in Neural Information Processing Systems 32, pp. 4287–4299 (2019).
Khan, M. E., Immer, A., Abedi, E. and Korzepa, M.
"Approximate Inference Turns Deep Networks into Gaussian Processes"
Advances in Neural Information Processing Systems 32, pp. 3094–3104 (2019).
Chérief-Abdellatif, B.-E., Alquier, P. and Khan, M. E.
"A Generalization Bound for Online Variational Inference"
Proceedings of The 11th Asian Conference on Machine Learning, PMLR 101, pp. 662-677 (2019).
Lin, W., Khan, M. E. and Schmidt, M.
"Fast and Simple Natural-Gradient Variational Inference with Mixture of Exponential-family Approximations"
Proceedings of the 36th International Conference on Machine Learning, PMLR 97, pp. 3992-4002 (2019).
Khan, M. E. and Lin, W.
"Conjugate-Computation Variational Inference : Converting Variational Inference in Non-Conjugate Models to Inferences in Conjugate Models"
Proceedings of the 20th International Conference on Artificial Intelligence and Statistics, PMLR 54, pp. 878-887 (2017).
- Mohammad Emtiyaz Khan
- Team Leader
- Pierre Alquier
- Research Scientist
- Gian Maria Marconi
- Postdoctoral Researcher
- Thomas Moellenhoff
- Postdoctoral Researcher
- Peter Georg Nickl
- Technical Staff I
Nihonbashi 1-chome Mitsui Building, 15th floor,
Email: emtiyaz.khan [at] riken.jp