RIKEN Center for Computational Science Learning Optimization Platform Development Unit

Unit Leader: Mohamed Wahib (Ph.D.)

Japanese Page

Research Summary

The learning optimization platform development unit is an R-CCS unit focusing on developing AI software infrastructure and models for expanding the use of AI beyond commercial use cases, and into scientific domains. In particular adapting into the scientific requirements of semi-structured multimodal data, complex representations, and attribution. Specifically, we conduct research on next-generation AI systems by focusing on the following topics:

1.Investigate and develop novel optimization methods for scaling generative AI techniques to address complex optimization problems across different science domains. The focus will be on enhancing optimization performance, scalability, and adaptability through the integration of generative AI models.
2.Research, develop, and implement parallel and distributed inference techniques for large language models (LLMs) to enable efficient and scientific applications built on top of LLMs. The focus will be on improving the inference speed, scalability, and resource utilization of LLMs for real-time and large-scale scientific applications.
3.Research, develop, and implement parallel and distributed DNNs to leverage the computational power of modern hardware architectures and accelerate optimization processes. The focus will be on improving scalability, efficiency, and robustness of optimization algorithms for large-scale problems across various domains.

Main Research Fields

Informatics

Keywords

AI-based Science
Infrastrcuture for Foundation Models (training inference)
Generative AI in Science
Integration of AI in Science

Selected Publications

Papers with an asterisk(*) are based on research conducted outside of RIKEN.

1. Enzhi Zhang, Isaac Lyngaas, Peng Chen, Xiao Wang, Jun Igarashi, Yuankai Huo, Masaharu Munetomo, Mohamed Wahib.
"Adaptive Patching for High-resolution Image Segmentation with Transformers"
International Conference for High Performance Computing, Networking, Storage, and Analysis (SC 2024)
2. Du Wu, Jintao Meng, Peng Chen, Mohamed Wahib, Xiao Wang, Minwen Deng, Wenxi Zhu, Luo Tao, Yanjie Wei.
"autoGEMM: Pushing the Limits of Irregular Matrix Multiplication on Arm Architectures"
International Conference for High Performance Computing, Networking, Storage, and Analysis (SC 2024)
3. *Yu Xue, Jiajie Zha, Danilo Pelusi, Peng Chen, Tao Luo, Liangli Zhen, Yan Wang, Mohamed Wahib.
"Neural Architecture Search With Progressive Evaluation and Sub-Population Preservation"
in IEEE Transactions on Evolutionary Computation, doi: 10.1109/TEVC.2024.3393304.(2024)
4. Thao Nguyen Truong, Balazs Gerofi, Edgar Josafat Martinez-Noriega, Francois Trahay, Mohamed Wahib.
"KAKURENBO: Adaptively Hiding Samples in Deep Neural Network Training"
Advances in Neural Information Processing Systems 2023 (NeurIPS 2023)
5. *Huaipeng Zhang, Nhut-Minh Ho, Yigit Polat Dogukan, Peng Chen, Mohamed Wahib, Truong Thao Nguyen, Jintao Meng, Rick Siow Mong Goh, Satoshi Matsuoka, Tao Luo, Weng-Fai Wong.
"Simeuro: A Hybrid CPU-GPU Parallel Simulator for Neuromorphic Computing Chips,"
IEEE Transactions on Parallel and Distributed Systems, volume:34, pp2767-2782 (2023)
6. *Lingqi Zhang, Mohamed Wahib, Chen Peng, Jintao Meng, Xiao Wang, Toshio Endo, Satoshi Matsuoka.
"PERKS:a Locality-Optimized Execution Model for Iterative Memory-bound GPU Applications"
ACM 37th International Confernce on Supercomputing (ACM ICS 2023)
7. *Jintao Meng, Peng Chen, Mingjun Yang, Mohamed Wahib, Yanjie Wei, Shengzhong Feng, Wei Liu,Liangzhen Zheng.
"Boosting the Predictive Performance with Aqueous Solubility Dataset Curation"
Nature Scientific Data, March 2022

Lab Members

Principal investigator

Mohamed Wahib: Unit Leader

Core members

Aleksandr Drozd: Research Scientist
Emil Vatai: Research Scientist
Lingqi Zhang: Postdoctoral Researcher
Joao Eduardo Batista: Postdoctoral Researcher

Careers

Position	Deadline
Seeking a few Senior Scientists, Research Scientists or Postdoctoral Researchers (K24040)	Open until filled

Contact Information

1-4-1 Nihonbashi,
Chuo-ku, Tokyo
103-0027, Japan
Email: mohamed.attia [at] riken.jp