1. Home
  2. Research
  3. Centers & Labs
  4. RIKEN Information R&D and Strategy Headquarters
  5. Guardian Robot Project

RIKEN Information R&D and Strategy Headquarters Knowledge Acquisition and Dialogue Research Team

Team Director: Koichiro Yoshino (Ph.D.)

Research Summary

Koichiro Yoshino (Ph.D.)

Communication through language is an essential tool for robots to cooperate with users in daily lives. This research team focuses on modeling intention estimation, thinking, and inference on verbal and non-verbal communications. We are working on the following topics:

  • 1.action management of dialogue robots
  • 2.spoken dialogue related technologies
  • 3.modeling thinking, inference, and topic selection of robots
  • 4.knowledge expressions grounded on robot behaviors and dialogue contents
  • 5.incorporating emotion and language information
  • 6.empathy, emotion, and trust in dialogue

Main Research Fields

  • Complex Systems

Related Research Fields

  • Engineering
  • Informatics
  • Interdisciplinary Science & Engineering
  • Human informatics – Intelligent informatics
  • Human informatics – Perceptual information processing
  • Human informatics – Intelligent robotics

Keywords

  • Spoken Language Processing (Recognition and Dialogue)
  • Natural Language Processing (Understanding, Generation)
  • Multimodal Information Processing
  • Intelligent Robot Dialogue
  • Machine Learning (Reinforcement Learning, Quantum Machine Learning)

Selected Publications

Papers with an asterisk(*) are based on research conducted outside of RIKEN.

  • 1. Takuma Miwa, Yusuke Oda, Seiya Kawano, Koichiro Yoshino
    "Efficient Channel Generation for QCNN based on Multi-Pauli Matrices"
    In Proceedings of International Conference on Quantum Communications, Networking, and Computing (QCNC), Nara, Japan, March 2025.
  • 2. Kai Yoshida, Masahiro Mizukami, Seiya Kawano, Canasai Kruenkrai, Hiroaki Sugiyama, Koichiro Yoshino
    "Training Dialogue Systems by AI Feedback for Improving Overall Dialogue Impression"
    In Proceedings of the 50th IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP), Hyderabad, India, April 2025.
  • 3. Muhammad Baihaqi, Angel Garcia Contreras, Seiya Kawano, Koichiro Yoshino
    "Rapport-Driven Virtual Agent: Rapport Building Dialogue Strategy for Improving User Experience at First Meeting"
    In Proceedings of the 25th Interspeech Conference (INTERSPEECH), Kos, Greece, September 2024.
  • 4. Shun Inadumi, Seiya Kawano, Akishige Yuguchi, Yasutomo Kawanishi, Koichiro Yoshino
    "A Gaze-grounded Visual Question Answering Dataset for Clarifying Ambiguous Questions"
    In Proceedings of The 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING), Torino, Italy, May 2024.
  • 5. Nobuhiro Ueda, Hideko Habe, Yoko Matsui, Akishige Yuguchi, Seiya Kawano, Yasutomo Kawanishi, Sadao Kurohashi, Koichiro Yoshino
    "J-CRe3: A Japanese Conversation Dataset for Real-world Reference Resolution"
    In Proceedings of The 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING), Torino, Italy, May 2024.
  • 6. Shang-Chi Tsai, Seiya Kawano, Angel Garcia Contreras, Koichiro Yoshino, Yun-Nung Chen
    "ASMR: Augmenting Life Scenario using Large Generative Models for Robotic Action Reflection"
    In Proceedings of International Workshop on Spoken Dialogue Systems Technology (IWSDS) 2024, Sapporo, Japan, March. 2024, Best Paper Award.
  • 7. Shohei Tanaka, Konosuke Yamasaki, Akishige Yuguchi, Seiya Kawano, Satoshi Nakamura, Koichiro Yoshino.
    "Do as I Demand, Not as I Say: A Dataset for Developing a Reflective Life Support Robot."
    IEEE Access, Vol. 12, pp.11774-11784, January 2024.
  • 8. Koichiro Yoshino, Yun-Nung Chen, Paul Crook, Satwik Kottur, Jinchao Li, Behnam Hedayatnia, Seungwhan Moon, Zhengcong Fei, Zekang Li, Jinchao Zhang, Yang Feng, Jie Zhou, Seokhwan Kim, Yang Liu, Di Jin, Alexandros Papangelis, Karthik Gopalakrishnan, Dilek Hakkani-Tur, Babak Damavandi, Alborz Geramifard, Chiori Hori, Ankit Shah, Chen Zhang, Haizhou Li, João Sedoc, Luis F. D'Haro, Rafael Banchs and Alexander Rudnicky.
    "Overview of the Tenth Dialog System Technology Challenge: DSTC10"
    IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP), Vol. 32, pp.765-768, July 2023
  • 9. Taiki Nakamura, Seiya Kawano, Akishige Yuguchi, Yasutomo Kawanishi and Koichiro Yoshino
    "Operative Action Captioning for Estimating System Actions"
    In Proceedings of 2023 IEEE International Conference on Robotics and Automation (ICRA2023), London, UK, May 2023.
  • 10. Seiya Kawano, Masahiro Mizukami, Koichiro Yoshino and Satoshi Nakamura
    "Entrainable Neural Conversation Model based on Reinforcement Learning"
    IEEE Access, Vol.8, pp.178283-178294, September 2020.

Lab Members

Principal investigator

Koichiro Yoshino
Team Director

Core members

Canasai Kruengkrai
Research Scientist
Angel Fernando Garcia Contreras
Postdoctoral Researcher
Hideko Habe
Technical Staff I
Yoko Matsui
Technical Staff I
Shun Inazumi
Junior Research Associate
Kazuyo Onishi
Junior Research Associate
Hyuga Nakaguro
Junior Research Associate

Contact Information

3rd Floor, Advanced Telecommunications Research Institute International
2-2-2 Hikaridai Seika-cho, Sorakugun, Kyoto
619-0288 Japan (Kansai Science City)
Tel：+81-(0)774-95-1360
Email: koichiro.yoshino@riken.jp

Top