Projects

Artificial intelligence (AI) clones could serve as a new interface for scientific communication between publishers and research communities. At a Nature conference in Seoul, multimodal AI clones — including one of the Chief Editor of Nature Sensors — engaged researchers in real-time dialogue about publishing and careers, in three different languages. At an event held on 13…

The collaboration project with Shutaro Aoyama, Kiyoshi Suganuma, and the National Museum of Emerging Science and Innovation (MIraikna) Abstract AI Clones (AICs) hold promise for augmenting communication, yet most AICs remain static snapshots that drift out of sync with their evolving source users. Iterative refinement of behavior descriptions offers a potential mechanism for improvement: users review…

Resonance of Intentions with an Embodied Agent based on the Free Energy Principle The collaboration project with the leading author, Takeru Hashimoto and Jun Tani (Okinawa Institute of Science and Technology) Abstract Physical joint action shapes a sense of partnership by enabling individuals to negotiate intentions through mutual coordination. However, conventional physical agents typically rely…

Conversational Agents on Your Behalf: Opportunities and Challenges of Shared Autonomy in Voice Communication for Multitasking The collaboration project with the leading author, a Sony CSL Summer Intern, Yi Fei Cheng (Carnegie Mellon University), and Hirokazu Shirado (Carnegie Mellon University) Abstract Advancements in computational agents will enable them to act as surrogates for users in…

The study explores how realism and AI assistance impact interpersonal coordination. While realism promotes collaboration, AI tends to encourage self-interest, overshadowing the benefits of social interaction.

AgiLimb: Embodied Agile Robotic Arm by Integrating Digital Reflex and Seamless Action Takeover The collaboration project with the leading lab of Ryuma Niiyama, Yusuke Kawashima and Yoshiaki Abe (Meiji Univ.) and Takeru Hashimoto (Sony CSL). Abstract Performing sports skills with a human-operated robot is a challenging task. The key to human-robot-human (HRH) interaction is to…

Control over self and others’ face: Exploitation and exploration The collaboration project with Wen Wen, Hakan Aktaş, Jie Mei, Acer Chang, Yosuke Suzuishi. Abstract The face serves as a crucial cue for self-identification, while the sense of agency plays a significant role in determining our influence through actions in the environment. The current study investigates how self-identification through facial…

Investigating the impact of motion visual synchrony on self-face recognition using real-time morphing Abstract Face recognition is a crucial aspect of self-image and social interactions. Previous studies have focused on static images to explore the boundary of self-face recognition. Our research, however, investigates the dynamics of face recognition in contexts involving motor-visual synchrony. We first…

Emergence and collapse of reciprocity in semiautomatic driving coordination experiments with humans The collaboration project with the lead author Hirokazu Shirado (CMU) and Christakis, N (Yale University). Abstract Forms of both simple and complex machine intelligence are increasingly acting within human groups in order to affect collective outcomes. Considering the nature of collective action problems,…

Morphing Identity: Exploring Self-Other Identity Continuum through Interpersonal Facial Morphing Experience We explored continuous changes in self-other identity by designing an interpersonal facial morphing experience where the facial images of two users are blended and then swapped over time. Both users’ facial images are displayed side by side, with each user controlling their own morphing…