JackIn: Integrating First-Person View with Out-of-Body Vision Generation for Human-Human Augmentation
Shunichi Kasahara and Jun Rekimoto
ACM Augmented Human 2014 · Best Presentation Award
A joint project of Sony CSL and the University of Tokyo, 2014.
JackIn Eye is a new human-human communication framework for connecting two or more people. With first-person view video streaming from a person (called Body) wearing a transparent head-mounted display and a head-mounted camera, the other person (called Ghost) participates in the shared 1st-person view. With JackIn, people’s activities can be shared and assistance or guidance can be given through other peoples expertise. This can be applied to daily activities such as cooking lessons, shopping navigation, education in craftwork or electrical work, and sharing experiences of sporting and live events. For a better viewing experience with 1st-person view, we developed the out-of-body view in which 1st-person images are integrated to construct a scene around a Body, and a Ghost can virtually control the viewpoint to look around the space surrounding the Body. We also developed a tele-pointing gesture interface. We conducted an experiment to evaluate how effective this framework is and found that Ghosts can understand the spatial situation of the Body.
The out-of-body view uses SLAM to model the space from a sequence of first-person images. This lets the Ghost follow the Body while observing the environment from an independent viewpoint, addressing the motion-sickness problem associated with first-person video. We also propose a visualization technique for pointing at objects outside the Body’s field of view.
Link : Rekimoto Lab Tokyo Univ. https://lab.rekimoto.org/projects/jackineye/
Reference
Shunichi Kasahara and Jun Rekimoto. 2014. JackIn: Integrating First-Person View with Out-of-Body Vision Generation for Human-Human Augmentation. In Proceedings of the 5th Augmented Human International Conference (AH ’14). Association for Computing Machinery, New York, NY, USA, 1–8. https://doi.org/10.1145/2582051.2582097
BibTeX
@inproceedings{10.1145/2582051.2582097,
author = {Kasahara, Shunichi and Rekimoto, Jun},
title = {JackIn: Integrating First-Person View with Out-of-Body Vision Generation for Human-Human Augmentation},
booktitle = {Proceedings of the 5th Augmented Human International Conference},
series = {AH '14},
year = {2014},
pages = {1--8},
publisher = {Association for Computing Machinery},
address = {New York, NY, USA},
doi = {10.1145/2582051.2582097}
}- 笠原 俊一, 暦本 純一, JackIn: 一人称視点と体外離脱視点を融合した人間-人間オーグメンテーションの枠組み,情報処理学会インタラクション2014 ベストペーパー賞/ベストインタラクティブ発表賞
