Seamless Interaction in Multi-Display Environment

E-conic: a perspective-aware interface for multi-display environments

We developed a perspective aware Multi-Display Environments (MDE) system that automatically corrects the point of view distortion, allowing users to interact with multiple displays as if they were in front of an ordinary desktop GUI environment. This system also allows the users to easily create a seamlessly connected workspace by gathering multiple different displays and three dimensionally arranging them at various angles and positions. Our system makes use of two basic features: perspective windows and perspective cursor, in order to achieve a seamlessly connected MDE. These functions allow the system to dynamically change, according to the point of view of the user, the way the contents are shown on the displays, and as such both require knowledge of the relative positions between the displays and the user. For this, we measure and store in the system the position of the displays, and track the position of the user in real-time using a 3D position tracking system.

Interactions using a Portable Projector in MDEs

This work proposes using a portable projector in order to create a movable new image within a perspective corrected MDE. This allows the users to seamlessly extend the main workspace and to adapt it to the current task in real time, creating an even more flexible environment. In this system the users can employ the projector to fill in any gaps between the displays, allowing for a true seamless multi-display experience, which can be very useful if they are browsing contents that spread over multiple displays (like a spreadsheet, or a graph) that are physically distant.

Publication

International

  • Chernicharo, J. H. d. S., Takashima, K., and Kitamura, Y. Seamless interaction using a portable projector in perspective corrected multi display environments;
    Proceedings of the 1st symposium on Spatial user interaction (SUI), pp.25-32, Jul. 2013. [PDF]
  • Miguel A. Nacenta, Satoshi Sakurai, Tokuo Yamaguchi, Yohei Miki, Yuichi Itoh, Yoshifumi Kitamura, Sriram Subramanian, Carl Gutwin:E-conic: a Perspective-Aware Interface for Multi-Display Environments; Proceedings of ACM symposium on User Interface Software and Technology (UIST), pp.279-288, Oct. 2007. [PDF]
  • Satoshi Sakurai, Yuichi Itoh, Yoshifumi Kitamura, Miguel A. Nacenta, Tokuo Yamaguchi, Sriram Subramanian, Fumio Kishino:A Middleware for Seamless Use of Multiple Displays;
    Proceedings of International Workshop on Design, Specification, and Verification of Interactive Systems (DSV-IS 2008),Springer LNCS 5136, pp. 252-266, Jul. 2008
  • Ryo Fukazawa, Kazuki Takashima, Garth Shoemaker, Yoshifumi Kitamura, Yuichi Itoh, Fumio Kishino: Comparison of Multimodal Interactions in Perspective-corrected Multi-display Environment,
    Proceedings of IEEE Symposium on 3D User Interfaces (3DUI), pp. 103-110, Mar. 2010. 

Domestic

  • 山口徳郎, Miguel A. Nacenta, 櫻井智史, 伊藤雄一, 北村喜文, Sriram Subramanian, Carl Gutwin, 岸野文郎: 利用者とディスプレイの位置関係を考慮したパースペクティブ表示; 電子情報通信学会論文誌, Vol. J91-D, No. 12, サイバーワールド論文特集, pp. 2746-2754, Dec. 2008. 
  • 櫻井智史, 北村喜文, 伊藤雄一, Miguel A. Nacenta, Sriram Subramanian, 岸野文郎:複数のディスプレイをシームレスに利用する環境の構築;日本バーチャルリアリティ学会論文誌, Vol. 13, No. 4, pp. 451-460, Dec. 2008.
  • 深澤遼, 山口徳郎, 櫻井智史, 北村喜文, 岸野文郎: 複数ディスプレイ環境におけるマルチモーダルインタフェース M2; ヒューマンインタフェースシンポジウム2008論文集, pp. 531-534, Sep. 2008. [優秀プレゼンテーション賞 受賞]