{"id":1682,"date":"2021-11-10T18:00:54","date_gmt":"2021-11-10T09:00:54","guid":{"rendered":"https:\/\/www.icd.riec.tohoku.ac.jp\/en\/?page_id=1682"},"modified":"2021-11-26T14:32:46","modified_gmt":"2021-11-26T05:32:46","slug":"magnetic-tracking-system-for-dexterous-3d-interaction-and-motion","status":"publish","type":"page","link":"https:\/\/www.icd.riec.tohoku.ac.jp\/en\/research\/projects\/magnetic-tracking-system-for-dexterous-3d-interaction-and-motion\/","title":{"rendered":"Magnetic Tracking System for Dexterous 3D Interaction and Motion"},"content":{"rendered":"\n<h1><strong><strong>Magnetic Tracking System for Dexterous 3D Interaction and Motion<\/strong><\/strong><\/h1>\n\n\n\n<div class=\"is-layout-flex wp-container-3 wp-block-columns\">\n<div class=\"is-layout-flow wp-block-column\">\n<p>We are developing a novel approach to reconstructing 3D motion data from a magnetic flux sensor array using deep learning. Computing the 3D configuration of markers (inductor-capacitor (LC) coils) from flux sensor data is achieved by using deep neural networks to learn the regression from the simulation flux values to the LC coils&#8217; 3D configuration, which can be applied to the actual LC coils at any location and orientation within the capture volume.&nbsp; Our method can track various movements, including fingers that manipulate objects, beetles that move inside a vivarium with leaves and soil, and the flow of opaque fluid. Since no power supply is needed for the lightweight wireless markers, our method can robustly track movements for a very long time, making it suitable for various types of observations whose tracking is difficult with existing motion-tracking systems.<\/p>\n<\/div>\n\n\n\n<div class=\"is-layout-flow wp-block-column\">\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" loading=\"lazy\" width=\"1024\" height=\"789\" src=\"https:\/\/www.icd.riec.tohoku.ac.jp\/en\/wp-content\/uploads\/sites\/3\/imxd-thumb-1024x789.jpg\" alt=\"\" class=\"wp-image-1172\" srcset=\"https:\/\/www.icd.riec.tohoku.ac.jp\/en\/wp-content\/uploads\/sites\/3\/imxd-thumb-1024x789.jpg 1024w, https:\/\/www.icd.riec.tohoku.ac.jp\/en\/wp-content\/uploads\/sites\/3\/imxd-thumb-300x231.jpg 300w, https:\/\/www.icd.riec.tohoku.ac.jp\/en\/wp-content\/uploads\/sites\/3\/imxd-thumb-768x592.jpg 768w, https:\/\/www.icd.riec.tohoku.ac.jp\/en\/wp-content\/uploads\/sites\/3\/imxd-thumb.jpg 1208w\" sizes=\"(max-width: 1024px) 100vw, 1024px\" \/><\/figure>\n\n\n\n<figure class=\"wp-block-image size-large\"><img decoding=\"async\" loading=\"lazy\" width=\"738\" height=\"425\" src=\"https:\/\/www.icd.riec.tohoku.ac.jp\/en\/wp-content\/uploads\/sites\/3\/abstract\uff08\u5c0f\u3055\u3044\uff09-2.jpg\" alt=\"\" class=\"wp-image-1680\" srcset=\"https:\/\/www.icd.riec.tohoku.ac.jp\/en\/wp-content\/uploads\/sites\/3\/abstract\uff08\u5c0f\u3055\u3044\uff09-2.jpg 738w, https:\/\/www.icd.riec.tohoku.ac.jp\/en\/wp-content\/uploads\/sites\/3\/abstract\uff08\u5c0f\u3055\u3044\uff09-2-300x173.jpg 300w\" sizes=\"(max-width: 738px) 100vw, 738px\" \/><\/figure>\n\n\n\n<p><\/p>\n<\/div>\n<\/div>\n\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<div class=\"jetpack-video-wrapper\"><span class=\"embed-youtube\" style=\"text-align:center; display: block;\"><iframe class='youtube-player' width='1170' height='659' src='https:\/\/www.youtube.com\/embed\/knoN38vQOJo?version=3&#038;rel=1&#038;showsearch=0&#038;showinfo=1&#038;iv_load_policy=1&#038;fs=1&#038;hl=ja&#038;autohide=2&#038;wmode=transparent' allowfullscreen='true' style='border:0;' sandbox='allow-scripts allow-same-origin allow-popups allow-presentation'><\/iframe><\/span><\/div>\n<\/div><\/figure>\n\n\n\n<figure class=\"wp-block-embed-youtube wp-block-embed is-type-video is-provider-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<div class=\"jetpack-video-wrapper\"><span class=\"embed-youtube\" style=\"text-align:center; display: block;\"><iframe class='youtube-player' width='1170' height='659' src='https:\/\/www.youtube.com\/embed\/SWaZRTGrFfk?version=3&#038;rel=1&#038;showsearch=0&#038;showinfo=1&#038;iv_load_policy=1&#038;fs=1&#038;hl=ja&#038;autohide=2&#038;wmode=transparent' allowfullscreen='true' style='border:0;' sandbox='allow-scripts allow-same-origin allow-popups allow-presentation'><\/iframe><\/span><\/div>\n<\/div><\/figure>\n\n\n\n<hr class=\"wp-block-separator\"\/>\n\n\n\n<h3>Publications<\/h3>\n\n\n\n<h4>International<\/h4>\n\n\n\n<ul><li>Jiawei Huang, Mori Tsuyoshi, Kazuki Takashima, Shuichiro Hashi, Yoshifumi Kitamura:&nbsp;<br>IM6D: Magnetic Tracking System with 6-DOF Passive Markers for Dexterous 3D Interaction and Motion<br>ACM Transactions on Graphics (TOG), Volume 34, Issue 6 (Proceedings of ACM SIGGRAPH Asia), pp. 217:1-217:10, November 2015. <a href=\"http:\/\/dl.acm.org\/citation.cfm?id=2818135\">[PDF]<\/a><br><strong>(This paper has been selected and listed on the top page of the <a href=\"http:\/\/www.siggraph.org\/\">ACM SIGGRAPH website<\/a> as one of the three papers that they feel might be of particular interest to SIGGRAPH members (April 1st &#8211; July 25th, 2016).)<\/strong><\/li><li>Jiawei Huang, Mori Tsuyoshi, Kazuki Takashima, Shuichiro Hashi, Yoshifumi Kitamura:&nbsp;<br>6-DOF Computation and Marker Design for Magnetic 3D Dexterous Motion-Tracking System<br>ACM Symposium on Virtual Reality Software and Technology (VRST), pp. 211-217, November 2016.<\/li><li>Jiawei Huang, Ryo Sugawara, Kinfung Chu, Taku Komura, and Yoshifumi Kitamura, <br>&#8220;Reconstruction of Dexterous 3D Motion Data from a Flexible Magnetic Sensor with Deep Learning and Structure-Aware Filtering,&#8221;<br>IEEE Transactions on Visualization and Computer Graphics (2020)<br><a href=\"https:\/\/ieeexplore.ieee.org\/document\/9226608\" data-type=\"URL\" data-id=\"https:\/\/ieeexplore.ieee.org\/document\/9226608\" target=\"_blank\" rel=\"noreferrer noopener\">[PDF]<\/a> <a href=\"https:\/\/www.tohoku.ac.jp\/japanese\/2020\/11\/press20201106-02-3d.html\" data-type=\"URL\" data-id=\"https:\/\/www.tohoku.ac.jp\/japanese\/2020\/11\/press20201106-02-3d.html\" target=\"_blank\" rel=\"noreferrer noopener\">[Press Release]<\/a><\/li><\/ul>\n\n\n\n<h4>Invited Talk<\/h4>\n\n\n\n<ul><li>\u9ec4 \u4f73\u7dad, \u68ee \u5065, \u9ad8\u5d8b \u548c\u6bc5, \u67a6 \u4fee\u4e00\u90ce, \u5317\u6751 \u559c\u6587: <br>\u8907\u96d1\u306a3D\u30a4\u30f3\u30bf\u30e9\u30af\u30b7\u30e7\u30f3\u3068\u30e2\u30fc\u30b7\u30e7\u30f3\u306e\u305f\u3081\u306e6\u81ea\u7531\u5ea6\u30d1\u30c3\u30b7\u30d6\u30de\u30fc\u30ab\u306b\u3088\u308b\u78c1\u6c17\u5f0f\u30c8\u30e9\u30c3\u30ad\u30f3\u30b0\u30b7\u30b9\u30c6\u30e0<br>\u60c5\u5831\u51e6\u7406\u5b66\u4f1a\u7814\u7a76\u5831\u544a \u30b0\u30e9\u30d5\u30a3\u30af\u30b9\u3068CAD (CG), 2015-CG-161, 8. SIGGRAPH ASIA\u62db\u5f85\u8b1b\u6f14\u30bb\u30c3\u30b7\u30e7\u30f3\uff0c2015\u5e7411\u67086\u65e5\uff0c\u795e\u6238 <a href=\"http:\/\/id.nii.ac.jp\/1001\/00145547\/\">[PDF]<\/a><\/li><\/ul>\n\n\n\n<h4>Demonstrations<\/h4>\n\n\n\n<ul><li>Jiawei Huang, Kazuki Takashima, Shuichiro Hashi, Yoshifumi Kitamura:<br>IM3D: Magnetic Motion Tracking System for Dexterous 3D Interactions<br>SIGGRAPH 2014 Emerging Technologies, Vancouver, Canada. <a href=\"http:\/\/s2014.siggraph.org\/attendees\/emerging-technologies\/events\/im3d-magnetic-motion-tracking-system-dexterous-3d.html\">[INFO]<\/a><\/li><\/ul>\n","protected":false},"excerpt":{"rendered":"<p>Magnetic Tracking System for Dexterous 3D Interaction and Motion We are developing a novel approach to reconst [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"parent":933,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"templates\/page-full-width.php","meta":[],"_links":{"self":[{"href":"https:\/\/www.icd.riec.tohoku.ac.jp\/en\/wp-json\/wp\/v2\/pages\/1682"}],"collection":[{"href":"https:\/\/www.icd.riec.tohoku.ac.jp\/en\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.icd.riec.tohoku.ac.jp\/en\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.icd.riec.tohoku.ac.jp\/en\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.icd.riec.tohoku.ac.jp\/en\/wp-json\/wp\/v2\/comments?post=1682"}],"version-history":[{"count":7,"href":"https:\/\/www.icd.riec.tohoku.ac.jp\/en\/wp-json\/wp\/v2\/pages\/1682\/revisions"}],"predecessor-version":[{"id":2014,"href":"https:\/\/www.icd.riec.tohoku.ac.jp\/en\/wp-json\/wp\/v2\/pages\/1682\/revisions\/2014"}],"up":[{"embeddable":true,"href":"https:\/\/www.icd.riec.tohoku.ac.jp\/en\/wp-json\/wp\/v2\/pages\/933"}],"wp:attachment":[{"href":"https:\/\/www.icd.riec.tohoku.ac.jp\/en\/wp-json\/wp\/v2\/media?parent=1682"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}