Organization
School of Computing Specially Appointed Associate Professor
Title
Specially Appointed Associate Professor
Contact information
Homepage
External link
WU ERWIN
Research Areas
-
Informatics / Human interface and interaction
-
Informatics / Perceptual information processing
-
Informatics / Intelligent informatics
Education
-
Tokyo Institute of Technology School of Computing Ph.D. of Computer Science
2018.10 - 2022.9
Country： Japan
-
Tokyo Institute of Technology School of Computing Master of Computer Science
2017.9 - 2019.9
Country： Japan
-
Shanghai Jiao Tong University School of Electronic Information and Electrical Engineering Computer Science
2013.9 - 2017.7
Country： China
Research History
-
Institute of Science Tokyo School of Computing Research Associate Professor
2025.6
Country：Japan
-
Keio University Graduate School of Media Design Guest Researcher
2023.6 - 2025.6
Country：Japan
-
Huawei Technologies Japan K.K. Expert Researcher
2023.6 - 2025.5
Country：Japan
-
Carnegie Mellon University Visiting Assistant Professor
2022.11 - 2023.4
Country：United States
-
Tokyo Institute of Technology Research Assistant Professor
2022.9 - 2023.5
Country：Japan
-
Meta FAIR Research Intern
2020.1 - 2020.3
Country：Japan
-
Sony Computer Science Laboratories, Inc. Research Fellow
2019.9 - 2022.9
Country：Japan
Committee Memberships
-
IEEE VR Poster Chair
2025.4
Committee type：Academic society
-
IEEE Transactions on Multimedia Guest Editor
2024.12
Committee type：Academic society
-
ACM CHI Late-Breaking Work Chair
2024.4 - 2025.4
-
International Conference on Machine Vision Applications (MVA) Organizing Committee
2023.1
Committee type：Academic society
Papers
-
DyaDiT: A Multi-Modal Diffusion Transformer for Socially Favorable Dyadic Gesture Generation. Reviewed
Yichen Peng, Jyun-Ting Song, Siyeol Jung, Ruofan Liu 0001, Haiyang Liu, Xuangeng Chu, Ruicong Liu, Erwin Wu, Hideki Koike, Kris Kitani
CVPR abs/2602.23165 2026.2
-
SoleCoach: Sole Pressure and IMU-based MLLMs for Skill Coaching. Reviewed
Toshihiro Hirano, Hitoshi Yoshihara, Yichen Peng, Chen-Chieh Liao, Erwin Wu, Hideki Koike
CHI 1429 - 17 2026
-
From Pose to Muscle: Multimodal Learning for Piano Hand Muscle Electromyography Reviewed
RUOFAN LIU ⋅, YICHEN PENG, Takanori Oku, Chen-Chieh Liao, Erwin Wu, Shinichi Furuya, Hideki Koike
NeurIPS ( 38 ) 115558 - 115587 2025.12
-
SolePoser: Full Body Pose Estimation using a Single Pair of Insole Sensor. Reviewed
Erwin Wu, Rawal Khirodkar, Hideki Koike, Kris Kitani
Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology(UIST) 67 - 9 2024
-
Erwin Wu, Hayato Nishioka, Shinichi Furuya, Hideki Koike
IEEE/CVF Winter Conference on Applications of Computer Vision(WACV) 2976 - 2985 2023
-
Erwin Wu, Takashi Matsumoto, Chen-Chieh Liao, Ruofan Liu 0001, Hidetaka Katsuyama, Yuki Inaba, Noriko Hakamada, Yusuke Yamamoto, Yusuke Ishige, Hideki Koike
Proceedings of the 6th International Workshop on Multimedia Content Analysis in Sports(MMSports@MM) 3 - 8 2023
-
SPinPong - Virtual Reality Table Tennis Skill Acquisition using Visual, Haptic and Temporal Cues. Reviewed
Erwin Wu, Mitski Piekenbrock, Takuto Nakamura, Hideki Koike
IEEE Transactions on Visualization and Computer Graphics 27 ( 5 ) 2566 - 2576 2021
-
Back-Hand-Pose: 3D Hand Pose Estimation for a Wrist-worn Camera via Dorsum Deformation Network. Reviewed
Erwin Wu, Ye Yuan 0007, Hui-Shyong Yeo, Aaron Quigley, Hideki Koike, Kris M. Kitani
UIST '20: The 33rd Annual ACM Symposium on User Interface Software and Technology(UIST) 1147 - 1160 2020
-
VR Alpine Ski Training Augmentation using Visual Cues of Leading Skier. Reviewed
Erwin Wu, Takayuki Nozawa, Florian Perteneder, Hideki Koike
2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition 3836 - 3845 2020
-
VR Ski Coach: Indoor Ski Training System Visualizing Difference from Leading Skier. Reviewed
Takayuki Nozawa, Erwin Wu, Hideki Koike
IEEE Conference on Virtual Reality and 3D User Interfaces(VR) 1341 - 1342 2019
-
Erwin Wu, Hideki Koike
IEEE Winter Conference on Applications of Computer Vision(WACV) 1384 - 1392 2019
-
MuscleGolfAR: Embodied versus Detached Visualization for Motions and Inferred Muscle Activations in Augmented Reality Reviewed
Ruofan Liu, Chen-Chieh Liao, Takuya Takahashi, Yichen Peng, Erwin Wu, Hideki Koike
IEEE Transactions on Visualization and Computer Graphics 2026.5
-
Hitoshi Yoshihara, Toshihiro Hirano, Chen-Chieh Liao, Erwin Wu, Hideki Koike
AHS 672 - 682 2026
-
Kanyu Chen, Rebecca Panskus, Erwin Wu, Yichen Peng, Daichi Saito, Emiko Kamiyama, Ruiteng Li, Chen-Chieh Liao, Karola Marky, Kato Akira, Hideki Koike, Kai Kunze
CHI 1087 - 1107 2026
-
Sakina Watanabe, Chen-Chieh Liao, Erwin Wu, Hideki Koike
AHS 691 - 697 2026
-
An AR-Based Exergame for Supporting Posture Correction in Alpine Skiing. Reviewed
Yuki Tabei, Chen-Chieh Liao, Yichen Peng, Erwin Wu, Hideki Koike
IEEE VR Worshop 588 - 592 2026
-
ElectroEncephaloGraphy Verification of Speed Adaptation in Time-Distortion Ski Training System. Reviewed
Funa Oba, Yichen Peng, Chen-Chieh Liao, Erwin Wu, Natsue Yoshimura, Hideki Koike
IEEE VR Worshop 624 - 628 2026
-
Exploring Foot Pressure Sensing for Avatar Manipulation and for Input Modality in VR. Reviewed
Shino Ito, Yichen Peng, Chen-Chieh Liao, Sakina Watanabe, Erwin Wu, Hideki Koike
IEEE VR Worshop 602 - 605 2026
-
Towards Interactive Intelligence for Digital Humans.
Yiyi Cai, Xuangeng Chu, Xiwei Gao, Sitong Gong, Yifei Huang, Caixin Kang, Kunhang Li, Haiyang Liu, Ruicong Liu, Yun Liu, Dianwen Ng, Zixiong Su, Erwin Wu, Yuhan Wu, Dingkun Yan, Tianyu Yan, Chang Zeng, Bo Zheng, You Zhou
CoRR abs/2512.13674 2025.12
-
SimDiff: Simulator-constrained Diffusion Model for Physically Plausible Motion Generation.
Akihisa Watanabe, Jiawei Ren, Li Siyao, Yichen Peng, Erwin Wu, Edgar Simo-Serra
CoRR abs/2509.20927 2025.9
-
Spatial Audio for Ski Simulation with Visually Impaired Users in Dynamic Environments. Reviewed
Yuta Taguchi, Toshihiro Hirano, Masaki Kuribayashi, Yichen Peng, Erwin Wu, Hideki Koike, Shigeo Morishima
SIGGRAPH Asia Posters 111 - 2 2025
-
ColorizeDiffusion: Improving Reference-Based Sketch Colorization with Latent Diffusion Model. Reviewed
Dingkun Yan, Liang Yuan, Erwin Wu, Yuma Nishioka, Issei Fujishiro, Suguru Saito
IEEE/CVF Winter Conference on Applications of Computer Vision(WACV) 5092 - 5102 2025
-
Ruofan Liu, Yichen Peng, Takanori Oku, Chen-Chieh Liao, Erwin Wu, Shinichi Furuya, Hideki Koike
Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems(CHI) 364 - 16 2025
-
Kanyu Chen, Erwin Wu, Chen-Chieh Liao, Daichi Saito, Yichen Peng, Akira Kato, Hideki Koike, Kai Kunze
UbiComp Companion 155 - 159 2025
-
Shino Ito, Yichen Peng, Erwin Wu, Hideki Koike
AHs 345 - 355 2025
-
Toshihiro Hirano, Yichen Peng, Masaki Kuribayashi, Erwin Wu, Shigeo Morishima, Hideki Koike
AHs 369 - 380 2025
-
An Augmented Reality Exergame for Improving Ski Posture through Gamified Feedback. Reviewed
Yuki Tabei, Chen-Chieh Liao, Yichen Peng, Erwin Wu, Hideki Koike
SIGGRAPH Asia Emerging Technologies 2 - 3 2025
-
Toshihiro Hirano, Yuki Tabei, Yichen Peng, Chen-Chieh Liao, Erwin Wu, Hideki Koike
MMSports@MM 39 - 46 2025
-
A Demonstration of ShiftingGolf: Gross Motor Skill Correction Using Redirection in VR. Reviewed
Chen-Chieh Liao, Ruofan Liu, Yichen Peng, Erwin Wu, Hideki Koike
SIGGRAPH Asia Emerging Technologies 1 - 3 2025
-
Dual-Modal 3D Human Pose Estimation using Insole Foot Pressure Sensors. Reviewed
Erwin Wu, Yichen Peng, Rawal Khirodkar, Hideo Koike, Kris Kitani
IEEE International Symposium on Mixed and Augmented Reality Adjunct(ISMAR-Adjunct) 131 - 135 2024
-
Ruofan Liu, Yichen Peng, Takanori Oku, Erwin Wu, Shinichi Furuya, Hideki Koike
SIGGRAPH Asia 2024 Posters 6 - 2 2024
-
Kanyu Chen, Erwin Wu, Daichi Saito, Yichen Peng, Chen-Chieh Liao, Akira Kato, Hideki Koike, Kai Kunze
IEEE International Symposium on Mixed and Augmented Reality Adjunct(ISMAR-Adjunct) 121 - 125 2024
-
ARpenSki: Augmenting Ski Training with Direct and Indirect Postural Visualization. Reviewed
Takashi Matsumoto, Erwin Wu, Chen-Chieh Liao, Hideki Koike
IEEE Conference Virtual Reality and 3D User Interfaces(VR) 1 - 9 2024
-
Kanyu Chen, Emiko Kamiyama, Ruiteng Li, Yichen Peng, Daichi Saito, Erwin Wu, Hideki Koike, Akira Kato
SIGGRAPH Asia 2024 Posters 113 - 2 2024
-
Ruofan Liu, Erwin Wu, Chen-Chieh Liao, Hayato Nishioka, Shinichi Furuya, Hideki Koike
IEEE International Symposium on Mixed and Augmented Reality(ISMAR) 859 - 868 2023
-
Exploration of Sonification Feedback for People with Visual Impairment to Use Ski Simulator. Reviewed
Yusuke Miura, Erwin Wu, Masaki Kuribayashi, Hideki Koike, Shigeo Morishima
Proceedings of the Augmented Humans International Conference 2023(AHs) 147 - 158 2023
-
AI Coach: A Motor Skill Training System using Motion Discrepancy Detection. Reviewed
Chen-Chieh Liao, Dong-Hyun Hwang, Erwin Wu, Hideki Koike
Proceedings of the Augmented Humans International Conference 2023(AHs) 179 - 189 2023
-
PianoHandSync: An Alignment-based Hand Pose Discrepancy Visualization System for Piano Learning. Reviewed
Ruofan Liu, Erwin Wu, Chen-Chieh Liao, Hayato Nishioka, Shinichi Furuya, Hideki Koike
Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems 228 - 7 2023
-
A Real-time Distance Learning System for Alpine Skiing Using Virtual Reality. Reviewed
Shigeharu Ono, Erwin Wu, Hideaki Kanai, Hideki Koike
IEEE International Conference on Teaching, Assessment and Learning for Engineering(TALE) 1 - 8 2023
-
Hui-Shyong Yeo, Erwin Wu, Daehwa Kim, Juyoung Lee, Hyung-il Kim, Seoyoung Oh, Luna Takagi, Woontack Woo, Hideki Koike, Aaron J. Quigley
Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems(CHI) 530 - 18 2023
-
Temporal and Spatial Distortion for VR Rhythmic Skill Training. Reviewed
Takashi Matsumoto, Erwin Wu, Hideki Koike
SIGGRAPH Asia 2022 Posters 49 - 2 2022
-
SkiSim: A comprehensive Study on Full Body Motion Capture and Real-Time Feedback in VR Ski Training. Reviewed
Jana Hoffard, Xuan Zhang, Erwin Wu, Takuto Nakamura, Hideki Koike
AHs 2022: Augmented Humans 2022(AHs) 131 - 141 2022
-
Context-aware Risk Degree Prediction for Smartphone Zombies. Reviewed
Erwin Wu, Chen-Chieh Liao, Ruofan Liu, Hideki Koike
SIGGRAPH '22: Special Interest Group on Computer Graphics and Interactive Techniques Conference 48 - 2 2022
-
A Study on Sonification Method of Simulator-Based Ski Training for People with Visual Impairment. Reviewed
Yusuke Miura, Masaki Kuribayashi, Erwin Wu, Hideki Koike, Shigeo Morishima
SIGGRAPH Asia 2022 Posters 33 - 2 2022
-
Skiing, Fast and Slow: Evaluation of Time Distortion for VR Ski Training. Reviewed
Takashi Matsumoto, Erwin Wu, Hideki Koike
AHs 2022: Augmented Humans 2022(AHs) 142 - 151 2022
-
Synchronized Hand Difference Visualization for Piano Learning. Reviewed
Ruofan Liu, Erwin Wu, Chen-Chieh Liao, Hayato Nishioka, Shinichi Furuya, Hideki Koike
SIGGRAPH '22: Special Interest Group on Computer Graphics and Interactive Techniques Conference 4 - 2 2022
-
Augmenting VR Ski Training using Time Distortion. Reviewed
Takashi Matsumoto, Erwin Wu, Hideki Koike
2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops 570 - 571 2022
-
A Distance Learning System With Shareable Physical Information For Ski Training. Reviewed
Shigeharu Ono, Hideaki Kanai, Erwin Wu, Hideki Koike
28th ACM Symposium on Virtual Reality Software and Technology(VRST) 36 - 2 2022
-
Using Rhythm Game to Train Rhythmic Motion in Sports. Reviewed
Hidetaka Katsuyama, Erwin Wu, Hideki Koike
SIGGRAPH Asia 2022 Posters 35 - 2 2022
-
CV-Based Analysis for Microscopic Gauze Suturing Training. Reviewed
Mikihito Matsuura, Shio Miyafuji, Erwin Wu, Satoshi Kiyofuji, Taichi Kin, Takeo Igarashi, Hideki Koike
AHs '21: Augmented Humans Conference 2021(AHs) 169 - 173 2021
-
Watch-Your-Skiing: Visualizations for VR Skiing using Real-time Body Tracking. Reviewed
Xuan Zhang, Erwin Wu, Hideki Koike
IEEE International Symposium on Mixed and Augmented Reality Adjunct 387 - 388 2021
-
PushToSki - An Indoor Ski Training System Using Haptic Feedback. Reviewed
Jana Hoffard, Takuto Nakamura, Erwin Wu, Hideki Koike
SIGGRAPH 2021: Special Interest Group on Computer Graphics and Interactive Techniques Conference 15 - 2 2021
-
Takuto Nakamura, Daichi Saito, Erwin Wu, Hideki Koike
SIGGRAPH 2020: Special Interest Group on Computer Graphics and Interactive Techniques Conference 12 - 2 2020
-
FuturePong: Real-time Table Tennis Trajectory Forecasting using Pose Prediction Network. Reviewed
Erwin Wu, Hideki Koike
Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems 1 - 8 2020
-
Hui-Shyong Yeo, Erwin Wu, Juyoung Lee, Aaron Quigley, Hideki Koike
Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology(UIST) 963 - 971 2019
-
How to VizSki: Visualizing Captured Skier Motion in a VR Ski Training Simulator. Reviewed
Erwin Wu, Florian Perteneder, Hideki Koike, Takayuki Nozawa
The 17th International Conference on Virtual-Reality Continuum and its Applications in Industry(VRCAI) 1 - 9 2019
-
Visualizing expert motion for guidance in a VR ski simulator. Reviewed
Takayuki Nozawa, Erwin Wu, Florian Perteneder, Hideki Koike
Special Interest Group on Computer Graphics and Interactive Techniques Conference 64 - 2 2019
-
Real-time Table Tennis Forecasting System based on Long Short-term Pose Prediction Network. Reviewed
Erwin Wu, Florian Perteneder, Hideki Koike
SIGGRAPH Asia 2019 Posters 23 - 2 2019
-
OmniGlobe: An Interactive I/O System For Symmetric 360-Degree Video Communication. Reviewed
Zhengqing Li, Shio Miyafuji, Erwin Wu, Hideaki Kuzuoka, Naomi Yamashita, Hideki Koike
Proceedings of the 2019 on Designing Interactive Systems Conference 1427 - 1438 2019
-
BitoBody: Real-time human contact detection and dynamic projection system. Reviewed
Erwin Wu, Mitski Piekenbrock, Hideki Koike
Proceedings of the 10th Augmented Human International Conference 2019(AH) 39 - 4 2019
-
Real-time Human Motion Forecasting using a RGB Camera. Reviewed
Erwin Wu, Hideki Koike
IEEE Conference on Virtual Reality and 3D User Interfaces(VR) 1575 - 1577 2019
-
Real-time human motion forecasting using a RGB camera. Reviewed
Erwin Wu, Hideki Koike
Proceedings of the 24th ACM Symposium on Virtual Reality Software and Technology(VRST) 118 - 2 2018
-
OmniEyeball: An Interactive I/O Device For 360-Degree Video Communication. Reviewed
Zhengqing Li, Shio Miyafuji, Erwin Wu, Toshiki Sato, Hideaki Kuzuoka, Hideki Koike
Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces(ISS) 429 - 432 2018
MISC
-
PianoSyncAR:拡張現実で同期した手のポーズの差分を視覚化することでピアノ学習を強化
LIU Ruofan, WU Erwin, LIAO Chen-Chieh, 西岡勇人, 古屋晋一, 小池英樹
日本ソフトウェア科学会研究会資料シリーズ(Web) ( 100 ) 2023
-
Visualizing Discrepancy of Hand Postures for Performing Piano
LIU Ruofan, WU Erwin, WU Erwin, LIAO Chen-Chieh, 西岡勇人, 古屋晋一, 小池英樹
日本ソフトウェア科学会研究会資料シリーズ(Web) ( 98 ) 2022
Presentations
-
Keynote Speech of Computer Vision for Winter Sports Invited
Erwin Wu, Hideki Koike
The IEEE/CVF Winter Conference on Applications of Computer Vision (WACV2023) 2023.1
-
PianoSyncAR: Enhancing Piano Learning through Visualizing Synchronized Hand Pose Discrepancies in Augmented Reality Invited
Ruofan Liu, Erwin Wu
WISS 2023 2023.12
-
腕装着型カメラを用いた手の甲の変形から三次元手の姿勢推定ネットワーク Invited
Erwin Wu
第67回東京国際交流館交流研究発表会 2020.8
-
Towards Interactive Intelligence for Digital Humans Invited
Erwin Wu
The 18th ACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia (Siggraph Asia 2025) 2025.12
Awards
-
Best Paper Award Honorable Mention
2026.4 ACM CHI 2026 SoleCoach: Sole Pressure and IMU-based MLLMs for Skill Coaching
Toshihiro Hirano, Hitoshi Yoshihara, Yichen Peng, Chen-Chieh Liao, Erwin Wu, Hideki Koike
-
Best Paper Award Honorable Mention
2026.4 ACM CHI 2026 Sensing Your Vocals: Exploring the Activity of Vocal Cord Muscles for Pitch Assessment Using Electromyography and Ultrasonography
Kanyu Chen, Rebecca Panskus, Erwin Wu, Yichen Peng, Daichi Saito, Emiko Kamiyama, Ruiteng Li, Chen-Chieh Liao, Karola Marky, Kato Akira, Hideki Koike, Kai Kunze
-
2022 AIP Network Director Award
2023.3 JST
Erwin Wu
-
Best Presentation Poster Award
2022.9 JST Marker-removal Network to Collect Precise 3D Hand Data for RGB-based Estimation and its Application in Piano
Erwin Wu
-
Seichi Teijima Research Award
2022.8 Tokyo Institute of Technology
Erwin Wu
-
2021 AIP Network Director Award
2022.3 JST
Erwin Wu
-
Best Demo Award
2019.4 IEEE VR VR Ski Coach: Indoor Ski Training System Visualizing Difference from Leading Skier
Takayuki Nozawa, Erwin Wu, Hideki Koike
-
Best Poster Award Honorable Mentions
2018.12 ACM VRST Real-time Human Motion Forecasting using a RGB Camera
Erwin Wu, Hideki Koike
-
Best Graduates Award in FY2017
2017.6 Shanghai Jiao Tong University
Research Projects
-
マルチモーダル情報からの人間姿勢推定と技能習得への応用
Grant number：26K21270 2026.4 - 2029.3
日本学術振興会 科学研究費助成事業 若手研究
WU ERWIN
Grant amount：\4550000 （ Direct Cost: \3500000 、 Indirect Cost：\1050000 ）
-
2024 - 2029
科学技術振興機構 戦略的な研究開発の推進 戦略的創造研究推進事業 CRONOS(情報通信科学・イノベーション創出基盤事業)
古屋 晋一
Authorship：Collaborating Investigator(s) (not designated on Grant-in-Aid)
本研究は、身体運動学・情報学・認知神経科学を融合し、新たな技能通信技術を創出することで、遠隔地間での人から人への技能の伝達の実現に挑戦します。そのため,(1)コモディティセンサを用いた技能情報の推定、(2)技能習得支援技術の創出、(3)技能の帰還による指導の質の向上に取り組みます。技能の民主化と共進化を促進し、教育格差の解消や、災害やパンデミックにレジリエントな社会の実現、無形文化財である身体技能の持続可能な発展を目指します。
-
Using Insole Pressure Sensor for Full Body Pose Estimation and its Application in Skiing
2022.4 - 2023.4
JST AIP Challenge
Erwin Wu
Authorship：Principal investigator
-
Deep Learning-based Real-time 3D Human Pose Forecasting and its Application on Sports
Grant number：20J20197 2020.4 - 2023.3
Japan Society for the Promotion of Science Grants-in-Aid for Scientific Research Grant-in-Aid for JSPS Fellows
-
Deep Learning-based Risk Prediction using Ultra-wide Camera
2020.4 - 2021.4
JST AIP Challenge
Authorship：Principal investigator