Faculty Profiles - PENG YICHEN

写真a

PENG YICHEN

Organization

School of Computing Specially Appointed Junior Associate Professor

Contact information

Homepage

http://puckikk1202.github.io/

External link

Degree

Ph.D (Information Science) ( 2024.3 Japan Advanced Institute of Science and Technology )
Master (Knowledge Science) ( 2021.3 Japan Advanced Institute of Science and Technology )
Bachelor’s degree ( Guangdong University of Technology )

Research Areas

Informatics / Human interface and interaction
Informatics / Intelligent informatics / Generative Model
Informatics / Perceptual information processing / Embodied AI

Education

Japan Advanced Institute of Science and Technology School of Information Science

2021.4 - 2024.3

　 More details

researchmap
Japan Advanced Institute of Science and Technology School of Knowledge Science

2018.10 - 2021.3

　 More details

Country： Japan

researchmap
Vellore Institute of Technology Computer Science

2013.6 - 2017.10

　 More details

Country： India

researchmap
Guangdong University of Technology Media Design

2013.9 - 2017.6

　 More details

Country： China

researchmap

Research History

Carnegie Mellon University Robotics Institute Visiting Researcher

2025.8 - 2025.12

　 More details

researchmap
Keio University Keio Media Design Visiting Researcher

2025.7 - 2026.3

　 More details

researchmap
Institute of Science Tokyo School of Computing Research Assistant Professor

2024.12

　 More details

researchmap
Institute of Science Tokyo School of Computing Postdoctoral Research Fellow

2024.4 - 2024.12

　 More details

researchmap

Papers

MuscleGolfAR: Embodied versus Detached Visualization for Motions and Inferred Muscle Activations in Augmented Reality

Ruofan Liu, Chen-Chieh Liao, Takuya Takahashi, Yichen Peng, Erwin Wu, Hideki Koike

IEEE Transactions on Visualization and Computer Graphics 2026.5

　More details

Publishing type：Research paper (scientific journal)

DOI： 10.1109/TVCG.2026.3680749

researchmap
Sensing Your Vocals: Exploring the Activity of Vocal Cord Muscles for Pitch Assessment Using Electromyography and Ultrasonography.

Kanyu Chen, Rebecca Panskus, Erwin Wu, Yichen Peng, Daichi Saito, Emiko Kamiyama, Ruiteng Li, Chen-Chieh Liao, Karola Marky, Akira Kato, Hideki Koike, Kai Kunze

CoRR abs/2603.19698 2026.3

　More details

Publishing type：Research paper (scientific journal)

DOI： 10.48550/arXiv.2603.19698

researchmap
DyaDiT: A Multi-Modal Diffusion Transformer for Socially Favorable Dyadic Gesture Generation.

Yichen Peng, Jyun-Ting Song, Siyeol Jung, Ruofan Liu 0001, Haiyang Liu, Xuangeng Chu, Ruicong Liu, Erwin Wu, Hideki Koike, Kris Kitani

CoRR abs/2602.23165 2026.2

　More details

Publishing type：Research paper (scientific journal)

DOI： 10.48550/arXiv.2602.23165

researchmap
SoleCoach: Sole Pressure and IMU-based MLLMs for Skill Coaching.

Toshihiro Hirano, Hitoshi Yoshihara, Yichen Peng, Chen-Chieh Liao, Erwin Wu, Hideki Koike

CHI 1429 - 17 2026

　More details

Publishing type：Research paper (international conference proceedings)

DOI： 10.1145/3772318.3791181

researchmap

Other Link： https://dblp.org/db/conf/chi/chi2026.html#HiranoYPLWK26
Sensing Your Vocals: Exploring the Activity of Vocal Cord Muscles for Pitch Assessment Using Electromyography and Ultrasonography.

Kanyu Chen, Rebecca Panskus, Erwin Wu, Yichen Peng, Daichi Saito, Emiko Kamiyama, Ruiteng Li, Chen-Chieh Liao, Karola Marky, Kato Akira, Hideki Koike, Kai Kunze

CHI 1087 - 20 2026

　More details

Publishing type：Research paper (international conference proceedings)

DOI： 10.1145/3772318.3790965

researchmap

Other Link： https://dblp.org/db/conf/chi/chi2026.html#ChenPWPSKLLMAKK26
UniLS: End-to-End Audio-Driven Avatars for Unified Listening and Speaking.

Xuangeng Chu, Ruicong Liu, Yifei Huang, Yun Liu, Yichen Peng, Bo Zheng

CoRR abs/2512.09327 2025.12

　More details

Publishing type：Research paper (scientific journal)

DOI： 10.48550/arXiv.2512.09327

researchmap
SimDiff: Simulator-constrained Diffusion Model for Physically Plausible Motion Generation.

Akihisa Watanabe, Jiawei Ren, Li Siyao, Yichen Peng, Erwin Wu, Edgar Simo-Serra

CoRR abs/2509.20927 2025.9

　More details

Publishing type：Research paper (scientific journal)

DOI： 10.48550/arXiv.2509.20927

researchmap
SoleLoadEvaluator: A Real-Time Feedback System for Walking Posture with Anterior Load Using Insole Sensors.

Shino Ito, Yichen Peng, Erwin Wu, Hideki Koike

AHs 345 - 355 2025

　More details

Publishing type：Research paper (international conference proceedings)

DOI： 10.1145/3745900.3746086

researchmap

Other Link： https://dblp.org/db/conf/aughuman2/ahs2025.html#ItoPWK25
SlopeNav: A Realtime Wearable Blind Ski Assistance System with Adaptive Path Planning for Simulated Environments.

Toshihiro Hirano, Yichen Peng, Masaki Kuribayashi, Erwin Wu, Shigeo Morishima, Hideki Koike

AHs 369 - 380 2025

　More details

Publishing type：Research paper (international conference proceedings)

DOI： 10.1145/3745900.3746082

researchmap

Other Link： https://dblp.org/db/conf/aughuman2/ahs2025.html#HiranoPKWMK25
SkiExARGame: Augmented Reality Exergame for Posture Correction in Alpine Ski.

Yuki Tabei, Takashi Matsumoto, Yichen Peng, Hideki Koike

AHs 467 - 469 2025

　More details

Publishing type：Research paper (international conference proceedings)

DOI： 10.1145/3745900.3747284

researchmap

Other Link： https://dblp.org/db/conf/aughuman2/ahs2025.html#TabeiMPK25
Introduction of the VCSD Dataset: A Vocal Cords Dataset Using EMG and Ultrasonography for Singing Pitch Skill Recognition.

Kanyu Chen, Erwin Wu, Chen-Chieh Liao, Daichi Saito, Yichen Peng, Akira Kato, Hideki Koike, Kai Kunze

UbiComp Companion 155 - 159 2025

　More details

Publishing type：Research paper (international conference proceedings)

DOI： 10.1145/3714394.3754407

researchmap

Other Link： https://dblp.org/db/conf/huc/ubicomp2025c.html#ChenWLSPKKK25
LineArt: A Knowledge-guided Training-free High-quality Appearance Transfer for Design Drawing with Diffusion Model.

Xi Wang, Hongzhen Li, Heng Fang, Yichen Peng, Haoran Xie 0002, Xi Yang 0017, Chuntao Li

IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR) 2912 - 2923 2025

　More details

Publishing type：Research paper (international conference proceedings) Publisher：Computer Vision Foundation / IEEE

DOI： 10.1109/CVPR52734.2025.00277

researchmap

Other Link： https://dblp.org/rec/conf/cvpr/2025
SkiTechCoach: A Multimodal Alpine Skiing Dataset with 3D Body Pose, Sole Pressure, and Expert Coaching.

Toshihiro Hirano, Yuki Tabei, Yichen Peng, Chen-Chieh Liao, Erwin Wu, Hideki Koike

MMSports@MM 39 - 46 2025

　More details

Publishing type：Research paper (international conference proceedings)

DOI： 10.1145/3728423.3759413

researchmap

Other Link： https://dblp.org/db/conf/mmsports/mmsports2025.html#HiranoTPLWK25
A Demonstration of ShiftingGolf: Gross Motor Skill Correction Using Redirection in VR.

Chen-Chieh Liao, Ruofan Liu 0001, Yichen Peng, Erwin Wu, Hideki Koike

SIGGRAPH Asia Emerging Technologies 1 - 3 2025

　More details

Publishing type：Research paper (international conference proceedings)

DOI： 10.1145/3757373.3763777

researchmap

Other Link： https://dblp.org/db/conf/siggrapha/siggrapha2025emerging.html#Liao0PWK25
An Augmented Reality Exergame for Improving Ski Posture through Gamified Feedback.

Yuki Tabei, Chen-Chieh Liao, Yichen Peng, Erwin Wu, Hideki Koike

SIGGRAPH Asia Emerging Technologies 2 - 3 2025

　More details

Publishing type：Research paper (international conference proceedings)

DOI： 10.1145/3757373.3763774

researchmap

Other Link： https://dblp.org/db/conf/siggrapha/siggrapha2025emerging.html#TabeiLPWK25
Spatial Audio for Ski Simulation with Visually Impaired Users in Dynamic Environments.

Yuta Taguchi, Toshihiro Hirano, Masaki Kuribayashi, Yichen Peng, Erwin Wu, Hideki Koike, Shigeo Morishima

SIGGRAPH Asia Posters 111 - 2 2025

　More details

Publishing type：Research paper (international conference proceedings)

DOI： 10.1145/3757374.3771466

researchmap

Other Link： https://dblp.org/db/conf/siggrapha/siggrapha2025posters.html#TaguchiHKPWKM25
PiaMuscle: Improving Piano Skill Acquisition by Cost-effectively Estimating and Visualizing Activities of Miniature Hand Muscles.

Ruofan Liu 0001, Yichen Peng, Takanori Oku, Chen-Chieh Liao, Erwin Wu, Shinichi Furuya, Hideki Koike

Proceedings of the 2025 CHI Conference on Human Factors in Computing Systems(CHI) 364 - 16 2025

　More details

Publishing type：Research paper (international conference proceedings) Publisher：ACM

DOI： 10.1145/3706598.3713465

researchmap

Other Link： https://dblp.org/db/conf/chi/chi2025.html#LiuPOLWFK25
Dual-Modal 3D Human Pose Estimation using Insole Foot Pressure Sensors.

Erwin Wu, Yichen Peng, Rawal Khirodkar, Hideo Koike, Kris Kitani

IEEE International Symposium on Mixed and Augmented Reality Adjunct(ISMAR-Adjunct) 131 - 135 2024

　More details

Publishing type：Research paper (international conference proceedings) Publisher：IEEE

DOI： 10.1109/ISMAR-Adjunct64951.2024.00036

researchmap

Other Link： https://dblp.org/db/conf/ismar/ismar2024a.html#WuPKKK24
Novel Sensing Methods for Vocal Technique Analysis: Evaluation on Electromyography and Ultrasonography.

Kanyu Chen, Erwin Wu, Daichi Saito, Yichen Peng, Chen-Chieh Liao, Akira Kato, Hideki Koike, Kai Kunze

IEEE International Symposium on Mixed and Augmented Reality Adjunct(ISMAR-Adjunct) 121 - 125 2024

　More details

Publishing type：Research paper (international conference proceedings) Publisher：IEEE

DOI： 10.1109/ISMAR-Adjunct64951.2024.00034

researchmap

Other Link： https://dblp.org/db/conf/ismar/ismar2024a.html#ChenWSPLKKK24
LineArt: A Knowledge-guided Training-free High-quality Appearance Transfer for Design Drawing with Diffusion Model.

Xi Wang, Hongzhen Li, Heng Fang, Yichen Peng, Haoran Xie 0002, Xi Yang 0017, Chuntao Li

CoRR abs/2412.11519 2024

　More details

Publishing type：Research paper (scientific journal)

DOI： 10.48550/arXiv.2412.11519

researchmap
PianoKeystroke-EMG: Piano Hand Muscle Electromyography Estimation from Easily Accessible Piano Keystroke.

Ruofan Liu 0001, Yichen Peng, Takanori Oku, Erwin Wu, Shinichi Furuya, Hideki Koike

SIGGRAPH Asia 2024 Posters 6 - 2 2024

　More details

Publishing type：Research paper (international conference proceedings) Publisher：ACM

DOI： 10.1145/3681756.3697878

researchmap

Other Link： https://dblp.org/db/conf/siggrapha/siggrapha2024posters.html#LiuPOWFK24
Phantom Audition: Using the Visualization of Electromyography and Vocal Metrics as Tools in Singing Training.

Kanyu Chen, Emiko Kamiyama, Ruiteng Li, Yichen Peng, Daichi Saito, Erwin Wu, Hideki Koike, Akira Kato

SIGGRAPH Asia 2024 Posters 113 - 2 2024

　More details

Publishing type：Research paper (international conference proceedings) Publisher：ACM

DOI： 10.1145/3681756.3697908

researchmap

Other Link： https://dblp.org/db/conf/siggrapha/siggrapha2024posters.html#ChenKLPSWKK24
EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Masked Audio Gesture Modeling.

Haiyang Liu, Zihao Zhu, Giorgio Becherini, Yichen Peng, Mingyang Su, You Zhou, Naoya Iwamoto, Bo Zheng, Michael J. Black

CoRR abs/2401.00374 2024

　More details

Publishing type：Research paper (scientific journal)

DOI： 10.48550/arXiv.2401.00374

researchmap
FilterPrompt: Guiding Image Transfer in Diffusion Models.

Xi Wang, Yichen Peng, Heng Fang, Haoran Xie 0002, Xi Yang 0017, Chuntao Li

CoRR abs/2404.13263 2024

　More details

Publishing type：Research paper (scientific journal)

DOI： 10.48550/arXiv.2404.13263

researchmap
Sketch-Guided Latent Diffusion Model for High-Fidelity Face Image Synthesis

Yichen Peng, Chunqi Zhao, Haoran Xie, Tsukasa Fukusato, Kazunori Miyata

IEEE Access 12 5770 - 5780 2024

　More details

Publishing type：Research paper (scientific journal)

DOI： 10.1109/ACCESS.2023.3346408

researchmap
EMAGE: Towards Unified Holistic Co-Speech Gesture Generation via Expressive Masked Audio Gesture Modeling.

Haiyang Liu, Zihao Zhu, Giorgio Becherini, Yichen Peng, Mingyang Su, You Zhou, Xuefei Zhe, Naoya Iwamoto, Bo Zheng, Michael J. Black

IEEE/CVF Conference on Computer Vision and Pattern Recognition(CVPR) 1144 - 1154 2024

　More details

Publishing type：Research paper (international conference proceedings) Publisher：IEEE

DOI： 10.1109/CVPR52733.2024.00115

researchmap

Other Link： https://dblp.org/db/conf/cvpr/cvpr2024.html#LiuZBPSZZIZB24
DualMotion: Global-to-Local Casual Motion Design for Character Animations.

Yichen Peng, Chunqi Zhao, Haoran Xie 0002, Tsukasa Fukusato, Kazunori Miyata, Takeo Igarashi

IEICE Transactions on Information & Systems 106 ( 4 ) 459 - 468 2023.4

　More details

Publishing type：Research paper (scientific journal)

DOI： 10.1587/transinf.2022iip0011

researchmap
DiffFaceSketch: High-Fidelity Face Image Synthesis with Sketch-Guided Latent Diffusion Model.

Yichen Peng, Chunqi Zhao, Haoran Xie 0002, Tsukasa Fukusato, Kazunori Miyata

CoRR abs/2302.06908 2023

　More details

Publishing type：Research paper (scientific journal)

DOI： 10.48550/arXiv.2302.06908

researchmap
BEAT: A Large-Scale Semantic and Emotional Multi-modal Dataset for Conversational Gestures Synthesis.

Haiyang Liu, Zihao Zhu, Naoya Iwamoto, Yichen Peng, Zhengqing Li, You Zhou, Elif Bozkurt, Bo Zheng

Computer Vision - ECCV 2022 - 17th European Conference 612 - 630 2022

　More details

Publishing type：Research paper (international conference proceedings) Publisher：Springer

DOI： 10.1007/978-3-031-20071-7_36

researchmap

Other Link： https://dblp.org/db/conf/eccv/eccv2022-7.html#LiuZIPLZBZ22
BEAT: A Large-Scale Semantic and Emotional Multi-Modal Dataset for Conversational Gestures Synthesis.

Haiyang Liu, Zihao Zhu, Naoya Iwamoto, Yichen Peng, Zhengqing Li, You Zhou, Elif Bozkurt, Bo Zheng

CoRR abs/2203.05297 2022

　More details

Publishing type：Research paper (scientific journal)

DOI： 10.48550/arXiv.2203.05297

researchmap
DualMotion: Global-to-Local Casual Motion Design for Character Animations.

Yichen Peng, Chunqi Zhao, Haoran Xie 0002, Tsukasa Fukusato, Kazunori Miyata, Takeo Igarashi

CoRR abs/2208.08636 2022

　More details

Publishing type：Research paper (scientific journal)

DOI： 10.48550/arXiv.2208.08636

researchmap
DualFace: Two-stage drawing guidance for freehand portrait sketching.

Zhengyu Huang, Yichen Peng, Tomohiro Hibino, Chunqi Zhao, Haoran Xie 0002, Tsukasa Fukusato, Kazunori Miyata

Computational Visual Media 8 ( 1 ) 63 - 77 2022

　More details

Publishing type：Research paper (scientific journal)

DOI： 10.1007/s41095-021-0227-7

researchmap
SketchMeHow: Interactive Projection Guided Task Instruction with User Sketches

Haoran Xie, Yichen Peng, Hange Wang, Kazunori Miyata

HCI International 2021 - Late Breaking Papers: Cognition, Inclusion, Learning, and Culture - 23rd HCI International Conference abs/2109.03013 513 - 527 2021

　More details

Publishing type：Research paper (international conference proceedings) Publisher：Springer

DOI： 10.1007/978-3-030-90328-2_35

researchmap

Other Link： https://dblp.org/db/conf/hci/hci2021-42.html#XiePWM21
Two-Stage Motion Editing Interface for Character Animation.

Yichen Peng, Chunqi Zhao, Zhengyu Huang, Tsukasa Fukusato, Haoran Xie 0002, Kazunori Miyata

SCA '21: The ACM SIGGRAPH / Eurographics Symposium on Computer Animation(SCA) 3 - 2 2021

　More details

Publishing type：Research paper (international conference proceedings) Publisher：ACM

DOI： 10.1145/3475946.3480960

researchmap

Other Link： https://dblp.org/db/conf/sca/sca2021.html#PengZHFXM21
Skeleton2Stroke: Interactive Stroke Correspondence Editing with Pose Features.

Ryoma Miyauchi, Yichen Peng, Tsukasa Fukusato, Haoran Xie 0002

SA '21: SIGGRAPH Asia 2021 Technical Communications 6 - 4 2021

　More details

Publishing type：Research paper (international conference proceedings) Publisher：ACM

DOI： 10.1145/3478512.3488612

researchmap

Other Link： https://dblp.org/db/conf/siggrapha/siggrapha2021tc.html#MiyauchiPF021
BalloonFAB: Digital Fabrication of Large-Scale Balloon Art.

Haoran Xie 0002, Yichen Peng, Naiyun Chen, Dazhao Xie, Chia-Ming Chang 0003, Kazunori Miyata

Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems 2019

　More details

Publishing type：Research paper (international conference proceedings) Publisher：ACM

DOI： 10.1145/3290607.3312947

researchmap

Other Link： https://dblp.org/db/conf/chi/chi2019a.html#XiePCXCM19

▼display all