国立研究開発法人情報通信研究機構 (NICT)   先進的音声技術研究室(ASTL)   テニュアトラック 研究員

2020年 - 2025年2月

Oxford University   Computer science department   visiting researcher

2019年4月 - 2019年5月

国立研究開発法人情報通信研究機構 (NICT)   先進的音声技術研究室(ASTL)   研究員

2017年 - 2019年

京都大学 音声メディア研究室   研究員

2016年4月 - 2016年12月

Sogou/Sohuピン音入力方法[株，中国北京市]   研究員

2012年4月 - 2012年9月

香港中文大学 深セン市 joint 研究所 [中国広東省深セン市]   研究員 (computer-assisted language learning)

2009年7月 - 2012年4月

SIG-CSLP (Chinese Spoken Language Processing)

APSIPA (Asia Pacific Signal and Information Processing Association)

IEEE   senior member  

2025年4月 - 現在   

IEEE Signal Processing Society (SPS)   Applied Signal Processing Systems Technical Committee (ASPS TC)  

2025年1月 - 2027年1月   

Co-organizing ACM Multimedia Asia 2024 workshop: Multimodal, Multilingual and Multitask Modeling Technologies for Oriental Languages (M3Oriental)   Co-organizer  

2024年12月   

Session Chair of DASFAA2024  

2024年7月   

Publicity Chair of ACM Multimedia Asia 2024  

2024年6月 - 2024年12月   

Session Chair of IEEE-ICASSP2024  

2024年4月   

Co-organizing ACM Multimedia Asia 2023 workshop: Multimodal, Multilingual and Multitask Modeling Technologies for Oriental Languages (M3Oriental)  

2023年12月   

Session Chair of ICANN 2023  

2023年9月   

Area Chair of APSIPA ASC 2023  

2023年7月   

Area Chair of EMNLP 2023  

2023年7月   

Co-organizing Coling2022 workshop: when creative ai meets conversational ai (cai + cai = cai^2)  

2022年10月   

Session Chair for Speaker Odyssey2022 (Evaluation and Benchmarking Session)  

2022年6月   

Session Chair for INTERSPEECH2020 (Topics of ASR I)  

2020年10月   

Co-organizing INTERSPEECH2020 SLIMTS (Spoken Language Interaction for Mobile Transportation System) workshop  

2020年10月   

Speech Foundation Bench for Robotic and EdgeAI systems 査読

Sheng Li, Takahiro Shinozaki

Proc. IEEE-ICASSP demo 2026.   2026年

Emotional Text-To-Speech Based on Mutual-Information-Guided Emotion-Timbre Disentanglement

Jianing Yang, Sheng Li, Takahiro Shinozaki, Yuki Saito, Hiroshi Saruwatari

APSIPA ASC 2025   2025年12月

LatentSpeech: Latent Diffusion for Text-To-Speech Generation 招待 査読

Haowei Lou, Hye young Paik, Pari Delir Haghighi, Sheng Li, Wen Hu, Lina Yao

Proc. RO-MAN   2025年12月

Towards Emotion Co-regulation with LLM-powered Socially Assistive Robots: Integrating LLM Prompts and Robotic Behaviors to Support Parent-Neurodivergent Child Dyads 査読

Jing Li, Felix Schijve, Sheng Li, Yuye Yang, Jun Hu, Emilia Barakova

Proc. IROS   2025年12月

Language-Aware Prompt Tuning for Parameter-Efficient Seamless Language Expansion in Multilingual ASR, 査読

Hongli Yang, S. Li, Hao Huang, Ayiduosi Tuohan, Yizhou Peng

Proc. Interspeech   2025年12月

End-to-end Acoustic-linguistic Emotion and Intent Recognition Enhanced by Semi-supervised Learning 査読

Zhao Ren, Rathi Adarshi Rammohan, Kevin Scheck, Sheng Li, Tanja Schultz

International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC)   2025年12月

Bandwidth Extension System for Throat Microphone Speech Reconstruction 査読

Yu Xu, Xiaokai Qin, Tianyu Fan, Eng Siong Chng, Sheng Li, Nobuaki Minematsu, Daisuke Saito

Proc. IEEE-ICME   2025年12月

Generative Error Correction for Emotion-aware Speech-to-text Translation 査読

Zhengdong Yang, Sheng Li, Chenhui Chu

Proc. ACL (findings)   2025年12月

SIQ: Exterminating Speech Intelligence Quotient Cross Cognitive Levels in Voice Understanding Large Language Models 査読

Zhen Wan, Chao-Han Huck Yang, Yahan Yu, Jinchuan Tian, Sheng Li, Ke Hu, Zhehuai Chen, Shinji Watanabe, Fei Cheng, Chenhui Chu, Sadao Kurohashi

Proc. ACL (long main)   2025年12月

Simple and Effective Content Encoder for Singing Voice Conversion via Dimension Reduction, 査読

Wangjin Zhou, Tianjiao Du, Chenglin Xu, S. Li, Yi Zhao, Tatsuya Kawahara

Proc. Interspeech   2025年12月

Adapting Whisper for Parameter-efficient Code-Switching Speech Recognition via Soft Prompt Tuning 査読

Hongli Yang, Yizhou Peng, Hao Huang, S. Li

Proc. Interspeech   2025年12月

Designing an LLM-powered Social Robot for Supporting Emotion Regulation In Parent-Child Dyads

Jing Li, Sheng Li, Emilia I. Barakova, Felix Schijve, Jun Hu

Proc. RO-MAN (late breaking)   2025年12月

Designing an LLM-powered Social Robot for Supporting Emotion Regulation In Parent-Child Dyads 査読

Jing Li, Felix Schijve, Sheng Li, Emilia Barakova, Jun Hu

Interactive AI for Preventive Health (IAI4PH) 2025   2025年12月

Empowering Māori Automatic Speech Recognition through EMD-Based Augmentation

Chengxi Lei, Sheng Li, Satwinder Singh, Feng Hou, Huia Jahnke, Ruili Wang

22nd Pacific Rim International Conference on Artificial Intelligence (PRICAI 2025)   2025年11月

Extending Whisper for Emotion Prediction Using Word-level Pseudo Labels 査読

Chin Yuen Kwok, Sheng Li, Jia Qi Yip, Chenhui Chu, Tatsuya Kawahara, Eng Siong Chng

IEEE-ICASSP   2025年3月

Similarity-based accent recognition with continuous and discrete self-supervised speech representations 査読

Jun-You Wang, Sheng Li, Li-An Lu, Sydney Chia-Chun Kao, Jyh-Shing Roger Jang

IEEE-ICASSP   2025年3月

Joint Automatic Speech Recognition And Structure Learning For Better Speech Understanding 査読

Jiliang Hu, Zuchao Li, Mengjia Shen, Haojun Ai, Sheng Li, Jun Zhang

IEEE-ICASSP   2025年3月

RAG-Boost: Retrieval-Augmented Generation Enhanced LLM-based Speech Recognition, 査読

Pengcheng Wang, Sheng Li, Takahiro Shinozaki

Interspeech2025 MLC-SLM Challenge workshop   2025年

CoVoGER: A Multilingual Multitask Benchmark for Speech-to-text Generative Error Correction with Large Language Models, 査読

Zhengdong Yang, Zhen Wan, Sheng Li, Chao-Han Huck Yang, Chenhui Chu

Proc. EMNLP (long main)   2025年

Collaborative Transformer Prototype Network With Pretrained Contrastive Language-Audio Encoder for Open Set Audio Recognition 査読

Haiyan Yang, Jun Wang, Sheng Li, Di Zhou, Xingwei Chen, Juncheng Li, Yufeng Hua, Jun Shi

IEEE Transactions on Signal Processing   73   4748 - 4763   2025年

Cross-Lingual Embedding Clustering for Hierarchical Softmax in Low-Resource Multilingual Speech Recognition 査読

Zhengdong Yang, Qianying Liu, Sheng Li, Fei Cheng, Chenhui Chu

IEEE Transactions on Audio, Speech and Language Processing   1 - 13   2025年

SpeechIQ: Speech-Agentic Intelligence Quotient Across Cognitive Levels in Voice Understanding by Large Language Models.

Zhen Wan, Chao-Han Huck Yang, Yahan Yu, Jinchuan Tian, Sheng Li 0010, Ke Hu, Zhehuai Chen, Shinji Watanabe 0001, Fei Cheng 0002, Chenhui Chu, Sadao Kurohashi

ACL (1)   30381 - 30398   2025年

Multi-Domain Dialogue State Tracking with Large Language Model Rationale and Disentangled Domain-Slot Attention 査読

Longfei Yang, Jiyi Li, Sheng Li, Takahiro Shinozaki

IEEE Transactions on Audio, Speech and Language Processing   1 - 14   2025年

Neural TTS-Based Dynamic Data Augmentation for Improved Speech Separation 査読

Kai Wang, Cuicui Zhu, Lili Yin, Sheng Li, Madina Mansurova, Hao Huang

IEEE Transactions on Audio, Speech and Language Processing   33   2457 - 2470   2025年

A Two-Stage LoRA Strategy for Expanding Language Capabilities in Multilingual ASR Models 査読

Chin Yuen Kwok, Hexin Liu, Jia Qi Yip, Sheng Li, Eng Siong Chng

IEEE Transactions on Audio, Speech and Language Processing   33   2576 - 2590   2025年

Parallel and Limited Data Voice Conversions on Myanmar Language Speech for Spoofed Detection 査読

Hay Mar Soe Naing, Win Pa Pa, Sheng Li

Proceedings of the 6th ACM International Conference on Multimedia in Asia Workshops   1 - 5   2024年12月

LaMuCo: Large-Scale Multilingual Conversation Speech Recognition Challenge 査読

Qingqing Zhang, Lei Luo, Simin Xu, Yongjing Chen, Chuang Li, Sheng Li, Ruili Wang

Proceedings of the 6th ACM International Conference on Multimedia in Asia Workshops   1 - 3   2024年12月

Data Selection using Spoken Language Identification for Low-Resource and Zero-Resource Speech Recognition 査読

Jianan Chen, Chenhui Chu, Sheng Li, Tatsuya Kawahara

2024 Asia Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC)   1 - 6   2024年12月

LLM as decoder: Investigating Lattice-based Speech Recognition Hypotheses Rescoring Using LLM 査読

Sheng Li, Yuka Ko, Akinori Ito

2024 Asia Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC)   1 - 5   2024年12月

Low-resource Language Adaptation with Ensemble of PEFT Approaches 査読

Chin Yuen Kwok, Sheng Li, Jia Qi Yip, Eng Siong Chng

2024 Asia Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC)   1 - 6   2024年12月

Investigating Effective Speaker Property Privacy Protection in Federated Learning for Speech Emotion Recognition 査読

Chao Tan, Sheng Li, Yang Cao, Zhao Ren, Tanja Schultz

ACM Multimedia Asia 2024   2024年12月

Enhancing Privacy of Spatiotemporal Federated Learning Against Gradient Inversion Attacks 査読

Lele Zheng, Yang Cao, Renhe Jiang, Kenjiro Taura, Yulong Shen, Sheng Li, Masatoshi Yoshikawa

Lecture Notes in Computer Science   457 - 473   2024年10月

Investigating ASR Error Correction with Large Language Model and Multilingual 1-best Hypotheses 査読

Sheng Li, Chen Chen, Chin Yuen Kwok, Chenhui Chu, Eng Siong Chng, Hisashi Kawai

Interspeech 2024   1315 - 1319   2024年9月

Automatic Post-Editing of Speech Recognition System Output Using Large Language Models 査読

Sheng Li, Jiyi Li, Yang Cao

The DASFAA 2024 Workshop   2024年7月

Revisiting Generative Adversarial Network for Downstream Task of Speech Recognition 査読

Sheng Li, Bei Liu, Jianlong Fu

Proc. IEEE GEM   2024年6月

Voices of the Himalayas: Benchmarking Speech Recognition Systems for the Tibetan Language 査読

Sheng Li, Jiyi Li, Chenhui Chu

2024年5月

Reproducibility Companion Paper: Stable Diffusion for Content-Style Disentanglement in Art Analysis 査読

Yankun Wu, Yuta Nakashima, Noa Garcia, Sheng Li, Zhaoyang Zeng

Proceedings of the 2024 International Conference on Multimedia Retrieval   2024年5月

Enhancing Realism in 3D Facial Animation Using Conformer-Based Generation and Automated Post-Processing 査読

Yi Zhao, Chunyu Qiang, Hao Li, Yulan Hu, Wangjin Zhou, Sheng Li

ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)   2024年4月

MOS-FAD: Improving Fake Audio Detection Via Automatic Mean Opinion Score Prediction 査読

Wangjin Zhou, Zhengdong Yang, Chenhui Chu, Sheng Li, Raj Dabre, Yi Zhao, Kawahara Tatsuya

ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)   2024年4月

Phantom in the opera: adversarial music attack for robot dialogue system 招待 査読

Sheng Li, Jiyi Li, Yang Cao

Frontiers in Computer Science   6   2024年2月

End-to-end Japanese-English Speech-to-text Translation with Spoken-to-Written Style Conversion 査読

Zhengdong Yang, Shuichiro Shimizu, Chenhui Chu, Sheng Li, Sadao Kurohashi

Journal of Natural Language Processing   31 ( 3 )   935 - 957   2024年

LE-SSL-MOS: Self-Supervised Learning MOS Prediction with Listener Enhancement 査読

Zili Qi, Xinhui Hu, Wangjin Zhou, Sheng Li, Hao Wu, Jian Lu, Xinkang Xu

2023 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU)   2023年12月

FedCPC: An Effective Federated Contrastive Learning Method for Privacy Preserving Early-Stage Alzheimers Speech Detection 査読

Wenqing Wei, Zhengdong Yang, Yuan Gao, Jiyi Li, Chenhui Chu, Shogo Okada, Sheng Li

2023 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU)   2023年12月

KyotoMOS: An Automatic MOS Scoring System for Speech Synthesis 招待 査読

Wangjin Zhou, Zhengdong Yang, Sheng Li, Chenhui Chu

ACM Multimedia Asia Workshops   2023年12月

Reprogramming Self-supervised Learning-based Speech Representations for Speaker Anonymization 査読

Xiaojiao Chen, Sheng Li, Jiyi Li, Hao Huang, Yang Cao, Liang He

ACM Multimedia Asia 2023   2023年12月

GhostVec: A New Threat to Speaker Privacy of End-to-End Speech Recognition System 査読

Xiaojiao Chen, Sheng Li, Jiyi Li, Yang Cao, Hao Huang, Liang He

ACM Multimedia Asia 2023   2023年12月

Robust voice activity detection using an auditory-inspired masked modulation encoder based convolutional attention network 査読

Nan Li, Longbiao Wang, Meng Ge, Masashi Unoki, Sheng Li, Jianwu Dang

Speech Communication   103024 - 103024   2023年12月

Finetuning Pretrained Model with Embedding of Domain and Language Information for ASR of Very Low-Resource Settings 査読

Soky Kak, Sheng Li, Chenhui Chu, Tatsuya Kawahara

International Journal of Asian Language Processing (IJALP)   2023年11月

Disordered speech recognition considering low resources and abnormal articulation

Yuqin Lin, Longbiao Wang, Jianwu Dang, Sheng Li, Chenchen Ding

Speech Communication   155   103002 - 103002   2023年11月

Correction while Recognition: Combining Pretrained Language Model for Taiwan-Accented Speech Recognition 査読

Sheng Li, Jiyi Li

Artificial Neural Networks and Machine Learning – ICANN 2023   389 - 400   2023年9月

The Kyoto Speech-to-Speech Translation System for IWSLT 2023 査読

Zhengdong Yang, Shuichiro Shimizu, Wangjin Zhou, Sheng Li, Chenhui Chu

International Conference on Spoken Language Translation (IWSLT)   2023年7月

Towards Speech Dialogue Translation Mediating Speakers of Different Languages 査読

Shuichiro Shimizu, Chenhui Chu, Sheng Li, Sadao Kurohashi

In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL 2023): Findings Volume   2023年7月

Multi-Domain Dialogue State Tracking with Disentangled Domain-Slot Attention 査読

Longfei Yang, Jiyi Li, Sheng Li, Takahiro Shinozaki

In Proceedings of the 61st Annual Meeting of the Association for Computational Linguistics (ACL 2023): Findings Volume   2023年7月

Dialogue State Tracking with Sparse Local Slot Attention 査読

Longfei Yang, Jiyi Li, Sheng Li, Takahiro Shinozaki

ACL 2023 Workshop on NLP for Conversational AI   2023年7月

Tendency-and-attention-informed deep learning for ENSO forecasts

Shen Qiao, Cuicui Zhang, Xuefeng Zhang, Kai Zhang, Hao Shi, Sheng Li, Hao Wei

Climate Dynamics   2023年6月

Development of a Pain Signaling System Using Machine Learning 査読

Helen Korving, Sheng Li, Di Zhou, Paula Sterkenburg, Panos Markopoulos, Emilia Barakova

2023 IEEE International Conference on Acoustics, Speech, and Signal Processing Workshops (ICASSPW)   2023年6月

General or Specific? Investigating Effective Privacy Protection in Federated Learning for Speech Emotion Recognition 査読

Chao Tan, Yang Cao, Sheng Li, Masatoshi Yoshikawa

ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)   2023年6月

Hierarchical Softmax for End-To-End Low-Resource Multilingual Speech Recognition 査読

Qianying Liu, Zhuo Gong, Zhengdong Yang, Yuhang Yang, Sheng Li, Chenchen Ding, Nobuaki Minematsu, Hao Huang, Fei Cheng, Chenhui Chu, Sadao Kurohashi

ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)   2023年6月

Domain and Language Adaptation Using Heterogeneous Datasets for Wav2vec2.0-Based Speech Recognition of Low-Resource Language 査読

Kak Soky, Sheng Li, Chenhui Chu, Tatsuya Kawahara

ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)   2023年6月

Speakeraugment: Data Augmentation for Generalizable Source Separation via Speaker Parameter Manipulation 査読

Kai Wang, Yuhang Yang, Hao Huang, Ying Hu, Sheng Li

ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)   2023年6月

Speech-Text Based Multi-Modal Training with Bidirectional Attention for Improved Speech Recognition 査読

Yuhang Yang, Haihua Xu, Hao Huang, Eng Siong Chng, Sheng Li

ICASSP 2023 - 2023 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)   2023年6月

An End-to-End Chinese and Japanese Bilingual Speech Recognition Systems with Shared Character Decomposition 査読

Sheng Li, Jiyi Li, Qianying Liu, Zhuo Gong

Communications in Computer and Information Science   493 - 503   2023年4月

Investigating Effective Domain Adaptation Method for Speaker Verification Task 査読

Guangxing Li, Wangjin Zhou, Sheng Li, Yi Zhao, Jichen Yang, Hao Huang

Communications in Computer and Information Science   517 - 527   2023年4月

GhostVec: Directly Extracting Speaker Embedding from End-to-End Speech Recognition Model Using Adversarial Examples 査読

Xiaojiao Chen, Sheng Li, Hao Huang

Communications in Computer and Information Science   482 - 492   2023年4月

SpecMNet: Spectrum Mend Network for Monaural Speech Enhancement 査読

Cunhang Fan, Hongmei Zhang, Jiangyan Yi, Zhao Lv, Jianhua Tao, Taihao Li, Guanxiong Pei, Xiaopei Wu, Sheng Li

Applied Acoustics   194 ( 108792 )   2022年12月

Improving low-resource Tibetan end-to-end ASR by multilingual and multilevel unit modeling 査読

Siqing Qin, Longbiao Wang, Sheng Li, Jianwu Dang, Lixin Pan

EURASIP Journal on Audio, Speech, and Music Processing   2022 ( 1 )   1 - 10   2022年12月

Can We Train a Language Model Inside an End-to-End ASR Model? - Investigating Effective Implicit Language Modeling 査読

Zhuo Gong, Saito Daisuke, Sheng Li, Hisashi Kawai, Minematsu Nobuaki

Proceedings of the Second Workshop on When Creative AI Meets Conversational AI   42 - 47   2022年12月

Subband-based Spectrogram Fusion for Speech Enhancement by Combining Mapping and Masking Approaches 査読

Hao Shi, Longbiao Wang, Sheng Li, Jianwu Dang, Tatsuya Kawahara

2022 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC)   2022年11月

Nict-Tib1: A Public Speech Corpus Of Lhasa Dialect For Benchmarking Tibetan Language Speech Recognition Systems 査読

Kak Soky, Zhuo Gong, Sheng Li

2022 25th Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques (O-COCOSDA)   2022年11月

Monaural Speech Enhancement Based on Spectrogram Decomposition for Convolutional Neural Network-sensitive Feature Extraction 査読

Hao Shi, Longbiao Wang, Sheng Li, Jianwu Dang, Tatsuya Kawahara

Interspeech 2022   2022年9月

Multi-Domain Dialogue State Tracking with Top-k Slot Self Attention 査読

Longfei Yang, Jiyi Li, Sheng Li, Takahiro Shinozaki

In Proc. SIGdial Meeting Discourse \& Dialogue   2022年9月

Leveraging Simultaneous Translation for Enhancing Transcription of Low-resource Language via Cross Attention Mechanism 査読

Kak Soky, Sheng Li, Masato Mimura, Chenhui Chu, Tatsuya Kawahara

in Proc. INTERSPEECH   2022年9月

Augmented Adversarial Self-Supervised Learning for Early-Stage Alzheimer's Speech Detection 査読

Longfei Yang, Wenqing Wei, Sheng Li, Jiyi Li, Takahiro Shinozaki

in Proc. INTERSPEECH   2022年9月

Data Augmentation Using McAdams-Coefficient-Based Speaker Anonymization for Fake Audio Detection 査読

Kai Li, Sheng Li, Xugang Lu, Masato Akagi, Meng Liu, Lin Zhang, Chang Zeng, Longbiao Wang, Jianwu Dang, Masashi Unoki

in Proc. INTERSPEECH   2022年9月

Fusion of Self-supervised Learned Models for MOS Prediction 査読

Zhengdong Yang, Wangjin Zhou, Chenhui Chu, Sheng Li, Raj Dabre, Raphael Rubino, Yi Zhao

in Proc. INTERSPEECH   2022年9月

Finer-grained Modeling units-based Meta-Learning for Low-resource Tibetan Speech Recognition 査読

Siqing Qin, Longbiao Wang, Sheng Li, Yuqin Lin, Jianwu Dang

in Proc. INTERSPEECH   2022年9月

Global Signal-to-noise Ratio Estimation Based on Multi-subband Processing Using Convolutional Neural Network 査読

Nan LI, Meng Ge, Longbiao Wang, Masashi Unoki, Sheng Li, Jianwu Dang

in Proc. INTERSPEECH   2022年9月

Relationship Between Speakers' Physiological Structure and Acoustic Speech Signals: Data-Driven Study Based on Frequency-Wise Attentional Neural Network 査読

Kai Li, Xugang Lu, Masato Akagi, Jianwu Dang, Sheng Li, Masashi Unoki

2022 30th European Signal Processing Conference (EUSIPCO)   379 - 383   2022年8月

TriECCC: Trilingual Corpus of the Extraordinary Chambers in the Courts of Cambodia for Speech Recognition and Translation Studies 招待 査読

Kak Soky, Masato Mimura, Tatsuya Kawahara, Chenhui Chu, Sheng Li, Chenchen Ding, Sethserey Sam

International Journal of Asian Language Processing   31 ( 03n04 )   2022年7月

Self-Adaptive Multilingual ASR Rescoring with Language Identification and Unified Language Model 査読

Zhuo Gong, Daisuke Saito, Longfei Yang, Takahiro Shinozaki, Sheng Li, Hisashi Kawai, Nobuaki Minematsu

The Speaker and Language Recognition Workshop (Odyssey 2022)   2022年6月

Adversarial Speech Generation and Natural Speech Recovery for Speech Content Protection. 査読

Sheng Li, Jiyi Li, Qianying Liu, Zhuo Gong

In Proc. LREC (Language Resources and Evaluation Conference)   7291 - 7297   2022年6月

Mining Hard Samples Locally And Globally For Improved Speech Separation 査読

Kai Wang, Yizhou Peng, Hao Huang, Ying Hu, Sheng Li

ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)   2022年5月

Compressing Transformer-Based ASR Model by Task-Driven Loss and Attention-Based Multi-Level Feature Distillation 査読

Yongjie Lv, Longbiao Wang, Meng Ge, Sheng Li, Chenchen Ding, Lixin Pan, Yuguang Wang, Jianwu Dang, Kiyoshi Honda

ICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)   2022年5月

Cross-Lingual Transfer Learningfor End-to-End Speech Translation

Shuichiro Shimizu, Chenhui Chu, Sheng Li, Sadao Kurohashi

自然言語処理   29 ( 2 )   611 - 637   2022年

Adversarial Attack and Defense on Deep Neural Network-based Voice Processing Systems: An Overview 査読

Xiaojiao Chen, Sheng Li, Hao Huang

Applied Sciences, Special Issues of Machine Speech Communication, 2021.   2021年12月

Spectrograms Fusion-based End-to-End Robust Automatic Speech Recognition 査読

Hao Shi, Longbiao Wang, Sheng Li, Cunhang Fan, Jianwu Dang, Tatsuya Kawahara

In Proc. APSIPA ASC   2021年12月

Multilingual Approach to Joint Speech and Accent Recognition with DNN-HMM Framework 査読

Yizhou Peng, Jicheng Zhang, Haobo Zhang, Haihua Xu, Hao Huang, Sheng Li, Eng Siong Chng

In Proc. APSIPA ASC   2021年12月

On the Use of Speaker Information for Automatic Speech Recognition in Speaker-imbalanced Corpora 査読

Kak Soky, Sheng Li, Masato Mimura, Chenhui Chu, Tatsuya Kawahara

In Proc. APSIPA ASC   2021年12月

Khmer Speech Translation Corpus of the Extraordinary Chambers in the Courts of Cambodia (ECCC) 査読

Kak Soky, Masato Mimura, Tatsuya Kawahara, Sheng Li, Chenchen Ding, Chenhui Chu, Sethserey Sam

in Proc. O-COCOSDA   2021年12月

An End-to-End Dialect Identification System with Transfer Learning from a Multilingual Automatic Speech Recognition Model 査読

Ding Wang, Shuaishuai Ye, Xinhui Hu, Sheng Li, Xinkang Xu

Interspeech 2021   3266 - 3270   2021年8月

End-to-End Speech Separation Using Orthogonal Representation in Complex and Real Time-Frequency Domain 査読

Kai Wang, Hao Huang, Ying Hu, Zhihua Huang, Sheng Li

Interspeech 2021   3046 - 3050   2021年8月

Robust Voice Activity Detection Using a Masked Auditory Encoder Based Convolutional Neural Network

Nan Li, Longbiao Wang, Masashi Unoki, Sheng Li, Rui Wang, Meng Ge, Jianwu Dang

ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)   2021年6月

An Investigation of Using Hybrid Modeling Units for Improving End-to-End Speech Recognition System

Shunfei Chen, Xinhui Hu, Sheng Li, Xinkang Xu

ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)   2021年6月

Encoder-Decoder Based Pitch Tracking and Joint Model Training for Mandarin Tone Classification 査読

Hao Huang, Kai Wang, Ying Hu, Sheng Li

ICASSP 2021 - 2021 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)   2021年6月

Phantom in the Opera: Effective Adversarial Music Attack on Keyword Spotting Systems.

Heran Zhang, Sheng Li, Xingjun Ma, Yi Zhao, Yang Cao, Tatsuya Kawahara

IEEE-SLT2021   2021年

Simultaneous Progressive Filtering-Based Monaural Speech Enhancement 査読

Haoran Yin, Hao Shi, Longbiao Wang, Luya Qiang, Sheng Li, Meng Ge, Gaoyan Zhang, Jianwu Dang

Communications in Computer and Information Science   213 - 221   2021年

Exploring Effective Speech Representation via ASR for High-Quality End-to-End Multispeaker TTS 査読

Dawei Liu, Longbiao Wang, Sheng Li, Haoyu Li, Chenchen Ding, Ju Zhang, Jianwu Dang

Communications in Computer and Information Science   110 - 118   2021年

Speech Dereverberation Based on Scale-Aware Mean Square Error Loss 査読

Luya Qiang, Hao Shi, Meng Ge, Haoran Yin, Nan Li, Longbiao Wang, Sheng Li, Jianwu Dang

Communications in Computer and Information Science   55 - 63   2021年

VOIS: The First Speech Therapy App Specifically Designed for Myanmar Hearing-Impaired Children

Aye Thida, Nway Nway Han, Sheinn Thawtar Oo, Sheng Li, Chenchen Ding

2020 23rd Conference of the Oriental COCOSDA International Committee for the Co-ordination and Standardisation of Speech Databases and Assessment Techniques (O-COCOSDA)   2020年11月

Compensation on x-vector for Short Utterance Spoken Language Identification

Peng Shen, Xugang Lu, Komei Sugiura, Sheng Li, Hisashi Kawai

Odyssey 2020 The Speaker and Language Recognition Workshop   47 - 52   2020年11月

Joint Training End-to-End Speech Recognition Systems with Speaker Attributes

Sheng Li, Xugang Lu, Raj Dabre, Peng Shen, Hisashi Kawai

Odyssey 2020 The Speaker and Language Recognition Workshop   2020年11月

Voice-Indistinguishability -- Protecting Voiceprint with Differential Privacy under an Untrusted Server

Yaowei Han, Yang Cao, Sheng Li, Qiang Ma, Masatoshi Yoshikawa

Proceedings of the 2020 ACM SIGSAC Conference on Computer and Communications Security   2125 - 2127   2020年10月

Singing Voice Extraction with Attention-Based Spectrograms Fusion

Hao Shi, Longbiao Wang, Sheng Li, Chenchen Ding, Meng Ge, Nan Li, Jianwu Dang, Hiroshi Seki

Interspeech 2020   2020年10月

Staged Knowledge Distillation for End-to-End Dysarthric Speech Recognition and Speech Attribute Transcription

Yuqin Lin, Longbiao Wang, Sheng Li, Jianwu Dang, Chenchen Ding

Interspeech 2020   2020年10月

Voice-Indistinguishability: Protecting Voiceprint In Privacy-Preserving Speech Data Release

Yaowei Han, Sheng Li, Yang Cao, Qiang Ma, Masatoshi Yoshikawa

2020 IEEE International Conference on Multimedia and Expo (ICME)   2020年7月

Spectrograms Fusion with Minimum Difference Masks Estimation for Monaural Speech Dereverberation

Hao Shi, Longbiao Wang, Meng Ge, Sheng Li, Jianwu Dang

ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)   2020年5月

End-to-End Articulatory Modeling for Dysarthric Articulatory Attribute Detection

Yuqin Lin, Longbiao Wang, Jianwu Dang, Sheng Li, Chenchen Ding

ICASSP 2020 - 2020 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)   2020年5月

Automatic speech recognition

Xugang Lu, Sheng Li, Masakiyo Fujimoto

SpringerBriefs in Computer Science   21 - 38   2020年

Investigation of Effectively Synthesizing Code-Switched Speech Using Highly Imbalanced Mix-Lingual Data

Shaotong Guo, Longbiao Wang, Sheng Li, Ju Zhang, Cheng Gong, Yuguang Wang, Jianwu Dang, Kiyoshi Honda

Neural Information Processing   36 - 47   2020年

Knowledge Distillation-Based Representation Learning for Short-Utterance Spoken Language Identification

Peng Shen, Xugang Lu, Sheng Li, Hisashi Kawai

IEEE/ACM Transactions on Audio, Speech, and Language Processing   28   2674 - 2683   2020年

Multi-lingual transformer training for khmer automatic speech recognition 査読

Kak Soky, Sheng Li, Tatsuya Kawahara, Sopheap Seng

2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA ASC 2019   1893 - 1896   2019年11月

Effective Training End-to-End ASR systems for Low-resource Lhasa Dialect of Tibetan Language

Lixin Pan, Sheng Li, Longbiao Wang, Jianwu Dang

2019 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC)   2019年11月

Class-Wise Centroid Distance Metric Learning for Acoustic Event Detection

Xugang Lu, Peng Shen, Sheng Li, Yu Tsao, Hisashi Kawai

Interspeech 2019   2019年9月

Improving Transformer-Based Speech Recognition Systems with Compressed Structure and Speech Attributes Augmentation

Sheng Li, Dabre Raj, Xugang Lu, Peng Shen, Tatsuya Kawahara, Hisashi Kawai

Interspeech 2019   2019年9月

End-to-End Articulatory Attribute Modeling for Low-Resource Multilingual Speech Recognition

Sheng Li, Chenchen Ding, Xugang Lu, Peng Shen, Tatsuya Kawahara, Hisashi Kawai

Interspeech 2019   2019年9月

Investigating Radical-Based End-to-End Speech Recognition Systems for Chinese Dialects and Japanese

Sheng Li, Xugang Lu, Chenchen Ding, Peng Shen, Tatsuya Kawahara, Hisashi Kawai

Interspeech 2019   2019年9月

Interactive learning of teacher-student model for short utterance spoken language identification. 査読

P.Shen, X.Lu, S. Li, H.Kawai

Proc. IEEE-ICASSP   2019年

INVESTIGATION OF SEQUENCE-LEVEL KNOWLEDGE DISTILLATION METHODS FOR CTC ACOUSTIC MODELS 査読

Ryoichi Takashima, Li Sheng, Hisashi Kawai

2019 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP)   6156 - 6160   2019年

Feature Representation of Short Utterances based on Knowledge Distillation for Spoken Language Identification. 査読

P.Shen, X.Lu, S. Li, H.Kawai

Proc. INTERSPEECH   2018年

Improving CTC-based Acoustic Model with Very Deep Residual Time-delay Neural Networks 査読

Sheng Li, Xugang Lu, Ryoichi Takashima, Peng Shen, Tatsuya Kawahara, Hisashi Kawai

19TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2018), VOLS 1-6   3708 - 3712   2018年

CTC LOSS FUNCTION WITH A UNIT-LEVEL AMBIGUITY PENALTY 査読

Ryoichi Takashima, Sheng Li, Hisashi Kawai

2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP)   5909 - 5913   2018年

AN INVESTIGATION OF A KNOWLEDGE DISTILLATION METHOD FOR CTC ACOUSTIC MODELS 査読

Ryoichi Takashima, Sheng Li, Hisashi Kawai

2018 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP)   5809 - 5813   2018年

Temporal Attentive Pooling for Acoustic Event Detection. 査読

X.Lu, P.Shen, S. Li, Y.Tsao, H.Kawai

Proc. INTERSPEECH   2018年

IMPROVING VERY DEEP TIME-DELAY NEURAL NETWORK WITH VERTICAL-ATTENTION FOR EFFECTIVELY TRAINING CTC-BASED ASR SYSTEMS 査読

Sheng Li, Xugang Lu, Ryoichi Takashima, Peng Shen, Tatsuya Kawahara, Hisashi Kawai

2018 IEEE WORKSHOP ON SPOKEN LANGUAGE TECHNOLOGY (SLT 2018)   77 - 83   2018年

INCREMENTAL TRAINING AND CONSTRUCTING THE VERY DEEP CONVOLUTIONAL RESIDUAL NETWORK ACOUSTIC MODELS 査読

Sheng Li, Xugang Lu, Peng Shen, Ryoichi Takashima, Tatsuya Kawahara, Hisashi Kawai

2017 IEEE AUTOMATIC SPEECH RECOGNITION AND UNDERSTANDING WORKSHOP (ASRU)   222 - 227   2017年

SEMI-SUPERVISED ENSEMBLE DNN ACOUSTIC MODEL TRAINING 査読

Sheng Li, Xugang Lu, Shinsuke Sakai, Masato Mimura, Tatsuya Kawahara

2017 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING (ICASSP)   5270 - 5274   2017年

Conditional generative adversarial nets classifier for spoken language identification 査読

Peng Shen, Xugang Lu, Sheng Li, Hisashi Kawai

Proceedings of the Annual Conference of the International Speech Communication Association, INTERSPEECH   2017-   2814 - 2818   2017年

Semi-Supervised Acoustic Model Training by Discriminative Data Selection From Multiple ASR Systems' Hypotheses 査読

Sheng Li, Yuya Akita, Tatsuya Kawahara

IEEE-ACM TRANSACTIONS ON AUDIO SPEECH AND LANGUAGE PROCESSING   24 ( 9 )   1524 - 1534   2016年9月

Confidence Estimation for Speech Recognition Systems using Conditional Random Fields Trained with Partially Annotated Data 査読

Sheng Li, Xugang Lu, Shinsuke Mori, Yuya Akita, Tatsuya Kawahara

2016 10TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING (ISCSLP)   2016年

Data Selection from Multiple ASR Systems' Hypotheses for Unsupervised Acoustic Model Training 査読

Sheng Li, Yuya Akita, Tatsuya Kawahara

2016 IEEE INTERNATIONAL CONFERENCE ON ACOUSTICS, SPEECH AND SIGNAL PROCESSING PROCEEDINGS   5875 - 5879   2016年

Automatic Lecture Transcription Based on Discriminative Data Selection for Lightly Supervised Acoustic Model Training 査読

Sheng Li, Yuya Akita, Tatsuya Kawahara

IEICE TRANSACTIONS ON INFORMATION AND SYSTEMS   E98D ( 8 )   1545 - 1552   2015年8月

Discriminative Data Selection for Lightly Supervised Training of Acoustic Model using Closed Caption Texts 査読

Sheng Li, Yuya Akita, Tatsuya Kawahara

16TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2015), VOLS 1-5   3526 - 3530   2015年

Ensemble Speaker Modeling using Speaker Adaptive Training Deep Neural Network for Speaker Adaptation 査読

Sheng Li, Xugang Lu, Yuya Akita, Tatsuya Kawahara

16TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION (INTERSPEECH 2015), VOLS 1-5   2892 - 2896   2015年

Corpus and Transcription System of Chinese Lecture Room 査読

Sheng Li, Yuya Akita, Tatsuya Kawahara

2014 9TH INTERNATIONAL SYMPOSIUM ON CHINESE SPOKEN LANGUAGE PROCESSING (ISCSLP)   442 - 445   2014年

Phoneme-level articulatory animation in pronunciation training 査読

Lan Wang, Hui Chen, Sheng Li, Helen M. Meng

SPEECH COMMUNICATION   54 ( 7 )   845 - 856   2012年9月

Cross Linguistic Comparison of Mandarin and English EMA Articulatory Data 査読

Sheng Li, Lan Wang

13TH ANNUAL CONFERENCE OF THE INTERNATIONAL SPEECH COMMUNICATION ASSOCIATION 2012 (INTERSPEECH 2012), VOLS 1-3   902 - 905   2012年

The Phoneme-level Articulator Dynamics for Pronunciation Animation 査読

Sheng Li, Lan Wang, En Qi

Proc. IALP   2011年

IELS: A Computer-aided Pronunciation Training System for Undergraduate Students 査読

Jinyu Chen, Lan Wang, Chongguo Li, Jin Hu, Sheng Li

ICETC   2010年

Generalized Multilingual Text-to-Speech Generation with Language-Aware Style Adaptation

Haowei Lou, Hye-young Paik, Sheng Li, Wen Hu, Lina Yao

arXiv preprint arXiv:2504.08274   2025年4月

Cross-lingual Embedding Clustering for Hierarchical Softmax in Low-Resource Multilingual Speech Recognition

Zhengdong Yang, Qianying Liu, Sheng Li, Fei Cheng, Chenhui Chu

arXiv   2025年1月

Joint Automatic Speech Recognition And Structure Learning For Better Speech Understanding

Jiliang Hu, Zuchao Li, Mengjia Shen, Haojun Ai, Sheng Li, Jun Zhang

arXiv   2025年1月

Multi-Prototype  Network with Swin Transformer for Open Set Recognition

Jun Wang, Haiyan Yang, Sheng Li, Di Zhou, Xingwei Chen, Juncheng Li, Yufeng Hua, Jun Shi

SSRN   2025年

A Unified Speech LLM for Diarization and Speech Recognition in Multilingual Conversations

Phurich Saengthong, Boonnithi Jiaramaneepini, Sheng Li, Manabu Okumura, Takahiro Shinozaki

arXiv   2025年

Towards Emotion Co-regulation with LLM-powered Socially Assistive Robots: Integrating LLM Prompts and Robotic Behaviors to Support Parent-Neurodivergent Child Dyads

Jing Li, Felix Schijve, Sheng Li, Yuye Yang, Jun Hu, Emilia Barakova

arXiv   2025年

Multi-Prototype  Network with Swin Transformer for Open Set Recognition

Jun Wang, Haiyan Yang, Sheng Li, Di Zhou, Xingwei Chen, Juncheng Li, Yufeng Hua, Jun Shi

SSRN   2025年

Benchmarking Japanese Speech Recognition on ASR-LLM Setups with Multi-Pass Augmented Generative Error Correction

Yuka Ko, Sheng Li, Chao-Han Huck Yang, Tatsuya Kawahara

arXiv   2024年12月

Extracting Spatiotemporal Data from Gradients with Large Language Models

Lele Zheng, Yang Cao, Renhe Jiang, Kenjiro Taura, Yulong Shen, Sheng Li, Masatoshi Yoshikawa

arXiv   2024年10月

Investigating Effective Speaker Property Privacy Protection in Federated Learning for Speech Emotion Recognition

Chao Tan, Sheng Li, Yang Cao, Zhao Ren, Tanja Schultz

arXiv   2024年10月

Enhancing Privacy of Spatiotemporal Federated Learning against Gradient Inversion Attacks

Lele Zheng, Yang Cao, Renhe Jiang, Kenjiro Taura, Yulong Shen, Sheng Li, Masatoshi Yoshikawa

arXiv   2024年7月

MOS-FAD: Improving Fake Audio Detection Via Automatic Mean Opinion Score Prediction

Wangjin Zhou, Zhengdong Yang, Chenhui Chu, Sheng Li, Raj Dabre, Yi Zhao, Tatsuya Kawahara

2024年1月

End-to-End Speech-to-Speech Translation toolkit

Wangjin Zhou, Zhengdong Yang, Chenhui Chu, Sheng Li

ACM Multimedia Asia 2023 workshop released tookit   2023年12月

FedCPC: An Effective Federated Contrastive Learning Method for Privacy Preserving Early-Stage Alzheimer's Speech Detection

Wenqing Wei, Zhengdong Yang, Yuan Gao, Jiyi Li, Chenhui Chu, Shogo Okada, Sheng Li

2023年11月

LE-SSL-MOS: Self-Supervised Learning MOS Prediction with Listener Enhancement

Zili Qi, Xinhui Hu, Wangjin Zhou, Sheng Li, Hao Wu, Jian Lu, Xinkang Xu

2023年11月

Reprogramming Self-supervised Learning-based Speech Representations for Speaker Anonymization

Xiaojiao Chen, Sheng Li, Jiyi Li, Hao Huang, Yang Cao, Liang He

2023年11月

GhostVec: A New Threat to Speaker Privacy of End-to-End Speech Recognition System

Xiaojiao Chen, Sheng Li, Jiyi Li, Hao Huang, Yang Cao, Liang He

2023年11月

Towards Speech Dialogue Translation Mediating Speakers of Different Languages

Shuichiro Shimizu, Chenhui Chu, Sheng Li, Sadao Kurohashi

arXiv:2305.09210   2023年5月

Robust Voice Activity Detection Using an Auditory-Inspired Masked Modulation Encoder Based Convolutional Attention Network

Nan LI, Longbiao Wang, Meng Ge, Masashi Unoki, Sheng Li, Jianwu Dang

2023年

Speech-text based multi-modal training with bidirectional attention for improved speech recognition

Yuhang Yang, Haihua Xu, Hao Huang, Eng Siong Chng, Sheng Li

arXiv:2211.00325   2022年10月

Tendency-and-Attention-Informed Deep Learning for ENSO Forecasts

Shen Qiao, Cuicui Zhang, Xuefeng Zhang, Kai Zhang, Hao Shi, Sheng Li, Hao Wei

2022年6月

Fusion of Self-supervised Learned Models for MOS Prediction

Zhengdong Yang, Wangjin Zhou, Chenhui Chu, Sheng Li, Raj Dabre, Raphael Rubino, Yi Zhao

CoRR abs/2204.04855   2022年4月

Hierarchical Softmax for End-to-End Low-resource Multilingual Speech Recognition.

Qianying Liu, Yuhang Yang, Zhuo Gong, Sheng Li, Chenchen Ding, Nobuaki Minematsu, Hao Huang, Fei Cheng, Sadao Kurohashi

abs/2204.03855   2022年4月

Voice-Indistinguishability: Protecting Voiceprint in Privacy-Preserving Speech Data Release

Yaowei Han, Sheng Li, Yang Cao, Qiang Ma, Masatoshi Yoshikawa

CoRR abs/2004.07442   2020年6月

Deep progressive multi-scale attention for acoustic event classification

Xugang Lu, Peng Shen, Sheng Li, Yu Tsao, Hisashi Kawai

CoRR abs/1912.12011   2019年4月

System Description for the CN-Celeb Speaker Recognition Challenge 2022

Guangxing Li, Wangjin Zhou, Sheng Li, Yi Zhao, Hao Huang, Jichen Yang

CNSRC (the CN-Celeb Speaker Recognition Challenge), Speaker Odyssey 2022  2022年6月 

Study on Relationship Between Speakers' Physiological Structure and Acoustic Speech Signals: Data-Driven Study Based on Frequency-Wise Attentional Neural Network

Li Kai, Xugang Lu, Masato Akagi, Jianwu Dang, Sheng Li, Unoki Masashi

信学技報  2022年8月 

異言語話者の対話を仲介する音声対話翻訳

清水 周一郎, 褚 晨翚, 李 勝, 黒橋 禎夫

言語処理学会第 29 回年次大会（NLP2023）  2023年3月 

Towards Security-aware Speech Recognition System, 招待

Sheng Li

NECTEC-NICT joint seminar  2023年8月 

Cross-lingual Mapping for Hierarchical Softmax in Low-Resource Multilingual Speech Recognition

Zhengdong Yang, Qianying Liu, Sheng Li, Chenhui Chu, Fei Cheng, Sadao Kurohashi

ASJ 2023 autumn  2023年9月 

Correction while Recognition: Combining Pretrained Language Model for Taiwan-accented Speech Recognition 招待

Sheng Li

Joint Seminar with NECTEC Language Understand Group  2023年11月 

System Description for the Voiceprivacy Challenge 2022

Xiaojiao Chen, Guangxing Li, Wangjin Zhou, Sheng Li, Yang Cao, Hao Huang, Yi Zhao

Voiceprivacy Challenge 2022  2022年9月 

VoicePrivacy Challenge: System description

X. Chen, G. Li, H. Huang, W. Zhou, Y. Cao, S. Li, Y. Zhao

VoicePrivacy 2022 Challenge Workshop (Interspeech2022)  2022年9月 

Domain and Language Adaptation of Large-scale Pretrained Model for Speech Recognition of Low-resource Language

Kak Soky, Sheng Li, Chenhui Chu, Tatsuya Kawahara

IEICE Tech. Rep. (信学技報)  2022年12月 

Self-Supervised Learning MOS Prediction with Listener Enhancement 招待

Sheng Li

VoiceMOS mini workshop  2023年11月 

Hierarchical Softmax for End-to-End Low-resource Multilingual Speech Recognition 招待

Zhengdong Yang

ICT-innovation 2023 (Kyoto Univ.)  2024年2月 

Investigating effective methods for combining large language model with speech recognition system

李 勝, 楊 正東, 周 汪勁, 褚 晨翚, 河井 恒

日本音響学会第151回(2024年春季)研究発表会  2024年3月 

Combining Large Language Model with Speech Recognition System in Low-resource Settings

李 勝, 楊 正東, 周 汪勁, 褚 晨翚, Chen Chen, Chng Eng Siong, 河井 恒

言語処理学会第30回年次大会  2024年3月 

Enhancing Multi-Step Reasoning in Language Models with Synthetic Math Data Augmentation (HP_Fighters team)

Jieqing Mei, Jiyi Li, Qianying Liu, Sheng Li

NLP2025 ワークショップ：大規模言語モデルのファインチューニング技術と評価  2025年3月 

大規模言語モデルを用いた英語学習者発話のCEFR-Jレベル推定

隆宏篠﨑, 秋太朗佐藤, 李勝

CEFR-J 2025国際シンポジウム  2025年3月 

The System Description for VoiceMOS Challenge 2022 (main/ood tasks)

2022年 

Application of the RFID based audio service in regional navigation system

S. Li, C. Li

Bulletin of Advanced Technology Research  2009年 

The Phoneme-level Articulator Dynamics for 3D Pronunciation Animation for Chinese

S. Li, K. Luo, L. Wang

Bulletin of Advanced Technology Research  2011年 

Phoneme-level articulatory animation in pronunciation training using EMA data

李 勝

Speech Synthesis Lab., Tsinghua University, host: Prof. Zhiyong Wu.  2012年 

Vocal Tract Length Normalization for Chinese Spontaneous Speech Recogntion

李 勝

Technical-report.（Kyoto university）  2013年 

Multi-lingual transformer training for Khmer automatic speech recognition

K. Soky, S. Li, T. Kawahara, S. Seng

Interspeech 2020 Satellite Workshop (SLIMTS2020). (abstract paper) 

Voice-Indistinguishability: Protecting Voiceprint in Privacy-Preserving Speech Data Release

Y. Han, S. Li, Y. Cao, Q. Ma, M. Yoshikawa

Interspeech 2020 Satellite Workshop (SLIMTS2020). (abstract paper)(invited report) 

Automatic Transcription of Chinese Spoken Lectures

S. Li, M. Mimura, T. Kawahara

Acoustical Society of Japan, autumn  2013年 

DNN-based Acoustic Modeling and Decoding for Chinese Spontaneous Speech Recogntion with HTK

李 勝

Technical-report.（Kyoto university）  2014年 

Lightly-supervised training and confidence estimation by using CRF classifiers,

李 勝

Speech and Cognition Lab., Tianjin University, host: Prof. Jianwu Dang and Prof. Kiyoshi Honda.  2014年 

Effective combination of multiple ASR hypotheses with CRF-based classifiers

S. Li, Y. Akita, T. Kawahara

Acoustical Society of Japan, autumn  2015年 

Discriminative data selection from multiple ASR systems' hypotheses for unsupervised acoustic model training

S. Li, Y. Akita, T. Kawahara

IPSJ SIG-SLP-109-8  2015年 

Data Selection Assisted by Caption to Improve Acoustic Modeling for Lecture Transcription

S. Li, Y. Akita, T. Kawahara

Acoustical Society of Japan, spring  2014年 

Classifier-based data selection for lightly-supervised training of acoustic model for lecture transcription

S. Li, Y. Akita, T. Kawahara

IPSJ SIG-SLP-102-4  2014年 

Unsupervised Training of Deep Neural Network Acoustic Models for Lecture Transcriptions

S. Li, Y. Akita, T. Kawahara

Acoustical Society of Japan, autumn  2014年 

Incorporating divergences from hypotheses of multiple ASR systems to improve unsupervised acoustic model training

S. Li, Y. Akita, T. Kawahara

Acoustical Society of Japan  2015年 

Diversity-driven Semi-supervised Ensemble DNN Acoustic Model Training

S. Li, X. Lu, S. Sakai, T. Kawahara

Acoustical Society of Japan, autumn  2016年 

Very deep convolutional residual network acoustic models for Japanese lecture transcription

S. Li, X. Lu, P. Shen, H. Kawai

Acoustical Society of Japan, autumn  2017年 

cGAN-classifier: Conditional Generative Adversarial Nets for Classification

P. Shen, X. Lu, S. Li, H. Kawai

Acoustical Society of Japan, autumn  2017年 

CTC 音響モデルのための knowledge distillation 方式の検討

R.Takashima, S. Li, H. Kawai

Acoustical Society of Japan, spring  2018年 

Short utterance-based spoken language identification

P. Shen, X. Lu, S. Li, H. Kawai

Acoustical Society of Japan, autumn  2018年 

Training CTC and LFMMI-based TDNN with CNTK

李 勝

NICT internal report  2018年 

CTC音響モデルのためのシーケンスレベル知識蒸留法の検討

高島 遼一, 李 勝, 河井 恒

IPSJ SIG-SLP  2018年 

An Empirical Comparison of Sequence Training Methods for the Very Deep Time-delay Neural Network

S. Li, X. Lu, R.Takashima, P. Shen, H. Kawai

Acoustical Society of Japan, autumn  2018年 

Improving CTC-based acoustic model with very deep residual neural network

S. Li, X. Lu, R.Takashima, P. Shen, H. Kawai

Acoustical Society of Japan, spring  2018年 

End-to-end音声認識技術の研究

李 勝

情報通信フェア2019  2019年9月 

End-to-End Articulatory Attribute Modeling for Low-resource Multilingual Speech Recognition

S. Li, C. Ding, X. Lu, P. Shen and H. Kawai,

Acoustical Society of Japan, spring  2020年 

Joint Training End-to-End Systems for Speech and Speaker Recognition with Speaker Attributes,

S. Li, X. Lu, R. Dabre, P. Shen and H. Kawai,

Acoustical Society of Japan, spring  2020年 

Improvement of x-vector for short utterance spoken language identification,

P. Shen, X. Lu, K. Sugiura, S. Li, H. Kawai,

Acoustical Society of Japan, spring  2020年 

Investigation of multi-domain training for speech recognition,

P. Shen, X. Lu, S. Li, H. Kawai

Acoustical Society of Japan, spring  2019年3月 

Voice-Indistinguishability: Protecting Voiceprint in Privacy-Preserving Speech Data Release 招待

Y. Han, S. Li, Y. Cao, Q. Ma, M. Yoshikawa

INTERSPEECH 2020 Satellite Workshop (SLIMTS2020) (invited report)  2020年10月 

A Mixture of Character and Word End-to-End System for Keyword Spotting 招待

H. Zhang, S. Ueno, M. Mimura, S. Li, W. Zhang, T. Kawahara

INTERSPEECH 2020 Satellite Workshop (SLIMTS2020)(full paper)  2020年9月 

Investigation of Effectively Synthesizing Code-switched Speech Using Highly Imbalanced Mix-lingual Data and mask embedding,

S. Guo, L. Wang, S. Li, J. Zhang, C. Gong, Y. Wang, J. Dang, K. Honda

INTERSPEECH 2020 Satellite Workshop (SLIMTS2020).  2020年9月 

Multi-lingual transformer training for Khmer automatic speech recognition, 招待

K. Soky, S. Li, T. Kawahara, S. Seng

INTERSPEECH 2020 Satellite Workshop (SLIMTS2020).  2020年9月 

System Description for Voice Privacy Challenge (Kyoto Team).

Y. Han, S. Li, Y. Cao, M. Yoshikawa

In special session of INTERSPEECH2020 (VoicePrivacy challenge 2020)  2020年9月 

Description of End-to-End Dialect Identification System (accepted in INTERSPEECH2021)

Ding Wang, Shuaishuai Ye, Xinhui Hu, Sheng Li, Xinkang Xu

In special session of INTERSPEECH2021 (OLR2020 challenge)  2021年9月 

Adversarial Attack and Defense on Deep Neural Network-based Voice Processing Systems: An Overview

Xiaojiao Chen, Sheng Li, Hao Huang

NCMMSC2021  2021年10月 

System description of Alzheimer's disease early detection (Silk-road team, short speech track)

Wenqing Wei, Rui Wong, Sheng Li, Yachao Guo, Hao Huang

Alzheimer's disease detection challenge (NCMMSC2021)  2021年10月 

System description of joint speech and accent recognition (published in APSIPA ASC, 2021)

Y. Peng, J. Zhang, H. Zhang, H. Xu, H. Huang, S. Li, E.S. Chng

in Challenge of Interspeech2020 Accented English Speech Recognition, AESR, 2020.  2021年12月 

End-to-End Speech Translation with Cross-lingual Transfer Learning

S Shimizu, C Chu, S Li, S Kurohashi

NLP2021  2021年 

Comparison of End-to-End Models for Joint Speaker and Speech Recognition

K Soky, S Li, M Mimura, C Chu, T Kawahara

IEICE-SP  2021年 

The RoyalFlush(NICT) System Description for AP21-OLR Challenge 招待

Ding Wang, Shuaishuai Ye, Xinhui Hu, Sheng Li

AP21-OLR Challenge  2022年1月 

Multilingual Retrieval-Augmented Generation Enhanced LLM-based Speech Recognition

王 鵬程, 李 勝, 篠崎 隆宏

日本音響学会第155回(2026年春季)研究発表会  2026年3月 

指示再構成手法に基づく言語モデルベース音声合成のスタイル制御

Zhu Shiao, Li Sheng, 篠崎 隆宏

日本音響学会第155回(2026年春季)研究発表会  2026年3月 

音声認識および音声翻訳における生成的誤り訂正のための多言語ベンチマーク

Zhengdong Yang, Zhen Wan, Sheng Li, Chao-Han Huck Yang, Chenhui Chu

言語処理学会 第32回年次大会  2026年3月 

言語識別モデルの訓練方法及び装置、並びにそのためのコンピュータプログラム

沈鵬, ルーシュガン, 李勝, 河井恒

推論器、推論プログラムおよび学習方法

李 勝, ルー・シュガン, 丁 塵辰, 河原 達也, 河井 恒

Julius decoder with Kaldi feature extractor

VTLN for Julius/HTK acoustic model

Julius for speech foundation models

https, github.com/halspeech/julius-speech-foundation-model

foundation models for Tibetan language

online speech recognition module for Erica the human robot

task1: speech recognition error correction using LLM

2024年12月   SLT2024 grand challenge LLM GER  

top2 in one track

2023年12月   ICASSP2024 ICMC-ASR (In-Car Multi-Channel Automatic Speech Recognition) Challenge  

1st place in one track in ASRU2023 special session: VoiceMOS challenge

2023年12月  

IEEE-SPS grant for IEEE-ICASSP2023 oral presentation (Co-supervised PhD student Qianying Liu)

2023年5月   IEEE signal processing society  

1st place in 6 indexes (total 16) of Main/OOD tracks in INTERSPEECH2022 special session: VoiceMOS challenge

2022年  

3rd/4th place in constrained/unconstrained resource multilingual ASR tracks of OLR2021 challenge

2021年12月   Oriental language recognition challenge 2021  

Supervised student (Soky Kak) got best student paper nomination

2021年11月   O-COCOSDA2021  

成績優秀表彰優秀賞（団体）

2021年6月   国立研究開発法人情報通信研究機構 (NICT)  

Travel Grant

2020年9月   ISCA   Singing Voice Extraction with Attention based Spectrograms Fusion

Supervised student Hao Shi

Travel Grant

2020年9月   ISCA   Staged Knowledge Distillation for End-to-End Dysarthric Speech Recognition and Speech Attribute Transcription

supervised student Yuqin Lin

ICME 2020 best student paper nomination, selected as journal paper in IEEE Trans Multimedia (TMM)

2020年7月  

2020年度 国際展開ファンド (新しい提案得点 top1)

2020年5月   国立研究開発法人情報通信研究機構 (NICT)  

テニュアトラック研究者として助成金を獲得 (2019年度はわずか3名)

2019年   情報通信研究機構  

第34回 テレコムシステム技術学生賞

2018年   電気通信普及財団  

李 勝

2012-2016 入学料・授業料の全部免除

2016年3月   京都大学  

Paper nominated as ACM/IEEE Trans. Audio, Speech \& Language Process. cover

2016年  

李 勝

ポートランド，Interspeech会議へIBM 旅行補助賞金

2012年   IBM Research  

李 勝

京都大学推薦国費留学生特別配置入学

2012年   日本文部科学省  

李 勝

職員優秀賞

2011年   中国科学院  

李 勝

香港青年起業家プログラムの創造的な企画賞

2011年  

李 勝

勵志奨学金

2004年   南京大学  

李 勝

香港陳蔭川財団大学新入生優秀者奨学金

2002年  

李 勝

化学オリンピック二等賞,生物学オリンピック三等賞

2002年   中国江蘇省  

李 勝

Phantom in the Opera -- the Vulnerabilities of Speech Interface for Robotic Dialogue System

2021年4月 - 2023年4月

日本学術振興会(JSPS)  科学研究費助成事業(KAKEN)  若手研究

李 勝

Advanced Multilingual End-to-End Speech Recognition

2020年4月 - 2022年4月

国立研究開発法人情報通信研究機構 (NICT)  NICT tenure-track start-up funding 

李 勝

Bridging Eurasia -- Multilingual Speech Recognition for Silkroad

2020年4月 - 2022年4月

国立研究開発法人情報通信研究機構 (NICT)  NICT international funding 

李 勝

Speaker De-identification with Provable Privacy in Speech Data Release

2020年4月 - 2021年4月

NII  Open Collaborative Research 

Next generation multilingual End-to-End speech recognition (from G30 to G200)

2019年10月 - 2021年3月

独立行政法人 日本学術振興会  科学研究費助成事業(KAKEN)  研究活動スタート支援

李 勝