About Me
I am a PhD student in Electrical and Computer Engineering at Johns Hopkins University, under the supervision of Prof. Mounya Elhilali. My research focuses on Audio Signal Processing, Generative Models, and Music Technology.
Outside of academia, I am also a Music Producer, having worked on many hip-hop and pop tracks in the Chinese entertainment industry.
For more details on my academic and professional journey, you can view my CV.
I am open to collaborations in audio/speech signal processing and music technology. Feel free to reach out at: jhai2@jhu.edu
News
- 2024.09: 🤗 EzAudio was selected to HuggingFace’s Daily Paper
- 2024.06: 🎉 Two papers accepted at Interspeech 2024: DreamVoice and Noise-robust Speech Separation
- 2023.12: 🎉 Two papers accepted at ICASSP 2024: DPM-TSE a study on EEG-based Auditory Attention Decoding
- 2023.09: 🎉 One paper on Multimodal Sentiment Analysis accepcted at ASRU 2023
- 2023.09: 🎉 I passed the Departmental Qualifying Exam at JHU
- 2023.07: 🎉 Diff-Pitcher accepted at WASPAA 2023
Selected Publications
Audio Signal Processing
-
2024pre-printEzAudio: Enhancing Text-to-Audio Generation with Efficient Diffusion Transformer | Jiarui Hai, Yong Xu, Hao Zhang, Chenxing Li, Helin Wang, Mounya Elhilali, Dong Yu | [paper] [page] [code] [space] -
2024pre-printSoloAudio: Target Sound Extraction with Language-oriented Audio Diffusion Transformer | Helin Wang*, Jiarui Hai*, Yen-Ju Lu, Karan Thakkar, Mounya Elhilali, Najim Dehak | [paper] [page] [code] -
2024pre-printSSR Speech: Towards Stable, Safe, and Robust Zero-shot Text-based Speech Editing and Synthesis | Helin Wang, Meng Yu, Jiarui Hai, Chen Chen, Yuchen Hu, Rilin Chen, Najim Dehak, Dong Yu | [paper] [page] [code] -
2024InterspeechDreamVoice: Text-Guided Voice Conversion | Jiarui Hai*, Karan Thakkar*, Helin Wang, Zengyi Qin, Mounya Elhilali | [paper] [code] [page] -
2024InterspeechNoise-robust Speech Separation with Fast Generative Correction | Helin Wang, Jesus Villalba, Laureano Moro-Velazquez, Jiarui Hai, Thomas Thebaud, Najim Dehak | [paper] -
2024ICASSPDPM-TSE: A Diffusion Probabilistic Model for Target Sound Extraction | Jiarui Hai*, Heilin Wang*, Dongchao Yang, Karan Thakkar, Najim Dehak, Mounya Elhilali | [paper] [page] [code] -
2024ICASSPInvestigating Self-Supervised Deep Representations for EEG-based Auditory Attention Decoding | Karan Thakkar, Jiarui Hai, Mounya Elhilali | [paper] -
2023ASRUBoosting Modality Representation with Pre-trained Models and Multi-task Training for Multimodal Sentiment Analysis | Jiarui Hai*, Yu-Jeh Liu*, Mounya Elhilali | [paper] -
2023WASPAADiff-Pitcher: Diffusion-based Singing Voice Pitch Correction | Jiarui Hai, Mounya Elhilali | [paper] [page] [code] -
2022ICASSPProgressive Teacher-Student Training Framework for Music Tagging | Rui Lu, Baigong Zheng, Jiarui Hai, Fei Tao, Zhiyao Duan, Ji Liu | [paper]
Biomedical Informatics and Data Science
-
2023JAMIA openLeveraging Natural Language Processing and Geospatial Time Series Model to Analyze COVID-19 Vaccination Sentiment Dynamics on Tweets | Jiancheng Ye*, Jiarui Hai*, Zidan Wang, Chumei Wei, Jiacheng Song -
2022JMIRSocial Networking Service, Patient-Generated Health Data, and Population Health Informatics: National Cross-sectional Study of Patterns and Implications of Leveraging Digital Technologies to Support Mental Health and Well-being| Jiancheng Ye, Zidan Wang, Jiarui Hai -
2022Journal of Data ScienceComparison of Methods for Imputing Social Network Data | Ziqian Xu, Jiarui Hai, Yutong Yang, Zhiyong Zhang
Educations
- 2022.08 - Present, Johns Hopkins University, Baltimore, United States
- Doctor of Philosophy | Electrical and Computer Engineering
- Advisor: Prof. Mounya Elhilali
- 2020.08 - 2022.06, Tsinghua University, Beijing, China
- Master of Engineering | Civil Engineering
- Big Data Program Member | Big Data Research Center
- 2016.08 - 2020.06, Tsinghua University, Beijing, China
- Bachelor of Engineering | Civil Engineering
- Bachelor of Science | Business Analytics
Experiences
- 2024.05 - 2024.08, Tencent Americas, Bellevue, USA
- Research Intern | AI lab
- Mentor: Dr. Yong Xu, Dr. Hao Zhang, and Dr. Dong Yu
- 2021.06 - 2022.01, Kuaishou, Beijing, China
- Music Technology Intern | AI Platform
- Advisor: Prof. Zhiyao Duan
- 2021.06 - 2021.09, University of Notre Dame, Notre Dame, United States
- Summer Research | Department of Psychology
- Advisor: Prof. Zhiyong Zhang
- 2019.06 - 2019.09, University of Hong Kong, Hongkong, China
- Summer Research | Business School
- Advisor: Prof. Hailiang Chen
Music Activities
- 2021.08, Hosted a lecture about music production at Modern Sky Studio
- 2021.05, Worked in the production of this rap song for the TV show “HipHop Bank“
- 2021.04, Top New Producer (1%), BeatsHome Hip-hop Production Contest, China
Copyright © Jiarui Hai. Powered by Jekyll with AcadHomepage theme.