Hello! I am Payal (hear pronunciation). I am a final year PhD candidate in Computer Engineering at Northwestern University advised by Prof. Qi Zhu. I work on machine learning for time-series under practical constraints, with a focus on healthcare and audio applications. Previously, I have been a student researcher at Mitsubishi Electric Research Labs (Summer 2025) and at Meta Reality Labs (Summers 2024 and 2023). My key research interests are:

1. Practical Multimodal Learning: I design efficient architectures for handling 10+ heterogeneous sensing modalities without combinatorial complexity. My work on MAESTRO (NeurIPS Spotlight 2025) introduces sparse adaptive cross-attention with symbolic tokenization, replacing expensive pairwise operations with scalable multimodal fusion. I showed that explicitly encoding missingness improves longitudinal signal monitoring for person identification, achieving top performance in the ICASSP’23 Signal Processing Grand Challenge. I also studied missingness in multimodal disfluency detection (InterSpeech’24), where opportunistically incorporating video when available enhanced performance.

2. Generalizable Time-Series Representations: I build models robust to distribution shifts from device changes and signal nonstationarity—common in real-world applications. I proposed a phase-anchored generalizable representation learning framework that is performant across a wide range of applications from sleep stage classification using Electroencephalogram (EEG) to gesture recognition using Electromyography (EMG) (TMLR’25, TS4H@NeurIPS’25).

3. Human-Centric Applications: I develop ML methods for: a) Subjective Labels: I designed custom optimization objectives to monitor physical fatigue in manufacturing workers at Boeing and John Deere (PNAS Nexus’24) and multi-label objectives to model auditory attention with Meta Reality Labs. b) Data Constraints: I designed data distillation and self-supervised frameworks for disfluency detection (ICASSP’23) and achieved state-of-the-art silent speech understanding from surface EMG without paired audio using LLMs (ACL’25).

From 2017 to 2021, I was a Design Engineer at Analog Devices Inc., where I worked on the consumer electronics team and supported the tape-out of two chips. I earned my Master’s in Electrical Engineering from IIT Madras, India, where I designed an end-to-end cardiac wrist-wearable (sensor and on-device algorithms) robust to skin pigmentation variations. My research interests are a product of my broad system level experience in consumer sensing devices that helps me prioritize pragmatism while developing state-of-the-art machine learning methods for sensing applications.

I am seeking full-time research positions in industry and academia for Spring/Summer 2026. Please review my CV or contact me to discuss opportunities.

News

  • Oct 2025 – Invited talk at the Real-time Communications Conference and Expo at Illinois Institute of Technology
  • Sept 2025 – Our paper Phase-driven Generalizable Representation Learning for Nonstationary Time Series Classification accepted at TMLR 2025 and TS4H Workshop at NeurIPS 2025
  • Sept 2025 🌟 – Our paper MAESTRO: Adaptive Sparse Attention and Robust Learning for Multimodal Dynamic Time Series accepted at NeurIPS 2025 as a spotlight (top 3%)
  • June 2025 – Interning with Mitsubishi Electric Labs (MERL), Boston, MA as a Research Scientist. Reach out if you are here and want to collaborate (or just catch up over coffee ☕)
  • May 2025 – Our paper Can LLMs Understand Unvoiced Speech? Exploring EMG-to-Text Conversion with LLMs accepted at ACL Main Conference
  • April 2025 – Selected as one of six speakers to present a Lightning Talk at CoDEX symposium, Northwestern University
  • Jan 2025 – Submitted our paper on head-orientation based acoustic zones' localization to IMWUT
  • Dec 2024 🏃‍♀️ – Successfully passed my PhD Prospectus examination
  • Oct 2024 📰 – Our paper Wearable Network for Multi-Level Physical Fatigue Prediction in Manufacturing Workers accepted in PNAS Nexus. Featured by Northwestern Engineering, PopSci, and other outlets
  • Aug 2024 🏆 – Selected as EECS Rising Star 2024. Invited to MIT workshop (article)
  • June 2024 – Started summer internship with Meta Reality Labs as a Research Scientist
  • June 2024 – Our paper Missingness-resilient Video-enhanced Multimodal Disfluency Detection accepted for oral presentation at InterSpeech 2024
  • Feb 2024 – Internship work with Meta Reality Labs on Non-verbal Hands-free Control for Smart Glasses using Teeth Clicks now live
  • Oct 2023 – Collaborating with Meta Reality Labs Audio Research group as part-time student researcher
  • July 2023 – Our paper Effect of Attention and Self-Supervised Speech Embeddings on Non-Semantic Speech Tasks accepted at ACM Multimedia 2023 Grand Challenges Track
  • June 2023 – Interning with Meta Reality Labs, Redmond, WA as a Research Scientist. Reach out if you are here and want to collaborate (or just catch up over coffee ☕)
  • Feb 2023 – Our paper Efficient Stuttering Event Detection using Siamese Networks accepted at ICASSP 2023
  • Feb 2023 – Secured third place in e-Prevention Challenge at ICASSP 2023. Invited to present Person Identification with Wearable Sensing using Missing Feature Encoding and Multi-Stage Modality Fusion

Selected Papers

MAESTRO: Adaptive Sparse Attention and Robust Learning for Multimodal Dynamic Time Series
NeurIPS 2025 🌟 Spotlight (Top 3%)
Payal Mohapatra, Yueyuan Sui, Akash Pandey, Stephen Xia, Qi Zhu
Phase-driven Generalizable Representation Learning for Nonstationary Time Series Classification
TMLR 2025 & TS4H Workshop at NeurIPS 2025
Payal Mohapatra, Lixu Wang, Qi Zhu
Can LLMs Understand Unvoiced Speech? Exploring EMG-to-Text Conversion with LLMs
ACL 2025
Payal Mohapatra*, Akash Pandey*, Xiaoyuan Zhang*, Qi Zhu
Missingness-resilient Video-enhanced Multimodal Disfluency Detection
InterSpeech 2024 🎤 Oral
Payal Mohapatra*, Shamika Likhite*, Subrata Biswas, Bashima Islam, Qi Zhu

Selected Recognition

  • EECS Rising Star, MIT Workshop (2024)
  • Top Performer, Computational Paralinguistics Challenge (ComParE), ACM Multimedia 2023
  • Third Place, e-Prevention Challenge, ICASSP 2023
  • Best Research Video, Design Automation Conference Young Fellowship, (2021)
  • Winner, Make-in-India Anveshan Design Challenge, Analog Devices Inc. (2017)

Services

  • Program Committee : 3rd ACM International Workshop on Intelligent Acoustic Systems and Applications (IASA 2025)
  • Reviewer:
    • Journals : IEEE Internet of Things’25, IEEE Transactions on Computer-Aided Design of Integrated Circuits and Systems’25, IEEE Transactions on Automation Science and Engineering’25
    • Conferences : ASP-DAC’26, ICASSP’25, ICLR’25, IMWUT’24, IROS’24, ICASSP’24
    • Workshops : TS4H’25 (Neurips), IEEE MLSP 2025, TSALM’24 (Neurips)
    • External Reviewer: ASP-DAC’24, EMSOFT’23, ICCPS’23, NSys’22
    • Book Reviews: Cambridge University Press early reader’s reviewing
  • Organize biweekly inter-laboratory Cyber-Physical Systems study group at Northwestern
  • Active participant in the ML reading group at Northwestern, covering topics like XGBoost, MultiModal Learning, and Non-Stationary Transformers
  • Mentoring:
    • 2025: Xiaoyuan Zhang, Haodong Yang (MS students, Computer Engineering, Northwestern)
    • 2024: Talia Ben-Naim (MS students, Computer Engineering, Northwestern), Brooks Hu (Undergraduate, Computer Engineering, Northwestern), Mark Zhang (MS student, Mechanical Engineering, Northwestern)
    • 2023:
      • Yueyuan Sui (MS, Northwestern University → PhD, Northwestern University), Shamika Likhite (MS, Northwestern University → SWE, SpeechAce)
      • Kiva Joseph (Undergraduate, Computer Engineering, Northwestern)
      • Jonathan Li Chen, Ben Forbes, Justin Lau (Undergraduates, Mechanical Engineering, Northwestern)
    • 2022: Devashri Naik (MS, Northwestern University → PhD, University of Illinois at Chicago), Jinjin Cai (MS, Northwestern University → PhD, Purdue University)