AI & ML
Sleep2Word: Peripheral-to-EEG Translation via Duration-Aware Wordization
arXiv cs.SD0 views
arXiv:2611.21643v1 Announce Type: cross Abstract: Estimating full-night electroencephalography (EEG) spectrograms from peripheral measurements could extend EEG-informed sleep analysis to recordings acquired without EEG. This task requires compact representations of signals with different temporal structures. We introduce Sleep2Word, a framework for translating respiration, electrocardiography (ECG), or photoplethysmography (PPG) into EEG spectrograms through duration-aware physiological words. Building on context-dependent chunking, Sleep2Word groups physiological embeddings into variable-duration chunks and jointly quantizes their content and duration into modality-specific wordbooks. A block-autoregressive translator then predicts target EEG word identities and occurrence-specific duration refinements within fixed-duration blocks. This design accommodates independent source and target wordbooks, limits temporal drift, and shortens the autoregressive decoding path. Trained on over 20K PSG cases across 9 datasets, Sleep2Word consistently outperforms existing spectrogram generation baselines in EEG spectrogram reconstruction, sleep staging, arousal detection, and survival prediction. Compressing full night sequences by up to 69.7%, the learned words yield a favorable accuracy-compute trade-off. Sleep event analysis further shows that the learned words capture physiologically plausible associations across modalities, suggesting their potential for interpretable cross-modal analysis.
Source:https://arxiv.org/abs/2611.21643PreviousBack to Mel: Learning to Bridge Fidelity and Perception in Generative Speech EnhancementNextScore-Informed Transformer for Refining MIDI Velocity in Automatic Piano Transcription
Related posts
TacBridge: Learning Unified Tactile Representations through Cross-Sensor Correspondence
0arXiv cs.RO
Transferable Neural CBFs via Generalized Closure
0arXiv cs.RO
QTOP: Scaling Humanoid Motion Tracking with Quantile Critics
0arXiv cs.RO
Non-Imaging Optical Tactile Sensors for Robotics: Transduction Principles, System Integration, and Robotic Applications
0arXiv cs.RO
Robotic Reward Models in the Foundation-Model Era
0arXiv cs.RO
Selective Sensor Acquisition for Multimodal Place Recognition
0arXiv cs.RO