AI & ML
Sleep2Word: Peripheral-to-EEG Translation via Duration-Aware Wordization
arXiv cs.SD0 views
arXiv:2611.21643v1 Announce Type: cross Abstract: Estimating full-night electroencephalography (EEG) spectrograms from peripheral measurements could extend EEG-informed sleep analysis to recordings acquired without EEG. This task requires compact representations of signals with different temporal structures. We introduce Sleep2Word, a framework for translating respiration, electrocardiography (ECG), or photoplethysmography (PPG) into EEG spectrograms through duration-aware physiological words. Building on context-dependent chunking, Sleep2Word groups physiological embeddings into variable-duration chunks and jointly quantizes their content and duration into modality-specific wordbooks. A block-autoregressive translator then predicts target EEG word identities and occurrence-specific duration refinements within fixed-duration blocks. This design accommodates independent source and target wordbooks, limits temporal drift, and shortens the autoregressive decoding path. Trained on over 20K PSG cases across 9 datasets, Sleep2Word consistently outperforms existing spectrogram generation baselines in EEG spectrogram reconstruction, sleep staging, arousal detection, and survival prediction. Compressing full night sequences by up to 69.7%, the learned words yield a favorable accuracy-compute trade-off. Sleep event analysis further shows that the learned words capture physiologically plausible associations across modalities, suggesting their potential for interpretable cross-modal analysis.
Source:https://arxiv.org/abs/2611.21643PreviousBack to Mel: Learning to Bridge Fidelity and Perception in Generative Speech EnhancementNextScore-Informed Transformer for Refining MIDI Velocity in Automatic Piano Transcription
Related posts
CMM. The cursed language that never really took off.
0dev.to Watercooler

I built a GitHub Action that scores pull requests and never auto-closes them
0dev.to GitHub
I built a Windows app to track Instagram follower and profile changes over time
0dev.to GitHub

Designing a Splash-Zone Ambient Lamp: What IP44 Actually Means in Practice
0dev.to Design
A Canva alternative for Instagram posts, stories and carousels with your brand applied in one click
0dev.to Design
What Might the Next Generation of AI Look Like?
0dev.to Discuss