AI & ML
A 1000-hour EEG-EMG-audio dataset of Japanese speech production
arXiv cs.HC0 views
arXiv:2606.01264v2 Announce Type: replace-cross Abstract: We present a multimodal dataset of 1020 hours of simultaneously recorded scalp electroencephalography (EEG), facial electromyography (EMG), and speech audio from three healthy native Japanese speakers during open-vocabulary overt speech, covert repetition and speech listening. Recordings were acquired in many sessions over several months with three EEG systems of 61-128 channels, an ultra-high-density system (g.Pangolin) and two cap-type systems (g.SCARABEO and eego sports). Each session provides time-synchronized EEG, facial EMG, and audio, together with speech-event annotations and transcriptions. Although collected with speech decoding as a primary motivation, the dataset also supports work on multimodal signal processing, artifact modeling, longitudinal and cross-device adaptation, and EEG representation learning. Technical validation used power spectral density and event-related potential analyses to characterise spectral profiles and time-locked responses across participants, devices, and tasks. The dataset is available in Brain Imaging Data Structure (BIDS) format from Harvard Dataverse under controlled access for research use. Its speech audio is voice-masked.
Source:https://arxiv.org/abs/2606.01264PreviousHuman-Data Interaction, Exploration, and Visualization Systems in the AI Era: Challenges and OpportunitiesNextEE-Motion: An EEG-based Web Architecture for Live Affective Music Recommendation
Related posts
Introduction to CUDA Beyond the Syntax
0Hacker News New
Physics AI: The illusion of ground truth
0Hacker News New
RiddleBell Puzzle Alarm Clock
0Hacker News New
Open WebUI – Open Terminal: A Computer for Your AI Agents
0Hacker News New
LLMs abandon correct climate facts when users push back (UNESCO/UCL)
0Hacker News New
Standard Support: How AI agents ask for support
0Hacker News New