AI & ML
Emo-H2A: Driving a Facial Robot Directly from LLM Hidden States at Token Rate
arXiv cs.RO0 views
arXiv:2611.23932v1 Announce Type: new Abstract: Diverse, semantically synchronized, and low-latency facial expressions are essential for human-robot interaction. While large language models (LLMs) have endowed anthropomorphic robots with fluent speech, facial expression still struggles to follow the conversation. Motivated by this gap, we present Emo-H2A (hidden-to-actuation), a paradigm that drives a facial robot directly from LLM hidden states during autoregressive decoding. Without a separate emotion label, expression stays continuous and context-sensitive, and the face moves with the unfolding reply. We instantiate this paradigm as EmoManifold, a training-free method that extracts a valence-arousal-dominance (VAD) coordinate from each hidden state, projects it, and drives the face at token granularity. The readout is checked on six language models, and the same projection drives our 29-degree-of-freedom (DoF) facial robot. When driven by this projection, the face shifts its expression in the matching direction on 87.5% of within-reply valence transitions, whereas holding a single label for the whole reply leaves directional tracking near the 50% chance level, and first moves in 0.96s rather than waiting 10-26s for the reply to finish and a turn-level label to return.
Source:https://arxiv.org/abs/2611.23932PreviousHow to Make AI Part of Every Employee's Day Without Breaking Trust or ComplianceNextFacet-SLAM: Real-Time Triangle Splatting SLAM
Related posts
![[Phân tích kỹ thuật] Artex: Vũ khí AI Agent 'ngắm là bắn' rút ngắn thời gian tấn công mạng xuống dưới 3 giờ](https://media2.dev.to/dynamic/image/width=800%2Cheight=%2Cfit=scale-down%2Cgravity=auto/https%3A%2F%2Fdev-to-uploads.s3.us-east-2.amazonaws.com%2Fuploads%2Farticles%2F69aiefxt38opzs2grqoj.webp)
[Phân tích kỹ thuật] Artex: Vũ khí AI Agent 'ngắm là bắn' rút ngắn thời gian tấn công mạng xuống dưới 3 giờ
0dev.to
A homepage check is not a usability verdict: lessons from 224 garage websites
0dev.to
Designing a useful preview for an AI-generated comic
0dev.to
AI Agents: What They Are and Why They Matter
0dev.to
GPT-6.2 Astra Was Easier to Jailbreak, UK Testing Found
0dev.to
iFixit Says Apple’s HomeView Breaks Easily. Here’s Why I’m Not Worried
0CNET News