AI & ML
OmniFaceRig: Fully Automatic Inner-Mouth-Aware Face Rigging Across Diverse 3D Character Topologies
arXiv cs.GR0 views
arXiv:2606.08043v3 Announce Type: replace Abstract: Facial rigging--creating Facial Action Coding System (FACS) blendshapes and inner-mouth geometry (teeth, gums, and tongue)--remains a major bottleneck in 3D character production. We present OmniFaceRig, a fully automatic end-to-end pipeline that converts a static surface-only 3D character mesh, with no pre-modeled oral cavity, into an inner-mouth-aware FACS rig with up to 155 blendshapes, procedurally fitted teeth, gums, and tongue, and re-packed UV/texture. It supports humans, humanoids, and long- and short-muzzled animals with no manual landmarks, user-provided templates, or per-asset setup. OmniFaceRig combines a hybrid vision-language and computer vision riggability checker, a four-model face segmentation ensemble, keypoint-driven template registration, procedural inner-mouth construction, and collision-aware blendshape transfer. For non-human characters, it selects topology-specific templates with a nose-landmark-free design and uses as-rigid-as-possible deformation with signed-distance-field constraints to reduce teeth-face intersections. We also introduce Omni-Bench, an open-source benchmark of more than 1,000 biped 3D characters rigged with FACS blendshapes and inner-mouth geometry, spanning humans, humanoids, cats, dogs, and other animals. Experiments show high rigging success, nearly complete face detection recall, low inner-mouth penetration, and 20-30 s end-to-end latency per asset on a single A100 GPU.
Source:https://arxiv.org/abs/2606.08043PreviousHierarchical Incremental Beta Splatting for Online ReconstructionNextLSD-3D: Large-Scale 3D Driving Scene Generation with Geometry Grounding
Related posts

Save 26% on this 142-piece toolkit for your PC repairs and hobbyist projects, now under $28
0Tom's Hardware
‘Mathematics is more than a mechanical process’ — why I think the field will survive OpenAI’s disruption
0Nature News
Preprint platform offers to pay researchers to review papers, but questions remain
0Nature News

I’ve reviewed almost every Android foldable this year — here’s how the iPhone Duo compares
0The Verge
Physicl raises $10M to make the digital world real enough for robots
0TechCrunch

Kubernetes, mark II? Why Google’s giving away gVisor, a code sandbox used by Anthropic and OpenAI
0The New Stack