AI & ML
Vision-Guided Reorientation and Color Sorting of Writing Utensils Using a Low-Cost 4-DoF Arm
arXiv cs.RO0 views
arXiv:2608.15968v2 Announce Type: replace Abstract: Low-cost four-degree-of-freedom (DoF) arms are among the most accessible robotic platforms. But they are one joint short for picking up in situations where objects are at arbitrary orientations, a task that appears to require five degrees of freedom: the planar position (x and y), the height (z), a wrist rotation to align the gripper with the object, and gripper actuation, of which a four-DoF arm lacks the wrist rotation. This work uses perception and motion planning so that such an arm, a roughly $200 Waveshare RoArm-M2-S under a fixed overhead camera, can detect and color-sort writing utensils without that joint. A YOLO11n-OBB (You Only Look Once, oriented bounding box) detector locates each writing utensil; camera intrinsics and an ArUco reference pose convert its pixel coordinates to robot coordinates; and a color classifier labels it. The detected orientation angle determines the motion strategy: utensils close to the arm's fixed approach direction are picked up directly, and those at steeper angles are reoriented via corrective sweeps until they are graspable, after which they are picked up and sorted into the assigned color bin. In 196 single-utensil trials, the 98 that started beyond 45 degrees from that direction all became graspable within four sweeps (130 total). Overall, 176 (89.8%) ended in the correct bin; 19 of 20 failures were slipped or missed grasps, one a mislabeled color. For the seven utensils tested in this setup, corrective sweeps brought every steeply misaligned utensil into a graspable orientation on an arm with no wrist joint.
Source:https://arxiv.org/abs/2608.15968PreviousMMUSV-Sim: A Maritime Simulation Platform for Multi-USV Cooperative PerceptionNextSimForcing: Distilling Simulation Motion Priors into Real-Domain Robot World Models
Related posts
RegimeVGGT: Layer-Wise Spatially Preserving Redundancy Removal for Visual Geometry Grounded Transformer
0arXiv cs.RO
RoboTryOn: Synthesizing Dexterous Robot Demonstrations from Human Videos via Virtual Try-On
0arXiv cs.RO
Future Representation Distillation for Imagination-free World Action Models
0arXiv cs.RO
When Robots Outweigh Objects: How Inertia Mismatch Shapes Robot Policy Learning
0arXiv cs.RO
Learning to Live: A Step Toward Lifelong Embodied Intelligence
0arXiv cs.RO
Tactus: Tactile & Pose Sensing Glove for Natural Dexterity Data Collection
0arXiv cs.RO