We put an RGB camera on a handheld UMI gripper and recorded a normal pick-and-place. After fixing the mount and improving marker detection, we got usable jaw-opening numbers on 98.7% of the frames in a 30-second clip (was ~95.3% before). Camera position relative to a table marker was available on ~84.8%. Not perfect, but good enough to actually look at what the hand was doing instead of just watching the video. 🧵1/6
We put an RGB camera on a handheld UMI gripper and recorded a normal pick-and-place. After fixing the mount and improving marker detection, we got usable jaw-opening numbers on 98.7% of the frames in a 30-second clip (was ~95.3% before). Camera position relative to a table marker was available on ~84.8%. Not perfect, but good enough to actually look at what the hand was doing instead of just watching the video. 🧵1/6
Source: Shenzhen Foundry — X · Read original article ↗
Article text · Original source · English
We put an RGB camera on a handheld UMI gripper and recorded a normal pick-and-place. After fixing the mount and improving marker detection, we got usable jaw-opening numbers on 98.7% of the frames in a 30-second clip (was ~95.3% before). Camera position relative to a table marker was available on ~84.8%. Not perfect, but good enough to actually look at what the hand was doing instead of just watching the video. 🧵1/6
Source：Shenzhen Foundry · x.com