Fast and Accurate Hand Estimation in Pixels, Interaction and World Space
Overview
This research presents FAH (Fast and Accurate Hand Estimation), a model family built on SAM 3D Body's hand branch. It directly predicts 3D joints that align better with 2D predictions and fits MANO or MHR-Hand meshes to reduce error. The models optionally estimate anatomical parts and contact without object geometry, use causal refinement to reduce acceleration error, and place hands in world space via camera estimation. Experiments show improvements in image-space alignment, hand geometry, contact estimation, and world-space tracking over baselines. The default ViT-L model runs at 65 fps with mesh fitting on an RTX 4070 Ti SUPER (or 49 fps with parts and contact enabled), while the smallest ViT-S model reaches 125 fps without mesh fitting, parts or contact. Code is available at https://github.com/noahcao/FAH.
Generated from attributed reports · Updated 2 days ago
Event evidence and corrections
0 attributed source owners. Ownership does not establish independent confirmation. Quantities are reported separately and are never added together.
Reported quantity · frames per second: 65 other · Basis not reported · Differing source assertions
“ing over the evaluated baselines. The default ViT-L model runs at 65 fps with mesh fitting on an RTX 4070 Ti SUPER, or 49 fps with parts and contact enabled. The smallest ViT-S model reaches 125 fps without mesh fitting, parts or contact. Code: https://github.com/noahcao/FAH.”
Exact source · revision 1Source owner not reported
Reported quantity · frames per second: 49 other · Basis not reported · Differing source assertions
“ing over the evaluated baselines. The default ViT-L model runs at 65 fps with mesh fitting on an RTX 4070 Ti SUPER, or 49 fps with parts and contact enabled. The smallest ViT-S model reaches 125 fps without mesh fitting, parts or contact. Code: https://github.com/noahcao/FAH.”
Exact source · revision 1Source owner not reported
Reported quantity · frames per second: 125 other · Basis not reported · Differing source assertions
“ing over the evaluated baselines. The default ViT-L model runs at 65 fps with mesh fitting on an RTX 4070 Ti SUPER, or 49 fps with parts and contact enabled. The smallest ViT-S model reaches 125 fps without mesh fitting, parts or contact. Code: https://github.com/noahcao/FAH.”
Exact source · revision 1Source owner not reported
Artifact availability · code: available
“ing over the evaluated baselines. The default ViT-L model runs at 65 fps with mesh fitting on an RTX 4070 Ti SUPER, or 49 fps with parts and contact enabled. The smallest ViT-S model reaches 125 fps without mesh fitting, parts or contact. Code: https://github.com/noahcao/FAH.”
Exact source · revision 1Source owner not reported
Report timeline
Follow attributed reports and material updates.
- arXiv Robotics — research abstractsSignalFast and Accurate Hand Estimation in Pixels, Interaction and World Space
This research presents FAH (Fast and Accurate Hand Estimation), a model family built on SAM 3D Body's hand branch. It directly predicts 3D joints that align better with 2D predictions and fits MANO or MHR-Hand meshes to reduce error. The models optionally estimate anatomical parts and contact without object geometry, use causal refinement to reduce acceleration error, and place hands in world space via camera estimation. Experiments show improvements in image-space alignment, hand geometry, contact estimation, and world-space tracking over baselines. The default ViT-L model runs at 65 fps with mesh fitting on an RTX 4070 Ti SUPER (or 49 fps with parts and contact enabled), while the smallest ViT-S model reaches 125 fps without mesh fitting, parts or contact. Code is available at https://github.com/noahcao/FAH.
Timezone · UTC
Article dates follow your selected timezone. Briefing editions use Hong Kong time (UTC+8).