Camera calibration and tracking for augmented reality during robotic surgery
Overview
A study published in the International Journal of Computer Assisted Radiology and Surgery introduces a calibration and tracking pipeline that overlays preoperative imaging onto live laparoscopic video during robotic surgery. Using an externally mounted electromagnetic tracker, the system achieves sub-millimeter accuracy with a 19-image calibration protocol. Evaluated in 16 real procedures, the system provides stable real-time tracking and augmented reality visualization, though further development is needed to assess its impact on surgical outcomes.
From Surgical robotics — News discovery
Event evidence and corrections
0 attributed source owners. Ownership does not establish independent confirmation. Quantities are reported separately and are never added together.
Reported quantity · mean 3D Euclidean error: 0.541 other · Basis not reported · Differing source assertions
“g dataset size, and 19 images was the smallest dataset size whose median 3D error fell within 5 percent of the best observed performance. That configuration yielded a mean 3D Euclidean error of 0.541 plus or minus 0.060 millimeters. Laboratory accuracy is one thing; operating room reality is another. Robotic endoscopes are handled and repositioned throughout a procedure, so any tracking hardware must survive clinical”
Exact source · revision 2Source owner not reported
Reported quantity · mean 3D Euclidean error: 0.784 other · Basis not reported · Differing source assertions
“handling without degrading the calibration. The researchers therefore designed a clinically suitable adapter carrying the electromagnetic tracker and rigidly mounted it on the robotic endoscope. When evaluated with the same calibration protocol, the clinical adapter achieved a mean 3D Euclidean error of 0.784 plus or minus 0.075 millimeters, still sub-millimeter but measurably higher than the benchtop configuration,”
Exact source · revision 2Source owner not reported
Reported quantity · number of calibration images: 35 other · Basis not reported · Differing source assertions
“fore the tracker can be trusted, however, the camera itself must be calibrated: the system needs the precise relationship between what the sensor reports and what the lens actually images. The researchers solved this by rigidly mounting a second sensor to a calibration checkerboard and acquiring 35 calibration images. A key question in any calibration protocol is how many images are actually needed. More frames gener”
Exact source · revision 2Source owner not reported
Reported quantity · number of calibration subsets: 2600 other · Basis not reported
“ally improve accuracy, but each additional acquisition adds setup time in an operating room. To answer this quantitatively, the team drew 2600 random subsets containing between 5 and 30 images, calibrated each subset using RANSAC-based robust estimation, and evaluated the results against 16 separately recorded checkerboard frames using three-dimensional Euclidean error. Accuracy and robustness improved with increasin”
Exact source · revision 2Source owner not reported
Reported quantity · number of images in calibration subsets: 5 other · Basis not reported · Differing source assertions
“ally improve accuracy, but each additional acquisition adds setup time in an operating room. To answer this quantitatively, the team drew 2600 random subsets containing between 5 and 30 images, calibrated each subset using RANSAC-based robust estimation, and evaluated the results against 16 separately recorded checkerboard frames using three-dimensional Euclidean error. Accuracy and robustness improved with increasin”
Exact source · revision 2Source owner not reported
Reported quantity · number of images in calibration subsets: 30 other · Basis not reported · Differing source assertions
“ally improve accuracy, but each additional acquisition adds setup time in an operating room. To answer this quantitatively, the team drew 2600 random subsets containing between 5 and 30 images, calibrated each subset using RANSAC-based robust estimation, and evaluated the results against 16 separately recorded checkerboard frames using three-dimensional Euclidean error. Accuracy and robustness improved with increasin”
Exact source · revision 2Source owner not reported
Reported quantity · Robot count: 16 robots · Basis not reported
“reflecting the practical tolerances introduced by a mountable clinical device. The decisive test came in the operating room. The system was deployed during 16 robot-assisted pelvic lymph node dissection procedures. According to the study, the setup provided stable, real-time tracking and augmented reality visualization throughout these procedures, without requiring substantial modification of the standard robotic wo”
Exact source · revision 2Source owner not reported
Reported quantity · number of calibration images: 19 other · Basis not reported · Differing source assertions
“g dataset size, and 19 images was the smallest dataset size whose median 3D error fell within 5 percent of the best observed performance. That configuration yielded a mean 3D Euclidean error of 0.541 plus or minus 0.060 millimeters. Laboratory accuracy is one thing; operating room reality is another. Robotic endoscopes are handled and repositioned throughout a procedure, so any tracking hardware must survive clinical”
Exact source · revision 2Source owner not reported
Evidence dependency changes (3)
- 2026-10-30T20:09:47.921Z · evidence updated · source revision 2. Evidence extraction was updated; current source attributions are shown above.
- 2026-10-30T20:09:35.376Z · evidence updated · source revision 2. Evidence extraction was updated; current source attributions are shown above.
- 2026-10-26T03:18:36.689Z · evidence updated · source revision 2. Evidence extraction was updated; current source attributions are shown above.
Report timeline
Follow attributed reports and material updates.
- Surgical robotics — News discoverySignalElectromagnetic tracking brings sub-millimeter augmented reality to robotic surgery
A study published in the International Journal of Computer Assisted Radiology and Surgery introduces a calibration and tracking pipeline that overlays preoperative imaging onto live laparoscopic video during robotic surgery. Using an externally mounted electromagnetic tracker, the system achieves sub-millimeter accuracy with a 19-image calibration protocol. Evaluated in 16 real procedures, the system provides stable real-time tracking and augmented reality visualization, though further development is needed to assess its impact on surgical outcomes.
Timezone · UTC
Article dates follow your selected timezone. Briefing editions use Hong Kong time (UTC+8).