Material-informed Gaussian Splatting for 3D World Reconstruction in a Digital Twin
Overview
This research presents a camera-only pipeline for 3D reconstruction within digital twins. The method utilizes 3D Gaussian Splatting from multi-view images, extracts semantic material masks using vision models, converts Gaussian representations to mesh surfaces with projected material labels, and assigns physics-based material properties for accurate sensor simulation. This approach aims to provide photorealistic reconstruction with physics-based material assignment while eliminating the hardware complexity and calibration requirements associated with traditional LiDAR-camera fusion methods. Validation is performed using an internal dataset from an instrumented test vehicle, leveraging LiDAR as ground truth for reflectivity validation alongside image similarity metrics.
Generated from attributed reports · Updated 2 hours ago
Event evidence and corrections
0 attributed source owners. Ownership does not establish independent confirmation. Quantities are reported separately and are never added together.
No current evidence-backed claims. Missing information remains not reported.
Report timeline
Follow attributed reports and material updates.
- arXiv Robotics — research abstractsSignalMaterial-informed Gaussian Splatting for 3D World Reconstruction in a Digital Twin
This research presents a camera-only pipeline for 3D reconstruction within digital twins. The method utilizes 3D Gaussian Splatting from multi-view images, extracts semantic material masks using vision models, converts Gaussian representations to mesh surfaces with projected material labels, and assigns physics-based material properties for accurate sensor simulation. This approach aims to provide photorealistic reconstruction with physics-based material assignment while eliminating the hardware complexity and calibration requirements associated with traditional LiDAR-camera fusion methods. Validation is performed using an internal dataset from an instrumented test vehicle, leveraging LiDAR as ground truth for reflectivity validation alongside image similarity metrics.
Event coverage history
There is not enough continuous observation data to show a trend.
Timezone · UTC
Article dates follow your selected timezone. Briefing editions use Hong Kong time (UTC+8).