3D Perception
Point Cloud Processing
import open3d as o3d
pcd = o3d.io.read_point_cloud("scene.ply")
pcd_down = pcd.voxel_down_sample(voxel_size=0.02)
pcd_down.estimate_normals(search_param=o3d.geometry.KDTreeSearchParamHybrid(radius=0.1, max_nn=30))
Core Tasks
| Task |
Methods |
Libraries |
| Depth estimation |
MiDaS, Depth Anything, stereo |
torch, timm |
| 3D reconstruction |
NeRF, 3DGS, TSDF fusion |
nerfstudio, Open3D |
| 6DoF pose |
FoundationPose, MegaPose |
PyTorch3D |
| 3D segmentation |
MinkowskiEngine, PTv3 |
MinkowskiEngine |
| Scene graphs |
3DSSG, ConceptGraphs |
custom |
| Registration |
ICP, GICP, RANSAC |
Open3D, kiss-icp |
Coordinate Conventions
- ROS: X-forward, Y-left, Z-up (REP-103)
- OpenCV: X-right, Y-down, Z-forward
- OpenGL: X-right, Y-up, Z-backward
- Always document which convention is used
Key Libraries
Open3D, PyTorch3D, kaolin, MinkowskiEngine, nerfstudio
1---2name: 3d-perception3version: 1.0.04description: 3D vision pipelines. Point clouds, depth estimation, 3D reconstruction, pose estimation, scene understanding.5---67# 3D Perception89## Point Cloud Processing10```python11import open3d as o3d12pcd = o3d.io.read_point_cloud("scene.ply")13pcd_down = pcd.voxel_down_sample(voxel_size=0.02)14pcd_down.estimate_normals(search_param=o3d.geometry.KDTreeSearchParamHybrid(radius=0.1, max_nn=30))15```1617## Core Tasks18| Task | Methods | Libraries |19|------|---------|-----------|20| Depth estimation | MiDaS, Depth Anything, stereo | torch, timm |21| 3D reconstruction | NeRF, 3DGS, TSDF fusion | nerfstudio, Open3D |22| 6DoF pose | FoundationPose, MegaPose | PyTorch3D |23| 3D segmentation | MinkowskiEngine, PTv3 | MinkowskiEngine |24| Scene graphs | 3DSSG, ConceptGraphs | custom |25| Registration | ICP, GICP, RANSAC | Open3D, kiss-icp |2627## Coordinate Conventions28- ROS: X-forward, Y-left, Z-up (REP-103)29- OpenCV: X-right, Y-down, Z-forward30- OpenGL: X-right, Y-up, Z-backward31- Always document which convention is used3233## Key Libraries34Open3D, PyTorch3D, kaolin, MinkowskiEngine, nerfstudio
aselimc