The 3D semantic instance prediction task involves detecting and segmenting the object in an 3D scan mesh.

Evaluation and metrics

Our evaluation ranks all methods according to the average precision for each class. We report the mean average precision AP at overlap 0.25 (AP 25%), overlap 0.5 (AP 50%), and over overlaps in the range [0.5:0.95:0.05] (AP). Note that multiple predictions of the same ground truth instance are penalized as false positives.



This table lists the benchmark results for the 3D object detection with limited annotations scenario.




Method Infoavg ap 25%bathtubbedbookshelfcabinetchaircountercurtaindeskdoorotherfurniturepicturerefrigeratorshower curtainsinksofatabletoiletwindow
sorted bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort by
WS3D_LA_ODpermissive0.566 10.917 10.891 10.674 10.379 10.840 10.486 10.301 10.649 10.436 10.425 10.162 10.428 10.484 20.474 10.836 10.434 10.882 10.491 1
Kangcheng Liu: WS3D: Weakly Supervised 3D Scene Segmentation with Region-Level Boundary Awareness and Instance Discrimination. European Conference on Computer Vision (ECCV), 2022
CSC_LA_DET0.336 20.667 20.498 40.494 20.061 20.653 30.038 40.138 30.268 30.220 20.211 20.052 20.338 20.333 30.241 20.798 20.174 20.709 20.148 2
PointContrast_LA_DET0.315 30.278 40.589 20.492 30.034 40.701 20.142 20.158 20.173 40.219 30.199 30.003 30.306 30.550 10.163 30.695 30.165 30.662 30.139 3
Scratch_LA_DET0.281 40.667 20.583 30.339 40.046 30.586 40.062 30.106 40.310 20.160 40.095 40.001 40.135 40.323 40.148 40.627 40.141 40.618 40.116 4