The 3D semantic instance prediction task involves detecting and segmenting the object in an 3D scan mesh.

Evaluation and metrics

Our evaluation ranks all methods according to the average precision for each class. We report the mean average precision AP at overlap 0.25 (AP 25%), overlap 0.5 (AP 50%), and over overlaps in the range [0.5:0.95:0.05] (AP). Note that multiple predictions of the same ground truth instance are penalized as false positives.



This table lists the benchmark results for the 3D object detection with limited reconstructions scenario.




Method Infoavg ap 25%bathtubbedbookshelfcabinetchaircountercurtaindeskdoorotherfurniturepicturerefrigeratorshower curtainsinksofatabletoiletwindow
sorted bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort by
WS3D_LR_ODpermissive0.555 11.000 10.880 10.702 10.329 20.834 20.364 40.223 30.550 30.455 10.432 10.122 10.464 10.342 20.576 20.872 20.481 10.906 40.452 1
Kangcheng Liu: WS3D: Weakly Supervised 3D Scene Segmentation with Region-Level Boundary Awareness and Instance Discrimination. European Conference on Computer Vision (ECCV), 2022
CSC_LR_DET0.547 21.000 10.757 40.567 20.391 10.832 30.677 10.189 40.657 10.414 20.369 30.083 20.411 20.449 10.559 30.831 40.415 30.930 20.318 4
PointContrast_LR_DET0.532 31.000 10.771 30.514 30.299 40.848 10.418 20.478 10.612 20.368 30.370 20.034 30.377 30.209 40.620 10.894 10.418 20.951 10.393 2
Scratch_LR_DET0.471 40.667 40.830 20.450 40.300 30.807 40.407 30.251 20.489 40.368 40.344 40.026 40.340 40.240 30.424 40.850 30.376 40.929 30.386 3