The 3D semantic instance prediction task involves detecting and segmenting the object in an 3D scan mesh.

Evaluation and metrics

Our evaluation ranks all methods according to the average precision for each class. We report the mean average precision AP at overlap 0.25 (AP 25%), overlap 0.5 (AP 50%), and over overlaps in the range [0.5:0.95:0.05] (AP). Note that multiple predictions of the same ground truth instance are penalized as false positives.



This table lists the benchmark results for the 3D object detection with limited reconstructions scenario.




Method Infoavg ap 25%bathtubbedbookshelfcabinetchaircountercurtaindeskdoorotherfurniturepicturerefrigeratorshower curtainsinksofatabletoiletwindow
sorted bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort by
WS3D_LR_ODpermissive0.551 10.917 20.878 10.752 10.308 20.834 10.442 10.266 10.588 10.442 10.423 10.138 10.463 20.450 20.446 10.842 10.462 10.839 30.430 1
Kangcheng Liu: WS3D: Weakly Supervised 3D Scene Segmentation with Region-Level Boundary Awareness and Instance Discrimination. European Conference on Computer Vision (ECCV), 2022
CSC_LR_DET0.474 21.000 10.865 20.421 20.259 30.802 30.153 30.198 30.399 30.332 20.277 30.044 20.538 10.491 10.404 30.808 20.364 20.889 10.286 2
PointContrast_LR_DET0.421 30.667 40.730 30.378 30.308 10.808 20.179 20.206 20.395 40.285 30.318 20.030 30.373 30.304 30.414 20.765 30.307 30.856 20.250 3
Scratch_LR_DET0.302 40.667 30.687 40.375 40.199 40.704 40.085 40.093 40.456 20.167 40.170 40.005 40.090 40.049 40.353 40.555 40.257 40.414 40.103 4