Limited Annotations Semantic Instance Results

The 3D semantic instance prediction task involves detecting and segmenting the object in an 3D scan mesh.

Our evaluation ranks all methods according to the average precision for each class. We report the mean average precision AP at overlap 0.25 (AP 25%), overlap 0.5 (AP 50%), and over overlaps in the range [0.5:0.95:0.05] (AP). Note that multiple predictions of the same ground truth instance are penalized as false positives.

This table lists the benchmark results for the 3D semantic instance with limited annotations scenario.

Method	avg ap 50%	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	window

WS3D_LA_Ins	0.548 1	1.000 1	0.690 1	0.476 2	0.406 1	0.756 1	0.031 1	0.733 1	0.215 1	0.351 1	0.415 2	0.319 1	0.541 1	1.000 1	0.477 1	0.576 2	0.557 1	0.941 2	0.377 1
Kangcheng Liu: WS3D: Weakly Supervised 3D Scene Segmentation with Region-Level Boundary Awareness and Instance Discrimination. European Conference on Computer Vision (ECCV), 2022
Box2Mask_LA	0.465 2	0.667 2	0.591 3	0.773 1	0.331 2	0.682 2	0.029 2	0.409 2	0.122 2	0.284 2	0.432 1	0.253 2	0.466 2	1.000 1	0.127 4	0.806 1	0.280 3	0.821 4	0.291 2
Julian Chibane, Francis Engelmann, Tuan Anh Tran, Gerard Pons-Moll: Box2Mask: Weakly Supervised 3D Semantic Instance Segmentation Using Bounding Boxes. ECCV 2022
PointContrast_LA_INS	0.259 4	0.333 5	0.286 5	0.334 4	0.142 4	0.485 3	0.000 3	0.343 4	0.010 4	0.127 3	0.219 3	0.005 4	0.324 3	0.267 3	0.226 2	0.402 5	0.103 5	0.994 1	0.069 4

CSC_LA_INS	0.289 3	0.667 2	0.580 4	0.427 3	0.202 3	0.424 5	0.000 3	0.384 3	0.015 3	0.061 4	0.180 4	0.014 3	0.071 4	0.119 5	0.173 3	0.445 3	0.390 2	0.938 3	0.120 3

Scratch_LA_INS	0.200 5	0.667 2	0.673 2	0.145 5	0.100 5	0.430 4	0.000 3	0.314 5	0.004 5	0.025 5	0.099 5	0.000 5	0.000 5	0.143 4	0.076 5	0.424 4	0.198 4	0.297 5	0.006 5

3D Semantic Instance with Limited Annotations Benchmark