3D Semantic Instance with Limited Reconstructions Benchmark
The 3D semantic instance prediction task involves detecting and segmenting the object in an 3D scan mesh.
Our evaluation ranks all methods according to the average precision for each class. We report the mean average precision AP at overlap 0.25 (AP 25%), overlap 0.5 (AP 50%), and over overlaps in the range [0.5:0.95:0.05] (AP). Note that multiple predictions of the same ground truth instance are penalized as false positives.
This table lists the benchmark results for the 3D semantic instance with limited reconstructions scenario.
| Method | Info | avg ap 50% | bathtub | bed | bookshelf | cabinet | chair | counter | curtain | desk | door | otherfurniture | picture | refrigerator | shower curtain | sink | sofa | table | toilet | window |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
 | | | | | | | | | | | | | | |  | | | | ||
| CSC_LR_INS | 0.529 4 | 1.000 1 | 0.773 1 | 0.704 2 | 0.414 4 | 0.786 4 | 0.050 3 | 0.412 4 | 0.394 3 | 0.376 5 | 0.442 4 | 0.179 4 | 0.542 3 | 0.539 5 | 0.394 5 | 0.793 1 | 0.564 4 | 0.944 6 | 0.217 6 | |
| WS3D_LR_Ins | 0.656 1 | 1.000 1 | 0.766 4 | 0.736 1 | 0.656 1 | 0.793 3 | 0.091 2 | 0.561 2 | 0.389 4 | 0.533 1 | 0.582 1 | 0.531 2 | 0.592 1 | 0.981 1 | 0.622 1 | 0.782 2 | 0.638 2 | 0.997 4 | 0.558 1 | |
| Kangcheng Liu: WS3D: Weakly Supervised 3D Scene Segmentation with Region-Level Boundary Awareness and Instance Discrimination. European Conference on Computer Vision (ECCV), 2022 | ||||||||||||||||||||
| PointContrast_LR_INS | 0.488 5 | 0.472 6 | 0.773 1 | 0.594 5 | 0.374 6 | 0.774 6 | 0.013 6 | 0.353 6 | 0.252 6 | 0.327 6 | 0.416 5 | 0.087 6 | 0.435 6 | 0.857 2 | 0.444 4 | 0.779 3 | 0.560 6 | 1.000 1 | 0.282 4 | |
| InstTeacher3D | 0.646 2 | 1.000 1 | 0.764 5 | 0.699 3 | 0.563 2 | 0.849 1 | 0.177 1 | 0.694 1 | 0.449 1 | 0.509 2 | 0.561 2 | 0.575 1 | 0.550 2 | 0.714 3 | 0.595 2 | 0.777 4 | 0.650 1 | 0.997 4 | 0.513 2 | |
| Yizheng Wu, Zhiyu Pan, Kewei Wang, Xingyi Li, Jiahao Cui, Liwen Xiao, Guosheng Lin, Zhiguo Cao: Instance Consistency Regularization for Semi-Supervised 3D Instance Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence | ||||||||||||||||||||
| TWIST+CSC | 0.550 3 | 1.000 1 | 0.758 6 | 0.570 6 | 0.462 3 | 0.797 2 | 0.050 3 | 0.389 5 | 0.436 2 | 0.433 3 | 0.484 3 | 0.253 3 | 0.491 4 | 0.571 4 | 0.538 3 | 0.760 5 | 0.561 5 | 1.000 1 | 0.354 3 | |
| Ruihang Chu: TWIST: Two-Way Inter-label Self-Training for Semi-supervised 3D Instance Segmentation. CVPR 2022 | ||||||||||||||||||||
| Scratch_LR_INS | 0.473 6 | 0.528 5 | 0.773 1 | 0.632 4 | 0.391 5 | 0.784 5 | 0.050 3 | 0.515 3 | 0.271 5 | 0.392 4 | 0.400 6 | 0.123 5 | 0.486 5 | 0.387 6 | 0.322 6 | 0.627 6 | 0.573 3 | 1.000 1 | 0.268 5 | |