3D Semantic Label with Limited Annotations Benchmark

This table lists the benchmark results for the 3D semantic label with limited annotations scenario.




Method Infoavg ioubathtubbedbookshelfcabinetchaircountercurtaindeskdoorfloorotherfurniturepicturerefrigeratorshower curtainsinksofatabletoiletwallwindow
sorted bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort by
Q2E0.741 10.984 10.821 20.757 40.739 10.868 20.600 10.849 10.595 60.659 10.971 20.490 20.299 20.689 40.822 30.749 10.788 40.641 10.935 20.860 10.699 2
ActiveST0.735 20.983 20.769 40.798 10.701 20.852 50.527 20.801 20.680 10.629 20.973 10.447 100.312 10.757 10.799 40.747 20.795 30.632 20.952 10.855 20.684 3
Gengxin Liu, Oliver van Kaick, Hui Huang, Ruizhen Hu: Active Self-Training for Weakly Supervised 3D Scene Semantic Segmentation.
DE-3DLearner LA0.704 30.774 70.766 50.764 30.687 40.832 70.413 110.790 40.639 20.599 40.952 40.478 60.222 80.746 20.859 10.678 40.806 20.607 60.915 50.847 30.703 1
Ping-Chung Yu, Cheng Sun, Min Sun: Data Efficient 3D Learner via Knowledge Transferred from 2D Model. ECCV 2022
WS3D_LA_Sempermissive0.689 40.879 30.753 60.798 10.648 80.816 90.421 100.796 30.604 50.603 30.945 100.457 90.204 90.559 100.851 20.724 30.760 70.630 30.903 70.821 50.603 8
Kangcheng Liu: WS3D: Weakly Supervised 3D Scene Segmentation with Region-Level Boundary Awareness and Instance Discrimination. European Conference on Computer Vision (ECCV), 2022
VIBUSpermissive0.684 50.848 40.752 70.708 90.691 30.861 30.474 50.770 50.611 40.538 90.951 50.478 60.275 40.676 50.671 110.649 80.788 40.610 50.869 90.808 100.657 4
Beiwen Tian,Liyi Luo,Hao Zhao,Guyue Zhou: VIBUS: Data-efficient 3D Scene Parsing with VIewpoint Bottleneck and Uncertainty-Spectrum Modeling. ISPRS Journal of Photogrammetry and Remote Sensing
GaIA0.682 60.731 110.846 10.713 80.657 60.869 10.475 40.705 90.452 130.569 50.951 50.563 10.290 30.544 110.799 40.677 50.810 10.618 40.900 80.821 50.642 5
Min Seok Lee*, Seok Woo Yang*, and Sung Won Han: GaIA: Graphical Information gain based Attention Network for Weakly Supervised 3D Point Cloud Semantic Segmentation. WACV 2023
LE0.680 70.744 90.731 90.727 60.664 50.859 40.427 90.759 60.562 70.562 60.948 70.480 40.245 60.735 30.765 60.648 100.786 60.591 70.931 30.817 70.624 7
One-Thing-One-Click0.670 80.734 100.815 30.661 130.644 90.841 60.509 30.741 70.479 120.548 70.968 30.461 80.251 50.664 60.754 70.656 70.744 100.541 110.917 40.844 40.625 6
Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu: One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation. CVPR 2021
Viewpoint_BN_LA_AIR0.650 90.778 60.731 90.688 110.617 110.812 110.446 70.739 80.618 30.540 80.945 100.415 110.204 90.623 70.676 100.594 110.744 100.576 80.868 100.811 80.582 10
Liyi Luo, Beiwen Tian, Hao Zhao, Guyue Zhou: Pointly-supervised 3D Scene Parsing with Viewpoint Bottleneck.
CSC_LA_SEM0.644 100.761 80.707 120.703 100.642 100.813 100.436 80.659 110.502 90.516 110.945 100.487 30.238 70.538 120.678 90.659 60.739 120.568 100.915 50.811 80.566 12
PointContrast_LA_SEM0.636 110.694 120.738 80.731 50.653 70.817 80.467 60.651 120.517 80.522 100.946 80.479 50.198 110.575 90.526 130.649 80.747 80.569 90.845 110.803 110.600 9
Scratch_LA_SEM0.621 120.802 50.715 110.687 120.570 120.800 120.386 120.703 100.486 110.514 120.946 80.390 120.181 120.620 80.670 120.487 130.746 90.539 120.804 120.798 120.580 11
SQN_LA0.576 130.674 130.670 130.722 70.454 130.790 130.342 130.622 130.487 100.427 130.933 130.357 130.157 130.452 130.721 80.492 120.696 130.487 130.790 130.748 130.507 13


3D Semantic Instance with Limited Annotations Benchmark

This table lists the benchmark results for the 3D semantic instance with limited annotations scenario.




Method Infoavg ap 50%bathtubbedbookshelfcabinetchaircountercurtaindeskdoorotherfurniturepicturerefrigeratorshower curtainsinksofatabletoiletwindow
sorted bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort by
WS3D_LA_Inspermissive0.579 10.667 20.758 10.655 30.498 10.750 10.042 40.779 10.163 20.429 10.472 20.408 10.625 11.000 10.469 30.680 30.612 11.000 10.404 1
Kangcheng Liu: WS3D: Weakly Supervised 3D Scene Segmentation with Region-Level Boundary Awareness and Instance Discrimination. European Conference on Computer Vision (ECCV), 2022
Box2Mask_LA0.565 21.000 10.719 40.649 40.407 20.742 20.135 20.598 20.298 10.368 20.509 10.343 20.503 20.981 30.347 40.755 10.521 20.983 40.315 2
Julian Chibane, Francis Engelmann, Tuan Anh Tran, Gerard Pons-Moll: Box2Mask: Weakly Supervised 3D Semantic Instance Segmentation Using Bounding Boxes. ECCV 2022
CSC_LA_INS0.460 30.528 40.754 30.709 10.314 50.542 40.139 10.472 40.120 30.302 40.373 30.090 40.389 40.714 40.631 10.531 50.467 31.000 10.203 4
PointContrast_LA_INS0.456 40.667 20.696 50.687 20.325 40.543 30.072 30.556 30.095 40.270 50.315 40.021 50.318 51.000 10.562 20.585 40.319 50.994 30.188 5
Scratch_LA_INS0.418 50.528 40.758 20.475 50.377 30.484 50.008 50.450 50.029 50.311 30.260 50.096 30.500 30.714 40.309 50.681 20.370 40.938 50.231 3


3D Object Detection with Limited Annotations Benchmark

This table lists the benchmark results for the 3D object detection with limited annotations scenario.




Method Infoavg ap 50%bathtubbedbookshelfcabinetchaircountercurtaindeskdoorotherfurniturepicturerefrigeratorshower curtainsinksofatabletoiletwindow
sorted bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort by
WS3D_LA_ODpermissive0.341 11.000 10.629 10.426 10.070 10.608 10.063 10.176 10.503 10.132 10.084 10.001 10.337 10.220 10.103 10.628 10.282 10.739 10.131 1
Kangcheng Liu: WS3D: Weakly Supervised 3D Scene Segmentation with Region-Level Boundary Awareness and Instance Discrimination. European Conference on Computer Vision (ECCV), 2022
PointContrast_LA_DET0.135 20.667 20.296 30.145 20.002 30.330 30.000 40.000 30.050 30.049 20.023 20.000 30.002 40.006 40.034 30.472 20.052 20.285 40.011 2
CSC_LA_DET0.135 20.444 30.336 20.029 40.001 40.356 20.008 20.000 20.011 40.045 30.010 40.000 20.032 20.011 30.043 20.458 30.028 30.602 20.010 3
Scratch_LA_DET0.098 40.167 40.253 40.074 30.002 20.257 40.004 30.000 40.080 20.038 40.013 30.000 30.006 30.143 20.002 40.243 40.017 40.473 30.001 4


3D Semantic Label with Limited Reconstructions Benchmark

This table lists the benchmark results for the 3D semantic label with limited reconstructions scenario.




Method Infoavg ioubathtubbedbookshelfcabinetchaircountercurtaindeskdoorfloorotherfurniturepicturerefrigeratorshower curtainsinksofatabletoiletwallwindow
sorted bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort by
WS3D_LR_Sem0.685 10.871 10.769 10.779 10.647 10.806 10.453 10.802 10.577 10.588 10.945 10.460 10.223 10.539 10.793 10.732 10.766 10.614 10.904 10.823 10.604 1
Kangcheng Liu: WS3D: Weakly Supervised 3D Scene Segmentation with Region-Level Boundary Awareness and Instance Discrimination. European Conference on Computer Vision (ECCV), 2022
NWSYY0.286 20.000 20.515 40.322 60.247 20.618 20.219 30.304 50.174 80.268 40.926 30.117 20.162 50.065 80.000 20.079 50.514 20.345 40.028 20.701 20.125 2
CSC_LR_SEM0.270 30.000 20.528 30.331 50.139 70.535 70.118 80.326 40.222 30.292 30.921 40.089 60.163 40.129 20.000 20.131 30.463 30.278 80.000 30.699 30.033 7
DE-3DLearner LR0.263 40.000 20.547 20.235 80.184 50.566 30.165 50.249 60.196 40.309 20.938 20.070 80.186 30.069 70.000 20.000 80.368 60.356 20.000 30.698 40.118 4
Ping-Chung Yu, Cheng Sun, Min Sun: Data Efficient 3D Learner via Knowledge Transferred from 2D Model. ECCV 2022
CSG_3DSegNet0.258 50.000 20.335 80.368 30.169 60.549 60.229 20.158 80.182 70.208 80.898 80.105 30.190 20.093 60.000 20.093 40.448 40.342 50.000 30.679 60.119 3
Viewpoint_BN_LR_AIR0.256 60.000 20.479 50.377 20.204 40.551 50.205 40.219 70.235 20.224 70.903 70.092 40.088 60.122 30.000 20.003 70.354 70.354 30.000 30.676 70.034 6
PointContrast_LR_SEM0.253 70.000 20.412 70.347 40.137 80.564 40.140 60.361 30.187 60.249 50.914 50.092 40.055 70.102 50.000 20.048 60.392 50.302 70.000 30.697 50.056 5
Scratch_LR_SEM0.251 80.000 20.457 60.238 70.205 30.528 80.123 70.419 20.195 50.246 60.905 60.086 70.048 80.103 40.000 20.132 20.331 80.308 60.000 30.675 80.015 8


3D Semantic Instance with Limited Reconstructions Benchmark

This table lists the benchmark results for the 3D semantic instance with limited reconstructions scenario.




Method Infoavg ap 50%bathtubbedbookshelfcabinetchaircountercurtaindeskdoorotherfurniturepicturerefrigeratorshower curtainsinksofatabletoiletwindow
sorted bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort by
WS3D_LR_Ins0.565 10.667 10.755 10.614 10.488 10.767 10.024 20.710 10.392 10.370 10.496 10.298 10.515 10.857 10.496 10.667 10.596 10.990 10.474 1
Kangcheng Liu: WS3D: Weakly Supervised 3D Scene Segmentation with Region-Level Boundary Awareness and Instance Discrimination. European Conference on Computer Vision (ECCV), 2022
TWIST+CSC0.186 20.000 20.545 20.153 20.148 20.667 30.050 10.420 20.007 40.210 30.175 20.016 50.218 20.000 20.000 50.511 20.227 20.000 20.000 5
Ruihang Chu: TWIST: Two-Way Inter-label Self-Training for Semi-supervised 3D Instance Segmentation. CVPR 2022
InstTeacher3D0.162 30.000 20.500 40.000 50.120 30.738 20.000 30.404 30.005 50.291 20.155 30.153 20.008 60.000 20.059 20.289 30.192 40.000 20.000 4
PointContrast_LR_INS0.119 40.000 20.534 30.041 30.047 40.560 40.000 30.307 40.000 60.083 60.071 50.068 40.064 30.000 20.000 50.186 60.176 50.000 20.000 5
CSC_LR_INS0.117 50.000 20.492 50.040 40.032 60.524 50.000 30.174 50.021 20.139 40.096 40.112 30.039 40.000 20.018 30.258 50.150 60.000 20.001 3
Scratch_LR_INS0.101 60.000 20.488 60.000 50.035 50.491 60.000 30.160 60.009 30.111 50.025 60.002 60.009 50.000 20.001 40.265 40.219 30.000 20.001 2


3D Object Detection with Limited Reconstructions Benchmark

This table lists the benchmark results for the 3D object detection with limited reconstructions scenario.




Method Infoavg ap 50%bathtubbedbookshelfcabinetchaircountercurtaindeskdoorotherfurniturepicturerefrigeratorshower curtainsinksofatabletoiletwindow
sorted bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort by
WS3D_LR_ODpermissive0.374 10.867 10.797 10.655 10.104 10.678 10.046 10.215 10.406 10.186 10.219 10.034 10.354 10.160 10.101 10.741 10.306 10.679 10.181 1
Kangcheng Liu: WS3D: Weakly Supervised 3D Scene Segmentation with Region-Level Boundary Awareness and Instance Discrimination. European Conference on Computer Vision (ECCV), 2022
CSC_LR_DET0.191 20.667 20.468 30.226 20.036 20.420 30.025 20.010 30.081 30.066 30.045 20.000 20.162 30.010 30.017 20.657 20.109 20.420 30.013 2
PointContrast_LR_DET0.187 30.667 20.523 20.109 30.027 30.435 20.005 30.013 20.199 20.070 20.035 30.000 40.183 20.033 20.003 40.497 30.078 30.488 20.005 3
Scratch_LR_DET0.076 40.667 20.099 40.015 40.005 40.190 40.000 40.000 40.033 40.007 40.001 40.000 30.000 40.010 40.004 30.094 40.014 40.237 40.000 4