Presenting the ScanNet200 Benchmark

We present the ScanNet200 benchmark, which studies an order of magnitude more class categories than previous version of ScanNet. The scene geometry is shared within the two tasks, but the parsing of surface annotation allows for a larger vocabulary and more realistic setting for in the wild 3D understanding methods.

The ScanNet200 benchmark includes both finer-grained categories as well as a large number of previously unaddressed classes. This induces a much more challenging setting regarding the diversity of naturally observed semantic classes seen in the raw ScanNet RGB-D observations, where the data also reflects naturally encountered class imbalances. The difference in category frequencies between ScanNet and ScanNet200 can be seen in the Figure above.

ScanNet200 Benchmark

This table lists the benchmark results for the ScanNet200 3D semantic label scenario.




Method Infoavg iouhead ioucommon ioutail iouwallchairfloortabledoorcouchcabinetshelfdeskoffice chairbedpillowsinkpicturewindowtoiletbookshelfmonitorcurtainbookarmchaircoffee tableboxrefrigeratorlampkitchen cabinettowelclothestvnightstandcounterdresserstoolcushionplantceilingbathtubend tabledining tablekeyboardbagbackpacktoilet paperprintertv standwhiteboardblanketshower curtaintrash canclosetstairsmicrowavestoveshoecomputer towerbottlebinottomanbenchboardwashing machinemirrorcopierbasketsofa chairfile cabinetfanlaptopshowerpaperpersonpaper towel dispenserovenblindsrackplateblackboardpianosuitcaserailradiatorrecycling bincontainerwardrobesoap dispensertelephonebucketclockstandlightlaundry basketpipeclothes dryerguitartoilet paper holderseatspeakercolumnbicycleladderbathroom stallshower wallcupjacketstorage bincoffee makerdishwasherpaper towel rollmachinematwindowsillbartoasterbulletin boardironing boardfireplacesoap dishkitchen counterdoorframetoilet paper dispensermini fridgefire extinguisherballhatshower curtain rodwater coolerpaper cuttertrayshower doorpillarledgetoaster ovenmousetoilet seat cover dispenserfurniturecartstorage containerscaletissue boxlight switchcratepower outletdecorationsignprojectorcloset doorvacuum cleanercandleplungerstuffed animalheadphonesdish rackbroomguitar caserange hooddustpanhair dryerwater bottlehandicap barpurseventshower floorwater pitchermailboxbowlpaper bagalarm clockmusic standprojector screendividerlaundry detergentbathroom counterobjectbathroom vanitycloset walllaundry hamperbathroom stall doorceiling lighttrash bindumbbellstair railtubebathroom cabinetcd casecloset rodcoffee kettlestructureshower headkeyboard pianocase of water bottlescoat rackstorage organizerfolded chairfire alarmpower stripcalendarposterpotted plantluggagemattress
sort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysorted bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort by
IMFSegNet0.334 100.532 140.251 120.179 80.799 120.683 90.940 110.555 90.631 130.740 120.406 110.336 140.560 100.062 40.795 70.518 130.733 110.274 60.646 140.947 90.458 180.848 140.862 110.305 100.649 50.284 140.713 130.495 80.626 90.527 100.363 100.820 60.574 140.010 140.411 40.597 70.000 10.842 50.873 100.704 150.246 40.000 70.495 120.041 170.486 100.305 80.444 130.604 160.134 170.055 170.852 100.633 140.076 100.792 50.612 90.573 180.484 130.668 130.216 130.000 30.197 90.518 70.784 140.344 130.908 80.283 50.190 40.599 140.439 110.496 110.569 30.000 10.392 100.776 30.000 40.064 50.000 10.000 60.710 100.756 130.508 120.512 170.159 160.034 150.773 20.363 110.000 30.000 80.000 10.032 70.000 40.029 170.648 170.000 10.000 110.000 100.830 70.595 40.274 160.228 90.206 90.188 130.000 150.425 90.237 120.123 130.000 50.277 60.214 150.003 10.610 30.044 130.124 100.320 150.408 120.594 100.196 80.213 80.139 140.000 10.615 70.618 60.839 40.000 10.014 70.260 70.080 130.025 20.000 110.139 130.135 60.035 70.000 110.000 10.793 20.799 100.000 10.357 140.000 10.369 60.359 140.000 10.512 160.000 10.000 10.120 130.424 30.903 90.027 60.091 70.000 10.245 50.000 10.073 160.457 150.340 130.191 160.021 160.009 180.322 160.608 70.060 30.000 10.494 110.000 20.000 20.068 110.624 120.000 30.000 10.000 10.139 120.047 40.000 30.561 80.000 1
GSTran0.334 110.533 130.250 130.179 90.799 120.684 80.940 110.554 100.633 120.741 110.405 120.337 130.560 100.060 50.794 90.517 140.732 120.274 60.647 130.948 80.459 170.849 120.864 100.306 90.648 60.282 150.717 120.496 70.624 100.533 90.363 100.821 50.573 150.009 150.411 40.593 90.000 10.841 60.873 100.704 150.242 50.000 70.495 120.041 170.487 90.304 90.439 140.613 140.133 180.055 170.853 90.634 130.075 130.791 60.601 100.574 170.483 140.669 120.217 110.000 30.198 80.518 70.782 150.345 120.914 70.273 60.193 30.598 150.440 100.499 90.570 20.000 10.381 120.775 40.000 40.063 60.000 10.000 60.712 90.752 140.507 130.512 170.158 170.036 140.773 20.361 120.000 30.000 80.000 10.032 70.000 40.032 160.651 160.000 10.000 110.000 100.831 60.595 40.273 170.229 80.200 100.191 110.000 150.425 90.233 130.125 120.000 50.279 50.213 160.003 10.608 40.044 130.138 90.321 130.408 120.593 110.198 60.205 90.139 140.000 10.614 80.609 70.838 50.000 10.014 70.260 70.080 130.010 50.000 110.136 140.136 50.047 60.000 110.000 10.787 30.797 110.000 10.354 150.000 10.372 50.357 150.000 10.507 170.000 10.000 10.121 120.423 40.903 90.028 50.089 80.000 10.252 40.000 10.072 170.465 130.340 130.189 170.020 170.011 170.320 170.606 80.060 30.000 10.496 100.000 20.000 20.070 100.618 140.000 30.000 10.000 10.139 120.047 40.000 30.558 90.000 1
Voltpermissive0.416 20.619 20.318 40.269 30.850 40.735 10.958 50.639 10.753 20.773 30.504 30.542 20.631 20.000 140.795 70.686 10.834 20.335 30.721 40.982 20.625 20.884 20.905 50.237 130.653 40.429 50.679 150.462 110.709 30.680 30.475 10.893 10.652 50.000 170.392 90.541 120.000 10.865 40.900 50.952 10.000 170.000 70.700 20.138 40.528 30.501 10.678 40.842 60.357 30.227 20.909 30.719 40.093 80.924 10.614 80.682 60.635 30.696 80.238 80.000 30.143 130.606 40.898 20.430 40.988 20.356 10.136 120.881 10.609 40.583 30.588 10.000 10.624 30.635 110.000 40.087 20.000 10.000 60.904 20.903 20.747 20.696 20.410 80.272 70.737 40.603 40.000 30.097 10.000 10.007 170.000 40.063 110.981 10.000 10.066 50.000 100.891 20.431 90.380 80.261 60.265 40.274 40.069 100.425 90.401 10.151 40.631 20.005 160.324 130.000 30.778 20.251 40.000 150.421 50.499 10.725 30.223 40.277 70.862 10.000 10.728 10.351 140.855 20.000 10.020 60.407 10.218 40.000 70.997 10.329 80.218 40.000 80.000 110.000 10.000 50.930 10.000 10.551 10.000 10.518 20.493 80.000 10.962 10.000 10.000 10.414 30.576 10.934 20.188 30.398 20.000 10.000 90.000 10.040 180.616 20.553 50.438 70.082 80.141 70.437 120.888 10.000 120.000 10.754 10.000 20.000 21.000 10.752 60.000 30.000 10.000 10.142 90.000 70.000 30.791 30.000 1
Kadir Yilmaz, Adrian Kruse, Tristan Höfer, Daan de Geus, Bastian Leibe: Volume Transformer: Revisiting Vanilla Transformers for 3D Scene Understanding.
CSC-Pretrainpermissive0.249 180.455 180.171 170.079 180.766 180.659 160.930 180.494 150.542 180.700 180.314 180.215 180.430 180.121 10.697 180.441 170.683 170.235 150.609 180.895 170.476 160.816 170.770 180.186 150.634 70.216 180.734 90.340 170.471 170.307 170.293 180.591 180.542 160.076 70.205 170.464 150.000 10.484 180.832 170.766 80.052 160.000 70.413 170.059 150.418 160.222 170.318 180.609 150.206 140.112 100.743 150.625 150.076 100.579 160.548 140.590 150.371 170.552 180.081 170.003 20.142 140.201 170.638 180.233 170.686 180.000 80.142 90.444 180.375 140.247 180.198 150.000 10.128 180.454 180.019 20.097 10.000 10.000 60.553 150.557 160.373 140.545 150.164 150.014 170.547 170.174 160.000 30.002 60.000 10.037 40.000 40.063 110.664 150.000 10.000 110.130 20.170 150.152 170.335 110.079 150.110 160.175 150.098 90.175 180.166 160.045 180.207 30.014 140.465 50.000 30.001 180.001 180.046 120.299 160.327 170.537 130.033 170.012 180.186 110.000 10.205 160.377 130.463 170.000 10.058 30.000 130.055 160.041 10.000 110.105 170.000 130.000 80.000 110.000 10.000 50.398 160.000 10.308 180.000 10.000 130.319 160.000 10.543 130.000 10.000 10.062 160.004 140.862 160.000 100.000 120.000 10.000 90.000 10.123 50.316 170.225 160.250 140.094 30.180 50.332 150.441 120.000 120.000 10.310 170.000 20.000 20.000 120.592 150.000 30.000 10.000 10.203 30.000 70.000 30.000 120.000 1
Ji Hou, Benjamin Graham, Matthias Nießner, Saining Xie: Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts. CVPR 2021
LGroundpermissive0.272 160.485 160.184 160.106 160.778 160.676 120.932 160.479 180.572 160.718 150.399 130.265 160.453 170.085 30.745 160.446 160.726 140.232 160.622 160.901 160.512 120.826 160.786 170.178 170.549 130.277 160.659 160.381 160.518 150.295 180.323 150.777 130.599 110.028 100.321 120.363 170.000 10.708 160.858 150.746 110.063 150.022 50.457 160.077 110.476 120.243 160.402 150.397 180.233 110.077 160.720 180.610 170.103 60.629 130.437 180.626 120.446 150.702 60.190 140.005 10.058 170.322 150.702 170.244 160.768 150.000 80.134 130.552 160.279 170.395 150.147 170.000 10.207 160.612 140.000 40.000 100.000 10.000 60.658 120.566 150.323 160.525 160.229 130.179 90.467 180.154 170.000 30.002 60.000 10.051 10.000 40.127 40.703 130.000 10.000 110.216 10.112 170.358 120.547 20.187 100.092 170.156 180.055 110.296 160.252 100.143 60.000 50.014 140.398 70.000 30.028 170.173 80.000 150.265 170.348 150.415 170.179 90.019 170.218 90.000 10.597 90.274 170.565 140.000 10.012 90.000 130.039 170.022 30.000 110.117 160.000 130.000 80.000 110.000 10.000 50.324 170.000 10.384 100.000 10.000 130.251 180.000 10.566 120.000 10.000 10.066 150.404 50.886 140.199 20.000 120.000 10.059 70.000 10.136 10.540 60.127 180.295 120.085 70.143 60.514 70.413 160.000 120.000 10.498 90.000 20.000 20.000 120.623 130.000 30.000 10.000 10.132 160.000 70.000 30.000 120.000 1
David Rozenberszki, Or Litany, Angela Dai: Language-Grounded Indoor 3D Semantic Segmentation in the Wild. arXiv
AWCS0.305 150.508 150.225 150.142 120.782 150.634 180.937 150.489 160.578 150.721 130.364 160.355 120.515 130.023 90.764 150.523 120.707 150.264 120.633 150.922 150.507 140.886 10.804 160.179 160.436 170.300 130.656 170.529 30.501 160.394 140.296 170.820 60.603 100.131 30.179 180.619 30.000 10.707 170.865 140.773 70.171 70.010 60.484 150.063 140.463 140.254 140.332 170.649 120.220 120.100 120.729 160.613 160.071 140.582 150.628 70.702 40.424 160.749 20.137 160.000 30.142 140.360 140.863 70.305 150.877 110.000 80.173 50.606 130.337 150.478 130.154 160.000 10.253 150.664 80.000 40.000 100.000 10.000 60.626 140.782 110.302 170.602 80.185 140.282 60.651 140.317 140.000 30.000 80.000 10.022 130.000 40.154 20.876 100.000 10.014 100.063 90.029 180.553 70.467 30.084 140.124 150.157 170.049 130.373 140.252 100.097 160.000 50.219 70.542 30.000 30.392 80.172 90.000 150.339 100.417 90.533 140.093 160.115 110.195 100.000 10.516 110.288 160.741 70.000 10.001 110.233 100.056 150.000 70.159 70.334 70.077 100.000 80.000 110.000 10.000 50.749 140.000 10.411 90.000 10.008 120.452 110.000 10.595 110.000 10.000 10.220 110.006 130.894 130.006 90.000 120.000 10.000 90.000 10.112 60.504 90.404 110.551 30.093 40.129 150.484 100.381 180.000 120.000 10.396 150.000 20.000 20.620 40.402 180.000 30.000 10.000 10.142 90.000 70.000 30.512 100.000 1
: Long-Tailed 3D Semantic Segmentation with Adaptive Weight Constraint and Sampling. ICRA 2024
CeCo0.340 80.551 100.247 140.181 70.784 140.661 150.939 140.564 70.624 140.721 130.484 60.429 60.575 60.027 80.774 120.503 150.753 60.242 140.656 120.945 100.534 80.865 80.860 120.177 180.616 90.400 60.818 20.579 10.615 120.367 150.408 70.726 160.633 60.162 10.360 100.619 30.000 10.828 100.873 100.924 30.109 130.083 30.564 70.057 160.475 130.266 120.781 20.767 80.257 80.100 120.825 120.663 110.048 160.620 140.551 130.595 140.532 80.692 90.246 60.000 30.213 60.615 20.861 80.376 80.900 90.000 80.102 160.660 90.321 160.547 60.226 140.000 10.311 140.742 50.011 30.006 90.000 10.000 60.546 160.824 90.345 150.665 30.450 60.435 10.683 90.411 90.338 10.000 80.000 10.030 90.000 40.068 90.892 90.000 10.063 60.000 100.257 140.304 140.387 60.079 150.228 70.190 120.000 150.586 10.347 50.133 80.000 50.037 130.377 100.000 30.384 90.006 170.003 130.421 50.410 110.643 60.171 100.121 100.142 130.000 10.510 120.447 110.474 150.000 10.000 120.286 60.083 120.000 70.000 110.603 10.096 80.063 50.000 110.000 10.000 50.898 40.000 10.429 80.000 10.400 30.550 40.000 10.633 70.000 10.000 10.377 60.000 160.916 50.000 100.000 120.000 10.000 90.000 10.102 120.499 100.296 150.463 60.089 50.304 10.740 30.401 170.010 70.000 10.560 50.000 20.000 20.709 30.652 110.000 30.000 10.000 10.143 80.000 70.000 30.609 60.000 1
Zhisheng Zhong, Jiequan Cui, Yibo Yang, Xiaoyang Wu, Xiaojuan Qi, Xiangyu Zhang, Jiaya Jia: Understanding Imbalanced Semantic Segmentation Through Neural Collapse. CVPR 2023
OctFormer ScanNet200permissive0.326 140.539 110.265 110.131 130.806 90.670 130.943 100.535 130.662 50.705 170.423 100.407 70.505 140.003 110.765 140.582 80.686 160.227 170.680 90.943 110.601 30.854 110.892 70.335 60.417 180.357 110.724 100.453 120.632 80.596 60.432 40.783 120.512 170.021 120.244 160.637 20.000 10.787 130.873 100.743 120.000 170.000 70.534 100.110 50.499 70.289 110.626 80.620 130.168 160.204 50.849 110.679 90.117 50.633 120.684 30.650 90.552 60.684 100.312 30.000 30.175 110.429 120.865 60.413 50.837 130.000 80.145 80.626 100.451 90.487 120.513 40.000 10.529 80.613 130.000 40.033 70.000 10.000 60.828 60.871 40.622 100.587 100.411 70.137 110.645 150.343 130.000 30.000 80.000 10.022 130.000 40.026 180.829 120.000 10.022 90.089 60.842 50.253 150.318 120.296 20.178 120.291 30.224 30.584 20.200 150.132 90.000 50.128 110.227 140.000 30.230 140.047 120.149 80.331 110.412 100.618 80.164 110.102 120.522 40.000 10.655 50.378 120.469 160.000 10.000 120.000 130.105 100.000 70.000 110.483 30.000 130.000 80.028 80.000 10.000 50.906 20.000 10.339 160.000 10.000 130.457 100.000 10.612 90.000 10.000 10.408 50.000 160.900 110.000 100.000 120.000 10.029 80.000 10.074 150.455 160.479 70.427 80.079 100.140 90.496 80.414 150.022 60.000 10.471 140.000 20.000 20.000 120.722 80.000 30.000 10.000 10.138 140.000 70.000 30.000 120.000 1
Peng-Shuai Wang: OctFormer: Octree-based Transformers for 3D Point Clouds. SIGGRAPH 2023
PPT-SpUNet-F.T.0.332 130.556 70.270 80.123 150.816 70.682 100.946 70.549 110.657 90.756 60.459 80.376 100.550 120.001 120.807 40.616 50.727 130.267 100.691 60.942 120.530 100.872 60.874 90.330 80.542 150.374 90.792 50.400 150.673 50.572 80.433 30.793 100.623 80.008 160.351 110.594 80.000 10.783 140.876 80.833 50.213 60.000 70.537 90.091 80.519 50.304 90.620 90.942 20.264 60.124 90.855 80.695 60.086 90.646 110.506 170.658 80.535 70.715 40.314 20.000 30.241 40.608 30.897 30.359 90.858 120.000 80.076 180.611 120.392 130.509 80.378 70.000 10.579 50.565 160.000 40.000 100.000 10.000 60.755 80.806 100.661 50.572 140.350 100.181 80.660 130.300 150.000 30.000 80.000 10.023 120.000 40.042 150.930 50.000 10.000 110.077 70.584 100.392 110.339 100.185 110.171 130.308 20.006 140.563 30.256 90.150 50.000 50.002 170.345 120.000 30.045 150.197 60.063 110.323 120.453 50.600 90.163 120.037 160.349 50.000 10.672 40.679 40.753 60.000 10.000 120.000 130.117 70.000 70.000 110.291 90.000 130.000 80.039 70.000 10.000 50.899 30.000 10.374 120.000 10.000 130.545 50.000 10.634 60.000 10.000 10.074 140.223 90.914 70.000 100.021 100.000 10.000 90.000 10.112 60.498 110.649 10.383 110.095 20.135 130.449 110.432 130.008 90.000 10.518 80.000 20.000 20.000 120.796 50.000 30.000 10.000 10.138 140.000 70.000 30.000 120.000 1
Xiaoyang Wu, Zhuotao Tian, Xin Wen, Bohao Peng, Xihui Liu, Kaicheng Yu, Hengshuang Zhao: Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Training. CVPR 2024
L3DETR-ScanNet_2000.336 90.533 120.279 70.155 110.801 100.689 50.946 70.539 120.660 80.759 50.380 150.333 150.583 50.000 140.788 110.529 110.740 90.261 130.679 100.940 130.525 110.860 90.883 80.226 140.613 100.397 70.720 110.512 50.565 130.620 40.417 50.775 140.629 70.158 20.298 130.579 110.000 10.835 70.883 70.927 20.114 110.079 40.511 110.073 120.508 60.312 70.629 70.861 50.192 150.098 140.908 40.636 120.032 180.563 180.514 160.664 70.505 110.697 70.225 100.000 30.264 20.411 130.860 90.321 140.960 40.058 70.109 140.776 40.526 60.557 40.303 100.000 10.339 130.712 70.000 40.014 80.000 10.000 60.638 130.856 50.641 80.579 120.107 180.119 120.661 120.416 80.000 30.000 80.000 10.007 170.000 40.067 100.910 60.000 10.000 110.000 100.463 120.448 80.294 150.324 10.293 30.211 90.108 80.448 80.068 180.141 70.000 50.330 30.699 10.000 30.256 120.192 70.000 150.355 90.418 80.209 180.146 130.679 30.101 180.000 10.503 140.687 20.671 90.000 10.000 120.174 120.117 70.000 70.122 80.515 20.104 70.259 20.312 30.000 10.000 50.765 130.000 10.369 130.000 10.183 90.422 120.000 10.646 50.000 10.000 10.565 20.001 150.125 180.010 80.002 110.000 10.487 10.000 10.075 140.548 50.420 100.233 150.082 80.138 120.430 130.427 140.000 120.000 10.549 70.000 20.000 20.074 90.409 170.000 30.000 10.000 10.152 70.051 30.000 30.598 70.000 1
Yanmin Wu, Qiankun Gao, Renrui Zhang, Jian Zhang: Language-Assisted 3D Scene Understanding. arXiv23.12
OA-CNN-L_ScanNet2000.333 120.558 60.269 100.124 140.821 60.703 40.946 70.569 60.662 50.748 100.487 40.455 50.572 80.000 140.789 100.534 100.736 100.271 90.713 50.949 70.498 150.877 40.860 120.332 70.706 10.474 30.788 70.406 140.637 70.495 120.355 120.805 80.592 130.015 130.396 80.602 60.000 10.799 120.876 80.713 140.276 20.000 70.493 140.080 100.448 150.363 60.661 50.833 70.262 70.125 80.823 130.665 100.076 100.720 90.557 110.637 100.517 100.672 110.227 90.000 30.158 120.496 90.843 120.352 110.835 140.000 80.103 150.711 60.527 50.526 70.320 90.000 10.568 70.625 120.067 10.000 100.000 10.001 50.806 70.836 80.621 110.591 90.373 90.314 50.668 110.398 100.003 20.000 80.000 10.016 160.024 20.043 140.906 70.000 10.052 70.000 100.384 130.330 130.342 90.100 130.223 80.183 140.112 70.476 60.313 80.130 100.196 40.112 120.370 110.000 30.234 130.071 100.160 70.403 70.398 140.492 150.197 70.076 140.272 60.000 10.200 170.560 100.735 80.000 10.000 120.000 130.110 90.002 60.021 90.412 50.000 130.000 80.000 110.000 10.000 50.794 120.000 10.445 60.000 10.022 110.509 70.000 10.517 140.000 10.000 10.001 180.245 80.915 60.024 70.089 80.000 10.262 30.000 10.103 110.524 80.392 120.515 40.013 180.251 40.411 140.662 50.001 110.000 10.473 130.000 20.000 20.150 60.699 100.000 30.000 10.000 10.166 60.000 70.024 20.000 120.000 1
PTv3 ScanNet2000.393 40.592 40.330 20.216 40.851 20.687 70.971 20.586 30.755 10.752 80.505 20.404 80.575 60.000 140.848 20.616 50.761 40.349 10.738 30.978 40.546 70.860 90.926 30.346 40.654 30.384 80.828 10.523 40.699 40.583 70.387 80.822 40.688 20.118 40.474 30.603 50.000 10.832 90.903 20.753 100.140 100.000 70.650 40.109 60.520 40.457 30.497 110.871 40.281 50.192 60.887 50.748 30.168 20.727 80.733 20.740 10.644 20.714 50.190 140.000 30.256 30.449 110.914 10.514 20.759 160.337 20.172 60.692 80.617 30.636 10.325 80.000 10.641 20.782 20.000 40.065 40.000 10.000 60.842 50.903 20.661 50.662 40.612 10.405 20.731 50.566 50.000 30.000 80.000 10.017 150.301 10.088 70.941 40.000 10.077 40.000 100.717 90.790 20.310 130.026 180.264 50.349 10.220 50.397 130.366 30.115 140.000 50.337 10.463 60.000 30.531 60.218 50.593 20.455 20.469 30.708 40.210 50.592 40.108 170.000 10.728 10.682 30.671 90.000 10.000 120.407 10.136 50.022 30.575 20.436 40.259 30.428 10.048 60.000 10.000 50.879 60.000 10.480 30.000 10.133 100.597 20.000 10.690 30.000 10.000 10.009 170.000 160.921 40.000 100.151 60.000 10.000 90.000 10.109 80.494 120.622 20.394 100.073 130.141 70.798 20.528 90.026 50.000 10.551 60.000 20.000 20.134 80.717 90.000 30.000 10.000 10.188 40.000 70.000 30.791 30.000 1
Xiaoyang Wu, Li Jiang, Peng-Shuai Wang, Zhijian Liu, Xihui Liu, Yu Qiao, Wanli Ouyang, Tong He, Hengshuang Zhao: Point Transformer V3: Simpler, Faster, Stronger. CVPR 2024 (Oral)
PonderV2 ScanNet2000.346 70.552 90.270 90.175 100.810 80.682 100.950 60.560 80.641 110.761 40.398 140.357 110.570 90.113 20.804 50.603 70.750 80.283 50.681 80.952 60.548 60.874 50.852 140.290 120.700 20.356 120.792 50.445 130.545 140.436 130.351 130.787 110.611 90.050 80.290 150.519 130.000 10.825 110.888 60.842 40.259 30.100 20.558 80.070 130.497 80.247 150.457 120.889 30.248 100.106 110.817 140.691 70.094 70.729 70.636 60.620 130.503 120.660 140.243 70.000 30.212 70.590 60.860 90.400 60.881 100.000 80.202 20.622 110.408 120.499 90.261 110.000 10.385 110.636 100.000 40.000 100.000 10.000 60.433 170.843 70.660 70.574 130.481 40.336 40.677 100.486 70.000 30.030 40.000 10.034 60.000 40.080 80.869 110.000 10.000 110.000 100.540 110.727 30.232 180.115 120.186 110.193 100.000 150.403 120.326 70.103 150.000 50.290 40.392 90.000 30.346 110.062 110.424 50.375 80.431 70.667 50.115 150.082 130.239 80.000 10.504 130.606 80.584 130.000 10.002 100.186 110.104 110.000 70.394 60.384 60.083 90.000 80.007 90.000 10.000 50.880 50.000 10.377 110.000 10.263 70.565 30.000 10.608 100.000 10.000 10.304 80.009 120.924 30.000 100.000 120.000 10.000 90.000 10.128 30.584 30.475 80.412 90.076 120.269 30.621 60.509 100.010 70.000 10.491 120.063 10.000 20.472 50.880 40.000 30.000 10.000 10.179 50.125 20.000 30.441 110.000 1
Haoyi Zhu, Honghui Yang, Xiaoyang Wu, Di Huang, Sha Zhang, Xianglong He, Tong He, Hengshuang Zhao, Chunhua Shen, Yu Qiao, Wanli Ouyang: PonderV2: Pave the Way for 3D Foundataion Model with A Universal Pre-training Paradigm.
ODIN - Sem200permissive0.368 50.562 50.297 50.207 50.800 110.669 140.940 110.575 40.654 100.749 90.487 40.589 10.609 30.001 120.769 130.561 90.752 70.274 60.682 70.926 140.554 50.833 150.921 40.389 20.599 110.591 10.787 80.550 20.657 60.610 50.334 140.803 90.661 40.090 60.408 70.373 160.000 10.912 20.796 180.501 180.169 80.000 70.641 50.196 10.380 180.397 40.641 60.740 100.862 10.213 40.857 70.685 80.216 10.578 170.557 110.685 50.523 90.581 170.312 30.000 30.065 160.000 180.871 40.359 90.988 20.321 30.090 170.704 70.631 20.393 160.246 120.000 10.482 90.565 160.000 40.000 100.000 10.181 10.913 10.468 170.632 90.642 60.259 120.000 180.832 10.663 10.000 30.081 20.000 10.048 20.000 40.376 10.898 80.000 10.157 10.000 100.870 40.000 180.400 50.265 40.242 60.227 70.539 10.370 150.214 140.129 110.000 50.131 100.054 180.000 30.358 100.491 10.462 40.434 30.346 160.454 160.316 20.814 10.828 30.000 10.000 180.220 180.612 120.000 10.000 120.373 30.378 20.000 70.429 50.152 120.077 100.166 40.202 50.000 10.000 50.441 150.000 10.440 70.000 10.000 130.655 10.000 10.626 80.000 10.000 10.228 100.487 20.784 170.000 100.301 40.000 10.426 20.000 10.108 90.460 140.590 40.775 10.088 60.119 160.485 90.791 20.000 120.000 10.256 180.000 20.000 20.000 120.885 30.303 10.000 10.000 10.127 170.000 70.000 30.894 20.000 1
Ayush Jain, Pushkal Katara, Nikolaos Gkanatsios, Adam W. Harley, Gabriel Sarch, Kriti Aggarwal, Vishrav Chaudhary, Katerina Fragkiadaki: ODIN: A Single Model for 2D and 3D Segmentation. CVPR 2024
ALS-MinkowskiNetcopyleft0.414 30.610 30.322 30.271 20.852 10.710 30.973 10.572 50.719 40.795 20.477 70.506 30.601 40.000 140.804 50.646 40.804 30.344 20.777 10.984 10.671 10.879 30.936 10.342 50.632 80.449 40.817 30.475 100.723 20.798 10.376 90.832 30.693 10.031 90.564 10.510 140.000 10.893 30.905 10.672 170.314 10.000 70.718 10.153 30.542 20.397 40.726 30.752 90.252 90.226 30.916 20.800 10.047 170.807 40.769 10.709 30.630 40.769 10.217 110.000 30.285 10.598 50.846 110.535 10.956 50.000 80.137 110.784 30.464 80.463 140.230 130.000 10.598 40.662 90.000 40.087 20.000 10.135 30.900 30.780 120.703 30.741 10.571 20.149 100.697 80.646 20.000 30.076 30.000 10.025 110.000 40.106 60.981 10.000 10.043 80.113 40.888 30.248 160.404 40.252 70.314 10.220 80.245 20.466 70.366 30.159 20.000 50.149 80.690 20.000 30.531 60.253 30.285 60.460 10.440 60.813 10.230 30.283 60.159 120.000 10.728 10.666 50.958 10.000 10.021 50.252 90.118 60.000 70.445 40.223 110.285 10.194 30.390 20.000 10.475 40.842 80.000 10.455 40.000 10.250 80.458 90.000 10.865 20.000 10.000 10.635 10.359 60.972 10.087 40.447 10.000 10.000 90.000 10.129 20.532 70.446 90.503 50.071 140.135 130.699 40.717 30.097 20.000 10.665 20.000 20.000 21.000 10.752 60.000 30.000 10.000 10.142 90.200 10.259 11.000 10.000 1
Guangda Ji, Silvan Weder, Francis Engelmann, Marc Pollefeys, Hermann Blum: ARKit LabelMaker: A New Scale for Indoor 3D Scene Understanding. CVPR 2025
BFANet ScanNet200permissive0.360 60.553 80.293 60.193 60.827 50.689 50.970 30.528 140.661 70.753 70.436 90.378 90.469 160.042 70.810 30.654 30.760 50.266 110.659 110.973 50.574 40.849 120.897 60.382 30.546 140.372 100.698 140.491 90.617 110.526 110.436 20.764 150.476 180.101 50.409 60.585 100.000 10.835 70.901 30.810 60.102 140.000 70.688 30.096 70.483 110.264 130.612 100.591 170.358 20.161 70.863 60.707 50.128 40.814 30.669 40.629 110.563 50.651 150.258 50.000 30.194 100.494 100.806 130.394 70.953 60.000 80.233 10.757 50.508 70.556 50.476 50.000 10.573 60.741 60.000 40.000 100.000 10.000 60.000 180.852 60.678 40.616 70.460 50.338 30.710 60.534 60.000 30.025 50.000 10.043 30.000 40.056 130.493 180.000 10.000 110.109 50.785 80.590 60.298 140.282 30.143 140.262 50.053 120.526 40.337 60.215 10.000 50.135 90.510 40.000 30.596 50.043 150.511 30.321 130.459 40.772 20.124 140.060 150.266 70.000 10.574 100.568 90.653 110.000 10.093 10.298 50.239 30.000 70.516 30.129 150.284 20.000 80.431 10.000 10.000 50.848 70.000 10.492 20.000 10.376 40.522 60.000 10.469 180.000 10.000 10.330 70.151 110.875 150.000 100.254 50.000 10.000 90.000 10.088 130.661 10.481 60.255 130.105 10.139 100.666 50.641 60.000 120.000 10.614 30.000 20.000 20.000 120.921 20.000 30.000 10.000 10.497 10.000 70.000 30.000 120.000 1
Weiguang Zhao, Rui Zhang, Qiufeng Wang, Guangliang Cheng, Kaizhu Huang: BFANet: Revisiting 3D Semantic Segmentation with Boundary Feature Analysis. CVPR 2025
DITR0.449 10.629 10.392 10.289 10.851 20.727 20.969 40.600 20.741 30.805 10.519 10.480 40.636 10.014 100.867 10.680 20.849 10.318 40.753 20.982 20.508 130.871 70.934 20.482 10.596 120.551 20.804 40.508 60.729 10.718 20.417 50.886 20.664 30.000 170.500 20.698 10.000 10.913 10.901 30.766 80.113 120.000 70.617 60.168 20.650 10.477 20.826 10.962 10.348 40.300 10.947 10.776 20.160 30.889 20.651 50.720 20.700 10.728 30.317 10.000 30.238 50.664 10.869 50.514 20.998 10.313 40.138 100.815 20.828 10.622 20.421 60.000 10.823 10.817 10.000 40.000 100.000 10.157 20.866 40.991 10.805 10.660 50.571 20.043 130.709 70.642 30.000 30.000 80.000 10.028 100.018 30.134 30.967 30.000 10.150 20.130 20.949 10.855 10.580 10.262 50.314 10.230 60.222 40.498 50.367 20.153 30.869 10.334 20.397 80.000 30.904 10.486 21.000 10.423 40.484 20.632 70.716 10.733 20.862 10.000 10.433 150.710 10.851 30.000 10.034 40.315 40.385 10.000 70.001 100.268 100.066 120.000 80.278 40.000 10.978 10.839 90.000 10.448 50.000 10.579 10.403 130.000 10.647 40.000 10.000 10.411 40.315 70.904 80.420 10.392 30.000 10.091 60.000 10.128 30.564 40.591 30.568 20.079 100.139 101.000 10.714 40.178 10.000 10.606 40.000 20.000 20.148 70.983 10.000 30.000 10.000 10.374 20.000 70.000 30.662 50.000 1
Karim Abou Zeid, Kadir Yilmaz, Daan de Geus, Alexander Hermans, David Adrian, Timm Linder, Bastian Leibe: DINO in the Room: Leveraging 2D Foundation Models for 3D Segmentation. 3DV 2026
Minkowski 34Dpermissive0.253 170.463 170.154 180.102 170.771 170.650 170.932 160.483 170.571 170.710 160.331 170.250 170.492 150.044 60.703 170.419 180.606 180.227 170.621 170.865 180.531 90.771 180.813 150.291 110.484 160.242 170.612 180.282 180.440 180.351 160.299 160.622 170.593 120.027 110.293 140.310 180.000 10.757 150.858 150.737 130.150 90.164 10.368 180.084 90.381 170.142 180.357 160.720 110.214 130.092 150.724 170.596 180.056 150.655 100.525 150.581 160.352 180.594 160.056 180.000 30.014 180.224 160.772 160.205 180.720 170.000 80.159 70.531 170.163 180.294 170.136 180.000 10.169 170.589 150.000 40.000 100.000 10.002 40.663 110.466 180.265 180.582 110.337 110.016 160.559 160.084 180.000 30.000 80.000 10.036 50.000 40.125 50.670 140.000 10.102 30.071 80.164 160.406 100.386 70.046 170.068 180.159 160.117 60.284 170.111 170.094 170.000 50.000 180.197 170.000 30.044 160.013 160.002 140.228 180.307 180.588 120.025 180.545 50.134 160.000 10.655 50.302 150.282 180.000 10.060 20.000 130.035 180.000 70.000 110.097 180.000 130.000 80.005 100.000 10.000 50.096 180.000 10.334 170.000 10.000 130.274 170.000 10.513 150.000 10.000 10.280 90.194 100.897 120.000 100.000 120.000 10.000 90.000 10.108 90.279 180.189 170.141 180.059 150.272 20.307 180.445 110.003 100.000 10.353 160.000 20.026 10.000 120.581 160.001 20.000 10.000 10.093 180.002 60.000 30.000 120.000 1
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019


This table lists the benchmark results for the ScanNet200 3D semantic instance scenario.




Method Infoavgchairtabledoorcouchcabinetshelfdeskoffice chairbedpillowsinkpicturewindowtoiletbookshelfmonitorcurtainbookarmchaircoffee tableboxrefrigeratorlampkitchen cabinettowelclothestvnightstandcounterdresserstoolcushionplantceilingbathtubend tabledining tablekeyboardbagbackpacktoilet paperprintertv standwhiteboardblanketshower curtaintrash canclosetstairsmicrowavestoveshoecomputer towerbottlebinottomanbenchboardwashing machinemirrorcopierbasketsofa chairfile cabinetfanlaptopshowerpaperpersonpaper towel dispenserovenblindsrackplateblackboardpianosuitcaserailradiatorrecycling bincontainerwardrobesoap dispensertelephonebucketclockstandlightlaundry basketpipeclothes dryerguitartoilet paper holderseatspeakercolumnbicycleladderbathroom stallshower wallcupjacketstorage bincoffee makerdishwasherpaper towel rollmachinematwindowsillbartoasterbulletin boardironing boardfireplacesoap dishkitchen counterdoorframetoilet paper dispensermini fridgefire extinguisherballhatshower curtain rodwater coolerpaper cuttertrayshower doorpillarledgetoaster ovenmousetoilet seat cover dispenserfurniturecartstorage containerscaletissue boxlight switchcratepower outletdecorationsignprojectorcloset doorvacuum cleanercandleplungerstuffed animalheadphonesdish rackbroomguitar caserange hooddustpanhair dryerwater bottlehandicap barpurseventshower floorwater pitchermailboxbowlpaper bagalarm clockmusic standprojector screendividerlaundry detergentbathroom counterobjectbathroom vanitycloset walllaundry hamperbathroom stall doorceiling lighttrash bindumbbellstair railtubebathroom cabinetcd casecloset rodcoffee kettlestructureshower headkeyboard pianocase of water bottlescoat rackstorage organizerfolded chairfire alarmpower stripcalendarposterpotted plantluggagemattress
sort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysorted bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort by
AQ3D-ScanNet2000.491 20.675 10.458 10.308 30.907 10.712 20.846 30.860 40.596 10.305 40.796 10.328 20.955 40.768 20.662 60.925 10.666 21.000 10.754 30.919 50.824 10.459 10.804 50.307 30.929 20.698 30.648 20.737 30.310 10.764 50.896 20.049 60.778 20.576 30.160 30.879 20.832 41.000 10.077 70.023 70.829 30.153 30.823 20.517 50.667 61.000 10.498 60.371 41.000 10.934 10.005 71.000 10.831 50.778 20.551 30.754 110.258 60.025 50.564 40.458 31.000 10.521 31.000 10.833 10.347 30.991 10.473 50.434 61.000 10.071 20.428 50.868 21.000 10.333 50.133 10.000 70.533 51.000 10.671 30.765 30.534 20.664 10.818 50.698 30.083 10.009 30.000 50.431 10.000 20.147 10.667 20.029 20.172 30.250 61.000 10.737 30.104 50.713 10.362 20.319 30.004 20.489 90.600 10.083 50.563 20.400 30.923 10.500 10.716 10.605 30.500 10.506 50.530 30.750 30.658 40.318 60.500 10.000 21.000 10.333 81.000 10.000 10.105 30.000 40.500 10.000 31.000 11.000 10.000 50.141 80.026 80.000 30.000 31.000 10.000 10.640 20.000 10.517 40.750 10.000 11.000 10.000 10.000 10.714 70.667 30.479 30.167 50.667 10.000 11.000 10.000 10.074 70.834 10.517 30.444 70.073 60.433 30.438 60.281 20.083 20.000 10.553 10.000 10.000 21.000 10.917 60.000 30.056 20.000 20.200 40.141 30.000 40.250 70.000 2
ACGP-ScanNet2000.494 10.656 20.453 30.345 10.771 70.746 10.864 20.831 80.484 60.344 10.687 50.035 40.933 60.633 50.823 10.871 20.633 30.997 50.834 10.963 10.718 20.442 20.838 10.313 20.893 50.680 40.655 10.840 10.276 30.800 20.743 80.212 10.573 60.548 40.000 50.736 40.853 11.000 10.062 81.000 10.819 50.178 20.723 40.424 70.835 21.000 10.618 20.378 31.000 10.914 30.023 30.703 60.836 40.667 60.495 50.817 40.260 50.035 40.511 60.307 60.903 30.566 21.000 10.708 20.360 20.931 20.511 30.510 31.000 10.089 10.671 10.765 51.000 10.528 30.005 20.204 41.000 10.500 30.702 20.842 20.590 10.461 20.844 40.664 40.042 20.010 20.000 50.405 20.000 20.040 70.817 10.007 40.341 20.444 51.000 10.714 40.020 90.643 20.310 40.396 10.000 30.903 20.400 20.500 20.250 30.600 20.657 20.500 10.304 50.540 50.000 60.532 30.545 20.750 30.677 30.637 20.500 10.000 20.792 70.504 31.000 10.000 10.071 40.000 40.396 40.000 31.000 11.000 10.036 40.146 70.396 20.000 30.000 31.000 10.000 10.627 30.000 10.638 30.677 60.000 10.974 20.000 10.000 10.835 50.850 10.449 51.000 10.472 20.000 10.250 70.000 10.148 10.695 40.387 60.592 30.189 50.204 80.500 40.088 90.064 30.000 10.471 20.000 10.000 21.000 11.000 10.000 30.000 50.000 20.317 30.144 20.024 31.000 10.008 1
Rongkun Yang, Ye Zhang, Longguang Wang, Zhiheng Fu, Lian Xu, Yulan Guo: Beyond Context Bias: Adaptive Instance Placement for Robust 3D Instance Segmentation.
CompetitorFormer-2000.415 50.574 50.370 60.274 50.885 20.584 80.846 40.779 90.318 80.205 60.704 40.400 10.987 20.651 40.731 50.830 40.682 11.000 10.599 80.957 20.685 60.428 30.806 40.196 60.870 70.641 50.600 50.583 60.183 70.780 40.833 40.095 40.663 40.538 50.021 40.540 90.845 20.903 80.103 50.083 60.881 20.054 80.632 50.311 90.745 31.000 10.545 40.378 20.933 90.832 70.015 40.684 70.748 70.700 50.562 20.869 20.218 70.064 10.885 10.243 70.794 50.484 51.000 10.000 60.289 50.758 50.482 40.452 40.000 90.015 50.286 60.759 60.663 31.000 10.000 30.380 30.250 60.500 30.491 60.622 80.213 60.131 50.877 10.602 60.000 40.005 40.008 40.209 70.000 20.089 30.399 50.000 60.160 40.500 20.500 50.144 100.260 20.347 80.443 10.207 70.000 30.724 50.400 20.125 40.083 40.317 70.462 40.083 30.565 20.587 40.500 10.648 20.551 10.750 30.508 60.018 80.500 10.000 21.000 10.667 11.000 10.000 10.142 20.000 40.500 10.000 30.125 70.489 50.000 50.500 10.269 40.000 30.050 20.625 60.000 10.581 40.000 10.677 20.467 90.000 10.694 70.000 10.000 10.820 60.071 100.215 81.000 10.103 50.000 11.000 10.000 10.132 20.410 60.327 70.541 50.232 40.292 50.261 90.186 50.157 10.000 10.216 60.000 10.056 10.250 51.000 10.000 30.082 10.000 20.400 20.025 40.000 41.000 10.000 2
Volt-SPFormerpermissive0.475 30.630 30.451 40.314 20.806 60.666 60.923 10.847 50.541 40.224 50.755 20.008 60.994 10.735 30.818 20.869 30.621 40.990 80.811 20.894 60.702 40.423 40.825 20.281 40.923 30.787 20.564 60.699 40.245 40.784 30.800 50.129 20.900 10.500 70.000 50.768 30.841 31.000 10.319 10.000 80.903 10.068 60.772 30.565 20.683 51.000 10.546 30.410 11.000 10.930 20.014 50.629 100.878 20.725 40.499 40.799 70.412 30.019 60.400 70.500 11.000 10.612 11.000 10.125 30.343 40.823 40.750 10.449 50.250 40.056 30.585 30.797 40.500 40.667 20.000 30.043 61.000 11.000 10.716 10.853 10.255 40.099 60.857 20.651 50.000 40.000 50.025 20.375 30.250 10.056 50.333 60.002 50.000 70.250 60.500 51.000 10.107 40.613 30.294 50.300 50.000 30.817 30.400 20.500 21.000 10.400 30.452 50.000 40.500 30.519 60.500 10.372 60.482 40.750 30.641 50.510 30.500 10.000 21.000 10.472 41.000 10.000 10.026 50.000 40.331 50.000 31.000 11.000 10.000 50.500 10.304 30.000 30.000 31.000 10.000 10.714 10.000 10.500 50.750 10.000 10.944 40.000 10.000 10.857 20.764 20.455 40.250 30.278 40.000 11.000 10.000 10.078 50.742 20.600 10.524 60.638 10.167 90.208 100.209 40.019 40.000 10.241 50.000 10.000 21.000 11.000 10.000 30.028 40.000 20.200 40.000 50.250 11.000 10.000 2
Kadir Yilmaz, Adrian Kruse, Tristan Höfer, Daan de Geus, Bastian Leibe: Volume Transformer: Revisiting Vanilla Transformers for 3D Scene Understanding.
DINO3D-Scannet200copyleft0.454 40.587 40.453 20.296 40.871 30.703 30.845 50.891 20.572 20.312 30.753 30.001 80.981 30.773 10.767 30.771 50.614 50.944 90.586 100.937 30.690 50.381 50.716 100.409 10.918 40.803 10.602 40.777 20.290 20.721 60.779 70.096 30.728 30.677 10.000 50.944 10.793 51.000 10.214 20.708 40.823 40.200 10.851 10.499 61.000 10.764 100.473 70.248 51.000 10.911 40.216 10.667 80.824 60.857 10.616 10.842 30.496 20.046 20.355 110.494 20.405 90.507 41.000 10.042 50.264 70.743 60.683 20.675 10.125 50.000 60.600 20.816 30.417 70.000 60.000 30.764 10.000 80.500 30.563 50.720 50.079 90.442 30.845 30.835 20.000 40.000 50.000 50.324 40.000 20.117 20.083 80.000 60.419 10.500 21.000 10.777 20.378 10.594 40.361 30.327 20.000 30.764 40.400 20.548 10.000 50.800 10.437 60.000 40.346 40.714 10.125 50.662 10.475 50.866 20.750 10.400 50.500 10.500 11.000 10.667 11.000 10.000 10.298 10.000 40.250 60.194 10.000 80.850 40.000 50.250 50.595 10.000 30.063 10.520 80.000 10.571 50.000 10.944 10.750 10.000 10.974 20.000 10.000 10.857 20.655 40.000 100.250 30.014 70.000 11.000 10.000 10.116 30.729 30.200 80.545 40.436 30.221 70.750 10.177 60.011 50.000 10.284 30.000 10.000 20.000 60.792 70.050 20.000 50.000 20.200 40.000 50.000 41.000 10.000 2
Jinyuan Qu, Hongyang Li, Xingyu Chen, Shilong Liu, Yukai Shi, Tianhe Ren, Ruitao Jing and Lei Zhang: SegDINO3D: 3D Instance Segmentation Empowered by Both Image-Level and Object-Level 2D Features. AAAI 2026
ODIN - Ins200permissive0.381 70.507 70.375 50.237 60.653 110.614 70.780 60.744 110.566 30.328 20.446 80.003 70.853 70.496 70.582 80.448 110.434 80.938 100.682 50.782 80.494 100.274 70.723 90.269 50.694 110.393 100.511 70.695 50.227 50.550 100.795 60.039 70.602 50.638 20.000 50.734 50.585 80.667 90.163 30.500 50.769 60.108 40.484 90.569 10.688 41.000 10.665 10.093 71.000 10.863 50.049 20.667 80.887 10.778 20.422 60.786 90.550 10.000 80.542 50.028 100.667 70.428 71.000 10.125 30.208 100.530 90.406 70.337 70.000 90.000 60.585 30.742 70.500 40.000 60.000 30.472 21.000 10.417 90.563 40.631 70.275 30.000 80.800 60.841 10.000 40.083 10.000 50.174 80.000 20.055 60.667 20.000 60.000 70.250 61.000 10.286 70.058 80.391 70.209 60.313 40.167 10.278 110.200 80.083 50.000 50.200 80.264 70.000 40.250 70.714 10.500 10.196 70.333 60.500 90.750 10.668 10.500 10.000 20.500 90.333 81.000 10.000 10.000 80.438 10.500 10.000 31.000 10.333 70.226 20.250 50.250 50.000 30.000 30.668 50.000 10.174 100.000 10.000 80.750 10.000 10.667 80.000 10.000 10.638 80.333 60.579 20.000 60.333 30.000 11.000 10.000 10.063 80.385 70.600 10.647 20.066 80.264 60.469 50.246 30.000 70.000 10.264 40.000 10.000 20.000 61.000 10.125 10.000 50.000 20.200 40.000 50.000 41.000 10.000 2
TD3D Scannet200permissive0.320 80.501 80.264 80.164 80.841 40.679 40.716 80.879 30.280 90.192 70.634 60.231 30.733 90.459 80.565 90.498 100.560 71.000 10.686 40.890 70.708 30.123 100.820 30.152 80.967 10.456 60.458 80.387 80.194 60.435 110.906 10.077 50.396 80.509 60.217 20.715 60.619 71.000 10.099 60.792 20.513 80.062 70.506 80.549 30.605 71.000 10.123 100.106 61.000 10.744 100.000 81.000 10.504 110.525 80.185 80.790 80.101 80.008 70.587 30.356 40.817 40.083 111.000 10.000 60.621 10.842 30.415 60.268 100.083 80.000 60.098 90.881 10.125 80.000 60.000 30.000 70.000 80.125 100.332 90.448 110.202 70.196 40.798 70.264 80.000 40.000 50.017 30.233 60.000 20.063 40.333 60.038 10.111 50.250 60.000 80.516 50.208 30.470 60.094 90.218 60.000 30.667 60.033 110.000 80.000 50.400 30.156 80.000 40.267 60.226 70.000 60.104 80.159 80.299 110.095 90.458 40.500 10.000 21.000 10.472 40.792 90.000 10.022 60.061 30.250 60.008 20.250 60.333 70.143 30.396 40.049 70.012 10.000 30.283 100.000 10.241 90.000 10.101 70.331 100.000 10.629 90.000 10.000 10.857 20.222 80.677 10.000 60.003 80.000 10.000 80.000 10.076 60.252 90.400 40.431 80.061 90.328 40.331 80.500 10.000 70.000 10.167 70.000 10.000 20.000 60.500 80.000 30.000 51.000 10.542 10.000 50.063 20.000 80.000 2
Maksim Kolodiazhnyi, Anna Vorontsova, Anton Konushin, Danila Rukhovich: Top-Down Beats Bottom-Up in 3D Instance Segmentation. WACV 2024
Mask3D Scannet2000.388 60.542 60.357 70.237 70.808 50.676 50.741 70.832 70.496 50.151 90.628 70.021 50.955 40.578 60.753 40.612 60.591 60.822 110.609 70.926 40.614 80.291 60.725 80.163 70.890 60.380 110.615 30.517 70.130 90.806 10.857 30.024 80.511 70.412 110.226 10.597 70.756 61.000 10.111 40.792 20.736 70.091 50.610 60.527 40.323 101.000 10.504 50.063 81.000 10.853 60.010 60.974 40.839 30.667 60.301 70.883 10.266 40.039 30.640 20.311 50.739 60.463 61.000 10.000 60.287 60.715 70.313 80.600 21.000 10.027 40.076 100.502 110.500 40.409 40.000 30.194 50.125 70.500 30.491 70.748 40.050 100.042 70.776 80.352 70.008 30.000 50.033 10.254 50.000 20.005 80.552 40.008 30.020 60.750 10.500 50.409 60.065 70.511 50.107 70.178 80.000 31.000 10.400 20.016 70.000 50.400 30.571 30.000 40.060 80.044 80.000 60.514 40.278 71.000 10.258 70.017 90.125 110.000 20.792 70.399 71.000 10.000 10.013 70.265 20.018 80.000 31.000 10.335 60.381 10.500 10.250 50.004 20.000 30.727 40.000 10.497 60.000 10.188 60.677 60.000 10.708 60.000 10.000 10.945 10.391 50.123 90.000 60.028 60.000 11.000 10.000 10.099 40.451 50.400 40.668 10.573 20.606 10.077 110.003 100.004 60.000 10.042 90.000 10.000 21.000 11.000 10.000 30.042 30.000 20.200 40.302 10.000 41.000 10.000 2
Jonas Schult, Francis Engelmann, Alexander Hermans, Or Litany, Siyu Tang, Bastian Leibe: Mask3D for 3D Semantic Instance Segmentation. ICRA 2023
Minkowski 34D Inst.permissive0.203 110.369 100.134 110.078 110.706 90.382 100.693 90.845 60.221 110.150 100.158 100.000 90.746 80.369 100.545 100.595 70.387 100.997 50.413 110.720 110.636 70.165 90.732 70.070 100.851 90.402 90.251 100.313 100.123 100.583 90.696 90.000 90.051 110.500 70.000 50.500 100.372 110.667 90.009 100.000 80.307 110.003 100.479 100.107 110.226 110.903 90.109 110.031 90.981 80.726 110.000 80.522 110.669 80.282 110.052 110.778 100.000 100.000 80.400 70.074 90.333 100.218 101.000 10.000 60.250 80.406 110.118 110.317 80.100 70.000 60.191 70.596 80.000 90.000 60.000 30.000 70.000 80.500 30.178 110.701 60.000 110.000 80.522 110.018 110.000 40.000 50.000 50.060 100.000 20.000 90.033 110.000 60.000 70.000 100.000 80.281 80.100 60.000 110.090 100.133 100.000 30.422 100.050 100.000 80.000 50.200 80.000 110.000 40.000 90.000 90.000 60.000 100.123 100.677 70.021 100.000 100.500 10.000 20.500 90.442 60.125 110.000 10.000 80.000 40.000 90.000 30.000 80.056 100.000 50.000 90.000 90.000 30.000 30.200 110.000 10.143 110.000 10.000 80.250 110.000 10.511 100.000 10.000 10.286 90.083 90.396 60.000 60.000 90.000 10.000 80.000 10.025 100.300 80.000 90.371 90.070 70.000 100.385 70.000 110.000 70.000 10.000 110.000 10.000 20.000 60.500 80.000 30.000 50.000 20.200 40.000 50.000 40.000 80.000 2
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019
CSC-Pretrain Inst.permissive0.209 100.361 110.157 100.085 100.700 100.248 110.634 110.776 100.322 70.135 110.103 110.000 90.524 110.364 110.618 70.592 80.381 110.997 50.589 90.747 100.340 110.109 110.768 60.059 110.702 100.448 70.188 110.149 110.091 110.636 80.573 110.000 90.246 90.500 70.000 50.450 110.405 90.667 90.006 110.000 80.356 100.007 90.506 70.420 80.340 90.667 110.294 80.004 100.571 100.748 80.000 81.000 10.573 100.502 100.094 100.807 60.000 100.000 80.400 70.000 110.278 110.228 91.000 10.000 60.115 110.432 100.198 90.050 110.125 50.000 60.000 110.573 90.000 90.000 60.000 30.000 70.000 80.125 100.312 100.610 90.221 50.000 80.667 100.050 100.000 40.000 50.000 50.032 110.000 20.000 90.083 80.000 60.000 70.000 100.000 80.220 90.000 110.125 90.000 110.111 110.000 30.667 60.200 80.000 80.000 50.000 100.110 90.000 40.000 90.000 90.000 60.000 100.053 110.500 90.000 110.000 100.500 10.000 20.500 90.333 80.500 100.000 10.000 80.000 40.000 90.000 30.000 80.000 110.000 50.000 90.000 90.000 30.000 30.600 70.000 10.364 70.000 10.000 80.750 10.000 10.833 50.000 10.000 10.143 110.000 110.396 60.000 60.000 90.000 10.000 80.000 10.021 110.221 100.000 90.093 110.055 100.451 20.677 30.125 70.000 70.000 10.028 100.000 10.000 20.000 60.500 80.000 30.000 50.000 20.050 100.000 50.000 40.000 80.000 2
Ji Hou, Benjamin Graham, Matthias Nießner, Saining Xie: Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts. CVPR 2021
LGround Inst.permissive0.246 90.413 90.170 90.130 90.754 80.541 90.682 100.903 10.264 100.164 80.234 90.000 90.681 100.452 90.464 110.541 90.399 91.000 10.637 60.772 90.588 90.190 80.589 110.081 90.857 80.426 80.373 90.318 90.135 80.690 70.653 100.000 90.159 100.500 70.000 50.581 80.387 101.000 10.046 90.000 80.402 90.003 110.455 110.196 100.571 81.000 10.270 90.003 110.530 110.748 90.000 80.744 50.575 90.511 90.112 90.815 50.067 90.000 80.400 70.167 80.667 70.241 81.000 10.000 60.208 90.660 80.125 100.317 80.000 90.000 60.100 80.561 100.000 90.000 60.000 30.000 71.000 10.500 30.344 80.568 100.167 80.000 80.706 90.068 90.000 40.000 50.000 50.063 90.000 20.000 90.056 100.000 60.000 70.500 20.000 80.143 110.017 100.125 90.097 80.164 90.000 30.582 80.400 20.000 80.000 50.000 100.083 100.000 40.000 90.000 90.000 60.025 90.156 90.533 80.250 80.200 70.500 10.000 21.000 10.333 81.000 10.000 10.000 80.000 40.000 90.000 30.000 80.333 70.000 50.000 90.000 90.000 30.000 30.400 90.000 10.364 70.000 10.000 80.500 80.000 10.511 100.000 10.000 10.286 90.333 60.000 100.000 60.000 90.000 10.000 80.000 10.034 90.111 110.000 90.333 100.031 110.000 100.750 10.125 70.000 70.000 10.151 80.000 10.000 20.000 60.500 80.000 30.000 50.000 20.000 110.000 50.000 40.000 80.000 2
David Rozenberszki, Or Litany, Angela Dai: Language-Grounded Indoor 3D Semantic Segmentation in the Wild.


ScanNet Benchmark

This table lists the benchmark results for the 3D semantic label scenario.


Method Infoavg ioubathtubbedbookshelfcabinetchaircountercurtaindeskdoorfloorotherfurniturepicturerefrigeratorshower curtainsinksofatabletoiletwallwindow
sorted bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort by
Volt ScanNetpermissive0.805 10.932 50.846 30.801 490.775 100.862 110.604 10.955 10.779 10.722 40.980 10.635 10.352 120.799 30.941 40.887 10.807 200.748 20.973 30.911 10.798 6
Kadir Yilmaz, Adrian Kruse, Tristan Höfer, Daan de Geus, Bastian Leibe: Volume Transformer: Revisiting Vanilla Transformers for 3D Scene Understanding.
PTv3-PPT-ALCcopyleft0.798 20.911 120.812 240.854 80.770 130.856 160.555 180.943 20.660 270.735 20.979 20.606 80.492 10.792 50.934 50.841 30.819 60.716 100.947 110.906 20.822 1
Guangda Ji, Silvan Weder, Francis Engelmann, Marc Pollefeys, Hermann Blum: ARKit LabelMaker: A New Scale for Indoor 3D Scene Understanding. CVPR 2025
DITR ScanNet0.797 30.727 780.869 10.882 10.785 60.868 70.578 60.943 20.744 20.727 30.979 20.627 30.364 90.824 10.949 20.779 160.844 10.757 10.982 10.905 30.802 3
Karim Abou Zeid, Kadir Yilmaz, Daan de Geus, Alexander Hermans, David Adrian, Timm Linder, Bastian Leibe: DINO in the Room: Leveraging 2D Foundation Models for 3D Segmentation. 3DV 2026
PTv3 ScanNet0.794 40.941 30.813 230.851 110.782 70.890 20.597 20.916 70.696 120.713 60.979 20.635 10.384 30.793 40.907 110.821 60.790 380.696 150.967 50.903 40.805 2
Xiaoyang Wu, Li Jiang, Peng-Shuai Wang, Zhijian Liu, Xihui Liu, Yu Qiao, Wanli Ouyang, Tong He, Hengshuang Zhao: Point Transformer V3: Simpler, Faster, Stronger. CVPR 2024 (Oral)
PonderV20.785 50.978 10.800 320.833 300.788 40.853 210.545 220.910 100.713 40.705 70.979 20.596 100.390 20.769 160.832 460.821 60.792 370.730 30.975 20.897 70.785 8
Haoyi Zhu, Honghui Yang, Xiaoyang Wu, Di Huang, Sha Zhang, Xianglong He, Tong He, Hengshuang Zhao, Chunhua Shen, Yu Qiao, Wanli Ouyang: PonderV2: Pave the Way for 3D Foundataion Model with A Universal Pre-training Paradigm.
Mix3Dpermissive0.781 60.964 20.855 20.843 200.781 80.858 140.575 90.831 410.685 180.714 50.979 20.594 110.310 320.801 20.892 200.841 30.819 60.723 70.940 160.887 90.725 30
Alexey Nekrasov, Jonas Schult, Or Litany, Bastian Leibe, Francis Engelmann: Mix3D: Out-of-Context Data Augmentation for 3D Scenes. 3DV 2021 (Oral)
Swin3Dpermissive0.779 70.861 250.818 180.836 270.790 30.875 40.576 80.905 110.704 80.739 10.969 130.611 40.349 130.756 260.958 10.702 530.805 210.708 110.916 400.898 60.801 4
TTT-KD0.773 80.646 990.818 180.809 420.774 110.878 30.581 40.943 20.687 160.704 80.978 70.607 70.336 210.775 120.912 90.838 50.823 40.694 160.967 50.899 50.794 7
Lisa Weijler, Muhammad Jehanzeb Mirza, Leon Sick, Can Ekkazan, Pedro Hermosilla: TTT-KD: Test-Time Training for 3D Semantic Segmentation through Knowledge Distillation from Foundation Models.
ResLFE_HDS0.772 90.939 40.824 80.854 80.771 120.840 360.564 140.900 130.686 170.677 150.961 190.537 370.348 140.769 160.903 130.785 140.815 90.676 270.939 170.880 140.772 12
OctFormerpermissive0.766 100.925 80.808 280.849 130.786 50.846 310.566 130.876 200.690 140.674 180.960 200.576 230.226 750.753 280.904 120.777 170.815 90.722 80.923 320.877 180.776 11
Peng-Shuai Wang: OctFormer: Octree-based Transformers for 3D Point Clouds. SIGGRAPH 2023
PPT-SpUNet-Joint0.766 100.932 50.794 380.829 320.751 270.854 190.540 260.903 120.630 400.672 190.963 170.565 270.357 100.788 60.900 150.737 320.802 220.685 210.950 90.887 90.780 9
Xiaoyang Wu, Zhuotao Tian, Xin Wen, Bohao Peng, Xihui Liu, Kaicheng Yu, Hengshuang Zhao: Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Training. CVPR 2024
OccuSeg+Semantic0.764 120.758 630.796 360.839 240.746 310.907 10.562 150.850 320.680 200.672 190.978 70.610 50.335 230.777 100.819 500.847 20.830 30.691 180.972 40.885 110.727 28
CU-Hybrid Net0.764 120.924 90.819 150.840 230.757 220.853 210.580 50.848 330.709 60.643 290.958 250.587 170.295 400.753 280.884 240.758 240.815 90.725 60.927 280.867 290.743 21
O-CNNpermissive0.762 140.924 90.823 90.844 190.770 130.852 230.577 70.847 350.711 50.640 330.958 250.592 120.217 810.762 210.888 210.758 240.813 130.726 50.932 260.868 280.744 20
Peng-Shuai Wang, Yang Liu, Yu-Xiao Guo, Chun-Yu Sun, Xin Tong: O-CNN: Octree-based Convolutional Neural Networks for 3D Shape Analysis. SIGGRAPH 2017
DiffSegNet0.758 150.725 800.789 430.843 200.762 180.856 160.562 150.920 50.657 300.658 230.958 250.589 150.337 200.782 70.879 250.787 120.779 430.678 230.926 300.880 140.799 5
DTC0.757 160.843 310.820 130.847 160.791 20.862 110.511 400.870 240.707 70.652 250.954 420.604 90.279 510.760 220.942 30.734 330.766 520.701 140.884 630.874 240.736 22
OA-CNN-L_ScanNet200.756 170.783 490.826 70.858 60.776 90.837 410.548 210.896 160.649 320.675 170.962 180.586 180.335 230.771 150.802 550.770 200.787 400.691 180.936 210.880 140.761 15
LSK3DNetpermissive0.755 180.899 180.823 90.843 200.764 170.838 390.584 30.845 360.717 30.638 350.956 320.580 220.229 740.640 510.900 150.750 270.813 130.729 40.920 360.872 260.757 16
Tuo Feng, Wenguan Wang, Fan Ma, Yi Yang: LSK3DNet: Towards Effective and Efficient 3D Perception with Large Sparse Kernels. CVPR 2024
ConDaFormer0.755 180.927 70.822 110.836 270.801 10.849 260.516 370.864 290.651 310.680 140.958 250.584 200.282 480.759 240.855 360.728 350.802 220.678 230.880 680.873 250.756 18
Lunhao Duan, Shanshan Zhao, Nan Xue, Mingming Gong, Guisong Xia, Dacheng Tao: ConDaFormer : Disassembled Transformer with Local Structure Enhancement for 3D Point Cloud Understanding. Neurips, 2023
PNE0.755 180.786 470.835 60.834 290.758 200.849 260.570 110.836 400.648 330.668 210.978 70.581 210.367 70.683 410.856 340.804 90.801 260.678 230.961 70.889 80.716 37
P. Hermosilla: Point Neighborhood Embeddings.
PointTransformerV20.752 210.742 700.809 270.872 20.758 200.860 130.552 190.891 180.610 470.687 90.960 200.559 310.304 350.766 190.926 70.767 210.797 300.644 400.942 140.876 210.722 33
Xiaoyang Wu, Yixing Lao, Li Jiang, Xihui Liu, Hengshuang Zhao: Point Transformer V2: Grouped Vector Attention and Partition-based Pooling. NeurIPS 2022
DMF-Net0.752 210.906 160.793 400.802 480.689 480.825 540.556 170.867 250.681 190.602 520.960 200.555 330.365 80.779 90.859 310.747 280.795 340.717 90.917 390.856 370.764 14
C.Yang, Y.Yan, W.Zhao, J.Ye, X.Yang, A.Hussain, B.Dong, K.Huang: Towards Deeper and Better Multi-view Feature Fusion for 3D Semantic Segmentation. ICONIP 2023
PointConvFormer0.749 230.793 450.790 410.807 440.750 290.856 160.524 330.881 190.588 600.642 320.977 110.591 130.274 540.781 80.929 60.804 90.796 310.642 410.947 110.885 110.715 38
Wenxuan Wu, Qi Shan, Li Fuxin: PointConvFormer: Revenge of the Point-based Convolution.
BPNetcopyleft0.749 230.909 140.818 180.811 400.752 250.839 380.485 550.842 370.673 220.644 280.957 300.528 440.305 340.773 130.859 310.788 110.818 80.693 170.916 400.856 370.723 32
Wenbo Hu, Hengshuang Zhao, Li Jiang, Jiaya Jia, Tien-Tsin Wong: Bidirectional Projection Network for Cross Dimension Scene Understanding. CVPR 2021 (Oral)
MSP0.748 250.623 1020.804 300.859 50.745 320.824 560.501 440.912 90.690 140.685 110.956 320.567 260.320 290.768 180.918 80.720 400.802 220.676 270.921 340.881 130.779 10
StratifiedFormerpermissive0.747 260.901 170.803 310.845 180.757 220.846 310.512 390.825 440.696 120.645 270.956 320.576 230.262 650.744 340.861 300.742 300.770 500.705 120.899 520.860 340.734 23
Xin Lai*, Jianhui Liu*, Li Jiang, Liwei Wang, Hengshuang Zhao, Shu Liu, Xiaojuan Qi, Jiaya Jia: Stratified Transformer for 3D Point Cloud Segmentation. CVPR 2022
VMNetpermissive0.746 270.870 230.838 40.858 60.729 370.850 250.501 440.874 210.587 610.658 230.956 320.564 280.299 370.765 200.900 150.716 430.812 150.631 460.939 170.858 350.709 39
Zeyu HU, Xuyang Bai, Jiaxiang Shang, Runze Zhang, Jiayu Dong, Xin Wang, Guangyuan Sun, Hongbo Fu, Chiew-Lan Tai: VMNet: Voxel-Mesh Network for Geodesic-Aware 3D Semantic Segmentation. ICCV 2021 (Oral)
Virtual MVFusion0.746 270.771 570.819 150.848 150.702 440.865 100.397 930.899 140.699 100.664 220.948 640.588 160.330 250.746 330.851 400.764 220.796 310.704 130.935 220.866 300.728 26
Abhijit Kundu, Xiaoqi Yin, Alireza Fathi, David Ross, Brian Brewington, Thomas Funkhouser, Caroline Pantofaru: Virtual Multi-view Fusion for 3D Semantic Segmentation. ECCV 2020
DiffSeg3D20.745 290.725 800.814 220.837 250.751 270.831 480.514 380.896 160.674 210.684 120.960 200.564 280.303 360.773 130.820 490.713 460.798 290.690 200.923 320.875 220.757 16
Retro-FPN0.744 300.842 320.800 320.767 630.740 330.836 430.541 240.914 80.672 230.626 390.958 250.552 340.272 560.777 100.886 230.696 540.801 260.674 300.941 150.858 350.717 35
Peng Xiang*, Xin Wen*, Yu-Shen Liu, Hui Zhang, Yi Fang, Zhizhong Han: Retrospective Feature Pyramid Network for Point Cloud Semantic Segmentation. ICCV 2023
ODINpermissive0.744 300.658 950.752 660.870 30.714 410.843 340.569 120.919 60.703 90.622 420.949 610.591 130.343 160.736 350.784 570.816 80.838 20.672 320.918 380.854 410.725 30
Ayush Jain, Pushkal Katara, Nikolaos Gkanatsios, Adam W. Harley, Gabriel Sarch, Kriti Aggarwal, Vishrav Chaudhary, Katerina Fragkiadaki: ODIN: A Single Model for 2D and 3D Segmentation. CVPR 2024
EQ-Net0.743 320.620 1030.799 350.849 130.730 360.822 580.493 520.897 150.664 240.681 130.955 360.562 300.378 40.760 220.903 130.738 310.801 260.673 310.907 440.877 180.745 19
Zetong Yang*, Li Jiang*, Yanan Sun, Bernt Schiele, Jiaya JIa: A Unified Query-based Paradigm for Point Cloud Understanding. CVPR 2022
SAT0.742 330.860 260.765 570.819 350.769 150.848 280.533 280.829 420.663 250.631 380.955 360.586 180.274 540.753 280.896 180.729 340.760 580.666 340.921 340.855 390.733 24
LRPNet0.742 330.816 400.806 290.807 440.752 250.828 520.575 90.839 390.699 100.637 360.954 420.520 480.320 290.755 270.834 440.760 230.772 470.676 270.915 420.862 320.717 35
LargeKernel3D0.739 350.909 140.820 130.806 460.740 330.852 230.545 220.826 430.594 590.643 290.955 360.541 360.263 640.723 390.858 330.775 190.767 510.678 230.933 240.848 450.694 44
Yukang Chen*, Jianhui Liu*, Xiangyu Zhang, Xiaojuan Qi, Jiaya Jia: LargeKernel3D: Scaling up Kernels in 3D Sparse CNNs. CVPR 2023
RPN0.736 360.776 530.790 410.851 110.754 240.854 190.491 540.866 270.596 580.686 100.955 360.536 380.342 170.624 580.869 270.787 120.802 220.628 470.927 280.875 220.704 41
MinkowskiNetpermissive0.736 360.859 270.818 180.832 310.709 420.840 360.521 350.853 310.660 270.643 290.951 530.544 350.286 460.731 370.893 190.675 630.772 470.683 220.874 750.852 430.727 28
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019
IPCA0.731 380.890 190.837 50.864 40.726 380.873 50.530 320.824 450.489 950.647 260.978 70.609 60.336 210.624 580.733 650.758 240.776 450.570 730.949 100.877 180.728 26
MS-SFA-net0.730 390.910 130.819 150.837 250.698 450.838 390.532 300.872 220.605 510.676 160.959 240.535 400.341 180.649 470.598 890.708 480.810 160.664 360.895 550.879 170.771 13
online3d0.727 400.715 850.777 500.854 80.748 300.858 140.497 490.872 220.572 680.639 340.957 300.523 450.297 390.750 310.803 540.744 290.810 160.587 690.938 190.871 270.719 34
PointTransformer++0.725 410.727 780.811 260.819 350.765 160.841 350.502 430.814 500.621 430.623 410.955 360.556 320.284 470.620 600.866 280.781 150.757 620.648 380.932 260.862 320.709 39
SparseConvNet0.725 410.647 980.821 120.846 170.721 390.869 60.533 280.754 660.603 540.614 440.955 360.572 250.325 270.710 400.870 260.724 380.823 40.628 470.934 230.865 310.683 47
MatchingNet0.724 430.812 420.812 240.810 410.735 350.834 450.495 510.860 300.572 680.602 520.954 420.512 500.280 500.757 250.845 420.725 370.780 420.606 570.937 200.851 440.700 43
INS-Conv-semantic0.717 440.751 660.759 600.812 390.704 430.868 70.537 270.842 370.609 490.608 480.953 460.534 410.293 410.616 610.864 290.719 420.793 350.640 420.933 240.845 490.663 53
PointMetaBase0.714 450.835 330.785 450.821 330.684 500.846 310.531 310.865 280.614 440.596 560.953 460.500 530.246 700.674 420.888 210.692 550.764 540.624 490.849 900.844 500.675 49
contrastBoundarypermissive0.705 460.769 600.775 510.809 420.687 490.820 610.439 810.812 510.661 260.591 580.945 720.515 490.171 1000.633 550.856 340.720 400.796 310.668 330.889 600.847 460.689 45
Liyao Tang, Yibing Zhan, Zhe Chen, Baosheng Yu, Dacheng Tao: Contrastive Boundary Learning for Point Cloud Segmentation. CVPR2022
ClickSeg_Semantic0.703 470.774 550.800 320.793 540.760 190.847 300.471 590.802 540.463 1020.634 370.968 150.491 560.271 580.726 380.910 100.706 490.815 90.551 850.878 690.833 510.570 85
RFCR0.702 480.889 200.745 720.813 380.672 530.818 650.493 520.815 490.623 410.610 460.947 660.470 650.249 690.594 650.848 410.705 500.779 430.646 390.892 580.823 570.611 68
Jingyu Gong, Jiachen Xu, Xin Tan, Haichuan Song, Yanyun Qu, Yuan Xie, Lizhuang Ma: Omni-Supervised Point Cloud Segmentation via Gradual Receptive Field Component Reasoning. CVPR2021
One Thing One Click0.701 490.825 370.796 360.723 700.716 400.832 470.433 830.816 470.634 380.609 470.969 130.418 910.344 150.559 770.833 450.715 440.808 190.560 790.902 490.847 460.680 48
JSENetpermissive0.699 500.881 220.762 580.821 330.667 540.800 780.522 340.792 570.613 450.607 490.935 920.492 550.205 870.576 700.853 380.691 570.758 600.652 370.872 780.828 540.649 57
Zeyu HU, Mingmin Zhen, Xuyang BAI, Hongbo Fu, Chiew-lan Tai: JSENet: Joint Semantic Segmentation and Edge Detection Network for 3D Point Clouds. ECCV 2020
One-Thing-One-Click0.693 510.743 690.794 380.655 930.684 500.822 580.497 490.719 760.622 420.617 430.977 110.447 780.339 190.750 310.664 820.703 520.790 380.596 620.946 130.855 390.647 58
Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu: One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation. CVPR 2021
PicassoNet-IIpermissive0.692 520.732 740.772 520.786 550.677 520.866 90.517 360.848 330.509 880.626 390.952 510.536 380.225 770.545 830.704 720.689 600.810 160.564 780.903 480.854 410.729 25
Huan Lei, Naveed Akhtar, Mubarak Shah, and Ajmal Mian: Geometric feature learning for 3D meshes.
Feature_GeometricNetpermissive0.690 530.884 210.754 640.795 520.647 610.818 650.422 850.802 540.612 460.604 500.945 720.462 680.189 950.563 760.853 380.726 360.765 530.632 450.904 460.821 600.606 72
Kangcheng Liu, Ben M. Chen: https://arxiv.org/abs/2012.09439. arXiv Preprint
FusionNet0.688 540.704 870.741 760.754 670.656 560.829 500.501 440.741 710.609 490.548 660.950 570.522 470.371 50.633 550.756 600.715 440.771 490.623 500.861 860.814 630.658 54
Feihu Zhang, Jin Fang, Benjamin Wah, Philip Torr: Deep FusionNet for Point Cloud Semantic Segmentation. ECCV 2020
Feature-Geometry Netpermissive0.685 550.866 240.748 690.819 350.645 630.794 810.450 710.802 540.587 610.604 500.945 720.464 670.201 900.554 790.840 430.723 390.732 730.602 600.907 440.822 590.603 75
DGNet0.684 560.712 860.784 460.782 590.658 550.835 440.499 480.823 460.641 350.597 550.950 570.487 580.281 490.575 710.619 860.647 760.764 540.620 520.871 810.846 480.688 46
VACNN++0.684 560.728 770.757 630.776 600.690 460.804 760.464 640.816 470.577 670.587 590.945 720.508 520.276 530.671 430.710 700.663 680.750 660.589 670.881 660.832 530.653 56
KP-FCNN0.684 560.847 300.758 620.784 570.647 610.814 680.473 580.772 600.605 510.594 570.935 920.450 760.181 980.587 660.805 530.690 580.785 410.614 530.882 650.819 610.632 64
H. Thomas, C. Qi, J. Deschaud, B. Marcotegui, F. Goulette, L. Guibas.: KPConv: Flexible and Deformable Convolution for Point Clouds. ICCV 2019
PointContrast_LA_SEM0.683 590.757 640.784 460.786 550.639 650.824 560.408 880.775 590.604 530.541 680.934 960.532 420.269 600.552 800.777 580.645 790.793 350.640 420.913 430.824 560.671 50
Superpoint Network0.683 590.851 290.728 800.800 510.653 580.806 740.468 610.804 520.572 680.602 520.946 690.453 750.239 730.519 880.822 470.689 600.762 570.595 640.895 550.827 550.630 65
VI-PointConv0.676 610.770 590.754 640.783 580.621 690.814 680.552 190.758 640.571 710.557 640.954 420.529 430.268 620.530 860.682 760.675 630.719 760.603 590.888 610.833 510.665 52
Xingyi Li, Wenxuan Wu, Xiaoli Z. Fern, Li Fuxin: The Devils in the Point Clouds: Studying the Robustness of Point Cloud Convolutions.
ROSMRF3D0.673 620.789 460.748 690.763 650.635 670.814 680.407 900.747 680.581 650.573 610.950 570.484 590.271 580.607 620.754 610.649 730.774 460.596 620.883 640.823 570.606 72
SALANet0.670 630.816 400.770 550.768 620.652 590.807 730.451 680.747 680.659 290.545 670.924 1020.473 640.149 1100.571 730.811 520.635 830.746 670.623 500.892 580.794 770.570 85
O3DSeg0.668 640.822 380.771 540.496 1140.651 600.833 460.541 240.761 630.555 770.611 450.966 160.489 570.370 60.388 1070.580 900.776 180.751 640.570 730.956 80.817 620.646 59
PointConvpermissive0.666 650.781 500.759 600.699 780.644 640.822 580.475 570.779 580.564 740.504 850.953 460.428 850.203 890.586 680.754 610.661 690.753 630.588 680.902 490.813 650.642 60
Wenxuan Wu, Zhongang Qi, Li Fuxin: PointConv: Deep Convolutional Networks on 3D Point Clouds. CVPR 2019
PointASNLpermissive0.666 650.703 880.781 480.751 690.655 570.830 490.471 590.769 610.474 980.537 700.951 530.475 630.279 510.635 530.698 750.675 630.751 640.553 840.816 970.806 670.703 42
Xu Yan, Chaoda Zheng, Zhen Li, Sheng Wang, Shuguang Cui: PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Sampling. CVPR 2020
PPCNN++permissive0.663 670.746 670.708 830.722 710.638 660.820 610.451 680.566 1040.599 560.541 680.950 570.510 510.313 310.648 490.819 500.616 880.682 910.590 660.869 820.810 660.656 55
Pyunghwan Ahn, Juyoung Yang, Eojindl Yi, Chanho Lee, Junmo Kim: Projection-based Point Convolution for Efficient Point Cloud Segmentation. IEEE Access
MVF-GNN0.658 680.558 1100.751 670.655 930.690 460.722 1030.453 670.867 250.579 660.576 600.893 1150.523 450.293 410.733 360.571 920.692 550.659 980.606 570.875 720.804 690.668 51
DCM-Net0.658 680.778 510.702 860.806 460.619 700.813 710.468 610.693 840.494 910.524 760.941 840.449 770.298 380.510 900.821 480.675 630.727 750.568 760.826 950.803 700.637 62
Jonas Schult*, Francis Engelmann*, Theodora Kontogianni, Bastian Leibe: DualConvMesh-Net: Joint Geodesic and Euclidean Convolutions on 3D Meshes. CVPR 2020 [Oral]
HPGCNN0.656 700.698 900.743 740.650 950.564 870.820 610.505 420.758 640.631 390.479 890.945 720.480 610.226 750.572 720.774 590.690 580.735 710.614 530.853 890.776 920.597 78
Jisheng Dang, Qingyong Hu, Yulan Guo, Jun Yang: HPGCNN.
SAFNet-segpermissive0.654 710.752 650.734 780.664 910.583 820.815 670.399 920.754 660.639 360.535 720.942 820.470 650.309 330.665 440.539 940.650 720.708 810.635 440.857 880.793 790.642 60
Linqing Zhao, Jiwen Lu, Jie Zhou: Similarity-Aware Fusion Network for 3D Semantic Segmentation. IROS 2021
RandLA-Netpermissive0.645 720.778 510.731 790.699 780.577 830.829 500.446 730.736 720.477 970.523 780.945 720.454 720.269 600.484 970.749 640.618 860.738 690.599 610.827 940.792 820.621 67
MVPNetpermissive0.641 730.831 340.715 810.671 880.590 780.781 870.394 940.679 860.642 340.553 650.937 890.462 680.256 660.649 470.406 1070.626 840.691 880.666 340.877 700.792 820.608 71
Maximilian Jaritz, Jiayuan Gu, Hao Su: Multi-view PointNet for 3D Scene Understanding. GMDL Workshop, ICCV 2019
PointConv-SFPN0.641 730.776 530.703 850.721 720.557 900.826 530.451 680.672 890.563 750.483 880.943 810.425 880.162 1050.644 500.726 660.659 700.709 800.572 720.875 720.786 870.559 91
PointMRNet0.640 750.717 840.701 870.692 810.576 840.801 770.467 630.716 770.563 750.459 950.953 460.429 840.169 1020.581 690.854 370.605 890.710 780.550 860.894 570.793 790.575 83
FPConvpermissive0.639 760.785 480.760 590.713 760.603 730.798 790.392 960.534 1090.603 540.524 760.948 640.457 700.250 680.538 840.723 680.598 930.696 860.614 530.872 780.799 720.567 88
Yiqun Lin, Zizheng Yan, Haibin Huang, Dong Du, Ligang Liu, Shuguang Cui, Xiaoguang Han: FPConv: Learning Local Flattening for Point Convolution. CVPR 2020
PD-Net0.638 770.797 440.769 560.641 1000.590 780.820 610.461 650.537 1080.637 370.536 710.947 660.388 980.206 860.656 450.668 800.647 760.732 730.585 700.868 830.793 790.473 111
PointSPNet0.637 780.734 730.692 940.714 750.576 840.797 800.446 730.743 700.598 570.437 1000.942 820.403 940.150 1090.626 570.800 560.649 730.697 850.557 820.846 910.777 910.563 89
SConv0.636 790.830 350.697 900.752 680.572 860.780 890.445 750.716 770.529 810.530 730.951 530.446 790.170 1010.507 920.666 810.636 820.682 910.541 920.886 620.799 720.594 79
Supervoxel-CNN0.635 800.656 960.711 820.719 730.613 710.757 980.444 780.765 620.534 800.566 620.928 1000.478 620.272 560.636 520.531 960.664 670.645 1020.508 1000.864 850.792 820.611 68
joint point-basedpermissive0.634 810.614 1040.778 490.667 900.633 680.825 540.420 860.804 520.467 1000.561 630.951 530.494 540.291 430.566 740.458 1020.579 990.764 540.559 810.838 920.814 630.598 77
Hung-Yueh Chiang, Yen-Liang Lin, Yueh-Cheng Liu, Winston H. Hsu: A Unified Point-Based Framework for 3D Segmentation. 3DV 2019
PointMTL0.632 820.731 750.688 970.675 850.591 770.784 860.444 780.565 1050.610 470.492 860.949 610.456 710.254 670.587 660.706 710.599 920.665 970.612 560.868 830.791 850.579 82
APCF-Net0.631 830.742 700.687 990.672 860.557 900.792 840.408 880.665 910.545 780.508 820.952 510.428 850.186 960.634 540.702 730.620 850.706 820.555 830.873 760.798 740.581 81
Haojia, Lin: Adaptive Pyramid Context Fusion for Point Cloud Perception. GRSL
PointNet2-SFPN0.631 830.771 570.692 940.672 860.524 960.837 410.440 800.706 820.538 790.446 970.944 780.421 900.219 800.552 800.751 630.591 950.737 700.543 910.901 510.768 940.557 92
3DSM_DMMF0.631 830.626 1010.745 720.801 490.607 720.751 990.506 410.729 750.565 730.491 870.866 1180.434 800.197 930.595 640.630 850.709 470.705 830.560 790.875 720.740 1020.491 106
FusionAwareConv0.630 860.604 1060.741 760.766 640.590 780.747 1000.501 440.734 730.503 900.527 740.919 1060.454 720.323 280.550 820.420 1060.678 620.688 890.544 890.896 540.795 760.627 66
Jiazhao Zhang, Chenyang Zhu, Lintao Zheng, Kai Xu: Fusion-Aware Point Convolution for Online Semantic 3D Scene Segmentation. CVPR 2020
DenSeR0.628 870.800 430.625 1100.719 730.545 930.806 740.445 750.597 990.448 1050.519 800.938 880.481 600.328 260.489 960.499 1010.657 710.759 590.592 650.881 660.797 750.634 63
SegGroup_sempermissive0.627 880.818 390.747 710.701 770.602 740.764 950.385 1000.629 960.490 930.508 820.931 990.409 930.201 900.564 750.725 670.618 860.692 870.539 930.873 760.794 770.548 95
An Tao, Yueqi Duan, Yi Wei, Jiwen Lu, Jie Zhou: SegGroup: Seg-Level Supervision for 3D Instance and Semantic Segmentation. TIP 2022
SIConv0.625 890.830 350.694 920.757 660.563 880.772 930.448 720.647 940.520 840.509 810.949 610.431 830.191 940.496 940.614 870.647 760.672 950.535 960.876 710.783 880.571 84
Weakly-Openseg v30.625 890.924 90.787 440.620 1020.555 920.811 720.393 950.666 900.382 1130.520 790.953 460.250 1170.208 840.604 630.670 780.644 800.742 680.538 940.919 370.803 700.513 103
dtc_net0.625 890.703 880.751 670.794 530.535 940.848 280.480 560.676 880.528 820.469 920.944 780.454 720.004 1220.464 990.636 840.704 510.758 600.548 880.924 310.787 860.492 105
HPEIN0.618 920.729 760.668 1010.647 970.597 760.766 940.414 870.680 850.520 840.525 750.946 690.432 810.215 820.493 950.599 880.638 810.617 1070.570 730.897 530.806 670.605 74
Li Jiang, Hengshuang Zhao, Shu Liu, Xiaoyong Shen, Chi-Wing Fu, Jiaya Jia: Hierarchical Point-Edge Interaction Network for Point Cloud Semantic Segmentation. ICCV 2019
SPH3D-GCNpermissive0.610 930.858 280.772 520.489 1150.532 950.792 840.404 910.643 950.570 720.507 840.935 920.414 920.046 1190.510 900.702 730.602 910.705 830.549 870.859 870.773 930.534 98
Huan Lei, Naveed Akhtar, and Ajmal Mian: Spherical Kernel for Efficient Graph Convolution on 3D Point Clouds. TPAMI 2020
AttAN0.609 940.760 620.667 1020.649 960.521 970.793 820.457 660.648 930.528 820.434 1020.947 660.401 950.153 1080.454 1000.721 690.648 750.717 770.536 950.904 460.765 950.485 107
Gege Zhang, Qinghua Ma, Licheng Jiao, Fang Liu and Qigong Sun: AttAN: Attention Adversarial Networks for 3D Point Cloud Semantic Segmentation. IJCAI2020
wsss-transformer0.600 950.634 1000.743 740.697 800.601 750.781 870.437 820.585 1020.493 920.446 970.933 970.394 960.011 1210.654 460.661 830.603 900.733 720.526 970.832 930.761 970.480 108
LAP-D0.594 960.720 820.692 940.637 1010.456 1060.773 920.391 980.730 740.587 610.445 990.940 860.381 990.288 440.434 1030.453 1040.591 950.649 1000.581 710.777 1010.749 1010.610 70
DPC0.592 970.720 820.700 880.602 1060.480 1020.762 970.380 1010.713 800.585 640.437 1000.940 860.369 1010.288 440.434 1030.509 1000.590 970.639 1050.567 770.772 1020.755 990.592 80
Francis Engelmann, Theodora Kontogianni, Bastian Leibe: Dilated Point Convolutions: On the Receptive Field Size of Point Convolutions on 3D Point Clouds. ICRA 2020
CCRFNet0.589 980.766 610.659 1050.683 830.470 1050.740 1020.387 990.620 980.490 930.476 900.922 1040.355 1040.245 710.511 890.511 990.571 1000.643 1030.493 1040.872 780.762 960.600 76
ROSMRF0.580 990.772 560.707 840.681 840.563 880.764 950.362 1030.515 1100.465 1010.465 940.936 910.427 870.207 850.438 1010.577 910.536 1030.675 940.486 1050.723 1080.779 890.524 100
SD-DETR0.576 1000.746 670.609 1140.445 1200.517 980.643 1140.366 1020.714 790.456 1030.468 930.870 1170.432 810.264 630.558 780.674 770.586 980.688 890.482 1060.739 1060.733 1040.537 97
SQN_0.1%0.569 1010.676 920.696 910.657 920.497 990.779 900.424 840.548 1060.515 860.376 1070.902 1140.422 890.357 100.379 1080.456 1030.596 940.659 980.544 890.685 1110.665 1150.556 93
TextureNetpermissive0.566 1020.672 940.664 1030.671 880.494 1000.719 1040.445 750.678 870.411 1110.396 1050.935 920.356 1030.225 770.412 1050.535 950.565 1010.636 1060.464 1080.794 1000.680 1120.568 87
Jingwei Huang, Haotian Zhang, Li Yi, Thomas Funkerhouser, Matthias Niessner, Leonidas Guibas: TextureNet: Consistent Local Parametrizations for Learning from High-Resolution Signals on Meshes. CVPR
DVVNet0.562 1030.648 970.700 880.770 610.586 810.687 1080.333 1070.650 920.514 870.475 910.906 1100.359 1020.223 790.340 1100.442 1050.422 1140.668 960.501 1010.708 1090.779 890.534 98
Pointnet++ & Featurepermissive0.557 1040.735 720.661 1040.686 820.491 1010.744 1010.392 960.539 1070.451 1040.375 1080.946 690.376 1000.205 870.403 1060.356 1100.553 1020.643 1030.497 1020.824 960.756 980.515 101
GMLPs0.538 1050.495 1150.693 930.647 970.471 1040.793 820.300 1110.477 1110.505 890.358 1090.903 1130.327 1070.081 1160.472 980.529 970.448 1120.710 780.509 980.746 1040.737 1030.554 94
PanopticFusion-label0.529 1060.491 1160.688 970.604 1050.386 1110.632 1150.225 1220.705 830.434 1080.293 1160.815 1200.348 1050.241 720.499 930.669 790.507 1050.649 1000.442 1140.796 990.602 1200.561 90
Gaku Narita, Takashi Seno, Tomoya Ishikawa, Yohsuke Kaji: PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Things. IROS 2019 (to appear)
subcloud_weak0.516 1070.676 920.591 1170.609 1030.442 1070.774 910.335 1060.597 990.422 1100.357 1100.932 980.341 1060.094 1150.298 1120.528 980.473 1100.676 930.495 1030.602 1170.721 1070.349 120
Online SegFusion0.515 1080.607 1050.644 1080.579 1080.434 1080.630 1160.353 1040.628 970.440 1060.410 1030.762 1230.307 1090.167 1030.520 870.403 1080.516 1040.565 1100.447 1120.678 1120.701 1090.514 102
Davide Menini, Suryansh Kumar, Martin R. Oswald, Erik Sandstroem, Cristian Sminchisescu, Luc van Gool: A Real-Time Learning Framework for Joint 3D Reconstruction and Semantic Segmentation. Robotics and Automation Letters Submission
3DMV, FTSDF0.501 1090.558 1100.608 1150.424 1220.478 1030.690 1070.246 1180.586 1010.468 990.450 960.911 1080.394 960.160 1060.438 1010.212 1170.432 1130.541 1150.475 1070.742 1050.727 1050.477 109
PCNN0.498 1100.559 1090.644 1080.560 1100.420 1100.711 1060.229 1200.414 1120.436 1070.352 1120.941 840.324 1080.155 1070.238 1170.387 1090.493 1060.529 1160.509 980.813 980.751 1000.504 104
3DMV0.484 1110.484 1170.538 1200.643 990.424 1090.606 1190.310 1080.574 1030.433 1090.378 1060.796 1210.301 1100.214 830.537 850.208 1180.472 1110.507 1200.413 1170.693 1100.602 1200.539 96
Angela Dai, Matthias Niessner: 3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation. ECCV'18
PointCNN with RGBpermissive0.458 1120.577 1080.611 1130.356 1240.321 1190.715 1050.299 1130.376 1160.328 1190.319 1140.944 780.285 1120.164 1040.216 1200.229 1150.484 1080.545 1140.456 1100.755 1030.709 1080.475 110
Yangyan Li, Rui Bu, Mingchao Sun, Baoquan Chen: PointCNN. NeurIPS 2018
FCPNpermissive0.447 1130.679 910.604 1160.578 1090.380 1120.682 1090.291 1140.106 1240.483 960.258 1220.920 1050.258 1160.025 1200.231 1190.325 1110.480 1090.560 1120.463 1090.725 1070.666 1140.231 124
Dario Rethage, Johanna Wald, Jürgen Sturm, Nassir Navab, Federico Tombari: Fully-Convolutional Point Networks for Large-Scale Point Clouds. ECCV 2018
DGCNN_reproducecopyleft0.446 1140.474 1180.623 1110.463 1180.366 1140.651 1120.310 1080.389 1150.349 1170.330 1130.937 890.271 1140.126 1120.285 1130.224 1160.350 1190.577 1090.445 1130.625 1150.723 1060.394 116
Yue Wang, Yongbin Sun, Ziwei Liu, Sanjay E. Sarma, Michael M. Bronstein, Justin M. Solomon: Dynamic Graph CNN for Learning on Point Clouds. TOG 2019
SurfaceConvPF0.442 1150.505 1140.622 1120.380 1230.342 1170.654 1110.227 1210.397 1140.367 1150.276 1180.924 1020.240 1180.198 920.359 1090.262 1130.366 1160.581 1080.435 1150.640 1140.668 1130.398 115
Hao Pan, Shilin Liu, Yang Liu, Xin Tong: Convolutional Neural Networks on 3D Surfaces Using Parallel Frames.
PNET20.442 1150.548 1120.548 1190.597 1070.363 1150.628 1170.300 1110.292 1190.374 1140.307 1150.881 1160.268 1150.186 960.238 1170.204 1190.407 1150.506 1210.449 1110.667 1130.620 1190.462 114
Tangent Convolutionspermissive0.438 1170.437 1200.646 1070.474 1160.369 1130.645 1130.353 1040.258 1210.282 1230.279 1170.918 1070.298 1110.147 1110.283 1140.294 1120.487 1070.562 1110.427 1160.619 1160.633 1180.352 119
Maxim Tatarchenko, Jaesik Park, Vladlen Koltun, Qian-Yi Zhou: Tangent convolutions for dense prediction in 3d. CVPR 2018
3DWSSS0.425 1180.525 1130.647 1060.522 1110.324 1180.488 1230.077 1250.712 810.353 1160.401 1040.636 1250.281 1130.176 990.340 1100.565 930.175 1230.551 1130.398 1180.370 1250.602 1200.361 118
SPLAT Netcopyleft0.393 1190.472 1190.511 1210.606 1040.311 1210.656 1100.245 1190.405 1130.328 1190.197 1230.927 1010.227 1200.000 1240.001 1260.249 1140.271 1220.510 1170.383 1200.593 1180.699 1100.267 122
Hang Su, Varun Jampani, Deqing Sun, Subhransu Maji, Evangelos Kalogerakis, Ming-Hsuan Yang, Jan Kautz: SPLATNet: Sparse Lattice Networks for Point Cloud Processing. CVPR 2018
ScanNet+FTSDF0.383 1200.297 1220.491 1220.432 1210.358 1160.612 1180.274 1160.116 1230.411 1110.265 1190.904 1120.229 1190.079 1170.250 1150.185 1200.320 1200.510 1170.385 1190.548 1190.597 1230.394 116
MSSP20.347 1210.278 1230.687 990.466 1170.316 1200.316 1250.308 1100.374 1170.317 1210.357 1100.905 1110.141 1240.000 1240.003 1250.000 1250.000 1250.508 1190.365 1220.481 1220.649 1170.466 113
PointNet++permissive0.339 1220.584 1070.478 1230.458 1190.256 1230.360 1240.250 1170.247 1220.278 1240.261 1210.677 1240.183 1210.117 1130.212 1210.145 1220.364 1170.346 1250.232 1250.548 1190.523 1240.252 123
Charles R. Qi, Li Yi, Hao Su, Leonidas J. Guibas: pointnet++: deep hierarchical feature learning on point sets in a metric space.
GrowSP++0.323 1230.114 1250.589 1180.499 1130.147 1250.555 1200.290 1150.336 1180.290 1220.262 1200.865 1190.102 1250.000 1240.037 1230.000 1250.000 1250.462 1220.381 1210.389 1240.664 1160.473 111
SSC-UNetpermissive0.308 1240.353 1210.290 1250.278 1250.166 1240.553 1210.169 1240.286 1200.147 1250.148 1250.908 1090.182 1220.064 1180.023 1240.018 1240.354 1180.363 1230.345 1230.546 1210.685 1110.278 121
ScanNetpermissive0.306 1250.203 1240.366 1240.501 1120.311 1210.524 1220.211 1230.002 1260.342 1180.189 1240.786 1220.145 1230.102 1140.245 1160.152 1210.318 1210.348 1240.300 1240.460 1230.437 1250.182 125
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner: ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes. CVPR'17
ERROR0.054 1260.000 1260.041 1260.172 1260.030 1260.062 1260.001 1260.035 1250.004 1260.051 1260.143 1260.019 1260.003 1230.041 1220.050 1230.003 1240.054 1260.018 1260.005 1260.264 1260.082 126


This table lists the benchmark results for the 3D semantic instance scenario.




Method Infoavg ap 50%bathtubbedbookshelfcabinetchaircountercurtaindeskdoorotherfurniturepicturerefrigeratorshower curtainsinksofatabletoiletwindow
sorted bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort by
AQ3D0.834 11.000 10.932 150.876 120.752 30.948 10.632 20.680 320.761 120.784 20.753 30.826 10.812 21.000 10.859 20.879 80.831 21.000 10.688 3
Volt-SPFormerScanNetpermissive0.827 21.000 10.981 60.975 10.801 10.940 50.426 250.693 300.752 140.762 80.800 10.804 30.855 10.959 490.745 240.879 70.806 80.997 440.710 1
Kadir Yilmaz, Adrian Kruse, Tristan Höfer, Daan de Geus, Bastian Leibe: Volume Transformer: Revisiting Vanilla Transformers for 3D Scene Understanding.
Competitor-MAFT0.816 31.000 10.983 40.872 130.718 70.941 40.588 60.652 430.819 30.776 40.720 80.780 80.769 131.000 10.797 120.813 330.798 101.000 10.659 6
PointRel0.816 31.000 10.971 100.908 70.743 40.923 120.573 100.714 220.695 220.734 120.747 40.725 150.809 31.000 10.814 100.899 50.820 41.000 10.610 21
: Relation3D: Enhancing Relation Modeling for Point Cloud Instance Segmentation. CVPR 2025
Spherical Mask(CtoF)0.812 51.000 10.973 90.852 170.718 80.917 140.574 80.677 330.748 150.729 160.715 110.795 50.809 31.000 10.831 50.854 140.787 141.000 10.638 10
EV3D0.811 61.000 10.968 120.852 170.717 90.921 130.574 90.677 330.748 150.730 150.703 170.795 50.809 31.000 10.831 50.854 140.778 181.000 10.638 11
PointComp0.811 60.850 620.969 110.864 150.739 50.946 30.539 170.671 360.835 20.700 200.742 50.817 20.766 141.000 10.755 220.909 10.808 71.000 10.687 4
VDG-Uni3DSeg0.804 81.000 10.990 10.886 100.688 220.912 160.602 30.703 260.786 80.771 50.708 150.700 200.669 280.981 420.789 180.903 20.772 221.000 10.609 22
SIM3D0.803 91.000 10.967 130.863 160.692 210.924 110.552 140.732 200.667 270.732 140.662 210.796 40.789 111.000 10.803 110.864 110.766 251.000 10.643 8
OneFormer3Dcopyleft0.801 101.000 10.973 80.909 60.698 170.928 90.582 70.668 390.685 230.780 30.687 190.698 240.702 171.000 10.794 140.900 40.784 160.986 570.635 12
Maxim Kolodiazhnyi, Anna Vorontsova, Anton Konushin, Danila Rukhovich: OneFormer3D: One Transformer for Unified Point Cloud Segmentation.
Competitor-SPFormer0.800 111.000 10.986 30.845 190.705 150.915 150.532 180.733 190.757 130.733 130.708 140.698 230.648 400.981 420.890 10.830 240.796 110.997 440.644 7
InsSSM0.799 121.000 10.915 170.710 460.729 60.925 100.664 10.670 370.770 90.766 60.739 60.737 110.700 181.000 10.792 150.829 260.815 50.997 440.625 14
Lei Yao, Yi Wang, Moyun Liu, Lap-Pui Chau: SGIFormer: Semantic-guided and Geometric-enhanced Interleaving Transformer for 3D Instance Segmentation. TCSVT, 2024
DCD0.798 131.000 10.878 250.792 310.693 200.936 60.596 40.685 310.663 290.736 100.717 90.788 70.693 231.000 10.825 80.840 200.837 11.000 10.689 2
TST3D0.795 141.000 10.929 160.918 50.709 120.884 250.596 50.704 250.769 100.734 110.644 260.699 220.751 151.000 10.794 130.876 100.757 280.997 440.550 38
Duc Tran Dang Trung, Byeongkeun Kang, Yeejin Lee: MSTA3D: Multi-scale Twin-attention for 3D Instance Segmentation. ACM Multimedia 2024
MG-Former0.791 151.000 10.980 70.837 220.626 310.897 180.543 160.759 140.800 70.766 70.659 220.769 100.697 211.000 10.791 160.707 540.791 131.000 10.610 20
ExtMask3D0.789 161.000 10.988 20.756 390.706 140.912 170.429 240.647 450.806 60.755 90.673 200.689 250.772 121.000 10.789 170.852 160.811 61.000 10.617 17
UniPerception0.787 171.000 10.909 180.768 360.687 230.947 20.551 150.714 210.843 10.696 210.713 130.773 90.607 460.981 420.690 310.878 90.775 211.000 10.640 9
Queryformer0.787 171.000 10.933 140.601 560.754 20.886 230.558 130.661 410.767 110.665 240.716 100.639 310.808 71.000 10.844 40.897 60.804 91.000 10.624 15
MAFT0.786 191.000 10.894 230.807 260.694 190.893 210.486 200.674 350.740 170.786 10.704 160.727 140.739 161.000 10.707 290.849 180.756 291.000 10.685 5
KmaxOneFormerNetpermissive0.783 200.903 600.981 50.794 300.706 130.931 80.561 120.701 270.706 200.727 170.697 180.731 130.689 251.000 10.856 30.750 450.761 271.000 10.599 26
Mask3D0.780 211.000 10.786 490.716 440.696 180.885 240.500 190.714 220.810 50.672 230.715 110.679 260.809 31.000 10.831 50.833 230.787 141.000 10.602 24
Jonas Schult, Francis Engelmann, Alexander Hermans, Or Litany, Siyu Tang, Bastian Leibe: Mask3D for 3D Semantic Instance Segmentation. ICRA 2023
SPFormerpermissive0.770 220.903 600.903 200.806 270.609 380.886 220.568 110.815 60.705 210.711 180.655 230.652 300.685 261.000 10.789 190.809 340.776 201.000 10.583 30
Sun Jiahao, Qing Chunmei, Tan Junpeng, Xu Xiangmin: Superpoint Transformer for 3D Scene Instance Segmentation. AAAI 2023 [Oral]
SoftGroup++0.769 231.000 10.803 420.937 20.684 240.865 270.213 410.870 20.664 280.571 310.758 20.702 190.807 81.000 10.653 370.902 30.792 121.000 10.626 13
SoftGrouppermissive0.761 241.000 10.808 380.845 190.716 100.862 290.243 380.824 40.655 310.620 250.734 70.699 210.791 100.981 420.716 260.844 190.769 231.000 10.594 28
Thang Vu, Kookhoi Kim, Tung M. Luu, Xuan Thanh Nguyen, Chang D. Yoo: SoftGroup for 3D Instance Segmentaiton on Point Clouds. CVPR 2022 [Oral]
ISBNetpermissive0.757 251.000 10.904 190.731 420.678 250.895 190.458 220.644 470.670 260.710 190.620 310.732 120.650 301.000 10.756 210.778 370.779 171.000 10.614 18
Tuan Duc Ngo, Binh-Son Hua, Khoi Nguyen: ISBNet: a 3D Point Cloud Instance Segmentation Network with Instance-aware Sampling and Box-aware Dynamic Convolution. CVPR 2023
TD3Dpermissive0.751 261.000 10.774 500.867 140.621 330.934 70.404 260.706 240.812 40.605 280.633 290.626 320.690 241.000 10.640 390.820 290.777 191.000 10.612 19
Maksim Kolodiazhnyi, Anna Vorontsova, Anton Konushin, Danila Rukhovich: Top-Down Beats Bottom-Up in 3D Instance Segmentation. WACV 2024
PBNetpermissive0.747 271.000 10.818 340.837 230.713 110.844 310.457 230.647 450.711 190.614 260.617 330.657 290.650 301.000 10.692 300.822 280.765 261.000 10.595 27
Weiguang Zhao, Yuyao Yan, Chaolong Yang, Jianan Ye, Xi Yang, Kaizhu Huang: Divide and Conquer: 3D Instance Segmentation With Point-Wise Binarization. ICCV 2023
GraphCut0.732 281.000 10.788 470.724 430.642 300.859 300.248 370.787 110.618 340.596 290.653 250.722 170.583 531.000 10.766 200.861 120.825 31.000 10.504 44
IPCA-Inst0.731 291.000 10.788 480.884 110.698 160.788 470.252 360.760 130.646 320.511 390.637 280.665 280.804 91.000 10.644 380.778 380.747 311.000 10.561 34
TopoSeg0.725 301.000 10.806 410.933 30.668 270.758 520.272 350.734 180.630 330.549 350.654 240.606 330.697 220.966 480.612 430.839 210.754 301.000 10.573 31
DKNet0.718 311.000 10.814 350.782 320.619 350.872 260.224 390.751 160.569 380.677 220.585 380.724 160.633 420.981 420.515 530.819 300.736 321.000 10.617 16
Yizheng Wu, Min Shi, Shuaiyuan Du, Hao Lu, Zhiguo Cao, Weicai Zhong: 3D Instances as 1D Kernels. ECCV 2022
SSEC0.707 321.000 10.850 270.924 40.648 280.747 550.162 430.862 30.572 370.520 370.624 300.549 360.649 391.000 10.560 480.706 550.768 241.000 10.591 29
HAISpermissive0.699 331.000 10.849 280.820 240.675 260.808 410.279 330.757 150.465 440.517 380.596 350.559 350.600 471.000 10.654 360.767 400.676 360.994 530.560 35
Shaoyu Chen, Jiemin Fang, Qian Zhang, Wenyu Liu, Xinggang Wang: Hierarchical Aggregation for 3D Instance Segmentation. ICCV 2021
SSTNetpermissive0.698 341.000 10.697 660.888 90.556 450.803 420.387 270.626 490.417 490.556 340.585 390.702 180.600 471.000 10.824 90.720 530.692 341.000 10.509 43
Zhihao Liang, Zhihao Li, Songcen Xu, Mingkui Tan, Kui Jia: Instance Segmentation in 3D Scenes using Semantic Superpoint Tree Networks. ICCV2021
DualGroup0.694 351.000 10.799 440.811 250.622 320.817 360.376 280.805 90.590 360.487 430.568 420.525 400.650 300.835 610.600 440.829 250.655 391.000 10.526 40
ODIN - Inspermissive0.693 361.000 10.880 240.647 510.620 340.779 490.336 300.501 640.681 240.577 300.595 360.679 270.683 271.000 10.709 280.816 320.637 430.770 730.557 36
Ayush Jain, Pushkal Katara, Nikolaos Gkanatsios, Adam W. Harley, Gabriel Sarch, Kriti Aggarwal, Vishrav Chaudhary, Katerina Fragkiadaki: ODIN: A Single Model for 2D and 3D Segmentation. CVPR 2024
SphereSeg0.680 371.000 10.856 260.744 400.618 360.893 200.151 440.651 440.713 180.537 360.579 410.430 500.651 291.000 10.389 640.744 480.697 330.991 550.601 25
DANCENET0.680 371.000 10.807 390.733 410.600 390.768 510.375 290.543 570.538 390.610 270.599 340.498 410.632 440.981 420.739 250.856 130.633 460.882 680.454 53
Box2Mask0.677 391.000 10.847 290.771 340.509 540.816 370.277 340.558 560.482 410.562 330.640 270.448 460.700 181.000 10.666 320.852 170.578 530.997 440.488 48
Julian Chibane, Francis Engelmann, Tuan Anh Tran, Gerard Pons-Moll: Box2Mask: Weakly Supervised 3D Semantic Instance Segmentation Using Bounding Boxes. ECCV 2022
OccuSeg+instance0.672 401.000 10.758 580.682 480.576 430.842 320.477 210.504 630.524 400.567 320.585 400.451 450.557 551.000 10.751 230.797 350.563 561.000 10.467 52
Lei Han, Tian Zheng, Lan Xu, Lu Fang: OccuSeg: Occupancy-aware 3D Instance Segmentation. CVPR2020
Mask-Group0.664 411.000 10.822 330.764 380.616 370.815 380.139 480.694 290.597 350.459 470.566 430.599 340.600 470.516 710.715 270.819 310.635 441.000 10.603 23
Min Zhong, Xinghao Chen, Xiaokang Chen, Gang Zeng, Yunhe Wang: MaskGroup: Hierarchical Point Grouping and Masking for 3D Instance Segmentation. ICME 2022
INS-Conv-instance0.657 421.000 10.760 560.667 500.581 410.863 280.323 310.655 420.477 420.473 450.549 450.432 490.650 301.000 10.655 350.738 490.585 520.944 600.472 51
CSC-Pretrained0.648 431.000 10.810 360.768 350.523 520.813 390.143 470.819 50.389 520.422 560.511 490.443 470.650 301.000 10.624 410.732 500.634 451.000 10.375 60
PE0.645 441.000 10.773 520.798 290.538 470.786 480.088 560.799 100.350 560.435 540.547 460.545 370.646 410.933 510.562 470.761 430.556 610.997 440.501 46
Biao Zhang, Peter Wonka: Point Cloud Instance Segmentation using Probabilistic Embeddings. CVPR 2021
RPGN0.643 451.000 10.758 570.582 620.539 460.826 350.046 610.765 120.372 540.436 530.588 370.539 390.650 301.000 10.577 450.750 460.653 410.997 440.495 47
Shichao Dong, Guosheng Lin, Tzu-Yi Hung: Learning Regional Purity for Instance Segmentation on 3D Point Clouds. ECCV 2022
Dyco3Dcopyleft0.641 461.000 10.841 300.893 80.531 490.802 430.115 530.588 540.448 460.438 510.537 480.430 510.550 560.857 530.534 510.764 420.657 380.987 560.568 32
Tong He; Chunhua Shen; Anton van den Hengel: DyCo3D: Robust Instance Segmentation of 3D Point Clouds through Dynamic Convolution. CVPR2021
GICN0.638 471.000 10.895 220.800 280.480 580.676 600.144 460.737 170.354 550.447 480.400 620.365 570.700 181.000 10.569 460.836 220.599 481.000 10.473 50
PointGroup0.636 481.000 10.765 530.624 530.505 560.797 440.116 520.696 280.384 530.441 490.559 440.476 430.596 501.000 10.666 320.756 440.556 600.997 440.513 42
Li Jiang, Hengshuang Zhao, Shaoshuai Shi, Shu Liu, Chi-Wing Fu, Jiaya Jia: PointGroup: Dual-Set Point Grouping for 3D Instance Segmentation. CVPR 2020 [oral]
DD-UNet+Group0.635 490.667 640.797 460.714 450.562 440.774 500.146 450.810 80.429 480.476 440.546 470.399 530.633 421.000 10.632 400.722 520.609 471.000 10.514 41
H. Liu, R. Liu, K. Yang, J. Zhang, K. Peng, R. Stiefelhagen: HIDA: Towards Holistic Indoor Understanding for the Visually Impaired via Semantic Instance Segmentation with a Wearable Solid-State LiDAR Sensor. ICCVW 2021
Mask3D_evaluation0.631 501.000 10.829 320.606 550.646 290.836 330.068 570.511 610.462 450.507 400.619 320.389 550.610 451.000 10.432 590.828 270.673 370.788 720.552 37
DENet0.629 511.000 10.797 450.608 540.589 400.627 640.219 400.882 10.310 580.402 610.383 640.396 540.650 301.000 10.663 340.543 720.691 351.000 10.568 33
3D-MPA0.611 521.000 10.833 310.765 370.526 510.756 530.136 500.588 540.470 430.438 520.432 580.358 590.650 300.857 530.429 600.765 410.557 591.000 10.430 55
Francis Engelmann, Martin Bokeloh, Alireza Fathi, Bastian Leibe, Matthias Nießner: 3D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentation. CVPR 2020
OSIS0.605 531.000 10.801 430.599 570.535 480.728 570.286 320.436 680.679 250.491 410.433 560.256 610.404 680.857 530.620 420.724 510.510 661.000 10.539 39
AOIA0.601 541.000 10.761 550.687 470.485 570.828 340.008 680.663 400.405 510.405 600.425 590.490 420.596 500.714 640.553 500.779 360.597 490.992 540.424 57
PCJC0.578 551.000 10.810 370.583 610.449 610.813 400.042 620.603 520.341 570.490 420.465 530.410 520.650 300.835 610.264 700.694 590.561 570.889 650.504 45
SSEN0.575 561.000 10.761 540.473 640.477 590.795 450.066 580.529 590.658 300.460 460.461 540.380 560.331 700.859 520.401 630.692 610.653 401.000 10.348 62
Dongsu Zhang, Junha Chun, Sang Kyun Cha, Young Min Kim: Spatial Semantic Embedding Network: Fast 3D Instance Segmentation with Deep Metric Learning. Arxiv
RWSeg0.567 570.528 740.708 650.626 520.580 420.745 560.063 590.627 480.240 620.400 620.497 500.464 440.515 571.000 10.475 550.745 470.571 541.000 10.429 56
NeuralBF0.555 580.667 640.896 210.843 210.517 530.751 540.029 630.519 600.414 500.439 500.465 520.000 800.484 590.857 530.287 680.693 600.651 421.000 10.485 49
Weiwei Sun, Daniel Rebain, Renjie Liao, Vladimir Tankovich, Soroosh Yazdani, Kwang Moo Yi, Andrea Tagliasacchi: NeuralBF: Neural Bilateral Filtering for Top-down Instance Segmentation on Point Clouds. WACV 2023
MTML0.549 591.000 10.807 400.588 600.327 660.647 620.004 700.815 70.180 650.418 570.364 660.182 640.445 621.000 10.442 580.688 620.571 551.000 10.396 58
Jean Lahoud, Bernard Ghanem, Marc Pollefeys, Martin R. Oswald: 3D Instance Segmentation via Multi-task Metric Learning. ICCV 2019 [oral]
ClickSeg_Instance0.539 601.000 10.621 690.300 670.530 500.698 580.127 510.533 580.222 630.430 550.400 610.365 570.574 540.938 500.472 560.659 640.543 620.944 600.347 63
One_Thing_One_Clickpermissive0.529 610.667 640.718 610.777 330.399 620.683 590.000 730.669 380.138 680.391 630.374 650.539 380.360 690.641 680.556 490.774 390.593 500.997 440.251 68
Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu: One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation. CVPR 2021
Sparse R-CNN0.515 621.000 10.538 740.282 680.468 600.790 460.173 420.345 700.429 470.413 590.484 510.176 650.595 520.591 690.522 520.668 630.476 670.986 580.327 64
Occipital-SCS0.512 631.000 10.716 620.509 630.506 550.611 650.092 550.602 530.177 660.346 660.383 630.165 660.442 630.850 600.386 650.618 680.543 630.889 650.389 59
3D-BoNet0.488 641.000 10.672 680.590 590.301 680.484 750.098 540.620 500.306 590.341 670.259 700.125 680.434 650.796 630.402 620.499 740.513 650.909 640.439 54
Bo Yang, Jianan Wang, Ronald Clark, Qingyong Hu, Sen Wang, Andrew Markham, Niki Trigoni: Learning Object Bounding Boxes for 3D Instance Segmentation on Point Clouds. NeurIPS 2019 Spotlight
PanopticFusion-inst0.478 650.667 640.712 640.595 580.259 710.550 710.000 730.613 510.175 670.250 720.434 550.437 480.411 670.857 530.485 540.591 710.267 770.944 600.359 61
Gaku Narita, Takashi Seno, Tomoya Ishikawa, Yohsuke Kaji: PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Things. IROS 2019 (to appear)
SPG_WSIS0.470 660.667 640.685 670.677 490.372 640.562 690.000 730.482 650.244 610.316 690.298 670.052 750.442 640.857 530.267 690.702 560.559 581.000 10.287 66
SALoss-ResNet0.459 671.000 10.737 600.159 780.259 700.587 670.138 490.475 660.217 640.416 580.408 600.128 670.315 710.714 640.411 610.536 730.590 510.873 690.304 65
Zhidong Liang, Ming Yang, Hao Li, Chunxiang Wang: 3D Instance Embedding Learning With a Structure-Aware Loss Function for Point Cloud Segmentation. IEEE Robotics and Automation Letters (IROS2020)
MASCpermissive0.447 680.528 740.555 720.381 650.382 630.633 630.002 710.509 620.260 600.361 650.432 570.327 600.451 610.571 700.367 660.639 660.386 680.980 590.276 67
Chen Liu, Yasutaka Furukawa: MASC: Multi-scale Affinity with Sparse Convolution for 3D Instance Segmentation.
SegGroup_inspermissive0.445 690.667 640.773 510.185 750.317 670.656 610.000 730.407 690.134 690.381 640.267 690.217 630.476 600.714 640.452 570.629 670.514 641.000 10.222 71
An Tao, Yueqi Duan, Yi Wei, Jiwen Lu, Jie Zhou: SegGroup: Seg-Level Supervision for 3D Instance and Semantic Segmentation. TIP 2022
3D-SISpermissive0.382 701.000 10.432 770.245 700.190 720.577 680.013 670.263 720.033 750.320 680.240 710.075 710.422 660.857 530.117 750.699 570.271 760.883 670.235 70
Ji Hou, Angela Dai, Matthias Niessner: 3D-SIS: 3D Semantic Instance Segmentation of RGB-D Scans. CVPR 2019
Hier3Dcopyleft0.323 710.667 640.542 730.264 690.157 750.550 700.000 730.205 750.009 770.270 710.218 720.075 710.500 580.688 670.007 810.698 580.301 730.459 780.200 72
Tan: HCFS3D: Hierarchical Coupled Feature Selection Network for 3D Semantic and Instance Segmentation.
UNet-backbone0.319 720.667 640.715 630.233 710.189 730.479 760.008 680.218 730.067 740.201 740.173 730.107 690.123 760.438 720.150 720.615 690.355 690.916 630.093 80
R-PointNet0.306 730.500 760.405 780.311 660.348 650.589 660.054 600.068 780.126 700.283 700.290 680.028 760.219 740.214 750.331 670.396 780.275 740.821 710.245 69
Region-18class0.284 740.250 800.751 590.228 730.270 690.521 720.000 730.468 670.008 790.205 730.127 740.000 800.068 780.070 790.262 710.652 650.323 710.740 740.173 73
SemRegionNet-20cls0.250 750.333 770.613 700.229 720.163 740.493 730.000 730.304 710.107 710.147 770.100 760.052 740.231 720.119 770.039 770.445 760.325 700.654 750.141 76
tmp0.248 760.667 640.437 760.188 740.153 760.491 740.000 730.208 740.094 730.153 760.099 770.057 730.217 750.119 770.039 770.466 750.302 720.640 760.140 77
3D-BEVIS0.248 760.667 640.566 710.076 790.035 810.394 790.027 650.035 800.098 720.099 790.030 800.025 770.098 770.375 740.126 740.604 700.181 790.854 700.171 74
Cathrin Elich, Francis Engelmann, Jonas Schult, Theodora Kontogianni, Bastian Leibe: 3D-BEVIS: Birds-Eye-View Instance Segmentation.
Sem_Recon_ins0.227 780.764 630.486 750.069 800.098 780.426 780.017 660.067 790.015 760.172 750.100 750.096 700.054 800.183 760.135 730.366 790.260 780.614 770.168 75
ASIS0.199 790.333 770.253 800.167 770.140 770.438 770.000 730.177 760.008 780.121 780.069 780.004 790.231 730.429 730.036 790.445 770.273 750.333 800.119 79
Sgpn_scannet0.143 800.208 810.390 790.169 760.065 790.275 800.029 640.069 770.000 800.087 800.043 790.014 780.027 810.000 800.112 760.351 800.168 800.438 790.138 78
MaskRCNN 2d->3d Proj0.058 810.333 770.002 810.000 810.053 800.002 810.002 720.021 810.000 800.045 810.024 810.238 620.065 790.000 800.014 800.107 810.020 810.110 810.006 81


This table lists the benchmark results for the 2D semantic label scenario.


Method Infoavg ioubathtubbedbookshelfcabinetchaircountercurtaindeskdoorfloorotherfurniturepicturerefrigeratorshower curtainsinksofatabletoiletwallwindow
sorted bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort by
Virtual MVFusion (R)0.745 10.861 10.839 10.881 10.672 20.512 10.422 190.898 10.723 10.714 10.954 20.454 10.509 10.773 10.895 10.756 10.820 10.653 10.935 10.891 10.728 1
Abhijit Kundu, Xiaoqi Yin, Alireza Fathi, David Ross, Brian Brewington, Thomas Funkhouser, Caroline Pantofaru: Virtual Multi-view Fusion for 3D Semantic Segmentation. ECCV 2020
BPNet_2Dcopyleft0.670 20.822 30.795 30.836 20.659 30.481 20.451 150.769 50.656 30.567 40.931 30.395 60.390 60.700 40.534 40.689 110.770 20.574 30.865 110.831 30.675 6
Wenbo Hu, Hengshuang Zhao, Li Jiang, Jiaya Jia and Tien-Tsin Wong: Bidirectional Projection Network for Cross Dimension Scene Understanding. CVPR 2021 (Oral)
MVF-GNN(2D)0.636 30.606 160.794 40.434 170.688 10.337 80.464 140.798 40.632 50.589 30.908 90.420 20.329 140.743 20.594 20.738 20.676 50.527 40.906 20.818 60.715 3
CU-Hybrid-2D Net0.636 30.825 20.820 20.179 250.648 40.463 30.549 20.742 90.676 20.628 20.961 10.420 20.379 70.684 80.381 200.732 30.723 30.599 20.827 180.851 20.634 9
DVEFormer0.626 50.616 120.764 60.690 50.583 110.322 140.540 30.809 30.593 70.502 120.900 140.374 90.433 30.660 90.528 50.665 190.663 60.491 90.871 100.810 90.705 4
Fischedick, S., Seichter, D., Stephan, B., Schmidt, R., Gross, H.-M.: DVEFormer: Efficient Prediction of Dense Visual Embeddings via Distillation and RGB-D Transformers. IROS 2025
CMX0.613 60.681 90.725 130.502 130.634 60.297 190.478 120.830 20.651 40.537 70.924 40.375 70.315 160.686 70.451 150.714 50.543 230.504 60.894 70.823 50.688 5
DMMF_3d0.605 70.651 100.744 110.782 30.637 50.387 40.536 50.732 100.590 80.540 60.856 230.359 120.306 170.596 160.539 30.627 220.706 40.497 80.785 230.757 210.476 24
EMSANet0.600 80.716 40.746 100.395 200.614 90.382 50.523 60.713 130.571 120.503 100.922 70.404 50.397 50.655 100.400 170.626 230.663 60.469 140.900 40.827 40.577 16
Seichter, Daniel and Fischedick, Söhnke and Köhler, Mona and Gross, Horst-Michael: EMSANet: Efficient Multi-Task RGB-D Scene Analysis for Indoor Environments. IJCNN 2022
MCA-Net0.595 90.533 220.756 90.746 40.590 100.334 100.506 90.670 170.587 90.500 130.905 110.366 110.352 100.601 150.506 90.669 170.648 100.501 70.839 170.769 170.516 23
RFBNet0.592 100.616 120.758 80.659 60.581 120.330 110.469 130.655 200.543 150.524 80.924 40.355 140.336 120.572 190.479 110.671 150.648 100.480 110.814 210.814 70.614 12
FAN_NV_RVC0.586 110.510 230.764 60.079 280.620 80.330 110.494 100.753 70.573 100.556 50.884 180.405 40.303 180.718 30.452 140.672 140.658 80.509 50.898 50.813 80.727 2
WSGFormer0.585 120.706 50.708 180.434 170.574 140.283 220.538 40.759 60.542 170.482 170.924 40.351 160.333 130.614 120.393 180.692 100.551 220.461 150.874 90.809 100.673 7
DCRedNet0.583 130.682 80.723 140.542 120.510 220.310 160.451 150.668 180.549 140.520 90.920 80.375 70.446 20.528 220.417 160.670 160.577 190.478 120.862 120.806 110.628 11
MIX6D_RVC0.582 140.695 60.687 190.225 230.632 70.328 130.550 10.748 80.623 60.494 160.890 160.350 170.254 250.688 60.454 130.716 40.597 180.489 100.881 80.768 180.575 17
SSMAcopyleft0.577 150.695 60.716 160.439 150.563 160.314 150.444 170.719 110.551 130.503 100.887 170.346 180.348 110.603 140.353 220.709 60.600 160.457 160.901 30.786 130.599 15
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. International Journal of Computer Vision, 2019
DMMF0.567 160.623 110.767 50.238 220.571 150.347 60.413 210.719 110.472 220.418 240.895 150.357 130.260 240.696 50.523 80.666 180.642 120.437 200.895 60.793 120.603 14
UNIV_CNP_RVC_UE0.566 170.569 210.686 210.435 160.524 190.294 200.421 200.712 140.543 150.463 190.872 190.320 190.363 90.611 130.477 120.686 120.627 130.443 190.862 120.775 160.639 8
EMSAFormer0.564 180.581 180.736 120.564 110.546 180.219 250.517 70.675 160.486 210.427 230.904 120.352 150.320 150.589 170.528 50.708 70.464 260.413 240.847 160.786 130.611 13
Söhnke Benedikt Fischedick, Daniel Seichter, Robin Schmidt, Leonard Rabes, and Horst-Michael Gross: Efficient Multi-Task Scene Analysis with RGB-D Transformers. IJCNN 2023
SN_RN152pyrx8_RVCcopyleft0.546 190.572 190.663 230.638 80.518 200.298 180.366 260.633 230.510 190.446 210.864 210.296 220.267 210.542 210.346 230.704 80.575 200.431 210.853 150.766 190.630 10
UDSSEG_RVC0.545 200.610 150.661 240.588 90.556 170.268 230.482 110.642 220.572 110.475 180.836 250.312 200.367 80.630 110.189 250.639 210.495 250.452 170.826 190.756 220.541 19
segfomer with 6d0.542 210.594 170.687 190.146 260.579 130.308 170.515 80.703 150.472 220.498 140.868 200.369 100.282 190.589 170.390 190.701 90.556 210.416 230.860 140.759 200.539 21
FuseNetpermissive0.535 220.570 200.681 220.182 240.512 210.290 210.431 180.659 190.504 200.495 150.903 130.308 210.428 40.523 230.365 210.676 130.621 150.470 130.762 240.779 150.541 19
Caner Hazirbas, Lingni Ma, Csaba Domokos, Daniel Cremers: FuseNet: Incorporating Depth into Semantic Segmentation via Fusion-based CNN Architecture. ACCV 2016
AdapNet++copyleft0.503 230.613 140.722 150.418 190.358 280.337 80.370 250.479 260.443 240.368 260.907 100.207 250.213 270.464 260.525 70.618 240.657 90.450 180.788 220.721 250.408 27
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. International Journal of Computer Vision, 2019
3DMV (2d proj)0.498 240.481 260.612 250.579 100.456 240.343 70.384 230.623 240.525 180.381 250.845 240.254 240.264 230.557 200.182 260.581 260.598 170.429 220.760 250.661 270.446 26
Angela Dai, Matthias Niessner: 3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation. ECCV'18
MSeg1080_RVCpermissive0.485 250.505 240.709 170.092 270.427 250.241 240.411 220.654 210.385 280.457 200.861 220.053 280.279 200.503 240.481 100.645 200.626 140.365 260.748 260.725 240.529 22
John Lambert*, Zhuang Liu*, Ozan Sener, James Hays, Vladlen Koltun: MSeg: A Composite Dataset for Multi-domain Semantic Segmentation. CVPR 2020
ILC-PSPNet0.475 260.490 250.581 260.289 210.507 230.067 280.379 240.610 250.417 260.435 220.822 270.278 230.267 210.503 240.228 240.616 250.533 240.375 250.820 200.729 230.560 18
Enet (reimpl)0.376 270.264 280.452 280.452 140.365 260.181 260.143 280.456 270.409 270.346 270.769 280.164 260.218 260.359 270.123 280.403 280.381 280.313 280.571 270.685 260.472 25
Re-implementation of Adam Paszke, Abhishek Chaurasia, Sangpil Kim, Eugenio Culurciello: ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation.
ScanNet (2d proj)permissive0.330 280.293 270.521 270.657 70.361 270.161 270.250 270.004 280.440 250.183 280.836 250.125 270.060 280.319 280.132 270.417 270.412 270.344 270.541 280.427 280.109 28
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner: ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes. CVPR'17


This table lists the benchmark results for the 2D semantic instance scenario.




Method Infoavg apbathtubbedbookshelfcabinetchaircountercurtaindeskdoorotherfurniturepicturerefrigeratorshower curtainsinksofatabletoiletwindow
sorted bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort by
EMSANet (Instance)0.241 10.401 10.439 10.085 10.242 10.220 10.081 10.289 20.117 20.121 10.182 10.126 10.346 10.181 20.181 20.358 10.156 10.675 20.131 1
Seichter, Daniel and Fischedick, Söhnke and Köhler, Mona and Gross, Horst-Michael: EMSANet: Efficient Multi-Task RGB-D Scene Analysis for Indoor Environments. IJCNN 2022
UniDet_RVC0.205 20.381 20.323 30.037 30.226 30.177 30.063 20.277 30.120 10.067 30.131 30.074 30.317 20.080 30.235 10.289 30.141 30.678 10.080 3
FKNet0.204 30.334 30.358 20.038 20.234 20.184 20.025 30.318 10.042 40.088 20.141 20.053 40.300 30.207 10.171 30.292 20.149 20.636 30.109 2
MaskRCNN_ScanNetpermissive0.119 40.129 40.212 40.002 40.112 40.148 40.014 40.205 40.044 30.066 40.078 40.095 20.142 40.030 40.128 40.139 40.080 40.459 40.057 4
Re-implementation of Kaiming He, Georgia Gkioxari, Piotr Dollár, Ross Girshick: Mask R-CNN. ICCV'17


This table lists the benchmark results for the scene type classification scenario.




Method Infoavg recallapartmentbathroombedroom / hotelbookstore / libraryconference roomcopy/mail roomhallwaykitchenlaundry roomliving room / loungemiscofficestorage / basement / garage
sorted bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort bysort by
LAST-PCL-type0.780 10.250 31.000 11.000 11.000 11.000 11.000 10.500 21.000 10.500 20.889 10.000 21.000 11.000 1
Yanmin Wu, Qiankun Gao, Renrui Zhang, and Jian Zhang: Language-Assisted 3D Scene Understanding. arxiv23.12
multi-taskpermissive0.700 20.500 11.000 10.882 30.500 31.000 11.000 10.500 21.000 11.000 10.778 20.000 20.938 20.000 3
Shengyu Huang, Mikhail Usvyatsov, Konrad Schindler: Indoor Scene Recognition in 3D. IROS 2020
3DASPP-SCE0.691 30.500 10.938 30.824 41.000 11.000 10.500 31.000 10.857 30.500 20.556 40.000 20.812 30.500 2
SE-ResNeXt-SSMA0.498 40.000 50.812 40.941 20.500 30.500 40.500 30.500 20.429 50.500 20.667 30.500 10.625 40.000 3
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. arXiv
resnet50_scannet0.353 50.250 30.812 40.529 50.500 30.500 40.000 50.500 20.571 40.000 50.556 40.000 20.375 50.000 3