Benchmark Results - ScanNet Benchmark

This table lists the benchmark results for the 3D semantic label scenario.

Method	avg iou	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	floor	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	wall	window

MinkowskiNet	0.736 1	0.859 2	0.818 2	0.832 2	0.709 2	0.840 2	0.521 2	0.853 1	0.660 1	0.643 1	0.951 4	0.544 2	0.286 6	0.731 1	0.893 1	0.675 4	0.772 3	0.683 1	0.874 7	0.852 2	0.727 1
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019
SparseConvNet	0.725 2	0.647 17	0.821 1	0.846 1	0.721 1	0.869 1	0.533 1	0.754 5	0.603 4	0.614 2	0.955 1	0.572 1	0.325 2	0.710 2	0.870 2	0.724 1	0.823 1	0.628 3	0.934 1	0.865 1	0.683 2

KP-FCNN	0.684 3	0.847 4	0.758 6	0.784 3	0.647 3	0.814 5	0.473 4	0.772 4	0.605 3	0.594 3	0.935 15	0.450 6	0.181 19	0.587 4	0.805 3	0.690 2	0.785 2	0.614 4	0.882 4	0.819 3	0.632 5
H. Thomas, C. Qi, J. Deschaud, B. Marcotegui, F. Goulette, L. Guibas.: KPConv: Flexible and Deformable Convolution for Point Clouds. ICCV 2019
joint point-based	0.634 6	0.614 18	0.778 3	0.667 14	0.633 5	0.825 3	0.420 8	0.804 2	0.467 18	0.561 4	0.951 4	0.494 3	0.291 3	0.566 7	0.458 15	0.579 14	0.764 4	0.559 9	0.838 11	0.814 4	0.598 11
Hung-Yueh Chiang, Yen-Liang Lin, Yueh-Cheng Liu, Winston H. Hsu: A Unified Point-Based Framework for 3D Segmentation. 3DV 2019
MVPNet	0.641 5	0.831 5	0.715 10	0.671 12	0.590 7	0.781 9	0.394 12	0.679 13	0.642 2	0.553 5	0.937 14	0.462 5	0.256 7	0.649 3	0.406 18	0.626 8	0.691 9	0.666 2	0.877 6	0.792 9	0.608 8
Maximilian Jaritz, Jiayuan Gu, Hao Su: Multi-view PointNet for 3D Scene Understanding. GMDL Workshop, ICCV 2019
DMC-Net	0.630 8	0.706 13	0.738 7	0.745 6	0.535 12	0.787 8	0.335 18	0.742 6	0.512 12	0.546 6	0.941 10	0.427 9	0.330 1	0.496 12	0.653 7	0.634 7	0.719 6	0.550 11	0.754 20	0.801 7	0.642 3

HPEIN	0.618 9	0.729 10	0.668 16	0.647 15	0.597 6	0.766 11	0.414 9	0.680 12	0.520 10	0.525 7	0.946 7	0.432 7	0.215 12	0.493 14	0.599 9	0.638 6	0.617 19	0.570 7	0.897 3	0.806 6	0.605 9
Li Jiang, Hengshuang Zhao, Shu Liu, Xiaoyong Shen, Chi-Wing Fu, Jiaya Jia: Hierarchical Point-Edge Interaction Network for Point Cloud Semantic Segmentation. ICCV 2019
SPH3D-GCN	0.610 10	0.858 3	0.772 4	0.489 25	0.532 13	0.792 7	0.404 11	0.643 16	0.570 7	0.507 8	0.935 15	0.414 11	0.046 30	0.510 10	0.702 5	0.602 11	0.705 8	0.549 12	0.859 10	0.773 11	0.534 17
Huan Lei, Naveed Akhtar, and Ajmal Mian: Spherical Kernel for Efficient Graph Convolution on 3D Point Clouds.
PointConv	0.666 4	0.781 6	0.759 5	0.699 9	0.644 4	0.822 4	0.475 3	0.779 3	0.564 8	0.504 9	0.953 2	0.428 8	0.203 15	0.586 5	0.754 4	0.661 5	0.753 5	0.588 5	0.902 2	0.813 5	0.642 3
Wenxuan Wu, Zhongang Qi, Li Fuxin: PointConv: Deep Convolutional Networks on 3D Point Clouds. CVPR 2019
MCCNN	0.633 7	0.866 1	0.731 8	0.771 4	0.576 9	0.809 6	0.410 10	0.684 11	0.497 14	0.491 10	0.949 6	0.466 4	0.105 26	0.581 6	0.646 8	0.620 9	0.680 11	0.542 13	0.817 13	0.795 8	0.618 6
P. Hermosilla, T. Ritschel, P.P. Vazquez, A. Vinacua, T. Ropinski: Monte Carlo Convolution for Learning on Non-Uniformly Sampled Point Clouds. SIGGRAPH Asia 2018
CCRFNet	0.589 15	0.766 7	0.659 19	0.683 11	0.470 18	0.740 15	0.387 15	0.620 17	0.490 15	0.476 11	0.922 20	0.355 19	0.245 8	0.511 9	0.511 13	0.571 15	0.643 15	0.493 18	0.872 8	0.762 13	0.600 10

DVVNet	0.562 17	0.648 16	0.700 11	0.770 5	0.586 8	0.687 21	0.333 19	0.650 15	0.514 11	0.475 12	0.906 25	0.359 17	0.223 11	0.340 22	0.442 17	0.422 25	0.668 12	0.501 16	0.708 23	0.779 10	0.534 17

CDF-SM3D	0.597 12	0.557 23	0.728 9	0.703 7	0.572 10	0.730 16	0.435 7	0.715 8	0.504 13	0.467 13	0.863 28	0.427 9	0.184 18	0.495 13	0.569 11	0.685 3	0.717 7	0.516 14	0.866 9	0.726 19	0.479 21

3DMV, FTSDF	0.501 20	0.558 22	0.608 24	0.424 29	0.478 17	0.690 20	0.246 26	0.586 19	0.468 17	0.450 14	0.911 23	0.394 13	0.160 21	0.438 16	0.212 26	0.432 24	0.541 24	0.475 19	0.742 21	0.727 18	0.477 22

LAP-D	0.594 13	0.720 11	0.692 14	0.637 17	0.456 19	0.773 10	0.391 14	0.730 7	0.587 5	0.445 15	0.940 12	0.381 14	0.288 4	0.434 17	0.453 16	0.591 12	0.649 13	0.581 6	0.777 17	0.749 17	0.610 7

DPC	0.592 14	0.720 11	0.700 11	0.602 20	0.480 16	0.762 12	0.380 16	0.713 9	0.585 6	0.437 16	0.940 12	0.369 16	0.288 4	0.434 17	0.509 14	0.590 13	0.639 17	0.567 8	0.772 18	0.755 15	0.592 12
Francis Engelmann, Theodora Kontogianni, Bastian Leibe: Dilated Point Convolutions. arXiv
FLConv	0.605 11	0.751 8	0.695 13	0.701 8	0.545 11	0.758 13	0.448 5	0.596 18	0.538 9	0.428 17	0.953 2	0.398 12	0.160 21	0.457 15	0.598 10	0.612 10	0.686 10	0.551 10	0.880 5	0.768 12	0.585 13

TextureNet	0.566 16	0.672 15	0.664 17	0.671 12	0.494 14	0.719 17	0.445 6	0.678 14	0.411 23	0.396 18	0.935 15	0.356 18	0.225 10	0.412 19	0.535 12	0.565 16	0.636 18	0.464 20	0.794 16	0.680 23	0.568 14
Jingwei Huang, Haotian Zhang, Li Yi, Thomas Funkerhouser, Matthias Niessner, Leonidas Guibas: TextureNet: Consistent Local Parametrizations for Learning from High-Resolution Signals on Meshes. CVPR
3DMV	0.484 22	0.484 27	0.538 27	0.643 16	0.424 20	0.606 29	0.310 20	0.574 20	0.433 22	0.378 19	0.796 30	0.301 22	0.214 13	0.537 8	0.208 27	0.472 23	0.507 28	0.413 27	0.693 24	0.602 28	0.539 16
Angela Dai, Matthias Niessner: 3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation. ECCV'18
Pointnet++ & Feature	0.557 18	0.735 9	0.661 18	0.686 10	0.491 15	0.744 14	0.392 13	0.539 21	0.451 19	0.375 20	0.946 7	0.376 15	0.205 14	0.403 20	0.356 20	0.553 17	0.643 15	0.497 17	0.824 12	0.756 14	0.515 19

PCNN	0.498 21	0.559 21	0.644 21	0.560 23	0.420 21	0.711 19	0.229 28	0.414 22	0.436 20	0.352 21	0.941 10	0.324 21	0.155 23	0.238 26	0.387 19	0.493 19	0.529 25	0.509 15	0.813 14	0.751 16	0.504 20

PointCNN with RGB	0.458 23	0.577 20	0.611 23	0.356 31	0.321 28	0.715 18	0.299 22	0.376 25	0.328 28	0.319 22	0.944 9	0.285 24	0.164 20	0.216 29	0.229 25	0.484 21	0.545 23	0.456 22	0.755 19	0.709 20	0.475 23
Yangyan Li, Rui Bu, Mingchao Sun, Baoquan Chen: PointCNN. NeurIPS 2018
PNET2	0.442 25	0.548 24	0.548 26	0.597 21	0.363 25	0.628 27	0.300 21	0.292 26	0.374 25	0.307 23	0.881 27	0.268 25	0.186 17	0.238 26	0.204 28	0.407 26	0.506 29	0.449 23	0.667 25	0.620 27	0.462 24

PanopticFusion-label	0.529 19	0.491 26	0.688 15	0.604 19	0.386 22	0.632 26	0.225 30	0.705 10	0.434 21	0.293 24	0.815 29	0.348 20	0.241 9	0.499 11	0.669 6	0.507 18	0.649 13	0.442 24	0.796 15	0.602 28	0.561 15
Gaku Narita, Takashi Seno, Tomoya Ishikawa, Yohsuke Kaji: PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Things. IROS 2019 (to appear)
Tangent Convolutions	0.438 27	0.437 29	0.646 20	0.474 26	0.369 24	0.645 25	0.353 17	0.258 28	0.282 30	0.279 25	0.918 22	0.298 23	0.147 24	0.283 23	0.294 22	0.487 20	0.562 21	0.427 26	0.619 27	0.633 26	0.352 27
Maxim Tatarchenko, Jaesik Park, Vladlen Koltun, Qian-Yi Zhou: Tangent convolutions for dense prediction in 3d. CVPR 2018
SurfaceConvPF	0.442 25	0.505 25	0.622 22	0.380 30	0.342 27	0.654 24	0.227 29	0.397 24	0.367 26	0.276 26	0.924 19	0.240 27	0.198 16	0.359 21	0.262 23	0.366 27	0.581 20	0.435 25	0.640 26	0.668 24	0.398 25
Hao Pan, Shilin Liu, Yang Liu, Xin Tong: Convolutional Neural Networks on 3D Surfaces Using Parallel Frames.
ScanNet+FTSDF	0.383 29	0.297 31	0.491 29	0.432 28	0.358 26	0.612 28	0.274 24	0.116 30	0.411 23	0.265 27	0.904 26	0.229 28	0.079 28	0.250 24	0.185 29	0.320 30	0.510 26	0.385 28	0.548 29	0.597 30	0.394 26

PointNet++	0.339 30	0.584 19	0.478 30	0.458 27	0.256 31	0.360 32	0.250 25	0.247 29	0.278 31	0.261 28	0.677 32	0.183 30	0.117 25	0.212 30	0.145 31	0.364 28	0.346 32	0.232 32	0.548 29	0.523 31	0.252 30
Charles R. Qi, Li Yi, Hao Su, Leonidas J. Guibas: pointnet++: deep hierarchical feature learning on point sets in a metric space.
FCPN	0.447 24	0.679 14	0.604 25	0.578 22	0.380 23	0.682 22	0.291 23	0.106 31	0.483 16	0.258 29	0.920 21	0.258 26	0.025 31	0.231 28	0.325 21	0.480 22	0.560 22	0.463 21	0.725 22	0.666 25	0.231 31
Dario Rethage, Johanna Wald, Jürgen Sturm, Nassir Navab, Federico Tombari: Fully-Convolutional Point Networks for Large-Scale Point Clouds. ECCV 2018
SPLAT Net	0.393 28	0.472 28	0.511 28	0.606 18	0.311 29	0.656 23	0.245 27	0.405 23	0.328 28	0.197 30	0.927 18	0.227 29	0.000 33	0.001 33	0.249 24	0.271 32	0.510 26	0.383 29	0.593 28	0.699 21	0.267 29
Hang Su, Varun Jampani, Deqing Sun, Subhransu Maji, Evangelos Kalogerakis, Ming-Hsuan Yang, Jan Kautz: SPLATNet: Sparse Lattice Networks for Point Cloud Processing. CVPR 2018
ScanNet	0.306 32	0.203 32	0.366 31	0.501 24	0.311 29	0.524 31	0.211 31	0.002 33	0.342 27	0.189 31	0.786 31	0.145 32	0.102 27	0.245 25	0.152 30	0.318 31	0.348 31	0.300 31	0.460 32	0.437 32	0.182 32
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner: ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes. CVPR'17
SSC-UNet	0.308 31	0.353 30	0.290 32	0.278 32	0.166 32	0.553 30	0.169 32	0.286 27	0.147 32	0.148 32	0.908 24	0.182 31	0.064 29	0.023 32	0.018 33	0.354 29	0.363 30	0.345 30	0.546 31	0.685 22	0.278 28

ERROR	0.054 33	0.000 33	0.041 33	0.172 33	0.030 33	0.062 33	0.001 33	0.035 32	0.004 33	0.051 33	0.143 33	0.019 33	0.003 32	0.041 31	0.050 32	0.003 33	0.054 33	0.018 33	0.005 33	0.264 33	0.082 33

This table lists the benchmark results for the 3D semantic instance scenario.

Method	avg ap 50%	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	window

DCNet	0.634 1	1.000 1	0.902 1	0.771 1	0.461 2	0.814 1	0.282 1	0.583 5	0.328 1	0.472 1	0.471 1	0.295 3	0.600 1	1.000 1	0.650 1	0.664 3	0.587 2	1.000 1	0.537 1

MTML	0.549 2	1.000 1	0.807 2	0.588 4	0.327 5	0.647 2	0.004 12	0.815 1	0.180 5	0.418 2	0.364 6	0.182 5	0.445 3	1.000 1	0.442 4	0.688 2	0.571 3	1.000 1	0.396 3

ResNet-backbone	0.459 6	1.000 1	0.737 3	0.159 13	0.259 7	0.587 6	0.138 2	0.475 7	0.217 4	0.416 3	0.408 4	0.128 7	0.315 8	0.714 7	0.411 5	0.536 9	0.590 1	0.873 10	0.304 6

MASC	0.447 7	0.528 10	0.555 9	0.381 7	0.382 3	0.633 3	0.002 13	0.509 6	0.260 3	0.361 4	0.432 3	0.327 2	0.451 2	0.571 8	0.367 8	0.639 4	0.386 7	0.980 3	0.276 7
Chen Liu, Yasutaka Furukawa: MASC: Multi-scale Affinity with Sparse Convolution for 3D Instance Segmentation.
Occipital-SCS	0.512 3	1.000 1	0.716 4	0.509 5	0.506 1	0.611 4	0.092 5	0.602 4	0.177 6	0.346 5	0.383 5	0.165 6	0.442 4	0.850 5	0.386 7	0.618 5	0.543 4	0.889 8	0.389 4

3D-BoNet	0.488 4	1.000 1	0.672 7	0.590 3	0.301 6	0.484 9	0.098 4	0.620 2	0.306 2	0.341 6	0.259 8	0.125 8	0.434 5	0.796 6	0.402 6	0.499 10	0.513 5	0.909 7	0.439 2
Bo Yang, Jianan Wang, Ronald Clark, Qingyong Hu, Sen Wang, Andrew Markham, Niki Trigoni: Learning Object Bounding Boxes for 3D Instance Segmentation on Point Clouds. NeurIPS 2019 Spotlight
3D-SIS	0.382 8	1.000 1	0.432 11	0.245 10	0.190 10	0.577 7	0.013 10	0.263 10	0.033 13	0.320 7	0.240 10	0.075 11	0.422 6	0.857 3	0.117 12	0.699 1	0.271 11	0.883 9	0.235 10
Ji Hou, Angela Dai, Matthias Niessner: 3D-SIS: 3D Semantic Instance Segmentation of RGB-D Scans. CVPR 2019
R-PointNet	0.306 11	0.500 11	0.405 12	0.311 8	0.348 4	0.589 5	0.054 6	0.068 13	0.126 8	0.283 8	0.290 7	0.028 12	0.219 10	0.214 13	0.331 9	0.396 12	0.275 10	0.821 12	0.245 8

PanopticFusion-inst	0.478 5	0.667 7	0.712 6	0.595 2	0.259 8	0.550 8	0.000 15	0.613 3	0.175 7	0.250 9	0.434 2	0.437 1	0.411 7	0.857 3	0.485 2	0.591 8	0.267 12	0.944 5	0.359 5
Gaku Narita, Takashi Seno, Tomoya Ishikawa, Yohsuke Kaji: PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Things. IROS 2019 (to appear)
DPC-instance	0.355 9	0.500 11	0.517 10	0.467 6	0.228 9	0.422 11	0.133 3	0.405 8	0.111 9	0.205 10	0.241 9	0.075 10	0.233 9	0.306 12	0.445 3	0.439 11	0.457 6	0.974 4	0.239 9
Francis Engelmann, Theodora Kontogianni, Bastian Leibe: Dilated Point Convolutions. arXiv
UNet-backbone	0.319 10	0.667 7	0.715 5	0.233 11	0.189 11	0.479 10	0.008 11	0.218 11	0.067 12	0.201 11	0.173 11	0.107 9	0.123 11	0.438 9	0.150 10	0.615 6	0.355 8	0.916 6	0.093 14

Seg-Cluster	0.215 13	0.370 13	0.337 14	0.285 9	0.105 12	0.325 13	0.025 9	0.282 9	0.085 11	0.105 12	0.107 12	0.007 15	0.079 13	0.317 11	0.114 13	0.309 14	0.304 9	0.587 13	0.123 13

3D-BEVIS	0.248 12	0.667 7	0.566 8	0.076 14	0.035 15	0.394 12	0.027 8	0.035 14	0.098 10	0.099 13	0.030 14	0.025 13	0.098 12	0.375 10	0.126 11	0.604 7	0.181 13	0.854 11	0.171 11
Cathrin Elich, Francis Engelmann, Jonas Schult, Theodora Kontogianni, Bastian Leibe: 3D-BEVIS: Birds-Eye-View Instance Segmentation.
Sgpn_scannet	0.143 14	0.208 15	0.390 13	0.169 12	0.065 13	0.275 14	0.029 7	0.069 12	0.000 14	0.087 14	0.043 13	0.014 14	0.027 15	0.000 14	0.112 14	0.351 13	0.168 14	0.438 14	0.138 12

MaskRCNN 2d->3d Proj	0.058 15	0.333 14	0.002 15	0.000 15	0.053 14	0.002 15	0.002 14	0.021 15	0.000 14	0.045 15	0.024 15	0.238 4	0.065 14	0.000 14	0.014 15	0.107 15	0.020 15	0.110 15	0.006 15

This table lists the benchmark results for the 2D semantic label scenario.

Method	avg iou	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	floor	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	wall	window

RFBNet	0.592 2	0.616 3	0.758 1	0.659 2	0.581 2	0.330 4	0.469 2	0.655 5	0.543 4	0.524 1	0.924 1	0.355 3	0.336 5	0.572 3	0.479 3	0.671 3	0.648 2	0.480 2	0.814 5	0.814 1	0.614 2

DCRedNet	0.583 3	0.682 2	0.723 3	0.542 5	0.510 5	0.310 6	0.451 3	0.668 3	0.549 3	0.520 2	0.920 2	0.375 1	0.446 1	0.528 5	0.417 4	0.670 4	0.577 7	0.478 3	0.862 2	0.806 2	0.628 1

SSMA	0.577 4	0.695 1	0.716 5	0.439 7	0.563 3	0.314 5	0.444 4	0.719 1	0.551 2	0.503 3	0.887 6	0.346 4	0.348 4	0.603 1	0.353 6	0.709 1	0.600 5	0.457 5	0.901 1	0.786 3	0.599 3
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. International Journal of Computer Vision, 2019
MCA-Net	0.595 1	0.533 6	0.756 2	0.746 1	0.590 1	0.334 3	0.506 1	0.670 2	0.587 1	0.500 4	0.905 4	0.366 2	0.352 3	0.601 2	0.506 2	0.669 5	0.648 2	0.501 1	0.839 3	0.769 5	0.516 6

FuseNet	0.535 5	0.570 5	0.681 6	0.182 10	0.512 4	0.290 7	0.431 5	0.659 4	0.504 6	0.495 5	0.903 5	0.308 5	0.428 2	0.523 6	0.365 5	0.676 2	0.621 4	0.470 4	0.762 7	0.779 4	0.541 5
Caner Hazirbas, Lingni Ma, Csaba Domokos, Daniel Cremers: FuseNet: Incorporating Depth into Semantic Segmentation via Fusion-based CNN Architecture. ACCV 2016
ILC-PSPNet	0.475 8	0.490 7	0.581 8	0.289 9	0.507 6	0.067 10	0.379 7	0.610 7	0.417 9	0.435 6	0.822 9	0.278 6	0.267 6	0.503 7	0.228 7	0.616 7	0.533 8	0.375 8	0.820 4	0.729 6	0.560 4

3DMV (2d proj)	0.498 7	0.481 8	0.612 7	0.579 4	0.456 7	0.343 1	0.384 6	0.623 6	0.525 5	0.381 7	0.845 7	0.254 7	0.264 7	0.557 4	0.182 8	0.581 8	0.598 6	0.429 7	0.760 8	0.661 9	0.446 8
Angela Dai, Matthias Niessner: 3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation. ECCV'18
AdapNet++	0.503 6	0.613 4	0.722 4	0.418 8	0.358 10	0.337 2	0.370 8	0.479 8	0.443 7	0.368 8	0.907 3	0.207 8	0.213 9	0.464 8	0.525 1	0.618 6	0.657 1	0.450 6	0.788 6	0.721 7	0.408 9
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. International Journal of Computer Vision, 2019
Enet (reimpl)	0.376 9	0.264 10	0.452 10	0.452 6	0.365 8	0.181 8	0.143 10	0.456 9	0.409 10	0.346 9	0.769 10	0.164 9	0.218 8	0.359 9	0.123 10	0.403 10	0.381 10	0.313 10	0.571 9	0.685 8	0.472 7
Re-implementation of Adam Paszke, Abhishek Chaurasia, Sangpil Kim, Eugenio Culurciello: ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation.
ScanNet (2d proj)	0.330 10	0.293 9	0.521 9	0.657 3	0.361 9	0.161 9	0.250 9	0.004 10	0.440 8	0.183 10	0.836 8	0.125 10	0.060 10	0.319 10	0.132 9	0.417 9	0.412 9	0.344 9	0.541 10	0.427 10	0.109 10
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner: ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes. CVPR'17

This table lists the benchmark results for the 2D semantic instance scenario.

Method	avg ap	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	window

MaskRCNN_ScanNet	0.119 1	0.129 1	0.212 1	0.002 1	0.112 1	0.148 1	0.014 1	0.205 1	0.044 1	0.066 1	0.078 1	0.095 1	0.142 1	0.030 1	0.128 1	0.139 1	0.080 1	0.459 1	0.057 1
Re-implementation of Kaiming He, Georgia Gkioxari, Piotr Dollár, Ross Girshick: Mask R-CNN. ICCV'17

This table lists the benchmark results for the scene type classification scenario.

Method	avg recall	apartment	bathroom	bedroom / hotel	bookstore / library	conference room	copy/mail room	hallway	kitchen	laundry room	living room / lounge	misc	office	storage / basement / garage

SSCN	0.534 1	0.500 1	0.938 1	0.824 2	1.000 1	0.500 1	0.000 2	1.000 1	0.857 1	0.000 2	0.444 3	0.000 2	0.875 1	0.000 1

SE-ResNeXt-SSMA	0.498 2	0.000 3	0.812 2	0.941 1	0.500 2	0.500 1	0.500 1	0.500 2	0.429 3	0.500 1	0.667 1	0.500 1	0.625 2	0.000 1
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. arXiv
resnet50_scannet	0.353 3	0.250 2	0.812 2	0.529 3	0.500 2	0.500 1	0.000 2	0.500 2	0.571 2	0.000 2	0.556 2	0.000 2	0.375 3	0.000 1

3D Semantic label benchmark

3D Semantic instance benchmark

2D Semantic label benchmark

2D Semantic instance benchmark

Scene type classification benchmark