Benchmark Results - ScanNet Benchmark

This table lists the benchmark results for the 3D semantic label scenario.

Method	avg iou	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	floor	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	wall	window

Virtual MVFusion	0.746 3	0.771 24	0.819 3	0.848 2	0.702 8	0.865 3	0.397 42	0.899 1	0.699 1	0.664 2	0.948 20	0.588 2	0.330 4	0.746 5	0.851 7	0.764 3	0.796 7	0.704 1	0.935 4	0.866 2	0.728 1
Abhijit Kundu, Xiaoqi Yin, Alireza Fathi, David Ross, Brian Brewington, Thomas Funkhouser, Caroline Pantofaru: Virtual Multi-view Fusion for 3D Semantic Segmentation. ECCV 2020
MinkowskiNet	0.736 5	0.859 7	0.818 4	0.832 5	0.709 7	0.840 5	0.521 4	0.853 4	0.660 4	0.643 5	0.951 10	0.544 5	0.286 15	0.731 6	0.893 2	0.675 16	0.772 13	0.683 4	0.874 25	0.852 6	0.727 2
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019
OccuSeg+Semantic	0.764 1	0.758 28	0.796 7	0.839 4	0.746 2	0.907 1	0.562 1	0.850 5	0.680 2	0.672 1	0.978 1	0.610 1	0.335 3	0.777 1	0.819 13	0.847 1	0.830 1	0.691 3	0.972 1	0.885 1	0.727 2

BPNet	0.749 2	0.909 1	0.818 4	0.811 8	0.752 1	0.839 6	0.485 12	0.842 7	0.673 3	0.644 4	0.957 3	0.528 7	0.305 9	0.773 2	0.859 4	0.788 2	0.818 3	0.693 2	0.916 6	0.856 5	0.723 4
Wenbo Hu, Hengshuang Zhao, Li Jiang, Jiaya Jia, Tien-Tsin Wong: Bidirectional Projection Network for Cross Dimension Scene Understanding. CVPR 2021
VMNet	0.746 3	0.870 5	0.838 1	0.858 1	0.729 4	0.850 4	0.501 7	0.874 2	0.587 19	0.658 3	0.956 4	0.564 4	0.299 10	0.765 3	0.900 1	0.716 7	0.812 4	0.631 10	0.939 2	0.858 4	0.709 5

PointASNL	0.666 17	0.703 40	0.781 11	0.751 23	0.655 13	0.830 10	0.471 15	0.769 15	0.474 47	0.537 20	0.951 10	0.475 17	0.279 17	0.635 12	0.698 32	0.675 16	0.751 18	0.553 35	0.816 45	0.806 19	0.703 6
Xu Yan, Chaoda Zheng, Zhen Li, Sheng Wang, Shuguang Cui: PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Sampling. CVPR 2020
MatchingNet	0.724 7	0.812 16	0.812 6	0.810 9	0.735 3	0.834 8	0.495 10	0.860 3	0.572 24	0.602 10	0.954 6	0.512 9	0.280 16	0.757 4	0.845 10	0.725 5	0.780 10	0.606 18	0.937 3	0.851 7	0.700 7

SparseConvNet	0.725 6	0.647 46	0.821 2	0.846 3	0.721 5	0.869 2	0.533 2	0.754 18	0.603 16	0.614 6	0.955 5	0.572 3	0.325 5	0.710 7	0.870 3	0.724 6	0.823 2	0.628 11	0.934 5	0.865 3	0.683 8

One Thing One Click	0.701 9	0.825 14	0.796 7	0.723 24	0.716 6	0.832 9	0.433 32	0.816 8	0.634 8	0.609 8	0.969 2	0.418 40	0.344 2	0.559 31	0.833 11	0.715 8	0.808 5	0.560 30	0.902 9	0.847 8	0.680 9

PointContrast_LA_SEM	0.683 14	0.757 29	0.784 10	0.786 13	0.639 17	0.824 15	0.408 36	0.775 13	0.604 15	0.541 19	0.934 46	0.532 6	0.269 20	0.552 32	0.777 18	0.645 28	0.793 8	0.640 8	0.913 7	0.824 11	0.671 10

VACNN++	0.664 19	0.891 2	0.724 29	0.680 36	0.636 18	0.814 20	0.438 31	0.629 46	0.553 32	0.537 20	0.950 14	0.499 11	0.247 26	0.626 15	0.786 17	0.666 19	0.700 32	0.566 28	0.860 35	0.816 15	0.665 11

FusionNet	0.688 12	0.704 39	0.741 23	0.754 21	0.656 12	0.829 11	0.501 7	0.741 23	0.609 13	0.548 17	0.950 14	0.522 8	0.371 1	0.633 14	0.756 20	0.715 8	0.771 14	0.623 12	0.861 34	0.814 16	0.658 12
Feihu Zhang, Jin Fang, Benjamin Wah, Philip Torr: Deep FusionNet for Point Cloud Semantic Segmentation. ECCV 2020
CU-Hybrid Net	0.693 11	0.596 51	0.789 9	0.803 11	0.677 9	0.800 28	0.469 16	0.846 6	0.554 31	0.591 12	0.948 20	0.500 10	0.316 7	0.609 18	0.847 9	0.732 4	0.808 5	0.593 21	0.894 14	0.839 9	0.652 13

JSENet	0.699 10	0.881 4	0.762 15	0.821 6	0.667 11	0.800 28	0.522 3	0.792 11	0.613 11	0.607 9	0.935 42	0.492 13	0.205 36	0.576 27	0.853 6	0.691 12	0.758 16	0.652 6	0.872 28	0.828 10	0.649 14
Zeyu HU, Mingmin Zhen, Xuyang BAI, Hongbo Fu, Chiew-lan Tai: JSENet: Joint Semantic Segmentation and Edge Detection Network for 3D Point Clouds. ECCV 2020
PointConv	0.666 17	0.781 19	0.759 17	0.699 29	0.644 16	0.822 16	0.475 13	0.779 12	0.564 27	0.504 32	0.953 7	0.428 35	0.203 38	0.586 24	0.754 21	0.661 21	0.753 17	0.588 22	0.902 9	0.813 18	0.642 15
Wenxuan Wu, Zhongang Qi, Li Fuxin: PointConv: Deep Convolutional Networks on 3D Point Clouds. CVPR 2019
SAFNet-seg	0.654 22	0.752 30	0.734 25	0.664 43	0.583 30	0.815 19	0.399 41	0.754 18	0.639 7	0.535 22	0.942 33	0.470 19	0.309 8	0.665 8	0.539 40	0.650 23	0.708 28	0.635 9	0.857 37	0.793 28	0.642 15

DCM-Net	0.658 20	0.778 20	0.702 35	0.806 10	0.619 21	0.813 23	0.468 17	0.693 34	0.494 43	0.524 26	0.941 35	0.449 28	0.298 11	0.510 38	0.821 12	0.675 16	0.727 24	0.568 26	0.826 42	0.803 21	0.637 17
Jonas Schult, Francis Engelmann, Theodora Kontogianni, Bastian Leibe: DualConvMesh-Net: Joint Geodesic and Euclidean Convolutions on 3D Meshes. CVPR 2020 [Oral]
KP-FCNN	0.684 13	0.847 9	0.758 18	0.784 14	0.647 15	0.814 20	0.473 14	0.772 14	0.605 14	0.594 11	0.935 42	0.450 27	0.181 44	0.587 22	0.805 15	0.690 13	0.785 9	0.614 14	0.882 20	0.819 14	0.632 18
H. Thomas, C. Qi, J. Deschaud, B. Marcotegui, F. Goulette, L. Guibas.: KPConv: Flexible and Deformable Convolution for Point Clouds. ICCV 2019
FusionAwareConv	0.630 37	0.604 50	0.741 23	0.766 18	0.590 27	0.747 46	0.501 7	0.734 25	0.503 41	0.527 24	0.919 53	0.454 25	0.323 6	0.550 34	0.420 50	0.678 15	0.688 37	0.544 38	0.896 13	0.795 25	0.627 19
Jiazhao Zhang, Chenyang Zhu, Lintao Zheng, Kai Xu: Fusion-Aware Point Convolution for Online Semantic 3D Scene Segmentation. CVPR 2020
RandLA-Net	0.645 23	0.778 20	0.731 26	0.699 29	0.577 32	0.829 11	0.446 24	0.736 24	0.477 46	0.523 28	0.945 27	0.454 25	0.269 20	0.484 45	0.749 24	0.618 35	0.738 21	0.599 19	0.827 41	0.792 30	0.621 20

MCCNN	0.633 32	0.866 6	0.731 26	0.771 15	0.576 33	0.809 24	0.410 35	0.684 35	0.497 42	0.491 35	0.949 17	0.466 21	0.105 58	0.581 25	0.646 35	0.620 33	0.680 39	0.542 40	0.817 44	0.795 25	0.618 21
P. Hermosilla, T. Ritschel, P.P. Vazquez, A. Vinacua, T. Ropinski: Monte Carlo Convolution for Learning on Non-Uniformly Sampled Point Clouds. SIGGRAPH Asia 2018
Supervoxel-CNN	0.635 30	0.656 44	0.711 31	0.719 26	0.613 22	0.757 44	0.444 28	0.765 16	0.534 35	0.566 14	0.928 47	0.478 16	0.272 18	0.636 11	0.531 42	0.664 20	0.645 46	0.508 46	0.864 33	0.792 30	0.611 22

RFCR	0.702 8	0.889 3	0.745 20	0.813 7	0.672 10	0.818 18	0.493 11	0.815 9	0.623 10	0.610 7	0.947 23	0.470 19	0.249 25	0.594 21	0.848 8	0.705 11	0.779 11	0.646 7	0.892 16	0.823 12	0.611 22

LAP-D	0.594 43	0.720 36	0.692 41	0.637 48	0.456 51	0.773 39	0.391 46	0.730 26	0.587 19	0.445 46	0.940 37	0.381 46	0.288 13	0.434 49	0.453 47	0.591 42	0.649 44	0.581 23	0.777 49	0.749 49	0.610 24

MVPNet	0.641 24	0.831 11	0.715 30	0.671 40	0.590 27	0.781 37	0.394 43	0.679 37	0.642 6	0.553 16	0.937 39	0.462 22	0.256 22	0.649 9	0.406 51	0.626 32	0.691 36	0.666 5	0.877 21	0.792 30	0.608 25
Maximilian Jaritz, Jiayuan Gu, Hao Su: Multi-view PointNet for 3D Scene Understanding. GMDL Workshop, ICCV 2019
ROSMRF3D	0.673 15	0.789 17	0.748 19	0.763 19	0.635 19	0.814 20	0.407 39	0.747 20	0.581 22	0.573 13	0.950 14	0.484 14	0.271 19	0.607 19	0.754 21	0.649 24	0.774 12	0.596 20	0.883 19	0.823 12	0.606 26

HPEIN	0.618 40	0.729 35	0.668 47	0.647 46	0.597 25	0.766 41	0.414 34	0.680 36	0.520 38	0.525 25	0.946 25	0.432 32	0.215 33	0.493 44	0.599 38	0.638 29	0.617 51	0.570 25	0.897 12	0.806 19	0.605 27
Li Jiang, Hengshuang Zhao, Shu Liu, Xiaoyong Shen, Chi-Wing Fu, Jiaya Jia: Hierarchical Point-Edge Interaction Network for Point Cloud Semantic Segmentation. ICCV 2019
CCRFNet	0.589 45	0.766 26	0.659 51	0.683 34	0.470 50	0.740 48	0.387 47	0.620 47	0.490 44	0.476 40	0.922 51	0.355 51	0.245 27	0.511 37	0.511 43	0.571 46	0.643 47	0.493 49	0.872 28	0.762 45	0.600 28

joint point-based	0.634 31	0.614 49	0.778 12	0.667 42	0.633 20	0.825 14	0.420 33	0.804 10	0.467 49	0.561 15	0.951 10	0.494 12	0.291 12	0.566 30	0.458 46	0.579 45	0.764 15	0.559 32	0.838 40	0.814 16	0.598 29
Hung-Yueh Chiang, Yen-Liang Lin, Yueh-Cheng Liu, Winston H. Hsu: A Unified Point-Based Framework for 3D Segmentation. 3DV 2019
HPGCNN	0.656 21	0.698 41	0.743 22	0.650 44	0.564 37	0.820 17	0.505 6	0.758 17	0.631 9	0.479 39	0.945 27	0.480 15	0.226 29	0.572 28	0.774 19	0.690 13	0.735 23	0.614 14	0.853 38	0.776 40	0.597 30
Jisheng Dang, Qingyong Hu, Yulan Guo, Jun Yang: HPGCNN.
SConv	0.636 29	0.830 12	0.697 39	0.752 22	0.572 36	0.780 38	0.445 26	0.716 29	0.529 36	0.530 23	0.951 10	0.446 29	0.170 45	0.507 40	0.666 34	0.636 30	0.682 38	0.541 41	0.886 18	0.799 22	0.594 31

DPC	0.592 44	0.720 36	0.700 37	0.602 51	0.480 48	0.762 43	0.380 48	0.713 31	0.585 21	0.437 47	0.940 37	0.369 48	0.288 13	0.434 49	0.509 44	0.590 44	0.639 49	0.567 27	0.772 50	0.755 47	0.592 32
Francis Engelmann, Theodora Kontogianni, Bastian Leibe: Dilated Point Convolutions: On the Receptive Field Size of Point Convolutions on 3D Point Clouds. ICRA 2020
APCF-Net	0.631 34	0.742 31	0.687 46	0.672 38	0.557 40	0.792 33	0.408 36	0.665 41	0.545 33	0.508 30	0.952 9	0.428 35	0.186 42	0.634 13	0.702 30	0.620 33	0.706 29	0.555 34	0.873 27	0.798 24	0.581 33
Haojia, Lin: Adaptive Pyramid Context Fusion for Point Cloud Perception. GRSL
PointMTL	0.632 33	0.731 34	0.688 44	0.675 37	0.591 26	0.784 36	0.444 28	0.565 50	0.610 12	0.492 34	0.949 17	0.456 24	0.254 23	0.587 22	0.706 29	0.599 39	0.665 43	0.612 17	0.868 32	0.791 33	0.579 34

PointMRNet	0.640 26	0.717 38	0.701 36	0.692 32	0.576 33	0.801 26	0.467 18	0.716 29	0.563 28	0.459 43	0.953 7	0.429 34	0.169 46	0.581 25	0.854 5	0.605 36	0.710 26	0.550 36	0.894 14	0.793 28	0.575 35

SIConv	0.625 38	0.830 12	0.694 40	0.757 20	0.563 38	0.772 40	0.448 22	0.647 44	0.520 38	0.509 29	0.949 17	0.431 33	0.191 41	0.496 43	0.614 37	0.647 27	0.672 41	0.535 43	0.876 22	0.783 36	0.571 36

SALANet	0.670 16	0.816 15	0.770 14	0.768 17	0.652 14	0.807 25	0.451 20	0.747 20	0.659 5	0.545 18	0.924 49	0.473 18	0.149 54	0.571 29	0.811 14	0.635 31	0.746 19	0.623 12	0.892 16	0.794 27	0.570 37

TextureNet	0.566 48	0.672 43	0.664 49	0.671 40	0.494 46	0.719 49	0.445 26	0.678 38	0.411 55	0.396 50	0.935 42	0.356 50	0.225 30	0.412 51	0.535 41	0.565 47	0.636 50	0.464 52	0.794 48	0.680 55	0.568 38
Jingwei Huang, Haotian Zhang, Li Yi, Thomas Funkerhouser, Matthias Niessner, Leonidas Guibas: TextureNet: Consistent Local Parametrizations for Learning from High-Resolution Signals on Meshes. CVPR
FPConv	0.639 27	0.785 18	0.760 16	0.713 28	0.603 24	0.798 30	0.392 44	0.534 52	0.603 16	0.524 26	0.948 20	0.457 23	0.250 24	0.538 35	0.723 26	0.598 40	0.696 35	0.614 14	0.872 28	0.799 22	0.567 39
Yiqun Lin, Zizheng Yan, Haibin Huang, Dong Du, Ligang Liu, Shuguang Cui, Xiaoguang Han: FPConv: Learning Local Flattening for Point Convolution. CVPR 2020
PointSPNet	0.637 28	0.734 33	0.692 41	0.714 27	0.576 33	0.797 31	0.446 24	0.743 22	0.598 18	0.437 47	0.942 33	0.403 42	0.150 53	0.626 15	0.800 16	0.649 24	0.697 34	0.557 33	0.846 39	0.777 39	0.563 40

PanopticFusion-label	0.529 51	0.491 58	0.688 44	0.604 50	0.386 54	0.632 58	0.225 62	0.705 33	0.434 53	0.293 57	0.815 61	0.348 52	0.241 28	0.499 42	0.669 33	0.507 50	0.649 44	0.442 56	0.796 47	0.602 61	0.561 41
Gaku Narita, Takashi Seno, Tomoya Ishikawa, Yohsuke Kaji: PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Things. IROS 2019 (to appear)
PointConv-SFPN	0.641 24	0.776 22	0.703 34	0.721 25	0.557 40	0.826 13	0.451 20	0.672 39	0.563 28	0.483 38	0.943 32	0.425 38	0.162 48	0.644 10	0.726 25	0.659 22	0.709 27	0.572 24	0.875 23	0.786 34	0.559 42

PointNet2-SFPN	0.631 34	0.771 24	0.692 41	0.672 38	0.524 43	0.837 7	0.440 30	0.706 32	0.538 34	0.446 45	0.944 29	0.421 39	0.219 32	0.552 32	0.751 23	0.591 42	0.737 22	0.543 39	0.901 11	0.768 43	0.557 43

PointMRNet-lite	0.625 38	0.643 47	0.711 31	0.697 31	0.581 31	0.801 26	0.408 36	0.670 40	0.558 30	0.497 33	0.944 29	0.436 30	0.152 52	0.617 17	0.708 28	0.603 37	0.743 20	0.532 44	0.870 31	0.784 35	0.545 44

3DMV	0.484 54	0.484 59	0.538 60	0.643 47	0.424 52	0.606 61	0.310 52	0.574 49	0.433 54	0.378 52	0.796 62	0.301 54	0.214 34	0.537 36	0.208 60	0.472 55	0.507 61	0.413 59	0.693 56	0.602 61	0.539 45
Angela Dai, Matthias Niessner: 3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation. ECCV'18
SPH3D-GCN	0.610 41	0.858 8	0.772 13	0.489 57	0.532 42	0.792 33	0.404 40	0.643 45	0.570 25	0.507 31	0.935 42	0.414 41	0.046 63	0.510 38	0.702 30	0.602 38	0.705 30	0.549 37	0.859 36	0.773 41	0.534 46
Huan Lei, Naveed Akhtar, and Ajmal Mian: Spherical Kernel for Efficient Graph Convolution on 3D Point Clouds. TPAMI 2020
DVVNet	0.562 49	0.648 45	0.700 37	0.770 16	0.586 29	0.687 53	0.333 51	0.650 42	0.514 40	0.475 41	0.906 57	0.359 49	0.223 31	0.340 54	0.442 49	0.422 57	0.668 42	0.501 47	0.708 55	0.779 37	0.534 46

ROSMRF	0.580 47	0.772 23	0.707 33	0.681 35	0.563 38	0.764 42	0.362 49	0.515 53	0.465 50	0.465 42	0.936 40	0.427 37	0.207 35	0.438 47	0.577 39	0.536 49	0.675 40	0.486 50	0.723 54	0.779 37	0.524 48

Pointnet++ & Feature	0.557 50	0.735 32	0.661 50	0.686 33	0.491 47	0.744 47	0.392 44	0.539 51	0.451 51	0.375 53	0.946 25	0.376 47	0.205 36	0.403 52	0.356 53	0.553 48	0.643 47	0.497 48	0.824 43	0.756 46	0.515 49

PCNN	0.498 53	0.559 54	0.644 54	0.560 54	0.420 53	0.711 51	0.229 60	0.414 55	0.436 52	0.352 54	0.941 35	0.324 53	0.155 50	0.238 59	0.387 52	0.493 51	0.529 58	0.509 45	0.813 46	0.751 48	0.504 50

SegGCN	0.589 45	0.833 10	0.731 26	0.539 55	0.514 45	0.789 35	0.448 22	0.467 54	0.573 23	0.484 37	0.936 40	0.396 44	0.061 62	0.501 41	0.507 45	0.594 41	0.700 32	0.563 29	0.874 25	0.771 42	0.493 51
Huan Lei, Naveed Akhtar, and Ajmal Mian: SegGCN: Efficient 3D Point Cloud Segmentation with Fuzzy Spherical Kernel. CVPR 2020
3DSM_DMMF	0.631 34	0.626 48	0.745 20	0.801 12	0.607 23	0.751 45	0.506 5	0.729 27	0.565 26	0.491 35	0.866 60	0.434 31	0.197 40	0.595 20	0.630 36	0.709 10	0.705 30	0.560 30	0.875 23	0.740 50	0.491 52

AttAN	0.609 42	0.760 27	0.667 48	0.649 45	0.521 44	0.793 32	0.457 19	0.648 43	0.528 37	0.434 49	0.947 23	0.401 43	0.153 51	0.454 46	0.721 27	0.648 26	0.717 25	0.536 42	0.904 8	0.765 44	0.485 53
Gege Zhang, Qinghua Ma, Licheng Jiao, Fang Liu and Qigong Sun: AttAN: Attention Adversarial Networks for 3D Point Cloud Semantic Segmentation. IJCAI2020
3DMV, FTSDF	0.501 52	0.558 55	0.608 57	0.424 62	0.478 49	0.690 52	0.246 58	0.586 48	0.468 48	0.450 44	0.911 55	0.394 45	0.160 49	0.438 47	0.212 59	0.432 56	0.541 57	0.475 51	0.742 52	0.727 51	0.477 54

PointCNN with RGB	0.458 55	0.577 53	0.611 56	0.356 64	0.321 60	0.715 50	0.299 54	0.376 58	0.328 61	0.319 55	0.944 29	0.285 56	0.164 47	0.216 62	0.229 58	0.484 53	0.545 56	0.456 54	0.755 51	0.709 52	0.475 55
Yangyan Li, Rui Bu, Mingchao Sun, Baoquan Chen: PointCNN. NeurIPS 2018
PNET2	0.442 57	0.548 56	0.548 59	0.597 52	0.363 57	0.628 59	0.300 53	0.292 59	0.374 58	0.307 56	0.881 59	0.268 57	0.186 42	0.238 59	0.204 61	0.407 58	0.506 62	0.449 55	0.667 57	0.620 59	0.462 56

SurfaceConvPF	0.442 57	0.505 57	0.622 55	0.380 63	0.342 59	0.654 56	0.227 61	0.397 57	0.367 59	0.276 59	0.924 49	0.240 60	0.198 39	0.359 53	0.262 56	0.366 59	0.581 53	0.435 57	0.640 58	0.668 56	0.398 57
Hao Pan, Shilin Liu, Yang Liu, Xin Tong: Convolutional Neural Networks on 3D Surfaces Using Parallel Frames.
ScanNet+FTSDF	0.383 62	0.297 64	0.491 62	0.432 61	0.358 58	0.612 60	0.274 56	0.116 63	0.411 55	0.265 60	0.904 58	0.229 61	0.079 60	0.250 57	0.185 62	0.320 62	0.510 59	0.385 60	0.548 61	0.597 63	0.394 58

Tangent Convolutions	0.438 59	0.437 62	0.646 53	0.474 59	0.369 56	0.645 57	0.353 50	0.258 61	0.282 63	0.279 58	0.918 54	0.298 55	0.147 55	0.283 56	0.294 55	0.487 52	0.562 54	0.427 58	0.619 59	0.633 58	0.352 59
Maxim Tatarchenko, Jaesik Park, Vladlen Koltun, Qian-Yi Zhou: Tangent convolutions for dense prediction in 3d. CVPR 2018
subcloud_weak	0.411 60	0.479 60	0.650 52	0.475 58	0.285 63	0.519 64	0.087 65	0.725 28	0.396 57	0.386 51	0.621 65	0.250 59	0.117 56	0.338 55	0.443 48	0.188 65	0.594 52	0.369 62	0.377 65	0.616 60	0.306 60

SSC-UNet	0.308 64	0.353 63	0.290 65	0.278 65	0.166 65	0.553 62	0.169 64	0.286 60	0.147 65	0.148 65	0.908 56	0.182 64	0.064 61	0.023 65	0.018 66	0.354 61	0.363 63	0.345 63	0.546 63	0.685 54	0.278 61

SPLAT Net	0.393 61	0.472 61	0.511 61	0.606 49	0.311 61	0.656 55	0.245 59	0.405 56	0.328 61	0.197 63	0.927 48	0.227 62	0.000 66	0.001 66	0.249 57	0.271 64	0.510 59	0.383 61	0.593 60	0.699 53	0.267 62
Hang Su, Varun Jampani, Deqing Sun, Subhransu Maji, Evangelos Kalogerakis, Ming-Hsuan Yang, Jan Kautz: SPLATNet: Sparse Lattice Networks for Point Cloud Processing. CVPR 2018
PointNet++	0.339 63	0.584 52	0.478 63	0.458 60	0.256 64	0.360 65	0.250 57	0.247 62	0.278 64	0.261 61	0.677 64	0.183 63	0.117 56	0.212 63	0.145 64	0.364 60	0.346 65	0.232 65	0.548 61	0.523 64	0.252 63
Charles R. Qi, Li Yi, Hao Su, Leonidas J. Guibas: pointnet++: deep hierarchical feature learning on point sets in a metric space.
FCPN	0.447 56	0.679 42	0.604 58	0.578 53	0.380 55	0.682 54	0.291 55	0.106 64	0.483 45	0.258 62	0.920 52	0.258 58	0.025 64	0.231 61	0.325 54	0.480 54	0.560 55	0.463 53	0.725 53	0.666 57	0.231 64
Dario Rethage, Johanna Wald, Jürgen Sturm, Nassir Navab, Federico Tombari: Fully-Convolutional Point Networks for Large-Scale Point Clouds. ECCV 2018
ScanNet	0.306 65	0.203 65	0.366 64	0.501 56	0.311 61	0.524 63	0.211 63	0.002 66	0.342 60	0.189 64	0.786 63	0.145 65	0.102 59	0.245 58	0.152 63	0.318 63	0.348 64	0.300 64	0.460 64	0.437 65	0.182 65
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner: ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes. CVPR'17
ERROR	0.054 66	0.000 66	0.041 66	0.172 66	0.030 66	0.062 66	0.001 66	0.035 65	0.004 66	0.051 66	0.143 66	0.019 66	0.003 65	0.041 64	0.050 65	0.003 66	0.054 66	0.018 66	0.005 66	0.264 66	0.082 66

This table lists the benchmark results for the 3D semantic instance scenario.

Method	avg ap 50%	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	window

Mask-Group	0.664 4	1.000 1	0.822 5	0.764 8	0.616 2	0.815 4	0.139 7	0.694 8	0.597 2	0.459 6	0.566 5	0.599 2	0.600 7	0.516 23	0.715 3	0.819 2	0.635 6	1.000 1	0.603 1

Dyco3D	0.641 8	1.000 1	0.841 3	0.893 1	0.531 7	0.802 9	0.115 11	0.588 14	0.448 7	0.438 9	0.537 8	0.430 10	0.550 14	0.857 12	0.534 10	0.764 6	0.657 3	0.987 14	0.568 2

HAIS	0.699 1	1.000 1	0.849 2	0.820 3	0.675 1	0.808 7	0.279 3	0.757 5	0.465 6	0.517 3	0.596 1	0.559 3	0.600 7	1.000 1	0.654 5	0.767 4	0.676 2	0.994 13	0.560 3

PointGroup	0.636 10	1.000 1	0.765 11	0.624 11	0.505 11	0.797 10	0.116 10	0.696 7	0.384 11	0.441 8	0.559 6	0.476 6	0.596 10	1.000 1	0.666 4	0.756 8	0.556 15	0.997 10	0.513 4
Li Jiang, Hengshuang Zhao, Shaoshuai Shi, Shu Liu, Chi-Wing Fu, Jiaya Jia: PointGroup: Dual-Set Point Grouping for 3D Instance Segmentation. CVPR 2020 [oral]
SSTNet	0.698 2	1.000 1	0.697 19	0.888 2	0.556 4	0.803 8	0.387 2	0.626 9	0.417 9	0.556 2	0.585 3	0.702 1	0.600 7	1.000 1	0.824 1	0.720 11	0.692 1	1.000 1	0.509 5

PCJC	0.578 13	1.000 1	0.810 7	0.583 15	0.449 15	0.813 6	0.042 18	0.603 12	0.341 15	0.490 4	0.465 12	0.410 11	0.650 2	0.835 17	0.264 22	0.694 15	0.561 13	0.889 20	0.504 6

PE	0.645 6	1.000 1	0.773 10	0.798 5	0.538 6	0.786 13	0.088 14	0.799 3	0.350 14	0.435 12	0.547 7	0.545 4	0.646 6	0.933 10	0.562 9	0.761 7	0.556 16	0.997 10	0.501 7
Biao Zhang, Peter Wonka: Point Cloud Instance Segmentation using Probabilistic Embeddings. CVPR 2021
RPGN	0.643 7	1.000 1	0.758 13	0.582 16	0.539 5	0.826 3	0.046 17	0.765 4	0.372 12	0.436 11	0.588 2	0.539 5	0.650 2	1.000 1	0.577 7	0.750 9	0.653 5	0.997 10	0.495 8

GICN	0.638 9	1.000 1	0.895 1	0.800 4	0.480 12	0.676 15	0.144 5	0.737 6	0.354 13	0.447 7	0.400 18	0.365 13	0.700 1	1.000 1	0.569 8	0.836 1	0.599 9	1.000 1	0.473 9

OccuSeg+instance	0.672 3	1.000 1	0.758 14	0.682 10	0.576 3	0.842 1	0.477 1	0.504 19	0.524 3	0.567 1	0.585 4	0.451 7	0.557 13	1.000 1	0.751 2	0.797 3	0.563 12	1.000 1	0.467 10

SphereNet	0.606 12	1.000 1	0.776 9	0.745 9	0.436 16	0.834 2	0.035 19	0.587 16	0.518 4	0.338 20	0.534 9	0.352 15	0.594 12	1.000 1	0.391 18	0.696 14	0.624 8	1.000 1	0.451 11

3D-BoNet	0.488 18	1.000 1	0.672 20	0.590 13	0.301 20	0.484 25	0.098 12	0.620 10	0.306 16	0.341 19	0.259 22	0.125 22	0.434 19	0.796 18	0.402 16	0.499 25	0.513 18	0.909 19	0.439 12
Bo Yang, Jianan Wang, Ronald Clark, Qingyong Hu, Sen Wang, Andrew Markham, Niki Trigoni: Learning Object Bounding Boxes for 3D Instance Segmentation on Point Clouds. NeurIPS 2019 Spotlight
3D-MPA	0.611 11	1.000 1	0.833 4	0.765 7	0.526 8	0.756 14	0.136 9	0.588 14	0.470 5	0.438 10	0.432 16	0.358 14	0.650 2	0.857 12	0.429 14	0.765 5	0.557 14	1.000 1	0.430 13
Francis Engelmann, Martin Bokeloh, Alireza Fathi, Bastian Leibe, Matthias Nießner: 3D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentation. CVPR 2020
MTML	0.549 15	1.000 1	0.807 8	0.588 14	0.327 19	0.647 16	0.004 24	0.815 2	0.180 19	0.418 14	0.364 20	0.182 18	0.445 17	1.000 1	0.442 13	0.688 17	0.571 11	1.000 1	0.396 14
Jean Lahoud, Bernard Ghanem, Marc Pollefeys, Martin R. Oswald: 3D Instance Segmentation via Multi-task Metric Learning. ICCV 2019 [oral]
Occipital-SCS	0.512 17	1.000 1	0.716 16	0.509 17	0.506 10	0.611 18	0.092 13	0.602 13	0.177 20	0.346 18	0.383 19	0.165 20	0.442 18	0.850 16	0.386 19	0.618 20	0.543 17	0.889 20	0.389 15

CSC-Pretrained	0.648 5	1.000 1	0.810 6	0.768 6	0.523 9	0.813 5	0.143 6	0.819 1	0.389 10	0.422 13	0.511 10	0.443 8	0.650 2	1.000 1	0.624 6	0.732 10	0.634 7	1.000 1	0.375 16

PanopticFusion-inst	0.478 19	0.667 21	0.712 18	0.595 12	0.259 22	0.550 23	0.000 27	0.613 11	0.175 21	0.250 24	0.434 14	0.437 9	0.411 21	0.857 12	0.485 12	0.591 23	0.267 26	0.944 17	0.359 17
Gaku Narita, Takashi Seno, Tomoya Ishikawa, Yohsuke Kaji: PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Things. IROS 2019 (to appear)
SSEN	0.575 14	1.000 1	0.761 12	0.473 18	0.477 13	0.795 11	0.066 15	0.529 17	0.658 1	0.460 5	0.461 13	0.380 12	0.331 22	0.859 11	0.401 17	0.692 16	0.653 4	1.000 1	0.348 18
Dongsu Zhang, Junha Chun, Sang Kyun Cha, Young Min Kim: Spatial Semantic Embedding Network: Fast 3D Instance Segmentation with Deep Metric Learning. Arxiv
Sparse R-CNN	0.515 16	1.000 1	0.538 24	0.282 21	0.468 14	0.790 12	0.173 4	0.345 21	0.429 8	0.413 16	0.484 11	0.176 19	0.595 11	0.591 21	0.522 11	0.668 18	0.476 19	0.986 15	0.327 19

SALoss-ResNet	0.459 20	1.000 1	0.737 15	0.159 27	0.259 21	0.587 20	0.138 8	0.475 20	0.217 18	0.416 15	0.408 17	0.128 21	0.315 23	0.714 19	0.411 15	0.536 24	0.590 10	0.873 23	0.304 20
Zhidong Liang, Ming Yang, Hao Li, Chunxiang Wang: 3D Instance Embedding Learning With a Structure-Aware Loss Function for Point Cloud Segmentation. IEEE Robotics and Automation Letters (IROS2020)
MASC	0.447 21	0.528 26	0.555 22	0.381 19	0.382 17	0.633 17	0.002 25	0.509 18	0.260 17	0.361 17	0.432 15	0.327 16	0.451 16	0.571 22	0.367 20	0.639 19	0.386 20	0.980 16	0.276 21
Chen Liu, Yasutaka Furukawa: MASC: Multi-scale Affinity with Sparse Convolution for 3D Instance Segmentation.
R-PointNet	0.306 25	0.500 27	0.405 27	0.311 20	0.348 18	0.589 19	0.054 16	0.068 27	0.126 22	0.283 22	0.290 21	0.028 27	0.219 24	0.214 26	0.331 21	0.396 27	0.275 24	0.821 25	0.245 22

3D-SIS	0.382 22	1.000 1	0.432 26	0.245 23	0.190 23	0.577 21	0.013 22	0.263 22	0.033 26	0.320 21	0.240 23	0.075 24	0.422 20	0.857 12	0.117 25	0.699 12	0.271 25	0.883 22	0.235 23
Ji Hou, Angela Dai, Matthias Niessner: 3D-SIS: 3D Semantic Instance Segmentation of RGB-D Scans. CVPR 2019
Hier3D	0.323 23	0.667 21	0.542 23	0.264 22	0.157 25	0.550 22	0.000 27	0.205 25	0.009 27	0.270 23	0.218 24	0.075 24	0.500 15	0.688 20	0.007 29	0.698 13	0.301 23	0.459 27	0.200 24
Tan: HCFS3D: Hierarchical Coupled Feature Selection Network for 3D Semantic and Instance Segmentation.
3D-BEVIS	0.248 26	0.667 21	0.566 21	0.076 28	0.035 29	0.394 27	0.027 21	0.035 28	0.098 23	0.099 27	0.030 28	0.025 28	0.098 27	0.375 25	0.126 24	0.604 22	0.181 27	0.854 24	0.171 25
Cathrin Elich, Francis Engelmann, Jonas Schult, Theodora Kontogianni, Bastian Leibe: 3D-BEVIS: Birds-Eye-View Instance Segmentation.
Region	0.248 26	0.667 21	0.437 25	0.188 25	0.153 26	0.491 24	0.000 27	0.208 24	0.094 24	0.153 26	0.099 26	0.057 26	0.217 25	0.119 27	0.039 27	0.466 26	0.302 22	0.640 26	0.140 26

Sgpn_scannet	0.143 28	0.208 29	0.390 28	0.169 26	0.065 27	0.275 28	0.029 20	0.069 26	0.000 28	0.087 28	0.043 27	0.014 29	0.027 29	0.000 28	0.112 26	0.351 28	0.168 28	0.438 28	0.138 27

UNet-backbone	0.319 24	0.667 21	0.715 17	0.233 24	0.189 24	0.479 26	0.008 23	0.218 23	0.067 25	0.201 25	0.173 25	0.107 23	0.123 26	0.438 24	0.150 23	0.615 21	0.355 21	0.916 18	0.093 28

MaskRCNN 2d->3d Proj	0.058 29	0.333 28	0.002 29	0.000 29	0.053 28	0.002 29	0.002 26	0.021 29	0.000 28	0.045 29	0.024 29	0.238 17	0.065 28	0.000 28	0.014 28	0.107 29	0.020 29	0.110 29	0.006 29

Method	avg iou	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	floor	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	wall	window

Virtual MVFusion (R)	0.745 1	0.861 1	0.839 1	0.881 1	0.672 1	0.512 1	0.422 10	0.898 1	0.723 1	0.714 1	0.954 2	0.454 1	0.509 1	0.773 1	0.895 1	0.756 1	0.820 1	0.653 1	0.935 1	0.891 1	0.728 1
Abhijit Kundu, Xiaoqi Yin, Alireza Fathi, David Ross, Brian Brewington, Thomas Funkhouser, Caroline Pantofaru: Virtual Multi-view Fusion for 3D Semantic Segmentation. ECCV 2020
BPNet_2D	0.670 2	0.822 3	0.795 3	0.836 2	0.659 2	0.481 2	0.451 6	0.769 2	0.656 3	0.567 3	0.931 3	0.395 3	0.390 4	0.700 2	0.534 3	0.689 5	0.770 2	0.574 3	0.865 3	0.831 3	0.675 2
Wenbo Hu, Hengshuang Zhao, Li Jiang, Jiaya Jia and Tien-Tsin Wong: Bidirectional Projection Network for Cross Dimension Scene Understanding. CVPR 2021
CU-Hybrid-2D Net	0.636 3	0.825 2	0.820 2	0.179 16	0.648 3	0.463 3	0.549 1	0.742 3	0.676 2	0.628 2	0.961 1	0.420 2	0.379 5	0.684 3	0.381 10	0.732 2	0.723 3	0.599 2	0.827 8	0.851 2	0.634 3

SN_RN152pyrx8_RVC	0.546 10	0.572 9	0.663 13	0.638 8	0.518 9	0.298 12	0.366 15	0.633 12	0.510 11	0.446 12	0.864 11	0.296 11	0.267 12	0.542 10	0.346 13	0.704 4	0.575 14	0.431 12	0.853 5	0.766 10	0.630 4

DCRedNet	0.583 8	0.682 5	0.723 8	0.542 10	0.510 11	0.310 11	0.451 6	0.668 8	0.549 8	0.520 6	0.920 5	0.375 4	0.446 2	0.528 11	0.417 9	0.670 9	0.577 13	0.478 8	0.862 4	0.806 5	0.628 5

RFBNet	0.592 7	0.616 7	0.758 4	0.659 6	0.581 7	0.330 9	0.469 5	0.655 10	0.543 9	0.524 5	0.924 4	0.355 7	0.336 8	0.572 8	0.479 8	0.671 8	0.648 6	0.480 7	0.814 10	0.814 4	0.614 6

SSMA	0.577 9	0.695 4	0.716 10	0.439 12	0.563 8	0.314 10	0.444 8	0.719 5	0.551 7	0.503 7	0.887 10	0.346 9	0.348 7	0.603 4	0.353 12	0.709 3	0.600 11	0.457 10	0.901 2	0.786 6	0.599 7
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. International Journal of Computer Vision, 2019
ILC-PSPNet	0.475 15	0.490 14	0.581 15	0.289 14	0.507 12	0.067 17	0.379 13	0.610 14	0.417 15	0.435 13	0.822 16	0.278 12	0.267 12	0.503 13	0.228 14	0.616 14	0.533 15	0.375 14	0.820 9	0.729 12	0.560 8

FuseNet	0.535 11	0.570 10	0.681 12	0.182 15	0.512 10	0.290 13	0.431 9	0.659 9	0.504 12	0.495 9	0.903 9	0.308 10	0.428 3	0.523 12	0.365 11	0.676 6	0.621 10	0.470 9	0.762 13	0.779 7	0.541 9
Caner Hazirbas, Lingni Ma, Csaba Domokos, Daniel Cremers: FuseNet: Incorporating Depth into Semantic Segmentation via Fusion-based CNN Architecture. ACCV 2016
MSeg1080_RVC	0.485 14	0.505 13	0.709 11	0.092 17	0.427 14	0.241 14	0.411 11	0.654 11	0.385 17	0.457 11	0.861 12	0.053 17	0.279 11	0.503 13	0.481 7	0.645 11	0.626 9	0.365 15	0.748 15	0.725 13	0.529 10
John Lambert, Zhuang Liu, Ozan Sener, James Hays, Vladlen Koltun: MSeg: A Composite Dataset for Multi-domain Semantic Segmentation. CVPR 2020
DMMF	0.597 5	0.543 11	0.755 6	0.749 4	0.585 6	0.338 6	0.494 4	0.704 6	0.598 4	0.494 10	0.911 6	0.347 8	0.327 9	0.593 7	0.527 4	0.675 7	0.646 8	0.513 4	0.842 6	0.774 8	0.527 11

MCA-Net	0.595 6	0.533 12	0.756 5	0.746 5	0.590 5	0.334 8	0.506 3	0.670 7	0.587 6	0.500 8	0.905 8	0.366 5	0.352 6	0.601 5	0.506 6	0.669 10	0.648 6	0.501 5	0.839 7	0.769 9	0.516 12

DMMF_3d	0.605 4	0.651 6	0.744 7	0.782 3	0.637 4	0.387 4	0.536 2	0.732 4	0.590 5	0.540 4	0.856 13	0.359 6	0.306 10	0.596 6	0.539 2	0.627 12	0.706 4	0.497 6	0.785 12	0.757 11	0.476 13

Enet (reimpl)	0.376 16	0.264 17	0.452 17	0.452 11	0.365 15	0.181 15	0.143 17	0.456 16	0.409 16	0.346 16	0.769 17	0.164 15	0.218 15	0.359 16	0.123 17	0.403 17	0.381 17	0.313 17	0.571 16	0.685 15	0.472 14
Re-implementation of Adam Paszke, Abhishek Chaurasia, Sangpil Kim, Eugenio Culurciello: ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation.
3DMV (2d proj)	0.498 13	0.481 15	0.612 14	0.579 9	0.456 13	0.343 5	0.384 12	0.623 13	0.525 10	0.381 14	0.845 14	0.254 13	0.264 14	0.557 9	0.182 15	0.581 15	0.598 12	0.429 13	0.760 14	0.661 16	0.446 15
Angela Dai, Matthias Niessner: 3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation. ECCV'18
AdapNet++	0.503 12	0.613 8	0.722 9	0.418 13	0.358 17	0.337 7	0.370 14	0.479 15	0.443 13	0.368 15	0.907 7	0.207 14	0.213 16	0.464 15	0.525 5	0.618 13	0.657 5	0.450 11	0.788 11	0.721 14	0.408 16
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. International Journal of Computer Vision, 2019
ScanNet (2d proj)	0.330 17	0.293 16	0.521 16	0.657 7	0.361 16	0.161 16	0.250 16	0.004 17	0.440 14	0.183 17	0.836 15	0.125 16	0.060 17	0.319 17	0.132 16	0.417 16	0.412 16	0.344 16	0.541 17	0.427 17	0.109 17
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner: ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes. CVPR'17

Method	avg ap	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	window

UniDet_RVC	0.205 1	0.381 1	0.323 1	0.037 1	0.226 1	0.177 1	0.063 1	0.277 1	0.120 1	0.067 1	0.131 1	0.074 2	0.317 1	0.080 1	0.235 1	0.289 1	0.141 1	0.678 1	0.080 1

MaskRCNN_ScanNet	0.119 2	0.129 2	0.212 2	0.002 2	0.112 2	0.148 2	0.014 2	0.205 2	0.044 2	0.066 2	0.078 2	0.095 1	0.142 2	0.030 2	0.128 2	0.139 2	0.080 2	0.459 2	0.057 2
Re-implementation of Kaiming He, Georgia Gkioxari, Piotr Dollár, Ross Girshick: Mask R-CNN. ICCV'17

Method	avg recall	apartment	bathroom	bedroom / hotel	bookstore / library	conference room	copy/mail room	hallway	kitchen	laundry room	living room / lounge	misc	office	storage / basement / garage

multi-task	0.700 1	0.500 1	1.000 1	0.882 2	0.500 1	1.000 1	1.000 1	0.500 1	1.000 1	1.000 1	0.778 1	0.000 2	0.938 1	0.000 1
Shengyu Huang, Mikhail Usvyatsov, Konrad Schindler: Indoor Scene Recognition in 3D. IROS 2020
SE-ResNeXt-SSMA	0.498 2	0.000 3	0.812 2	0.941 1	0.500 1	0.500 2	0.500 2	0.500 1	0.429 3	0.500 2	0.667 2	0.500 1	0.625 2	0.000 1
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. arXiv
resnet50_scannet	0.353 3	0.250 2	0.812 2	0.529 3	0.500 1	0.500 2	0.000 3	0.500 1	0.571 2	0.000 3	0.556 3	0.000 2	0.375 3	0.000 1

3D Semantic label benchmark

3D Semantic instance benchmark

2D Semantic label benchmark

2D Semantic instance benchmark

Scene type classification benchmark