Benchmark Results - ScanNet Benchmark

This table lists the benchmark results for the 3D semantic label scenario.

Method	avg iou	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	floor	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	wall	window

OccuSeg+Semantic	0.764 1	0.758 31	0.796 7	0.839 4	0.746 2	0.907 1	0.562 1	0.850 5	0.680 2	0.672 1	0.978 1	0.610 1	0.335 3	0.777 1	0.819 16	0.847 1	0.830 1	0.691 3	0.972 1	0.885 1	0.727 2

BPNet	0.749 2	0.909 1	0.818 4	0.811 8	0.752 1	0.839 6	0.485 14	0.842 7	0.673 3	0.644 4	0.957 3	0.528 8	0.305 9	0.773 2	0.859 4	0.788 2	0.818 3	0.693 2	0.916 6	0.856 5	0.723 4
Wenbo Hu, Hengshuang Zhao, Li Jiang, Jiaya Jia, Tien-Tsin Wong: Bidirectional Projection Network for Cross Dimension Scene Understanding. CVPR 2021 (Oral)
Virtual MVFusion	0.746 3	0.771 26	0.819 3	0.848 2	0.702 8	0.865 3	0.397 45	0.899 1	0.699 1	0.664 2	0.948 20	0.588 2	0.330 4	0.746 5	0.851 8	0.764 3	0.796 7	0.704 1	0.935 4	0.866 2	0.728 1
Abhijit Kundu, Xiaoqi Yin, Alireza Fathi, David Ross, Brian Brewington, Thomas Funkhouser, Caroline Pantofaru: Virtual Multi-view Fusion for 3D Semantic Segmentation. ECCV 2020
VMNet	0.746 3	0.870 6	0.838 1	0.858 1	0.729 4	0.850 4	0.501 8	0.874 2	0.587 21	0.658 3	0.956 4	0.564 4	0.299 10	0.765 3	0.900 1	0.716 8	0.812 4	0.631 11	0.939 2	0.858 4	0.709 5
Zeyu HU, Xuyang Bai, Jiaxiang Shang, Runze Zhang, Jiayu Dong, Xin Wang, Guangyuan Sun, Hongbo Fu, Chiew-Lan Tai: VMNet: Voxel-Mesh Network for Geodesic-Aware 3D Semantic Segmentation. ICCV 2021 (Oral)
MinkowskiNet	0.736 5	0.859 8	0.818 4	0.832 5	0.709 7	0.840 5	0.521 5	0.853 4	0.660 4	0.643 5	0.951 11	0.544 5	0.286 15	0.731 6	0.893 2	0.675 19	0.772 14	0.683 4	0.874 31	0.852 6	0.727 2
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019
SparseConvNet	0.725 6	0.647 50	0.821 2	0.846 3	0.721 5	0.869 2	0.533 3	0.754 23	0.603 18	0.614 6	0.955 5	0.572 3	0.325 5	0.710 7	0.870 3	0.724 7	0.823 2	0.628 12	0.934 5	0.865 3	0.683 8

MatchingNet	0.724 7	0.812 18	0.812 6	0.810 9	0.735 3	0.834 8	0.495 11	0.860 3	0.572 27	0.602 12	0.954 6	0.512 10	0.280 16	0.757 4	0.845 11	0.725 6	0.780 11	0.606 20	0.937 3	0.851 7	0.700 7

RFCR	0.702 8	0.889 3	0.745 23	0.813 7	0.672 12	0.818 19	0.493 12	0.815 10	0.623 10	0.610 8	0.947 24	0.470 20	0.249 28	0.594 20	0.848 9	0.705 13	0.779 12	0.646 7	0.892 18	0.823 15	0.611 24
Jingyu Gong, Jiachen Xu, Xin Tan, Haichuan Song, Yanyun Qu, Yuan Xie, Lizhuang Ma: Omni-Supervised Point Cloud Segmentation via Gradual Receptive Field Component Reasoning. CVPR2021
One Thing One Click	0.701 9	0.825 16	0.796 7	0.723 29	0.716 6	0.832 9	0.433 35	0.816 8	0.634 8	0.609 9	0.969 2	0.418 43	0.344 2	0.559 31	0.833 12	0.715 9	0.808 5	0.560 34	0.902 10	0.847 8	0.680 9

JSENet	0.699 10	0.881 5	0.762 15	0.821 6	0.667 13	0.800 31	0.522 4	0.792 15	0.613 11	0.607 10	0.935 46	0.492 14	0.205 39	0.576 26	0.853 6	0.691 14	0.758 19	0.652 6	0.872 34	0.828 12	0.649 15
Zeyu HU, Mingmin Zhen, Xuyang BAI, Hongbo Fu, Chiew-lan Tai: JSENet: Joint Semantic Segmentation and Edge Detection Network for 3D Point Clouds. ECCV 2020
Feature-Geometry Net	0.694 11	0.894 2	0.741 26	0.768 21	0.677 10	0.827 13	0.491 13	0.811 11	0.612 12	0.612 7	0.948 20	0.464 23	0.250 26	0.554 32	0.828 13	0.708 12	0.781 10	0.614 15	0.884 22	0.822 17	0.593 35
Kangcheng Liu, Ben M. Chen: https://arxiv.org/abs/2012.09439. arXiv Preprint
CU-Hybrid Net	0.693 12	0.596 56	0.789 9	0.803 11	0.677 10	0.800 31	0.469 18	0.846 6	0.554 35	0.591 15	0.948 20	0.500 12	0.316 7	0.609 17	0.847 10	0.732 4	0.808 5	0.593 25	0.894 16	0.839 9	0.652 14

Feature_GeometricNet	0.690 13	0.884 4	0.754 20	0.795 14	0.647 18	0.818 19	0.422 36	0.802 14	0.612 12	0.604 11	0.945 29	0.462 24	0.189 45	0.563 30	0.853 6	0.726 5	0.765 16	0.632 10	0.904 8	0.821 18	0.606 28
Kangcheng Liu, Ben M. Chen: https://arxiv.org/abs/2012.09439. arXiv Preprint
FusionNet	0.688 14	0.704 43	0.741 26	0.754 26	0.656 14	0.829 11	0.501 8	0.741 28	0.609 15	0.548 22	0.950 15	0.522 9	0.371 1	0.633 15	0.756 22	0.715 9	0.771 15	0.623 13	0.861 39	0.814 20	0.658 12
Feihu Zhang, Jin Fang, Benjamin Wah, Philip Torr: Deep FusionNet for Point Cloud Semantic Segmentation. ECCV 2020
VACNN++	0.684 15	0.728 39	0.757 19	0.776 18	0.690 9	0.804 29	0.464 22	0.816 8	0.577 25	0.587 16	0.945 29	0.508 11	0.276 18	0.671 8	0.710 30	0.663 24	0.750 22	0.589 26	0.881 26	0.832 11	0.653 13

KP-FCNN	0.684 15	0.847 11	0.758 18	0.784 16	0.647 18	0.814 22	0.473 16	0.772 18	0.605 16	0.594 14	0.935 46	0.450 31	0.181 48	0.587 21	0.805 18	0.690 15	0.785 9	0.614 15	0.882 24	0.819 19	0.632 19
H. Thomas, C. Qi, J. Deschaud, B. Marcotegui, F. Goulette, L. Guibas.: KPConv: Flexible and Deformable Convolution for Point Clouds. ICCV 2019
Superpoint Network	0.683 17	0.851 10	0.728 33	0.800 13	0.653 16	0.806 28	0.468 19	0.804 12	0.572 27	0.602 12	0.946 26	0.453 30	0.239 31	0.519 40	0.822 14	0.689 17	0.762 18	0.595 24	0.895 15	0.827 13	0.630 20

PointContrast_LA_SEM	0.683 17	0.757 32	0.784 10	0.786 15	0.639 21	0.824 16	0.408 40	0.775 17	0.604 17	0.541 24	0.934 50	0.532 6	0.269 21	0.552 33	0.777 20	0.645 32	0.793 8	0.640 8	0.913 7	0.824 14	0.671 10

VI-PointConv	0.676 19	0.770 28	0.754 20	0.783 17	0.621 24	0.814 22	0.552 2	0.758 21	0.571 29	0.557 20	0.954 6	0.529 7	0.268 23	0.530 38	0.682 35	0.675 19	0.719 28	0.603 21	0.888 20	0.833 10	0.665 11
Xingyi Li, Wenxuan Wu, Xiaoli Z. Fern, Li Fuxin: The Devils in the Point Clouds: Studying the Robustness of Point Cloud Convolutions.
ROSMRF3D	0.673 20	0.789 19	0.748 22	0.763 24	0.635 22	0.814 22	0.407 42	0.747 25	0.581 24	0.573 17	0.950 15	0.484 15	0.271 20	0.607 18	0.754 23	0.649 28	0.774 13	0.596 23	0.883 23	0.823 15	0.606 28

SALANet	0.670 21	0.816 17	0.770 14	0.768 21	0.652 17	0.807 27	0.451 24	0.747 25	0.659 5	0.545 23	0.924 53	0.473 19	0.149 59	0.571 28	0.811 17	0.635 35	0.746 23	0.623 13	0.892 18	0.794 31	0.570 41

PointConv	0.666 22	0.781 21	0.759 17	0.699 34	0.644 20	0.822 17	0.475 15	0.779 16	0.564 32	0.504 36	0.953 8	0.428 38	0.203 41	0.586 23	0.754 23	0.661 25	0.753 20	0.588 27	0.902 10	0.813 22	0.642 16
Wenxuan Wu, Zhongang Qi, Li Fuxin: PointConv: Deep Convolutional Networks on 3D Point Clouds. CVPR 2019
PointASNL	0.666 22	0.703 44	0.781 11	0.751 28	0.655 15	0.830 10	0.471 17	0.769 19	0.474 50	0.537 25	0.951 11	0.475 18	0.279 17	0.635 13	0.698 34	0.675 19	0.751 21	0.553 39	0.816 49	0.806 23	0.703 6
Xu Yan, Chaoda Zheng, Zhen Li, Sheng Wang, Shuguang Cui: PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Sampling. CVPR 2020
DCM-Net	0.658 24	0.778 22	0.702 38	0.806 10	0.619 25	0.813 25	0.468 19	0.693 40	0.494 46	0.524 30	0.941 38	0.449 32	0.298 11	0.510 42	0.821 15	0.675 19	0.727 27	0.568 31	0.826 46	0.803 25	0.637 18
Jonas Schult, Francis Engelmann, Theodora Kontogianni, Bastian Leibe: DualConvMesh-Net: Joint Geodesic and Euclidean Convolutions on 3D Meshes. CVPR 2020 [Oral]
HPGCNN	0.656 25	0.698 45	0.743 25	0.650 48	0.564 40	0.820 18	0.505 7	0.758 21	0.631 9	0.479 42	0.945 29	0.480 16	0.226 32	0.572 27	0.774 21	0.690 15	0.735 26	0.614 15	0.853 42	0.776 43	0.597 33
Jisheng Dang, Qingyong Hu, Yulan Guo, Jun Yang: HPGCNN.
SAFNet-seg	0.654 26	0.752 33	0.734 29	0.664 46	0.583 34	0.815 21	0.399 44	0.754 23	0.639 7	0.535 26	0.942 36	0.470 20	0.309 8	0.665 9	0.539 44	0.650 27	0.708 33	0.635 9	0.857 41	0.793 32	0.642 16
Linqing Zhao, Jiwen Lu, Jie Zhou: Similarity-Aware Fusion Network for 3D Semantic Segmentation. IROS 2021
RandLA-Net	0.645 27	0.778 22	0.731 30	0.699 34	0.577 35	0.829 11	0.446 28	0.736 29	0.477 49	0.523 32	0.945 29	0.454 28	0.269 21	0.484 49	0.749 26	0.618 39	0.738 24	0.599 22	0.827 45	0.792 34	0.621 22

MVPNet	0.641 28	0.831 13	0.715 34	0.671 43	0.590 31	0.781 41	0.394 46	0.679 43	0.642 6	0.553 21	0.937 43	0.462 24	0.256 24	0.649 10	0.406 56	0.626 36	0.691 40	0.666 5	0.877 27	0.792 34	0.608 27
Maximilian Jaritz, Jiayuan Gu, Hao Su: Multi-view PointNet for 3D Scene Understanding. GMDL Workshop, ICCV 2019
PointConv-SFPN	0.641 28	0.776 24	0.703 37	0.721 30	0.557 43	0.826 14	0.451 24	0.672 45	0.563 33	0.483 41	0.943 35	0.425 41	0.162 54	0.644 11	0.726 27	0.659 26	0.709 32	0.572 29	0.875 29	0.786 38	0.559 46

PointMRNet	0.640 30	0.717 42	0.701 39	0.692 36	0.576 36	0.801 30	0.467 21	0.716 34	0.563 33	0.459 46	0.953 8	0.429 37	0.169 51	0.581 24	0.854 5	0.605 40	0.710 31	0.550 40	0.894 16	0.793 32	0.575 39

FPConv	0.639 31	0.785 20	0.760 16	0.713 33	0.603 28	0.798 34	0.392 47	0.534 58	0.603 18	0.524 30	0.948 20	0.457 26	0.250 26	0.538 36	0.723 28	0.598 43	0.696 39	0.614 15	0.872 34	0.799 26	0.567 43
Yiqun Lin, Zizheng Yan, Haibin Huang, Dong Du, Ligang Liu, Shuguang Cui, Xiaoguang Han: FPConv: Learning Local Flattening for Point Convolution. CVPR 2020
PointSPNet	0.637 32	0.734 36	0.692 44	0.714 32	0.576 36	0.797 35	0.446 28	0.743 27	0.598 20	0.437 50	0.942 36	0.403 45	0.150 58	0.626 16	0.800 19	0.649 28	0.697 38	0.557 37	0.846 43	0.777 42	0.563 44

SConv	0.636 33	0.830 14	0.697 42	0.752 27	0.572 39	0.780 42	0.445 30	0.716 34	0.529 39	0.530 27	0.951 11	0.446 33	0.170 50	0.507 44	0.666 37	0.636 34	0.682 42	0.541 45	0.886 21	0.799 26	0.594 34

Supervoxel-CNN	0.635 34	0.656 48	0.711 35	0.719 31	0.613 26	0.757 48	0.444 32	0.765 20	0.534 38	0.566 18	0.928 51	0.478 17	0.272 19	0.636 12	0.531 46	0.664 23	0.645 50	0.508 49	0.864 38	0.792 34	0.611 24

joint point-based	0.634 35	0.614 53	0.778 12	0.667 45	0.633 23	0.825 15	0.420 37	0.804 12	0.467 52	0.561 19	0.951 11	0.494 13	0.291 12	0.566 29	0.458 50	0.579 48	0.764 17	0.559 36	0.838 44	0.814 20	0.598 32
Hung-Yueh Chiang, Yen-Liang Lin, Yueh-Cheng Liu, Winston H. Hsu: A Unified Point-Based Framework for 3D Segmentation. 3DV 2019
MCCNN	0.633 36	0.866 7	0.731 30	0.771 19	0.576 36	0.809 26	0.410 39	0.684 41	0.497 45	0.491 38	0.949 17	0.466 22	0.105 64	0.581 24	0.646 38	0.620 37	0.680 43	0.542 44	0.817 48	0.795 29	0.618 23
P. Hermosilla, T. Ritschel, P.P. Vazquez, A. Vinacua, T. Ropinski: Monte Carlo Convolution for Learning on Non-Uniformly Sampled Point Clouds. SIGGRAPH Asia 2018
PointMTL	0.632 37	0.731 37	0.688 47	0.675 40	0.591 30	0.784 40	0.444 32	0.565 56	0.610 14	0.492 37	0.949 17	0.456 27	0.254 25	0.587 21	0.706 31	0.599 42	0.665 47	0.612 19	0.868 37	0.791 37	0.579 38

APCF-Net	0.631 38	0.742 34	0.687 49	0.672 41	0.557 43	0.792 37	0.408 40	0.665 46	0.545 36	0.508 34	0.952 10	0.428 38	0.186 46	0.634 14	0.702 32	0.620 37	0.706 34	0.555 38	0.873 33	0.798 28	0.581 37
Haojia, Lin: Adaptive Pyramid Context Fusion for Point Cloud Perception. GRSL
PointNet2-SFPN	0.631 38	0.771 26	0.692 44	0.672 41	0.524 46	0.837 7	0.440 34	0.706 38	0.538 37	0.446 48	0.944 33	0.421 42	0.219 35	0.552 33	0.751 25	0.591 45	0.737 25	0.543 43	0.901 12	0.768 46	0.557 47

3DSM_DMMF	0.631 38	0.626 52	0.745 23	0.801 12	0.607 27	0.751 49	0.506 6	0.729 32	0.565 31	0.491 38	0.866 64	0.434 34	0.197 43	0.595 19	0.630 39	0.709 11	0.705 35	0.560 34	0.875 29	0.740 53	0.491 56

FusionAwareConv	0.630 41	0.604 55	0.741 26	0.766 23	0.590 31	0.747 50	0.501 8	0.734 30	0.503 44	0.527 28	0.919 57	0.454 28	0.323 6	0.550 35	0.420 55	0.678 18	0.688 41	0.544 42	0.896 14	0.795 29	0.627 21
Jiazhao Zhang, Chenyang Zhu, Lintao Zheng, Kai Xu: Fusion-Aware Point Convolution for Online Semantic 3D Scene Segmentation. CVPR 2020
SIConv	0.625 42	0.830 14	0.694 43	0.757 25	0.563 41	0.772 44	0.448 26	0.647 49	0.520 41	0.509 33	0.949 17	0.431 36	0.191 44	0.496 47	0.614 40	0.647 31	0.672 45	0.535 47	0.876 28	0.783 39	0.571 40

HPEIN	0.618 43	0.729 38	0.668 50	0.647 50	0.597 29	0.766 45	0.414 38	0.680 42	0.520 41	0.525 29	0.946 26	0.432 35	0.215 36	0.493 48	0.599 41	0.638 33	0.617 55	0.570 30	0.897 13	0.806 23	0.605 30
Li Jiang, Hengshuang Zhao, Shu Liu, Xiaoyong Shen, Chi-Wing Fu, Jiaya Jia: Hierarchical Point-Edge Interaction Network for Point Cloud Semantic Segmentation. ICCV 2019
SPH3D-GCN	0.610 44	0.858 9	0.772 13	0.489 63	0.532 45	0.792 37	0.404 43	0.643 50	0.570 30	0.507 35	0.935 46	0.414 44	0.046 69	0.510 42	0.702 32	0.602 41	0.705 35	0.549 41	0.859 40	0.773 44	0.534 49
Huan Lei, Naveed Akhtar, and Ajmal Mian: Spherical Kernel for Efficient Graph Convolution on 3D Point Clouds. TPAMI 2020
AttAN	0.609 45	0.760 30	0.667 51	0.649 49	0.521 47	0.793 36	0.457 23	0.648 48	0.528 40	0.434 52	0.947 24	0.401 46	0.153 57	0.454 50	0.721 29	0.648 30	0.717 29	0.536 46	0.904 8	0.765 47	0.485 57
Gege Zhang, Qinghua Ma, Licheng Jiao, Fang Liu and Qigong Sun: AttAN: Attention Adversarial Networks for 3D Point Cloud Semantic Segmentation. IJCAI2020
LAP-D	0.594 46	0.720 40	0.692 44	0.637 52	0.456 54	0.773 43	0.391 49	0.730 31	0.587 21	0.445 49	0.940 40	0.381 49	0.288 13	0.434 53	0.453 51	0.591 45	0.649 48	0.581 28	0.777 53	0.749 52	0.610 26

DPC	0.592 47	0.720 40	0.700 40	0.602 55	0.480 51	0.762 47	0.380 52	0.713 36	0.585 23	0.437 50	0.940 40	0.369 51	0.288 13	0.434 53	0.509 48	0.590 47	0.639 53	0.567 32	0.772 54	0.755 50	0.592 36
Francis Engelmann, Theodora Kontogianni, Bastian Leibe: Dilated Point Convolutions: On the Receptive Field Size of Point Convolutions on 3D Point Clouds. ICRA 2020
SegGCN	0.589 48	0.833 12	0.731 30	0.539 60	0.514 48	0.789 39	0.448 26	0.467 60	0.573 26	0.484 40	0.936 44	0.396 47	0.061 68	0.501 45	0.507 49	0.594 44	0.700 37	0.563 33	0.874 31	0.771 45	0.493 55
Huan Lei, Naveed Akhtar, and Ajmal Mian: SegGCN: Efficient 3D Point Cloud Segmentation with Fuzzy Spherical Kernel. CVPR 2020
CCRFNet	0.589 48	0.766 29	0.659 54	0.683 38	0.470 53	0.740 52	0.387 51	0.620 52	0.490 47	0.476 43	0.922 55	0.355 55	0.245 29	0.511 41	0.511 47	0.571 49	0.643 51	0.493 52	0.872 34	0.762 48	0.600 31

ROSMRF	0.580 50	0.772 25	0.707 36	0.681 39	0.563 41	0.764 46	0.362 53	0.515 59	0.465 53	0.465 45	0.936 44	0.427 40	0.207 38	0.438 51	0.577 42	0.536 53	0.675 44	0.486 53	0.723 58	0.779 40	0.524 51

TextureNet	0.566 51	0.672 47	0.664 52	0.671 43	0.494 49	0.719 53	0.445 30	0.678 44	0.411 60	0.396 55	0.935 46	0.356 54	0.225 33	0.412 55	0.535 45	0.565 50	0.636 54	0.464 56	0.794 52	0.680 60	0.568 42
Jingwei Huang, Haotian Zhang, Li Yi, Thomas Funkerhouser, Matthias Niessner, Leonidas Guibas: TextureNet: Consistent Local Parametrizations for Learning from High-Resolution Signals on Meshes. CVPR
DVVNet	0.562 52	0.648 49	0.700 40	0.770 20	0.586 33	0.687 57	0.333 56	0.650 47	0.514 43	0.475 44	0.906 61	0.359 53	0.223 34	0.340 59	0.442 54	0.422 62	0.668 46	0.501 50	0.708 59	0.779 40	0.534 49

Pointnet++ & Feature	0.557 53	0.735 35	0.661 53	0.686 37	0.491 50	0.744 51	0.392 47	0.539 57	0.451 55	0.375 58	0.946 26	0.376 50	0.205 39	0.403 56	0.356 59	0.553 52	0.643 51	0.497 51	0.824 47	0.756 49	0.515 52

PointMRNet-lite	0.553 54	0.633 51	0.648 56	0.659 47	0.430 56	0.800 31	0.390 50	0.592 53	0.454 54	0.371 59	0.939 42	0.368 52	0.136 61	0.368 57	0.448 52	0.560 51	0.715 30	0.486 53	0.882 24	0.720 55	0.462 60

PanopticFusion-label	0.529 55	0.491 64	0.688 47	0.604 54	0.386 59	0.632 62	0.225 67	0.705 39	0.434 58	0.293 63	0.815 65	0.348 56	0.241 30	0.499 46	0.669 36	0.507 55	0.649 48	0.442 61	0.796 51	0.602 66	0.561 45
Gaku Narita, Takashi Seno, Tomoya Ishikawa, Yohsuke Kaji: PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Things. IROS 2019 (to appear)
Online SegFusion	0.515 56	0.607 54	0.644 59	0.579 57	0.434 55	0.630 63	0.353 54	0.628 51	0.440 56	0.410 53	0.762 68	0.307 58	0.167 52	0.520 39	0.403 57	0.516 54	0.565 58	0.447 60	0.678 61	0.701 57	0.514 53
Davide Menini, Suryansh Kumar, Martin R. Oswald, Erik Sandstroem, Cristian Sminchisescu, Luc van Gool: A Real-Time Learning Framework for Joint 3D Reconstruction and Semantic Segmentation. Robotics and Automation Letters Submission
3DMV, FTSDF	0.501 57	0.558 60	0.608 63	0.424 68	0.478 52	0.690 56	0.246 63	0.586 54	0.468 51	0.450 47	0.911 59	0.394 48	0.160 55	0.438 51	0.212 65	0.432 61	0.541 63	0.475 55	0.742 56	0.727 54	0.477 58

PCNN	0.498 58	0.559 59	0.644 59	0.560 59	0.420 58	0.711 55	0.229 65	0.414 61	0.436 57	0.352 60	0.941 38	0.324 57	0.155 56	0.238 65	0.387 58	0.493 56	0.529 64	0.509 48	0.813 50	0.751 51	0.504 54

3DMV	0.484 59	0.484 65	0.538 66	0.643 51	0.424 57	0.606 66	0.310 57	0.574 55	0.433 59	0.378 57	0.796 66	0.301 59	0.214 37	0.537 37	0.208 66	0.472 60	0.507 67	0.413 64	0.693 60	0.602 66	0.539 48
Angela Dai, Matthias Niessner: 3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation. ECCV'18
PointCNN with RGB	0.458 60	0.577 58	0.611 62	0.356 70	0.321 66	0.715 54	0.299 59	0.376 64	0.328 67	0.319 61	0.944 33	0.285 61	0.164 53	0.216 68	0.229 64	0.484 58	0.545 62	0.456 58	0.755 55	0.709 56	0.475 59
Yangyan Li, Rui Bu, Mingchao Sun, Baoquan Chen: PointCNN. NeurIPS 2018
FCPN	0.447 61	0.679 46	0.604 64	0.578 58	0.380 60	0.682 58	0.291 60	0.106 70	0.483 48	0.258 68	0.920 56	0.258 64	0.025 70	0.231 67	0.325 60	0.480 59	0.560 60	0.463 57	0.725 57	0.666 62	0.231 70
Dario Rethage, Johanna Wald, Jürgen Sturm, Nassir Navab, Federico Tombari: Fully-Convolutional Point Networks for Large-Scale Point Clouds. ECCV 2018
PNET2	0.442 62	0.548 61	0.548 65	0.597 56	0.363 62	0.628 64	0.300 58	0.292 65	0.374 63	0.307 62	0.881 63	0.268 63	0.186 46	0.238 65	0.204 67	0.407 63	0.506 68	0.449 59	0.667 62	0.620 64	0.462 60

SurfaceConvPF	0.442 62	0.505 63	0.622 61	0.380 69	0.342 64	0.654 60	0.227 66	0.397 63	0.367 64	0.276 65	0.924 53	0.240 66	0.198 42	0.359 58	0.262 62	0.366 64	0.581 57	0.435 62	0.640 63	0.668 61	0.398 62
Hao Pan, Shilin Liu, Yang Liu, Xin Tong: Convolutional Neural Networks on 3D Surfaces Using Parallel Frames.
Tangent Convolutions	0.438 64	0.437 68	0.646 58	0.474 65	0.369 61	0.645 61	0.353 54	0.258 67	0.282 69	0.279 64	0.918 58	0.298 60	0.147 60	0.283 62	0.294 61	0.487 57	0.562 59	0.427 63	0.619 64	0.633 63	0.352 65
Maxim Tatarchenko, Jaesik Park, Vladlen Koltun, Qian-Yi Zhou: Tangent convolutions for dense prediction in 3d. CVPR 2018
3DWSSS	0.425 65	0.525 62	0.647 57	0.522 61	0.324 65	0.488 70	0.077 71	0.712 37	0.353 65	0.401 54	0.636 70	0.281 62	0.176 49	0.340 59	0.565 43	0.175 71	0.551 61	0.398 65	0.370 71	0.602 66	0.361 64

subcloud_weak	0.411 66	0.479 66	0.650 55	0.475 64	0.285 69	0.519 69	0.087 70	0.725 33	0.396 62	0.386 56	0.621 71	0.250 65	0.117 62	0.338 61	0.443 53	0.188 70	0.594 56	0.369 68	0.377 70	0.616 65	0.306 66

SPLAT Net	0.393 67	0.472 67	0.511 67	0.606 53	0.311 67	0.656 59	0.245 64	0.405 62	0.328 67	0.197 69	0.927 52	0.227 68	0.000 72	0.001 72	0.249 63	0.271 69	0.510 65	0.383 67	0.593 65	0.699 58	0.267 68
Hang Su, Varun Jampani, Deqing Sun, Subhransu Maji, Evangelos Kalogerakis, Ming-Hsuan Yang, Jan Kautz: SPLATNet: Sparse Lattice Networks for Point Cloud Processing. CVPR 2018
ScanNet+FTSDF	0.383 68	0.297 70	0.491 68	0.432 67	0.358 63	0.612 65	0.274 61	0.116 69	0.411 60	0.265 66	0.904 62	0.229 67	0.079 66	0.250 63	0.185 68	0.320 67	0.510 65	0.385 66	0.548 66	0.597 69	0.394 63

PointNet++	0.339 69	0.584 57	0.478 69	0.458 66	0.256 70	0.360 71	0.250 62	0.247 68	0.278 70	0.261 67	0.677 69	0.183 69	0.117 62	0.212 69	0.145 70	0.364 65	0.346 71	0.232 71	0.548 66	0.523 70	0.252 69
Charles R. Qi, Li Yi, Hao Su, Leonidas J. Guibas: pointnet++: deep hierarchical feature learning on point sets in a metric space.
SSC-UNet	0.308 70	0.353 69	0.290 71	0.278 71	0.166 71	0.553 67	0.169 69	0.286 66	0.147 71	0.148 71	0.908 60	0.182 70	0.064 67	0.023 71	0.018 72	0.354 66	0.363 69	0.345 69	0.546 68	0.685 59	0.278 67

ScanNet	0.306 71	0.203 71	0.366 70	0.501 62	0.311 67	0.524 68	0.211 68	0.002 72	0.342 66	0.189 70	0.786 67	0.145 71	0.102 65	0.245 64	0.152 69	0.318 68	0.348 70	0.300 70	0.460 69	0.437 71	0.182 71
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner: ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes. CVPR'17
ERROR	0.054 72	0.000 72	0.041 72	0.172 72	0.030 72	0.062 72	0.001 72	0.035 71	0.004 72	0.051 72	0.143 72	0.019 72	0.003 71	0.041 70	0.050 71	0.003 72	0.054 72	0.018 72	0.005 72	0.264 72	0.082 72

This table lists the benchmark results for the 3D semantic instance scenario.

Method	avg ap 50%	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	window

HAIS	0.699 1	1.000 1	0.849 2	0.820 3	0.675 1	0.808 7	0.279 3	0.757 6	0.465 6	0.517 3	0.596 1	0.559 3	0.600 8	1.000 1	0.654 5	0.767 4	0.676 2	0.994 14	0.560 3
Shaoyu Chen, Jiemin Fang, Qian Zhang, Wenyu Liu, Xinggang Wang: Hierarchical Aggregation for 3D Instance Segmentation. ICCV 2021
SSTNet	0.698 2	1.000 1	0.697 20	0.888 2	0.556 5	0.803 8	0.387 2	0.626 10	0.417 10	0.556 2	0.585 3	0.702 1	0.600 8	1.000 1	0.824 1	0.720 12	0.692 1	1.000 1	0.509 6

OccuSeg+instance	0.672 3	1.000 1	0.758 15	0.682 11	0.576 3	0.842 1	0.477 1	0.504 20	0.524 3	0.567 1	0.585 4	0.451 7	0.557 14	1.000 1	0.751 2	0.797 3	0.563 13	1.000 1	0.467 11

Mask-Group	0.664 4	1.000 1	0.822 5	0.764 8	0.616 2	0.815 4	0.139 8	0.694 9	0.597 2	0.459 7	0.566 5	0.599 2	0.600 8	0.516 24	0.715 3	0.819 2	0.635 6	1.000 1	0.603 1

CSC-Pretrained	0.648 5	1.000 1	0.810 6	0.768 6	0.523 10	0.813 5	0.143 7	0.819 1	0.389 11	0.422 14	0.511 11	0.443 8	0.650 2	1.000 1	0.624 7	0.732 10	0.634 7	1.000 1	0.375 17

PE	0.645 6	1.000 1	0.773 11	0.798 5	0.538 7	0.786 13	0.088 15	0.799 4	0.350 15	0.435 13	0.547 7	0.545 4	0.646 6	0.933 11	0.562 10	0.761 7	0.556 17	0.997 11	0.501 8
Biao Zhang, Peter Wonka: Point Cloud Instance Segmentation using Probabilistic Embeddings. CVPR 2021
RPGN	0.643 7	1.000 1	0.758 14	0.582 17	0.539 6	0.826 3	0.046 18	0.765 5	0.372 13	0.436 12	0.588 2	0.539 5	0.650 2	1.000 1	0.577 8	0.750 9	0.653 5	0.997 11	0.495 9

Dyco3D	0.641 8	1.000 1	0.841 3	0.893 1	0.531 8	0.802 9	0.115 12	0.588 15	0.448 7	0.438 10	0.537 9	0.430 10	0.550 15	0.857 13	0.534 11	0.764 6	0.657 3	0.987 15	0.568 2

GICN	0.638 9	1.000 1	0.895 1	0.800 4	0.480 13	0.676 16	0.144 6	0.737 7	0.354 14	0.447 8	0.400 19	0.365 14	0.700 1	1.000 1	0.569 9	0.836 1	0.599 10	1.000 1	0.473 10

PointGroup	0.636 10	1.000 1	0.765 12	0.624 12	0.505 12	0.797 10	0.116 11	0.696 8	0.384 12	0.441 9	0.559 6	0.476 6	0.596 11	1.000 1	0.666 4	0.756 8	0.556 16	0.997 11	0.513 5
Li Jiang, Hengshuang Zhao, Shaoshuai Shi, Shu Liu, Chi-Wing Fu, Jiaya Jia: PointGroup: Dual-Set Point Grouping for 3D Instance Segmentation. CVPR 2020 [oral]
DD-UNet+Group	0.635 11	0.667 21	0.797 9	0.714 10	0.562 4	0.774 14	0.146 5	0.810 3	0.429 9	0.476 5	0.546 8	0.399 12	0.633 7	1.000 1	0.632 6	0.722 11	0.609 9	1.000 1	0.514 4
H. Liu, R. Liu, K. Yang, J. Zhang, K. Peng, R. Stiefelhagen: HIDA: Towards Holistic Indoor Understanding for the Visually Impaired via Semantic Instance Segmentation with a Wearable Solid-State LiDAR Sensor.
3D-MPA	0.611 12	1.000 1	0.833 4	0.765 7	0.526 9	0.756 15	0.136 10	0.588 15	0.470 5	0.438 11	0.432 17	0.358 15	0.650 2	0.857 13	0.429 15	0.765 5	0.557 15	1.000 1	0.430 14
Francis Engelmann, Martin Bokeloh, Alireza Fathi, Bastian Leibe, Matthias Nießner: 3D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentation. CVPR 2020
SphereNet	0.606 13	1.000 1	0.776 10	0.745 9	0.436 17	0.834 2	0.035 20	0.587 17	0.518 4	0.338 21	0.534 10	0.352 16	0.594 13	1.000 1	0.391 19	0.696 15	0.624 8	1.000 1	0.451 12

PCJC	0.578 14	1.000 1	0.810 7	0.583 16	0.449 16	0.813 6	0.042 19	0.603 13	0.341 16	0.490 4	0.465 13	0.410 11	0.650 2	0.835 18	0.264 23	0.694 16	0.561 14	0.889 21	0.504 7

SSEN	0.575 15	1.000 1	0.761 13	0.473 19	0.477 14	0.795 11	0.066 16	0.529 18	0.658 1	0.460 6	0.461 14	0.380 13	0.331 23	0.859 12	0.401 18	0.692 17	0.653 4	1.000 1	0.348 19
Dongsu Zhang, Junha Chun, Sang Kyun Cha, Young Min Kim: Spatial Semantic Embedding Network: Fast 3D Instance Segmentation with Deep Metric Learning. Arxiv
MTML	0.549 16	1.000 1	0.807 8	0.588 15	0.327 20	0.647 17	0.004 25	0.815 2	0.180 20	0.418 15	0.364 21	0.182 19	0.445 18	1.000 1	0.442 14	0.688 18	0.571 12	1.000 1	0.396 15
Jean Lahoud, Bernard Ghanem, Marc Pollefeys, Martin R. Oswald: 3D Instance Segmentation via Multi-task Metric Learning. ICCV 2019 [oral]
Sparse R-CNN	0.515 17	1.000 1	0.538 26	0.282 22	0.468 15	0.790 12	0.173 4	0.345 22	0.429 8	0.413 17	0.484 12	0.176 20	0.595 12	0.591 22	0.522 12	0.668 19	0.476 20	0.986 16	0.327 20

Occipital-SCS	0.512 18	1.000 1	0.716 17	0.509 18	0.506 11	0.611 19	0.092 14	0.602 14	0.177 21	0.346 19	0.383 20	0.165 21	0.442 19	0.850 17	0.386 20	0.618 21	0.543 18	0.889 21	0.389 16

3D-BoNet	0.488 19	1.000 1	0.672 21	0.590 14	0.301 21	0.484 27	0.098 13	0.620 11	0.306 17	0.341 20	0.259 23	0.125 23	0.434 20	0.796 19	0.402 17	0.499 26	0.513 19	0.909 20	0.439 13
Bo Yang, Jianan Wang, Ronald Clark, Qingyong Hu, Sen Wang, Andrew Markham, Niki Trigoni: Learning Object Bounding Boxes for 3D Instance Segmentation on Point Clouds. NeurIPS 2019 Spotlight
PanopticFusion-inst	0.478 20	0.667 21	0.712 19	0.595 13	0.259 23	0.550 24	0.000 28	0.613 12	0.175 22	0.250 25	0.434 15	0.437 9	0.411 22	0.857 13	0.485 13	0.591 24	0.267 28	0.944 18	0.359 18
Gaku Narita, Takashi Seno, Tomoya Ishikawa, Yohsuke Kaji: PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Things. IROS 2019 (to appear)
SALoss-ResNet	0.459 21	1.000 1	0.737 16	0.159 29	0.259 22	0.587 21	0.138 9	0.475 21	0.217 19	0.416 16	0.408 18	0.128 22	0.315 24	0.714 20	0.411 16	0.536 25	0.590 11	0.873 24	0.304 21
Zhidong Liang, Ming Yang, Hao Li, Chunxiang Wang: 3D Instance Embedding Learning With a Structure-Aware Loss Function for Point Cloud Segmentation. IEEE Robotics and Automation Letters (IROS2020)
MASC	0.447 22	0.528 27	0.555 24	0.381 20	0.382 18	0.633 18	0.002 26	0.509 19	0.260 18	0.361 18	0.432 16	0.327 17	0.451 17	0.571 23	0.367 21	0.639 20	0.386 21	0.980 17	0.276 22
Chen Liu, Yasutaka Furukawa: MASC: Multi-scale Affinity with Sparse Convolution for 3D Instance Segmentation.
3D-SIS	0.382 23	1.000 1	0.432 28	0.245 24	0.190 24	0.577 22	0.013 23	0.263 24	0.033 28	0.320 22	0.240 24	0.075 25	0.422 21	0.857 13	0.117 26	0.699 13	0.271 27	0.883 23	0.235 24
Ji Hou, Angela Dai, Matthias Niessner: 3D-SIS: 3D Semantic Instance Segmentation of RGB-D Scans. CVPR 2019
Hier3D	0.323 24	0.667 21	0.542 25	0.264 23	0.157 27	0.550 23	0.000 28	0.205 27	0.009 29	0.270 24	0.218 25	0.075 25	0.500 16	0.688 21	0.007 31	0.698 14	0.301 25	0.459 29	0.200 25
Tan: HCFS3D: Hierarchical Coupled Feature Selection Network for 3D Semantic and Instance Segmentation.
UNet-backbone	0.319 25	0.667 21	0.715 18	0.233 25	0.189 25	0.479 28	0.008 24	0.218 25	0.067 27	0.201 26	0.173 26	0.107 24	0.123 28	0.438 25	0.150 24	0.615 22	0.355 22	0.916 19	0.093 30

R-PointNet	0.306 26	0.500 28	0.405 29	0.311 21	0.348 19	0.589 20	0.054 17	0.068 29	0.126 23	0.283 23	0.290 22	0.028 29	0.219 26	0.214 27	0.331 22	0.396 29	0.275 26	0.821 26	0.245 23

RandSA	0.250 27	0.333 29	0.613 22	0.229 26	0.163 26	0.493 25	0.000 28	0.304 23	0.107 24	0.147 28	0.100 27	0.052 28	0.231 25	0.119 28	0.039 28	0.445 28	0.325 23	0.654 27	0.141 27

Region	0.248 28	0.667 21	0.437 27	0.188 27	0.153 28	0.491 26	0.000 28	0.208 26	0.094 26	0.153 27	0.099 28	0.057 27	0.217 27	0.119 28	0.039 28	0.466 27	0.302 24	0.640 28	0.140 28

3D-BEVIS	0.248 28	0.667 21	0.566 23	0.076 30	0.035 31	0.394 29	0.027 22	0.035 30	0.098 25	0.099 29	0.030 30	0.025 30	0.098 29	0.375 26	0.126 25	0.604 23	0.181 29	0.854 25	0.171 26
Cathrin Elich, Francis Engelmann, Jonas Schult, Theodora Kontogianni, Bastian Leibe: 3D-BEVIS: Birds-Eye-View Instance Segmentation.
Sgpn_scannet	0.143 30	0.208 31	0.390 30	0.169 28	0.065 29	0.275 30	0.029 21	0.069 28	0.000 30	0.087 30	0.043 29	0.014 31	0.027 31	0.000 30	0.112 27	0.351 30	0.168 30	0.438 30	0.138 29

MaskRCNN 2d->3d Proj	0.058 31	0.333 29	0.002 31	0.000 31	0.053 30	0.002 31	0.002 27	0.021 31	0.000 30	0.045 31	0.024 31	0.238 18	0.065 30	0.000 30	0.014 30	0.107 31	0.020 31	0.110 31	0.006 31

Method	avg iou	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	floor	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	wall	window

Virtual MVFusion (R)	0.745 1	0.861 1	0.839 1	0.881 1	0.672 1	0.512 1	0.422 10	0.898 1	0.723 1	0.714 1	0.954 2	0.454 1	0.509 1	0.773 1	0.895 1	0.756 1	0.820 1	0.653 1	0.935 1	0.891 1	0.728 1
Abhijit Kundu, Xiaoqi Yin, Alireza Fathi, David Ross, Brian Brewington, Thomas Funkhouser, Caroline Pantofaru: Virtual Multi-view Fusion for 3D Semantic Segmentation. ECCV 2020
BPNet_2D	0.670 2	0.822 3	0.795 3	0.836 2	0.659 2	0.481 2	0.451 6	0.769 2	0.656 3	0.567 3	0.931 3	0.395 3	0.390 4	0.700 2	0.534 3	0.689 5	0.770 2	0.574 3	0.865 3	0.831 3	0.675 2
Wenbo Hu, Hengshuang Zhao, Li Jiang, Jiaya Jia and Tien-Tsin Wong: Bidirectional Projection Network for Cross Dimension Scene Understanding. CVPR 2021 (Oral)
CU-Hybrid-2D Net	0.636 3	0.825 2	0.820 2	0.179 16	0.648 3	0.463 3	0.549 1	0.742 3	0.676 2	0.628 2	0.961 1	0.420 2	0.379 5	0.684 3	0.381 10	0.732 2	0.723 3	0.599 2	0.827 8	0.851 2	0.634 3

DMMF_3d	0.605 4	0.651 6	0.744 7	0.782 3	0.637 4	0.387 4	0.536 2	0.732 4	0.590 5	0.540 4	0.856 13	0.359 6	0.306 10	0.596 6	0.539 2	0.627 12	0.706 4	0.497 6	0.785 12	0.757 11	0.476 13

DMMF	0.597 5	0.543 11	0.755 6	0.749 4	0.585 6	0.338 6	0.494 4	0.704 6	0.598 4	0.494 10	0.911 6	0.347 8	0.327 9	0.593 7	0.527 4	0.675 7	0.646 8	0.513 4	0.842 6	0.774 8	0.527 11

MCA-Net	0.595 6	0.533 12	0.756 5	0.746 5	0.590 5	0.334 8	0.506 3	0.670 7	0.587 6	0.500 8	0.905 8	0.366 5	0.352 6	0.601 5	0.506 6	0.669 10	0.648 6	0.501 5	0.839 7	0.769 9	0.516 12

RFBNet	0.592 7	0.616 7	0.758 4	0.659 6	0.581 7	0.330 9	0.469 5	0.655 10	0.543 9	0.524 5	0.924 4	0.355 7	0.336 8	0.572 8	0.479 8	0.671 8	0.648 6	0.480 7	0.814 10	0.814 4	0.614 6

DCRedNet	0.583 8	0.682 5	0.723 8	0.542 10	0.510 11	0.310 11	0.451 6	0.668 8	0.549 8	0.520 6	0.920 5	0.375 4	0.446 2	0.528 11	0.417 9	0.670 9	0.577 13	0.478 8	0.862 4	0.806 5	0.628 5

SSMA	0.577 9	0.695 4	0.716 10	0.439 12	0.563 8	0.314 10	0.444 8	0.719 5	0.551 7	0.503 7	0.887 10	0.346 9	0.348 7	0.603 4	0.353 12	0.709 3	0.600 11	0.457 10	0.901 2	0.786 6	0.599 7
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. International Journal of Computer Vision, 2019
SN_RN152pyrx8_RVC	0.546 10	0.572 9	0.663 13	0.638 8	0.518 9	0.298 12	0.366 15	0.633 12	0.510 11	0.446 12	0.864 11	0.296 11	0.267 12	0.542 10	0.346 13	0.704 4	0.575 14	0.431 12	0.853 5	0.766 10	0.630 4

FuseNet	0.535 11	0.570 10	0.681 12	0.182 15	0.512 10	0.290 13	0.431 9	0.659 9	0.504 12	0.495 9	0.903 9	0.308 10	0.428 3	0.523 12	0.365 11	0.676 6	0.621 10	0.470 9	0.762 13	0.779 7	0.541 9
Caner Hazirbas, Lingni Ma, Csaba Domokos, Daniel Cremers: FuseNet: Incorporating Depth into Semantic Segmentation via Fusion-based CNN Architecture. ACCV 2016
AdapNet++	0.503 12	0.613 8	0.722 9	0.418 13	0.358 17	0.337 7	0.370 14	0.479 15	0.443 13	0.368 15	0.907 7	0.207 14	0.213 16	0.464 15	0.525 5	0.618 13	0.657 5	0.450 11	0.788 11	0.721 14	0.408 16
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. International Journal of Computer Vision, 2019
3DMV (2d proj)	0.498 13	0.481 15	0.612 14	0.579 9	0.456 13	0.343 5	0.384 12	0.623 13	0.525 10	0.381 14	0.845 14	0.254 13	0.264 14	0.557 9	0.182 15	0.581 15	0.598 12	0.429 13	0.760 14	0.661 16	0.446 15
Angela Dai, Matthias Niessner: 3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation. ECCV'18
MSeg1080_RVC	0.485 14	0.505 13	0.709 11	0.092 17	0.427 14	0.241 14	0.411 11	0.654 11	0.385 17	0.457 11	0.861 12	0.053 17	0.279 11	0.503 13	0.481 7	0.645 11	0.626 9	0.365 15	0.748 15	0.725 13	0.529 10
John Lambert, Zhuang Liu, Ozan Sener, James Hays, Vladlen Koltun: MSeg: A Composite Dataset for Multi-domain Semantic Segmentation. CVPR 2020
ILC-PSPNet	0.475 15	0.490 14	0.581 15	0.289 14	0.507 12	0.067 17	0.379 13	0.610 14	0.417 15	0.435 13	0.822 16	0.278 12	0.267 12	0.503 13	0.228 14	0.616 14	0.533 15	0.375 14	0.820 9	0.729 12	0.560 8

Enet (reimpl)	0.376 16	0.264 17	0.452 17	0.452 11	0.365 15	0.181 15	0.143 17	0.456 16	0.409 16	0.346 16	0.769 17	0.164 15	0.218 15	0.359 16	0.123 17	0.403 17	0.381 17	0.313 17	0.571 16	0.685 15	0.472 14
Re-implementation of Adam Paszke, Abhishek Chaurasia, Sangpil Kim, Eugenio Culurciello: ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation.
ScanNet (2d proj)	0.330 17	0.293 16	0.521 16	0.657 7	0.361 16	0.161 16	0.250 16	0.004 17	0.440 14	0.183 17	0.836 15	0.125 16	0.060 17	0.319 17	0.132 16	0.417 16	0.412 16	0.344 16	0.541 17	0.427 17	0.109 17
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner: ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes. CVPR'17

Method	avg ap	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	window

UniDet_RVC	0.205 1	0.381 1	0.323 1	0.037 1	0.226 1	0.177 1	0.063 1	0.277 1	0.120 1	0.067 1	0.131 1	0.074 2	0.317 1	0.080 1	0.235 1	0.289 1	0.141 1	0.678 1	0.080 1

MaskRCNN_ScanNet	0.119 2	0.129 2	0.212 2	0.002 2	0.112 2	0.148 2	0.014 2	0.205 2	0.044 2	0.066 2	0.078 2	0.095 1	0.142 2	0.030 2	0.128 2	0.139 2	0.080 2	0.459 2	0.057 2
Re-implementation of Kaiming He, Georgia Gkioxari, Piotr Dollár, Ross Girshick: Mask R-CNN. ICCV'17

Method	avg recall	apartment	bathroom	bedroom / hotel	bookstore / library	conference room	copy/mail room	hallway	kitchen	laundry room	living room / lounge	misc	office	storage / basement / garage

multi-task	0.700 1	0.500 1	1.000 1	0.882 2	0.500 2	1.000 1	1.000 1	0.500 2	1.000 1	1.000 1	0.778 1	0.000 2	0.938 1	0.000 2
Shengyu Huang, Mikhail Usvyatsov, Konrad Schindler: Indoor Scene Recognition in 3D. IROS 2020
3DASPP-SCE	0.691 2	0.500 1	0.938 2	0.824 3	1.000 1	1.000 1	0.500 2	1.000 1	0.857 2	0.500 2	0.556 3	0.000 2	0.812 2	0.500 1

SE-ResNeXt-SSMA	0.498 3	0.000 4	0.812 3	0.941 1	0.500 2	0.500 3	0.500 2	0.500 2	0.429 4	0.500 2	0.667 2	0.500 1	0.625 3	0.000 2
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. arXiv
resnet50_scannet	0.353 4	0.250 3	0.812 3	0.529 4	0.500 2	0.500 3	0.000 4	0.500 2	0.571 3	0.000 4	0.556 3	0.000 2	0.375 4	0.000 2

3D Semantic label benchmark

3D Semantic instance benchmark

2D Semantic label benchmark

2D Semantic instance benchmark

Scene type classification benchmark