Benchmark Results - ScanNet Benchmark

This table lists the benchmark results for the ScanNet200 3D semantic label scenario.

Method	avg iou	head iou	common iou	tail iou	backpack	bag	ball	bar	basket	bathroom cabinet	bathroom stall	bathroom stall door	bathroom vanity	bathtub	bed	bench	bicycle	bin	blackboard	blanket	blinds	board	book	bookshelf	bottle	bowl	box	broom	bucket	bulletin board	cabinet	calendar	candle	cart	case of water bottles	ceiling	ceiling light	chair	clock	closet	closet rod	clothes	clothes dryer	coat rack	coffee kettle	coffee maker	coffee table	column	computer tower	copier	couch	counter	cup	curtain	cushion	decoration	desk	dining table	dish rack	dishwasher	door	doorframe	dresser	dumbbell	end table	fan	file cabinet	fire alarm	fire extinguisher	floor	folded chair	hat	headphones	ironing board	jacket	keyboard	keyboard piano	kitchen cabinet	kitchen counter	ladder	lamp	laptop	laundry basket	laundry detergent	laundry hamper	ledge	light	light switch	machine	mailbox	mat	microwave	mini fridge	mirror	monitor	mouse	music stand	nightstand	object	office chair	oven	paper	paper bag	paper cutter	paper towel dispenser	paper towel roll	person	piano	picture	pillow	pipe	plant	plate	plunger	poster	power outlet	power strip	printer	projector	projector screen	rack	radiator	range hood	recycling bin	refrigerator	scale	seat	shelf	shoe	shower	shower curtain	shower curtain rod	shower floor	shower head	shower wall	sign	sink	soap dispenser	sofa chair	speaker	stair rail	stairs	stand	stool	storage bin	storage container	storage organizer	stove	structure	stuffed animal	suitcase	table	telephone	tissue box	toaster	toilet	toilet paper	toilet paper dispenser	towel	trash bin	trash can	tray	tube	tv	tv stand	vacuum cleaner	vent	wall	wardrobe	washing machine	water bottle	water cooler	water pitcher	whiteboard	window	windowsill

L3DETR-ScanNet_200	0.336 6	0.533 9	0.279 4	0.155 6	0.508 4	0.073 9	0.101 13	0.000 1	0.058 2	0.000 1	0.294 12	0.233 12	0.548 3	0.927 1	0.788 7	0.264 2	0.463 7	0.000 3	0.638 8	0.098 11	0.014 5	0.411 9	0.226 9	0.525 9	0.225 7	0.010 4	0.397 4	0.000 1	0.000 3	0.192 4	0.380 10	0.598 4	0.000 1	0.117 4	0.000 2	0.883 5	0.082 7	0.689 3	0.000 6	0.032 13	0.549 5	0.417 4	0.910 4	0.000 1	0.000 2	0.448 7	0.613 7	0.000 9	0.697 6	0.960 1	0.759 3	0.158 2	0.293 2	0.883 5	0.000 1	0.312 3	0.583 2	0.079 4	0.422 10	0.068 13	0.660 6	0.418 6	0.298 8	0.430 10	0.114 8	0.526 3	0.776 2	0.051 3	0.679 1	0.946 5	0.152 6	0.000 1	0.183 5	0.000 11	0.211 6	0.511 8	0.409 12	0.565 8	0.355 6	0.448 5	0.512 4	0.557 2	0.000 3	0.000 1	0.420 7	0.000 8	0.007 13	0.104 4	0.000 3	0.125 13	0.330 2	0.514 11	0.146 8	0.321 9	0.860 7	0.174 7	0.000 1	0.629 4	0.075 12	0.000 10	0.000 4	0.000 1	0.002 6	0.671 5	0.712 4	0.141 5	0.339 8	0.856 3	0.261 8	0.529 8	0.067 8	0.835 2	0.000 4	0.369 10	0.000 1	0.259 2	0.000 3	0.629 4	0.000 2	0.487 1	0.000 1	0.579 9	0.646 3	0.107 13	0.720 9	0.122 6	0.000 1	0.333 10	0.505 8	0.303 6	0.908 2	0.503 11	0.565 2	0.074 7	0.324 1	0.000 1	0.740 6	0.661 7	0.109 10	0.000 8	0.427 9	0.563 13	0.000 1	0.579 8	0.108 6	0.000 5	0.000 1	0.664 4	0.000 2	0.000 1	0.641 6	0.539 7	0.416 5	0.515 2	0.256 7	0.940 9	0.312 4	0.209 13	0.620 2	0.138 10	0.636 9	0.000 1	0.000 9	0.775 9	0.861 4	0.765 9	0.000 1	0.801 8	0.119 11	0.860 6	0.000 1	0.687 1	0.001 10	0.192 12	0.679 7	0.699 1
Yanmin Wu, Qiankun Gao, Renrui Zhang, Jian Zhang: Language-Assisted 3D Scene Understanding. arXiv23.12
ALS-MinkowskiNet	0.414 1	0.610 1	0.322 2	0.271 1	0.542 1	0.153 1	0.159 9	0.000 1	0.000 3	0.000 1	0.404 3	0.503 3	0.532 5	0.672 13	0.804 4	0.285 1	0.888 1	0.000 3	0.900 1	0.226 1	0.087 2	0.598 3	0.342 3	0.671 1	0.217 8	0.087 2	0.449 2	0.000 1	0.000 3	0.253 1	0.477 4	1.000 1	0.000 1	0.118 3	0.000 2	0.905 1	0.071 11	0.710 1	0.076 1	0.047 12	0.665 1	0.376 7	0.981 1	0.000 1	0.000 2	0.466 6	0.632 5	0.113 3	0.769 1	0.956 2	0.795 1	0.031 8	0.314 1	0.936 1	0.000 1	0.390 2	0.601 1	0.000 7	0.458 7	0.366 1	0.719 2	0.440 4	0.564 1	0.699 3	0.314 1	0.464 5	0.784 1	0.200 1	0.283 4	0.973 1	0.142 8	0.000 1	0.250 4	0.285 4	0.220 5	0.718 1	0.752 4	0.723 1	0.460 1	0.248 12	0.475 6	0.463 10	0.000 3	0.000 1	0.446 6	0.021 4	0.025 7	0.285 1	0.000 3	0.972 1	0.149 5	0.769 1	0.230 1	0.535 1	0.879 2	0.252 4	0.000 1	0.693 1	0.129 2	0.000 10	0.000 4	0.000 1	0.447 1	0.958 1	0.662 6	0.159 2	0.598 2	0.780 10	0.344 2	0.646 2	0.106 4	0.893 1	0.135 1	0.455 3	0.000 1	0.194 3	0.259 1	0.726 2	0.475 1	0.000 5	0.000 1	0.741 1	0.865 1	0.571 2	0.817 3	0.445 3	0.000 1	0.506 1	0.630 2	0.230 8	0.916 1	0.728 1	0.635 1	1.000 1	0.252 4	0.000 1	0.804 1	0.697 3	0.137 8	0.043 5	0.717 1	0.807 2	0.000 1	0.510 10	0.245 1	0.000 5	0.000 1	0.709 2	0.000 2	0.000 1	0.703 1	0.572 2	0.646 1	0.223 9	0.531 2	0.984 1	0.397 2	0.813 1	0.798 1	0.135 11	0.800 1	0.000 1	0.097 1	0.832 1	0.752 7	0.842 7	0.000 1	0.852 1	0.149 9	0.846 8	0.000 1	0.666 4	0.359 2	0.252 6	0.777 1	0.690 2
Guangda Ji, Silvan Weder, Francis Engelmann, Marc Pollefeys, Hermann Blum: ARKit LabelMaker: A New Scale for Indoor 3D Scene Understanding. arxiv
BFANet ScanNet200	0.360 3	0.553 5	0.293 3	0.193 3	0.483 7	0.096 4	0.266 4	0.000 1	0.000 3	0.000 1	0.298 11	0.255 10	0.661 1	0.810 5	0.810 2	0.194 7	0.785 3	0.000 3	0.000 13	0.161 4	0.000 7	0.494 6	0.382 1	0.574 3	0.258 3	0.000 6	0.372 7	0.000 1	0.000 3	0.043 10	0.436 6	0.000 7	0.000 1	0.239 1	0.000 2	0.901 3	0.105 1	0.689 3	0.025 3	0.128 2	0.614 2	0.436 1	0.493 13	0.000 1	0.000 2	0.526 4	0.546 9	0.109 4	0.651 11	0.953 3	0.753 5	0.101 5	0.143 9	0.897 3	0.000 1	0.431 1	0.469 11	0.000 7	0.522 5	0.337 4	0.661 5	0.459 2	0.409 3	0.666 4	0.102 10	0.508 4	0.757 3	0.000 5	0.060 10	0.970 3	0.497 1	0.000 1	0.376 2	0.511 2	0.262 4	0.688 2	0.921 1	0.617 6	0.321 10	0.590 3	0.491 5	0.556 3	0.000 3	0.000 1	0.481 3	0.093 1	0.043 2	0.284 2	0.000 3	0.875 11	0.135 6	0.669 4	0.124 9	0.394 5	0.849 10	0.298 2	0.000 1	0.476 13	0.088 11	0.042 5	0.000 4	0.000 1	0.254 2	0.653 7	0.741 3	0.215 1	0.573 4	0.852 4	0.266 6	0.654 1	0.056 10	0.835 2	0.000 4	0.492 1	0.000 1	0.000 5	0.000 3	0.612 7	0.000 2	0.000 5	0.000 1	0.616 4	0.469 13	0.460 4	0.698 10	0.516 2	0.000 1	0.378 6	0.563 3	0.476 2	0.863 4	0.574 7	0.330 5	0.000 8	0.282 3	0.000 1	0.760 3	0.710 2	0.233 1	0.000 8	0.641 3	0.814 1	0.000 1	0.585 7	0.053 9	0.000 5	0.000 1	0.629 8	0.000 2	0.000 1	0.678 2	0.528 9	0.534 3	0.129 10	0.596 1	0.973 3	0.264 8	0.772 2	0.526 6	0.139 9	0.707 3	0.000 1	0.000 9	0.764 10	0.591 12	0.848 6	0.000 1	0.827 3	0.338 3	0.806 10	0.000 1	0.568 6	0.151 6	0.358 1	0.659 8	0.510 4

CeCo	0.340 5	0.551 7	0.247 9	0.181 4	0.475 9	0.057 13	0.142 10	0.000 1	0.000 3	0.000 1	0.387 4	0.463 4	0.499 8	0.924 2	0.774 8	0.213 5	0.257 9	0.000 3	0.546 11	0.100 9	0.006 6	0.615 1	0.177 13	0.534 6	0.246 4	0.000 6	0.400 3	0.000 1	0.338 1	0.006 12	0.484 3	0.609 3	0.000 1	0.083 9	0.000 2	0.873 8	0.089 5	0.661 10	0.000 6	0.048 11	0.560 3	0.408 5	0.892 6	0.000 1	0.000 2	0.586 1	0.616 6	0.000 9	0.692 7	0.900 4	0.721 8	0.162 1	0.228 4	0.860 7	0.000 1	0.000 9	0.575 3	0.083 3	0.550 3	0.347 3	0.624 9	0.410 9	0.360 5	0.740 2	0.109 9	0.321 11	0.660 6	0.000 5	0.121 5	0.939 9	0.143 7	0.000 1	0.400 1	0.003 9	0.190 8	0.564 4	0.652 8	0.615 7	0.421 3	0.304 10	0.579 1	0.547 4	0.000 3	0.000 1	0.296 10	0.000 8	0.030 6	0.096 5	0.000 3	0.916 4	0.037 9	0.551 8	0.171 5	0.376 6	0.865 6	0.286 3	0.000 1	0.633 3	0.102 10	0.027 6	0.011 3	0.000 1	0.000 7	0.474 10	0.742 2	0.133 6	0.311 9	0.824 7	0.242 9	0.503 10	0.068 7	0.828 5	0.000 4	0.429 5	0.000 1	0.063 4	0.000 3	0.781 1	0.000 2	0.000 5	0.000 1	0.665 2	0.633 5	0.450 5	0.818 2	0.000 8	0.000 1	0.429 3	0.532 6	0.226 9	0.825 7	0.510 9	0.377 4	0.709 2	0.079 10	0.000 1	0.753 4	0.683 4	0.102 12	0.063 3	0.401 12	0.620 10	0.000 1	0.619 2	0.000 12	0.000 5	0.000 1	0.595 11	0.000 2	0.000 1	0.345 10	0.564 4	0.411 6	0.603 1	0.384 5	0.945 6	0.266 7	0.643 5	0.367 10	0.304 1	0.663 8	0.000 1	0.010 4	0.726 11	0.767 6	0.898 3	0.000 1	0.784 9	0.435 1	0.861 5	0.000 1	0.447 8	0.000 11	0.257 5	0.656 9	0.377 9
Zhisheng Zhong, Jiequan Cui, Yibo Yang, Xiaoyang Wu, Xiaojuan Qi, Xiangyu Zhang, Jiaya Jia: Understanding Imbalanced Semantic Segmentation Through Neural Collapse. CVPR 2023
PonderV2 ScanNet200	0.346 4	0.552 6	0.270 6	0.175 5	0.497 6	0.070 10	0.239 5	0.000 1	0.000 3	0.000 1	0.232 13	0.412 6	0.584 2	0.842 3	0.804 4	0.212 6	0.540 6	0.000 3	0.433 12	0.106 8	0.000 7	0.590 4	0.290 8	0.548 4	0.243 5	0.000 6	0.356 9	0.000 1	0.000 3	0.062 8	0.398 9	0.441 6	0.000 1	0.104 8	0.000 2	0.888 4	0.076 9	0.682 6	0.030 2	0.094 5	0.491 8	0.351 9	0.869 8	0.000 1	0.063 1	0.403 8	0.700 2	0.000 9	0.660 10	0.881 5	0.761 2	0.050 7	0.186 6	0.852 9	0.000 1	0.007 7	0.570 6	0.100 2	0.565 2	0.326 5	0.641 8	0.431 5	0.290 10	0.621 5	0.259 3	0.408 7	0.622 8	0.125 2	0.082 8	0.950 4	0.179 4	0.000 1	0.263 3	0.424 3	0.193 7	0.558 5	0.880 2	0.545 9	0.375 5	0.727 2	0.445 8	0.499 7	0.000 3	0.000 1	0.475 5	0.002 6	0.034 5	0.083 6	0.000 3	0.924 2	0.290 3	0.636 5	0.115 10	0.400 4	0.874 4	0.186 6	0.000 1	0.611 6	0.128 3	0.113 2	0.000 4	0.000 1	0.000 7	0.584 8	0.636 7	0.103 10	0.385 7	0.843 5	0.283 3	0.603 5	0.080 6	0.825 6	0.000 4	0.377 8	0.000 1	0.000 5	0.000 3	0.457 9	0.000 2	0.000 5	0.000 1	0.574 10	0.608 7	0.481 3	0.792 4	0.394 4	0.000 1	0.357 8	0.503 9	0.261 7	0.817 9	0.504 10	0.304 6	0.472 4	0.115 7	0.000 1	0.750 5	0.677 5	0.202 2	0.000 8	0.509 5	0.729 3	0.000 1	0.519 9	0.000 12	0.000 5	0.000 1	0.620 10	0.000 2	0.000 1	0.660 5	0.560 5	0.486 4	0.384 6	0.346 6	0.952 4	0.247 10	0.667 4	0.436 8	0.269 3	0.691 5	0.000 1	0.010 4	0.787 6	0.889 2	0.880 4	0.000 1	0.810 6	0.336 4	0.860 6	0.000 1	0.606 5	0.009 7	0.248 7	0.681 5	0.392 8
Haoyi Zhu, Honghui Yang, Xiaoyang Wu, Di Huang, Sha Zhang, Xianglong He, Tong He, Hengshuang Zhao, Chunhua Shen, Yu Qiao, Wanli Ouyang: PonderV2: Pave the Way for 3D Foundataion Model with A Universal Pre-training Paradigm.
AWCS	0.305 10	0.508 10	0.225 10	0.142 7	0.463 10	0.063 11	0.195 7	0.000 1	0.000 3	0.000 1	0.467 2	0.551 1	0.504 7	0.773 6	0.764 10	0.142 10	0.029 13	0.000 3	0.626 9	0.100 9	0.000 7	0.360 10	0.179 11	0.507 11	0.137 11	0.006 5	0.300 10	0.000 1	0.000 3	0.172 6	0.364 11	0.512 5	0.000 1	0.056 10	0.000 2	0.865 10	0.093 4	0.634 13	0.000 6	0.071 9	0.396 11	0.296 12	0.876 7	0.000 1	0.000 2	0.373 10	0.436 12	0.063 8	0.749 2	0.877 6	0.721 8	0.131 3	0.124 10	0.804 11	0.000 1	0.000 9	0.515 8	0.010 6	0.452 9	0.252 8	0.578 10	0.417 7	0.179 13	0.484 8	0.171 5	0.337 10	0.606 10	0.000 5	0.115 6	0.937 10	0.142 8	0.000 1	0.008 8	0.000 11	0.157 12	0.484 10	0.402 13	0.501 11	0.339 7	0.553 4	0.529 2	0.478 9	0.000 3	0.000 1	0.404 8	0.001 7	0.022 9	0.077 7	0.000 3	0.894 9	0.219 4	0.628 6	0.093 11	0.305 10	0.886 1	0.233 5	0.000 1	0.603 7	0.112 5	0.023 7	0.000 4	0.000 1	0.000 7	0.741 3	0.664 5	0.097 11	0.253 10	0.782 9	0.264 7	0.523 9	0.154 1	0.707 12	0.000 4	0.411 6	0.000 1	0.000 5	0.000 3	0.332 12	0.000 2	0.000 5	0.000 1	0.602 5	0.595 8	0.185 11	0.656 12	0.159 5	0.000 1	0.355 9	0.424 11	0.154 11	0.729 11	0.516 8	0.220 8	0.620 3	0.084 9	0.000 1	0.707 10	0.651 9	0.173 3	0.014 7	0.381 13	0.582 11	0.000 1	0.619 2	0.049 10	0.000 5	0.000 1	0.702 3	0.000 2	0.000 1	0.302 12	0.489 11	0.317 9	0.334 7	0.392 4	0.922 10	0.254 9	0.533 10	0.394 9	0.129 13	0.613 11	0.000 1	0.000 9	0.820 3	0.649 9	0.749 10	0.000 1	0.782 10	0.282 6	0.863 4	0.000 1	0.288 12	0.006 8	0.220 9	0.633 10	0.542 3

PPT-SpUNet-F.T.	0.332 8	0.556 4	0.270 5	0.123 10	0.519 3	0.091 5	0.349 2	0.000 1	0.000 3	0.000 1	0.339 7	0.383 8	0.498 9	0.833 4	0.807 3	0.241 4	0.584 5	0.000 3	0.755 5	0.124 6	0.000 7	0.608 2	0.330 6	0.530 8	0.314 1	0.000 6	0.374 6	0.000 1	0.000 3	0.197 3	0.459 5	0.000 7	0.000 1	0.117 4	0.000 2	0.876 6	0.095 2	0.682 6	0.000 6	0.086 6	0.518 6	0.433 2	0.930 3	0.000 1	0.000 2	0.563 3	0.542 10	0.077 6	0.715 3	0.858 7	0.756 4	0.008 13	0.171 8	0.874 6	0.000 1	0.039 5	0.550 7	0.000 7	0.545 4	0.256 7	0.657 7	0.453 3	0.351 6	0.449 9	0.213 4	0.392 8	0.611 9	0.000 5	0.037 11	0.946 5	0.138 10	0.000 1	0.000 9	0.063 7	0.308 2	0.537 6	0.796 3	0.673 3	0.323 9	0.392 7	0.400 10	0.509 6	0.000 3	0.000 1	0.649 1	0.000 8	0.023 8	0.000 8	0.000 3	0.914 6	0.002 12	0.506 12	0.163 7	0.359 7	0.872 5	0.000 8	0.000 1	0.623 5	0.112 5	0.001 9	0.000 4	0.000 1	0.021 5	0.753 2	0.565 12	0.150 3	0.579 3	0.806 8	0.267 5	0.616 3	0.042 12	0.783 9	0.000 4	0.374 9	0.000 1	0.000 5	0.000 3	0.620 6	0.000 2	0.000 5	0.000 1	0.572 11	0.634 4	0.350 8	0.792 4	0.000 8	0.000 1	0.376 7	0.535 5	0.378 3	0.855 5	0.672 3	0.074 9	0.000 8	0.185 6	0.000 1	0.727 8	0.660 8	0.076 13	0.000 8	0.432 8	0.646 7	0.000 1	0.594 6	0.006 11	0.000 5	0.000 1	0.658 5	0.000 2	0.000 1	0.661 3	0.549 6	0.300 10	0.291 8	0.045 10	0.942 8	0.304 5	0.600 7	0.572 5	0.135 11	0.695 4	0.000 1	0.008 6	0.793 5	0.942 1	0.899 2	0.000 1	0.816 5	0.181 7	0.897 2	0.000 1	0.679 3	0.223 4	0.264 3	0.691 4	0.345 11
Xiaoyang Wu, Zhuotao Tian, Xin Wen, Bohao Peng, Xihui Liu, Kaicheng Yu, Hengshuang Zhao: Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Training. CVPR 2024
OctFormer ScanNet200	0.326 9	0.539 8	0.265 8	0.131 8	0.499 5	0.110 2	0.522 1	0.000 1	0.000 3	0.000 1	0.318 9	0.427 5	0.455 11	0.743 10	0.765 9	0.175 8	0.842 2	0.000 3	0.828 3	0.204 2	0.033 4	0.429 8	0.335 4	0.601 2	0.312 2	0.000 6	0.357 8	0.000 1	0.000 3	0.047 9	0.423 7	0.000 7	0.000 1	0.105 7	0.000 2	0.873 8	0.079 8	0.670 9	0.000 6	0.117 3	0.471 10	0.432 3	0.829 9	0.000 1	0.000 2	0.584 2	0.417 13	0.089 5	0.684 8	0.837 8	0.705 12	0.021 11	0.178 7	0.892 4	0.000 1	0.028 6	0.505 9	0.000 7	0.457 8	0.200 10	0.662 3	0.412 8	0.244 11	0.496 7	0.000 13	0.451 6	0.626 7	0.000 5	0.102 7	0.943 8	0.138 10	0.000 1	0.000 9	0.149 6	0.291 3	0.534 7	0.722 5	0.632 5	0.331 8	0.253 11	0.453 7	0.487 8	0.000 3	0.000 1	0.479 4	0.000 8	0.022 9	0.000 8	0.000 3	0.900 7	0.128 7	0.684 3	0.164 6	0.413 3	0.854 9	0.000 8	0.000 1	0.512 12	0.074 13	0.003 8	0.000 4	0.000 1	0.000 7	0.469 11	0.613 9	0.132 7	0.529 6	0.871 2	0.227 12	0.582 6	0.026 13	0.787 8	0.000 4	0.339 11	0.000 1	0.000 5	0.000 3	0.626 5	0.000 2	0.029 4	0.000 1	0.587 7	0.612 6	0.411 6	0.724 8	0.000 8	0.000 1	0.407 4	0.552 4	0.513 1	0.849 6	0.655 4	0.408 3	0.000 8	0.296 2	0.000 1	0.686 11	0.645 10	0.145 6	0.022 6	0.414 10	0.633 8	0.000 1	0.637 1	0.224 2	0.000 5	0.000 1	0.650 6	0.000 2	0.000 1	0.622 7	0.535 8	0.343 8	0.483 3	0.230 9	0.943 7	0.289 6	0.618 6	0.596 3	0.140 8	0.679 6	0.000 1	0.022 3	0.783 7	0.620 10	0.906 1	0.000 1	0.806 7	0.137 10	0.865 3	0.000 1	0.378 9	0.000 11	0.168 13	0.680 6	0.227 12
Peng-Shuai Wang: OctFormer: Octree-based Transformers for 3D Point Clouds. SIGGRAPH 2023
OA-CNN-L_ScanNet200	0.333 7	0.558 3	0.269 7	0.124 9	0.448 11	0.080 7	0.272 3	0.000 1	0.000 3	0.000 1	0.342 6	0.515 2	0.524 6	0.713 12	0.789 6	0.158 9	0.384 8	0.000 3	0.806 4	0.125 5	0.000 7	0.496 5	0.332 5	0.498 12	0.227 6	0.024 3	0.474 1	0.000 1	0.003 2	0.071 7	0.487 2	0.000 7	0.000 1	0.110 6	0.000 2	0.876 6	0.013 13	0.703 2	0.000 6	0.076 7	0.473 9	0.355 8	0.906 5	0.000 1	0.000 2	0.476 5	0.706 1	0.000 9	0.672 9	0.835 9	0.748 7	0.015 12	0.223 5	0.860 7	0.000 1	0.000 9	0.572 5	0.000 7	0.509 6	0.313 6	0.662 3	0.398 10	0.396 4	0.411 11	0.276 2	0.527 2	0.711 4	0.000 5	0.076 9	0.946 5	0.166 5	0.000 1	0.022 7	0.160 5	0.183 9	0.493 9	0.699 7	0.637 4	0.403 4	0.330 9	0.406 9	0.526 5	0.024 2	0.000 1	0.392 9	0.000 8	0.016 12	0.000 8	0.196 2	0.915 5	0.112 8	0.557 7	0.197 3	0.352 8	0.877 3	0.000 8	0.000 1	0.592 10	0.103 9	0.000 10	0.067 1	0.000 1	0.089 4	0.735 4	0.625 8	0.130 8	0.568 5	0.836 6	0.271 4	0.534 7	0.043 11	0.799 7	0.001 3	0.445 4	0.000 1	0.000 5	0.024 2	0.661 3	0.000 2	0.262 2	0.000 1	0.591 6	0.517 11	0.373 7	0.788 6	0.021 7	0.000 1	0.455 2	0.517 7	0.320 5	0.823 8	0.200 13	0.001 13	0.150 5	0.100 8	0.000 1	0.736 7	0.668 6	0.103 11	0.052 4	0.662 2	0.720 5	0.000 1	0.602 5	0.112 5	0.002 4	0.000 1	0.637 7	0.000 2	0.000 1	0.621 8	0.569 3	0.398 7	0.412 5	0.234 8	0.949 5	0.363 3	0.492 11	0.495 7	0.251 4	0.665 7	0.000 1	0.001 8	0.805 4	0.833 5	0.794 8	0.000 1	0.821 4	0.314 5	0.843 9	0.000 1	0.560 7	0.245 3	0.262 4	0.713 3	0.370 10

LGround	0.272 11	0.485 11	0.184 11	0.106 11	0.476 8	0.077 8	0.218 6	0.000 1	0.000 3	0.000 1	0.547 1	0.295 9	0.540 4	0.746 9	0.745 11	0.058 12	0.112 12	0.005 1	0.658 7	0.077 13	0.000 7	0.322 11	0.178 12	0.512 10	0.190 9	0.199 1	0.277 11	0.000 1	0.000 3	0.173 5	0.399 8	0.000 7	0.000 1	0.039 12	0.000 2	0.858 11	0.085 6	0.676 8	0.002 4	0.103 4	0.498 7	0.323 10	0.703 10	0.000 1	0.000 2	0.296 11	0.549 8	0.216 1	0.702 5	0.768 10	0.718 10	0.028 9	0.092 12	0.786 12	0.000 1	0.000 9	0.453 12	0.022 5	0.251 13	0.252 8	0.572 11	0.348 11	0.321 7	0.514 6	0.063 11	0.279 12	0.552 11	0.000 5	0.019 12	0.932 11	0.132 12	0.000 1	0.000 9	0.000 11	0.156 13	0.457 11	0.623 9	0.518 10	0.265 12	0.358 8	0.381 11	0.395 11	0.000 3	0.000 1	0.127 13	0.012 5	0.051 1	0.000 8	0.000 3	0.886 10	0.014 10	0.437 13	0.179 4	0.244 11	0.826 11	0.000 8	0.000 1	0.599 8	0.136 1	0.085 3	0.000 4	0.000 1	0.000 7	0.565 9	0.612 10	0.143 4	0.207 11	0.566 11	0.232 11	0.446 11	0.127 2	0.708 11	0.000 4	0.384 7	0.000 1	0.000 5	0.000 3	0.402 10	0.000 2	0.059 3	0.000 1	0.525 13	0.566 9	0.229 10	0.659 11	0.000 8	0.000 1	0.265 11	0.446 10	0.147 12	0.720 13	0.597 6	0.066 10	0.000 8	0.187 5	0.000 1	0.726 9	0.467 13	0.134 9	0.000 8	0.413 11	0.629 9	0.000 1	0.363 12	0.055 8	0.022 2	0.000 1	0.626 9	0.000 2	0.000 1	0.323 11	0.479 13	0.154 12	0.117 11	0.028 12	0.901 11	0.243 11	0.415 12	0.295 13	0.143 6	0.610 12	0.000 1	0.000 9	0.777 8	0.397 13	0.324 12	0.000 1	0.778 11	0.179 8	0.702 12	0.000 1	0.274 13	0.404 1	0.233 8	0.622 11	0.398 7
David Rozenberszki, Or Litany, Angela Dai: Language-Grounded Indoor 3D Semantic Segmentation in the Wild. arXiv
PTv3 ScanNet200	0.393 2	0.592 2	0.330 1	0.216 2	0.520 2	0.109 3	0.108 12	0.000 1	0.337 1	0.000 1	0.310 10	0.394 7	0.494 10	0.753 8	0.848 1	0.256 3	0.717 4	0.000 3	0.842 2	0.192 3	0.065 3	0.449 7	0.346 2	0.546 5	0.190 9	0.000 6	0.384 5	0.000 1	0.000 3	0.218 2	0.505 1	0.791 2	0.000 1	0.136 2	0.000 2	0.903 2	0.073 10	0.687 5	0.000 6	0.168 1	0.551 4	0.387 6	0.941 2	0.000 1	0.000 2	0.397 9	0.654 3	0.000 9	0.714 4	0.759 11	0.752 6	0.118 4	0.264 3	0.926 2	0.000 1	0.048 4	0.575 3	0.000 7	0.597 1	0.366 1	0.755 1	0.469 1	0.474 2	0.798 1	0.140 7	0.617 1	0.692 5	0.000 5	0.592 2	0.971 2	0.188 3	0.000 1	0.133 6	0.593 1	0.349 1	0.650 3	0.717 6	0.699 2	0.455 2	0.790 1	0.523 3	0.636 1	0.301 1	0.000 1	0.622 2	0.000 8	0.017 11	0.259 3	0.000 3	0.921 3	0.337 1	0.733 2	0.210 2	0.514 2	0.860 7	0.407 1	0.000 1	0.688 2	0.109 7	0.000 10	0.000 4	0.000 1	0.151 3	0.671 5	0.782 1	0.115 9	0.641 1	0.903 1	0.349 1	0.616 3	0.088 5	0.832 4	0.000 4	0.480 2	0.000 1	0.428 1	0.000 3	0.497 8	0.000 2	0.000 5	0.000 1	0.662 3	0.690 2	0.612 1	0.828 1	0.575 1	0.000 1	0.404 5	0.644 1	0.325 4	0.887 3	0.728 1	0.009 12	0.134 6	0.026 13	0.000 1	0.761 2	0.731 1	0.172 4	0.077 2	0.528 4	0.727 4	0.000 1	0.603 4	0.220 3	0.022 2	0.000 1	0.740 1	0.000 2	0.000 1	0.661 3	0.586 1	0.566 2	0.436 4	0.531 2	0.978 2	0.457 1	0.708 3	0.583 4	0.141 7	0.748 2	0.000 1	0.026 2	0.822 2	0.871 3	0.879 5	0.000 1	0.851 2	0.405 2	0.914 1	0.000 1	0.682 2	0.000 11	0.281 2	0.738 2	0.463 6
Xiaoyang Wu, Li Jiang, Peng-Shuai Wang, Zhijian Liu, Xihui Liu, Yu Qiao, Wanli Ouyang, Tong He, Hengshuang Zhao: Point Transformer V3: Simpler, Faster, Stronger. CVPR 2024 (Oral)
Minkowski 34D	0.253 12	0.463 12	0.154 13	0.102 12	0.381 13	0.084 6	0.134 11	0.000 1	0.000 3	0.000 1	0.386 5	0.141 13	0.279 13	0.737 11	0.703 12	0.014 13	0.164 11	0.000 3	0.663 6	0.092 12	0.000 7	0.224 12	0.291 7	0.531 7	0.056 13	0.000 6	0.242 12	0.000 1	0.000 3	0.013 11	0.331 12	0.000 7	0.000 1	0.035 13	0.001 1	0.858 11	0.059 12	0.650 12	0.000 6	0.056 10	0.353 12	0.299 11	0.670 11	0.000 1	0.000 2	0.284 12	0.484 11	0.071 7	0.594 12	0.720 12	0.710 11	0.027 10	0.068 13	0.813 10	0.000 1	0.005 8	0.492 10	0.164 1	0.274 12	0.111 12	0.571 12	0.307 13	0.293 9	0.307 13	0.150 6	0.163 13	0.531 12	0.002 4	0.545 3	0.932 11	0.093 13	0.000 1	0.000 9	0.002 10	0.159 11	0.368 13	0.581 11	0.440 13	0.228 13	0.406 6	0.282 13	0.294 12	0.000 3	0.000 1	0.189 12	0.060 2	0.036 4	0.000 8	0.000 3	0.897 8	0.000 13	0.525 10	0.025 13	0.205 13	0.771 13	0.000 8	0.000 1	0.593 9	0.108 8	0.044 4	0.000 4	0.000 1	0.000 7	0.282 13	0.589 11	0.094 12	0.169 12	0.466 13	0.227 12	0.419 13	0.125 3	0.757 10	0.002 2	0.334 12	0.000 1	0.000 5	0.000 3	0.357 11	0.000 2	0.000 5	0.000 1	0.582 8	0.513 12	0.337 9	0.612 13	0.000 8	0.000 1	0.250 12	0.352 13	0.136 13	0.724 12	0.655 4	0.280 7	0.000 8	0.046 12	0.000 1	0.606 13	0.559 11	0.159 5	0.102 1	0.445 6	0.655 6	0.000 1	0.310 13	0.117 4	0.000 5	0.000 1	0.581 13	0.026 1	0.000 1	0.265 13	0.483 12	0.084 13	0.097 13	0.044 11	0.865 13	0.142 13	0.588 8	0.351 11	0.272 2	0.596 13	0.000 1	0.003 7	0.622 12	0.720 8	0.096 13	0.000 1	0.771 12	0.016 12	0.772 11	0.000 1	0.302 11	0.194 5	0.214 10	0.621 12	0.197 13
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019
CSC-Pretrain	0.249 13	0.455 13	0.171 12	0.079 13	0.418 12	0.059 12	0.186 8	0.000 1	0.000 3	0.000 1	0.335 8	0.250 11	0.316 12	0.766 7	0.697 13	0.142 10	0.170 10	0.003 2	0.553 10	0.112 7	0.097 1	0.201 13	0.186 10	0.476 13	0.081 12	0.000 6	0.216 13	0.000 1	0.000 3	0.001 13	0.314 13	0.000 7	0.000 1	0.055 11	0.000 2	0.832 13	0.094 3	0.659 11	0.002 4	0.076 7	0.310 13	0.293 13	0.664 12	0.000 1	0.000 2	0.175 13	0.634 4	0.130 2	0.552 13	0.686 13	0.700 13	0.076 6	0.110 11	0.770 13	0.000 1	0.000 9	0.430 13	0.000 7	0.319 11	0.166 11	0.542 13	0.327 12	0.205 12	0.332 12	0.052 12	0.375 9	0.444 13	0.000 5	0.012 13	0.930 13	0.203 2	0.000 1	0.000 9	0.046 8	0.175 10	0.413 12	0.592 10	0.471 12	0.299 11	0.152 13	0.340 12	0.247 13	0.000 3	0.000 1	0.225 11	0.058 3	0.037 3	0.000 8	0.207 1	0.862 12	0.014 10	0.548 9	0.033 12	0.233 12	0.816 12	0.000 8	0.000 1	0.542 11	0.123 4	0.121 1	0.019 2	0.000 1	0.000 7	0.463 12	0.454 13	0.045 13	0.128 13	0.557 12	0.235 10	0.441 12	0.063 9	0.484 13	0.000 4	0.308 13	0.000 1	0.000 5	0.000 3	0.318 13	0.000 2	0.000 5	0.000 1	0.545 12	0.543 10	0.164 12	0.734 7	0.000 8	0.000 1	0.215 13	0.371 12	0.198 10	0.743 10	0.205 12	0.062 11	0.000 8	0.079 10	0.000 1	0.683 12	0.547 12	0.142 7	0.000 8	0.441 7	0.579 12	0.000 1	0.464 11	0.098 7	0.041 1	0.000 1	0.590 12	0.000 2	0.000 1	0.373 9	0.494 10	0.174 11	0.105 12	0.001 13	0.895 12	0.222 12	0.537 9	0.307 12	0.180 5	0.625 10	0.000 1	0.000 9	0.591 13	0.609 11	0.398 11	0.000 1	0.766 13	0.014 13	0.638 13	0.000 1	0.377 10	0.004 9	0.206 11	0.609 13	0.465 5
Ji Hou, Benjamin Graham, Matthias Nießner, Saining Xie: Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts. CVPR 2021

This table lists the benchmark results for the ScanNet200 3D semantic instance scenario.

Method	avg ap 50%	head ap 50%	common ap 50%	tail ap 50%	backpack	bag	ball	bar	basket	bathroom cabinet	bathroom stall	bathroom stall door	bathroom vanity	bathtub	bed	bench	bicycle	bin	blackboard	blanket	blinds	board	book	bookshelf	bottle	bowl	box	broom	bucket	bulletin board	cabinet	calendar	candle	cart	case of water bottles	ceiling	ceiling light	chair	clock	closet	closet rod	clothes	clothes dryer	coat rack	coffee kettle	coffee maker	coffee table	column	computer tower	copier	couch	counter	cup	curtain	cushion	decoration	desk	dining table	dish rack	dishwasher	door	doorframe	dresser	dumbbell	end table	fan	file cabinet	fire alarm	fire extinguisher	folded chair	hat	headphones	ironing board	jacket	keyboard	keyboard piano	kitchen cabinet	kitchen counter	ladder	lamp	laptop	laundry basket	laundry detergent	laundry hamper	ledge	light	light switch	machine	mailbox	mat	microwave	mini fridge	mirror	monitor	mouse	music stand	nightstand	object	office chair	oven	paper	paper bag	paper cutter	paper towel dispenser	paper towel roll	person	piano	picture	pillow	pipe	plant	plate	plunger	poster	power outlet	power strip	printer	projector	projector screen	rack	radiator	range hood	recycling bin	refrigerator	scale	seat	shelf	shoe	shower	shower curtain	shower curtain rod	shower floor	shower head	shower wall	sign	sink	soap dispenser	sofa chair	speaker	stair rail	stairs	stand	stool	storage bin	storage container	storage organizer	stove	structure	stuffed animal	suitcase	table	telephone	tissue box	toaster	toilet	toilet paper	toilet paper dispenser	towel	trash bin	trash can	tray	tube	tv	tv stand	vacuum cleaner	vent	wardrobe	washing machine	water bottle	water cooler	water pitcher	whiteboard	window	windowsill

TD3D Scannet200	0.320 2	0.501 2	0.264 2	0.164 2	0.506 3	0.062 2	0.500 1	0.000 1	0.000 1	0.000 1	0.208 1	0.431 2	0.252 3	1.000 1	0.733 3	0.587 2	0.000 2	0.008 2	0.000 3	0.106 1	0.000 2	0.356 1	0.123 4	0.686 1	0.101 2	0.000 1	0.152 2	0.000 1	0.000 2	0.226 1	0.280 3	0.000 2	0.000 1	0.250 1	0.000 1	0.619 2	0.061 3	0.841 1	0.000 1	0.000 2	0.167 1	0.194 1	0.333 2	0.000 2	0.000 1	0.667 2	0.820 1	0.250 3	0.790 4	1.000 1	0.879 2	0.077 1	0.094 3	0.708 1	0.217 2	0.049 2	0.634 1	0.792 1	0.331 4	0.033 5	0.716 2	0.159 2	0.396 2	0.331 4	0.099 2	0.415 1	0.842 1	0.000 2	0.458 1	0.542 1	0.000 1	0.101 2	0.000 1	0.218 1	0.513 2	0.500 2	0.458 2	0.104 2	0.516 1	0.456 1	0.268 4	0.000 1	0.000 1	0.400 1	0.022 1	0.233 2	0.143 2	0.000 1	0.677 1	0.400 1	0.504 5	0.095 3	0.083 5	0.890 2	0.061 2	0.000 1	0.906 1	0.076 2	0.231 1	0.125 2	0.000 2	0.003 2	0.792 3	0.881 1	0.000 2	0.098 3	0.125 4	0.498 5	0.459 2	0.063 1	0.715 1	0.000 2	0.241 4	0.000 1	0.396 2	0.063 1	0.605 1	0.000 1	0.000 2	0.000 1	0.448 5	0.629 3	0.202 2	0.967 1	0.250 2	0.038 1	0.192 1	0.185 2	0.083 4	1.000 1	1.000 1	0.857 2	0.000 2	0.470 2	0.012 1	0.565 3	0.798 1	0.621 1	0.111 1	0.500 1	1.000 1	0.017 2	0.509 1	0.000 1	0.008 1	1.000 1	0.525 2	0.000 1	0.000 1	0.332 3	0.679 1	0.264 2	0.333 2	0.267 1	1.000 1	0.549 1	0.299 5	0.387 2	0.328 3	0.744 4	0.000 1	0.000 2	0.435 5	1.000 1	0.283 4	0.000 1	0.196 1	0.817 1	0.000 1	0.472 1	0.222 3	0.123 4	0.560 2	0.156 2
Maksim Kolodiazhnyi, Anna Vorontsova, Anton Konushin, Danila Rukhovich: Top-Down Beats Bottom-Up in 3D Instance Segmentation. WACV 2024
Mask3D Scannet200	0.388 1	0.542 1	0.357 1	0.237 1	0.610 1	0.091 1	0.125 5	0.000 1	0.000 1	0.000 1	0.065 3	0.668 1	0.451 1	1.000 1	0.955 1	0.640 1	0.500 1	0.039 1	0.125 2	0.063 2	0.409 1	0.311 2	0.291 1	0.609 3	0.266 1	0.000 1	0.163 1	0.000 1	0.008 1	0.044 2	0.496 1	1.000 1	0.000 1	0.018 2	0.000 1	0.756 1	0.573 1	0.808 2	0.000 1	0.010 1	0.042 3	0.130 3	0.552 1	0.042 1	0.000 1	1.000 1	0.725 4	0.750 1	0.883 1	1.000 1	0.832 4	0.024 2	0.107 1	0.614 3	0.226 1	0.250 1	0.628 2	0.792 1	0.677 2	0.400 1	0.741 1	0.278 1	0.511 1	0.077 5	0.111 1	0.313 2	0.715 2	0.302 1	0.017 3	0.200 2	0.000 1	0.188 1	0.000 1	0.178 2	0.736 1	1.000 1	0.615 1	0.514 1	0.409 2	0.380 5	0.600 1	0.000 1	0.000 1	0.400 1	0.013 2	0.254 1	0.381 1	0.000 1	0.123 4	0.400 1	0.839 1	0.258 1	0.463 1	0.926 1	0.265 1	0.000 1	0.857 2	0.099 1	0.021 2	0.500 1	0.027 1	0.028 1	1.000 1	0.502 5	0.016 1	0.076 4	0.500 1	0.612 1	0.578 1	0.005 2	0.597 2	0.194 1	0.497 1	0.000 1	0.500 1	0.000 2	0.323 4	0.000 1	1.000 1	0.000 1	0.748 1	0.708 2	0.050 4	0.890 2	1.000 1	0.008 2	0.151 3	0.301 1	1.000 1	1.000 1	0.792 3	0.945 1	1.000 1	0.511 1	0.004 2	0.753 1	0.776 2	0.287 2	0.020 2	0.003 4	0.974 3	0.033 1	0.412 5	0.000 1	0.000 2	0.000 2	0.667 1	0.000 1	0.000 1	0.491 1	0.676 2	0.352 1	0.335 1	0.060 2	0.822 5	0.527 2	1.000 1	0.517 1	0.606 1	0.853 1	0.000 1	0.004 1	0.806 1	1.000 1	0.727 1	0.000 1	0.042 2	0.739 2	0.000 1	0.399 3	0.391 1	0.504 1	0.591 1	0.571 1
Jonas Schult, Francis Engelmann, Alexander Hermans, Or Litany, Siyu Tang, Bastian Leibe: Mask3D for 3D Semantic Instance Segmentation. ICRA 2023
Minkowski 34D Inst.	0.203 5	0.369 4	0.134 5	0.078 5	0.479 4	0.003 4	0.500 1	0.000 1	0.000 1	0.000 1	0.100 2	0.371 3	0.300 2	0.667 4	0.746 2	0.400 3	0.000 2	0.000 3	0.000 3	0.031 3	0.000 2	0.074 4	0.165 3	0.413 5	0.000 4	0.000 1	0.070 4	0.000 1	0.000 2	0.000 3	0.221 5	0.000 2	0.000 1	0.000 3	0.000 1	0.372 5	0.070 2	0.706 4	0.000 1	0.000 2	0.000 5	0.123 4	0.033 5	0.000 2	0.000 1	0.422 5	0.732 3	0.000 4	0.778 5	1.000 1	0.845 3	0.000 3	0.090 4	0.636 2	0.000 3	0.000 3	0.158 4	0.000 3	0.250 5	0.050 4	0.693 3	0.123 4	0.051 5	0.385 3	0.009 4	0.118 5	0.406 5	0.000 2	0.000 4	0.200 2	0.000 1	0.000 3	0.000 1	0.133 4	0.307 5	0.500 2	0.251 4	0.000 4	0.281 3	0.402 4	0.317 2	0.000 1	0.000 1	0.000 3	0.000 3	0.060 4	0.000 3	0.000 1	0.396 2	0.200 3	0.669 2	0.021 4	0.218 4	0.720 5	0.000 3	0.000 1	0.696 3	0.025 4	0.000 3	0.000 3	0.000 2	0.000 3	0.125 5	0.596 2	0.000 2	0.191 1	0.500 1	0.595 2	0.369 4	0.000 3	0.500 4	0.000 2	0.143 5	0.000 1	0.000 3	0.000 2	0.226 5	0.000 1	0.000 2	0.000 1	0.701 2	0.511 4	0.000 5	0.851 4	0.000 3	0.000 3	0.150 4	0.052 5	0.100 3	0.981 3	0.500 4	0.286 3	0.000 2	0.000 5	0.000 3	0.545 4	0.522 5	0.250 3	0.000 3	0.000 5	0.522 5	0.000 3	0.500 2	0.000 1	0.000 2	0.000 2	0.282 5	0.000 1	0.000 1	0.178 5	0.382 4	0.018 5	0.056 4	0.000 3	0.997 3	0.107 5	0.677 2	0.313 4	0.000 4	0.726 5	0.000 1	0.000 2	0.583 4	0.903 4	0.200 5	0.000 1	0.000 3	0.333 4	0.000 1	0.442 2	0.083 4	0.109 5	0.387 4	0.000 5
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019
CSC-Pretrain Inst.	0.209 4	0.361 5	0.157 4	0.085 4	0.506 2	0.007 3	0.500 1	0.000 1	0.000 1	0.000 1	0.000 5	0.093 5	0.221 4	0.667 4	0.524 5	0.400 3	0.000 2	0.000 3	0.000 3	0.004 4	0.000 2	0.000 5	0.109 5	0.589 4	0.000 4	0.000 1	0.059 5	0.000 1	0.000 2	0.000 3	0.322 2	0.000 2	0.000 1	0.000 3	0.000 1	0.405 3	0.055 4	0.700 5	0.000 1	0.000 2	0.028 4	0.091 5	0.083 3	0.000 2	0.000 1	0.667 2	0.768 2	0.000 4	0.807 3	1.000 1	0.776 5	0.000 3	0.000 5	0.340 5	0.000 3	0.000 3	0.103 5	0.000 3	0.750 1	0.200 3	0.634 5	0.053 5	0.246 3	0.677 2	0.006 5	0.198 3	0.432 4	0.000 2	0.000 4	0.050 4	0.000 1	0.000 3	0.000 1	0.111 5	0.356 4	0.500 2	0.188 5	0.000 4	0.220 4	0.448 2	0.050 5	0.000 1	0.000 1	0.000 3	0.000 3	0.032 5	0.000 3	0.000 1	0.396 2	0.000 4	0.573 4	0.000 5	0.228 3	0.747 4	0.000 3	0.000 1	0.573 5	0.021 5	0.000 3	0.000 3	0.000 2	0.000 3	0.500 4	0.573 3	0.000 2	0.000 5	0.125 4	0.592 3	0.364 5	0.000 3	0.450 5	0.000 2	0.364 2	0.000 1	0.000 3	0.000 2	0.340 3	0.000 1	0.000 2	0.000 1	0.610 3	0.833 1	0.221 1	0.702 5	0.000 3	0.000 3	0.135 5	0.094 4	0.125 2	0.571 4	0.500 4	0.143 5	0.000 2	0.125 3	0.000 3	0.618 2	0.667 4	0.115 5	0.000 3	0.125 2	1.000 1	0.000 3	0.500 2	0.000 1	0.000 2	0.000 2	0.502 4	0.000 1	0.000 1	0.312 4	0.248 5	0.050 4	0.000 5	0.000 3	0.997 3	0.420 3	0.500 4	0.149 5	0.451 2	0.748 2	0.000 1	0.000 2	0.636 3	0.667 5	0.600 2	0.000 1	0.000 3	0.278 5	0.000 1	0.333 4	0.000 5	0.294 2	0.381 5	0.110 3
Ji Hou, Benjamin Graham, Matthias Nießner, Saining Xie: Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts. CVPR 2021
LGround Inst.	0.246 3	0.413 3	0.170 3	0.130 3	0.455 5	0.003 5	0.500 1	0.000 1	0.000 1	0.000 1	0.017 4	0.333 4	0.111 5	1.000 1	0.681 4	0.400 3	0.000 2	0.000 3	1.000 1	0.003 5	0.000 2	0.167 3	0.190 2	0.637 2	0.067 3	0.000 1	0.081 3	0.000 1	0.000 2	0.000 3	0.264 4	0.000 2	0.000 1	0.000 3	0.000 1	0.387 4	0.031 5	0.754 3	0.000 1	0.000 2	0.151 2	0.135 2	0.056 4	0.000 2	0.000 1	0.582 4	0.589 5	0.500 2	0.815 2	1.000 1	0.903 1	0.000 3	0.097 2	0.588 4	0.000 3	0.000 3	0.234 3	0.000 3	0.500 3	0.400 1	0.682 4	0.156 3	0.159 4	0.750 1	0.046 3	0.125 4	0.660 3	0.000 2	0.200 2	0.000 5	0.000 1	0.000 3	0.000 1	0.164 3	0.402 3	0.500 2	0.373 3	0.025 3	0.143 5	0.426 3	0.317 2	0.000 1	0.000 1	0.000 3	0.000 3	0.063 3	0.000 3	0.000 1	0.000 5	0.000 4	0.575 3	0.250 2	0.241 2	0.772 3	0.000 3	0.000 1	0.653 4	0.034 3	0.000 3	0.000 3	0.000 2	0.000 3	1.000 1	0.561 4	0.000 2	0.100 2	0.500 1	0.541 4	0.452 3	0.000 3	0.581 3	0.000 2	0.364 2	0.000 1	0.000 3	0.000 2	0.571 2	0.000 1	0.000 2	0.000 1	0.568 4	0.511 4	0.167 3	0.857 3	0.000 3	0.000 3	0.164 2	0.112 3	0.000 5	0.530 5	1.000 1	0.286 3	0.000 2	0.125 3	0.000 3	0.464 5	0.706 3	0.208 4	0.000 3	0.125 2	0.744 4	0.000 3	0.500 2	0.000 1	0.000 2	0.000 2	0.511 3	0.000 1	0.000 1	0.344 2	0.541 3	0.068 3	0.333 2	0.000 3	1.000 1	0.196 4	0.533 3	0.318 3	0.000 4	0.748 3	0.000 1	0.000 2	0.690 2	1.000 1	0.400 3	0.000 1	0.000 3	0.667 3	0.000 1	0.333 4	0.333 2	0.270 3	0.399 3	0.083 4
David Rozenberszki, Or Litany, Angela Dai: Language-Grounded Indoor 3D Semantic Segmentation in the Wild.

ScanNet Benchmark

This table lists the benchmark results for the 3D semantic label scenario.

Method	avg iou	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	floor	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	wall	window

PTv3-PPT-ALC	0.798 1	0.911 10	0.812 20	0.854 6	0.770 11	0.856 13	0.555 13	0.943 1	0.660 23	0.735 2	0.979 1	0.606 6	0.492 1	0.792 3	0.934 3	0.841 2	0.819 4	0.716 7	0.947 9	0.906 1	0.822 1
Guangda Ji, Silvan Weder, Francis Engelmann, Marc Pollefeys, Hermann Blum: ARKit LabelMaker: A New Scale for Indoor 3D Scene Understanding. arxiv
PTv3 ScanNet	0.794 2	0.941 3	0.813 19	0.851 8	0.782 6	0.890 2	0.597 1	0.916 3	0.696 8	0.713 4	0.979 1	0.635 1	0.384 3	0.793 2	0.907 9	0.821 5	0.790 32	0.696 12	0.967 3	0.903 2	0.805 2
Xiaoyang Wu, Li Jiang, Peng-Shuai Wang, Zhijian Liu, Xihui Liu, Yu Qiao, Wanli Ouyang, Tong He, Hengshuang Zhao: Point Transformer V3: Simpler, Faster, Stronger. CVPR 2024 (Oral)
PonderV2	0.785 3	0.978 1	0.800 28	0.833 24	0.788 4	0.853 17	0.545 17	0.910 6	0.713 1	0.705 5	0.979 1	0.596 8	0.390 2	0.769 13	0.832 42	0.821 5	0.792 31	0.730 1	0.975 1	0.897 5	0.785 5
Haoyi Zhu, Honghui Yang, Xiaoyang Wu, Di Huang, Sha Zhang, Xianglong He, Tong He, Hengshuang Zhao, Chunhua Shen, Yu Qiao, Wanli Ouyang: PonderV2: Pave the Way for 3D Foundataion Model with A Universal Pre-training Paradigm.
Mix3D	0.781 4	0.964 2	0.855 1	0.843 17	0.781 7	0.858 12	0.575 6	0.831 34	0.685 14	0.714 3	0.979 1	0.594 9	0.310 27	0.801 1	0.892 17	0.841 2	0.819 4	0.723 4	0.940 14	0.887 7	0.725 25
Alexey Nekrasov, Jonas Schult, Or Litany, Bastian Leibe, Francis Engelmann: Mix3D: Out-of-Context Data Augmentation for 3D Scenes. 3DV 2021 (Oral)
Swin3D	0.779 5	0.861 21	0.818 14	0.836 21	0.790 3	0.875 4	0.576 5	0.905 7	0.704 5	0.739 1	0.969 11	0.611 2	0.349 11	0.756 23	0.958 1	0.702 46	0.805 15	0.708 8	0.916 33	0.898 4	0.801 3

TTT-KD	0.773 6	0.646 92	0.818 14	0.809 36	0.774 9	0.878 3	0.581 2	0.943 1	0.687 12	0.704 6	0.978 5	0.607 5	0.336 16	0.775 9	0.912 7	0.838 4	0.823 2	0.694 13	0.967 3	0.899 3	0.794 4
Lisa Weijler, Muhammad Jehanzeb Mirza, Leon Sick, Can Ekkazan, Pedro Hermosilla: TTT-KD: Test-Time Training for 3D Semantic Segmentation through Knowledge Distillation from Foundation Models.
ResLFE_HDS	0.772 7	0.939 4	0.824 6	0.854 6	0.771 10	0.840 31	0.564 10	0.900 9	0.686 13	0.677 13	0.961 17	0.537 32	0.348 12	0.769 13	0.903 11	0.785 11	0.815 7	0.676 23	0.939 15	0.880 12	0.772 9

PPT-SpUNet-Joint	0.766 8	0.932 5	0.794 34	0.829 26	0.751 23	0.854 15	0.540 21	0.903 8	0.630 35	0.672 16	0.963 15	0.565 22	0.357 9	0.788 4	0.900 13	0.737 26	0.802 16	0.685 18	0.950 7	0.887 7	0.780 6
Xiaoyang Wu, Zhuotao Tian, Xin Wen, Bohao Peng, Xihui Liu, Kaicheng Yu, Hengshuang Zhao: Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Training. CVPR 2024
OctFormer	0.766 8	0.925 7	0.808 24	0.849 10	0.786 5	0.846 27	0.566 9	0.876 16	0.690 10	0.674 15	0.960 18	0.576 18	0.226 68	0.753 25	0.904 10	0.777 13	0.815 7	0.722 5	0.923 28	0.877 14	0.776 8
Peng-Shuai Wang: OctFormer: Octree-based Transformers for 3D Point Clouds. SIGGRAPH 2023
OccuSeg+Semantic	0.764 10	0.758 59	0.796 32	0.839 19	0.746 26	0.907 1	0.562 11	0.850 26	0.680 16	0.672 16	0.978 5	0.610 3	0.335 18	0.777 7	0.819 46	0.847 1	0.830 1	0.691 15	0.972 2	0.885 9	0.727 23

CU-Hybrid Net	0.764 10	0.924 8	0.819 12	0.840 18	0.757 18	0.853 17	0.580 3	0.848 27	0.709 3	0.643 25	0.958 22	0.587 13	0.295 34	0.753 25	0.884 21	0.758 20	0.815 7	0.725 3	0.927 25	0.867 23	0.743 16

O-CNN	0.762 12	0.924 8	0.823 7	0.844 16	0.770 11	0.852 19	0.577 4	0.847 29	0.711 2	0.640 29	0.958 22	0.592 10	0.217 74	0.762 18	0.888 18	0.758 20	0.813 11	0.726 2	0.932 23	0.868 22	0.744 15
Peng-Shuai Wang, Yang Liu, Yu-Xiao Guo, Chun-Yu Sun, Xin Tong: O-CNN: Octree-based Convolutional Neural Networks for 3D Shape Analysis. SIGGRAPH 2017
DTC	0.757 13	0.843 27	0.820 10	0.847 13	0.791 2	0.862 10	0.511 34	0.870 18	0.707 4	0.652 21	0.954 36	0.604 7	0.279 45	0.760 19	0.942 2	0.734 27	0.766 45	0.701 11	0.884 55	0.874 20	0.736 17

OA-CNN-L_ScanNet20	0.756 14	0.783 45	0.826 5	0.858 4	0.776 8	0.837 34	0.548 16	0.896 12	0.649 27	0.675 14	0.962 16	0.586 14	0.335 18	0.771 12	0.802 50	0.770 16	0.787 34	0.691 15	0.936 18	0.880 12	0.761 11

ConDaFormer	0.755 15	0.927 6	0.822 8	0.836 21	0.801 1	0.849 22	0.516 31	0.864 23	0.651 26	0.680 12	0.958 22	0.584 16	0.282 42	0.759 21	0.855 32	0.728 29	0.802 16	0.678 20	0.880 60	0.873 21	0.756 13
Lunhao Duan, Shanshan Zhao, Nan Xue, Mingming Gong, Guisong Xia, Dacheng Tao: ConDaFormer : Disassembled Transformer with Local Structure Enhancement for 3D Point Cloud Understanding. Neurips, 2023
PNE	0.755 15	0.786 43	0.835 4	0.834 23	0.758 16	0.849 22	0.570 8	0.836 33	0.648 28	0.668 18	0.978 5	0.581 17	0.367 7	0.683 36	0.856 30	0.804 7	0.801 20	0.678 20	0.961 5	0.889 6	0.716 30
P. Hermosilla: Point Neighborhood Embeddings.
DMF-Net	0.752 17	0.906 13	0.793 36	0.802 42	0.689 41	0.825 47	0.556 12	0.867 19	0.681 15	0.602 45	0.960 18	0.555 28	0.365 8	0.779 6	0.859 27	0.747 23	0.795 28	0.717 6	0.917 32	0.856 31	0.764 10
C.Yang, Y.Yan, W.Zhao, J.Ye, X.Yang, A.Hussain, B.Dong, K.Huang: Towards Deeper and Better Multi-view Feature Fusion for 3D Semantic Segmentation. ICONIP 2023
PointTransformerV2	0.752 17	0.742 67	0.809 23	0.872 1	0.758 16	0.860 11	0.552 14	0.891 14	0.610 42	0.687 7	0.960 18	0.559 26	0.304 30	0.766 16	0.926 5	0.767 17	0.797 24	0.644 34	0.942 12	0.876 17	0.722 27
Xiaoyang Wu, Yixing Lao, Li Jiang, Xihui Liu, Hengshuang Zhao: Point Transformer V2: Grouped Vector Attention and Partition-based Pooling. NeurIPS 2022
BPNet	0.749 19	0.909 11	0.818 14	0.811 34	0.752 21	0.839 33	0.485 48	0.842 30	0.673 18	0.644 24	0.957 26	0.528 38	0.305 29	0.773 10	0.859 27	0.788 9	0.818 6	0.693 14	0.916 33	0.856 31	0.723 26
Wenbo Hu, Hengshuang Zhao, Li Jiang, Jiaya Jia, Tien-Tsin Wong: Bidirectional Projection Network for Cross Dimension Scene Understanding. CVPR 2021 (Oral)
PointConvFormer	0.749 19	0.793 41	0.790 37	0.807 38	0.750 25	0.856 13	0.524 27	0.881 15	0.588 54	0.642 28	0.977 9	0.591 11	0.274 48	0.781 5	0.929 4	0.804 7	0.796 25	0.642 35	0.947 9	0.885 9	0.715 31
Wenxuan Wu, Qi Shan, Li Fuxin: PointConvFormer: Revenge of the Point-based Convolution.
MSP	0.748 21	0.623 95	0.804 26	0.859 3	0.745 27	0.824 49	0.501 38	0.912 5	0.690 10	0.685 9	0.956 27	0.567 21	0.320 24	0.768 15	0.918 6	0.720 34	0.802 16	0.676 23	0.921 30	0.881 11	0.779 7

StratifiedFormer	0.747 22	0.901 14	0.803 27	0.845 15	0.757 18	0.846 27	0.512 33	0.825 37	0.696 8	0.645 23	0.956 27	0.576 18	0.262 59	0.744 30	0.861 26	0.742 24	0.770 43	0.705 9	0.899 45	0.860 28	0.734 18
Xin Lai, Jianhui Liu, Li Jiang, Liwei Wang, Hengshuang Zhao, Shu Liu, Xiaojuan Qi, Jiaya Jia: Stratified Transformer for 3D Point Cloud Segmentation. CVPR 2022
Virtual MVFusion	0.746 23	0.771 53	0.819 12	0.848 12	0.702 38	0.865 9	0.397 86	0.899 10	0.699 6	0.664 19	0.948 56	0.588 12	0.330 20	0.746 29	0.851 36	0.764 18	0.796 25	0.704 10	0.935 19	0.866 24	0.728 21
Abhijit Kundu, Xiaoqi Yin, Alireza Fathi, David Ross, Brian Brewington, Thomas Funkhouser, Caroline Pantofaru: Virtual Multi-view Fusion for 3D Semantic Segmentation. ECCV 2020
VMNet	0.746 23	0.870 19	0.838 2	0.858 4	0.729 32	0.850 21	0.501 38	0.874 17	0.587 55	0.658 20	0.956 27	0.564 23	0.299 32	0.765 17	0.900 13	0.716 37	0.812 12	0.631 40	0.939 15	0.858 29	0.709 32
Zeyu HU, Xuyang Bai, Jiaxiang Shang, Runze Zhang, Jiayu Dong, Xin Wang, Guangyuan Sun, Hongbo Fu, Chiew-Lan Tai: VMNet: Voxel-Mesh Network for Geodesic-Aware 3D Semantic Segmentation. ICCV 2021 (Oral)
DiffSeg3D2	0.745 25	0.725 76	0.814 18	0.837 20	0.751 23	0.831 41	0.514 32	0.896 12	0.674 17	0.684 10	0.960 18	0.564 23	0.303 31	0.773 10	0.820 45	0.713 40	0.798 23	0.690 17	0.923 28	0.875 18	0.757 12

Retro-FPN	0.744 26	0.842 28	0.800 28	0.767 56	0.740 28	0.836 36	0.541 19	0.914 4	0.672 19	0.626 33	0.958 22	0.552 29	0.272 50	0.777 7	0.886 20	0.696 47	0.801 20	0.674 26	0.941 13	0.858 29	0.717 28
Peng Xiang, Xin Wen, Yu-Shen Liu, Hui Zhang, Yi Fang, Zhizhong Han: Retrospective Feature Pyramid Network for Point Cloud Semantic Segmentation. ICCV 2023
EQ-Net	0.743 27	0.620 96	0.799 31	0.849 10	0.730 31	0.822 51	0.493 45	0.897 11	0.664 20	0.681 11	0.955 30	0.562 25	0.378 4	0.760 19	0.903 11	0.738 25	0.801 20	0.673 27	0.907 37	0.877 14	0.745 14
Zetong Yang, Li Jiang, Yanan Sun, Bernt Schiele, Jiaya JIa: A Unified Query-based Paradigm for Point Cloud Understanding. CVPR 2022
SAT	0.742 28	0.860 22	0.765 50	0.819 29	0.769 13	0.848 24	0.533 23	0.829 35	0.663 21	0.631 32	0.955 30	0.586 14	0.274 48	0.753 25	0.896 15	0.729 28	0.760 51	0.666 29	0.921 30	0.855 33	0.733 19

LRPNet	0.742 28	0.816 36	0.806 25	0.807 38	0.752 21	0.828 45	0.575 6	0.839 32	0.699 6	0.637 30	0.954 36	0.520 41	0.320 24	0.755 24	0.834 40	0.760 19	0.772 40	0.676 23	0.915 35	0.862 26	0.717 28

LargeKernel3D	0.739 30	0.909 11	0.820 10	0.806 40	0.740 28	0.852 19	0.545 17	0.826 36	0.594 53	0.643 25	0.955 30	0.541 31	0.263 58	0.723 34	0.858 29	0.775 15	0.767 44	0.678 20	0.933 21	0.848 38	0.694 37
Yukang Chen, Jianhui Liu, Xiangyu Zhang, Xiaojuan Qi, Jiaya Jia: LargeKernel3D: Scaling up Kernels in 3D Sparse CNNs. CVPR 2023
RPN	0.736 31	0.776 49	0.790 37	0.851 8	0.754 20	0.854 15	0.491 47	0.866 21	0.596 52	0.686 8	0.955 30	0.536 33	0.342 14	0.624 51	0.869 23	0.787 10	0.802 16	0.628 41	0.927 25	0.875 18	0.704 34

MinkowskiNet	0.736 31	0.859 23	0.818 14	0.832 25	0.709 36	0.840 31	0.521 29	0.853 25	0.660 23	0.643 25	0.951 46	0.544 30	0.286 40	0.731 32	0.893 16	0.675 56	0.772 40	0.683 19	0.874 67	0.852 36	0.727 23
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019
IPCA	0.731 33	0.890 15	0.837 3	0.864 2	0.726 33	0.873 5	0.530 26	0.824 38	0.489 88	0.647 22	0.978 5	0.609 4	0.336 16	0.624 51	0.733 59	0.758 20	0.776 38	0.570 66	0.949 8	0.877 14	0.728 21

PointTransformer++	0.725 34	0.727 75	0.811 22	0.819 29	0.765 14	0.841 30	0.502 37	0.814 43	0.621 38	0.623 35	0.955 30	0.556 27	0.284 41	0.620 53	0.866 24	0.781 12	0.757 55	0.648 32	0.932 23	0.862 26	0.709 32

SparseConvNet	0.725 34	0.647 91	0.821 9	0.846 14	0.721 34	0.869 6	0.533 23	0.754 59	0.603 48	0.614 37	0.955 30	0.572 20	0.325 22	0.710 35	0.870 22	0.724 32	0.823 2	0.628 41	0.934 20	0.865 25	0.683 40

MatchingNet	0.724 36	0.812 38	0.812 20	0.810 35	0.735 30	0.834 38	0.495 44	0.860 24	0.572 62	0.602 45	0.954 36	0.512 43	0.280 44	0.757 22	0.845 38	0.725 31	0.780 36	0.606 51	0.937 17	0.851 37	0.700 36

INS-Conv-semantic	0.717 37	0.751 62	0.759 53	0.812 33	0.704 37	0.868 7	0.537 22	0.842 30	0.609 44	0.608 41	0.953 40	0.534 35	0.293 35	0.616 54	0.864 25	0.719 36	0.793 29	0.640 36	0.933 21	0.845 42	0.663 46

PointMetaBase	0.714 38	0.835 29	0.785 39	0.821 27	0.684 43	0.846 27	0.531 25	0.865 22	0.614 39	0.596 49	0.953 40	0.500 46	0.246 64	0.674 37	0.888 18	0.692 48	0.764 47	0.624 43	0.849 82	0.844 43	0.675 42

contrastBoundary	0.705 39	0.769 56	0.775 44	0.809 36	0.687 42	0.820 54	0.439 74	0.812 44	0.661 22	0.591 51	0.945 64	0.515 42	0.171 92	0.633 48	0.856 30	0.720 34	0.796 25	0.668 28	0.889 52	0.847 39	0.689 38
Liyao Tang, Yibing Zhan, Zhe Chen, Baosheng Yu, Dacheng Tao: Contrastive Boundary Learning for Point Cloud Segmentation. CVPR2022
ClickSeg_Semantic	0.703 40	0.774 51	0.800 28	0.793 47	0.760 15	0.847 26	0.471 52	0.802 47	0.463 95	0.634 31	0.968 13	0.491 49	0.271 52	0.726 33	0.910 8	0.706 42	0.815 7	0.551 78	0.878 61	0.833 44	0.570 78

RFCR	0.702 41	0.889 16	0.745 64	0.813 32	0.672 46	0.818 58	0.493 45	0.815 42	0.623 36	0.610 39	0.947 58	0.470 58	0.249 63	0.594 57	0.848 37	0.705 43	0.779 37	0.646 33	0.892 50	0.823 50	0.611 61
Jingyu Gong, Jiachen Xu, Xin Tan, Haichuan Song, Yanyun Qu, Yuan Xie, Lizhuang Ma: Omni-Supervised Point Cloud Segmentation via Gradual Receptive Field Component Reasoning. CVPR2021
One Thing One Click	0.701 42	0.825 33	0.796 32	0.723 63	0.716 35	0.832 40	0.433 76	0.816 40	0.634 33	0.609 40	0.969 11	0.418 84	0.344 13	0.559 69	0.833 41	0.715 38	0.808 14	0.560 72	0.902 42	0.847 39	0.680 41

JSENet	0.699 43	0.881 18	0.762 51	0.821 27	0.667 47	0.800 70	0.522 28	0.792 50	0.613 40	0.607 42	0.935 84	0.492 48	0.205 79	0.576 62	0.853 34	0.691 50	0.758 53	0.652 31	0.872 70	0.828 47	0.649 50
Zeyu HU, Mingmin Zhen, Xuyang BAI, Hongbo Fu, Chiew-lan Tai: JSENet: Joint Semantic Segmentation and Edge Detection Network for 3D Point Clouds. ECCV 2020
One-Thing-One-Click	0.693 44	0.743 66	0.794 34	0.655 86	0.684 43	0.822 51	0.497 43	0.719 69	0.622 37	0.617 36	0.977 9	0.447 71	0.339 15	0.750 28	0.664 75	0.703 45	0.790 32	0.596 56	0.946 11	0.855 33	0.647 51
Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu: One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation. CVPR 2021
PicassoNet-II	0.692 45	0.732 71	0.772 45	0.786 48	0.677 45	0.866 8	0.517 30	0.848 27	0.509 81	0.626 33	0.952 44	0.536 33	0.225 70	0.545 75	0.704 66	0.689 53	0.810 13	0.564 71	0.903 41	0.854 35	0.729 20
Huan Lei, Naveed Akhtar, Mubarak Shah, and Ajmal Mian: Geometric feature learning for 3D meshes.
Feature_GeometricNet	0.690 46	0.884 17	0.754 57	0.795 45	0.647 54	0.818 58	0.422 78	0.802 47	0.612 41	0.604 43	0.945 64	0.462 61	0.189 87	0.563 68	0.853 34	0.726 30	0.765 46	0.632 39	0.904 39	0.821 53	0.606 65
Kangcheng Liu, Ben M. Chen: https://arxiv.org/abs/2012.09439. arXiv Preprint
FusionNet	0.688 47	0.704 81	0.741 68	0.754 60	0.656 49	0.829 43	0.501 38	0.741 64	0.609 44	0.548 59	0.950 50	0.522 40	0.371 5	0.633 48	0.756 54	0.715 38	0.771 42	0.623 44	0.861 78	0.814 56	0.658 47
Feihu Zhang, Jin Fang, Benjamin Wah, Philip Torr: Deep FusionNet for Point Cloud Semantic Segmentation. ECCV 2020
Feature-Geometry Net	0.685 48	0.866 20	0.748 61	0.819 29	0.645 56	0.794 73	0.450 64	0.802 47	0.587 55	0.604 43	0.945 64	0.464 60	0.201 82	0.554 71	0.840 39	0.723 33	0.732 65	0.602 54	0.907 37	0.822 52	0.603 68

VACNN++	0.684 49	0.728 74	0.757 56	0.776 53	0.690 39	0.804 68	0.464 57	0.816 40	0.577 61	0.587 52	0.945 64	0.508 45	0.276 47	0.671 38	0.710 64	0.663 61	0.750 59	0.589 61	0.881 58	0.832 46	0.653 49

DGNet	0.684 49	0.712 80	0.784 40	0.782 52	0.658 48	0.835 37	0.499 42	0.823 39	0.641 30	0.597 48	0.950 50	0.487 51	0.281 43	0.575 63	0.619 79	0.647 69	0.764 47	0.620 46	0.871 73	0.846 41	0.688 39

KP-FCNN	0.684 49	0.847 26	0.758 55	0.784 50	0.647 54	0.814 61	0.473 51	0.772 53	0.605 46	0.594 50	0.935 84	0.450 69	0.181 90	0.587 58	0.805 49	0.690 51	0.785 35	0.614 47	0.882 57	0.819 54	0.632 57
H. Thomas, C. Qi, J. Deschaud, B. Marcotegui, F. Goulette, L. Guibas.: KPConv: Flexible and Deformable Convolution for Point Clouds. ICCV 2019
Superpoint Network	0.683 52	0.851 25	0.728 72	0.800 44	0.653 51	0.806 66	0.468 54	0.804 45	0.572 62	0.602 45	0.946 61	0.453 68	0.239 67	0.519 80	0.822 43	0.689 53	0.762 50	0.595 58	0.895 48	0.827 48	0.630 58

PointContrast_LA_SEM	0.683 52	0.757 60	0.784 40	0.786 48	0.639 58	0.824 49	0.408 81	0.775 52	0.604 47	0.541 61	0.934 88	0.532 36	0.269 54	0.552 72	0.777 52	0.645 72	0.793 29	0.640 36	0.913 36	0.824 49	0.671 43

VI-PointConv	0.676 54	0.770 55	0.754 57	0.783 51	0.621 62	0.814 61	0.552 14	0.758 57	0.571 64	0.557 57	0.954 36	0.529 37	0.268 56	0.530 78	0.682 70	0.675 56	0.719 68	0.603 53	0.888 53	0.833 44	0.665 45
Xingyi Li, Wenxuan Wu, Xiaoli Z. Fern, Li Fuxin: The Devils in the Point Clouds: Studying the Robustness of Point Cloud Convolutions.
ROSMRF3D	0.673 55	0.789 42	0.748 61	0.763 58	0.635 60	0.814 61	0.407 83	0.747 61	0.581 59	0.573 54	0.950 50	0.484 52	0.271 52	0.607 55	0.754 55	0.649 66	0.774 39	0.596 56	0.883 56	0.823 50	0.606 65

SALANet	0.670 56	0.816 36	0.770 48	0.768 55	0.652 52	0.807 65	0.451 61	0.747 61	0.659 25	0.545 60	0.924 94	0.473 57	0.149 102	0.571 65	0.811 48	0.635 75	0.746 60	0.623 44	0.892 50	0.794 69	0.570 78

O3DSeg	0.668 57	0.822 34	0.771 47	0.496 106	0.651 53	0.833 39	0.541 19	0.761 56	0.555 70	0.611 38	0.966 14	0.489 50	0.370 6	0.388 100	0.580 82	0.776 14	0.751 57	0.570 66	0.956 6	0.817 55	0.646 52

PointASNL	0.666 58	0.703 82	0.781 42	0.751 62	0.655 50	0.830 42	0.471 52	0.769 54	0.474 91	0.537 63	0.951 46	0.475 56	0.279 45	0.635 46	0.698 69	0.675 56	0.751 57	0.553 77	0.816 89	0.806 60	0.703 35
Xu Yan, Chaoda Zheng, Zhen Li, Sheng Wang, Shuguang Cui: PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Sampling. CVPR 2020
PointConv	0.666 58	0.781 46	0.759 53	0.699 71	0.644 57	0.822 51	0.475 50	0.779 51	0.564 67	0.504 77	0.953 40	0.428 78	0.203 81	0.586 60	0.754 55	0.661 62	0.753 56	0.588 62	0.902 42	0.813 58	0.642 53
Wenxuan Wu, Zhongang Qi, Li Fuxin: PointConv: Deep Convolutional Networks on 3D Point Clouds. CVPR 2019
PPCNN++	0.663 60	0.746 64	0.708 75	0.722 64	0.638 59	0.820 54	0.451 61	0.566 97	0.599 50	0.541 61	0.950 50	0.510 44	0.313 26	0.648 43	0.819 46	0.616 80	0.682 83	0.590 60	0.869 74	0.810 59	0.656 48
Pyunghwan Ahn, Juyoung Yang, Eojindl Yi, Chanho Lee, Junmo Kim: Projection-based Point Convolution for Efficient Point Cloud Segmentation. IEEE Access
DCM-Net	0.658 61	0.778 47	0.702 78	0.806 40	0.619 63	0.813 64	0.468 54	0.693 77	0.494 84	0.524 69	0.941 76	0.449 70	0.298 33	0.510 82	0.821 44	0.675 56	0.727 67	0.568 69	0.826 87	0.803 63	0.637 55
Jonas Schult, Francis Engelmann, Theodora Kontogianni, Bastian Leibe: DualConvMesh-Net: Joint Geodesic and Euclidean Convolutions on 3D Meshes. CVPR 2020 [Oral]
MVF-GNN	0.658 61	0.558 103	0.751 59	0.655 86	0.690 39	0.722 95	0.453 60	0.867 19	0.579 60	0.576 53	0.893 106	0.523 39	0.293 35	0.733 31	0.571 84	0.692 48	0.659 90	0.606 51	0.875 64	0.804 62	0.668 44

HPGCNN	0.656 63	0.698 84	0.743 66	0.650 88	0.564 80	0.820 54	0.505 36	0.758 57	0.631 34	0.479 81	0.945 64	0.480 54	0.226 68	0.572 64	0.774 53	0.690 51	0.735 63	0.614 47	0.853 81	0.776 84	0.597 71
Jisheng Dang, Qingyong Hu, Yulan Guo, Jun Yang: HPGCNN.
SAFNet-seg	0.654 64	0.752 61	0.734 70	0.664 84	0.583 75	0.815 60	0.399 85	0.754 59	0.639 31	0.535 65	0.942 74	0.470 58	0.309 28	0.665 39	0.539 86	0.650 65	0.708 73	0.635 38	0.857 80	0.793 71	0.642 53
Linqing Zhao, Jiwen Lu, Jie Zhou: Similarity-Aware Fusion Network for 3D Semantic Segmentation. IROS 2021
RandLA-Net	0.645 65	0.778 47	0.731 71	0.699 71	0.577 76	0.829 43	0.446 66	0.736 65	0.477 90	0.523 71	0.945 64	0.454 65	0.269 54	0.484 90	0.749 58	0.618 78	0.738 61	0.599 55	0.827 86	0.792 74	0.621 60

PointConv-SFPN	0.641 66	0.776 49	0.703 77	0.721 65	0.557 83	0.826 46	0.451 61	0.672 82	0.563 68	0.483 80	0.943 73	0.425 81	0.162 97	0.644 44	0.726 60	0.659 63	0.709 72	0.572 65	0.875 64	0.786 79	0.559 84

MVPNet	0.641 66	0.831 30	0.715 73	0.671 81	0.590 71	0.781 79	0.394 87	0.679 79	0.642 29	0.553 58	0.937 81	0.462 61	0.256 60	0.649 42	0.406 100	0.626 76	0.691 80	0.666 29	0.877 62	0.792 74	0.608 64
Maximilian Jaritz, Jiayuan Gu, Hao Su: Multi-view PointNet for 3D Scene Understanding. GMDL Workshop, ICCV 2019
PointMRNet	0.640 68	0.717 79	0.701 79	0.692 74	0.576 77	0.801 69	0.467 56	0.716 70	0.563 68	0.459 87	0.953 40	0.429 77	0.169 94	0.581 61	0.854 33	0.605 81	0.710 70	0.550 79	0.894 49	0.793 71	0.575 76

FPConv	0.639 69	0.785 44	0.760 52	0.713 69	0.603 66	0.798 71	0.392 88	0.534 102	0.603 48	0.524 69	0.948 56	0.457 63	0.250 62	0.538 76	0.723 62	0.598 85	0.696 78	0.614 47	0.872 70	0.799 64	0.567 81
Yiqun Lin, Zizheng Yan, Haibin Huang, Dong Du, Ligang Liu, Shuguang Cui, Xiaoguang Han: FPConv: Learning Local Flattening for Point Convolution. CVPR 2020
PD-Net	0.638 70	0.797 40	0.769 49	0.641 94	0.590 71	0.820 54	0.461 58	0.537 101	0.637 32	0.536 64	0.947 58	0.388 91	0.206 78	0.656 40	0.668 73	0.647 69	0.732 65	0.585 63	0.868 75	0.793 71	0.473 104

PointSPNet	0.637 71	0.734 70	0.692 86	0.714 68	0.576 77	0.797 72	0.446 66	0.743 63	0.598 51	0.437 92	0.942 74	0.403 87	0.150 101	0.626 50	0.800 51	0.649 66	0.697 77	0.557 75	0.846 83	0.777 83	0.563 82

SConv	0.636 72	0.830 31	0.697 82	0.752 61	0.572 79	0.780 81	0.445 68	0.716 70	0.529 74	0.530 66	0.951 46	0.446 72	0.170 93	0.507 85	0.666 74	0.636 74	0.682 83	0.541 85	0.886 54	0.799 64	0.594 72

Supervoxel-CNN	0.635 73	0.656 89	0.711 74	0.719 66	0.613 64	0.757 90	0.444 71	0.765 55	0.534 73	0.566 55	0.928 92	0.478 55	0.272 50	0.636 45	0.531 88	0.664 60	0.645 94	0.508 92	0.864 77	0.792 74	0.611 61

joint point-based	0.634 74	0.614 97	0.778 43	0.667 83	0.633 61	0.825 47	0.420 79	0.804 45	0.467 93	0.561 56	0.951 46	0.494 47	0.291 37	0.566 66	0.458 95	0.579 91	0.764 47	0.559 74	0.838 84	0.814 56	0.598 70
Hung-Yueh Chiang, Yen-Liang Lin, Yueh-Cheng Liu, Winston H. Hsu: A Unified Point-Based Framework for 3D Segmentation. 3DV 2019
PointMTL	0.632 75	0.731 72	0.688 89	0.675 78	0.591 70	0.784 78	0.444 71	0.565 98	0.610 42	0.492 78	0.949 54	0.456 64	0.254 61	0.587 58	0.706 65	0.599 84	0.665 89	0.612 50	0.868 75	0.791 77	0.579 75

3DSM_DMMF	0.631 76	0.626 94	0.745 64	0.801 43	0.607 65	0.751 91	0.506 35	0.729 68	0.565 66	0.491 79	0.866 109	0.434 73	0.197 85	0.595 56	0.630 78	0.709 41	0.705 75	0.560 72	0.875 64	0.740 94	0.491 99

PointNet2-SFPN	0.631 76	0.771 53	0.692 86	0.672 79	0.524 88	0.837 34	0.440 73	0.706 75	0.538 72	0.446 89	0.944 70	0.421 83	0.219 73	0.552 72	0.751 57	0.591 87	0.737 62	0.543 84	0.901 44	0.768 86	0.557 85

APCF-Net	0.631 76	0.742 67	0.687 91	0.672 79	0.557 83	0.792 76	0.408 81	0.665 83	0.545 71	0.508 74	0.952 44	0.428 78	0.186 88	0.634 47	0.702 67	0.620 77	0.706 74	0.555 76	0.873 68	0.798 66	0.581 74
Haojia, Lin: Adaptive Pyramid Context Fusion for Point Cloud Perception. GRSL
FusionAwareConv	0.630 79	0.604 99	0.741 68	0.766 57	0.590 71	0.747 92	0.501 38	0.734 66	0.503 83	0.527 67	0.919 98	0.454 65	0.323 23	0.550 74	0.420 99	0.678 55	0.688 81	0.544 82	0.896 47	0.795 68	0.627 59
Jiazhao Zhang, Chenyang Zhu, Lintao Zheng, Kai Xu: Fusion-Aware Point Convolution for Online Semantic 3D Scene Segmentation. CVPR 2020
DenSeR	0.628 80	0.800 39	0.625 102	0.719 66	0.545 85	0.806 66	0.445 68	0.597 91	0.448 98	0.519 72	0.938 80	0.481 53	0.328 21	0.489 89	0.499 93	0.657 64	0.759 52	0.592 59	0.881 58	0.797 67	0.634 56

SegGroup_sem	0.627 81	0.818 35	0.747 63	0.701 70	0.602 67	0.764 87	0.385 92	0.629 88	0.490 86	0.508 74	0.931 91	0.409 86	0.201 82	0.564 67	0.725 61	0.618 78	0.692 79	0.539 86	0.873 68	0.794 69	0.548 88
An Tao, Yueqi Duan, Yi Wei, Jiwen Lu, Jie Zhou: SegGroup: Seg-Level Supervision for 3D Instance and Semantic Segmentation. TIP 2022
SIConv	0.625 82	0.830 31	0.694 84	0.757 59	0.563 81	0.772 85	0.448 65	0.647 86	0.520 77	0.509 73	0.949 54	0.431 76	0.191 86	0.496 87	0.614 80	0.647 69	0.672 87	0.535 88	0.876 63	0.783 80	0.571 77

dtc_net	0.625 82	0.703 82	0.751 59	0.794 46	0.535 86	0.848 24	0.480 49	0.676 81	0.528 75	0.469 84	0.944 70	0.454 65	0.004 115	0.464 92	0.636 77	0.704 44	0.758 53	0.548 81	0.924 27	0.787 78	0.492 98

HPEIN	0.618 84	0.729 73	0.668 92	0.647 90	0.597 69	0.766 86	0.414 80	0.680 78	0.520 77	0.525 68	0.946 61	0.432 74	0.215 75	0.493 88	0.599 81	0.638 73	0.617 99	0.570 66	0.897 46	0.806 60	0.605 67
Li Jiang, Hengshuang Zhao, Shu Liu, Xiaoyong Shen, Chi-Wing Fu, Jiaya Jia: Hierarchical Point-Edge Interaction Network for Point Cloud Semantic Segmentation. ICCV 2019
SPH3D-GCN	0.610 85	0.858 24	0.772 45	0.489 107	0.532 87	0.792 76	0.404 84	0.643 87	0.570 65	0.507 76	0.935 84	0.414 85	0.046 112	0.510 82	0.702 67	0.602 83	0.705 75	0.549 80	0.859 79	0.773 85	0.534 91
Huan Lei, Naveed Akhtar, and Ajmal Mian: Spherical Kernel for Efficient Graph Convolution on 3D Point Clouds. TPAMI 2020
AttAN	0.609 86	0.760 58	0.667 93	0.649 89	0.521 89	0.793 74	0.457 59	0.648 85	0.528 75	0.434 94	0.947 58	0.401 88	0.153 100	0.454 93	0.721 63	0.648 68	0.717 69	0.536 87	0.904 39	0.765 87	0.485 100
Gege Zhang, Qinghua Ma, Licheng Jiao, Fang Liu and Qigong Sun: AttAN: Attention Adversarial Networks for 3D Point Cloud Semantic Segmentation. IJCAI2020
wsss-transformer	0.600 87	0.634 93	0.743 66	0.697 73	0.601 68	0.781 79	0.437 75	0.585 94	0.493 85	0.446 89	0.933 89	0.394 89	0.011 114	0.654 41	0.661 76	0.603 82	0.733 64	0.526 89	0.832 85	0.761 89	0.480 101

LAP-D	0.594 88	0.720 77	0.692 86	0.637 95	0.456 99	0.773 84	0.391 90	0.730 67	0.587 55	0.445 91	0.940 78	0.381 92	0.288 38	0.434 96	0.453 97	0.591 87	0.649 92	0.581 64	0.777 93	0.749 93	0.610 63

DPC	0.592 89	0.720 77	0.700 80	0.602 99	0.480 95	0.762 89	0.380 93	0.713 73	0.585 58	0.437 92	0.940 78	0.369 94	0.288 38	0.434 96	0.509 92	0.590 89	0.639 97	0.567 70	0.772 95	0.755 91	0.592 73
Francis Engelmann, Theodora Kontogianni, Bastian Leibe: Dilated Point Convolutions: On the Receptive Field Size of Point Convolutions on 3D Point Clouds. ICRA 2020
CCRFNet	0.589 90	0.766 57	0.659 97	0.683 76	0.470 98	0.740 94	0.387 91	0.620 90	0.490 86	0.476 82	0.922 96	0.355 97	0.245 65	0.511 81	0.511 91	0.571 92	0.643 95	0.493 96	0.872 70	0.762 88	0.600 69

ROSMRF	0.580 91	0.772 52	0.707 76	0.681 77	0.563 81	0.764 87	0.362 95	0.515 103	0.465 94	0.465 86	0.936 83	0.427 80	0.207 77	0.438 94	0.577 83	0.536 95	0.675 86	0.486 97	0.723 101	0.779 81	0.524 94

SD-DETR	0.576 92	0.746 64	0.609 106	0.445 111	0.517 90	0.643 106	0.366 94	0.714 72	0.456 96	0.468 85	0.870 108	0.432 74	0.264 57	0.558 70	0.674 71	0.586 90	0.688 81	0.482 98	0.739 99	0.733 96	0.537 90

SQN_0.1%	0.569 93	0.676 86	0.696 83	0.657 85	0.497 91	0.779 82	0.424 77	0.548 99	0.515 79	0.376 99	0.902 105	0.422 82	0.357 9	0.379 101	0.456 96	0.596 86	0.659 90	0.544 82	0.685 104	0.665 107	0.556 86

TextureNet	0.566 94	0.672 88	0.664 94	0.671 81	0.494 93	0.719 96	0.445 68	0.678 80	0.411 104	0.396 97	0.935 84	0.356 96	0.225 70	0.412 98	0.535 87	0.565 93	0.636 98	0.464 100	0.794 92	0.680 104	0.568 80
Jingwei Huang, Haotian Zhang, Li Yi, Thomas Funkerhouser, Matthias Niessner, Leonidas Guibas: TextureNet: Consistent Local Parametrizations for Learning from High-Resolution Signals on Meshes. CVPR
DVVNet	0.562 95	0.648 90	0.700 80	0.770 54	0.586 74	0.687 100	0.333 99	0.650 84	0.514 80	0.475 83	0.906 102	0.359 95	0.223 72	0.340 103	0.442 98	0.422 106	0.668 88	0.501 93	0.708 102	0.779 81	0.534 91

Pointnet++ & Feature	0.557 96	0.735 69	0.661 96	0.686 75	0.491 94	0.744 93	0.392 88	0.539 100	0.451 97	0.375 100	0.946 61	0.376 93	0.205 79	0.403 99	0.356 103	0.553 94	0.643 95	0.497 94	0.824 88	0.756 90	0.515 95

GMLPs	0.538 97	0.495 108	0.693 85	0.647 90	0.471 97	0.793 74	0.300 102	0.477 104	0.505 82	0.358 102	0.903 104	0.327 100	0.081 109	0.472 91	0.529 89	0.448 104	0.710 70	0.509 90	0.746 97	0.737 95	0.554 87

PanopticFusion-label	0.529 98	0.491 109	0.688 89	0.604 98	0.386 104	0.632 107	0.225 112	0.705 76	0.434 101	0.293 108	0.815 110	0.348 98	0.241 66	0.499 86	0.669 72	0.507 97	0.649 92	0.442 106	0.796 91	0.602 111	0.561 83
Gaku Narita, Takashi Seno, Tomoya Ishikawa, Yohsuke Kaji: PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Things. IROS 2019 (to appear)
subcloud_weak	0.516 99	0.676 86	0.591 109	0.609 96	0.442 100	0.774 83	0.335 98	0.597 91	0.422 103	0.357 103	0.932 90	0.341 99	0.094 108	0.298 105	0.528 90	0.473 102	0.676 85	0.495 95	0.602 110	0.721 99	0.349 111

Online SegFusion	0.515 100	0.607 98	0.644 100	0.579 101	0.434 101	0.630 108	0.353 96	0.628 89	0.440 99	0.410 95	0.762 114	0.307 102	0.167 95	0.520 79	0.403 101	0.516 96	0.565 102	0.447 104	0.678 105	0.701 101	0.514 96
Davide Menini, Suryansh Kumar, Martin R. Oswald, Erik Sandstroem, Cristian Sminchisescu, Luc van Gool: A Real-Time Learning Framework for Joint 3D Reconstruction and Semantic Segmentation. Robotics and Automation Letters Submission
3DMV, FTSDF	0.501 101	0.558 103	0.608 107	0.424 113	0.478 96	0.690 99	0.246 108	0.586 93	0.468 92	0.450 88	0.911 100	0.394 89	0.160 98	0.438 94	0.212 110	0.432 105	0.541 108	0.475 99	0.742 98	0.727 97	0.477 102

PCNN	0.498 102	0.559 102	0.644 100	0.560 103	0.420 103	0.711 98	0.229 110	0.414 105	0.436 100	0.352 104	0.941 76	0.324 101	0.155 99	0.238 110	0.387 102	0.493 98	0.529 109	0.509 90	0.813 90	0.751 92	0.504 97

Weakly-Openseg v3	0.489 103	0.749 63	0.664 94	0.646 92	0.496 92	0.559 112	0.122 115	0.577 95	0.257 115	0.364 101	0.805 111	0.198 113	0.096 107	0.510 82	0.496 94	0.361 110	0.563 103	0.359 113	0.777 93	0.644 108	0.532 93

3DMV	0.484 104	0.484 110	0.538 111	0.643 93	0.424 102	0.606 111	0.310 100	0.574 96	0.433 102	0.378 98	0.796 112	0.301 103	0.214 76	0.537 77	0.208 111	0.472 103	0.507 112	0.413 109	0.693 103	0.602 111	0.539 89
Angela Dai, Matthias Niessner: 3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation. ECCV'18
PointCNN with RGB	0.458 105	0.577 101	0.611 105	0.356 115	0.321 112	0.715 97	0.299 104	0.376 109	0.328 111	0.319 106	0.944 70	0.285 105	0.164 96	0.216 113	0.229 108	0.484 100	0.545 107	0.456 102	0.755 96	0.709 100	0.475 103
Yangyan Li, Rui Bu, Mingchao Sun, Baoquan Chen: PointCNN. NeurIPS 2018
FCPN	0.447 106	0.679 85	0.604 108	0.578 102	0.380 105	0.682 101	0.291 105	0.106 115	0.483 89	0.258 113	0.920 97	0.258 109	0.025 113	0.231 112	0.325 104	0.480 101	0.560 105	0.463 101	0.725 100	0.666 106	0.231 115
Dario Rethage, Johanna Wald, Jürgen Sturm, Nassir Navab, Federico Tombari: Fully-Convolutional Point Networks for Large-Scale Point Clouds. ECCV 2018
DGCNN_reproduce	0.446 107	0.474 111	0.623 103	0.463 109	0.366 107	0.651 104	0.310 100	0.389 108	0.349 109	0.330 105	0.937 81	0.271 107	0.126 104	0.285 106	0.224 109	0.350 112	0.577 101	0.445 105	0.625 108	0.723 98	0.394 107
Yue Wang, Yongbin Sun, Ziwei Liu, Sanjay E. Sarma, Michael M. Bronstein, Justin M. Solomon: Dynamic Graph CNN for Learning on Point Clouds. TOG 2019
PNET2	0.442 108	0.548 105	0.548 110	0.597 100	0.363 108	0.628 109	0.300 102	0.292 110	0.374 106	0.307 107	0.881 107	0.268 108	0.186 88	0.238 110	0.204 112	0.407 107	0.506 113	0.449 103	0.667 106	0.620 110	0.462 105

SurfaceConvPF	0.442 108	0.505 107	0.622 104	0.380 114	0.342 110	0.654 103	0.227 111	0.397 107	0.367 107	0.276 110	0.924 94	0.240 110	0.198 84	0.359 102	0.262 106	0.366 108	0.581 100	0.435 107	0.640 107	0.668 105	0.398 106
Hao Pan, Shilin Liu, Yang Liu, Xin Tong: Convolutional Neural Networks on 3D Surfaces Using Parallel Frames.
Tangent Convolutions	0.438 110	0.437 113	0.646 99	0.474 108	0.369 106	0.645 105	0.353 96	0.258 112	0.282 113	0.279 109	0.918 99	0.298 104	0.147 103	0.283 107	0.294 105	0.487 99	0.562 104	0.427 108	0.619 109	0.633 109	0.352 110
Maxim Tatarchenko, Jaesik Park, Vladlen Koltun, Qian-Yi Zhou: Tangent convolutions for dense prediction in 3d. CVPR 2018
3DWSSS	0.425 111	0.525 106	0.647 98	0.522 104	0.324 111	0.488 115	0.077 116	0.712 74	0.353 108	0.401 96	0.636 116	0.281 106	0.176 91	0.340 103	0.565 85	0.175 116	0.551 106	0.398 110	0.370 116	0.602 111	0.361 109

SPLAT Net	0.393 112	0.472 112	0.511 112	0.606 97	0.311 113	0.656 102	0.245 109	0.405 106	0.328 111	0.197 114	0.927 93	0.227 112	0.000 117	0.001 117	0.249 107	0.271 115	0.510 110	0.383 112	0.593 111	0.699 102	0.267 113
Hang Su, Varun Jampani, Deqing Sun, Subhransu Maji, Evangelos Kalogerakis, Ming-Hsuan Yang, Jan Kautz: SPLATNet: Sparse Lattice Networks for Point Cloud Processing. CVPR 2018
ScanNet+FTSDF	0.383 113	0.297 115	0.491 113	0.432 112	0.358 109	0.612 110	0.274 106	0.116 114	0.411 104	0.265 111	0.904 103	0.229 111	0.079 110	0.250 108	0.185 113	0.320 113	0.510 110	0.385 111	0.548 112	0.597 114	0.394 107

PointNet++	0.339 114	0.584 100	0.478 114	0.458 110	0.256 115	0.360 116	0.250 107	0.247 113	0.278 114	0.261 112	0.677 115	0.183 114	0.117 105	0.212 114	0.145 115	0.364 109	0.346 116	0.232 116	0.548 112	0.523 115	0.252 114
Charles R. Qi, Li Yi, Hao Su, Leonidas J. Guibas: pointnet++: deep hierarchical feature learning on point sets in a metric space.
SSC-UNet	0.308 115	0.353 114	0.290 116	0.278 116	0.166 116	0.553 113	0.169 114	0.286 111	0.147 116	0.148 116	0.908 101	0.182 115	0.064 111	0.023 116	0.018 117	0.354 111	0.363 114	0.345 114	0.546 114	0.685 103	0.278 112

ScanNet	0.306 116	0.203 116	0.366 115	0.501 105	0.311 113	0.524 114	0.211 113	0.002 117	0.342 110	0.189 115	0.786 113	0.145 116	0.102 106	0.245 109	0.152 114	0.318 114	0.348 115	0.300 115	0.460 115	0.437 116	0.182 116
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner: ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes. CVPR'17
ERROR	0.054 117	0.000 117	0.041 117	0.172 117	0.030 117	0.062 117	0.001 117	0.035 116	0.004 117	0.051 117	0.143 117	0.019 117	0.003 116	0.041 115	0.050 116	0.003 117	0.054 117	0.018 117	0.005 117	0.264 117	0.082 117

This table lists the benchmark results for the 3D semantic instance scenario.

Method	avg ap 50%	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	window

Spherical Mask(CtoF)	0.812 1	1.000 1	0.973 4	0.852 12	0.718 4	0.917 6	0.574 4	0.677 26	0.748 9	0.729 10	0.715 5	0.795 2	0.809 1	1.000 1	0.831 2	0.854 8	0.787 8	1.000 1	0.638 4

EV3D	0.811 2	1.000 1	0.968 5	0.852 12	0.717 5	0.921 5	0.574 5	0.677 26	0.748 9	0.730 9	0.703 9	0.795 2	0.809 1	1.000 1	0.831 2	0.854 8	0.778 12	1.000 1	0.638 5

SIM3D	0.803 3	1.000 1	0.967 6	0.863 11	0.692 14	0.924 4	0.552 8	0.732 20	0.667 18	0.732 8	0.662 12	0.796 1	0.789 8	1.000 1	0.803 6	0.864 5	0.766 17	1.000 1	0.643 3

OneFormer3D	0.801 4	1.000 1	0.973 3	0.909 5	0.698 11	0.928 2	0.582 3	0.668 31	0.685 15	0.780 2	0.687 10	0.698 15	0.702 13	1.000 1	0.794 8	0.900 2	0.784 10	0.986 48	0.635 6
Maxim Kolodiazhnyi, Anna Vorontsova, Anton Konushin, Danila Rukhovich: OneFormer3D: One Transformer for Unified Point Cloud Segmentation.
UniPerception	0.800 5	1.000 1	0.930 8	0.872 9	0.727 3	0.862 20	0.454 15	0.764 13	0.820 1	0.746 6	0.706 7	0.750 5	0.772 9	0.926 41	0.764 14	0.818 24	0.826 1	0.997 36	0.660 2

InsSSM	0.799 6	1.000 1	0.915 10	0.710 37	0.729 2	0.925 3	0.664 1	0.670 29	0.770 6	0.766 3	0.739 2	0.737 6	0.700 14	1.000 1	0.792 9	0.829 18	0.815 3	0.997 36	0.625 8

TST3D	0.795 7	1.000 1	0.929 9	0.918 4	0.709 8	0.884 15	0.596 2	0.704 23	0.769 7	0.734 7	0.644 17	0.699 14	0.751 11	1.000 1	0.794 7	0.876 4	0.757 19	0.997 36	0.550 28

MG-Former	0.791 8	1.000 1	0.980 2	0.837 16	0.626 22	0.897 8	0.543 9	0.759 15	0.800 5	0.766 4	0.659 13	0.769 4	0.697 17	1.000 1	0.791 10	0.707 44	0.791 7	1.000 1	0.610 14

ExtMask3D	0.789 9	1.000 1	0.988 1	0.756 30	0.706 9	0.912 7	0.429 16	0.647 36	0.806 4	0.755 5	0.673 11	0.689 16	0.772 10	1.000 1	0.789 11	0.852 10	0.811 4	1.000 1	0.617 11

Queryformer	0.787 10	1.000 1	0.933 7	0.601 46	0.754 1	0.886 13	0.558 7	0.661 33	0.767 8	0.665 15	0.716 4	0.639 21	0.808 4	1.000 1	0.844 1	0.897 3	0.804 5	1.000 1	0.624 9

MAFT	0.786 11	1.000 1	0.894 15	0.807 20	0.694 13	0.893 11	0.486 11	0.674 28	0.740 11	0.786 1	0.704 8	0.727 8	0.739 12	1.000 1	0.707 20	0.849 12	0.756 20	1.000 1	0.685 1

Mask3D	0.780 12	1.000 1	0.786 39	0.716 35	0.696 12	0.885 14	0.500 10	0.714 21	0.810 3	0.672 14	0.715 5	0.679 17	0.809 1	1.000 1	0.831 2	0.833 16	0.787 8	1.000 1	0.602 16
Jonas Schult, Francis Engelmann, Alexander Hermans, Or Litany, Siyu Tang, Bastian Leibe: Mask3D for 3D Semantic Instance Segmentation. ICRA 2023
SPFormer	0.770 13	0.903 52	0.903 12	0.806 21	0.609 28	0.886 12	0.568 6	0.815 6	0.705 14	0.711 11	0.655 14	0.652 20	0.685 20	1.000 1	0.789 12	0.809 25	0.776 14	1.000 1	0.583 21
Sun Jiahao, Qing Chunmei, Tan Junpeng, Xu Xiangmin: Superpoint Transformer for 3D Scene Instance Segmentation. AAAI 2023 [Oral]
SoftGroup++	0.769 14	1.000 1	0.803 32	0.937 1	0.684 15	0.865 17	0.213 31	0.870 2	0.664 19	0.571 21	0.758 1	0.702 12	0.807 5	1.000 1	0.653 27	0.902 1	0.792 6	1.000 1	0.626 7

SoftGroup	0.761 15	1.000 1	0.808 28	0.845 14	0.716 6	0.862 19	0.243 28	0.824 4	0.655 21	0.620 16	0.734 3	0.699 13	0.791 7	0.981 35	0.716 18	0.844 13	0.769 15	1.000 1	0.594 19
Thang Vu, Kookhoi Kim, Tung M. Luu, Xuan Thanh Nguyen, Chang D. Yoo: SoftGroup for 3D Instance Segmentaiton on Point Clouds. CVPR 2022 [Oral]
ISBNet	0.757 16	1.000 1	0.904 11	0.731 33	0.678 16	0.895 9	0.458 13	0.644 38	0.670 17	0.710 12	0.620 22	0.732 7	0.650 22	1.000 1	0.756 15	0.778 28	0.779 11	1.000 1	0.614 12
Tuan Duc Ngo, Binh-Son Hua, Khoi Nguyen: ISBNet: a 3D Point Cloud Instance Segmentation Network with Instance-aware Sampling and Box-aware Dynamic Convolution. CVPR 2023
TD3D	0.751 17	1.000 1	0.774 40	0.867 10	0.621 24	0.934 1	0.404 17	0.706 22	0.812 2	0.605 19	0.633 20	0.626 22	0.690 19	1.000 1	0.640 29	0.820 21	0.777 13	1.000 1	0.612 13
Maksim Kolodiazhnyi, Anna Vorontsova, Anton Konushin, Danila Rukhovich: Top-Down Beats Bottom-Up in 3D Instance Segmentation. WACV 2024
PBNet	0.747 18	1.000 1	0.818 24	0.837 17	0.713 7	0.844 22	0.457 14	0.647 36	0.711 13	0.614 17	0.617 24	0.657 19	0.650 22	1.000 1	0.692 21	0.822 20	0.765 18	1.000 1	0.595 18
W.Zhao, Y.Yan, C.Yang, J.Ye,X.Yang,K.Huang: Divide and Conquer: 3D Instance Segmentation With Point-Wise Binarization. ICCV 2023
GraphCut	0.732 19	1.000 1	0.788 37	0.724 34	0.642 21	0.859 21	0.248 27	0.787 11	0.618 24	0.596 20	0.653 16	0.722 10	0.583 43	1.000 1	0.766 13	0.861 6	0.825 2	1.000 1	0.504 34

IPCA-Inst	0.731 20	1.000 1	0.788 38	0.884 8	0.698 10	0.788 38	0.252 26	0.760 14	0.646 22	0.511 29	0.637 19	0.665 18	0.804 6	1.000 1	0.644 28	0.778 29	0.747 22	1.000 1	0.561 25

TopoSeg	0.725 21	1.000 1	0.806 31	0.933 2	0.668 18	0.758 42	0.272 25	0.734 19	0.630 23	0.549 25	0.654 15	0.606 23	0.697 18	0.966 38	0.612 33	0.839 14	0.754 21	1.000 1	0.573 22

DKNet	0.718 22	1.000 1	0.814 25	0.782 24	0.619 25	0.872 16	0.224 29	0.751 17	0.569 28	0.677 13	0.585 28	0.724 9	0.633 33	0.981 35	0.515 43	0.819 22	0.736 23	1.000 1	0.617 10
Yizheng Wu, Min Shi, Shuaiyuan Du, Hao Lu, Zhiguo Cao, Weicai Zhong: 3D Instances as 1D Kernels. ECCV 2022
SSEC	0.707 23	1.000 1	0.850 17	0.924 3	0.648 19	0.747 45	0.162 33	0.862 3	0.572 27	0.520 27	0.624 21	0.549 26	0.649 31	1.000 1	0.560 38	0.706 45	0.768 16	1.000 1	0.591 20

HAIS	0.699 24	1.000 1	0.849 18	0.820 18	0.675 17	0.808 32	0.279 23	0.757 16	0.465 34	0.517 28	0.596 26	0.559 25	0.600 37	1.000 1	0.654 26	0.767 31	0.676 27	0.994 44	0.560 26
Shaoyu Chen, Jiemin Fang, Qian Zhang, Wenyu Liu, Xinggang Wang: Hierarchical Aggregation for 3D Instance Segmentation. ICCV 2021
SSTNet	0.698 25	1.000 1	0.697 56	0.888 7	0.556 35	0.803 33	0.387 18	0.626 40	0.417 39	0.556 24	0.585 29	0.702 11	0.600 37	1.000 1	0.824 5	0.720 43	0.692 25	1.000 1	0.509 33
Zhihao Liang, Zhihao Li, Songcen Xu, Mingkui Tan, Kui Jia: Instance Segmentation in 3D Scenes using Semantic Superpoint Tree Networks. ICCV2021
DualGroup	0.694 26	1.000 1	0.799 34	0.811 19	0.622 23	0.817 27	0.376 19	0.805 9	0.590 26	0.487 33	0.568 32	0.525 30	0.650 22	0.835 51	0.600 34	0.829 17	0.655 30	1.000 1	0.526 30

DANCENET	0.680 27	1.000 1	0.807 29	0.733 32	0.600 29	0.768 41	0.375 20	0.543 48	0.538 29	0.610 18	0.599 25	0.498 31	0.632 35	0.981 35	0.739 17	0.856 7	0.633 36	0.882 59	0.454 43

SphereSeg	0.680 27	1.000 1	0.856 16	0.744 31	0.618 26	0.893 10	0.151 34	0.651 35	0.713 12	0.537 26	0.579 31	0.430 40	0.651 21	1.000 1	0.389 54	0.744 38	0.697 24	0.991 46	0.601 17

Box2Mask	0.677 29	1.000 1	0.847 19	0.771 26	0.509 44	0.816 28	0.277 24	0.558 47	0.482 31	0.562 23	0.640 18	0.448 36	0.700 14	1.000 1	0.666 22	0.852 11	0.578 43	0.997 36	0.488 38
Julian Chibane, Francis Engelmann, Tuan Anh Tran, Gerard Pons-Moll: Box2Mask: Weakly Supervised 3D Semantic Instance Segmentation Using Bounding Boxes. ECCV 2022
OccuSeg+instance	0.672 30	1.000 1	0.758 48	0.682 39	0.576 33	0.842 23	0.477 12	0.504 54	0.524 30	0.567 22	0.585 30	0.451 35	0.557 45	1.000 1	0.751 16	0.797 26	0.563 46	1.000 1	0.467 42
Lei Han, Tian Zheng, Lan Xu, Lu Fang: OccuSeg: Occupancy-aware 3D Instance Segmentation. CVPR2020
Mask-Group	0.664 31	1.000 1	0.822 23	0.764 29	0.616 27	0.815 29	0.139 38	0.694 25	0.597 25	0.459 37	0.566 33	0.599 24	0.600 37	0.516 61	0.715 19	0.819 23	0.635 34	1.000 1	0.603 15
Min Zhong, Xinghao Chen, Xiaokang Chen, Gang Zeng, Yunhe Wang: MaskGroup: Hierarchical Point Grouping and Masking for 3D Instance Segmentation. ICME 2022
INS-Conv-instance	0.657 32	1.000 1	0.760 46	0.667 41	0.581 31	0.863 18	0.323 21	0.655 34	0.477 32	0.473 35	0.549 35	0.432 39	0.650 22	1.000 1	0.655 25	0.738 39	0.585 42	0.944 51	0.472 41

CSC-Pretrained	0.648 33	1.000 1	0.810 26	0.768 27	0.523 42	0.813 30	0.143 37	0.819 5	0.389 42	0.422 46	0.511 39	0.443 37	0.650 22	1.000 1	0.624 31	0.732 40	0.634 35	1.000 1	0.375 50

PE	0.645 34	1.000 1	0.773 42	0.798 23	0.538 37	0.786 39	0.088 46	0.799 10	0.350 46	0.435 44	0.547 36	0.545 27	0.646 32	0.933 40	0.562 37	0.761 34	0.556 51	0.997 36	0.501 36
Biao Zhang, Peter Wonka: Point Cloud Instance Segmentation using Probabilistic Embeddings. CVPR 2021
RPGN	0.643 35	1.000 1	0.758 47	0.582 52	0.539 36	0.826 26	0.046 51	0.765 12	0.372 44	0.436 43	0.588 27	0.539 29	0.650 22	1.000 1	0.577 35	0.750 36	0.653 32	0.997 36	0.495 37
Shichao Dong, Guosheng Lin, Tzu-Yi Hung: Learning Regional Purity for Instance Segmentation on 3D Point Clouds. ECCV 2022
Dyco3D	0.641 36	1.000 1	0.841 20	0.893 6	0.531 39	0.802 34	0.115 43	0.588 45	0.448 36	0.438 41	0.537 38	0.430 41	0.550 46	0.857 43	0.534 41	0.764 33	0.657 29	0.987 47	0.568 23
Tong He; Chunhua Shen; Anton van den Hengel: DyCo3D: Robust Instance Segmentation of 3D Point Clouds through Dynamic Convolution. CVPR2021
GICN	0.638 37	1.000 1	0.895 14	0.800 22	0.480 48	0.676 50	0.144 36	0.737 18	0.354 45	0.447 38	0.400 52	0.365 47	0.700 14	1.000 1	0.569 36	0.836 15	0.599 38	1.000 1	0.473 40

PointGroup	0.636 38	1.000 1	0.765 43	0.624 43	0.505 46	0.797 35	0.116 42	0.696 24	0.384 43	0.441 39	0.559 34	0.476 33	0.596 40	1.000 1	0.666 22	0.756 35	0.556 50	0.997 36	0.513 32
Li Jiang, Hengshuang Zhao, Shaoshuai Shi, Shu Liu, Chi-Wing Fu, Jiaya Jia: PointGroup: Dual-Set Point Grouping for 3D Instance Segmentation. CVPR 2020 [oral]
DD-UNet+Group	0.635 39	0.667 54	0.797 36	0.714 36	0.562 34	0.774 40	0.146 35	0.810 8	0.429 38	0.476 34	0.546 37	0.399 43	0.633 33	1.000 1	0.632 30	0.722 42	0.609 37	1.000 1	0.514 31
H. Liu, R. Liu, K. Yang, J. Zhang, K. Peng, R. Stiefelhagen: HIDA: Towards Holistic Indoor Understanding for the Visually Impaired via Semantic Instance Segmentation with a Wearable Solid-State LiDAR Sensor. ICCVW 2021
Mask3D_evaluation	0.631 40	1.000 1	0.829 22	0.606 45	0.646 20	0.836 24	0.068 47	0.511 52	0.462 35	0.507 30	0.619 23	0.389 45	0.610 36	1.000 1	0.432 49	0.828 19	0.673 28	0.788 63	0.552 27

DENet	0.629 41	1.000 1	0.797 35	0.608 44	0.589 30	0.627 54	0.219 30	0.882 1	0.310 48	0.402 51	0.383 54	0.396 44	0.650 22	1.000 1	0.663 24	0.543 62	0.691 26	1.000 1	0.568 24

3D-MPA	0.611 42	1.000 1	0.833 21	0.765 28	0.526 41	0.756 43	0.136 40	0.588 45	0.470 33	0.438 42	0.432 48	0.358 49	0.650 22	0.857 43	0.429 50	0.765 32	0.557 49	1.000 1	0.430 45
Francis Engelmann, Martin Bokeloh, Alireza Fathi, Bastian Leibe, Matthias Nießner: 3D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentation. CVPR 2020
OSIS	0.605 43	1.000 1	0.801 33	0.599 47	0.535 38	0.728 47	0.286 22	0.436 58	0.679 16	0.491 31	0.433 46	0.256 51	0.404 58	0.857 43	0.620 32	0.724 41	0.510 56	1.000 1	0.539 29

AOIA	0.601 44	1.000 1	0.761 45	0.687 38	0.485 47	0.828 25	0.008 58	0.663 32	0.405 41	0.405 50	0.425 49	0.490 32	0.596 40	0.714 54	0.553 40	0.779 27	0.597 39	0.992 45	0.424 47

PCJC	0.578 45	1.000 1	0.810 27	0.583 51	0.449 51	0.813 31	0.042 52	0.603 43	0.341 47	0.490 32	0.465 43	0.410 42	0.650 22	0.835 51	0.264 60	0.694 49	0.561 47	0.889 56	0.504 35

SSEN	0.575 46	1.000 1	0.761 44	0.473 54	0.477 49	0.795 36	0.066 48	0.529 50	0.658 20	0.460 36	0.461 44	0.380 46	0.331 60	0.859 42	0.401 53	0.692 51	0.653 31	1.000 1	0.348 52
Dongsu Zhang, Junha Chun, Sang Kyun Cha, Young Min Kim: Spatial Semantic Embedding Network: Fast 3D Instance Segmentation with Deep Metric Learning. Arxiv
RWSeg	0.567 47	0.528 64	0.708 55	0.626 42	0.580 32	0.745 46	0.063 49	0.627 39	0.240 52	0.400 52	0.497 40	0.464 34	0.515 47	1.000 1	0.475 45	0.745 37	0.571 44	1.000 1	0.429 46

NeuralBF	0.555 48	0.667 54	0.896 13	0.843 15	0.517 43	0.751 44	0.029 53	0.519 51	0.414 40	0.439 40	0.465 42	0.000 70	0.484 49	0.857 43	0.287 58	0.693 50	0.651 33	1.000 1	0.485 39
Weiwei Sun, Daniel Rebain, Renjie Liao, Vladimir Tankovich, Soroosh Yazdani, Kwang Moo Yi, Andrea Tagliasacchi: NeuralBF: Neural Bilateral Filtering for Top-down Instance Segmentation on Point Clouds. WACV 2023
MTML	0.549 49	1.000 1	0.807 30	0.588 50	0.327 56	0.647 52	0.004 60	0.815 7	0.180 55	0.418 47	0.364 56	0.182 54	0.445 52	1.000 1	0.442 48	0.688 52	0.571 45	1.000 1	0.396 48
Jean Lahoud, Bernard Ghanem, Marc Pollefeys, Martin R. Oswald: 3D Instance Segmentation via Multi-task Metric Learning. ICCV 2019 [oral]
ClickSeg_Instance	0.539 50	1.000 1	0.621 59	0.300 57	0.530 40	0.698 48	0.127 41	0.533 49	0.222 53	0.430 45	0.400 51	0.365 47	0.574 44	0.938 39	0.472 46	0.659 54	0.543 52	0.944 51	0.347 53

One_Thing_One_Click	0.529 51	0.667 54	0.718 51	0.777 25	0.399 52	0.683 49	0.000 63	0.669 30	0.138 58	0.391 53	0.374 55	0.539 28	0.360 59	0.641 58	0.556 39	0.774 30	0.593 40	0.997 36	0.251 58
Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu: One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation. CVPR 2021
Sparse R-CNN	0.515 52	1.000 1	0.538 64	0.282 58	0.468 50	0.790 37	0.173 32	0.345 60	0.429 37	0.413 49	0.484 41	0.176 55	0.595 42	0.591 59	0.522 42	0.668 53	0.476 57	0.986 49	0.327 54

Occipital-SCS	0.512 53	1.000 1	0.716 52	0.509 53	0.506 45	0.611 55	0.092 45	0.602 44	0.177 56	0.346 56	0.383 53	0.165 56	0.442 53	0.850 50	0.386 55	0.618 58	0.543 53	0.889 56	0.389 49

3D-BoNet	0.488 54	1.000 1	0.672 58	0.590 49	0.301 58	0.484 65	0.098 44	0.620 41	0.306 49	0.341 57	0.259 60	0.125 58	0.434 55	0.796 53	0.402 52	0.499 64	0.513 55	0.909 55	0.439 44
Bo Yang, Jianan Wang, Ronald Clark, Qingyong Hu, Sen Wang, Andrew Markham, Niki Trigoni: Learning Object Bounding Boxes for 3D Instance Segmentation on Point Clouds. NeurIPS 2019 Spotlight
PanopticFusion-inst	0.478 55	0.667 54	0.712 54	0.595 48	0.259 61	0.550 61	0.000 63	0.613 42	0.175 57	0.250 62	0.434 45	0.437 38	0.411 57	0.857 43	0.485 44	0.591 61	0.267 67	0.944 51	0.359 51
Gaku Narita, Takashi Seno, Tomoya Ishikawa, Yohsuke Kaji: PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Things. IROS 2019 (to appear)
SPG_WSIS	0.470 56	0.667 54	0.685 57	0.677 40	0.372 54	0.562 59	0.000 63	0.482 55	0.244 51	0.316 59	0.298 57	0.052 65	0.442 54	0.857 43	0.267 59	0.702 46	0.559 48	1.000 1	0.287 56

SALoss-ResNet	0.459 57	1.000 1	0.737 50	0.159 68	0.259 60	0.587 57	0.138 39	0.475 56	0.217 54	0.416 48	0.408 50	0.128 57	0.315 61	0.714 54	0.411 51	0.536 63	0.590 41	0.873 60	0.304 55
Zhidong Liang, Ming Yang, Hao Li, Chunxiang Wang: 3D Instance Embedding Learning With a Structure-Aware Loss Function for Point Cloud Segmentation. IEEE Robotics and Automation Letters (IROS2020)
MASC	0.447 58	0.528 64	0.555 62	0.381 55	0.382 53	0.633 53	0.002 61	0.509 53	0.260 50	0.361 55	0.432 47	0.327 50	0.451 51	0.571 60	0.367 56	0.639 56	0.386 58	0.980 50	0.276 57
Chen Liu, Yasutaka Furukawa: MASC: Multi-scale Affinity with Sparse Convolution for 3D Instance Segmentation.
SegGroup_ins	0.445 59	0.667 54	0.773 41	0.185 65	0.317 57	0.656 51	0.000 63	0.407 59	0.134 59	0.381 54	0.267 59	0.217 53	0.476 50	0.714 54	0.452 47	0.629 57	0.514 54	1.000 1	0.222 61
An Tao, Yueqi Duan, Yi Wei, Jiwen Lu, Jie Zhou: SegGroup: Seg-Level Supervision for 3D Instance and Semantic Segmentation. TIP 2022
3D-SIS	0.382 60	1.000 1	0.432 67	0.245 60	0.190 62	0.577 58	0.013 57	0.263 62	0.033 65	0.320 58	0.240 61	0.075 61	0.422 56	0.857 43	0.117 65	0.699 47	0.271 66	0.883 58	0.235 60
Ji Hou, Angela Dai, Matthias Niessner: 3D-SIS: 3D Semantic Instance Segmentation of RGB-D Scans. CVPR 2019
Hier3D	0.323 61	0.667 54	0.542 63	0.264 59	0.157 65	0.550 60	0.000 63	0.205 65	0.009 67	0.270 61	0.218 62	0.075 61	0.500 48	0.688 57	0.007 71	0.698 48	0.301 63	0.459 68	0.200 62
Tan: HCFS3D: Hierarchical Coupled Feature Selection Network for 3D Semantic and Instance Segmentation.
UNet-backbone	0.319 62	0.667 54	0.715 53	0.233 61	0.189 63	0.479 66	0.008 58	0.218 63	0.067 64	0.201 64	0.173 63	0.107 59	0.123 66	0.438 62	0.150 62	0.615 59	0.355 59	0.916 54	0.093 70

R-PointNet	0.306 63	0.500 66	0.405 68	0.311 56	0.348 55	0.589 56	0.054 50	0.068 68	0.126 60	0.283 60	0.290 58	0.028 66	0.219 64	0.214 65	0.331 57	0.396 68	0.275 64	0.821 62	0.245 59

Region-18class	0.284 64	0.250 70	0.751 49	0.228 63	0.270 59	0.521 62	0.000 63	0.468 57	0.008 69	0.205 63	0.127 64	0.000 70	0.068 68	0.070 69	0.262 61	0.652 55	0.323 61	0.740 64	0.173 63

SemRegionNet-20cls	0.250 65	0.333 67	0.613 60	0.229 62	0.163 64	0.493 63	0.000 63	0.304 61	0.107 61	0.147 67	0.100 66	0.052 64	0.231 62	0.119 67	0.039 67	0.445 66	0.325 60	0.654 65	0.141 66

3D-BEVIS	0.248 66	0.667 54	0.566 61	0.076 69	0.035 71	0.394 69	0.027 55	0.035 70	0.098 62	0.099 69	0.030 70	0.025 67	0.098 67	0.375 64	0.126 64	0.604 60	0.181 69	0.854 61	0.171 64
Cathrin Elich, Francis Engelmann, Jonas Schult, Theodora Kontogianni, Bastian Leibe: 3D-BEVIS: Birds-Eye-View Instance Segmentation.
tmp	0.248 66	0.667 54	0.437 66	0.188 64	0.153 66	0.491 64	0.000 63	0.208 64	0.094 63	0.153 66	0.099 67	0.057 63	0.217 65	0.119 67	0.039 67	0.466 65	0.302 62	0.640 66	0.140 67

Sem_Recon_ins	0.227 68	0.764 53	0.486 65	0.069 70	0.098 68	0.426 68	0.017 56	0.067 69	0.015 66	0.172 65	0.100 65	0.096 60	0.054 70	0.183 66	0.135 63	0.366 69	0.260 68	0.614 67	0.168 65

ASIS	0.199 69	0.333 67	0.253 70	0.167 67	0.140 67	0.438 67	0.000 63	0.177 66	0.008 68	0.121 68	0.069 68	0.004 69	0.231 63	0.429 63	0.036 69	0.445 67	0.273 65	0.333 70	0.119 69

Sgpn_scannet	0.143 70	0.208 71	0.390 69	0.169 66	0.065 69	0.275 70	0.029 54	0.069 67	0.000 70	0.087 70	0.043 69	0.014 68	0.027 71	0.000 70	0.112 66	0.351 70	0.168 70	0.438 69	0.138 68

MaskRCNN 2d->3d Proj	0.058 71	0.333 67	0.002 71	0.000 71	0.053 70	0.002 71	0.002 62	0.021 71	0.000 70	0.045 71	0.024 71	0.238 52	0.065 69	0.000 70	0.014 70	0.107 71	0.020 71	0.110 71	0.006 71

Method	avg iou	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	floor	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	wall	window

Virtual MVFusion (R)	0.745 1	0.861 1	0.839 1	0.881 1	0.672 2	0.512 1	0.422 17	0.898 1	0.723 1	0.714 1	0.954 2	0.454 1	0.509 1	0.773 1	0.895 1	0.756 1	0.820 1	0.653 1	0.935 1	0.891 1	0.728 1
Abhijit Kundu, Xiaoqi Yin, Alireza Fathi, David Ross, Brian Brewington, Thomas Funkhouser, Caroline Pantofaru: Virtual Multi-view Fusion for 3D Semantic Segmentation. ECCV 2020
BPNet_2D	0.670 2	0.822 3	0.795 3	0.836 2	0.659 3	0.481 2	0.451 13	0.769 4	0.656 3	0.567 4	0.931 3	0.395 6	0.390 5	0.700 4	0.534 4	0.689 10	0.770 2	0.574 3	0.865 9	0.831 3	0.675 5
Wenbo Hu, Hengshuang Zhao, Li Jiang, Jiaya Jia and Tien-Tsin Wong: Bidirectional Projection Network for Cross Dimension Scene Understanding. CVPR 2021 (Oral)
MVF-GNN（2D）	0.636 3	0.606 14	0.794 4	0.434 16	0.688 1	0.337 8	0.464 12	0.798 3	0.632 5	0.589 3	0.908 8	0.420 2	0.329 12	0.743 2	0.594 2	0.738 2	0.676 5	0.527 4	0.906 2	0.818 6	0.715 3

CU-Hybrid-2D Net	0.636 3	0.825 2	0.820 2	0.179 23	0.648 4	0.463 3	0.549 2	0.742 7	0.676 2	0.628 2	0.961 1	0.420 2	0.379 6	0.684 8	0.381 18	0.732 3	0.723 3	0.599 2	0.827 16	0.851 2	0.634 7

CMX	0.613 5	0.681 8	0.725 12	0.502 12	0.634 6	0.297 18	0.478 10	0.830 2	0.651 4	0.537 7	0.924 4	0.375 7	0.315 14	0.686 7	0.451 14	0.714 5	0.543 21	0.504 6	0.894 7	0.823 5	0.688 4

DMMF_3d	0.605 6	0.651 9	0.744 10	0.782 3	0.637 5	0.387 4	0.536 3	0.732 8	0.590 7	0.540 6	0.856 21	0.359 11	0.306 15	0.596 14	0.539 3	0.627 20	0.706 4	0.497 8	0.785 21	0.757 19	0.476 22

EMSANet	0.600 7	0.716 4	0.746 9	0.395 18	0.614 9	0.382 5	0.523 4	0.713 11	0.571 11	0.503 10	0.922 6	0.404 5	0.397 4	0.655 9	0.400 16	0.626 21	0.663 6	0.469 13	0.900 4	0.827 4	0.577 14
Seichter, Daniel and Fischedick, Söhnke and Köhler, Mona and Gross, Horst-Michael: EMSANet: Efficient Multi-Task RGB-D Scene Analysis for Indoor Environments. IJCNN 2022
MCA-Net	0.595 8	0.533 20	0.756 8	0.746 4	0.590 10	0.334 10	0.506 7	0.670 15	0.587 8	0.500 12	0.905 10	0.366 10	0.352 9	0.601 13	0.506 8	0.669 16	0.648 9	0.501 7	0.839 15	0.769 15	0.516 21

RFBNet	0.592 9	0.616 11	0.758 7	0.659 5	0.581 11	0.330 11	0.469 11	0.655 18	0.543 14	0.524 8	0.924 4	0.355 13	0.336 11	0.572 17	0.479 10	0.671 14	0.648 9	0.480 10	0.814 19	0.814 7	0.614 10

FAN_NV_RVC	0.586 10	0.510 21	0.764 6	0.079 26	0.620 8	0.330 11	0.494 8	0.753 5	0.573 9	0.556 5	0.884 16	0.405 4	0.303 16	0.718 3	0.452 13	0.672 13	0.658 7	0.509 5	0.898 5	0.813 8	0.727 2

DCRedNet	0.583 11	0.682 7	0.723 13	0.542 11	0.510 20	0.310 15	0.451 13	0.668 16	0.549 13	0.520 9	0.920 7	0.375 7	0.446 2	0.528 20	0.417 15	0.670 15	0.577 18	0.478 11	0.862 10	0.806 9	0.628 9

MIX6D_RVC	0.582 12	0.695 5	0.687 17	0.225 21	0.632 7	0.328 13	0.550 1	0.748 6	0.623 6	0.494 15	0.890 14	0.350 15	0.254 23	0.688 6	0.454 12	0.716 4	0.597 17	0.489 9	0.881 8	0.768 16	0.575 15

SSMA	0.577 13	0.695 5	0.716 15	0.439 14	0.563 14	0.314 14	0.444 15	0.719 9	0.551 12	0.503 10	0.887 15	0.346 16	0.348 10	0.603 12	0.353 20	0.709 6	0.600 15	0.457 14	0.901 3	0.786 11	0.599 13
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. International Journal of Computer Vision, 2019
DMMF	0.567 14	0.623 10	0.767 5	0.238 20	0.571 13	0.347 6	0.413 19	0.719 9	0.472 20	0.418 22	0.895 13	0.357 12	0.260 22	0.696 5	0.523 7	0.666 17	0.642 11	0.437 18	0.895 6	0.793 10	0.603 12

UNIV_CNP_RVC_UE	0.566 15	0.569 19	0.686 19	0.435 15	0.524 17	0.294 19	0.421 18	0.712 12	0.543 14	0.463 17	0.872 17	0.320 17	0.363 8	0.611 11	0.477 11	0.686 11	0.627 12	0.443 17	0.862 10	0.775 14	0.639 6

EMSAFormer	0.564 16	0.581 16	0.736 11	0.564 10	0.546 16	0.219 23	0.517 5	0.675 14	0.486 19	0.427 21	0.904 11	0.352 14	0.320 13	0.589 15	0.528 5	0.708 7	0.464 24	0.413 22	0.847 14	0.786 11	0.611 11

SN_RN152pyrx8_RVC	0.546 17	0.572 17	0.663 21	0.638 7	0.518 18	0.298 17	0.366 24	0.633 21	0.510 17	0.446 19	0.864 19	0.296 20	0.267 19	0.542 19	0.346 21	0.704 8	0.575 19	0.431 19	0.853 13	0.766 17	0.630 8

UDSSEG_RVC	0.545 18	0.610 13	0.661 22	0.588 8	0.556 15	0.268 21	0.482 9	0.642 20	0.572 10	0.475 16	0.836 23	0.312 18	0.367 7	0.630 10	0.189 23	0.639 19	0.495 23	0.452 15	0.826 17	0.756 20	0.541 17

segfomer with 6d	0.542 19	0.594 15	0.687 17	0.146 24	0.579 12	0.308 16	0.515 6	0.703 13	0.472 20	0.498 13	0.868 18	0.369 9	0.282 17	0.589 15	0.390 17	0.701 9	0.556 20	0.416 21	0.860 12	0.759 18	0.539 19

FuseNet	0.535 20	0.570 18	0.681 20	0.182 22	0.512 19	0.290 20	0.431 16	0.659 17	0.504 18	0.495 14	0.903 12	0.308 19	0.428 3	0.523 21	0.365 19	0.676 12	0.621 14	0.470 12	0.762 22	0.779 13	0.541 17
Caner Hazirbas, Lingni Ma, Csaba Domokos, Daniel Cremers: FuseNet: Incorporating Depth into Semantic Segmentation via Fusion-based CNN Architecture. ACCV 2016
AdapNet++	0.503 21	0.613 12	0.722 14	0.418 17	0.358 26	0.337 8	0.370 23	0.479 24	0.443 22	0.368 24	0.907 9	0.207 23	0.213 25	0.464 24	0.525 6	0.618 22	0.657 8	0.450 16	0.788 20	0.721 23	0.408 25
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. International Journal of Computer Vision, 2019
3DMV (2d proj)	0.498 22	0.481 24	0.612 23	0.579 9	0.456 22	0.343 7	0.384 21	0.623 22	0.525 16	0.381 23	0.845 22	0.254 22	0.264 21	0.557 18	0.182 24	0.581 24	0.598 16	0.429 20	0.760 23	0.661 25	0.446 24
Angela Dai, Matthias Niessner: 3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation. ECCV'18
MSeg1080_RVC	0.485 23	0.505 22	0.709 16	0.092 25	0.427 23	0.241 22	0.411 20	0.654 19	0.385 26	0.457 18	0.861 20	0.053 26	0.279 18	0.503 22	0.481 9	0.645 18	0.626 13	0.365 24	0.748 24	0.725 22	0.529 20
John Lambert, Zhuang Liu, Ozan Sener, James Hays, Vladlen Koltun: MSeg: A Composite Dataset for Multi-domain Semantic Segmentation. CVPR 2020
ILC-PSPNet	0.475 24	0.490 23	0.581 24	0.289 19	0.507 21	0.067 26	0.379 22	0.610 23	0.417 24	0.435 20	0.822 25	0.278 21	0.267 19	0.503 22	0.228 22	0.616 23	0.533 22	0.375 23	0.820 18	0.729 21	0.560 16

Enet (reimpl)	0.376 25	0.264 26	0.452 26	0.452 13	0.365 24	0.181 24	0.143 26	0.456 25	0.409 25	0.346 25	0.769 26	0.164 24	0.218 24	0.359 25	0.123 26	0.403 26	0.381 26	0.313 26	0.571 25	0.685 24	0.472 23
Re-implementation of Adam Paszke, Abhishek Chaurasia, Sangpil Kim, Eugenio Culurciello: ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation.
ScanNet (2d proj)	0.330 26	0.293 25	0.521 25	0.657 6	0.361 25	0.161 25	0.250 25	0.004 26	0.440 23	0.183 26	0.836 23	0.125 25	0.060 26	0.319 26	0.132 25	0.417 25	0.412 25	0.344 25	0.541 26	0.427 26	0.109 26
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner: ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes. CVPR'17

Method	avg ap	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	window

EMSANet (Instance)	0.241 1	0.401 1	0.439 1	0.085 1	0.242 1	0.220 1	0.081 1	0.289 2	0.117 2	0.121 1	0.182 1	0.126 1	0.346 1	0.181 2	0.181 2	0.358 1	0.156 1	0.675 2	0.131 1
Seichter, Daniel and Fischedick, Söhnke and Köhler, Mona and Gross, Horst-Michael: EMSANet: Efficient Multi-Task RGB-D Scene Analysis for Indoor Environments. IJCNN 2022
UniDet_RVC	0.205 2	0.381 2	0.323 3	0.037 3	0.226 3	0.177 3	0.063 2	0.277 3	0.120 1	0.067 3	0.131 3	0.074 3	0.317 2	0.080 3	0.235 1	0.289 3	0.141 3	0.678 1	0.080 3

FKNet	0.204 3	0.334 3	0.358 2	0.038 2	0.234 2	0.184 2	0.025 3	0.318 1	0.042 4	0.088 2	0.141 2	0.053 4	0.300 3	0.207 1	0.171 3	0.292 2	0.149 2	0.636 3	0.109 2

MaskRCNN_ScanNet	0.119 4	0.129 4	0.212 4	0.002 4	0.112 4	0.148 4	0.014 4	0.205 4	0.044 3	0.066 4	0.078 4	0.095 2	0.142 4	0.030 4	0.128 4	0.139 4	0.080 4	0.459 4	0.057 4
Re-implementation of Kaiming He, Georgia Gkioxari, Piotr Dollár, Ross Girshick: Mask R-CNN. ICCV'17

Presenting the ScanNet200 Benchmark

ScanNet200 Benchmark

ScanNet200 3D Semantic Label Benchmark

ScanNet200 3D Semantic Instance Benchmark

ScanNet Benchmark

3D Semantic Label Benchmark

3D Semantic Instance Benchmark

2D Semantic Label Benchmark

2D Semantic Instance Benchmark

Scene Type Classification Benchmark

Method	avg recall	apartment	bathroom	bedroom / hotel	bookstore / library	conference room	copy/mail room	hallway	kitchen	laundry room	living room / lounge	misc	office	storage / basement / garage

LAST-PCL-type	0.780 1	0.250 3	1.000 1	1.000 1	1.000 1	1.000 1	1.000 1	0.500 2	1.000 1	0.500 2	0.889 1	0.000 2	1.000 1	1.000 1
Yanmin Wu, Qiankun Gao, Renrui Zhang, and Jian Zhang: Language-Assisted 3D Scene Understanding. arxiv23.12
multi-task	0.700 2	0.500 1	1.000 1	0.882 3	0.500 3	1.000 1	1.000 1	0.500 2	1.000 1	1.000 1	0.778 2	0.000 2	0.938 2	0.000 3
Shengyu Huang, Mikhail Usvyatsov, Konrad Schindler: Indoor Scene Recognition in 3D. IROS 2020
3DASPP-SCE	0.691 3	0.500 1	0.938 3	0.824 4	1.000 1	1.000 1	0.500 3	1.000 1	0.857 3	0.500 2	0.556 4	0.000 2	0.812 3	0.500 2

SE-ResNeXt-SSMA	0.498 4	0.000 5	0.812 4	0.941 2	0.500 3	0.500 4	0.500 3	0.500 2	0.429 5	0.500 2	0.667 3	0.500 1	0.625 4	0.000 3
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. arXiv
resnet50_scannet	0.353 5	0.250 3	0.812 4	0.529 5	0.500 3	0.500 4	0.000 5	0.500 2	0.571 4	0.000 5	0.556 4	0.000 2	0.375 5	0.000 3