Benchmark Results - ScanNet Benchmark

This table lists the benchmark results for the ScanNet200 3D semantic label scenario.

Method	avg iou	head iou	common iou	tail iou	backpack	bag	ball	bar	basket	bathroom cabinet	bathroom stall	bathroom stall door	bathroom vanity	bathtub	bed	bench	bicycle	bin	blackboard	blanket	blinds	board	book	bookshelf	bottle	bowl	box	broom	bucket	bulletin board	cabinet	calendar	candle	cart	case of water bottles	ceiling	ceiling light	chair	clock	closet	closet rod	clothes	clothes dryer	coat rack	coffee kettle	coffee maker	coffee table	column	computer tower	copier	couch	counter	cup	curtain	cushion	decoration	desk	dining table	dish rack	dishwasher	door	doorframe	dresser	dumbbell	end table	fan	file cabinet	fire alarm	fire extinguisher	floor	folded chair	hat	headphones	ironing board	jacket	keyboard	keyboard piano	kitchen cabinet	kitchen counter	ladder	lamp	laptop	laundry basket	laundry detergent	laundry hamper	ledge	light	light switch	machine	mailbox	mat	microwave	mini fridge	mirror	monitor	mouse	music stand	nightstand	object	office chair	oven	paper	paper bag	paper cutter	paper towel dispenser	paper towel roll	person	piano	picture	pillow	pipe	plant	plate	plunger	poster	power outlet	power strip	printer	projector	projector screen	rack	radiator	range hood	recycling bin	refrigerator	scale	seat	shelf	shoe	shower	shower curtain	shower curtain rod	shower floor	shower head	shower wall	sign	sink	soap dispenser	sofa chair	speaker	stair rail	stairs	stand	stool	storage bin	storage container	storage organizer	stove	structure	stuffed animal	suitcase	table	telephone	tissue box	toaster	toilet	toilet paper	toilet paper dispenser	towel	trash bin	trash can	tray	tube	tv	tv stand	vacuum cleaner	vent	wall	wardrobe	washing machine	water bottle	water cooler	water pitcher	whiteboard	window	windowsill

LGround	0.272 2	0.485 2	0.184 2	0.106 2	0.476 1	0.077 2	0.218 1	0.000 1	0.000 1	0.000 1	0.547 1	0.295 2	0.540 1	0.746 3	0.745 2	0.058 3	0.112 4	0.005 1	0.658 2	0.077 4	0.000 3	0.322 2	0.178 3	0.512 3	0.190 2	0.199 1	0.277 2	0.000 1	0.000 2	0.173 1	0.399 2	0.000 2	0.000 1	0.039 3	0.000 2	0.858 2	0.085 3	0.676 1	0.002 1	0.103 1	0.498 2	0.323 2	0.703 2	0.000 1	0.000 1	0.296 2	0.549 3	0.216 1	0.702 1	0.768 2	0.718 2	0.028 3	0.092 3	0.786 3	0.000 1	0.000 2	0.453 3	0.022 3	0.251 4	0.252 2	0.572 2	0.348 2	0.321 2	0.514 2	0.063 3	0.279 3	0.552 2	0.000 2	0.019 3	0.932 2	0.132 3	0.000 1	0.000 2	0.000 4	0.156 4	0.457 2	0.623 2	0.518 2	0.265 3	0.358 2	0.381 2	0.395 2	0.000 1	0.000 1	0.127 4	0.012 3	0.051 1	0.000 2	0.000 2	0.886 3	0.014 2	0.437 4	0.179 1	0.244 2	0.826 2	0.000 2	0.000 1	0.599 2	0.136 1	0.085 2	0.000 3	0.000 1	0.000 1	0.565 1	0.612 2	0.143 1	0.207 2	0.566 2	0.232 3	0.446 2	0.127 1	0.708 3	0.000 2	0.384 2	0.000 1	0.000 2	0.000 1	0.402 2	0.000 1	0.059 1	0.000 1	0.525 4	0.566 2	0.229 3	0.659 3	0.000 1	0.000 1	0.265 2	0.446 2	0.147 3	0.720 4	0.597 2	0.066 3	0.000 2	0.187 1	0.000 1	0.726 2	0.467 4	0.134 3	0.000 3	0.413 3	0.629 2	0.000 1	0.363 3	0.055 3	0.022 2	0.000 1	0.626 1	0.000 2	0.000 1	0.323 3	0.479 4	0.154 3	0.117 2	0.028 3	0.901 2	0.243 2	0.415 4	0.295 4	0.143 4	0.610 3	0.000 1	0.000 3	0.777 1	0.397 4	0.324 3	0.000 1	0.778 2	0.179 2	0.702 3	0.000 1	0.274 4	0.404 1	0.233 2	0.622 2	0.398 2
David Rozenberszki, Or Litany, Angela Dai: Language-Grounded Indoor 3D Semantic Segmentation in the Wild. arXiv
CSC-Pretrain	0.249 4	0.455 4	0.171 3	0.079 4	0.418 3	0.059 3	0.186 2	0.000 1	0.000 1	0.000 1	0.335 4	0.250 3	0.316 3	0.766 2	0.697 4	0.142 2	0.170 2	0.003 2	0.553 3	0.112 1	0.097 1	0.201 4	0.186 2	0.476 4	0.081 3	0.000 2	0.216 4	0.000 1	0.000 2	0.001 4	0.314 4	0.000 2	0.000 1	0.055 2	0.000 2	0.832 4	0.094 1	0.659 3	0.002 1	0.076 2	0.310 4	0.293 4	0.664 4	0.000 1	0.000 1	0.175 4	0.634 1	0.130 2	0.552 4	0.686 4	0.700 4	0.076 2	0.110 2	0.770 4	0.000 1	0.000 2	0.430 4	0.000 4	0.319 2	0.166 3	0.542 4	0.327 3	0.205 4	0.332 3	0.052 4	0.375 1	0.444 4	0.000 2	0.012 4	0.930 4	0.203 1	0.000 1	0.000 2	0.046 1	0.175 2	0.413 3	0.592 3	0.471 3	0.299 2	0.152 4	0.340 3	0.247 4	0.000 1	0.000 1	0.225 2	0.058 2	0.037 2	0.000 2	0.207 1	0.862 4	0.014 2	0.548 2	0.033 3	0.233 3	0.816 3	0.000 2	0.000 1	0.542 4	0.123 2	0.121 1	0.019 1	0.000 1	0.000 1	0.463 3	0.454 4	0.045 4	0.128 4	0.557 3	0.235 2	0.441 3	0.063 4	0.484 4	0.000 2	0.308 4	0.000 1	0.000 2	0.000 1	0.318 4	0.000 1	0.000 2	0.000 1	0.545 3	0.543 3	0.164 4	0.734 2	0.000 1	0.000 1	0.215 4	0.371 3	0.198 2	0.743 2	0.205 4	0.062 4	0.000 2	0.079 2	0.000 1	0.683 3	0.547 3	0.142 2	0.000 3	0.441 2	0.579 4	0.000 1	0.464 2	0.098 2	0.041 1	0.000 1	0.590 3	0.000 2	0.000 1	0.373 1	0.494 2	0.174 2	0.105 3	0.001 4	0.895 3	0.222 3	0.537 3	0.307 3	0.180 3	0.625 2	0.000 1	0.000 3	0.591 4	0.609 3	0.398 2	0.000 1	0.766 4	0.014 4	0.638 4	0.000 1	0.377 2	0.004 3	0.206 4	0.609 4	0.465 1
Ji Hou, Benjamin Graham, Matthias Nießner, Saining Xie: Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts. CVPR 2021
Minkowski 34D	0.253 3	0.463 3	0.154 4	0.102 3	0.381 4	0.084 1	0.134 4	0.000 1	0.000 1	0.000 1	0.386 3	0.141 4	0.279 4	0.737 4	0.703 3	0.014 4	0.164 3	0.000 3	0.663 1	0.092 3	0.000 3	0.224 3	0.291 1	0.531 2	0.056 4	0.000 2	0.242 3	0.000 1	0.000 2	0.013 2	0.331 3	0.000 2	0.000 1	0.035 4	0.001 1	0.858 2	0.059 4	0.650 4	0.000 3	0.056 3	0.353 3	0.299 3	0.670 3	0.000 1	0.000 1	0.284 3	0.484 4	0.071 3	0.594 3	0.720 3	0.710 3	0.027 4	0.068 4	0.813 2	0.000 1	0.005 1	0.492 2	0.164 1	0.274 3	0.111 4	0.571 3	0.307 4	0.293 3	0.307 4	0.150 1	0.163 4	0.531 3	0.002 1	0.545 1	0.932 2	0.093 4	0.000 1	0.000 2	0.002 3	0.159 3	0.368 4	0.581 4	0.440 4	0.228 4	0.406 1	0.282 4	0.294 3	0.000 1	0.000 1	0.189 3	0.060 1	0.036 3	0.000 2	0.000 2	0.897 2	0.000 4	0.525 3	0.025 4	0.205 4	0.771 4	0.000 2	0.000 1	0.593 3	0.108 3	0.044 3	0.000 3	0.000 1	0.000 1	0.282 4	0.589 3	0.094 3	0.169 3	0.466 4	0.227 4	0.419 4	0.125 2	0.757 2	0.002 1	0.334 3	0.000 1	0.000 2	0.000 1	0.357 3	0.000 1	0.000 2	0.000 1	0.582 2	0.513 4	0.337 2	0.612 4	0.000 1	0.000 1	0.250 3	0.352 4	0.136 4	0.724 3	0.655 1	0.280 2	0.000 2	0.046 4	0.000 1	0.606 4	0.559 2	0.159 1	0.102 1	0.445 1	0.655 1	0.000 1	0.310 4	0.117 1	0.000 3	0.000 1	0.581 4	0.026 1	0.000 1	0.265 4	0.483 3	0.084 4	0.097 4	0.044 2	0.865 4	0.142 4	0.588 2	0.351 2	0.272 2	0.596 4	0.000 1	0.003 2	0.622 3	0.720 2	0.096 4	0.000 1	0.771 3	0.016 3	0.772 2	0.000 1	0.302 3	0.194 2	0.214 3	0.621 3	0.197 4
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019
CeCo	0.340 1	0.551 1	0.247 1	0.181 1	0.475 2	0.057 4	0.142 3	0.000 1	0.000 1	0.000 1	0.387 2	0.463 1	0.499 2	0.924 1	0.774 1	0.213 1	0.257 1	0.000 3	0.546 4	0.100 2	0.006 2	0.615 1	0.177 4	0.534 1	0.246 1	0.000 2	0.400 1	0.000 1	0.338 1	0.006 3	0.484 1	0.609 1	0.000 1	0.083 1	0.000 2	0.873 1	0.089 2	0.661 2	0.000 3	0.048 4	0.560 1	0.408 1	0.892 1	0.000 1	0.000 1	0.586 1	0.616 2	0.000 4	0.692 2	0.900 1	0.721 1	0.162 1	0.228 1	0.860 1	0.000 1	0.000 2	0.575 1	0.083 2	0.550 1	0.347 1	0.624 1	0.410 1	0.360 1	0.740 1	0.109 2	0.321 2	0.660 1	0.000 2	0.121 2	0.939 1	0.143 2	0.000 1	0.400 1	0.003 2	0.190 1	0.564 1	0.652 1	0.615 1	0.421 1	0.304 3	0.579 1	0.547 1	0.000 1	0.000 1	0.296 1	0.000 4	0.030 4	0.096 1	0.000 2	0.916 1	0.037 1	0.551 1	0.171 2	0.376 1	0.865 1	0.286 1	0.000 1	0.633 1	0.102 4	0.027 4	0.011 2	0.000 1	0.000 1	0.474 2	0.742 1	0.133 2	0.311 1	0.824 1	0.242 1	0.503 1	0.068 3	0.828 1	0.000 2	0.429 1	0.000 1	0.063 1	0.000 1	0.781 1	0.000 1	0.000 2	0.000 1	0.665 1	0.633 1	0.450 1	0.818 1	0.000 1	0.000 1	0.429 1	0.532 1	0.226 1	0.825 1	0.510 3	0.377 1	0.709 1	0.079 2	0.000 1	0.753 1	0.683 1	0.102 4	0.063 2	0.401 4	0.620 3	0.000 1	0.619 1	0.000 4	0.000 3	0.000 1	0.595 2	0.000 2	0.000 1	0.345 2	0.564 1	0.411 1	0.603 1	0.384 1	0.945 1	0.266 1	0.643 1	0.367 1	0.304 1	0.663 1	0.000 1	0.010 1	0.726 2	0.767 1	0.898 1	0.000 1	0.784 1	0.435 1	0.861 1	0.000 1	0.447 1	0.000 4	0.257 1	0.656 1	0.377 3
: Understanding Imbalanced Semantic Segmentation Through Neural Collapse.

This table lists the benchmark results for the ScanNet200 3D semantic instance scenario.

Method	avg ap	head ap	common ap	tail ap	backpack	bag	ball	bar	basket	bathroom cabinet	bathroom stall	bathroom stall door	bathroom vanity	bathtub	bed	bench	bicycle	bin	blackboard	blanket	blinds	board	book	bookshelf	bottle	bowl	box	broom	bucket	bulletin board	cabinet	calendar	candle	cart	case of water bottles	ceiling	ceiling light	chair	clock	closet	closet rod	clothes	clothes dryer	coat rack	coffee kettle	coffee maker	coffee table	column	computer tower	copier	couch	counter	cup	curtain	cushion	decoration	desk	dining table	dish rack	dishwasher	door	doorframe	dresser	dumbbell	end table	fan	file cabinet	fire alarm	fire extinguisher	folded chair	hat	headphones	ironing board	jacket	keyboard	keyboard piano	kitchen cabinet	kitchen counter	ladder	lamp	laptop	laundry basket	laundry detergent	laundry hamper	ledge	light	light switch	machine	mailbox	mat	microwave	mini fridge	mirror	monitor	mouse	music stand	nightstand	object	office chair	oven	paper	paper bag	paper cutter	paper towel dispenser	paper towel roll	person	piano	picture	pillow	pipe	plant	plate	plunger	poster	power outlet	power strip	printer	projector	projector screen	rack	radiator	range hood	recycling bin	refrigerator	scale	seat	shelf	shoe	shower	shower curtain	shower curtain rod	shower floor	shower head	shower wall	sign	sink	soap dispenser	sofa chair	speaker	stair rail	stairs	stand	stool	storage bin	storage container	storage organizer	stove	structure	stuffed animal	suitcase	table	telephone	tissue box	toaster	toilet	toilet paper	toilet paper dispenser	towel	trash bin	trash can	tray	tube	tv	tv stand	vacuum cleaner	vent	wardrobe	washing machine	water bottle	water cooler	water pitcher	whiteboard	window	windowsill

Mask3D Scannet200	0.278 1	0.383 1	0.263 1	0.168 1	0.506 1	0.068 1	0.083 5	0.000 1	0.000 1	0.000 1	0.023 2	0.149 4	0.302 1	0.778 3	0.647 1	0.569 1	0.500 1	0.031 1	0.014 2	0.027 2	0.173 1	0.311 1	0.195 1	0.351 3	0.258 1	0.000 1	0.082 1	0.000 1	0.003 1	0.037 2	0.391 1	1.000 1	0.000 1	0.014 2	0.000 1	0.572 1	0.573 1	0.661 2	0.000 1	0.003 1	0.005 4	0.082 4	0.349 1	0.028 1	0.000 1	0.605 1	0.515 3	0.509 1	0.711 1	1.000 1	0.665 3	0.015 2	0.107 1	0.402 4	0.201 1	0.083 1	0.304 1	0.759 1	0.491 1	0.378 1	0.572 1	0.119 1	0.277 1	0.013 5	0.089 1	0.283 2	0.411 2	0.267 1	0.006 3	0.156 2	0.000 1	0.116 1	0.000 1	0.105 3	0.556 1	0.514 1	0.396 1	0.275 1	0.323 1	0.215 2	0.380 1	0.000 1	0.000 1	0.356 1	0.005 2	0.208 1	0.325 1	0.000 1	0.050 4	0.400 1	0.561 1	0.258 1	0.179 1	0.722 1	0.147 1	0.000 1	0.586 1	0.063 1	0.015 2	0.139 1	0.016 1	0.028 1	0.708 1	0.418 2	0.016 1	0.048 3	0.500 1	0.489 1	0.349 1	0.001 2	0.475 2	0.086 1	0.365 1	0.000 1	0.500 1	0.000 2	0.323 3	0.000 1	0.222 1	0.000 1	0.497 1	0.626 1	0.044 3	0.795 1	0.556 1	0.008 2	0.121 4	0.265 1	0.667 1	0.789 1	0.568 2	0.579 1	0.444 1	0.176 1	0.004 2	0.474 1	0.752 1	0.233 2	0.014 2	0.002 4	0.570 2	0.007 1	0.377 5	0.000 1	0.000 2	0.000 2	0.337 1	0.000 1	0.000 1	0.384 1	0.465 1	0.287 1	0.085 1	0.048 2	0.816 5	0.467 1	0.810 1	0.377 1	0.415 1	0.744 1	0.000 1	0.004 1	0.724 1	0.778 2	0.590 1	0.000 1	0.032 2	0.441 1	0.000 1	0.377 2	0.391 1	0.427 1	0.321 1	0.192 1
Jonas Schult, Francis Engelmann, Alexander Hermans, Or Litany, Siyu Tang, Bastian Leibe: Mask3D for 3D Semantic Instance Segmentation. ICRA 2023
LGround Inst.	0.154 3	0.275 3	0.108 3	0.060 3	0.295 5	0.002 4	0.278 1	0.000 1	0.000 1	0.000 1	0.006 4	0.272 2	0.064 5	0.815 2	0.503 3	0.333 5	0.000 2	0.000 3	0.556 1	0.001 4	0.000 2	0.148 3	0.078 2	0.448 1	0.007 3	0.000 1	0.024 3	0.000 1	0.000 2	0.000 3	0.190 4	0.000 2	0.000 1	0.000 3	0.000 1	0.209 5	0.031 5	0.573 3	0.000 1	0.000 2	0.041 2	0.099 3	0.037 4	0.000 2	0.000 1	0.327 2	0.364 5	0.181 2	0.642 2	1.000 1	0.654 4	0.000 3	0.023 3	0.429 3	0.000 3	0.000 3	0.097 3	0.000 3	0.278 2	0.267 2	0.434 3	0.048 2	0.092 3	0.257 2	0.030 3	0.097 4	0.189 3	0.000 2	0.089 2	0.000 5	0.000 1	0.000 3	0.000 1	0.115 2	0.166 3	0.222 5	0.222 3	0.003 3	0.127 3	0.213 4	0.169 2	0.000 1	0.000 1	0.000 3	0.000 3	0.044 3	0.000 3	0.000 1	0.000 5	0.000 4	0.268 5	0.222 2	0.130 2	0.494 3	0.000 3	0.000 1	0.363 3	0.015 3	0.000 3	0.000 3	0.000 2	0.000 3	0.611 2	0.400 3	0.000 2	0.056 2	0.278 3	0.242 4	0.180 3	0.000 3	0.383 4	0.000 2	0.209 2	0.000 1	0.000 3	0.000 2	0.364 2	0.000 1	0.000 2	0.000 1	0.323 4	0.302 3	0.019 4	0.654 2	0.000 3	0.000 3	0.141 2	0.045 3	0.000 5	0.427 5	0.514 3	0.143 3	0.000 2	0.028 4	0.000 3	0.252 3	0.402 4	0.156 4	0.000 3	0.028 2	0.470 3	0.000 3	0.444 3	0.000 1	0.000 2	0.000 2	0.205 3	0.000 1	0.000 1	0.203 3	0.381 3	0.026 3	0.037 3	0.000 3	0.881 3	0.099 4	0.135 4	0.239 3	0.000 4	0.585 4	0.000 1	0.000 2	0.616 2	0.778 2	0.322 2	0.000 1	0.000 3	0.407 3	0.000 1	0.333 4	0.148 3	0.177 3	0.242 3	0.028 3
David Rozenberszki, Or Litany, Angela Dai: Language-Grounded Indoor 3D Semantic Segmentation in the Wild.
TD3D Scannet200	0.211 2	0.332 2	0.177 2	0.103 2	0.337 2	0.036 2	0.222 4	0.000 1	0.000 1	0.000 1	0.031 1	0.342 1	0.093 4	0.852 1	0.452 4	0.559 2	0.000 2	0.004 2	0.000 3	0.039 1	0.000 2	0.309 2	0.047 4	0.380 2	0.028 2	0.000 1	0.080 2	0.000 1	0.000 2	0.147 1	0.192 3	0.000 2	0.000 1	0.083 1	0.000 1	0.395 2	0.039 4	0.662 1	0.000 1	0.000 2	0.074 1	0.135 1	0.296 2	0.000 2	0.000 1	0.231 5	0.646 1	0.139 3	0.633 3	1.000 1	0.705 1	0.048 1	0.088 2	0.439 2	0.184 2	0.039 2	0.266 2	0.551 2	0.260 3	0.026 5	0.463 2	0.046 3	0.252 2	0.249 3	0.083 2	0.372 1	0.411 1	0.000 2	0.414 1	0.323 1	0.000 1	0.052 2	0.000 1	0.157 1	0.278 2	0.278 2	0.237 2	0.015 2	0.321 2	0.253 1	0.060 4	0.000 1	0.000 1	0.272 2	0.008 1	0.169 2	0.032 2	0.000 1	0.404 1	0.356 2	0.283 2	0.073 3	0.028 5	0.617 2	0.038 2	0.000 1	0.494 2	0.037 2	0.215 1	0.083 2	0.000 2	0.003 2	0.486 3	0.694 1	0.000 2	0.040 4	0.083 4	0.219 5	0.209 2	0.007 1	0.483 1	0.000 2	0.125 4	0.000 1	0.150 2	0.014 1	0.544 1	0.000 1	0.000 2	0.000 1	0.260 5	0.143 5	0.200 1	0.610 3	0.028 2	0.032 1	0.145 1	0.059 2	0.046 4	0.740 2	0.806 1	0.543 2	0.000 2	0.108 2	0.008 1	0.222 5	0.669 2	0.456 1	0.074 1	0.224 1	0.586 1	0.006 2	0.451 2	0.000 1	0.002 1	0.889 1	0.282 2	0.000 1	0.000 1	0.252 2	0.413 2	0.111 2	0.074 2	0.240 1	0.893 1	0.266 2	0.144 3	0.293 2	0.281 2	0.604 2	0.000 1	0.000 2	0.379 5	0.963 1	0.250 4	0.000 1	0.160 1	0.420 2	0.000 1	0.343 3	0.207 2	0.079 5	0.315 2	0.052 2

Minkowski 34D Inst.	0.130 4	0.246 4	0.083 4	0.043 5	0.299 4	0.000 5	0.278 1	0.000 1	0.000 1	0.000 1	0.022 3	0.175 3	0.122 2	0.537 4	0.521 2	0.400 3	0.000 2	0.000 3	0.000 3	0.008 3	0.000 2	0.048 4	0.076 3	0.182 5	0.000 4	0.000 1	0.022 4	0.000 1	0.000 2	0.000 3	0.141 5	0.000 2	0.000 1	0.000 3	0.000 1	0.210 4	0.063 2	0.547 5	0.000 1	0.000 2	0.000 5	0.100 2	0.026 5	0.000 2	0.000 1	0.241 4	0.488 4	0.000 4	0.564 5	1.000 1	0.672 2	0.000 3	0.021 4	0.486 1	0.000 3	0.000 3	0.067 4	0.000 3	0.194 5	0.033 4	0.415 4	0.026 4	0.025 5	0.271 1	0.004 4	0.094 5	0.142 5	0.000 2	0.000 4	0.111 3	0.000 1	0.000 3	0.000 1	0.088 4	0.083 5	0.278 2	0.110 4	0.000 4	0.082 5	0.199 5	0.137 3	0.000 1	0.000 1	0.000 3	0.000 3	0.041 4	0.000 3	0.000 1	0.308 2	0.067 3	0.280 3	0.016 4	0.101 3	0.373 5	0.000 3	0.000 1	0.319 4	0.007 4	0.000 3	0.000 3	0.000 2	0.000 3	0.028 5	0.355 5	0.000 2	0.101 1	0.444 2	0.289 2	0.114 5	0.000 3	0.394 3	0.000 2	0.032 5	0.000 1	0.000 3	0.000 2	0.201 5	0.000 1	0.000 2	0.000 1	0.384 2	0.248 4	0.000 5	0.529 4	0.000 3	0.000 3	0.133 3	0.020 5	0.089 3	0.720 3	0.500 4	0.099 4	0.000 2	0.000 5	0.000 3	0.238 4	0.334 5	0.190 3	0.000 3	0.000 5	0.317 5	0.000 3	0.472 1	0.000 1	0.000 2	0.000 2	0.094 5	0.000 1	0.000 1	0.082 5	0.236 4	0.004 5	0.019 4	0.000 3	0.883 2	0.061 5	0.262 2	0.217 4	0.000 4	0.557 5	0.000 1	0.000 2	0.460 4	0.761 4	0.156 5	0.000 1	0.000 3	0.259 4	0.000 1	0.394 1	0.019 4	0.084 4	0.232 4	0.000 5
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019
CSC-Pretrain Inst.	0.123 5	0.223 5	0.082 5	0.046 4	0.308 3	0.004 3	0.278 1	0.000 1	0.000 1	0.000 1	0.000 5	0.032 5	0.105 3	0.537 4	0.348 5	0.378 4	0.000 2	0.000 3	0.000 3	0.000 5	0.000 2	0.000 5	0.037 5	0.323 4	0.000 4	0.000 1	0.013 5	0.000 1	0.000 2	0.000 3	0.235 2	0.000 2	0.000 1	0.000 3	0.000 1	0.231 3	0.045 3	0.564 4	0.000 1	0.000 2	0.006 3	0.078 5	0.065 3	0.000 2	0.000 1	0.259 3	0.516 2	0.000 4	0.600 4	1.000 1	0.578 5	0.000 3	0.000 5	0.184 5	0.000 3	0.000 3	0.034 5	0.000 3	0.211 4	0.089 3	0.394 5	0.018 5	0.064 4	0.171 4	0.001 5	0.144 3	0.172 4	0.000 2	0.000 4	0.044 4	0.000 1	0.000 3	0.000 1	0.064 5	0.126 4	0.278 2	0.093 5	0.000 4	0.094 4	0.214 3	0.011 5	0.000 1	0.000 1	0.000 3	0.000 3	0.022 5	0.000 3	0.000 1	0.275 3	0.000 4	0.275 4	0.000 5	0.098 4	0.407 4	0.000 3	0.000 1	0.250 5	0.007 5	0.000 3	0.000 3	0.000 2	0.000 3	0.333 4	0.376 4	0.000 2	0.000 5	0.042 5	0.285 3	0.119 4	0.000 3	0.224 5	0.000 2	0.184 3	0.000 1	0.000 3	0.000 2	0.244 4	0.000 1	0.000 2	0.000 1	0.377 3	0.378 2	0.051 2	0.424 5	0.000 3	0.000 3	0.116 5	0.030 4	0.125 2	0.441 4	0.444 5	0.063 5	0.000 2	0.042 3	0.000 3	0.297 2	0.483 3	0.096 5	0.000 3	0.028 2	0.338 4	0.000 3	0.444 3	0.000 1	0.000 2	0.000 2	0.189 4	0.000 1	0.000 1	0.141 4	0.152 5	0.017 4	0.000 5	0.000 3	0.838 4	0.193 3	0.111 5	0.105 5	0.198 3	0.588 3	0.000 1	0.000 2	0.542 3	0.343 5	0.267 3	0.000 1	0.000 3	0.108 5	0.000 1	0.333 4	0.000 5	0.228 2	0.202 5	0.022 4
Ji Hou, Benjamin Graham, Matthias Nießner, Saining Xie: Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts. CVPR 2021

ScanNet Benchmark

This table lists the benchmark results for the 3D semantic label scenario.

Method	avg iou	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	floor	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	wall	window

Mix3D	0.781 1	0.964 1	0.855 1	0.843 10	0.781 1	0.858 7	0.575 3	0.831 19	0.685 7	0.714 1	0.979 1	0.594 3	0.310 17	0.801 1	0.892 8	0.841 2	0.819 3	0.723 3	0.940 8	0.887 1	0.725 12
Alexey Nekrasov, Jonas Schult, Or Litany, Bastian Leibe, Francis Engelmann: Mix3D: Out-of-Context Data Augmentation for 3D Scenes. 3DV 2021 (Oral)
OccuSeg+Semantic	0.764 2	0.758 46	0.796 20	0.839 12	0.746 11	0.907 1	0.562 5	0.850 13	0.680 9	0.672 5	0.978 2	0.610 1	0.335 8	0.777 4	0.819 32	0.847 1	0.830 1	0.691 8	0.972 1	0.885 2	0.727 10

CU-Hybrid Net	0.764 2	0.924 2	0.819 8	0.840 11	0.757 6	0.853 9	0.580 1	0.848 14	0.709 2	0.643 12	0.958 10	0.587 7	0.295 23	0.753 14	0.884 12	0.758 11	0.815 6	0.725 2	0.927 17	0.867 10	0.743 5

O-CNN	0.762 4	0.924 2	0.823 5	0.844 9	0.770 2	0.852 10	0.577 2	0.847 15	0.711 1	0.640 16	0.958 10	0.592 4	0.217 58	0.762 10	0.888 9	0.758 11	0.813 7	0.726 1	0.932 15	0.868 9	0.744 4
Peng-Shuai Wang, Yang Liu, Yu-Xiao Guo, Chun-Yu Sun, Xin Tong: O-CNN: Octree-based Convolutional Neural Networks for 3D Shape Analysis. SIGGRAPH 2017
PointTransformerV2	0.752 5	0.742 53	0.809 14	0.872 1	0.758 5	0.860 6	0.552 7	0.891 5	0.610 30	0.687 2	0.960 8	0.559 14	0.304 20	0.766 8	0.926 2	0.767 8	0.797 14	0.644 22	0.942 6	0.876 7	0.722 14
Xiaoyang Wu, Yixing Lao, Li Jiang, Xihui Liu, Hengshuang Zhao: Point Transformer V2: Grouped Vector Attention and Partition-based Pooling. NeurIPS 2022
DMF-Net	0.752 5	0.906 6	0.793 23	0.802 29	0.689 27	0.825 31	0.556 6	0.867 9	0.681 8	0.602 30	0.960 8	0.555 16	0.365 3	0.779 3	0.859 17	0.747 14	0.795 18	0.717 4	0.917 20	0.856 18	0.764 2

PointConvFormer	0.749 7	0.793 32	0.790 24	0.807 24	0.750 10	0.856 8	0.524 16	0.881 7	0.588 41	0.642 15	0.977 4	0.591 5	0.274 34	0.781 2	0.929 1	0.804 3	0.796 15	0.642 23	0.947 3	0.885 2	0.715 17
Wenxuan Wu, Qi Shan, Li Fuxin: PointConvFormer: Revenge of the Point-based Convolution.
BPNet	0.749 7	0.909 4	0.818 10	0.811 21	0.752 8	0.839 19	0.485 32	0.842 16	0.673 10	0.644 11	0.957 13	0.528 25	0.305 19	0.773 6	0.859 17	0.788 4	0.818 5	0.693 7	0.916 21	0.856 18	0.723 13
Wenbo Hu, Hengshuang Zhao, Li Jiang, Jiaya Jia, Tien-Tsin Wong: Bidirectional Projection Network for Cross Dimension Scene Understanding. CVPR 2021 (Oral)
MSP	0.748 9	0.623 79	0.804 16	0.859 3	0.745 12	0.824 33	0.501 23	0.912 2	0.690 6	0.685 3	0.956 14	0.567 11	0.320 13	0.768 7	0.918 3	0.720 22	0.802 10	0.676 12	0.921 18	0.881 4	0.779 1

StratifiedFormer	0.747 10	0.901 7	0.803 17	0.845 8	0.757 6	0.846 14	0.512 19	0.825 22	0.696 5	0.645 10	0.956 14	0.576 9	0.262 44	0.744 18	0.861 16	0.742 15	0.770 30	0.705 5	0.899 33	0.860 15	0.734 6
Xin Lai, Jianhui Liu, Li Jiang, Liwei Wang, Hengshuang Zhao, Shu Liu, Xiaojuan Qi, Jiaya Jia: Stratified Transformer for 3D Point Cloud Segmentation. CVPR 2022
VMNet	0.746 11	0.870 12	0.838 2	0.858 4	0.729 17	0.850 12	0.501 23	0.874 8	0.587 42	0.658 8	0.956 14	0.564 12	0.299 21	0.765 9	0.900 5	0.716 25	0.812 8	0.631 28	0.939 9	0.858 16	0.709 18
Zeyu HU, Xuyang Bai, Jiaxiang Shang, Runze Zhang, Jiayu Dong, Xin Wang, Guangyuan Sun, Hongbo Fu, Chiew-Lan Tai: VMNet: Voxel-Mesh Network for Geodesic-Aware 3D Semantic Segmentation. ICCV 2021 (Oral)
Virtual MVFusion	0.746 11	0.771 40	0.819 8	0.848 6	0.702 25	0.865 5	0.397 70	0.899 3	0.699 3	0.664 7	0.948 41	0.588 6	0.330 9	0.746 17	0.851 24	0.764 9	0.796 15	0.704 6	0.935 11	0.866 11	0.728 8
Abhijit Kundu, Xiaoqi Yin, Alireza Fathi, David Ross, Brian Brewington, Thomas Funkhouser, Caroline Pantofaru: Virtual Multi-view Fusion for 3D Semantic Segmentation. ECCV 2020
Retro-FPN	0.744 13	0.842 19	0.800 18	0.767 41	0.740 13	0.836 22	0.541 10	0.914 1	0.672 11	0.626 19	0.958 10	0.552 17	0.272 36	0.777 4	0.886 11	0.696 32	0.801 11	0.674 14	0.941 7	0.858 16	0.717 15

EQ-Net	0.743 14	0.620 80	0.799 19	0.849 5	0.730 16	0.822 35	0.493 30	0.897 4	0.664 12	0.681 4	0.955 18	0.562 13	0.378 1	0.760 11	0.903 4	0.738 16	0.801 11	0.673 15	0.907 26	0.877 5	0.745 3
Zetong Yang, Li Jiang, Yanan Sun, Bernt Schiele, Jiaya JIa: A Unified Query-based Paradigm for Point Cloud Understanding. CVPR 2022
LRPNet	0.742 15	0.816 27	0.806 15	0.807 24	0.752 8	0.828 29	0.575 3	0.839 18	0.699 3	0.637 17	0.954 23	0.520 27	0.320 13	0.755 13	0.834 28	0.760 10	0.772 27	0.676 12	0.915 22	0.862 13	0.717 15

SAT	0.742 15	0.860 14	0.765 35	0.819 16	0.769 3	0.848 13	0.533 12	0.829 20	0.663 13	0.631 18	0.955 18	0.586 8	0.274 34	0.753 14	0.896 6	0.729 17	0.760 37	0.666 17	0.921 18	0.855 20	0.733 7

TXC	0.740 17	0.842 19	0.832 4	0.805 28	0.715 21	0.846 14	0.473 34	0.885 6	0.615 26	0.671 6	0.971 6	0.547 18	0.320 13	0.697 22	0.799 37	0.777 6	0.819 3	0.682 10	0.946 4	0.871 8	0.696 23

LargeKernel3D	0.739 18	0.909 4	0.820 7	0.806 26	0.740 13	0.852 10	0.545 9	0.826 21	0.594 40	0.643 12	0.955 18	0.541 20	0.263 43	0.723 20	0.858 19	0.775 7	0.767 31	0.678 11	0.933 13	0.848 24	0.694 24

MinkowskiNet	0.736 19	0.859 15	0.818 10	0.832 13	0.709 22	0.840 18	0.521 18	0.853 12	0.660 15	0.643 12	0.951 31	0.544 19	0.286 28	0.731 19	0.893 7	0.675 39	0.772 27	0.683 9	0.874 51	0.852 22	0.727 10
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019
IPCA	0.731 20	0.890 8	0.837 3	0.864 2	0.726 18	0.873 2	0.530 15	0.824 23	0.489 73	0.647 9	0.978 2	0.609 2	0.336 7	0.624 37	0.733 46	0.758 11	0.776 25	0.570 53	0.949 2	0.877 5	0.728 8

SparseConvNet	0.725 21	0.647 76	0.821 6	0.846 7	0.721 19	0.869 3	0.533 12	0.754 43	0.603 36	0.614 23	0.955 18	0.572 10	0.325 11	0.710 21	0.870 13	0.724 20	0.823 2	0.628 29	0.934 12	0.865 12	0.683 27

PointTransformer++	0.725 21	0.727 60	0.811 13	0.819 16	0.765 4	0.841 17	0.502 22	0.814 29	0.621 25	0.623 20	0.955 18	0.556 15	0.284 29	0.620 38	0.866 14	0.781 5	0.757 40	0.648 20	0.932 15	0.862 13	0.709 18

MatchingNet	0.724 23	0.812 29	0.812 12	0.810 22	0.735 15	0.834 24	0.495 29	0.860 11	0.572 48	0.602 30	0.954 23	0.512 29	0.280 31	0.757 12	0.845 26	0.725 19	0.780 23	0.606 39	0.937 10	0.851 23	0.700 21

INS-Conv-semantic	0.717 24	0.751 49	0.759 38	0.812 20	0.704 24	0.868 4	0.537 11	0.842 16	0.609 32	0.608 26	0.953 26	0.534 21	0.293 24	0.616 39	0.864 15	0.719 24	0.793 19	0.640 24	0.933 13	0.845 29	0.663 32

PointMetaBase	0.714 25	0.835 21	0.785 26	0.821 14	0.684 29	0.846 14	0.531 14	0.865 10	0.614 27	0.596 34	0.953 26	0.500 32	0.246 50	0.674 23	0.888 9	0.692 33	0.764 33	0.624 30	0.849 66	0.844 30	0.675 29

contrastBoundary	0.705 26	0.769 43	0.775 31	0.809 23	0.687 28	0.820 38	0.439 58	0.812 30	0.661 14	0.591 36	0.945 49	0.515 28	0.171 76	0.633 34	0.856 20	0.720 22	0.796 15	0.668 16	0.889 40	0.847 26	0.689 25
Liyao Tang, Yibing Zhan, Zhe Chen, Baosheng Yu, Dacheng Tao: Contrastive Boundary Learning for Point Cloud Segmentation. CVPR2022
RFCR	0.702 27	0.889 9	0.745 47	0.813 19	0.672 31	0.818 42	0.493 30	0.815 27	0.623 23	0.610 24	0.947 43	0.470 42	0.249 49	0.594 42	0.848 25	0.705 29	0.779 24	0.646 21	0.892 38	0.823 36	0.611 46
Jingyu Gong, Jiachen Xu, Xin Tan, Haichuan Song, Yanyun Qu, Yuan Xie, Lizhuang Ma: Omni-Supervised Point Cloud Segmentation via Gradual Receptive Field Component Reasoning. CVPR2021
One Thing One Click	0.701 28	0.825 25	0.796 20	0.723 48	0.716 20	0.832 25	0.433 60	0.816 25	0.634 21	0.609 25	0.969 7	0.418 67	0.344 5	0.559 54	0.833 29	0.715 26	0.808 9	0.560 57	0.902 30	0.847 26	0.680 28

JSENet	0.699 29	0.881 11	0.762 36	0.821 14	0.667 32	0.800 55	0.522 17	0.792 35	0.613 28	0.607 27	0.935 69	0.492 34	0.205 63	0.576 47	0.853 22	0.691 34	0.758 39	0.652 19	0.872 54	0.828 33	0.649 36
Zeyu HU, Mingmin Zhen, Xuyang BAI, Hongbo Fu, Chiew-lan Tai: JSENet: Joint Semantic Segmentation and Edge Detection Network for 3D Point Clouds. ECCV 2020
PicassoNet-II	0.696 30	0.704 65	0.790 24	0.787 33	0.709 22	0.837 20	0.459 42	0.815 27	0.543 57	0.615 22	0.956 14	0.529 23	0.250 47	0.551 59	0.790 38	0.703 30	0.799 13	0.619 34	0.908 25	0.848 24	0.700 21
Huan Lei, Naveed Akhtar, Mubarak Shah, and Ajmal Mian: Geometric feature learning for 3D meshes.
One-Thing-One-Click	0.693 31	0.743 52	0.794 22	0.655 72	0.684 29	0.822 35	0.497 28	0.719 53	0.622 24	0.617 21	0.977 4	0.447 54	0.339 6	0.750 16	0.664 61	0.703 30	0.790 21	0.596 43	0.946 4	0.855 20	0.647 37
Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu: One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation. CVPR 2021
Feature_GeometricNet	0.690 32	0.884 10	0.754 42	0.795 32	0.647 38	0.818 42	0.422 62	0.802 33	0.612 29	0.604 28	0.945 49	0.462 45	0.189 71	0.563 53	0.853 22	0.726 18	0.765 32	0.632 27	0.904 28	0.821 39	0.606 50
Kangcheng Liu, Ben M. Chen: https://arxiv.org/abs/2012.09439. arXiv Preprint
FusionNet	0.688 33	0.704 65	0.741 51	0.754 45	0.656 34	0.829 27	0.501 23	0.741 48	0.609 32	0.548 43	0.950 35	0.522 26	0.371 2	0.633 34	0.756 41	0.715 26	0.771 29	0.623 31	0.861 62	0.814 41	0.658 33
Feihu Zhang, Jin Fang, Benjamin Wah, Philip Torr: Deep FusionNet for Point Cloud Semantic Segmentation. ECCV 2020
Feature-Geometry Net	0.685 34	0.866 13	0.748 44	0.819 16	0.645 40	0.794 58	0.450 47	0.802 33	0.587 42	0.604 28	0.945 49	0.464 44	0.201 66	0.554 56	0.840 27	0.723 21	0.732 49	0.602 41	0.907 26	0.822 38	0.603 53

KP-FCNN	0.684 35	0.847 18	0.758 40	0.784 35	0.647 38	0.814 45	0.473 34	0.772 38	0.605 34	0.594 35	0.935 69	0.450 52	0.181 74	0.587 43	0.805 35	0.690 35	0.785 22	0.614 35	0.882 44	0.819 40	0.632 42
H. Thomas, C. Qi, J. Deschaud, B. Marcotegui, F. Goulette, L. Guibas.: KPConv: Flexible and Deformable Convolution for Point Clouds. ICCV 2019
DGNet	0.684 35	0.712 64	0.784 27	0.782 37	0.658 33	0.835 23	0.499 27	0.823 24	0.641 18	0.597 33	0.950 35	0.487 35	0.281 30	0.575 48	0.619 64	0.647 52	0.764 33	0.620 33	0.871 57	0.846 28	0.688 26

VACNN++	0.684 35	0.728 59	0.757 41	0.776 38	0.690 26	0.804 52	0.464 40	0.816 25	0.577 47	0.587 37	0.945 49	0.508 31	0.276 33	0.671 24	0.710 51	0.663 44	0.750 43	0.589 48	0.881 45	0.832 32	0.653 35

Superpoint Network	0.683 38	0.851 17	0.728 55	0.800 31	0.653 36	0.806 50	0.468 37	0.804 31	0.572 48	0.602 30	0.946 46	0.453 51	0.239 53	0.519 65	0.822 30	0.689 37	0.762 36	0.595 45	0.895 36	0.827 34	0.630 43

PointContrast_LA_SEM	0.683 38	0.757 47	0.784 27	0.786 34	0.639 42	0.824 33	0.408 65	0.775 37	0.604 35	0.541 45	0.934 73	0.532 22	0.269 39	0.552 57	0.777 39	0.645 55	0.793 19	0.640 24	0.913 23	0.824 35	0.671 30

VI-PointConv	0.676 40	0.770 42	0.754 42	0.783 36	0.621 46	0.814 45	0.552 7	0.758 41	0.571 50	0.557 41	0.954 23	0.529 23	0.268 41	0.530 63	0.682 56	0.675 39	0.719 52	0.603 40	0.888 41	0.833 31	0.665 31
Xingyi Li, Wenxuan Wu, Xiaoli Z. Fern, Li Fuxin: The Devils in the Point Clouds: Studying the Robustness of Point Cloud Convolutions.
ROSMRF3D	0.673 41	0.789 33	0.748 44	0.763 43	0.635 44	0.814 45	0.407 67	0.747 45	0.581 46	0.573 38	0.950 35	0.484 36	0.271 38	0.607 40	0.754 42	0.649 49	0.774 26	0.596 43	0.883 43	0.823 36	0.606 50

SALANet	0.670 42	0.816 27	0.770 33	0.768 40	0.652 37	0.807 49	0.451 44	0.747 45	0.659 16	0.545 44	0.924 79	0.473 41	0.149 86	0.571 50	0.811 34	0.635 58	0.746 44	0.623 31	0.892 38	0.794 53	0.570 63

PointASNL	0.666 43	0.703 67	0.781 29	0.751 47	0.655 35	0.830 26	0.471 36	0.769 39	0.474 76	0.537 47	0.951 31	0.475 40	0.279 32	0.635 32	0.698 55	0.675 39	0.751 42	0.553 62	0.816 73	0.806 45	0.703 20
Xu Yan, Chaoda Zheng, Zhen Li, Sheng Wang, Shuguang Cui: PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Sampling. CVPR 2020
PointConv	0.666 43	0.781 35	0.759 38	0.699 57	0.644 41	0.822 35	0.475 33	0.779 36	0.564 53	0.504 61	0.953 26	0.428 61	0.203 65	0.586 45	0.754 42	0.661 45	0.753 41	0.588 49	0.902 30	0.813 43	0.642 38
Wenxuan Wu, Zhongang Qi, Li Fuxin: PointConv: Deep Convolutional Networks on 3D Point Clouds. CVPR 2019
PPCNN++	0.663 45	0.746 50	0.708 59	0.722 49	0.638 43	0.820 38	0.451 44	0.566 80	0.599 38	0.541 45	0.950 35	0.510 30	0.313 16	0.648 29	0.819 32	0.616 63	0.682 68	0.590 47	0.869 58	0.810 44	0.656 34
Pyunghwan Ahn, Juyoung Yang, Eojindl Yi, Chanho Lee, Junmo Kim: Projection-based Point Convolution for Efficient Point Cloud Segmentation. IEEE Access
DCM-Net	0.658 46	0.778 36	0.702 62	0.806 26	0.619 47	0.813 48	0.468 37	0.693 61	0.494 68	0.524 53	0.941 60	0.449 53	0.298 22	0.510 67	0.821 31	0.675 39	0.727 51	0.568 55	0.826 71	0.803 47	0.637 40
Jonas Schult, Francis Engelmann, Theodora Kontogianni, Bastian Leibe: DualConvMesh-Net: Joint Geodesic and Euclidean Convolutions on 3D Meshes. CVPR 2020 [Oral]
HPGCNN	0.656 47	0.698 68	0.743 49	0.650 73	0.564 64	0.820 38	0.505 21	0.758 41	0.631 22	0.479 66	0.945 49	0.480 38	0.226 54	0.572 49	0.774 40	0.690 35	0.735 47	0.614 35	0.853 65	0.776 68	0.597 56
Jisheng Dang, Qingyong Hu, Yulan Guo, Jun Yang: HPGCNN.
SAFNet-seg	0.654 48	0.752 48	0.734 53	0.664 70	0.583 59	0.815 44	0.399 69	0.754 43	0.639 19	0.535 49	0.942 58	0.470 42	0.309 18	0.665 25	0.539 70	0.650 48	0.708 57	0.635 26	0.857 64	0.793 55	0.642 38
Linqing Zhao, Jiwen Lu, Jie Zhou: Similarity-Aware Fusion Network for 3D Semantic Segmentation. IROS 2021
RandLA-Net	0.645 49	0.778 36	0.731 54	0.699 57	0.577 60	0.829 27	0.446 49	0.736 49	0.477 75	0.523 55	0.945 49	0.454 49	0.269 39	0.484 74	0.749 45	0.618 61	0.738 45	0.599 42	0.827 70	0.792 58	0.621 45

MVPNet	0.641 50	0.831 22	0.715 57	0.671 67	0.590 55	0.781 64	0.394 71	0.679 63	0.642 17	0.553 42	0.937 66	0.462 45	0.256 45	0.649 28	0.406 83	0.626 59	0.691 65	0.666 17	0.877 47	0.792 58	0.608 49
Maximilian Jaritz, Jiayuan Gu, Hao Su: Multi-view PointNet for 3D Scene Understanding. GMDL Workshop, ICCV 2019
PointConv-SFPN	0.641 50	0.776 38	0.703 61	0.721 50	0.557 67	0.826 30	0.451 44	0.672 65	0.563 54	0.483 65	0.943 57	0.425 64	0.162 81	0.644 30	0.726 47	0.659 46	0.709 56	0.572 52	0.875 49	0.786 63	0.559 68

PointMRNet	0.640 52	0.717 63	0.701 63	0.692 60	0.576 61	0.801 54	0.467 39	0.716 54	0.563 54	0.459 71	0.953 26	0.429 60	0.169 78	0.581 46	0.854 21	0.605 64	0.710 54	0.550 63	0.894 37	0.793 55	0.575 61

FPConv	0.639 53	0.785 34	0.760 37	0.713 55	0.603 50	0.798 56	0.392 72	0.534 85	0.603 36	0.524 53	0.948 41	0.457 47	0.250 47	0.538 61	0.723 49	0.598 68	0.696 63	0.614 35	0.872 54	0.799 48	0.567 65
Yiqun Lin, Zizheng Yan, Haibin Huang, Dong Du, Ligang Liu, Shuguang Cui, Xiaoguang Han: FPConv: Learning Local Flattening for Point Convolution. CVPR 2020
PD-Net	0.638 54	0.797 31	0.769 34	0.641 78	0.590 55	0.820 38	0.461 41	0.537 84	0.637 20	0.536 48	0.947 43	0.388 75	0.206 62	0.656 26	0.668 59	0.647 52	0.732 49	0.585 50	0.868 59	0.793 55	0.473 87

PointSPNet	0.637 55	0.734 56	0.692 70	0.714 54	0.576 61	0.797 57	0.446 49	0.743 47	0.598 39	0.437 76	0.942 58	0.403 71	0.150 85	0.626 36	0.800 36	0.649 49	0.697 62	0.557 60	0.846 67	0.777 67	0.563 66

SConv	0.636 56	0.830 23	0.697 66	0.752 46	0.572 63	0.780 66	0.445 51	0.716 54	0.529 60	0.530 50	0.951 31	0.446 55	0.170 77	0.507 69	0.666 60	0.636 57	0.682 68	0.541 68	0.886 42	0.799 48	0.594 57

Supervoxel-CNN	0.635 57	0.656 74	0.711 58	0.719 51	0.613 48	0.757 75	0.444 54	0.765 40	0.534 59	0.566 39	0.928 77	0.478 39	0.272 36	0.636 31	0.531 72	0.664 43	0.645 78	0.508 76	0.864 61	0.792 58	0.611 46

joint point-based	0.634 58	0.614 81	0.778 30	0.667 69	0.633 45	0.825 31	0.420 63	0.804 31	0.467 78	0.561 40	0.951 31	0.494 33	0.291 25	0.566 51	0.458 78	0.579 75	0.764 33	0.559 59	0.838 68	0.814 41	0.598 55
Hung-Yueh Chiang, Yen-Liang Lin, Yueh-Cheng Liu, Winston H. Hsu: A Unified Point-Based Framework for 3D Segmentation. 3DV 2019
PointMTL	0.632 59	0.731 57	0.688 73	0.675 64	0.591 54	0.784 63	0.444 54	0.565 81	0.610 30	0.492 63	0.949 39	0.456 48	0.254 46	0.587 43	0.706 52	0.599 67	0.665 74	0.612 38	0.868 59	0.791 62	0.579 60

3DSM_DMMF	0.631 60	0.626 78	0.745 47	0.801 30	0.607 49	0.751 76	0.506 20	0.729 52	0.565 52	0.491 64	0.866 93	0.434 56	0.197 69	0.595 41	0.630 63	0.709 28	0.705 59	0.560 57	0.875 49	0.740 78	0.491 82

PointNet2-SFPN	0.631 60	0.771 40	0.692 70	0.672 65	0.524 72	0.837 20	0.440 57	0.706 59	0.538 58	0.446 73	0.944 55	0.421 66	0.219 57	0.552 57	0.751 44	0.591 71	0.737 46	0.543 67	0.901 32	0.768 70	0.557 69

APCF-Net	0.631 60	0.742 53	0.687 75	0.672 65	0.557 67	0.792 61	0.408 65	0.665 66	0.545 56	0.508 58	0.952 30	0.428 61	0.186 72	0.634 33	0.702 53	0.620 60	0.706 58	0.555 61	0.873 52	0.798 50	0.581 59
Haojia, Lin: Adaptive Pyramid Context Fusion for Point Cloud Perception. GRSL
FusionAwareConv	0.630 63	0.604 83	0.741 51	0.766 42	0.590 55	0.747 77	0.501 23	0.734 50	0.503 67	0.527 51	0.919 83	0.454 49	0.323 12	0.550 60	0.420 82	0.678 38	0.688 66	0.544 65	0.896 35	0.795 52	0.627 44
Jiazhao Zhang, Chenyang Zhu, Lintao Zheng, Kai Xu: Fusion-Aware Point Convolution for Online Semantic 3D Scene Segmentation. CVPR 2020
DenSeR	0.628 64	0.800 30	0.625 85	0.719 51	0.545 70	0.806 50	0.445 51	0.597 75	0.448 82	0.519 56	0.938 65	0.481 37	0.328 10	0.489 73	0.499 77	0.657 47	0.759 38	0.592 46	0.881 45	0.797 51	0.634 41

SegGroup_sem	0.627 65	0.818 26	0.747 46	0.701 56	0.602 51	0.764 72	0.385 76	0.629 72	0.490 71	0.508 58	0.931 76	0.409 69	0.201 66	0.564 52	0.725 48	0.618 61	0.692 64	0.539 69	0.873 52	0.794 53	0.548 72
An Tao, Yueqi Duan, Yi Wei, Jiwen Lu, Jie Zhou: SegGroup: Seg-Level Supervision for 3D Instance and Semantic Segmentation. TIP 2022
SIConv	0.625 66	0.830 23	0.694 68	0.757 44	0.563 65	0.772 70	0.448 48	0.647 69	0.520 62	0.509 57	0.949 39	0.431 59	0.191 70	0.496 71	0.614 65	0.647 52	0.672 72	0.535 71	0.876 48	0.783 64	0.571 62

HPEIN	0.618 67	0.729 58	0.668 76	0.647 75	0.597 53	0.766 71	0.414 64	0.680 62	0.520 62	0.525 52	0.946 46	0.432 57	0.215 59	0.493 72	0.599 66	0.638 56	0.617 83	0.570 53	0.897 34	0.806 45	0.605 52
Li Jiang, Hengshuang Zhao, Shu Liu, Xiaoyong Shen, Chi-Wing Fu, Jiaya Jia: Hierarchical Point-Edge Interaction Network for Point Cloud Semantic Segmentation. ICCV 2019
SPH3D-GCN	0.610 68	0.858 16	0.772 32	0.489 90	0.532 71	0.792 61	0.404 68	0.643 71	0.570 51	0.507 60	0.935 69	0.414 68	0.046 95	0.510 67	0.702 53	0.602 66	0.705 59	0.549 64	0.859 63	0.773 69	0.534 75
Huan Lei, Naveed Akhtar, and Ajmal Mian: Spherical Kernel for Efficient Graph Convolution on 3D Point Clouds. TPAMI 2020
AttAN	0.609 69	0.760 45	0.667 77	0.649 74	0.521 73	0.793 59	0.457 43	0.648 68	0.528 61	0.434 78	0.947 43	0.401 72	0.153 84	0.454 76	0.721 50	0.648 51	0.717 53	0.536 70	0.904 28	0.765 71	0.485 83
Gege Zhang, Qinghua Ma, Licheng Jiao, Fang Liu and Qigong Sun: AttAN: Attention Adversarial Networks for 3D Point Cloud Semantic Segmentation. IJCAI2020
wsss-transformer	0.600 70	0.634 77	0.743 49	0.697 59	0.601 52	0.781 64	0.437 59	0.585 78	0.493 69	0.446 73	0.933 74	0.394 73	0.011 97	0.654 27	0.661 62	0.603 65	0.733 48	0.526 72	0.832 69	0.761 73	0.480 84

dtc_net	0.596 71	0.683 69	0.725 56	0.715 53	0.549 69	0.803 53	0.444 54	0.647 69	0.493 69	0.495 62	0.941 60	0.409 69	0.000 99	0.424 81	0.544 69	0.598 68	0.703 61	0.522 73	0.912 24	0.792 58	0.520 78

LAP-D	0.594 72	0.720 61	0.692 70	0.637 79	0.456 82	0.773 69	0.391 74	0.730 51	0.587 42	0.445 75	0.940 63	0.381 76	0.288 26	0.434 79	0.453 80	0.591 71	0.649 76	0.581 51	0.777 77	0.749 77	0.610 48

DPC	0.592 73	0.720 61	0.700 64	0.602 83	0.480 78	0.762 74	0.380 77	0.713 57	0.585 45	0.437 76	0.940 63	0.369 78	0.288 26	0.434 79	0.509 76	0.590 73	0.639 81	0.567 56	0.772 78	0.755 75	0.592 58
Francis Engelmann, Theodora Kontogianni, Bastian Leibe: Dilated Point Convolutions: On the Receptive Field Size of Point Convolutions on 3D Point Clouds. ICRA 2020
CCRFNet	0.589 74	0.766 44	0.659 80	0.683 62	0.470 81	0.740 79	0.387 75	0.620 74	0.490 71	0.476 67	0.922 81	0.355 81	0.245 51	0.511 66	0.511 75	0.571 76	0.643 79	0.493 80	0.872 54	0.762 72	0.600 54

ROSMRF	0.580 75	0.772 39	0.707 60	0.681 63	0.563 65	0.764 72	0.362 79	0.515 86	0.465 79	0.465 70	0.936 68	0.427 63	0.207 61	0.438 77	0.577 67	0.536 79	0.675 71	0.486 81	0.723 84	0.779 65	0.524 77

SD-DETR	0.576 76	0.746 50	0.609 89	0.445 94	0.517 74	0.643 90	0.366 78	0.714 56	0.456 80	0.468 69	0.870 92	0.432 57	0.264 42	0.558 55	0.674 57	0.586 74	0.688 66	0.482 82	0.739 82	0.733 80	0.537 74

SQN_0.1%	0.569 77	0.676 71	0.696 67	0.657 71	0.497 75	0.779 67	0.424 61	0.548 82	0.515 64	0.376 83	0.902 90	0.422 65	0.357 4	0.379 84	0.456 79	0.596 70	0.659 75	0.544 65	0.685 87	0.665 91	0.556 70

TextureNet	0.566 78	0.672 73	0.664 78	0.671 67	0.494 76	0.719 80	0.445 51	0.678 64	0.411 88	0.396 81	0.935 69	0.356 80	0.225 55	0.412 82	0.535 71	0.565 77	0.636 82	0.464 84	0.794 76	0.680 88	0.568 64
Jingwei Huang, Haotian Zhang, Li Yi, Thomas Funkerhouser, Matthias Niessner, Leonidas Guibas: TextureNet: Consistent Local Parametrizations for Learning from High-Resolution Signals on Meshes. CVPR
DVVNet	0.562 79	0.648 75	0.700 64	0.770 39	0.586 58	0.687 84	0.333 83	0.650 67	0.514 65	0.475 68	0.906 87	0.359 79	0.223 56	0.340 86	0.442 81	0.422 90	0.668 73	0.501 77	0.708 85	0.779 65	0.534 75

Pointnet++ & Feature	0.557 80	0.735 55	0.661 79	0.686 61	0.491 77	0.744 78	0.392 72	0.539 83	0.451 81	0.375 84	0.946 46	0.376 77	0.205 63	0.403 83	0.356 86	0.553 78	0.643 79	0.497 78	0.824 72	0.756 74	0.515 79

GMLPs	0.538 81	0.495 91	0.693 69	0.647 75	0.471 80	0.793 59	0.300 86	0.477 87	0.505 66	0.358 85	0.903 89	0.327 84	0.081 92	0.472 75	0.529 73	0.448 88	0.710 54	0.509 74	0.746 80	0.737 79	0.554 71

PanopticFusion-label	0.529 82	0.491 92	0.688 73	0.604 82	0.386 87	0.632 91	0.225 96	0.705 60	0.434 85	0.293 91	0.815 94	0.348 82	0.241 52	0.499 70	0.669 58	0.507 81	0.649 76	0.442 90	0.796 75	0.602 94	0.561 67
Gaku Narita, Takashi Seno, Tomoya Ishikawa, Yohsuke Kaji: PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Things. IROS 2019 (to appear)
subcloud_weak	0.516 83	0.676 71	0.591 92	0.609 80	0.442 83	0.774 68	0.335 82	0.597 75	0.422 87	0.357 86	0.932 75	0.341 83	0.094 91	0.298 88	0.528 74	0.473 86	0.676 70	0.495 79	0.602 93	0.721 83	0.349 94

Online SegFusion	0.515 84	0.607 82	0.644 83	0.579 85	0.434 84	0.630 92	0.353 80	0.628 73	0.440 83	0.410 79	0.762 97	0.307 86	0.167 79	0.520 64	0.403 84	0.516 80	0.565 86	0.447 88	0.678 88	0.701 85	0.514 80
Davide Menini, Suryansh Kumar, Martin R. Oswald, Erik Sandstroem, Cristian Sminchisescu, Luc van Gool: A Real-Time Learning Framework for Joint 3D Reconstruction and Semantic Segmentation. Robotics and Automation Letters Submission
3DMV, FTSDF	0.501 85	0.558 87	0.608 90	0.424 96	0.478 79	0.690 83	0.246 92	0.586 77	0.468 77	0.450 72	0.911 85	0.394 73	0.160 82	0.438 77	0.212 93	0.432 89	0.541 91	0.475 83	0.742 81	0.727 81	0.477 85

PCNN	0.498 86	0.559 86	0.644 83	0.560 87	0.420 86	0.711 82	0.229 94	0.414 88	0.436 84	0.352 87	0.941 60	0.324 85	0.155 83	0.238 93	0.387 85	0.493 82	0.529 92	0.509 74	0.813 74	0.751 76	0.504 81

3DMV	0.484 87	0.484 93	0.538 94	0.643 77	0.424 85	0.606 95	0.310 84	0.574 79	0.433 86	0.378 82	0.796 95	0.301 87	0.214 60	0.537 62	0.208 94	0.472 87	0.507 95	0.413 93	0.693 86	0.602 94	0.539 73
Angela Dai, Matthias Niessner: 3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation. ECCV'18
PointCNN with RGB	0.458 88	0.577 85	0.611 88	0.356 98	0.321 95	0.715 81	0.299 88	0.376 92	0.328 95	0.319 89	0.944 55	0.285 89	0.164 80	0.216 96	0.229 91	0.484 84	0.545 90	0.456 86	0.755 79	0.709 84	0.475 86
Yangyan Li, Rui Bu, Mingchao Sun, Baoquan Chen: PointCNN. NeurIPS 2018
FCPN	0.447 89	0.679 70	0.604 91	0.578 86	0.380 88	0.682 85	0.291 89	0.106 98	0.483 74	0.258 96	0.920 82	0.258 93	0.025 96	0.231 95	0.325 87	0.480 85	0.560 88	0.463 85	0.725 83	0.666 90	0.231 98
Dario Rethage, Johanna Wald, Jürgen Sturm, Nassir Navab, Federico Tombari: Fully-Convolutional Point Networks for Large-Scale Point Clouds. ECCV 2018
DGCNN_reproduce	0.446 90	0.474 94	0.623 86	0.463 92	0.366 90	0.651 88	0.310 84	0.389 91	0.349 93	0.330 88	0.937 66	0.271 91	0.126 88	0.285 89	0.224 92	0.350 95	0.577 85	0.445 89	0.625 91	0.723 82	0.394 90
Yue Wang, Yongbin Sun, Ziwei Liu, Sanjay E. Sarma, Michael M. Bronstein, Justin M. Solomon: Dynamic Graph CNN for Learning on Point Clouds. TOG 2019
PNET2	0.442 91	0.548 88	0.548 93	0.597 84	0.363 91	0.628 93	0.300 86	0.292 93	0.374 90	0.307 90	0.881 91	0.268 92	0.186 72	0.238 93	0.204 95	0.407 91	0.506 96	0.449 87	0.667 89	0.620 93	0.462 88

SurfaceConvPF	0.442 91	0.505 90	0.622 87	0.380 97	0.342 93	0.654 87	0.227 95	0.397 90	0.367 91	0.276 93	0.924 79	0.240 94	0.198 68	0.359 85	0.262 89	0.366 92	0.581 84	0.435 91	0.640 90	0.668 89	0.398 89
Hao Pan, Shilin Liu, Yang Liu, Xin Tong: Convolutional Neural Networks on 3D Surfaces Using Parallel Frames.
Tangent Convolutions	0.438 93	0.437 96	0.646 82	0.474 91	0.369 89	0.645 89	0.353 80	0.258 95	0.282 97	0.279 92	0.918 84	0.298 88	0.147 87	0.283 90	0.294 88	0.487 83	0.562 87	0.427 92	0.619 92	0.633 92	0.352 93
Maxim Tatarchenko, Jaesik Park, Vladlen Koltun, Qian-Yi Zhou: Tangent convolutions for dense prediction in 3d. CVPR 2018
3DWSSS	0.425 94	0.525 89	0.647 81	0.522 88	0.324 94	0.488 98	0.077 99	0.712 58	0.353 92	0.401 80	0.636 99	0.281 90	0.176 75	0.340 86	0.565 68	0.175 99	0.551 89	0.398 94	0.370 99	0.602 94	0.361 92

SPLAT Net	0.393 95	0.472 95	0.511 95	0.606 81	0.311 96	0.656 86	0.245 93	0.405 89	0.328 95	0.197 97	0.927 78	0.227 96	0.000 99	0.001 100	0.249 90	0.271 98	0.510 93	0.383 96	0.593 94	0.699 86	0.267 96
Hang Su, Varun Jampani, Deqing Sun, Subhransu Maji, Evangelos Kalogerakis, Ming-Hsuan Yang, Jan Kautz: SPLATNet: Sparse Lattice Networks for Point Cloud Processing. CVPR 2018
ScanNet+FTSDF	0.383 96	0.297 98	0.491 96	0.432 95	0.358 92	0.612 94	0.274 90	0.116 97	0.411 88	0.265 94	0.904 88	0.229 95	0.079 93	0.250 91	0.185 96	0.320 96	0.510 93	0.385 95	0.548 95	0.597 97	0.394 90

PointNet++	0.339 97	0.584 84	0.478 97	0.458 93	0.256 98	0.360 99	0.250 91	0.247 96	0.278 98	0.261 95	0.677 98	0.183 97	0.117 89	0.212 97	0.145 98	0.364 93	0.346 99	0.232 99	0.548 95	0.523 98	0.252 97
Charles R. Qi, Li Yi, Hao Su, Leonidas J. Guibas: pointnet++: deep hierarchical feature learning on point sets in a metric space.
SSC-UNet	0.308 98	0.353 97	0.290 99	0.278 99	0.166 99	0.553 96	0.169 98	0.286 94	0.147 99	0.148 99	0.908 86	0.182 98	0.064 94	0.023 99	0.018 100	0.354 94	0.363 97	0.345 97	0.546 97	0.685 87	0.278 95

ScanNet	0.306 99	0.203 99	0.366 98	0.501 89	0.311 96	0.524 97	0.211 97	0.002 100	0.342 94	0.189 98	0.786 96	0.145 99	0.102 90	0.245 92	0.152 97	0.318 97	0.348 98	0.300 98	0.460 98	0.437 99	0.182 99
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner: ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes. CVPR'17
ERROR	0.054 100	0.000 100	0.041 100	0.172 100	0.030 100	0.062 100	0.001 100	0.035 99	0.004 100	0.051 100	0.143 100	0.019 100	0.003 98	0.041 98	0.050 99	0.003 100	0.054 100	0.018 100	0.005 100	0.264 100	0.082 100

This table lists the benchmark results for the 3D semantic instance scenario.

Method	avg ap	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	window

PBNet	0.573 1	0.926 2	0.575 9	0.619 1	0.472 2	0.736 4	0.239 4	0.487 23	0.383 2	0.459 3	0.506 6	0.533 6	0.585 5	0.767 7	0.404 7	0.717 3	0.559 4	0.969 1	0.381 4

Queryformer	0.570 2	0.926 2	0.702 1	0.393 21	0.504 1	0.733 6	0.277 2	0.383 31	0.375 3	0.479 1	0.534 3	0.533 7	0.615 3	0.720 15	0.436 6	0.745 2	0.592 1	0.958 2	0.361 9

Mask3D	0.566 3	0.926 2	0.597 5	0.408 18	0.420 3	0.737 3	0.239 3	0.598 8	0.386 1	0.458 4	0.549 1	0.568 4	0.716 1	0.601 25	0.480 3	0.646 9	0.575 3	0.922 4	0.364 6
Jonas Schult, Francis Engelmann, Alexander Hermans, Or Litany, Siyu Tang, Bastian Leibe: Mask3D for 3D Semantic Instance Segmentation. ICRA 2023
GraphCut	0.552 4	1.000 1	0.611 4	0.438 13	0.392 6	0.714 7	0.139 7	0.598 9	0.327 6	0.389 6	0.510 5	0.598 1	0.427 22	0.754 10	0.463 4	0.761 1	0.588 2	0.903 8	0.329 13

SPFormer	0.549 5	0.745 13	0.640 2	0.484 6	0.395 5	0.739 2	0.311 1	0.566 13	0.335 5	0.468 2	0.492 7	0.555 5	0.478 13	0.747 12	0.436 5	0.712 4	0.540 5	0.893 12	0.343 12
Sun Jiahao, Qing Chunmei, Tan Junpeng, Xu Xiangmin: Superpoint Transformer for 3D Scene Instance Segmentation. AAAI 2023 [Oral]
DKNet	0.532 6	0.815 8	0.624 3	0.517 3	0.377 8	0.749 1	0.107 9	0.509 20	0.304 8	0.437 5	0.475 8	0.581 2	0.539 8	0.775 6	0.339 12	0.640 11	0.506 8	0.901 9	0.385 3
Yizheng Wu, Min Shi, Shuaiyuan Du, Hao Lu, Zhiguo Cao, Weicai Zhong: 3D Instances as 1D Kernels. ECCV 2022
IPCA-Inst	0.520 7	0.889 5	0.551 13	0.548 2	0.418 4	0.665 17	0.064 18	0.585 10	0.260 16	0.277 18	0.471 10	0.500 8	0.644 2	0.785 4	0.369 8	0.591 17	0.511 6	0.878 17	0.362 7

SoftGroup++	0.513 8	0.704 19	0.578 8	0.398 20	0.363 13	0.704 8	0.061 19	0.647 4	0.297 13	0.378 9	0.537 2	0.343 10	0.614 4	0.828 3	0.295 16	0.710 6	0.505 10	0.875 19	0.394 1

SSTNet	0.506 9	0.738 16	0.549 14	0.497 5	0.316 18	0.693 11	0.178 6	0.377 32	0.198 21	0.330 11	0.463 12	0.576 3	0.515 10	0.857 2	0.494 1	0.637 12	0.457 14	0.943 3	0.290 22
Zhihao Liang, Zhihao Li, Songcen Xu, Mingkui Tan, Kui Jia: Instance Segmentation in 3D Scenes using Semantic Superpoint Tree Networks. ICCV2021
SoftGroup	0.504 10	0.667 26	0.579 6	0.372 24	0.381 7	0.694 10	0.072 15	0.677 2	0.303 9	0.387 7	0.531 4	0.319 14	0.582 6	0.754 9	0.318 13	0.643 10	0.492 11	0.907 7	0.388 2
Thang Vu, Kookhoi Kim, Tung M. Luu, Xuan Thanh Nguyen, Chang D. Yoo: SoftGroup for 3D Instance Segmentaiton on Point Clouds. CVPR 2022 [Oral]
TD3D	0.489 11	0.852 6	0.511 22	0.434 14	0.322 17	0.735 5	0.101 12	0.512 19	0.355 4	0.349 10	0.468 11	0.283 18	0.514 11	0.676 21	0.268 21	0.671 7	0.510 7	0.908 6	0.329 14

OccuSeg+instance	0.486 12	0.802 10	0.536 16	0.428 16	0.369 10	0.702 9	0.205 5	0.331 37	0.301 10	0.379 8	0.474 9	0.327 11	0.437 18	0.862 1	0.485 2	0.601 15	0.394 24	0.846 28	0.273 24
Lei Han, Tian Zheng, Lan Xu, Lu Fang: OccuSeg: Occupancy-aware 3D Instance Segmentation. CVPR2020
TopoSeg	0.479 13	0.704 19	0.564 10	0.467 9	0.366 11	0.633 25	0.068 16	0.554 15	0.262 15	0.328 12	0.447 14	0.323 12	0.534 9	0.722 14	0.288 18	0.614 13	0.482 12	0.912 5	0.358 10

DualGroup	0.469 14	0.815 8	0.552 12	0.398 19	0.374 9	0.683 13	0.130 8	0.539 17	0.310 7	0.327 13	0.407 17	0.276 19	0.447 17	0.535 29	0.342 11	0.659 8	0.455 15	0.900 11	0.301 18

SSEC	0.465 15	0.667 26	0.578 7	0.502 4	0.362 14	0.641 24	0.035 27	0.605 6	0.291 14	0.323 14	0.451 13	0.296 16	0.417 24	0.677 20	0.245 25	0.501 33	0.506 9	0.900 10	0.366 5

HAIS	0.457 16	0.704 19	0.561 11	0.457 10	0.364 12	0.673 14	0.046 26	0.547 16	0.194 22	0.308 15	0.426 15	0.288 17	0.454 16	0.711 16	0.262 22	0.563 24	0.434 18	0.889 14	0.344 11
Shaoyu Chen, Jiemin Fang, Qian Zhang, Wenyu Liu, Xinggang Wang: Hierarchical Aggregation for 3D Instance Segmentation. ICCV 2021
DD-UNet+Group	0.436 17	0.630 33	0.508 25	0.480 7	0.310 19	0.624 28	0.065 17	0.638 5	0.174 23	0.256 22	0.384 20	0.194 30	0.428 20	0.759 8	0.289 17	0.574 21	0.400 22	0.849 26	0.291 21
H. Liu, R. Liu, K. Yang, J. Zhang, K. Peng, R. Stiefelhagen: HIDA: Towards Holistic Indoor Understanding for the Visually Impaired via Semantic Instance Segmentation with a Wearable Solid-State LiDAR Sensor. ICCVW 2021
INS-Conv-instance	0.435 18	0.716 18	0.495 27	0.355 26	0.331 15	0.689 12	0.102 11	0.394 30	0.208 20	0.280 16	0.395 19	0.250 22	0.544 7	0.741 13	0.309 15	0.536 30	0.391 25	0.842 31	0.258 28

Mask-Group	0.434 19	0.778 11	0.516 20	0.471 8	0.330 16	0.658 18	0.029 29	0.526 18	0.249 17	0.256 21	0.400 18	0.309 15	0.384 28	0.296 45	0.368 9	0.575 20	0.425 19	0.877 18	0.362 8
Min Zhong, Xinghao Chen, Xiaokang Chen, Gang Zeng, Yunhe Wang: MaskGroup: Hierarchical Point Grouping and Masking for 3D Instance Segmentation. ICME 2022
Box2Mask	0.433 20	0.741 14	0.463 32	0.433 15	0.283 21	0.625 27	0.103 10	0.298 41	0.125 31	0.260 20	0.424 16	0.322 13	0.472 14	0.701 18	0.363 10	0.711 5	0.309 39	0.882 15	0.272 26
Julian Chibane, Francis Engelmann, Tuan Anh Tran, Gerard Pons-Moll: Box2Mask: Weakly Supervised 3D Semantic Instance Segmentation Using Bounding Boxes. ECCV 2022
RPGN	0.428 21	0.630 33	0.508 24	0.367 25	0.249 28	0.658 19	0.016 36	0.673 3	0.131 29	0.234 25	0.383 21	0.270 20	0.434 19	0.748 11	0.274 20	0.609 14	0.406 21	0.842 30	0.267 27
Shichao Dong, Guosheng Lin, Tzu-Yi Hung: Learning Regional Purity for Instance Segmentation on 3D Point Clouds. ECCV 2022
DENet	0.413 22	0.741 14	0.520 18	0.237 37	0.284 20	0.523 35	0.097 13	0.691 1	0.138 26	0.209 35	0.229 37	0.238 24	0.390 26	0.707 17	0.310 14	0.448 40	0.470 13	0.892 13	0.310 16

PointGroup	0.407 23	0.639 32	0.496 26	0.415 17	0.243 30	0.645 23	0.021 34	0.570 12	0.114 32	0.211 33	0.359 23	0.217 28	0.428 21	0.660 22	0.256 23	0.562 25	0.341 31	0.860 22	0.291 20
Li Jiang, Hengshuang Zhao, Shaoshuai Shi, Shu Liu, Chi-Wing Fu, Jiaya Jia: PointGroup: Dual-Set Point Grouping for 3D Instance Segmentation. CVPR 2020 [oral]
CSC-Pretrained	0.405 24	0.738 16	0.465 31	0.331 30	0.205 34	0.655 20	0.051 23	0.601 7	0.092 35	0.211 34	0.329 26	0.198 29	0.459 15	0.775 5	0.195 32	0.524 32	0.400 23	0.878 16	0.184 36

PE	0.396 25	0.667 26	0.467 30	0.446 12	0.243 29	0.624 29	0.022 33	0.577 11	0.106 33	0.219 28	0.340 24	0.239 23	0.487 12	0.475 36	0.225 27	0.541 29	0.350 29	0.818 32	0.273 25
Biao Zhang, Peter Wonka: Point Cloud Instance Segmentation using Probabilistic Embeddings. CVPR 2021
Dyco3D	0.395 26	0.642 31	0.518 19	0.447 11	0.259 27	0.666 16	0.050 24	0.251 45	0.166 24	0.231 26	0.362 22	0.232 25	0.331 31	0.535 28	0.229 26	0.587 18	0.438 17	0.850 24	0.317 15
Tong He; Chunhua Shen; Anton van den Hengel: DyCo3D: Robust Instance Segmentation of 3D Point Clouds through Dynamic Convolution. CVPR2021
OSIS	0.392 27	0.778 11	0.530 17	0.220 39	0.278 22	0.567 32	0.083 14	0.330 38	0.299 11	0.270 19	0.310 29	0.143 35	0.260 35	0.624 24	0.277 19	0.568 23	0.361 27	0.865 21	0.301 17

AOIA	0.387 28	0.704 19	0.515 21	0.385 22	0.225 33	0.669 15	0.005 42	0.482 24	0.126 30	0.181 38	0.269 34	0.221 27	0.426 23	0.478 35	0.218 28	0.592 16	0.371 26	0.851 23	0.242 30

SSEN	0.384 29	0.852 6	0.494 28	0.192 40	0.226 32	0.648 22	0.022 32	0.398 29	0.299 12	0.277 17	0.317 28	0.231 26	0.194 42	0.514 32	0.196 30	0.586 19	0.444 16	0.843 29	0.184 35
Dongsu Zhang, Junha Chun, Sang Kyun Cha, Young Min Kim: Spatial Semantic Embedding Network: Fast 3D Instance Segmentation with Deep Metric Learning. Arxiv
PCJC	0.375 30	0.704 19	0.542 15	0.284 34	0.197 36	0.649 21	0.006 40	0.426 25	0.138 27	0.242 23	0.304 30	0.183 33	0.388 27	0.629 23	0.141 42	0.546 28	0.344 30	0.738 38	0.283 23

SphereSeg	0.357 31	0.651 30	0.411 34	0.345 27	0.264 26	0.630 26	0.059 20	0.289 43	0.212 18	0.240 24	0.336 25	0.158 34	0.305 32	0.557 26	0.159 38	0.455 39	0.341 32	0.726 40	0.294 19

3D-MPA	0.355 32	0.457 44	0.484 29	0.299 32	0.277 23	0.591 31	0.047 25	0.332 35	0.212 19	0.217 29	0.278 31	0.193 31	0.413 25	0.410 39	0.195 31	0.574 22	0.352 28	0.849 25	0.213 33
Francis Engelmann, Martin Bokeloh, Alireza Fathi, Bastian Leibe, Matthias Nießner: 3D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentation. CVPR 2020
NeuralBF	0.353 33	0.593 35	0.511 23	0.375 23	0.264 25	0.597 30	0.008 38	0.332 36	0.160 25	0.229 27	0.274 33	0.000 55	0.206 39	0.678 19	0.155 39	0.485 35	0.422 20	0.816 33	0.254 29
Weiwei Sun, Daniel Rebain, Renjie Liao, Vladimir Tankovich, Soroosh Yazdani, Kwang Moo Yi, Andrea Tagliasacchi: NeuralBF: Neural Bilateral Filtering for Top-down Instance Segmentation on Point Clouds. WACV 2023
RWSeg	0.348 34	0.475 41	0.456 33	0.320 31	0.275 24	0.476 37	0.020 35	0.491 22	0.056 42	0.212 32	0.320 27	0.261 21	0.302 33	0.520 30	0.182 34	0.557 26	0.285 41	0.867 20	0.197 34

GICN	0.341 35	0.580 36	0.371 36	0.344 28	0.198 35	0.469 38	0.052 22	0.564 14	0.093 34	0.212 31	0.212 39	0.127 37	0.347 30	0.537 27	0.206 29	0.525 31	0.329 34	0.729 39	0.241 31

One_Thing_One_Click	0.326 36	0.472 42	0.361 37	0.232 38	0.183 37	0.555 33	0.000 48	0.498 21	0.038 44	0.195 36	0.226 38	0.362 9	0.168 43	0.469 37	0.251 24	0.553 27	0.335 33	0.846 27	0.117 44
Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu: One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation. CVPR 2021
Occipital-SCS	0.320 37	0.679 25	0.352 38	0.334 29	0.229 31	0.436 39	0.025 30	0.412 28	0.058 40	0.161 43	0.240 36	0.085 39	0.262 34	0.496 34	0.187 33	0.467 37	0.328 35	0.775 34	0.231 32

Sparse R-CNN	0.292 38	0.704 19	0.213 48	0.153 42	0.154 39	0.551 34	0.053 21	0.212 46	0.132 28	0.174 40	0.274 32	0.070 41	0.363 29	0.441 38	0.176 35	0.424 42	0.234 43	0.758 36	0.161 40

MTML	0.282 39	0.577 37	0.380 35	0.182 41	0.107 45	0.430 40	0.001 45	0.422 26	0.057 41	0.179 39	0.162 42	0.070 42	0.229 37	0.511 33	0.161 36	0.491 34	0.313 36	0.650 45	0.162 38
Jean Lahoud, Bernard Ghanem, Marc Pollefeys, Martin R. Oswald: 3D Instance Segmentation via Multi-task Metric Learning. ICCV 2019 [oral]
SALoss-ResNet	0.262 40	0.667 26	0.335 39	0.067 49	0.123 43	0.427 41	0.022 31	0.280 44	0.058 39	0.216 30	0.211 40	0.039 45	0.142 45	0.519 31	0.106 46	0.338 46	0.310 38	0.721 41	0.138 41
Zhidong Liang, Ming Yang, Hao Li, Chunxiang Wang: 3D Instance Embedding Learning With a Structure-Aware Loss Function for Point Cloud Segmentation. IEEE Robotics and Automation Letters (IROS2020)
MASC	0.254 41	0.463 43	0.249 47	0.113 43	0.167 38	0.412 43	0.000 47	0.374 33	0.073 36	0.173 41	0.243 35	0.130 36	0.228 38	0.368 41	0.160 37	0.356 44	0.208 44	0.711 42	0.136 42
Chen Liu, Yasutaka Furukawa: MASC: Multi-scale Affinity with Sparse Convolution for 3D Instance Segmentation.
3D-BoNet	0.253 42	0.519 39	0.324 42	0.251 36	0.137 42	0.345 48	0.031 28	0.419 27	0.069 37	0.162 42	0.131 44	0.052 43	0.202 41	0.338 43	0.147 41	0.301 49	0.303 40	0.651 44	0.178 37
Bo Yang, Jianan Wang, Ronald Clark, Qingyong Hu, Sen Wang, Andrew Markham, Niki Trigoni: Learning Object Bounding Boxes for 3D Instance Segmentation on Point Clouds. NeurIPS 2019 Spotlight
SPG_WSIS	0.251 43	0.380 46	0.274 45	0.289 33	0.144 40	0.413 42	0.000 48	0.311 39	0.065 38	0.113 45	0.130 45	0.029 47	0.204 40	0.388 40	0.108 45	0.459 38	0.311 37	0.769 35	0.127 43

SegGroup_ins	0.246 44	0.556 38	0.335 40	0.062 51	0.115 44	0.490 36	0.000 48	0.297 42	0.018 48	0.186 37	0.142 43	0.083 40	0.233 36	0.216 47	0.153 40	0.469 36	0.251 42	0.744 37	0.083 47
An Tao, Yueqi Duan, Yi Wei, Jiwen Lu, Jie Zhou: SegGroup: Seg-Level Supervision for 3D Instance and Semantic Segmentation. TIP 2022
PanopticFusion-inst	0.214 45	0.250 50	0.330 41	0.275 35	0.103 46	0.228 54	0.000 48	0.345 34	0.024 46	0.088 47	0.203 41	0.186 32	0.167 44	0.367 42	0.125 43	0.221 52	0.112 54	0.666 43	0.162 39
Gaku Narita, Takashi Seno, Tomoya Ishikawa, Yohsuke Kaji: PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Things. IROS 2019 (to appear)
UNet-backbone	0.161 46	0.519 39	0.259 46	0.084 45	0.059 48	0.325 50	0.002 43	0.093 51	0.009 50	0.077 49	0.064 48	0.045 44	0.044 52	0.161 49	0.045 48	0.331 47	0.180 46	0.566 46	0.033 55

3D-SIS	0.161 46	0.407 45	0.155 52	0.068 48	0.043 52	0.346 47	0.001 44	0.134 48	0.005 51	0.088 46	0.106 47	0.037 46	0.135 47	0.321 44	0.028 51	0.339 45	0.116 53	0.466 49	0.093 46
Ji Hou, Angela Dai, Matthias Niessner: 3D-SIS: 3D Semantic Instance Segmentation of RGB-D Scans. CVPR 2019
R-PointNet	0.158 48	0.356 47	0.173 50	0.113 44	0.140 41	0.359 44	0.012 37	0.023 53	0.039 43	0.134 44	0.123 46	0.008 51	0.089 48	0.149 50	0.117 44	0.221 51	0.128 51	0.563 47	0.094 45

Region-18class	0.146 49	0.175 54	0.321 43	0.080 46	0.062 47	0.357 45	0.000 48	0.307 40	0.002 52	0.066 50	0.044 50	0.000 55	0.018 54	0.036 54	0.054 47	0.447 41	0.133 49	0.472 48	0.060 50

SemRegionNet-20cls	0.121 50	0.296 49	0.203 49	0.071 47	0.058 49	0.349 46	0.000 48	0.150 47	0.019 47	0.054 51	0.034 52	0.017 50	0.052 50	0.042 53	0.013 54	0.209 53	0.183 45	0.371 50	0.057 51

Hier3D	0.117 51	0.222 52	0.161 51	0.054 53	0.027 53	0.289 51	0.000 48	0.124 49	0.001 54	0.079 48	0.061 49	0.027 48	0.141 46	0.240 46	0.005 55	0.310 48	0.129 50	0.153 55	0.081 48
Tan: HCFS3D: Hierarchical Coupled Feature Selection Network for 3D Semantic and Instance Segmentation.
3D-BEVIS	0.117 51	0.250 50	0.308 44	0.020 55	0.009 56	0.269 53	0.006 41	0.008 54	0.029 45	0.037 54	0.014 55	0.003 53	0.036 53	0.147 51	0.042 49	0.381 43	0.118 52	0.362 51	0.069 49
Cathrin Elich, Francis Engelmann, Jonas Schult, Theodora Kontogianni, Bastian Leibe: 3D-BEVIS: Birds-Eye-View Instance Segmentation.
tmp	0.113 53	0.333 48	0.151 53	0.056 52	0.053 50	0.344 49	0.000 48	0.105 50	0.016 49	0.049 52	0.035 51	0.020 49	0.053 49	0.048 52	0.013 53	0.183 54	0.173 47	0.344 52	0.054 52

ASIS	0.085 54	0.037 55	0.080 55	0.066 50	0.047 51	0.282 52	0.000 48	0.052 52	0.002 53	0.047 53	0.026 53	0.001 54	0.046 51	0.194 48	0.031 50	0.264 50	0.140 48	0.167 54	0.047 54

Sgpn_scannet	0.049 55	0.023 56	0.134 54	0.031 54	0.013 55	0.144 55	0.006 39	0.008 55	0.000 55	0.028 55	0.017 54	0.003 52	0.009 56	0.000 55	0.021 52	0.122 55	0.095 55	0.175 53	0.054 53

MaskRCNN 2d->3d Proj	0.022 56	0.185 53	0.000 56	0.000 56	0.015 54	0.000 56	0.000 46	0.006 56	0.000 55	0.010 56	0.006 56	0.107 38	0.012 55	0.000 55	0.002 56	0.027 56	0.004 56	0.022 56	0.001 56

Method	avg iou	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	floor	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	wall	window

Virtual MVFusion (R)	0.745 1	0.861 1	0.839 1	0.881 1	0.672 1	0.512 1	0.422 15	0.898 1	0.723 1	0.714 1	0.954 2	0.454 1	0.509 1	0.773 1	0.895 1	0.756 1	0.820 1	0.653 1	0.935 1	0.891 1	0.728 1
Abhijit Kundu, Xiaoqi Yin, Alireza Fathi, David Ross, Brian Brewington, Thomas Funkhouser, Caroline Pantofaru: Virtual Multi-view Fusion for 3D Semantic Segmentation. ECCV 2020
BPNet_2D	0.670 2	0.822 3	0.795 3	0.836 2	0.659 2	0.481 2	0.451 11	0.769 3	0.656 3	0.567 3	0.931 3	0.395 4	0.390 4	0.700 3	0.534 3	0.689 9	0.770 2	0.574 3	0.865 6	0.831 3	0.675 4
Wenbo Hu, Hengshuang Zhao, Li Jiang, Jiaya Jia and Tien-Tsin Wong: Bidirectional Projection Network for Cross Dimension Scene Understanding. CVPR 2021 (Oral)
CU-Hybrid-2D Net	0.636 3	0.825 2	0.820 2	0.179 20	0.648 3	0.463 3	0.549 2	0.742 6	0.676 2	0.628 2	0.961 1	0.420 2	0.379 5	0.684 6	0.381 15	0.732 2	0.723 3	0.599 2	0.827 13	0.851 2	0.634 6

CMX	0.613 4	0.681 7	0.725 9	0.502 12	0.634 5	0.297 15	0.478 9	0.830 2	0.651 4	0.537 6	0.924 4	0.375 5	0.315 12	0.686 5	0.451 12	0.714 4	0.543 18	0.504 5	0.894 4	0.823 4	0.688 3

DMMF_3d	0.605 5	0.651 8	0.744 7	0.782 3	0.637 4	0.387 4	0.536 3	0.732 7	0.590 6	0.540 5	0.856 18	0.359 9	0.306 13	0.596 11	0.539 2	0.627 18	0.706 4	0.497 7	0.785 18	0.757 16	0.476 19

MCA-Net	0.595 6	0.533 17	0.756 6	0.746 4	0.590 8	0.334 7	0.506 6	0.670 12	0.587 7	0.500 10	0.905 8	0.366 8	0.352 8	0.601 10	0.506 6	0.669 15	0.648 7	0.501 6	0.839 12	0.769 12	0.516 18

RFBNet	0.592 7	0.616 9	0.758 5	0.659 5	0.581 9	0.330 8	0.469 10	0.655 15	0.543 12	0.524 7	0.924 4	0.355 10	0.336 10	0.572 14	0.479 8	0.671 13	0.648 7	0.480 9	0.814 16	0.814 5	0.614 9

FAN_NV_RVC	0.586 8	0.510 18	0.764 4	0.079 23	0.620 7	0.330 8	0.494 7	0.753 4	0.573 8	0.556 4	0.884 13	0.405 3	0.303 14	0.718 2	0.452 11	0.672 12	0.658 5	0.509 4	0.898 3	0.813 6	0.727 2

DCRedNet	0.583 9	0.682 6	0.723 10	0.542 11	0.510 17	0.310 12	0.451 11	0.668 13	0.549 11	0.520 8	0.920 6	0.375 5	0.446 2	0.528 17	0.417 13	0.670 14	0.577 15	0.478 10	0.862 7	0.806 7	0.628 8

MIX6D_RVC	0.582 10	0.695 4	0.687 14	0.225 18	0.632 6	0.328 10	0.550 1	0.748 5	0.623 5	0.494 13	0.890 11	0.350 12	0.254 20	0.688 4	0.454 10	0.716 3	0.597 14	0.489 8	0.881 5	0.768 13	0.575 12

SSMA	0.577 11	0.695 4	0.716 12	0.439 14	0.563 11	0.314 11	0.444 13	0.719 8	0.551 10	0.503 9	0.887 12	0.346 13	0.348 9	0.603 9	0.353 17	0.709 5	0.600 12	0.457 12	0.901 2	0.786 8	0.599 11
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. International Journal of Computer Vision, 2019
UNIV_CNP_RVC_UE	0.566 12	0.569 16	0.686 16	0.435 15	0.524 14	0.294 16	0.421 16	0.712 9	0.543 12	0.463 15	0.872 14	0.320 14	0.363 7	0.611 8	0.477 9	0.686 10	0.627 9	0.443 15	0.862 7	0.775 11	0.639 5

EMSAFormer	0.564 13	0.581 13	0.736 8	0.564 10	0.546 13	0.219 20	0.517 4	0.675 11	0.486 17	0.427 19	0.904 9	0.352 11	0.320 11	0.589 12	0.528 4	0.708 6	0.464 21	0.413 19	0.847 11	0.786 8	0.611 10

SN_RN152pyrx8_RVC	0.546 14	0.572 14	0.663 18	0.638 7	0.518 15	0.298 14	0.366 21	0.633 18	0.510 15	0.446 17	0.864 16	0.296 17	0.267 17	0.542 16	0.346 18	0.704 7	0.575 16	0.431 16	0.853 10	0.766 14	0.630 7

UDSSEG_RVC	0.545 15	0.610 11	0.661 19	0.588 8	0.556 12	0.268 18	0.482 8	0.642 17	0.572 9	0.475 14	0.836 20	0.312 15	0.367 6	0.630 7	0.189 20	0.639 17	0.495 20	0.452 13	0.826 14	0.756 17	0.541 14

segfomer with 6d	0.542 16	0.594 12	0.687 14	0.146 21	0.579 10	0.308 13	0.515 5	0.703 10	0.472 18	0.498 11	0.868 15	0.369 7	0.282 15	0.589 12	0.390 14	0.701 8	0.556 17	0.416 18	0.860 9	0.759 15	0.539 16

FuseNet	0.535 17	0.570 15	0.681 17	0.182 19	0.512 16	0.290 17	0.431 14	0.659 14	0.504 16	0.495 12	0.903 10	0.308 16	0.428 3	0.523 18	0.365 16	0.676 11	0.621 11	0.470 11	0.762 19	0.779 10	0.541 14
Caner Hazirbas, Lingni Ma, Csaba Domokos, Daniel Cremers: FuseNet: Incorporating Depth into Semantic Segmentation via Fusion-based CNN Architecture. ACCV 2016
AdapNet++	0.503 18	0.613 10	0.722 11	0.418 16	0.358 23	0.337 6	0.370 20	0.479 21	0.443 19	0.368 21	0.907 7	0.207 20	0.213 22	0.464 21	0.525 5	0.618 19	0.657 6	0.450 14	0.788 17	0.721 20	0.408 22
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. International Journal of Computer Vision, 2019
3DMV (2d proj)	0.498 19	0.481 21	0.612 20	0.579 9	0.456 19	0.343 5	0.384 18	0.623 19	0.525 14	0.381 20	0.845 19	0.254 19	0.264 19	0.557 15	0.182 21	0.581 21	0.598 13	0.429 17	0.760 20	0.661 22	0.446 21
Angela Dai, Matthias Niessner: 3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation. ECCV'18
MSeg1080_RVC	0.485 20	0.505 19	0.709 13	0.092 22	0.427 20	0.241 19	0.411 17	0.654 16	0.385 23	0.457 16	0.861 17	0.053 23	0.279 16	0.503 19	0.481 7	0.645 16	0.626 10	0.365 21	0.748 21	0.725 19	0.529 17
John Lambert, Zhuang Liu, Ozan Sener, James Hays, Vladlen Koltun: MSeg: A Composite Dataset for Multi-domain Semantic Segmentation. CVPR 2020
ILC-PSPNet	0.475 21	0.490 20	0.581 21	0.289 17	0.507 18	0.067 23	0.379 19	0.610 20	0.417 21	0.435 18	0.822 22	0.278 18	0.267 17	0.503 19	0.228 19	0.616 20	0.533 19	0.375 20	0.820 15	0.729 18	0.560 13

Enet (reimpl)	0.376 22	0.264 23	0.452 23	0.452 13	0.365 21	0.181 21	0.143 23	0.456 22	0.409 22	0.346 22	0.769 23	0.164 21	0.218 21	0.359 22	0.123 23	0.403 23	0.381 23	0.313 23	0.571 22	0.685 21	0.472 20
Re-implementation of Adam Paszke, Abhishek Chaurasia, Sangpil Kim, Eugenio Culurciello: ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation.
ScanNet (2d proj)	0.330 23	0.293 22	0.521 22	0.657 6	0.361 22	0.161 22	0.250 22	0.004 23	0.440 20	0.183 23	0.836 20	0.125 22	0.060 23	0.319 23	0.132 22	0.417 22	0.412 22	0.344 22	0.541 23	0.427 23	0.109 23
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner: ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes. CVPR'17
DMMF	0.003 24	0.000 24	0.005 24	0.000 24	0.000 24	0.037 24	0.001 24	0.000 24	0.001 24	0.005 24	0.003 24	0.000 24	0.000 24	0.000 24	0.000 24	0.000 24	0.002 24	0.001 24	0.000 24	0.006 24	0.000 24

Presenting the ScanNet200 Benchmark

ScanNet200 Benchmark

ScanNet200 3D Semantic Label Benchmark

ScanNet200 3D Semantic Instance Benchmark

ScanNet Benchmark

3D Semantic Label Benchmark

3D Semantic Instance Benchmark

2D Semantic Label Benchmark

2D Semantic Instance Benchmark

Scene Type Classification Benchmark

Method	avg ap	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	window

UniDet_RVC	0.205 1	0.381 1	0.323 1	0.037 1	0.226 1	0.177 1	0.063 1	0.277 1	0.120 1	0.067 1	0.131 1	0.074 2	0.317 1	0.080 1	0.235 1	0.289 1	0.141 1	0.678 1	0.080 1

MaskRCNN_ScanNet	0.119 2	0.129 2	0.212 2	0.002 2	0.112 2	0.148 2	0.014 2	0.205 2	0.044 2	0.066 2	0.078 2	0.095 1	0.142 2	0.030 2	0.128 2	0.139 2	0.080 2	0.459 2	0.057 2
Re-implementation of Kaiming He, Georgia Gkioxari, Piotr Dollár, Ross Girshick: Mask R-CNN. ICCV'17

Method	avg recall	apartment	bathroom	bedroom / hotel	bookstore / library	conference room	copy/mail room	hallway	kitchen	laundry room	living room / lounge	misc	office	storage / basement / garage

multi-task	0.700 1	0.500 1	1.000 1	0.882 2	0.500 2	1.000 1	1.000 1	0.500 2	1.000 1	1.000 1	0.778 1	0.000 2	0.938 1	0.000 2
Shengyu Huang, Mikhail Usvyatsov, Konrad Schindler: Indoor Scene Recognition in 3D. IROS 2020
3DASPP-SCE	0.691 2	0.500 1	0.938 2	0.824 3	1.000 1	1.000 1	0.500 2	1.000 1	0.857 2	0.500 2	0.556 3	0.000 2	0.812 2	0.500 1

SE-ResNeXt-SSMA	0.498 3	0.000 4	0.812 3	0.941 1	0.500 2	0.500 3	0.500 2	0.500 2	0.429 4	0.500 2	0.667 2	0.500 1	0.625 3	0.000 2
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. arXiv
resnet50_scannet	0.353 4	0.250 3	0.812 3	0.529 4	0.500 2	0.500 3	0.000 4	0.500 2	0.571 3	0.000 4	0.556 3	0.000 2	0.375 4	0.000 2