Benchmark Results - ScanNet Benchmark

This table lists the benchmark results for the ScanNet200 3D semantic label scenario.

Method	avg iou	head iou	common iou	tail iou	wall	chair	floor	table	door	couch	cabinet	shelf	desk	office chair	bed	pillow	sink	picture	window	toilet	bookshelf	monitor	curtain	book	coffee table	box	refrigerator	lamp	kitchen cabinet	towel	clothes	tv	nightstand	counter	dresser	stool	cushion	plant	ceiling	bathtub	end table	dining table	keyboard	bag	backpack	toilet paper	printer	tv stand	whiteboard	blanket	shower curtain	trash can	closet	stairs	microwave	stove	shoe	computer tower	bottle	bin	bench	board	washing machine	mirror	copier	basket	sofa chair	file cabinet	fan	laptop	shower	paper	person	paper towel dispenser	oven	blinds	rack	plate	blackboard	piano	suitcase	radiator	recycling bin	wardrobe	soap dispenser	telephone	bucket	clock	stand	light	laundry basket	pipe	clothes dryer	seat	speaker	column	bicycle	ladder	bathroom stall	shower wall	cup	jacket	storage bin	coffee maker	dishwasher	paper towel roll	machine	mat	windowsill	bar	toaster	bulletin board	ironing board	kitchen counter	doorframe	toilet paper dispenser	mini fridge	fire extinguisher	ball	hat	shower curtain rod	water cooler	paper cutter	tray	ledge	mouse	cart	storage container	scale	tissue box	light switch	power outlet	decoration	sign	projector	vacuum cleaner	candle	plunger	stuffed animal	headphones	dish rack	broom	range hood	water bottle	vent	shower floor	water pitcher	mailbox	bowl	paper bag	music stand	projector screen	laundry detergent	object	bathroom vanity	laundry hamper	bathroom stall door	ceiling light	trash bin	dumbbell	stair rail	tube	bathroom cabinet	closet rod	coffee kettle	structure	shower head	keyboard piano	case of water bottles	coat rack	storage organizer	folded chair	fire alarm	power strip	calendar	poster

OA-CNN-L_ScanNet200	0.333 2	0.558 1	0.269 1	0.124 3	0.821 1	0.703 1	0.946 1	0.569 1	0.662 1	0.748 1	0.487 1	0.455 1	0.572 2	0.000 6	0.789 1	0.534 1	0.736 2	0.271 1	0.713 1	0.949 1	0.498 5	0.877 2	0.860 1	0.332 1	0.706 1	0.474 1	0.788 2	0.406 3	0.637 1	0.495 1	0.355 2	0.805 2	0.592 5	0.015 6	0.396 1	0.602 3	0.000 1	0.799 2	0.876 1	0.713 6	0.276 1	0.000 5	0.493 2	0.080 2	0.448 4	0.363 1	0.661 2	0.833 1	0.262 1	0.125 1	0.823 2	0.665 1	0.076 2	0.720 1	0.557 2	0.637 2	0.517 2	0.672 4	0.227 2	0.000 3	0.158 2	0.496 2	0.843 3	0.352 2	0.835 3	0.000 1	0.103 5	0.711 1	0.527 1	0.526 2	0.320 1	0.000 1	0.568 1	0.625 3	0.067 1	0.000 3	0.000 1	0.001 2	0.806 1	0.836 1	0.621 1	0.591 3	0.373 2	0.314 2	0.668 2	0.398 2	0.003 2	0.000 3	0.000 1	0.016 6	0.024 1	0.043 6	0.906 1	0.000 1	0.052 3	0.000 5	0.384 1	0.330 4	0.342 5	0.100 2	0.223 2	0.183 2	0.112 2	0.476 2	0.313 2	0.130 3	0.196 2	0.112 2	0.370 5	0.000 1	0.234 3	0.071 3	0.160 1	0.403 2	0.398 3	0.492 5	0.197 1	0.076 4	0.272 1	0.000 1	0.200 6	0.560 1	0.735 2	0.000 1	0.000 5	0.000 3	0.110 1	0.002 3	0.021 2	0.412 2	0.000 3	0.000 2	0.000 2	0.000 1	0.000 1	0.794 2	0.000 1	0.445 1	0.000 1	0.022 2	0.509 2	0.000 1	0.517 5	0.000 1	0.000 1	0.001 6	0.245 2	0.915 2	0.024 2	0.089 1	0.000 1	0.262 1	0.000 1	0.103 5	0.524 2	0.392 2	0.515 2	0.013 6	0.251 3	0.411 4	0.662 1	0.001 3	0.000 1	0.473 3	0.000 1	0.000 2	0.150 3	0.699 1	0.000 2	0.000 1	0.000 1	0.166 2	0.000 2	0.024 1	0.000 3	0.000 1

CeCo	0.340 1	0.551 2	0.247 2	0.181 1	0.784 2	0.661 3	0.939 2	0.564 2	0.624 2	0.721 2	0.484 2	0.429 2	0.575 1	0.027 4	0.774 2	0.503 3	0.753 1	0.242 3	0.656 2	0.945 2	0.534 1	0.865 3	0.860 1	0.177 6	0.616 3	0.400 2	0.818 1	0.579 1	0.615 2	0.367 3	0.408 1	0.726 4	0.633 1	0.162 1	0.360 2	0.619 1	0.000 1	0.828 1	0.873 2	0.924 1	0.109 4	0.083 2	0.564 1	0.057 6	0.475 2	0.266 2	0.781 1	0.767 2	0.257 2	0.100 3	0.825 1	0.663 2	0.048 6	0.620 4	0.551 3	0.595 4	0.532 1	0.692 3	0.246 1	0.000 3	0.213 1	0.615 1	0.861 2	0.376 1	0.900 1	0.000 1	0.102 6	0.660 2	0.321 4	0.547 1	0.226 2	0.000 1	0.311 2	0.742 1	0.011 3	0.006 2	0.000 1	0.000 3	0.546 6	0.824 2	0.345 3	0.665 1	0.450 1	0.435 1	0.683 1	0.411 1	0.338 1	0.000 3	0.000 1	0.030 4	0.000 2	0.068 4	0.892 2	0.000 1	0.063 2	0.000 5	0.257 2	0.304 5	0.387 3	0.079 4	0.228 1	0.190 1	0.000 6	0.586 1	0.347 1	0.133 2	0.000 3	0.037 3	0.377 4	0.000 1	0.384 2	0.006 5	0.003 3	0.421 1	0.410 2	0.643 1	0.171 3	0.121 2	0.142 5	0.000 1	0.510 4	0.447 2	0.474 4	0.000 1	0.000 5	0.286 1	0.083 2	0.000 4	0.000 3	0.603 1	0.096 1	0.063 1	0.000 2	0.000 1	0.000 1	0.898 1	0.000 1	0.429 2	0.000 1	0.400 1	0.550 1	0.000 1	0.633 1	0.000 1	0.000 1	0.377 1	0.000 6	0.916 1	0.000 4	0.000 2	0.000 1	0.000 3	0.000 1	0.102 6	0.499 4	0.296 3	0.463 3	0.089 3	0.304 1	0.740 1	0.401 5	0.010 1	0.000 1	0.560 1	0.000 1	0.000 2	0.709 1	0.652 2	0.000 2	0.000 1	0.000 1	0.143 3	0.000 2	0.000 2	0.609 1	0.000 1
: Understanding Imbalanced Semantic Segmentation Through Neural Collapse.
AWCS	0.305 3	0.508 3	0.225 3	0.142 2	0.782 3	0.634 6	0.937 3	0.489 4	0.578 3	0.721 2	0.364 4	0.355 3	0.515 3	0.023 5	0.764 3	0.523 2	0.707 4	0.264 2	0.633 3	0.922 3	0.507 4	0.886 1	0.804 4	0.179 4	0.436 6	0.300 3	0.656 5	0.529 2	0.501 4	0.394 2	0.296 5	0.820 1	0.603 2	0.131 2	0.179 6	0.619 1	0.000 1	0.707 5	0.865 3	0.773 2	0.171 2	0.010 4	0.484 3	0.063 4	0.463 3	0.254 3	0.332 5	0.649 4	0.220 4	0.100 3	0.729 4	0.613 4	0.071 4	0.582 5	0.628 1	0.702 1	0.424 4	0.749 1	0.137 4	0.000 3	0.142 3	0.360 3	0.863 1	0.305 3	0.877 2	0.000 1	0.173 1	0.606 3	0.337 3	0.478 3	0.154 4	0.000 1	0.253 3	0.664 2	0.000 4	0.000 3	0.000 1	0.000 3	0.626 4	0.782 3	0.302 5	0.602 2	0.185 5	0.282 3	0.651 3	0.317 3	0.000 3	0.000 3	0.000 1	0.022 5	0.000 2	0.154 1	0.876 3	0.000 1	0.014 4	0.063 4	0.029 6	0.553 1	0.467 2	0.084 3	0.124 3	0.157 5	0.049 5	0.373 3	0.252 3	0.097 4	0.000 3	0.219 1	0.542 1	0.000 1	0.392 1	0.172 2	0.000 5	0.339 3	0.417 1	0.533 4	0.093 4	0.115 3	0.195 3	0.000 1	0.516 3	0.288 5	0.741 1	0.000 1	0.001 4	0.233 2	0.056 3	0.000 4	0.159 1	0.334 3	0.077 2	0.000 2	0.000 2	0.000 1	0.000 1	0.749 3	0.000 1	0.411 3	0.000 1	0.008 3	0.452 3	0.000 1	0.595 2	0.000 1	0.000 1	0.220 3	0.006 4	0.894 4	0.006 3	0.000 2	0.000 1	0.000 3	0.000 1	0.112 3	0.504 3	0.404 1	0.551 1	0.093 2	0.129 6	0.484 3	0.381 6	0.000 4	0.000 1	0.396 4	0.000 1	0.000 2	0.620 2	0.402 6	0.000 2	0.000 1	0.000 1	0.142 4	0.000 2	0.000 2	0.512 2	0.000 1

LGround	0.272 4	0.485 4	0.184 4	0.106 4	0.778 4	0.676 2	0.932 4	0.479 6	0.572 4	0.718 4	0.399 3	0.265 4	0.453 5	0.085 2	0.745 4	0.446 4	0.726 3	0.232 5	0.622 4	0.901 4	0.512 3	0.826 4	0.786 5	0.178 5	0.549 4	0.277 4	0.659 4	0.381 4	0.518 3	0.295 6	0.323 3	0.777 3	0.599 3	0.028 4	0.321 3	0.363 5	0.000 1	0.708 4	0.858 4	0.746 4	0.063 5	0.022 3	0.457 4	0.077 3	0.476 1	0.243 4	0.402 3	0.397 6	0.233 3	0.077 6	0.720 6	0.610 5	0.103 1	0.629 3	0.437 6	0.626 3	0.446 3	0.702 2	0.190 3	0.005 1	0.058 5	0.322 4	0.702 5	0.244 4	0.768 4	0.000 1	0.134 4	0.552 4	0.279 5	0.395 4	0.147 5	0.000 1	0.207 4	0.612 4	0.000 4	0.000 3	0.000 1	0.000 3	0.658 3	0.566 4	0.323 4	0.525 6	0.229 4	0.179 4	0.467 6	0.154 5	0.000 3	0.002 1	0.000 1	0.051 1	0.000 2	0.127 2	0.703 4	0.000 1	0.000 5	0.216 1	0.112 5	0.358 3	0.547 1	0.187 1	0.092 5	0.156 6	0.055 4	0.296 4	0.252 3	0.143 1	0.000 3	0.014 4	0.398 3	0.000 1	0.028 5	0.173 1	0.000 5	0.265 5	0.348 4	0.415 6	0.179 2	0.019 5	0.218 2	0.000 1	0.597 2	0.274 6	0.565 3	0.000 1	0.012 3	0.000 3	0.039 5	0.022 2	0.000 3	0.117 4	0.000 3	0.000 2	0.000 2	0.000 1	0.000 1	0.324 5	0.000 1	0.384 4	0.000 1	0.000 4	0.251 6	0.000 1	0.566 3	0.000 1	0.000 1	0.066 4	0.404 1	0.886 5	0.199 1	0.000 2	0.000 1	0.059 2	0.000 1	0.136 1	0.540 1	0.127 6	0.295 4	0.085 4	0.143 5	0.514 2	0.413 4	0.000 4	0.000 1	0.498 2	0.000 1	0.000 2	0.000 4	0.623 3	0.000 2	0.000 1	0.000 1	0.132 5	0.000 2	0.000 2	0.000 3	0.000 1
David Rozenberszki, Or Litany, Angela Dai: Language-Grounded Indoor 3D Semantic Segmentation in the Wild. arXiv
CSC-Pretrain	0.249 6	0.455 6	0.171 5	0.079 6	0.766 6	0.659 4	0.930 6	0.494 3	0.542 6	0.700 6	0.314 6	0.215 6	0.430 6	0.121 1	0.697 6	0.441 5	0.683 5	0.235 4	0.609 6	0.895 5	0.476 6	0.816 5	0.770 6	0.186 3	0.634 2	0.216 6	0.734 3	0.340 5	0.471 5	0.307 5	0.293 6	0.591 6	0.542 6	0.076 3	0.205 5	0.464 4	0.000 1	0.484 6	0.832 6	0.766 3	0.052 6	0.000 5	0.413 5	0.059 5	0.418 5	0.222 5	0.318 6	0.609 5	0.206 6	0.112 2	0.743 3	0.625 3	0.076 2	0.579 6	0.548 4	0.590 5	0.371 5	0.552 6	0.081 5	0.003 2	0.142 3	0.201 6	0.638 6	0.233 5	0.686 6	0.000 1	0.142 3	0.444 6	0.375 2	0.247 6	0.198 3	0.000 1	0.128 6	0.454 6	0.019 2	0.097 1	0.000 1	0.000 3	0.553 5	0.557 5	0.373 2	0.545 5	0.164 6	0.014 6	0.547 5	0.174 4	0.000 3	0.002 1	0.000 1	0.037 2	0.000 2	0.063 5	0.664 6	0.000 1	0.000 5	0.130 2	0.170 3	0.152 6	0.335 6	0.079 4	0.110 4	0.175 3	0.098 3	0.175 6	0.166 5	0.045 6	0.207 1	0.014 4	0.465 2	0.000 1	0.001 6	0.001 6	0.046 2	0.299 4	0.327 5	0.537 3	0.033 5	0.012 6	0.186 4	0.000 1	0.205 5	0.377 3	0.463 5	0.000 1	0.058 2	0.000 3	0.055 4	0.041 1	0.000 3	0.105 5	0.000 3	0.000 2	0.000 2	0.000 1	0.000 1	0.398 4	0.000 1	0.308 6	0.000 1	0.000 4	0.319 4	0.000 1	0.543 4	0.000 1	0.000 1	0.062 5	0.004 5	0.862 6	0.000 4	0.000 2	0.000 1	0.000 3	0.000 1	0.123 2	0.316 5	0.225 4	0.250 5	0.094 1	0.180 4	0.332 5	0.441 3	0.000 4	0.000 1	0.310 6	0.000 1	0.000 2	0.000 4	0.592 4	0.000 2	0.000 1	0.000 1	0.203 1	0.000 2	0.000 2	0.000 3	0.000 1
Ji Hou, Benjamin Graham, Matthias Nießner, Saining Xie: Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts. CVPR 2021
Minkowski 34D	0.253 5	0.463 5	0.154 6	0.102 5	0.771 5	0.650 5	0.932 4	0.483 5	0.571 5	0.710 5	0.331 5	0.250 5	0.492 4	0.044 3	0.703 5	0.419 6	0.606 6	0.227 6	0.621 5	0.865 6	0.531 2	0.771 6	0.813 3	0.291 2	0.484 5	0.242 5	0.612 6	0.282 6	0.440 6	0.351 4	0.299 4	0.622 5	0.593 4	0.027 5	0.293 4	0.310 6	0.000 1	0.757 3	0.858 4	0.737 5	0.150 3	0.164 1	0.368 6	0.084 1	0.381 6	0.142 6	0.357 4	0.720 3	0.214 5	0.092 5	0.724 5	0.596 6	0.056 5	0.655 2	0.525 5	0.581 6	0.352 6	0.594 5	0.056 6	0.000 3	0.014 6	0.224 5	0.772 4	0.205 6	0.720 5	0.000 1	0.159 2	0.531 5	0.163 6	0.294 5	0.136 6	0.000 1	0.169 5	0.589 5	0.000 4	0.000 3	0.000 1	0.002 1	0.663 2	0.466 6	0.265 6	0.582 4	0.337 3	0.016 5	0.559 4	0.084 6	0.000 3	0.000 3	0.000 1	0.036 3	0.000 2	0.125 3	0.670 5	0.000 1	0.102 1	0.071 3	0.164 4	0.406 2	0.386 4	0.046 6	0.068 6	0.159 4	0.117 1	0.284 5	0.111 6	0.094 5	0.000 3	0.000 6	0.197 6	0.000 1	0.044 4	0.013 4	0.002 4	0.228 6	0.307 6	0.588 2	0.025 6	0.545 1	0.134 6	0.000 1	0.655 1	0.302 4	0.282 6	0.000 1	0.060 1	0.000 3	0.035 6	0.000 4	0.000 3	0.097 6	0.000 3	0.000 2	0.005 1	0.000 1	0.000 1	0.096 6	0.000 1	0.334 5	0.000 1	0.000 4	0.274 5	0.000 1	0.513 6	0.000 1	0.000 1	0.280 2	0.194 3	0.897 3	0.000 4	0.000 2	0.000 1	0.000 3	0.000 1	0.108 4	0.279 6	0.189 5	0.141 6	0.059 5	0.272 2	0.307 6	0.445 2	0.003 2	0.000 1	0.353 5	0.000 1	0.026 1	0.000 4	0.581 5	0.001 1	0.000 1	0.000 1	0.093 6	0.002 1	0.000 2	0.000 3	0.000 1
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019

This table lists the benchmark results for the ScanNet200 3D semantic instance scenario.

Method	avg ap 25%	head ap 25%	common ap 25%	tail ap 25%	chair	table	door	couch	cabinet	shelf	desk	office chair	bed	pillow	sink	picture	window	toilet	bookshelf	monitor	curtain	book	coffee table	box	refrigerator	lamp	kitchen cabinet	towel	clothes	tv	nightstand	counter	dresser	stool	cushion	plant	ceiling	bathtub	end table	dining table	keyboard	bag	backpack	toilet paper	printer	tv stand	whiteboard	blanket	shower curtain	trash can	closet	stairs	microwave	stove	shoe	computer tower	bottle	bin	bench	board	washing machine	mirror	copier	basket	sofa chair	file cabinet	fan	laptop	shower	paper	person	paper towel dispenser	oven	blinds	rack	plate	blackboard	piano	suitcase	radiator	recycling bin	wardrobe	soap dispenser	telephone	bucket	clock	stand	light	laundry basket	pipe	clothes dryer	seat	speaker	column	bicycle	ladder	bathroom stall	shower wall	cup	jacket	storage bin	coffee maker	dishwasher	paper towel roll	machine	mat	windowsill	bar	toaster	bulletin board	ironing board	kitchen counter	doorframe	toilet paper dispenser	mini fridge	fire extinguisher	ball	hat	shower curtain rod	water cooler	paper cutter	tray	ledge	mouse	cart	storage container	scale	tissue box	light switch	power outlet	decoration	sign	projector	vacuum cleaner	candle	plunger	stuffed animal	headphones	dish rack	broom	range hood	water bottle	vent	shower floor	water pitcher	mailbox	bowl	paper bag	music stand	projector screen	laundry detergent	object	bathroom vanity	laundry hamper	bathroom stall door	ceiling light	trash bin	dumbbell	stair rail	tube	bathroom cabinet	closet rod	coffee kettle	structure	shower head	keyboard piano	case of water bottles	coat rack	storage organizer	folded chair	fire alarm	power strip	calendar	poster

TD3D Scannet200	0.379 2	0.603 2	0.306 2	0.190 2	0.885 1	0.755 1	0.800 2	0.958 1	0.390 2	0.260 2	0.866 2	0.232 1	0.979 2	0.523 3	0.869 3	0.559 5	0.689 2	1.000 1	0.795 1	0.905 2	0.748 1	0.173 5	0.825 1	0.173 2	0.970 1	0.457 1	0.615 2	0.456 2	0.200 1	0.621 4	0.906 2	0.553 1	0.517 1	0.510 1	0.220 2	0.715 1	0.706 2	1.000 1	0.113 2	0.792 1	0.717 2	0.073 2	0.635 2	0.557 1	0.638 1	1.000 1	0.205 5	0.146 3	1.000 1	0.769 5	0.186 2	1.000 1	0.710 5	0.778 1	0.415 1	0.834 4	0.226 2	0.021 2	0.590 2	0.356 2	0.817 1	0.477 5	1.000 1	0.000 1	0.635 1	0.843 2	0.427 1	0.270 4	0.125 2	0.000 2	0.102 3	1.000 1	0.125 2	0.000 2	0.000 1	0.000 2	0.000 3	0.125 4	0.370 3	0.622 5	0.221 1	0.196 2	0.836 1	0.288 2	0.000 2	0.093 2	0.020 2	0.294 2	0.000 1	0.075 2	0.667 1	0.038 1	0.111 1	0.250 4	0.000 4	0.526 2	0.495 3	0.908 1	0.111 3	0.259 1	0.003 3	0.667 2	0.045 5	0.000 2	0.000 1	0.400 1	0.274 3	0.000 1	0.274 2	0.226 2	0.000 1	0.520 2	0.302 5	0.731 2	0.103 3	0.458 1	0.500 1	0.000 1	1.000 1	0.472 1	0.792 3	0.000 1	0.088 2	0.061 2	0.250 1	0.009 2	0.250 2	0.333 3	0.181 2	0.396 2	0.051 2	0.012 1	0.000 1	0.458 4	0.000 1	0.424 5	0.000 1	0.101 2	0.390 5	0.000 1	0.833 2	0.000 1	0.000 1	0.857 2	0.222 3	1.000 1	0.000 1	0.003 2	0.000 1	0.000 2	0.000 1	0.102 2	0.275 5	0.400 2	0.735 2	0.061 3	0.433 3	0.533 3	0.625 1	0.000 2	0.000 1	0.259 4	0.000 1	0.000 1	0.000 2	0.500 2	0.000 1	0.000 2	1.000 1	0.600 1	0.000 2	0.250 1	0.000 2	0.000 1

Mask3D Scannet200	0.445 1	0.653 1	0.392 1	0.254 1	0.844 2	0.746 2	0.818 1	0.888 4	0.556 1	0.262 1	0.890 1	0.025 2	1.000 1	0.608 1	0.930 1	0.694 3	0.721 1	0.930 5	0.686 3	0.966 1	0.615 4	0.440 1	0.725 4	0.201 1	0.890 3	0.414 4	0.827 1	0.552 1	0.158 5	0.806 1	0.924 1	0.042 3	0.512 2	0.412 5	0.226 1	0.604 3	0.830 1	1.000 1	0.125 1	0.792 1	0.815 1	0.097 1	0.648 1	0.551 2	0.354 4	1.000 1	0.630 1	0.241 2	1.000 1	0.853 1	0.204 1	0.974 4	0.841 1	0.778 1	0.358 2	0.927 1	0.300 1	0.045 1	0.640 1	0.363 1	0.745 2	0.710 1	1.000 1	0.000 1	0.330 2	0.943 1	0.315 2	0.600 1	1.000 1	0.027 1	0.080 5	0.556 5	0.500 1	0.409 1	0.000 1	0.194 1	1.000 1	0.500 1	0.493 2	0.761 2	0.053 4	0.042 3	0.780 2	0.454 1	0.009 1	0.333 1	0.050 1	0.321 1	0.000 1	0.084 1	0.552 2	0.008 2	0.027 2	0.750 1	0.500 1	0.442 3	0.657 1	0.765 2	0.120 2	0.183 3	0.021 2	1.000 1	0.510 2	0.016 1	0.000 1	0.400 1	0.619 1	0.000 1	0.396 1	0.290 1	0.000 1	0.741 1	0.699 1	1.000 1	0.260 1	0.017 3	0.125 5	0.000 1	0.792 4	0.399 4	1.000 1	0.000 1	0.049 3	0.265 1	0.063 3	0.000 3	1.000 1	0.335 2	0.381 1	0.500 1	0.250 1	0.004 2	0.000 1	0.727 2	0.000 1	0.538 3	0.000 1	0.188 1	0.677 2	0.000 1	0.930 1	0.000 1	0.000 1	0.966 1	0.391 1	0.908 2	0.000 1	0.028 1	0.000 1	1.000 1	0.000 1	0.152 1	0.451 2	0.458 1	0.971 1	0.573 1	0.606 1	0.167 5	0.625 1	0.004 1	0.000 1	0.058 5	0.000 1	0.000 1	1.000 1	1.000 1	0.000 1	0.056 1	0.000 2	0.200 3	0.309 1	0.000 2	1.000 1	0.000 1
Jonas Schult, Francis Engelmann, Alexander Hermans, Or Litany, Siyu Tang, Bastian Leibe: Mask3D for 3D Semantic Instance Segmentation. ICRA 2023
Minkowski 34D Inst.	0.280 4	0.488 4	0.192 5	0.124 4	0.804 4	0.518 4	0.772 5	0.904 3	0.337 5	0.191 4	0.443 4	0.000 3	0.861 4	0.502 4	0.868 4	0.669 4	0.587 4	0.997 3	0.467 5	0.828 5	0.732 2	0.342 3	0.745 3	0.119 5	0.918 2	0.404 5	0.419 4	0.398 3	0.172 3	0.618 5	0.743 4	0.167 2	0.077 5	0.500 2	0.000 3	0.568 4	0.506 5	1.000 1	0.044 4	0.000 3	0.502 4	0.010 4	0.593 4	0.284 5	0.305 5	0.903 5	0.213 4	0.142 4	0.981 3	0.790 4	0.000 4	1.000 1	0.715 4	0.538 5	0.346 4	0.830 5	0.067 3	0.000 3	0.400 3	0.074 4	0.333 4	0.551 2	1.000 1	0.000 1	0.292 3	0.777 4	0.118 5	0.317 3	0.100 4	0.000 2	0.191 2	0.648 3	0.000 3	0.000 2	0.000 1	0.000 2	0.000 3	0.500 1	0.213 5	0.825 1	0.021 5	0.333 1	0.648 5	0.098 4	0.000 2	0.000 3	0.000 3	0.077 3	0.000 1	0.000 5	0.150 5	0.000 3	0.000 3	0.000 5	0.225 2	0.281 4	0.447 4	0.000 5	0.090 4	0.148 4	0.000 4	0.479 5	0.542 1	0.000 2	0.000 1	0.200 3	0.131 5	0.000 1	0.250 3	0.000 4	0.000 1	0.159 5	0.396 4	0.677 3	0.021 4	0.000 4	0.500 1	0.000 1	1.000 1	0.442 3	0.125 5	0.000 1	0.000 4	0.000 3	0.000 4	0.333 1	0.000 3	0.528 1	0.000 3	0.000 3	0.000 3	0.000 3	0.000 1	0.200 5	0.000 1	0.516 4	0.000 1	0.000 3	0.500 3	0.000 1	0.833 2	0.000 1	0.000 1	0.286 4	0.083 4	0.750 3	0.000 1	0.000 3	0.000 1	0.000 2	0.000 1	0.059 5	0.445 3	0.200 3	0.535 4	0.070 2	0.167 4	0.385 4	0.375 3	0.000 2	0.000 1	0.333 3	0.000 1	0.000 1	0.000 2	0.500 2	0.000 1	0.000 2	0.000 2	0.200 3	0.000 2	0.000 2	0.000 2	0.000 1
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019
CSC-Pretrain Inst.	0.275 5	0.466 5	0.218 4	0.110 5	0.783 5	0.383 5	0.783 4	0.829 5	0.367 4	0.168 5	0.305 5	0.000 3	0.661 5	0.413 5	0.869 2	0.719 1	0.546 5	0.997 3	0.685 4	0.841 4	0.555 5	0.277 4	0.768 2	0.132 3	0.779 5	0.448 3	0.364 5	0.212 5	0.161 4	0.768 2	0.692 5	0.000 4	0.395 3	0.500 2	0.000 3	0.450 5	0.591 3	1.000 1	0.020 5	0.000 3	0.423 5	0.007 5	0.625 3	0.420 3	0.505 3	1.000 1	0.353 2	0.119 5	0.571 4	0.819 2	0.014 3	1.000 1	0.774 2	0.689 4	0.311 5	0.866 2	0.067 3	0.000 3	0.400 3	0.000 5	0.278 5	0.501 3	1.000 1	0.000 1	0.162 5	0.584 5	0.286 3	0.206 5	0.125 2	0.000 2	0.084 4	0.649 2	0.000 3	0.000 2	0.000 1	0.000 2	0.000 3	0.125 4	0.312 4	0.727 3	0.221 2	0.000 4	0.667 4	0.114 3	0.000 2	0.000 3	0.000 3	0.065 5	0.000 1	0.004 4	0.278 3	0.000 3	0.000 3	0.500 2	0.000 4	0.571 1	0.000 5	0.250 4	0.019 5	0.145 5	0.000 4	0.667 2	0.200 4	0.000 2	0.000 1	0.200 3	0.258 4	0.000 1	0.000 4	0.000 4	0.000 1	0.369 4	0.429 3	0.613 4	0.000 5	0.000 4	0.500 1	0.000 1	0.500 5	0.333 5	0.500 4	0.000 1	0.106 1	0.000 3	0.000 4	0.000 3	0.000 3	0.333 3	0.000 3	0.000 3	0.000 3	0.000 3	0.000 1	0.918 1	0.000 1	0.638 1	0.000 1	0.000 3	0.750 1	0.000 1	0.833 2	0.000 1	0.000 1	0.143 5	0.000 5	0.750 3	0.000 1	0.000 3	0.000 1	0.000 2	0.000 1	0.063 4	0.377 4	0.200 3	0.222 5	0.055 4	0.500 2	0.677 2	0.250 4	0.000 2	0.000 1	0.500 2	0.000 1	0.000 1	0.000 2	0.500 2	0.000 1	0.000 2	0.000 2	0.115 5	0.000 2	0.000 2	0.000 2	0.000 1
Ji Hou, Benjamin Graham, Matthias Nießner, Saining Xie: Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts. CVPR 2021
LGround Inst.	0.314 3	0.529 3	0.225 3	0.155 3	0.810 3	0.625 3	0.798 3	0.940 2	0.372 3	0.217 3	0.484 3	0.000 3	0.927 3	0.528 2	0.826 5	0.694 2	0.605 3	1.000 1	0.731 2	0.846 3	0.716 3	0.350 2	0.589 5	0.123 4	0.857 4	0.457 2	0.578 3	0.376 4	0.183 2	0.765 3	0.800 3	0.000 4	0.278 4	0.500 2	0.000 3	0.659 2	0.569 4	1.000 1	0.093 3	0.000 3	0.539 3	0.010 3	0.578 5	0.378 4	0.571 2	1.000 1	0.337 3	0.252 1	0.530 5	0.814 3	0.000 4	0.744 5	0.743 3	0.746 3	0.346 3	0.863 3	0.067 3	0.000 3	0.400 3	0.167 3	0.667 3	0.488 4	1.000 1	0.000 1	0.208 4	0.783 3	0.166 4	0.375 2	0.071 5	0.000 2	0.200 1	0.607 4	0.000 3	0.000 2	0.000 1	0.000 2	1.000 1	0.500 1	0.517 1	0.716 4	0.221 2	0.000 4	0.706 3	0.085 5	0.000 2	0.000 3	0.000 3	0.077 4	0.000 1	0.063 3	0.278 3	0.000 3	0.000 3	0.500 2	0.083 3	0.181 5	0.515 2	0.286 3	0.144 1	0.219 2	0.042 1	0.582 4	0.400 3	0.000 2	0.000 1	0.000 5	0.305 2	0.000 1	0.000 4	0.036 3	0.000 1	0.413 3	0.500 2	0.533 5	0.250 2	0.200 2	0.500 1	0.000 1	1.000 1	0.472 1	1.000 1	0.000 1	0.000 4	0.000 3	0.250 1	0.000 3	0.000 3	0.333 3	0.000 3	0.000 3	0.000 3	0.000 3	0.000 1	0.600 3	0.000 1	0.594 2	0.000 1	0.000 3	0.500 3	0.000 1	0.647 5	0.000 1	0.000 1	0.429 3	0.333 2	0.500 5	0.000 1	0.000 3	0.000 1	0.000 2	0.000 1	0.069 3	0.696 1	0.050 5	0.556 3	0.031 5	0.042 5	0.750 1	0.250 4	0.000 2	0.000 1	0.630 1	0.000 1	0.000 1	0.000 2	0.500 2	0.000 1	0.000 2	0.000 2	0.400 2	0.000 2	0.000 2	0.000 2	0.000 1
David Rozenberszki, Or Litany, Angela Dai: Language-Grounded Indoor 3D Semantic Segmentation in the Wild.

ScanNet Benchmark

This table lists the benchmark results for the 3D semantic label scenario.

Method	avg iou	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	floor	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	wall	window

Mix3D	0.781 1	0.964 1	0.855 1	0.843 11	0.781 1	0.858 7	0.575 3	0.831 20	0.685 7	0.714 1	0.979 1	0.594 3	0.310 18	0.801 1	0.892 8	0.841 2	0.819 3	0.723 3	0.940 8	0.887 1	0.725 13
Alexey Nekrasov, Jonas Schult, Or Litany, Bastian Leibe, Francis Engelmann: Mix3D: Out-of-Context Data Augmentation for 3D Scenes. 3DV 2021 (Oral)
CU-Hybrid Net	0.764 2	0.924 2	0.819 9	0.840 12	0.757 7	0.853 9	0.580 1	0.848 15	0.709 2	0.643 13	0.958 11	0.587 7	0.295 24	0.753 15	0.884 12	0.758 12	0.815 6	0.725 2	0.927 18	0.867 11	0.743 6

OccuSeg+Semantic	0.764 2	0.758 47	0.796 21	0.839 13	0.746 12	0.907 1	0.562 5	0.850 14	0.680 9	0.672 6	0.978 2	0.610 1	0.335 8	0.777 4	0.819 32	0.847 1	0.830 1	0.691 8	0.972 1	0.885 2	0.727 11

O-CNN	0.762 4	0.924 2	0.823 6	0.844 10	0.770 3	0.852 10	0.577 2	0.847 16	0.711 1	0.640 17	0.958 11	0.592 4	0.217 59	0.762 11	0.888 9	0.758 12	0.813 7	0.726 1	0.932 16	0.868 10	0.744 5
Peng-Shuai Wang, Yang Liu, Yu-Xiao Guo, Chun-Yu Sun, Xin Tong: O-CNN: Octree-based Convolutional Neural Networks for 3D Shape Analysis. SIGGRAPH 2017
OA-CNN-L_ScanNet20	0.756 5	0.783 35	0.826 5	0.858 4	0.776 2	0.837 20	0.548 9	0.896 5	0.649 17	0.675 5	0.962 8	0.586 8	0.335 8	0.771 7	0.802 36	0.770 8	0.787 22	0.691 8	0.936 11	0.880 5	0.761 3

PointTransformerV2	0.752 6	0.742 54	0.809 15	0.872 1	0.758 6	0.860 6	0.552 7	0.891 6	0.610 31	0.687 2	0.960 9	0.559 15	0.304 21	0.766 9	0.926 2	0.767 9	0.797 14	0.644 23	0.942 6	0.876 8	0.722 15
Xiaoyang Wu, Yixing Lao, Li Jiang, Xihui Liu, Hengshuang Zhao: Point Transformer V2: Grouped Vector Attention and Partition-based Pooling. NeurIPS 2022
DMF-Net	0.752 6	0.906 6	0.793 24	0.802 30	0.689 28	0.825 32	0.556 6	0.867 10	0.681 8	0.602 31	0.960 9	0.555 17	0.365 3	0.779 3	0.859 17	0.747 15	0.795 18	0.717 4	0.917 21	0.856 19	0.764 2

PointConvFormer	0.749 8	0.793 32	0.790 25	0.807 25	0.750 11	0.856 8	0.524 17	0.881 8	0.588 42	0.642 16	0.977 4	0.591 5	0.274 35	0.781 2	0.929 1	0.804 3	0.796 15	0.642 24	0.947 3	0.885 2	0.715 18
Wenxuan Wu, Qi Shan, Li Fuxin: PointConvFormer: Revenge of the Point-based Convolution.
BPNet	0.749 8	0.909 4	0.818 11	0.811 22	0.752 9	0.839 19	0.485 33	0.842 17	0.673 10	0.644 12	0.957 14	0.528 26	0.305 20	0.773 6	0.859 17	0.788 4	0.818 5	0.693 7	0.916 22	0.856 19	0.723 14
Wenbo Hu, Hengshuang Zhao, Li Jiang, Jiaya Jia, Tien-Tsin Wong: Bidirectional Projection Network for Cross Dimension Scene Understanding. CVPR 2021 (Oral)
MSP	0.748 10	0.623 80	0.804 17	0.859 3	0.745 13	0.824 34	0.501 24	0.912 2	0.690 6	0.685 3	0.956 15	0.567 12	0.320 14	0.768 8	0.918 3	0.720 23	0.802 10	0.676 13	0.921 19	0.881 4	0.779 1

StratifiedFormer	0.747 11	0.901 7	0.803 18	0.845 9	0.757 7	0.846 14	0.512 20	0.825 23	0.696 5	0.645 11	0.956 15	0.576 10	0.262 45	0.744 19	0.861 16	0.742 16	0.770 31	0.705 5	0.899 34	0.860 16	0.734 7
Xin Lai, Jianhui Liu, Li Jiang, Liwei Wang, Hengshuang Zhao, Shu Liu, Xiaojuan Qi, Jiaya Jia: Stratified Transformer for 3D Point Cloud Segmentation. CVPR 2022
Virtual MVFusion	0.746 12	0.771 41	0.819 9	0.848 7	0.702 26	0.865 5	0.397 71	0.899 3	0.699 3	0.664 8	0.948 42	0.588 6	0.330 10	0.746 18	0.851 24	0.764 10	0.796 15	0.704 6	0.935 12	0.866 12	0.728 9
Abhijit Kundu, Xiaoqi Yin, Alireza Fathi, David Ross, Brian Brewington, Thomas Funkhouser, Caroline Pantofaru: Virtual Multi-view Fusion for 3D Semantic Segmentation. ECCV 2020
VMNet	0.746 12	0.870 12	0.838 2	0.858 4	0.729 18	0.850 12	0.501 24	0.874 9	0.587 43	0.658 9	0.956 15	0.564 13	0.299 22	0.765 10	0.900 5	0.716 26	0.812 8	0.631 29	0.939 9	0.858 17	0.709 19
Zeyu HU, Xuyang Bai, Jiaxiang Shang, Runze Zhang, Jiayu Dong, Xin Wang, Guangyuan Sun, Hongbo Fu, Chiew-Lan Tai: VMNet: Voxel-Mesh Network for Geodesic-Aware 3D Semantic Segmentation. ICCV 2021 (Oral)
Retro-FPN	0.744 14	0.842 19	0.800 19	0.767 42	0.740 14	0.836 23	0.541 11	0.914 1	0.672 11	0.626 20	0.958 11	0.552 18	0.272 37	0.777 4	0.886 11	0.696 33	0.801 11	0.674 15	0.941 7	0.858 17	0.717 16

EQ-Net	0.743 15	0.620 81	0.799 20	0.849 6	0.730 17	0.822 36	0.493 31	0.897 4	0.664 12	0.681 4	0.955 19	0.562 14	0.378 1	0.760 12	0.903 4	0.738 17	0.801 11	0.673 16	0.907 27	0.877 6	0.745 4
Zetong Yang, Li Jiang, Yanan Sun, Bernt Schiele, Jiaya JIa: A Unified Query-based Paradigm for Point Cloud Understanding. CVPR 2022
SAT	0.742 16	0.860 14	0.765 36	0.819 17	0.769 4	0.848 13	0.533 13	0.829 21	0.663 13	0.631 19	0.955 19	0.586 8	0.274 35	0.753 15	0.896 6	0.729 18	0.760 38	0.666 18	0.921 19	0.855 21	0.733 8

LRPNet	0.742 16	0.816 27	0.806 16	0.807 25	0.752 9	0.828 30	0.575 3	0.839 19	0.699 3	0.637 18	0.954 24	0.520 28	0.320 14	0.755 14	0.834 28	0.760 11	0.772 28	0.676 13	0.915 23	0.862 14	0.717 16

TXC	0.740 18	0.842 19	0.832 4	0.805 29	0.715 22	0.846 14	0.473 35	0.885 7	0.615 27	0.671 7	0.971 6	0.547 19	0.320 14	0.697 23	0.799 38	0.777 6	0.819 3	0.682 11	0.946 4	0.871 9	0.696 24

LargeKernel3D	0.739 19	0.909 4	0.820 8	0.806 27	0.740 14	0.852 10	0.545 10	0.826 22	0.594 41	0.643 13	0.955 19	0.541 21	0.263 44	0.723 21	0.858 19	0.775 7	0.767 32	0.678 12	0.933 14	0.848 25	0.694 25

MinkowskiNet	0.736 20	0.859 15	0.818 11	0.832 14	0.709 23	0.840 18	0.521 19	0.853 13	0.660 15	0.643 13	0.951 32	0.544 20	0.286 29	0.731 20	0.893 7	0.675 40	0.772 28	0.683 10	0.874 52	0.852 23	0.727 11
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019
IPCA	0.731 21	0.890 8	0.837 3	0.864 2	0.726 19	0.873 2	0.530 16	0.824 24	0.489 74	0.647 10	0.978 2	0.609 2	0.336 7	0.624 38	0.733 47	0.758 12	0.776 26	0.570 54	0.949 2	0.877 6	0.728 9

SparseConvNet	0.725 22	0.647 77	0.821 7	0.846 8	0.721 20	0.869 3	0.533 13	0.754 44	0.603 37	0.614 24	0.955 19	0.572 11	0.325 12	0.710 22	0.870 13	0.724 21	0.823 2	0.628 30	0.934 13	0.865 13	0.683 28

PointTransformer++	0.725 22	0.727 61	0.811 14	0.819 17	0.765 5	0.841 17	0.502 23	0.814 30	0.621 26	0.623 21	0.955 19	0.556 16	0.284 30	0.620 39	0.866 14	0.781 5	0.757 41	0.648 21	0.932 16	0.862 14	0.709 19

MatchingNet	0.724 24	0.812 29	0.812 13	0.810 23	0.735 16	0.834 25	0.495 30	0.860 12	0.572 49	0.602 31	0.954 24	0.512 30	0.280 32	0.757 13	0.845 26	0.725 20	0.780 24	0.606 40	0.937 10	0.851 24	0.700 22

INS-Conv-semantic	0.717 25	0.751 50	0.759 39	0.812 21	0.704 25	0.868 4	0.537 12	0.842 17	0.609 33	0.608 27	0.953 27	0.534 22	0.293 25	0.616 40	0.864 15	0.719 25	0.793 19	0.640 25	0.933 14	0.845 30	0.663 33

PointMetaBase	0.714 26	0.835 21	0.785 27	0.821 15	0.684 30	0.846 14	0.531 15	0.865 11	0.614 28	0.596 35	0.953 27	0.500 33	0.246 51	0.674 24	0.888 9	0.692 34	0.764 34	0.624 31	0.849 67	0.844 31	0.675 30

contrastBoundary	0.705 27	0.769 44	0.775 32	0.809 24	0.687 29	0.820 39	0.439 59	0.812 31	0.661 14	0.591 37	0.945 50	0.515 29	0.171 77	0.633 35	0.856 20	0.720 23	0.796 15	0.668 17	0.889 41	0.847 27	0.689 26
Liyao Tang, Yibing Zhan, Zhe Chen, Baosheng Yu, Dacheng Tao: Contrastive Boundary Learning for Point Cloud Segmentation. CVPR2022
RFCR	0.702 28	0.889 9	0.745 48	0.813 20	0.672 32	0.818 43	0.493 31	0.815 28	0.623 24	0.610 25	0.947 44	0.470 43	0.249 50	0.594 43	0.848 25	0.705 30	0.779 25	0.646 22	0.892 39	0.823 37	0.611 47
Jingyu Gong, Jiachen Xu, Xin Tan, Haichuan Song, Yanyun Qu, Yuan Xie, Lizhuang Ma: Omni-Supervised Point Cloud Segmentation via Gradual Receptive Field Component Reasoning. CVPR2021
One Thing One Click	0.701 29	0.825 25	0.796 21	0.723 49	0.716 21	0.832 26	0.433 61	0.816 26	0.634 22	0.609 26	0.969 7	0.418 68	0.344 5	0.559 55	0.833 29	0.715 27	0.808 9	0.560 58	0.902 31	0.847 27	0.680 29

JSENet	0.699 30	0.881 11	0.762 37	0.821 15	0.667 33	0.800 56	0.522 18	0.792 36	0.613 29	0.607 28	0.935 70	0.492 35	0.205 64	0.576 48	0.853 22	0.691 35	0.758 40	0.652 20	0.872 55	0.828 34	0.649 37
Zeyu HU, Mingmin Zhen, Xuyang BAI, Hongbo Fu, Chiew-lan Tai: JSENet: Joint Semantic Segmentation and Edge Detection Network for 3D Point Clouds. ECCV 2020
PicassoNet-II	0.696 31	0.704 66	0.790 25	0.787 34	0.709 23	0.837 20	0.459 43	0.815 28	0.543 58	0.615 23	0.956 15	0.529 24	0.250 48	0.551 60	0.790 39	0.703 31	0.799 13	0.619 35	0.908 26	0.848 25	0.700 22
Huan Lei, Naveed Akhtar, Mubarak Shah, and Ajmal Mian: Geometric feature learning for 3D meshes.
One-Thing-One-Click	0.693 32	0.743 53	0.794 23	0.655 73	0.684 30	0.822 36	0.497 29	0.719 54	0.622 25	0.617 22	0.977 4	0.447 55	0.339 6	0.750 17	0.664 62	0.703 31	0.790 21	0.596 44	0.946 4	0.855 21	0.647 38
Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu: One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation. CVPR 2021
Feature_GeometricNet	0.690 33	0.884 10	0.754 43	0.795 33	0.647 39	0.818 43	0.422 63	0.802 34	0.612 30	0.604 29	0.945 50	0.462 46	0.189 72	0.563 54	0.853 22	0.726 19	0.765 33	0.632 28	0.904 29	0.821 40	0.606 51
Kangcheng Liu, Ben M. Chen: https://arxiv.org/abs/2012.09439. arXiv Preprint
FusionNet	0.688 34	0.704 66	0.741 52	0.754 46	0.656 35	0.829 28	0.501 24	0.741 49	0.609 33	0.548 44	0.950 36	0.522 27	0.371 2	0.633 35	0.756 42	0.715 27	0.771 30	0.623 32	0.861 63	0.814 42	0.658 34
Feihu Zhang, Jin Fang, Benjamin Wah, Philip Torr: Deep FusionNet for Point Cloud Semantic Segmentation. ECCV 2020
Feature-Geometry Net	0.685 35	0.866 13	0.748 45	0.819 17	0.645 41	0.794 59	0.450 48	0.802 34	0.587 43	0.604 29	0.945 50	0.464 45	0.201 67	0.554 57	0.840 27	0.723 22	0.732 50	0.602 42	0.907 27	0.822 39	0.603 54

VACNN++	0.684 36	0.728 60	0.757 42	0.776 39	0.690 27	0.804 53	0.464 41	0.816 26	0.577 48	0.587 38	0.945 50	0.508 32	0.276 34	0.671 25	0.710 52	0.663 45	0.750 44	0.589 49	0.881 46	0.832 33	0.653 36

KP-FCNN	0.684 36	0.847 18	0.758 41	0.784 36	0.647 39	0.814 46	0.473 35	0.772 39	0.605 35	0.594 36	0.935 70	0.450 53	0.181 75	0.587 44	0.805 35	0.690 36	0.785 23	0.614 36	0.882 45	0.819 41	0.632 43
H. Thomas, C. Qi, J. Deschaud, B. Marcotegui, F. Goulette, L. Guibas.: KPConv: Flexible and Deformable Convolution for Point Clouds. ICCV 2019
DGNet	0.684 36	0.712 65	0.784 28	0.782 38	0.658 34	0.835 24	0.499 28	0.823 25	0.641 19	0.597 34	0.950 36	0.487 36	0.281 31	0.575 49	0.619 65	0.647 53	0.764 34	0.620 34	0.871 58	0.846 29	0.688 27

Superpoint Network	0.683 39	0.851 17	0.728 56	0.800 32	0.653 37	0.806 51	0.468 38	0.804 32	0.572 49	0.602 31	0.946 47	0.453 52	0.239 54	0.519 66	0.822 30	0.689 38	0.762 37	0.595 46	0.895 37	0.827 35	0.630 44

PointContrast_LA_SEM	0.683 39	0.757 48	0.784 28	0.786 35	0.639 43	0.824 34	0.408 66	0.775 38	0.604 36	0.541 46	0.934 74	0.532 23	0.269 40	0.552 58	0.777 40	0.645 56	0.793 19	0.640 25	0.913 24	0.824 36	0.671 31

VI-PointConv	0.676 41	0.770 43	0.754 43	0.783 37	0.621 47	0.814 46	0.552 7	0.758 42	0.571 51	0.557 42	0.954 24	0.529 24	0.268 42	0.530 64	0.682 57	0.675 40	0.719 53	0.603 41	0.888 42	0.833 32	0.665 32
Xingyi Li, Wenxuan Wu, Xiaoli Z. Fern, Li Fuxin: The Devils in the Point Clouds: Studying the Robustness of Point Cloud Convolutions.
ROSMRF3D	0.673 42	0.789 33	0.748 45	0.763 44	0.635 45	0.814 46	0.407 68	0.747 46	0.581 47	0.573 39	0.950 36	0.484 37	0.271 39	0.607 41	0.754 43	0.649 50	0.774 27	0.596 44	0.883 44	0.823 37	0.606 51

SALANet	0.670 43	0.816 27	0.770 34	0.768 41	0.652 38	0.807 50	0.451 45	0.747 46	0.659 16	0.545 45	0.924 80	0.473 42	0.149 87	0.571 51	0.811 34	0.635 59	0.746 45	0.623 32	0.892 39	0.794 54	0.570 64

PointConv	0.666 44	0.781 36	0.759 39	0.699 58	0.644 42	0.822 36	0.475 34	0.779 37	0.564 54	0.504 62	0.953 27	0.428 62	0.203 66	0.586 46	0.754 43	0.661 46	0.753 42	0.588 50	0.902 31	0.813 44	0.642 39
Wenxuan Wu, Zhongang Qi, Li Fuxin: PointConv: Deep Convolutional Networks on 3D Point Clouds. CVPR 2019
PointASNL	0.666 44	0.703 68	0.781 30	0.751 48	0.655 36	0.830 27	0.471 37	0.769 40	0.474 77	0.537 48	0.951 32	0.475 41	0.279 33	0.635 33	0.698 56	0.675 40	0.751 43	0.553 63	0.816 74	0.806 46	0.703 21
Xu Yan, Chaoda Zheng, Zhen Li, Sheng Wang, Shuguang Cui: PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Sampling. CVPR 2020
PPCNN++	0.663 46	0.746 51	0.708 60	0.722 50	0.638 44	0.820 39	0.451 45	0.566 81	0.599 39	0.541 46	0.950 36	0.510 31	0.313 17	0.648 30	0.819 32	0.616 64	0.682 69	0.590 48	0.869 59	0.810 45	0.656 35
Pyunghwan Ahn, Juyoung Yang, Eojindl Yi, Chanho Lee, Junmo Kim: Projection-based Point Convolution for Efficient Point Cloud Segmentation. IEEE Access
DCM-Net	0.658 47	0.778 37	0.702 63	0.806 27	0.619 48	0.813 49	0.468 38	0.693 62	0.494 69	0.524 54	0.941 61	0.449 54	0.298 23	0.510 68	0.821 31	0.675 40	0.727 52	0.568 56	0.826 72	0.803 48	0.637 41
Jonas Schult, Francis Engelmann, Theodora Kontogianni, Bastian Leibe: DualConvMesh-Net: Joint Geodesic and Euclidean Convolutions on 3D Meshes. CVPR 2020 [Oral]
HPGCNN	0.656 48	0.698 69	0.743 50	0.650 74	0.564 65	0.820 39	0.505 22	0.758 42	0.631 23	0.479 67	0.945 50	0.480 39	0.226 55	0.572 50	0.774 41	0.690 36	0.735 48	0.614 36	0.853 66	0.776 69	0.597 57
Jisheng Dang, Qingyong Hu, Yulan Guo, Jun Yang: HPGCNN.
SAFNet-seg	0.654 49	0.752 49	0.734 54	0.664 71	0.583 60	0.815 45	0.399 70	0.754 44	0.639 20	0.535 50	0.942 59	0.470 43	0.309 19	0.665 26	0.539 71	0.650 49	0.708 58	0.635 27	0.857 65	0.793 56	0.642 39
Linqing Zhao, Jiwen Lu, Jie Zhou: Similarity-Aware Fusion Network for 3D Semantic Segmentation. IROS 2021
RandLA-Net	0.645 50	0.778 37	0.731 55	0.699 58	0.577 61	0.829 28	0.446 50	0.736 50	0.477 76	0.523 56	0.945 50	0.454 50	0.269 40	0.484 75	0.749 46	0.618 62	0.738 46	0.599 43	0.827 71	0.792 59	0.621 46

MVPNet	0.641 51	0.831 22	0.715 58	0.671 68	0.590 56	0.781 65	0.394 72	0.679 64	0.642 18	0.553 43	0.937 67	0.462 46	0.256 46	0.649 29	0.406 84	0.626 60	0.691 66	0.666 18	0.877 48	0.792 59	0.608 50
Maximilian Jaritz, Jiayuan Gu, Hao Su: Multi-view PointNet for 3D Scene Understanding. GMDL Workshop, ICCV 2019
PointConv-SFPN	0.641 51	0.776 39	0.703 62	0.721 51	0.557 68	0.826 31	0.451 45	0.672 66	0.563 55	0.483 66	0.943 58	0.425 65	0.162 82	0.644 31	0.726 48	0.659 47	0.709 57	0.572 53	0.875 50	0.786 64	0.559 69

PointMRNet	0.640 53	0.717 64	0.701 64	0.692 61	0.576 62	0.801 55	0.467 40	0.716 55	0.563 55	0.459 72	0.953 27	0.429 61	0.169 79	0.581 47	0.854 21	0.605 65	0.710 55	0.550 64	0.894 38	0.793 56	0.575 62

FPConv	0.639 54	0.785 34	0.760 38	0.713 56	0.603 51	0.798 57	0.392 73	0.534 86	0.603 37	0.524 54	0.948 42	0.457 48	0.250 48	0.538 62	0.723 50	0.598 69	0.696 64	0.614 36	0.872 55	0.799 49	0.567 66
Yiqun Lin, Zizheng Yan, Haibin Huang, Dong Du, Ligang Liu, Shuguang Cui, Xiaoguang Han: FPConv: Learning Local Flattening for Point Convolution. CVPR 2020
PD-Net	0.638 55	0.797 31	0.769 35	0.641 79	0.590 56	0.820 39	0.461 42	0.537 85	0.637 21	0.536 49	0.947 44	0.388 76	0.206 63	0.656 27	0.668 60	0.647 53	0.732 50	0.585 51	0.868 60	0.793 56	0.473 88

PointSPNet	0.637 56	0.734 57	0.692 71	0.714 55	0.576 62	0.797 58	0.446 50	0.743 48	0.598 40	0.437 77	0.942 59	0.403 72	0.150 86	0.626 37	0.800 37	0.649 50	0.697 63	0.557 61	0.846 68	0.777 68	0.563 67

SConv	0.636 57	0.830 23	0.697 67	0.752 47	0.572 64	0.780 67	0.445 52	0.716 55	0.529 61	0.530 51	0.951 32	0.446 56	0.170 78	0.507 70	0.666 61	0.636 58	0.682 69	0.541 69	0.886 43	0.799 49	0.594 58

Supervoxel-CNN	0.635 58	0.656 75	0.711 59	0.719 52	0.613 49	0.757 76	0.444 55	0.765 41	0.534 60	0.566 40	0.928 78	0.478 40	0.272 37	0.636 32	0.531 73	0.664 44	0.645 79	0.508 77	0.864 62	0.792 59	0.611 47

joint point-based	0.634 59	0.614 82	0.778 31	0.667 70	0.633 46	0.825 32	0.420 64	0.804 32	0.467 79	0.561 41	0.951 32	0.494 34	0.291 26	0.566 52	0.458 79	0.579 76	0.764 34	0.559 60	0.838 69	0.814 42	0.598 56
Hung-Yueh Chiang, Yen-Liang Lin, Yueh-Cheng Liu, Winston H. Hsu: A Unified Point-Based Framework for 3D Segmentation. 3DV 2019
PointMTL	0.632 60	0.731 58	0.688 74	0.675 65	0.591 55	0.784 64	0.444 55	0.565 82	0.610 31	0.492 64	0.949 40	0.456 49	0.254 47	0.587 44	0.706 53	0.599 68	0.665 75	0.612 39	0.868 60	0.791 63	0.579 61

3DSM_DMMF	0.631 61	0.626 79	0.745 48	0.801 31	0.607 50	0.751 77	0.506 21	0.729 53	0.565 53	0.491 65	0.866 94	0.434 57	0.197 70	0.595 42	0.630 64	0.709 29	0.705 60	0.560 58	0.875 50	0.740 79	0.491 83

PointNet2-SFPN	0.631 61	0.771 41	0.692 71	0.672 66	0.524 73	0.837 20	0.440 58	0.706 60	0.538 59	0.446 74	0.944 56	0.421 67	0.219 58	0.552 58	0.751 45	0.591 72	0.737 47	0.543 68	0.901 33	0.768 71	0.557 70

APCF-Net	0.631 61	0.742 54	0.687 76	0.672 66	0.557 68	0.792 62	0.408 66	0.665 67	0.545 57	0.508 59	0.952 31	0.428 62	0.186 73	0.634 34	0.702 54	0.620 61	0.706 59	0.555 62	0.873 53	0.798 51	0.581 60
Haojia, Lin: Adaptive Pyramid Context Fusion for Point Cloud Perception. GRSL
FusionAwareConv	0.630 64	0.604 84	0.741 52	0.766 43	0.590 56	0.747 78	0.501 24	0.734 51	0.503 68	0.527 52	0.919 84	0.454 50	0.323 13	0.550 61	0.420 83	0.678 39	0.688 67	0.544 66	0.896 36	0.795 53	0.627 45
Jiazhao Zhang, Chenyang Zhu, Lintao Zheng, Kai Xu: Fusion-Aware Point Convolution for Online Semantic 3D Scene Segmentation. CVPR 2020
DenSeR	0.628 65	0.800 30	0.625 86	0.719 52	0.545 71	0.806 51	0.445 52	0.597 76	0.448 83	0.519 57	0.938 66	0.481 38	0.328 11	0.489 74	0.499 78	0.657 48	0.759 39	0.592 47	0.881 46	0.797 52	0.634 42

SegGroup_sem	0.627 66	0.818 26	0.747 47	0.701 57	0.602 52	0.764 73	0.385 77	0.629 73	0.490 72	0.508 59	0.931 77	0.409 70	0.201 67	0.564 53	0.725 49	0.618 62	0.692 65	0.539 70	0.873 53	0.794 54	0.548 73
An Tao, Yueqi Duan, Yi Wei, Jiwen Lu, Jie Zhou: SegGroup: Seg-Level Supervision for 3D Instance and Semantic Segmentation. TIP 2022
SIConv	0.625 67	0.830 23	0.694 69	0.757 45	0.563 66	0.772 71	0.448 49	0.647 70	0.520 63	0.509 58	0.949 40	0.431 60	0.191 71	0.496 72	0.614 66	0.647 53	0.672 73	0.535 72	0.876 49	0.783 65	0.571 63

HPEIN	0.618 68	0.729 59	0.668 77	0.647 76	0.597 54	0.766 72	0.414 65	0.680 63	0.520 63	0.525 53	0.946 47	0.432 58	0.215 60	0.493 73	0.599 67	0.638 57	0.617 84	0.570 54	0.897 35	0.806 46	0.605 53
Li Jiang, Hengshuang Zhao, Shu Liu, Xiaoyong Shen, Chi-Wing Fu, Jiaya Jia: Hierarchical Point-Edge Interaction Network for Point Cloud Semantic Segmentation. ICCV 2019
SPH3D-GCN	0.610 69	0.858 16	0.772 33	0.489 91	0.532 72	0.792 62	0.404 69	0.643 72	0.570 52	0.507 61	0.935 70	0.414 69	0.046 96	0.510 68	0.702 54	0.602 67	0.705 60	0.549 65	0.859 64	0.773 70	0.534 76
Huan Lei, Naveed Akhtar, and Ajmal Mian: Spherical Kernel for Efficient Graph Convolution on 3D Point Clouds. TPAMI 2020
AttAN	0.609 70	0.760 46	0.667 78	0.649 75	0.521 74	0.793 60	0.457 44	0.648 69	0.528 62	0.434 79	0.947 44	0.401 73	0.153 85	0.454 77	0.721 51	0.648 52	0.717 54	0.536 71	0.904 29	0.765 72	0.485 84
Gege Zhang, Qinghua Ma, Licheng Jiao, Fang Liu and Qigong Sun: AttAN: Attention Adversarial Networks for 3D Point Cloud Semantic Segmentation. IJCAI2020
wsss-transformer	0.600 71	0.634 78	0.743 50	0.697 60	0.601 53	0.781 65	0.437 60	0.585 79	0.493 70	0.446 74	0.933 75	0.394 74	0.011 98	0.654 28	0.661 63	0.603 66	0.733 49	0.526 73	0.832 70	0.761 74	0.480 85

dtc_net	0.596 72	0.683 70	0.725 57	0.715 54	0.549 70	0.803 54	0.444 55	0.647 70	0.493 70	0.495 63	0.941 61	0.409 70	0.000 100	0.424 82	0.544 70	0.598 69	0.703 62	0.522 74	0.912 25	0.792 59	0.520 79

LAP-D	0.594 73	0.720 62	0.692 71	0.637 80	0.456 83	0.773 70	0.391 75	0.730 52	0.587 43	0.445 76	0.940 64	0.381 77	0.288 27	0.434 80	0.453 81	0.591 72	0.649 77	0.581 52	0.777 78	0.749 78	0.610 49

DPC	0.592 74	0.720 62	0.700 65	0.602 84	0.480 79	0.762 75	0.380 78	0.713 58	0.585 46	0.437 77	0.940 64	0.369 79	0.288 27	0.434 80	0.509 77	0.590 74	0.639 82	0.567 57	0.772 79	0.755 76	0.592 59
Francis Engelmann, Theodora Kontogianni, Bastian Leibe: Dilated Point Convolutions: On the Receptive Field Size of Point Convolutions on 3D Point Clouds. ICRA 2020
CCRFNet	0.589 75	0.766 45	0.659 81	0.683 63	0.470 82	0.740 80	0.387 76	0.620 75	0.490 72	0.476 68	0.922 82	0.355 82	0.245 52	0.511 67	0.511 76	0.571 77	0.643 80	0.493 81	0.872 55	0.762 73	0.600 55

ROSMRF	0.580 76	0.772 40	0.707 61	0.681 64	0.563 66	0.764 73	0.362 80	0.515 87	0.465 80	0.465 71	0.936 69	0.427 64	0.207 62	0.438 78	0.577 68	0.536 80	0.675 72	0.486 82	0.723 85	0.779 66	0.524 78

SD-DETR	0.576 77	0.746 51	0.609 90	0.445 95	0.517 75	0.643 91	0.366 79	0.714 57	0.456 81	0.468 70	0.870 93	0.432 58	0.264 43	0.558 56	0.674 58	0.586 75	0.688 67	0.482 83	0.739 83	0.733 81	0.537 75

SQN_0.1%	0.569 78	0.676 72	0.696 68	0.657 72	0.497 76	0.779 68	0.424 62	0.548 83	0.515 65	0.376 84	0.902 91	0.422 66	0.357 4	0.379 85	0.456 80	0.596 71	0.659 76	0.544 66	0.685 88	0.665 92	0.556 71

TextureNet	0.566 79	0.672 74	0.664 79	0.671 68	0.494 77	0.719 81	0.445 52	0.678 65	0.411 89	0.396 82	0.935 70	0.356 81	0.225 56	0.412 83	0.535 72	0.565 78	0.636 83	0.464 85	0.794 77	0.680 89	0.568 65
Jingwei Huang, Haotian Zhang, Li Yi, Thomas Funkerhouser, Matthias Niessner, Leonidas Guibas: TextureNet: Consistent Local Parametrizations for Learning from High-Resolution Signals on Meshes. CVPR
DVVNet	0.562 80	0.648 76	0.700 65	0.770 40	0.586 59	0.687 85	0.333 84	0.650 68	0.514 66	0.475 69	0.906 88	0.359 80	0.223 57	0.340 87	0.442 82	0.422 91	0.668 74	0.501 78	0.708 86	0.779 66	0.534 76

Pointnet++ & Feature	0.557 81	0.735 56	0.661 80	0.686 62	0.491 78	0.744 79	0.392 73	0.539 84	0.451 82	0.375 85	0.946 47	0.376 78	0.205 64	0.403 84	0.356 87	0.553 79	0.643 80	0.497 79	0.824 73	0.756 75	0.515 80

GMLPs	0.538 82	0.495 92	0.693 70	0.647 76	0.471 81	0.793 60	0.300 87	0.477 88	0.505 67	0.358 86	0.903 90	0.327 85	0.081 93	0.472 76	0.529 74	0.448 89	0.710 55	0.509 75	0.746 81	0.737 80	0.554 72

PanopticFusion-label	0.529 83	0.491 93	0.688 74	0.604 83	0.386 88	0.632 92	0.225 97	0.705 61	0.434 86	0.293 92	0.815 95	0.348 83	0.241 53	0.499 71	0.669 59	0.507 82	0.649 77	0.442 91	0.796 76	0.602 95	0.561 68
Gaku Narita, Takashi Seno, Tomoya Ishikawa, Yohsuke Kaji: PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Things. IROS 2019 (to appear)
subcloud_weak	0.516 84	0.676 72	0.591 93	0.609 81	0.442 84	0.774 69	0.335 83	0.597 76	0.422 88	0.357 87	0.932 76	0.341 84	0.094 92	0.298 89	0.528 75	0.473 87	0.676 71	0.495 80	0.602 94	0.721 84	0.349 95

Online SegFusion	0.515 85	0.607 83	0.644 84	0.579 86	0.434 85	0.630 93	0.353 81	0.628 74	0.440 84	0.410 80	0.762 98	0.307 87	0.167 80	0.520 65	0.403 85	0.516 81	0.565 87	0.447 89	0.678 89	0.701 86	0.514 81
Davide Menini, Suryansh Kumar, Martin R. Oswald, Erik Sandstroem, Cristian Sminchisescu, Luc van Gool: A Real-Time Learning Framework for Joint 3D Reconstruction and Semantic Segmentation. Robotics and Automation Letters Submission
3DMV, FTSDF	0.501 86	0.558 88	0.608 91	0.424 97	0.478 80	0.690 84	0.246 93	0.586 78	0.468 78	0.450 73	0.911 86	0.394 74	0.160 83	0.438 78	0.212 94	0.432 90	0.541 92	0.475 84	0.742 82	0.727 82	0.477 86

PCNN	0.498 87	0.559 87	0.644 84	0.560 88	0.420 87	0.711 83	0.229 95	0.414 89	0.436 85	0.352 88	0.941 61	0.324 86	0.155 84	0.238 94	0.387 86	0.493 83	0.529 93	0.509 75	0.813 75	0.751 77	0.504 82

3DMV	0.484 88	0.484 94	0.538 95	0.643 78	0.424 86	0.606 96	0.310 85	0.574 80	0.433 87	0.378 83	0.796 96	0.301 88	0.214 61	0.537 63	0.208 95	0.472 88	0.507 96	0.413 94	0.693 87	0.602 95	0.539 74
Angela Dai, Matthias Niessner: 3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation. ECCV'18
PointCNN with RGB	0.458 89	0.577 86	0.611 89	0.356 99	0.321 96	0.715 82	0.299 89	0.376 93	0.328 96	0.319 90	0.944 56	0.285 90	0.164 81	0.216 97	0.229 92	0.484 85	0.545 91	0.456 87	0.755 80	0.709 85	0.475 87
Yangyan Li, Rui Bu, Mingchao Sun, Baoquan Chen: PointCNN. NeurIPS 2018
FCPN	0.447 90	0.679 71	0.604 92	0.578 87	0.380 89	0.682 86	0.291 90	0.106 99	0.483 75	0.258 97	0.920 83	0.258 94	0.025 97	0.231 96	0.325 88	0.480 86	0.560 89	0.463 86	0.725 84	0.666 91	0.231 99
Dario Rethage, Johanna Wald, Jürgen Sturm, Nassir Navab, Federico Tombari: Fully-Convolutional Point Networks for Large-Scale Point Clouds. ECCV 2018
DGCNN_reproduce	0.446 91	0.474 95	0.623 87	0.463 93	0.366 91	0.651 89	0.310 85	0.389 92	0.349 94	0.330 89	0.937 67	0.271 92	0.126 89	0.285 90	0.224 93	0.350 96	0.577 86	0.445 90	0.625 92	0.723 83	0.394 91
Yue Wang, Yongbin Sun, Ziwei Liu, Sanjay E. Sarma, Michael M. Bronstein, Justin M. Solomon: Dynamic Graph CNN for Learning on Point Clouds. TOG 2019
SurfaceConvPF	0.442 92	0.505 91	0.622 88	0.380 98	0.342 94	0.654 88	0.227 96	0.397 91	0.367 92	0.276 94	0.924 80	0.240 95	0.198 69	0.359 86	0.262 90	0.366 93	0.581 85	0.435 92	0.640 91	0.668 90	0.398 90
Hao Pan, Shilin Liu, Yang Liu, Xin Tong: Convolutional Neural Networks on 3D Surfaces Using Parallel Frames.
PNET2	0.442 92	0.548 89	0.548 94	0.597 85	0.363 92	0.628 94	0.300 87	0.292 94	0.374 91	0.307 91	0.881 92	0.268 93	0.186 73	0.238 94	0.204 96	0.407 92	0.506 97	0.449 88	0.667 90	0.620 94	0.462 89

Tangent Convolutions	0.438 94	0.437 97	0.646 83	0.474 92	0.369 90	0.645 90	0.353 81	0.258 96	0.282 98	0.279 93	0.918 85	0.298 89	0.147 88	0.283 91	0.294 89	0.487 84	0.562 88	0.427 93	0.619 93	0.633 93	0.352 94
Maxim Tatarchenko, Jaesik Park, Vladlen Koltun, Qian-Yi Zhou: Tangent convolutions for dense prediction in 3d. CVPR 2018
3DWSSS	0.425 95	0.525 90	0.647 82	0.522 89	0.324 95	0.488 99	0.077 100	0.712 59	0.353 93	0.401 81	0.636 100	0.281 91	0.176 76	0.340 87	0.565 69	0.175 100	0.551 90	0.398 95	0.370 100	0.602 95	0.361 93

SPLAT Net	0.393 96	0.472 96	0.511 96	0.606 82	0.311 97	0.656 87	0.245 94	0.405 90	0.328 96	0.197 98	0.927 79	0.227 97	0.000 100	0.001 101	0.249 91	0.271 99	0.510 94	0.383 97	0.593 95	0.699 87	0.267 97
Hang Su, Varun Jampani, Deqing Sun, Subhransu Maji, Evangelos Kalogerakis, Ming-Hsuan Yang, Jan Kautz: SPLATNet: Sparse Lattice Networks for Point Cloud Processing. CVPR 2018
ScanNet+FTSDF	0.383 97	0.297 99	0.491 97	0.432 96	0.358 93	0.612 95	0.274 91	0.116 98	0.411 89	0.265 95	0.904 89	0.229 96	0.079 94	0.250 92	0.185 97	0.320 97	0.510 94	0.385 96	0.548 96	0.597 98	0.394 91

PointNet++	0.339 98	0.584 85	0.478 98	0.458 94	0.256 99	0.360 100	0.250 92	0.247 97	0.278 99	0.261 96	0.677 99	0.183 98	0.117 90	0.212 98	0.145 99	0.364 94	0.346 100	0.232 100	0.548 96	0.523 99	0.252 98
Charles R. Qi, Li Yi, Hao Su, Leonidas J. Guibas: pointnet++: deep hierarchical feature learning on point sets in a metric space.
SSC-UNet	0.308 99	0.353 98	0.290 100	0.278 100	0.166 100	0.553 97	0.169 99	0.286 95	0.147 100	0.148 100	0.908 87	0.182 99	0.064 95	0.023 100	0.018 101	0.354 95	0.363 98	0.345 98	0.546 98	0.685 88	0.278 96

ScanNet	0.306 100	0.203 100	0.366 99	0.501 90	0.311 97	0.524 98	0.211 98	0.002 101	0.342 95	0.189 99	0.786 97	0.145 100	0.102 91	0.245 93	0.152 98	0.318 98	0.348 99	0.300 99	0.460 99	0.437 100	0.182 100
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner: ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes. CVPR'17
ERROR	0.054 101	0.000 101	0.041 101	0.172 101	0.030 101	0.062 101	0.001 101	0.035 100	0.004 101	0.051 101	0.143 101	0.019 101	0.003 99	0.041 99	0.050 100	0.003 101	0.054 101	0.018 101	0.005 101	0.264 101	0.082 101

This table lists the benchmark results for the 3D semantic instance scenario.

Method	avg ap 25%	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	window

TD3D	0.875 1	1.000 1	0.976 12	0.877 9	0.783 14	0.970 1	0.889 1	0.828 12	0.945 3	0.803 6	0.713 10	0.720 10	0.709 8	1.000 1	0.936 6	0.934 3	0.873 7	1.000 1	0.791 5

Queryformer	0.874 2	1.000 1	0.978 10	0.809 24	0.876 1	0.936 5	0.702 8	0.716 26	0.920 5	0.875 3	0.766 4	0.772 2	0.818 4	1.000 1	0.995 1	0.916 4	0.892 1	1.000 1	0.767 8

SoftGroup++	0.874 2	1.000 1	0.972 13	0.947 1	0.839 5	0.898 12	0.556 23	0.913 2	0.881 11	0.756 8	0.828 2	0.748 6	0.821 2	1.000 1	0.937 5	0.937 1	0.887 2	1.000 1	0.821 2

Mask3D	0.870 4	1.000 1	0.985 6	0.782 32	0.818 8	0.938 4	0.760 4	0.749 23	0.923 4	0.877 2	0.760 5	0.785 1	0.820 3	1.000 1	0.912 9	0.864 23	0.878 5	0.983 39	0.825 1
Jonas Schult, Francis Engelmann, Alexander Hermans, Or Litany, Siyu Tang, Bastian Leibe: Mask3D for 3D Semantic Instance Segmentation. ICRA 2023
SoftGroup	0.865 5	1.000 1	0.969 14	0.860 12	0.860 2	0.913 8	0.558 21	0.899 3	0.911 6	0.760 7	0.828 1	0.736 7	0.802 6	0.981 29	0.919 8	0.875 14	0.877 6	1.000 1	0.820 3
Thang Vu, Kookhoi Kim, Tung M. Luu, Xuan Thanh Nguyen, Chang D. Yoo: SoftGroup for 3D Instance Segmentaiton on Point Clouds. CVPR 2022 [Oral]
IPCA-Inst	0.851 6	1.000 1	0.968 15	0.884 8	0.842 4	0.862 24	0.693 10	0.812 17	0.888 9	0.677 20	0.783 3	0.698 11	0.807 5	1.000 1	0.911 13	0.865 22	0.865 9	1.000 1	0.757 10

SPFormer	0.851 6	1.000 1	0.994 2	0.806 25	0.774 16	0.942 3	0.637 13	0.849 10	0.859 14	0.889 1	0.720 8	0.730 8	0.665 13	1.000 1	0.911 13	0.868 21	0.873 8	1.000 1	0.796 4
Sun Jiahao, Qing Chunmei, Tan Junpeng, Xu Xiangmin: Superpoint Transformer for 3D Scene Instance Segmentation. AAAI 2023 [Oral]
ISBNet	0.845 8	1.000 1	0.976 11	0.798 26	0.794 11	0.916 6	0.757 5	0.667 33	0.882 10	0.842 4	0.715 9	0.757 4	0.832 1	1.000 1	0.905 16	0.803 43	0.843 12	1.000 1	0.715 17
Tuan Duc Ngo, Binh-Son Hua, Khoi Nguyen: ISBNet: a 3D Point Cloud Instance Segmentation Network with Instance-aware Sampling and Box-aware Dynamic Convolution. CVPR 2023
SphereSeg	0.835 9	1.000 1	0.963 18	0.891 6	0.794 10	0.954 2	0.822 3	0.710 27	0.961 2	0.721 12	0.693 16	0.530 31	0.653 15	1.000 1	0.867 23	0.857 26	0.859 10	0.991 36	0.771 7

TopoSeg	0.832 10	1.000 1	0.981 8	0.933 2	0.819 7	0.826 32	0.524 29	0.841 11	0.811 19	0.681 19	0.759 6	0.687 12	0.727 7	0.981 29	0.911 13	0.883 10	0.853 11	1.000 1	0.756 11

GraphCut	0.832 10	1.000 1	0.922 32	0.724 41	0.798 9	0.902 11	0.701 9	0.856 8	0.859 13	0.715 13	0.706 11	0.748 5	0.640 26	1.000 1	0.934 7	0.862 24	0.880 3	1.000 1	0.729 13

PBNet	0.825 12	1.000 1	0.963 17	0.837 16	0.843 3	0.865 19	0.822 2	0.647 35	0.878 12	0.733 10	0.639 24	0.683 13	0.650 16	1.000 1	0.853 24	0.870 18	0.820 13	1.000 1	0.744 12

SSEC	0.820 13	1.000 1	0.983 7	0.924 3	0.826 6	0.817 35	0.415 38	0.899 4	0.793 23	0.673 21	0.731 7	0.636 18	0.653 14	1.000 1	0.939 4	0.804 41	0.878 4	1.000 1	0.780 6

DKNet	0.815 14	1.000 1	0.930 24	0.844 14	0.765 20	0.915 7	0.534 27	0.805 19	0.805 21	0.807 5	0.654 18	0.763 3	0.650 16	1.000 1	0.794 36	0.881 11	0.766 17	1.000 1	0.758 9
Yizheng Wu, Min Shi, Shuaiyuan Du, Hao Lu, Zhiguo Cao, Weicai Zhong: 3D Instances as 1D Kernels. ECCV 2022
RPGN	0.806 15	1.000 1	0.992 4	0.789 28	0.723 32	0.891 13	0.650 12	0.810 18	0.832 16	0.665 23	0.699 14	0.658 14	0.700 9	1.000 1	0.881 18	0.832 33	0.774 15	0.997 29	0.613 34
Shichao Dong, Guosheng Lin, Tzu-Yi Hung: Learning Regional Purity for Instance Segmentation on 3D Point Clouds. ECCV 2022
HAIS	0.803 16	1.000 1	0.994 2	0.820 20	0.759 21	0.855 25	0.554 24	0.882 5	0.827 18	0.615 29	0.676 17	0.638 17	0.646 24	1.000 1	0.912 9	0.797 45	0.767 16	0.994 34	0.726 14
Shaoyu Chen, Jiemin Fang, Qian Zhang, Wenyu Liu, Xinggang Wang: Hierarchical Aggregation for 3D Instance Segmentation. ICCV 2021
Box2Mask	0.803 16	1.000 1	0.962 19	0.874 10	0.707 35	0.887 16	0.686 11	0.598 39	0.961 1	0.715 14	0.694 15	0.469 36	0.700 9	1.000 1	0.912 9	0.902 5	0.753 22	0.997 29	0.637 28
Julian Chibane, Francis Engelmann, Tuan Anh Tran, Gerard Pons-Moll: Box2Mask: Weakly Supervised 3D Semantic Instance Segmentation Using Bounding Boxes. ECCV 2022
Mask-Group	0.792 18	1.000 1	0.968 16	0.812 21	0.766 19	0.864 20	0.460 32	0.815 16	0.888 8	0.598 32	0.651 21	0.639 16	0.600 30	0.918 33	0.941 2	0.896 6	0.721 29	1.000 1	0.723 15
Min Zhong, Xinghao Chen, Xiaokang Chen, Gang Zeng, Yunhe Wang: MaskGroup: Hierarchical Point Grouping and Masking for 3D Instance Segmentation. ICME 2022
CSC-Pretrained	0.791 19	1.000 1	0.996 1	0.829 19	0.767 18	0.889 15	0.600 16	0.819 15	0.770 28	0.594 33	0.620 27	0.541 28	0.700 9	1.000 1	0.941 2	0.889 8	0.763 18	1.000 1	0.526 43

SSTNet	0.789 20	1.000 1	0.840 46	0.888 7	0.717 33	0.835 28	0.717 7	0.684 32	0.627 42	0.724 11	0.652 20	0.727 9	0.600 30	1.000 1	0.912 9	0.822 36	0.757 21	1.000 1	0.691 22
Zhihao Liang, Zhihao Li, Songcen Xu, Mingkui Tan, Kui Jia: Instance Segmentation in 3D Scenes using Semantic Superpoint Tree Networks. ICCV2021
GICN	0.788 21	1.000 1	0.978 9	0.867 11	0.781 15	0.833 29	0.527 28	0.824 13	0.806 20	0.549 41	0.596 30	0.551 24	0.700 9	1.000 1	0.853 24	0.935 2	0.733 26	1.000 1	0.651 25

DENet	0.786 22	1.000 1	0.929 25	0.736 39	0.750 27	0.720 47	0.755 6	0.934 1	0.794 22	0.590 34	0.561 36	0.537 29	0.650 16	1.000 1	0.882 17	0.804 42	0.789 14	1.000 1	0.719 16

DualGroup	0.782 23	1.000 1	0.927 26	0.811 22	0.772 17	0.853 26	0.631 15	0.805 19	0.773 25	0.613 30	0.611 28	0.610 20	0.650 16	0.835 44	0.881 18	0.879 13	0.750 24	1.000 1	0.675 23

PointGroup	0.778 24	1.000 1	0.900 36	0.798 27	0.715 34	0.863 21	0.493 30	0.706 28	0.895 7	0.569 39	0.701 12	0.576 22	0.639 27	1.000 1	0.880 20	0.851 28	0.719 30	0.997 29	0.709 19
Li Jiang, Hengshuang Zhao, Shaoshuai Shi, Shu Liu, Chi-Wing Fu, Jiaya Jia: PointGroup: Dual-Set Point Grouping for 3D Instance Segmentation. CVPR 2020 [oral]
PE	0.776 25	1.000 1	0.900 37	0.860 12	0.728 31	0.869 17	0.400 39	0.857 7	0.774 24	0.568 40	0.701 13	0.602 21	0.646 24	0.933 32	0.843 27	0.890 7	0.691 37	0.997 29	0.709 18
Biao Zhang, Peter Wonka: Point Cloud Instance Segmentation using Probabilistic Embeddings. CVPR 2021
AOIA	0.767 26	1.000 1	0.937 21	0.810 23	0.740 29	0.906 9	0.550 25	0.800 21	0.706 34	0.577 38	0.624 26	0.544 27	0.596 35	0.857 36	0.879 22	0.880 12	0.750 23	0.992 35	0.658 24

DD-UNet+Group	0.764 27	1.000 1	0.897 39	0.837 15	0.753 24	0.830 31	0.459 34	0.824 13	0.699 36	0.629 27	0.653 19	0.438 39	0.650 16	1.000 1	0.880 20	0.858 25	0.690 38	1.000 1	0.650 26
H. Liu, R. Liu, K. Yang, J. Zhang, K. Peng, R. Stiefelhagen: HIDA: Towards Holistic Indoor Understanding for the Visually Impaired via Semantic Instance Segmentation with a Wearable Solid-State LiDAR Sensor. ICCVW 2021
INS-Conv-instance	0.762 28	1.000 1	0.923 29	0.765 35	0.785 13	0.905 10	0.600 16	0.655 34	0.646 41	0.683 18	0.647 22	0.530 30	0.650 16	1.000 1	0.824 29	0.830 34	0.693 36	0.944 43	0.644 27

Dyco3D	0.761 29	1.000 1	0.935 22	0.893 5	0.752 26	0.863 22	0.600 16	0.588 40	0.742 31	0.641 25	0.633 25	0.546 26	0.550 37	0.857 36	0.789 38	0.853 27	0.762 19	0.987 37	0.699 20
Tong He; Chunhua Shen; Anton van den Hengel: DyCo3D: Robust Instance Segmentation of 3D Point Clouds through Dynamic Convolution. CVPR2021
OccuSeg+instance	0.742 30	1.000 1	0.923 29	0.785 29	0.745 28	0.867 18	0.557 22	0.578 43	0.729 32	0.670 22	0.644 23	0.488 34	0.577 36	1.000 1	0.794 36	0.830 34	0.620 45	1.000 1	0.550 39
Lei Han, Tian Zheng, Lan Xu, Lu Fang: OccuSeg: Occupancy-aware 3D Instance Segmentation. CVPR2020
RWSeg	0.739 31	1.000 1	0.899 38	0.759 37	0.753 25	0.823 33	0.282 43	0.691 31	0.658 39	0.582 37	0.594 31	0.547 25	0.628 28	1.000 1	0.795 35	0.868 20	0.728 28	1.000 1	0.692 21

3D-MPA	0.737 32	1.000 1	0.933 23	0.785 29	0.794 12	0.831 30	0.279 45	0.588 40	0.695 37	0.616 28	0.559 37	0.556 23	0.650 16	1.000 1	0.809 33	0.875 15	0.696 34	1.000 1	0.608 36
Francis Engelmann, Martin Bokeloh, Alireza Fathi, Bastian Leibe, Matthias Nießner: 3D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentation. CVPR 2020
MTML	0.731 33	1.000 1	0.992 4	0.779 34	0.609 44	0.746 42	0.308 42	0.867 6	0.601 45	0.607 31	0.539 40	0.519 32	0.550 37	1.000 1	0.824 29	0.869 19	0.729 27	1.000 1	0.616 32
Jean Lahoud, Bernard Ghanem, Marc Pollefeys, Martin R. Oswald: 3D Instance Segmentation via Multi-task Metric Learning. ICCV 2019 [oral]
OSIS	0.725 34	1.000 1	0.885 42	0.653 47	0.657 41	0.801 36	0.576 20	0.695 30	0.828 17	0.698 16	0.534 41	0.457 38	0.500 44	0.857 36	0.831 28	0.841 31	0.627 44	1.000 1	0.619 31

SSEN	0.724 35	1.000 1	0.926 27	0.781 33	0.661 39	0.845 27	0.596 19	0.529 45	0.764 30	0.653 24	0.489 46	0.461 37	0.500 44	0.859 35	0.765 39	0.872 17	0.761 20	1.000 1	0.577 37
Dongsu Zhang, Junha Chun, Sang Kyun Cha, Young Min Kim: Spatial Semantic Embedding Network: Fast 3D Instance Segmentation with Deep Metric Learning. Arxiv
NeuralBF	0.718 36	1.000 1	0.945 20	0.901 4	0.754 23	0.817 34	0.460 32	0.700 29	0.772 26	0.688 17	0.568 35	0.000 56	0.500 44	0.981 29	0.606 47	0.872 16	0.740 25	1.000 1	0.614 33
Weiwei Sun, Daniel Rebain, Renjie Liao, Vladimir Tankovich, Soroosh Yazdani, Kwang Moo Yi, Andrea Tagliasacchi: NeuralBF: Neural Bilateral Filtering for Top-down Instance Segmentation on Point Clouds. WACV 2023
Sparse R-CNN	0.714 37	1.000 1	0.926 28	0.694 42	0.699 37	0.890 14	0.636 14	0.516 46	0.693 38	0.743 9	0.588 32	0.369 42	0.601 29	0.594 49	0.800 34	0.886 9	0.676 39	0.986 38	0.546 40

SALoss-ResNet	0.695 38	1.000 1	0.855 44	0.579 51	0.589 46	0.735 45	0.484 31	0.588 40	0.856 15	0.634 26	0.571 34	0.298 43	0.500 44	1.000 1	0.824 29	0.818 37	0.702 33	0.935 47	0.545 41
Zhidong Liang, Ming Yang, Hao Li, Chunxiang Wang: 3D Instance Embedding Learning With a Structure-Aware Loss Function for Point Cloud Segmentation. IEEE Robotics and Automation Letters (IROS2020)
PanopticFusion-inst	0.693 39	1.000 1	0.852 45	0.655 46	0.616 43	0.788 37	0.334 41	0.763 22	0.771 27	0.457 51	0.555 38	0.652 15	0.518 41	0.857 36	0.765 39	0.732 51	0.631 42	0.944 43	0.577 38
Gaku Narita, Takashi Seno, Tomoya Ishikawa, Yohsuke Kaji: PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Things. IROS 2019 (to appear)
Occipital-SCS	0.688 40	1.000 1	0.913 33	0.730 40	0.737 30	0.743 44	0.442 35	0.855 9	0.655 40	0.546 42	0.546 39	0.263 45	0.508 43	0.889 34	0.568 48	0.771 48	0.705 32	0.889 50	0.625 30

3D-BoNet	0.687 41	1.000 1	0.887 41	0.836 17	0.587 47	0.643 54	0.550 25	0.620 36	0.724 33	0.522 46	0.501 44	0.243 46	0.512 42	1.000 1	0.751 41	0.807 40	0.661 41	0.909 49	0.612 35
Bo Yang, Jianan Wang, Ronald Clark, Qingyong Hu, Sen Wang, Andrew Markham, Niki Trigoni: Learning Object Bounding Boxes for 3D Instance Segmentation on Point Clouds. NeurIPS 2019 Spotlight
PCJC	0.684 42	1.000 1	0.895 40	0.757 38	0.659 40	0.862 23	0.189 52	0.739 24	0.606 44	0.712 15	0.581 33	0.515 33	0.650 16	0.857 36	0.357 53	0.785 46	0.631 43	0.889 50	0.635 29

SPG_WSIS	0.678 43	1.000 1	0.880 43	0.836 17	0.701 36	0.727 46	0.273 47	0.607 38	0.706 35	0.541 44	0.515 43	0.174 48	0.600 30	0.857 36	0.716 42	0.846 30	0.711 31	1.000 1	0.506 44

One_Thing_One_Click	0.675 44	1.000 1	0.823 47	0.782 31	0.621 42	0.766 39	0.211 49	0.736 25	0.560 48	0.586 35	0.522 42	0.636 19	0.453 48	0.641 48	0.853 24	0.850 29	0.694 35	0.997 29	0.411 48
Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu: One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation. CVPR 2021
SegGroup_ins	0.637 45	1.000 1	0.923 31	0.593 50	0.561 48	0.746 43	0.143 54	0.504 47	0.766 29	0.485 49	0.442 47	0.372 41	0.530 40	0.714 45	0.815 32	0.775 47	0.673 40	1.000 1	0.431 47
An Tao, Yueqi Duan, Yi Wei, Jiwen Lu, Jie Zhou: SegGroup: Seg-Level Supervision for 3D Instance and Semantic Segmentation. TIP 2022
MASC	0.615 46	0.711 52	0.802 48	0.540 52	0.757 22	0.777 38	0.029 55	0.577 44	0.588 47	0.521 47	0.600 29	0.436 40	0.534 39	0.697 46	0.616 46	0.838 32	0.526 47	0.980 40	0.534 42
Chen Liu, Yasutaka Furukawa: MASC: Multi-scale Affinity with Sparse Convolution for 3D Instance Segmentation.
UNet-backbone	0.605 47	1.000 1	0.909 34	0.764 36	0.603 45	0.704 48	0.415 37	0.301 52	0.548 49	0.461 50	0.394 48	0.267 44	0.386 50	0.857 36	0.649 45	0.817 38	0.504 48	0.959 41	0.356 51

3D-SIS	0.558 48	1.000 1	0.773 49	0.614 49	0.503 50	0.691 50	0.200 50	0.412 48	0.498 52	0.546 43	0.311 53	0.103 52	0.600 30	0.857 36	0.382 50	0.799 44	0.445 54	0.938 46	0.371 49
Ji Hou, Angela Dai, Matthias Niessner: 3D-SIS: 3D Semantic Instance Segmentation of RGB-D Scans. CVPR 2019
R-PointNet	0.544 49	0.500 55	0.655 55	0.661 45	0.663 38	0.765 40	0.432 36	0.214 54	0.612 43	0.584 36	0.499 45	0.204 47	0.286 54	0.429 52	0.655 44	0.650 56	0.539 46	0.950 42	0.499 45

Hier3D	0.540 50	1.000 1	0.727 50	0.626 48	0.467 53	0.693 49	0.200 50	0.412 48	0.480 53	0.528 45	0.318 52	0.077 55	0.600 30	0.688 47	0.382 50	0.768 49	0.472 50	0.941 45	0.350 52
Tan: HCFS3D: Hierarchical Coupled Feature Selection Network for 3D Semantic and Instance Segmentation.
Region-18class	0.497 51	0.250 57	0.902 35	0.689 43	0.540 49	0.747 41	0.276 46	0.610 37	0.268 56	0.489 48	0.348 49	0.000 56	0.243 56	0.220 55	0.663 43	0.814 39	0.459 52	0.928 48	0.496 46

tmp	0.474 52	1.000 1	0.727 50	0.433 55	0.481 52	0.673 52	0.022 57	0.380 50	0.517 51	0.436 53	0.338 51	0.128 50	0.343 52	0.429 52	0.291 55	0.728 52	0.473 49	0.833 53	0.300 54

SemRegionNet-20cls	0.470 53	1.000 1	0.727 50	0.447 54	0.481 51	0.678 51	0.024 56	0.380 50	0.518 50	0.440 52	0.339 50	0.128 50	0.350 51	0.429 52	0.212 56	0.711 53	0.465 51	0.833 53	0.290 55

ASIS	0.422 54	0.333 56	0.707 53	0.676 44	0.401 54	0.650 53	0.350 40	0.177 55	0.594 46	0.376 54	0.202 54	0.077 54	0.404 49	0.571 50	0.197 57	0.674 55	0.447 53	0.500 56	0.260 56

3D-BEVIS	0.401 55	0.667 53	0.687 54	0.419 56	0.137 57	0.587 55	0.188 53	0.235 53	0.359 55	0.211 56	0.093 57	0.080 53	0.311 53	0.571 50	0.382 50	0.754 50	0.300 56	0.874 52	0.357 50
Cathrin Elich, Francis Engelmann, Jonas Schult, Theodora Kontogianni, Bastian Leibe: 3D-BEVIS: Birds-Eye-View Instance Segmentation.
Sgpn_scannet	0.390 56	0.556 54	0.636 56	0.493 53	0.353 55	0.539 56	0.271 48	0.160 56	0.450 54	0.359 55	0.178 55	0.146 49	0.250 55	0.143 56	0.347 54	0.698 54	0.436 55	0.667 55	0.331 53

MaskRCNN 2d->3d Proj	0.261 57	0.903 51	0.081 57	0.008 57	0.233 56	0.175 57	0.280 44	0.106 57	0.150 57	0.203 57	0.175 56	0.480 35	0.218 57	0.143 56	0.542 49	0.404 57	0.153 57	0.393 57	0.049 57

Method	avg iou	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	floor	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	wall	window

Virtual MVFusion (R)	0.745 1	0.861 1	0.839 1	0.881 1	0.672 1	0.512 1	0.422 15	0.898 1	0.723 1	0.714 1	0.954 2	0.454 1	0.509 1	0.773 1	0.895 1	0.756 1	0.820 1	0.653 1	0.935 1	0.891 1	0.728 1
Abhijit Kundu, Xiaoqi Yin, Alireza Fathi, David Ross, Brian Brewington, Thomas Funkhouser, Caroline Pantofaru: Virtual Multi-view Fusion for 3D Semantic Segmentation. ECCV 2020
BPNet_2D	0.670 2	0.822 3	0.795 3	0.836 2	0.659 2	0.481 2	0.451 11	0.769 3	0.656 3	0.567 3	0.931 3	0.395 4	0.390 4	0.700 3	0.534 3	0.689 9	0.770 2	0.574 3	0.865 6	0.831 3	0.675 4
Wenbo Hu, Hengshuang Zhao, Li Jiang, Jiaya Jia and Tien-Tsin Wong: Bidirectional Projection Network for Cross Dimension Scene Understanding. CVPR 2021 (Oral)
CU-Hybrid-2D Net	0.636 3	0.825 2	0.820 2	0.179 20	0.648 3	0.463 3	0.549 2	0.742 6	0.676 2	0.628 2	0.961 1	0.420 2	0.379 5	0.684 6	0.381 15	0.732 2	0.723 3	0.599 2	0.827 13	0.851 2	0.634 6

CMX	0.613 4	0.681 7	0.725 9	0.502 12	0.634 5	0.297 15	0.478 9	0.830 2	0.651 4	0.537 6	0.924 4	0.375 5	0.315 12	0.686 5	0.451 12	0.714 4	0.543 18	0.504 5	0.894 4	0.823 4	0.688 3

DMMF_3d	0.605 5	0.651 8	0.744 7	0.782 3	0.637 4	0.387 4	0.536 3	0.732 7	0.590 6	0.540 5	0.856 18	0.359 9	0.306 13	0.596 11	0.539 2	0.627 18	0.706 4	0.497 7	0.785 18	0.757 16	0.476 19

MCA-Net	0.595 6	0.533 17	0.756 6	0.746 4	0.590 8	0.334 7	0.506 6	0.670 12	0.587 7	0.500 10	0.905 8	0.366 8	0.352 8	0.601 10	0.506 6	0.669 15	0.648 7	0.501 6	0.839 12	0.769 12	0.516 18

RFBNet	0.592 7	0.616 9	0.758 5	0.659 5	0.581 9	0.330 8	0.469 10	0.655 15	0.543 12	0.524 7	0.924 4	0.355 10	0.336 10	0.572 14	0.479 8	0.671 13	0.648 7	0.480 9	0.814 16	0.814 5	0.614 9

FAN_NV_RVC	0.586 8	0.510 18	0.764 4	0.079 23	0.620 7	0.330 8	0.494 7	0.753 4	0.573 8	0.556 4	0.884 13	0.405 3	0.303 14	0.718 2	0.452 11	0.672 12	0.658 5	0.509 4	0.898 3	0.813 6	0.727 2

DCRedNet	0.583 9	0.682 6	0.723 10	0.542 11	0.510 17	0.310 12	0.451 11	0.668 13	0.549 11	0.520 8	0.920 6	0.375 5	0.446 2	0.528 17	0.417 13	0.670 14	0.577 15	0.478 10	0.862 7	0.806 7	0.628 8

MIX6D_RVC	0.582 10	0.695 4	0.687 14	0.225 18	0.632 6	0.328 10	0.550 1	0.748 5	0.623 5	0.494 13	0.890 11	0.350 12	0.254 20	0.688 4	0.454 10	0.716 3	0.597 14	0.489 8	0.881 5	0.768 13	0.575 12

SSMA	0.577 11	0.695 4	0.716 12	0.439 14	0.563 11	0.314 11	0.444 13	0.719 8	0.551 10	0.503 9	0.887 12	0.346 13	0.348 9	0.603 9	0.353 17	0.709 5	0.600 12	0.457 12	0.901 2	0.786 8	0.599 11
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. International Journal of Computer Vision, 2019
UNIV_CNP_RVC_UE	0.566 12	0.569 16	0.686 16	0.435 15	0.524 14	0.294 16	0.421 16	0.712 9	0.543 12	0.463 15	0.872 14	0.320 14	0.363 7	0.611 8	0.477 9	0.686 10	0.627 9	0.443 15	0.862 7	0.775 11	0.639 5

EMSAFormer	0.564 13	0.581 13	0.736 8	0.564 10	0.546 13	0.219 20	0.517 4	0.675 11	0.486 17	0.427 19	0.904 9	0.352 11	0.320 11	0.589 12	0.528 4	0.708 6	0.464 21	0.413 19	0.847 11	0.786 8	0.611 10

SN_RN152pyrx8_RVC	0.546 14	0.572 14	0.663 18	0.638 7	0.518 15	0.298 14	0.366 21	0.633 18	0.510 15	0.446 17	0.864 16	0.296 17	0.267 17	0.542 16	0.346 18	0.704 7	0.575 16	0.431 16	0.853 10	0.766 14	0.630 7

UDSSEG_RVC	0.545 15	0.610 11	0.661 19	0.588 8	0.556 12	0.268 18	0.482 8	0.642 17	0.572 9	0.475 14	0.836 20	0.312 15	0.367 6	0.630 7	0.189 20	0.639 17	0.495 20	0.452 13	0.826 14	0.756 17	0.541 14

segfomer with 6d	0.542 16	0.594 12	0.687 14	0.146 21	0.579 10	0.308 13	0.515 5	0.703 10	0.472 18	0.498 11	0.868 15	0.369 7	0.282 15	0.589 12	0.390 14	0.701 8	0.556 17	0.416 18	0.860 9	0.759 15	0.539 16

FuseNet	0.535 17	0.570 15	0.681 17	0.182 19	0.512 16	0.290 17	0.431 14	0.659 14	0.504 16	0.495 12	0.903 10	0.308 16	0.428 3	0.523 18	0.365 16	0.676 11	0.621 11	0.470 11	0.762 19	0.779 10	0.541 14
Caner Hazirbas, Lingni Ma, Csaba Domokos, Daniel Cremers: FuseNet: Incorporating Depth into Semantic Segmentation via Fusion-based CNN Architecture. ACCV 2016
AdapNet++	0.503 18	0.613 10	0.722 11	0.418 16	0.358 23	0.337 6	0.370 20	0.479 21	0.443 19	0.368 21	0.907 7	0.207 20	0.213 22	0.464 21	0.525 5	0.618 19	0.657 6	0.450 14	0.788 17	0.721 20	0.408 22
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. International Journal of Computer Vision, 2019
3DMV (2d proj)	0.498 19	0.481 21	0.612 20	0.579 9	0.456 19	0.343 5	0.384 18	0.623 19	0.525 14	0.381 20	0.845 19	0.254 19	0.264 19	0.557 15	0.182 21	0.581 21	0.598 13	0.429 17	0.760 20	0.661 22	0.446 21
Angela Dai, Matthias Niessner: 3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation. ECCV'18
MSeg1080_RVC	0.485 20	0.505 19	0.709 13	0.092 22	0.427 20	0.241 19	0.411 17	0.654 16	0.385 23	0.457 16	0.861 17	0.053 23	0.279 16	0.503 19	0.481 7	0.645 16	0.626 10	0.365 21	0.748 21	0.725 19	0.529 17
John Lambert, Zhuang Liu, Ozan Sener, James Hays, Vladlen Koltun: MSeg: A Composite Dataset for Multi-domain Semantic Segmentation. CVPR 2020
ILC-PSPNet	0.475 21	0.490 20	0.581 21	0.289 17	0.507 18	0.067 23	0.379 19	0.610 20	0.417 21	0.435 18	0.822 22	0.278 18	0.267 17	0.503 19	0.228 19	0.616 20	0.533 19	0.375 20	0.820 15	0.729 18	0.560 13

Enet (reimpl)	0.376 22	0.264 23	0.452 23	0.452 13	0.365 21	0.181 21	0.143 23	0.456 22	0.409 22	0.346 22	0.769 23	0.164 21	0.218 21	0.359 22	0.123 23	0.403 23	0.381 23	0.313 23	0.571 22	0.685 21	0.472 20
Re-implementation of Adam Paszke, Abhishek Chaurasia, Sangpil Kim, Eugenio Culurciello: ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation.
ScanNet (2d proj)	0.330 23	0.293 22	0.521 22	0.657 6	0.361 22	0.161 22	0.250 22	0.004 23	0.440 20	0.183 23	0.836 20	0.125 22	0.060 23	0.319 23	0.132 22	0.417 22	0.412 22	0.344 22	0.541 23	0.427 23	0.109 23
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner: ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes. CVPR'17
DMMF	0.003 24	0.000 24	0.005 24	0.000 24	0.000 24	0.037 24	0.001 24	0.000 24	0.001 24	0.005 24	0.003 24	0.000 24	0.000 24	0.000 24	0.000 24	0.000 24	0.002 24	0.001 24	0.000 24	0.006 24	0.000 24

Method	avg ap	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	window

UniDet_RVC	0.205 1	0.381 1	0.323 1	0.037 1	0.226 1	0.177 1	0.063 1	0.277 1	0.120 1	0.067 1	0.131 1	0.074 2	0.317 1	0.080 1	0.235 1	0.289 1	0.141 1	0.678 1	0.080 1

MaskRCNN_ScanNet	0.119 2	0.129 2	0.212 2	0.002 2	0.112 2	0.148 2	0.014 2	0.205 2	0.044 2	0.066 2	0.078 2	0.095 1	0.142 2	0.030 2	0.128 2	0.139 2	0.080 2	0.459 2	0.057 2
Re-implementation of Kaiming He, Georgia Gkioxari, Piotr Dollár, Ross Girshick: Mask R-CNN. ICCV'17

Presenting the ScanNet200 Benchmark

ScanNet200 Benchmark

ScanNet200 3D Semantic Label Benchmark

ScanNet200 3D Semantic Instance Benchmark

ScanNet Benchmark

3D Semantic Label Benchmark

3D Semantic Instance Benchmark

2D Semantic Label Benchmark

2D Semantic Instance Benchmark

Scene Type Classification Benchmark

Method	avg recall	apartment	bathroom	bedroom / hotel	bookstore / library	conference room	copy/mail room	hallway	kitchen	laundry room	living room / lounge	misc	office	storage / basement / garage

multi-task	0.700 1	0.500 1	1.000 1	0.882 2	0.500 2	1.000 1	1.000 1	0.500 2	1.000 1	1.000 1	0.778 1	0.000 2	0.938 1	0.000 2
Shengyu Huang, Mikhail Usvyatsov, Konrad Schindler: Indoor Scene Recognition in 3D. IROS 2020
3DASPP-SCE	0.691 2	0.500 1	0.938 2	0.824 3	1.000 1	1.000 1	0.500 2	1.000 1	0.857 2	0.500 2	0.556 3	0.000 2	0.812 2	0.500 1

SE-ResNeXt-SSMA	0.498 3	0.000 4	0.812 3	0.941 1	0.500 2	0.500 3	0.500 2	0.500 2	0.429 4	0.500 2	0.667 2	0.500 1	0.625 3	0.000 2
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. arXiv
resnet50_scannet	0.353 4	0.250 3	0.812 3	0.529 4	0.500 2	0.500 3	0.000 4	0.500 2	0.571 3	0.000 4	0.556 3	0.000 2	0.375 4	0.000 2