Benchmark Results - ScanNet Benchmark

This table lists the benchmark results for the ScanNet200 3D semantic label scenario.

Method	avg iou	head iou	common iou	tail iou	wall	chair	floor	table	door	couch	cabinet	shelf	desk	office chair	bed	pillow	sink	picture	window	toilet	bookshelf	monitor	curtain	book	coffee table	box	refrigerator	lamp	kitchen cabinet	towel	clothes	tv	nightstand	counter	dresser	stool	cushion	plant	ceiling	bathtub	end table	dining table	keyboard	bag	backpack	toilet paper	printer	tv stand	whiteboard	blanket	shower curtain	trash can	closet	stairs	microwave	stove	shoe	computer tower	bottle	bin	bench	board	washing machine	mirror	copier	basket	sofa chair	file cabinet	fan	laptop	shower	paper	person	paper towel dispenser	oven	blinds	rack	plate	blackboard	piano	suitcase	radiator	recycling bin	wardrobe	soap dispenser	telephone	bucket	clock	stand	light	laundry basket	pipe	clothes dryer	seat	speaker	column	bicycle	ladder	bathroom stall	shower wall	cup	jacket	storage bin	coffee maker	dishwasher	paper towel roll	machine	mat	windowsill	bar	toaster	bulletin board	ironing board	kitchen counter	doorframe	toilet paper dispenser	mini fridge	fire extinguisher	ball	hat	shower curtain rod	water cooler	paper cutter	tray	ledge	mouse	cart	storage container	scale	tissue box	light switch	power outlet	decoration	sign	projector	vacuum cleaner	candle	plunger	stuffed animal	headphones	dish rack	broom	range hood	water bottle	vent	shower floor	water pitcher	mailbox	bowl	paper bag	music stand	projector screen	laundry detergent	object	bathroom vanity	laundry hamper	bathroom stall door	ceiling light	trash bin	dumbbell	stair rail	tube	bathroom cabinet	closet rod	coffee kettle	structure	shower head	keyboard piano	case of water bottles	coat rack	storage organizer	folded chair	fire alarm	power strip	calendar	poster

PPT-SpUNet-F.T.	0.332 3	0.556 2	0.270 1	0.123 5	0.816 2	0.682 2	0.946 1	0.549 3	0.657 3	0.756 1	0.459 3	0.376 4	0.550 3	0.001 7	0.807 1	0.616 1	0.727 3	0.267 2	0.691 2	0.942 4	0.530 4	0.872 3	0.874 2	0.330 3	0.542 5	0.374 3	0.792 2	0.400 5	0.673 1	0.572 2	0.433 1	0.793 3	0.623 2	0.008 8	0.351 3	0.594 5	0.000 1	0.783 4	0.876 1	0.833 2	0.213 2	0.000 5	0.537 2	0.091 2	0.519 1	0.304 2	0.620 4	0.942 1	0.264 1	0.124 3	0.855 1	0.695 1	0.086 3	0.646 3	0.506 7	0.658 2	0.535 2	0.715 2	0.314 1	0.000 3	0.241 1	0.608 2	0.897 1	0.359 3	0.858 3	0.000 1	0.076 8	0.611 4	0.392 3	0.509 3	0.378 2	0.000 1	0.579 1	0.565 7	0.000 4	0.000 4	0.000 1	0.000 3	0.755 3	0.806 4	0.661 1	0.572 6	0.350 4	0.181 4	0.660 3	0.300 5	0.000 3	0.000 3	0.000 1	0.023 5	0.000 2	0.042 7	0.930 1	0.000 1	0.000 6	0.077 4	0.584 2	0.392 3	0.339 6	0.185 3	0.171 4	0.308 1	0.006 7	0.563 3	0.256 3	0.150 1	0.000 3	0.002 7	0.345 6	0.000 1	0.045 5	0.197 1	0.063 3	0.323 5	0.453 1	0.600 3	0.163 5	0.037 6	0.349 2	0.000 1	0.672 1	0.679 1	0.753 1	0.000 1	0.000 5	0.000 3	0.117 1	0.000 4	0.000 3	0.291 5	0.000 3	0.000 2	0.039 1	0.000 1	0.000 1	0.899 2	0.000 1	0.374 5	0.000 1	0.000 4	0.545 2	0.000 1	0.634 1	0.000 1	0.000 1	0.074 5	0.223 3	0.914 3	0.000 4	0.021 2	0.000 1	0.000 4	0.000 1	0.112 3	0.498 5	0.649 1	0.383 5	0.095 1	0.135 7	0.449 5	0.432 4	0.008 3	0.000 1	0.518 2	0.000 1	0.000 2	0.000 4	0.796 1	0.000 2	0.000 1	0.000 1	0.138 5	0.000 2	0.000 2	0.000 3	0.000 1

OA-CNN-L_ScanNet200	0.333 2	0.558 1	0.269 2	0.124 4	0.821 1	0.703 1	0.946 1	0.569 1	0.662 1	0.748 2	0.487 1	0.455 1	0.572 2	0.000 8	0.789 2	0.534 3	0.736 2	0.271 1	0.713 1	0.949 1	0.498 7	0.877 2	0.860 3	0.332 2	0.706 1	0.474 1	0.788 3	0.406 4	0.637 2	0.495 3	0.355 4	0.805 2	0.592 6	0.015 7	0.396 1	0.602 4	0.000 1	0.799 2	0.876 1	0.713 8	0.276 1	0.000 5	0.493 4	0.080 4	0.448 6	0.363 1	0.661 2	0.833 2	0.262 2	0.125 2	0.823 4	0.665 3	0.076 4	0.720 1	0.557 3	0.637 4	0.517 4	0.672 6	0.227 4	0.000 3	0.158 4	0.496 3	0.843 5	0.352 4	0.835 5	0.000 1	0.103 6	0.711 1	0.527 1	0.526 2	0.320 3	0.000 1	0.568 2	0.625 3	0.067 1	0.000 4	0.000 1	0.001 2	0.806 2	0.836 2	0.621 3	0.591 3	0.373 3	0.314 2	0.668 2	0.398 2	0.003 2	0.000 3	0.000 1	0.016 8	0.024 1	0.043 6	0.906 2	0.000 1	0.052 3	0.000 7	0.384 3	0.330 5	0.342 5	0.100 4	0.223 2	0.183 4	0.112 3	0.476 4	0.313 2	0.130 5	0.196 2	0.112 3	0.370 5	0.000 1	0.234 3	0.071 4	0.160 1	0.403 2	0.398 5	0.492 7	0.197 1	0.076 5	0.272 3	0.000 1	0.200 8	0.560 2	0.735 3	0.000 1	0.000 5	0.000 3	0.110 2	0.002 3	0.021 2	0.412 3	0.000 3	0.000 2	0.000 4	0.000 1	0.000 1	0.794 4	0.000 1	0.445 1	0.000 1	0.022 2	0.509 3	0.000 1	0.517 7	0.000 1	0.000 1	0.001 8	0.245 2	0.915 2	0.024 2	0.089 1	0.000 1	0.262 1	0.000 1	0.103 6	0.524 2	0.392 4	0.515 2	0.013 8	0.251 3	0.411 6	0.662 1	0.001 5	0.000 1	0.473 4	0.000 1	0.000 2	0.150 3	0.699 3	0.000 2	0.000 1	0.000 1	0.166 2	0.000 2	0.024 1	0.000 3	0.000 1

OctFormer ScanNet200	0.326 4	0.539 4	0.265 3	0.131 3	0.806 3	0.670 4	0.943 3	0.535 4	0.662 1	0.705 7	0.423 4	0.407 3	0.505 5	0.003 6	0.765 4	0.582 2	0.686 6	0.227 7	0.680 3	0.943 3	0.601 1	0.854 5	0.892 1	0.335 1	0.417 8	0.357 4	0.724 5	0.453 3	0.632 3	0.596 1	0.432 2	0.783 4	0.512 8	0.021 6	0.244 6	0.637 1	0.000 1	0.787 3	0.873 3	0.743 6	0.000 8	0.000 5	0.534 3	0.110 1	0.499 2	0.289 3	0.626 3	0.620 6	0.168 8	0.204 1	0.849 2	0.679 2	0.117 1	0.633 4	0.684 1	0.650 3	0.552 1	0.684 5	0.312 2	0.000 3	0.175 3	0.429 4	0.865 2	0.413 1	0.837 4	0.000 1	0.145 3	0.626 3	0.451 2	0.487 4	0.513 1	0.000 1	0.529 3	0.613 4	0.000 4	0.033 2	0.000 1	0.000 3	0.828 1	0.871 1	0.622 2	0.587 4	0.411 2	0.137 6	0.645 5	0.343 3	0.000 3	0.000 3	0.000 1	0.022 6	0.000 2	0.026 8	0.829 5	0.000 1	0.022 4	0.089 3	0.842 1	0.253 7	0.318 8	0.296 1	0.178 3	0.291 2	0.224 1	0.584 2	0.200 6	0.132 4	0.000 3	0.128 2	0.227 7	0.000 1	0.230 4	0.047 5	0.149 2	0.331 4	0.412 3	0.618 2	0.164 4	0.102 4	0.522 1	0.000 1	0.655 2	0.378 4	0.469 6	0.000 1	0.000 5	0.000 3	0.105 3	0.000 4	0.000 3	0.483 2	0.000 3	0.000 2	0.028 2	0.000 1	0.000 1	0.906 1	0.000 1	0.339 6	0.000 1	0.000 4	0.457 4	0.000 1	0.612 3	0.000 1	0.000 1	0.408 1	0.000 7	0.900 4	0.000 4	0.000 3	0.000 1	0.029 3	0.000 1	0.074 8	0.455 6	0.479 2	0.427 4	0.079 6	0.140 6	0.496 3	0.414 5	0.022 1	0.000 1	0.471 5	0.000 1	0.000 2	0.000 4	0.722 2	0.000 2	0.000 1	0.000 1	0.138 5	0.000 2	0.000 2	0.000 3	0.000 1
Peng-Shuai Wang: OctFormer: Octree-based Transformers for 3D Point Clouds. SIGGRAPH 2023
CeCo	0.340 1	0.551 3	0.247 4	0.181 1	0.784 4	0.661 5	0.939 4	0.564 2	0.624 4	0.721 3	0.484 2	0.429 2	0.575 1	0.027 4	0.774 3	0.503 5	0.753 1	0.242 4	0.656 4	0.945 2	0.534 2	0.865 4	0.860 3	0.177 8	0.616 3	0.400 2	0.818 1	0.579 1	0.615 4	0.367 5	0.408 3	0.726 6	0.633 1	0.162 1	0.360 2	0.619 2	0.000 1	0.828 1	0.873 3	0.924 1	0.109 5	0.083 2	0.564 1	0.057 8	0.475 4	0.266 4	0.781 1	0.767 3	0.257 3	0.100 5	0.825 3	0.663 4	0.048 8	0.620 6	0.551 4	0.595 6	0.532 3	0.692 4	0.246 3	0.000 3	0.213 2	0.615 1	0.861 4	0.376 2	0.900 1	0.000 1	0.102 7	0.660 2	0.321 6	0.547 1	0.226 4	0.000 1	0.311 4	0.742 1	0.011 3	0.006 3	0.000 1	0.000 3	0.546 8	0.824 3	0.345 5	0.665 1	0.450 1	0.435 1	0.683 1	0.411 1	0.338 1	0.000 3	0.000 1	0.030 4	0.000 2	0.068 4	0.892 3	0.000 1	0.063 2	0.000 7	0.257 4	0.304 6	0.387 3	0.079 6	0.228 1	0.190 3	0.000 8	0.586 1	0.347 1	0.133 3	0.000 3	0.037 4	0.377 4	0.000 1	0.384 2	0.006 7	0.003 5	0.421 1	0.410 4	0.643 1	0.171 3	0.121 2	0.142 7	0.000 1	0.510 6	0.447 3	0.474 5	0.000 1	0.000 5	0.286 1	0.083 4	0.000 4	0.000 3	0.603 1	0.096 1	0.063 1	0.000 4	0.000 1	0.000 1	0.898 3	0.000 1	0.429 2	0.000 1	0.400 1	0.550 1	0.000 1	0.633 2	0.000 1	0.000 1	0.377 2	0.000 7	0.916 1	0.000 4	0.000 3	0.000 1	0.000 4	0.000 1	0.102 7	0.499 4	0.296 5	0.463 3	0.089 4	0.304 1	0.740 1	0.401 7	0.010 2	0.000 1	0.560 1	0.000 1	0.000 2	0.709 1	0.652 4	0.000 2	0.000 1	0.000 1	0.143 3	0.000 2	0.000 2	0.609 1	0.000 1
: Understanding Imbalanced Semantic Segmentation Through Neural Collapse.
LGround	0.272 6	0.485 6	0.184 6	0.106 6	0.778 6	0.676 3	0.932 6	0.479 8	0.572 6	0.718 5	0.399 5	0.265 6	0.453 7	0.085 2	0.745 6	0.446 6	0.726 4	0.232 6	0.622 6	0.901 6	0.512 5	0.826 6	0.786 7	0.178 7	0.549 4	0.277 6	0.659 6	0.381 6	0.518 5	0.295 8	0.323 5	0.777 5	0.599 4	0.028 4	0.321 4	0.363 7	0.000 1	0.708 6	0.858 6	0.746 5	0.063 6	0.022 3	0.457 6	0.077 5	0.476 3	0.243 6	0.402 5	0.397 8	0.233 4	0.077 8	0.720 8	0.610 7	0.103 2	0.629 5	0.437 8	0.626 5	0.446 5	0.702 3	0.190 5	0.005 1	0.058 7	0.322 6	0.702 7	0.244 6	0.768 6	0.000 1	0.134 5	0.552 6	0.279 7	0.395 6	0.147 7	0.000 1	0.207 6	0.612 5	0.000 4	0.000 4	0.000 1	0.000 3	0.658 5	0.566 6	0.323 6	0.525 8	0.229 6	0.179 5	0.467 8	0.154 7	0.000 3	0.002 1	0.000 1	0.051 1	0.000 2	0.127 2	0.703 6	0.000 1	0.000 6	0.216 1	0.112 7	0.358 4	0.547 1	0.187 2	0.092 7	0.156 8	0.055 5	0.296 6	0.252 4	0.143 2	0.000 3	0.014 5	0.398 3	0.000 1	0.028 7	0.173 2	0.000 7	0.265 7	0.348 6	0.415 8	0.179 2	0.019 7	0.218 4	0.000 1	0.597 4	0.274 8	0.565 4	0.000 1	0.012 3	0.000 3	0.039 7	0.022 2	0.000 3	0.117 6	0.000 3	0.000 2	0.000 4	0.000 1	0.000 1	0.324 7	0.000 1	0.384 4	0.000 1	0.000 4	0.251 8	0.000 1	0.566 5	0.000 1	0.000 1	0.066 6	0.404 1	0.886 7	0.199 1	0.000 3	0.000 1	0.059 2	0.000 1	0.136 1	0.540 1	0.127 8	0.295 6	0.085 5	0.143 5	0.514 2	0.413 6	0.000 6	0.000 1	0.498 3	0.000 1	0.000 2	0.000 4	0.623 5	0.000 2	0.000 1	0.000 1	0.132 7	0.000 2	0.000 2	0.000 3	0.000 1
David Rozenberszki, Or Litany, Angela Dai: Language-Grounded Indoor 3D Semantic Segmentation in the Wild. arXiv
AWCS	0.305 5	0.508 5	0.225 5	0.142 2	0.782 5	0.634 8	0.937 5	0.489 6	0.578 5	0.721 3	0.364 6	0.355 5	0.515 4	0.023 5	0.764 5	0.523 4	0.707 5	0.264 3	0.633 5	0.922 5	0.507 6	0.886 1	0.804 6	0.179 6	0.436 7	0.300 5	0.656 7	0.529 2	0.501 6	0.394 4	0.296 7	0.820 1	0.603 3	0.131 2	0.179 8	0.619 2	0.000 1	0.707 7	0.865 5	0.773 3	0.171 3	0.010 4	0.484 5	0.063 6	0.463 5	0.254 5	0.332 7	0.649 5	0.220 5	0.100 5	0.729 6	0.613 6	0.071 6	0.582 7	0.628 2	0.702 1	0.424 6	0.749 1	0.137 6	0.000 3	0.142 5	0.360 5	0.863 3	0.305 5	0.877 2	0.000 1	0.173 1	0.606 5	0.337 5	0.478 5	0.154 6	0.000 1	0.253 5	0.664 2	0.000 4	0.000 4	0.000 1	0.000 3	0.626 6	0.782 5	0.302 7	0.602 2	0.185 7	0.282 3	0.651 4	0.317 4	0.000 3	0.000 3	0.000 1	0.022 6	0.000 2	0.154 1	0.876 4	0.000 1	0.014 5	0.063 6	0.029 8	0.553 1	0.467 2	0.084 5	0.124 5	0.157 7	0.049 6	0.373 5	0.252 4	0.097 6	0.000 3	0.219 1	0.542 1	0.000 1	0.392 1	0.172 3	0.000 7	0.339 3	0.417 2	0.533 6	0.093 6	0.115 3	0.195 5	0.000 1	0.516 5	0.288 7	0.741 2	0.000 1	0.001 4	0.233 2	0.056 5	0.000 4	0.159 1	0.334 4	0.077 2	0.000 2	0.000 4	0.000 1	0.000 1	0.749 5	0.000 1	0.411 3	0.000 1	0.008 3	0.452 5	0.000 1	0.595 4	0.000 1	0.000 1	0.220 4	0.006 5	0.894 6	0.006 3	0.000 3	0.000 1	0.000 4	0.000 1	0.112 3	0.504 3	0.404 3	0.551 1	0.093 3	0.129 8	0.484 4	0.381 8	0.000 6	0.000 1	0.396 6	0.000 1	0.000 2	0.620 2	0.402 8	0.000 2	0.000 1	0.000 1	0.142 4	0.000 2	0.000 2	0.512 2	0.000 1

CSC-Pretrain	0.249 8	0.455 8	0.171 7	0.079 8	0.766 8	0.659 6	0.930 8	0.494 5	0.542 8	0.700 8	0.314 8	0.215 8	0.430 8	0.121 1	0.697 8	0.441 7	0.683 7	0.235 5	0.609 8	0.895 7	0.476 8	0.816 7	0.770 8	0.186 5	0.634 2	0.216 8	0.734 4	0.340 7	0.471 7	0.307 7	0.293 8	0.591 8	0.542 7	0.076 3	0.205 7	0.464 6	0.000 1	0.484 8	0.832 8	0.766 4	0.052 7	0.000 5	0.413 7	0.059 7	0.418 7	0.222 7	0.318 8	0.609 7	0.206 7	0.112 4	0.743 5	0.625 5	0.076 4	0.579 8	0.548 5	0.590 7	0.371 7	0.552 8	0.081 7	0.003 2	0.142 5	0.201 8	0.638 8	0.233 7	0.686 8	0.000 1	0.142 4	0.444 8	0.375 4	0.247 8	0.198 5	0.000 1	0.128 8	0.454 8	0.019 2	0.097 1	0.000 1	0.000 3	0.553 7	0.557 7	0.373 4	0.545 7	0.164 8	0.014 8	0.547 7	0.174 6	0.000 3	0.002 1	0.000 1	0.037 2	0.000 2	0.063 5	0.664 8	0.000 1	0.000 6	0.130 2	0.170 5	0.152 8	0.335 7	0.079 6	0.110 6	0.175 5	0.098 4	0.175 8	0.166 7	0.045 8	0.207 1	0.014 5	0.465 2	0.000 1	0.001 8	0.001 8	0.046 4	0.299 6	0.327 7	0.537 5	0.033 7	0.012 8	0.186 6	0.000 1	0.205 7	0.377 5	0.463 7	0.000 1	0.058 2	0.000 3	0.055 6	0.041 1	0.000 3	0.105 7	0.000 3	0.000 2	0.000 4	0.000 1	0.000 1	0.398 6	0.000 1	0.308 8	0.000 1	0.000 4	0.319 6	0.000 1	0.543 6	0.000 1	0.000 1	0.062 7	0.004 6	0.862 8	0.000 4	0.000 3	0.000 1	0.000 4	0.000 1	0.123 2	0.316 7	0.225 6	0.250 7	0.094 2	0.180 4	0.332 7	0.441 3	0.000 6	0.000 1	0.310 8	0.000 1	0.000 2	0.000 4	0.592 6	0.000 2	0.000 1	0.000 1	0.203 1	0.000 2	0.000 2	0.000 3	0.000 1
Ji Hou, Benjamin Graham, Matthias Nießner, Saining Xie: Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts. CVPR 2021
Minkowski 34D	0.253 7	0.463 7	0.154 8	0.102 7	0.771 7	0.650 7	0.932 6	0.483 7	0.571 7	0.710 6	0.331 7	0.250 7	0.492 6	0.044 3	0.703 7	0.419 8	0.606 8	0.227 7	0.621 7	0.865 8	0.531 3	0.771 8	0.813 5	0.291 4	0.484 6	0.242 7	0.612 8	0.282 8	0.440 8	0.351 6	0.299 6	0.622 7	0.593 5	0.027 5	0.293 5	0.310 8	0.000 1	0.757 5	0.858 6	0.737 7	0.150 4	0.164 1	0.368 8	0.084 3	0.381 8	0.142 8	0.357 6	0.720 4	0.214 6	0.092 7	0.724 7	0.596 8	0.056 7	0.655 2	0.525 6	0.581 8	0.352 8	0.594 7	0.056 8	0.000 3	0.014 8	0.224 7	0.772 6	0.205 8	0.720 7	0.000 1	0.159 2	0.531 7	0.163 8	0.294 7	0.136 8	0.000 1	0.169 7	0.589 6	0.000 4	0.000 4	0.000 1	0.002 1	0.663 4	0.466 8	0.265 8	0.582 5	0.337 5	0.016 7	0.559 6	0.084 8	0.000 3	0.000 3	0.000 1	0.036 3	0.000 2	0.125 3	0.670 7	0.000 1	0.102 1	0.071 5	0.164 6	0.406 2	0.386 4	0.046 8	0.068 8	0.159 6	0.117 2	0.284 7	0.111 8	0.094 7	0.000 3	0.000 8	0.197 8	0.000 1	0.044 6	0.013 6	0.002 6	0.228 8	0.307 8	0.588 4	0.025 8	0.545 1	0.134 8	0.000 1	0.655 2	0.302 6	0.282 8	0.000 1	0.060 1	0.000 3	0.035 8	0.000 4	0.000 3	0.097 8	0.000 3	0.000 2	0.005 3	0.000 1	0.000 1	0.096 8	0.000 1	0.334 7	0.000 1	0.000 4	0.274 7	0.000 1	0.513 8	0.000 1	0.000 1	0.280 3	0.194 4	0.897 5	0.000 4	0.000 3	0.000 1	0.000 4	0.000 1	0.108 5	0.279 8	0.189 7	0.141 8	0.059 7	0.272 2	0.307 8	0.445 2	0.003 4	0.000 1	0.353 7	0.000 1	0.026 1	0.000 4	0.581 7	0.001 1	0.000 1	0.000 1	0.093 8	0.002 1	0.000 2	0.000 3	0.000 1
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019

This table lists the benchmark results for the ScanNet200 3D semantic instance scenario.

Method	avg ap	head ap	common ap	tail ap	chair	table	door	couch	cabinet	shelf	desk	office chair	bed	pillow	sink	picture	window	toilet	bookshelf	monitor	curtain	book	coffee table	box	refrigerator	lamp	kitchen cabinet	towel	clothes	tv	nightstand	counter	dresser	stool	cushion	plant	ceiling	bathtub	end table	dining table	keyboard	bag	backpack	toilet paper	printer	tv stand	whiteboard	blanket	shower curtain	trash can	closet	stairs	microwave	stove	shoe	computer tower	bottle	bin	bench	board	washing machine	mirror	copier	basket	sofa chair	file cabinet	fan	laptop	shower	paper	person	paper towel dispenser	oven	blinds	rack	plate	blackboard	piano	suitcase	radiator	recycling bin	wardrobe	soap dispenser	telephone	bucket	clock	stand	light	laundry basket	pipe	clothes dryer	seat	speaker	column	bicycle	ladder	bathroom stall	shower wall	cup	jacket	storage bin	coffee maker	dishwasher	paper towel roll	machine	mat	windowsill	bar	toaster	bulletin board	ironing board	kitchen counter	doorframe	toilet paper dispenser	mini fridge	fire extinguisher	ball	hat	shower curtain rod	water cooler	paper cutter	tray	ledge	mouse	cart	storage container	scale	tissue box	light switch	power outlet	decoration	sign	projector	vacuum cleaner	candle	plunger	stuffed animal	headphones	dish rack	broom	range hood	water bottle	vent	shower floor	water pitcher	mailbox	bowl	paper bag	music stand	projector screen	laundry detergent	object	bathroom vanity	laundry hamper	bathroom stall door	ceiling light	trash bin	dumbbell	stair rail	tube	bathroom cabinet	closet rod	coffee kettle	structure	shower head	keyboard piano	case of water bottles	coat rack	storage organizer	folded chair	fire alarm	power strip	calendar	poster

Mask3D Scannet200	0.278 1	0.383 1	0.263 1	0.168 1	0.661 2	0.465 1	0.572 1	0.665 3	0.391 1	0.121 4	0.304 1	0.015 2	0.647 1	0.349 1	0.474 1	0.489 1	0.321 1	0.816 5	0.351 3	0.722 1	0.402 4	0.195 1	0.515 3	0.082 1	0.795 1	0.215 2	0.396 1	0.377 1	0.082 4	0.724 1	0.586 1	0.015 2	0.277 1	0.377 5	0.201 1	0.475 2	0.572 1	0.778 3	0.089 1	0.759 1	0.556 1	0.068 1	0.506 1	0.467 1	0.323 3	0.778 2	0.427 1	0.027 2	0.789 1	0.744 1	0.003 1	0.570 2	0.561 1	0.337 1	0.265 1	0.711 1	0.258 1	0.031 1	0.569 1	0.311 1	0.441 1	0.179 1	1.000 1	0.000 1	0.233 2	0.411 2	0.283 2	0.380 1	0.667 1	0.016 1	0.048 3	0.418 2	0.139 1	0.173 1	0.000 1	0.086 1	0.014 2	0.500 1	0.384 1	0.497 1	0.044 3	0.032 2	0.752 1	0.287 1	0.003 1	0.000 1	0.007 1	0.208 1	0.000 1	0.001 2	0.349 1	0.008 2	0.014 2	0.509 1	0.500 1	0.323 1	0.023 2	0.176 1	0.107 1	0.105 3	0.000 1	0.605 1	0.378 1	0.016 1	0.000 1	0.400 1	0.192 1	0.000 1	0.048 2	0.037 2	0.000 1	0.275 1	0.119 1	0.810 1	0.258 1	0.006 3	0.083 5	0.000 1	0.568 2	0.377 2	0.708 1	0.000 1	0.005 2	0.147 1	0.014 2	0.000 2	0.556 1	0.085 1	0.325 1	0.500 1	0.083 1	0.004 2	0.000 1	0.590 1	0.000 1	0.365 1	0.000 1	0.116 1	0.491 1	0.000 1	0.626 1	0.000 1	0.000 1	0.579 1	0.391 1	0.050 4	0.000 1	0.028 1	0.000 1	0.222 1	0.000 1	0.063 1	0.302 1	0.356 1	0.149 4	0.573 1	0.415 1	0.013 5	0.002 4	0.004 1	0.000 1	0.005 4	0.000 1	0.000 1	0.444 1	0.514 1	0.000 1	0.028 1	0.000 2	0.156 2	0.267 1	0.000 2	1.000 1	0.000 1
Jonas Schult, Francis Engelmann, Alexander Hermans, Or Litany, Siyu Tang, Bastian Leibe: Mask3D for 3D Semantic Instance Segmentation. ICRA 2023
TD3D Scannet200	0.211 2	0.332 2	0.177 2	0.103 2	0.662 1	0.413 2	0.463 2	0.705 1	0.192 3	0.145 1	0.266 2	0.215 1	0.452 4	0.209 2	0.222 5	0.219 5	0.315 2	0.893 1	0.380 2	0.617 2	0.439 2	0.047 4	0.646 1	0.080 2	0.610 3	0.253 1	0.237 2	0.293 2	0.135 1	0.379 5	0.494 2	0.048 1	0.252 2	0.451 2	0.184 2	0.483 1	0.395 2	0.852 1	0.083 2	0.551 2	0.278 2	0.036 2	0.337 2	0.266 2	0.544 1	0.963 1	0.079 5	0.039 1	0.740 2	0.604 2	0.000 2	0.586 1	0.283 2	0.282 2	0.059 2	0.633 3	0.028 2	0.004 2	0.559 2	0.309 2	0.420 2	0.028 5	1.000 1	0.000 1	0.456 1	0.411 1	0.372 1	0.060 4	0.046 4	0.000 2	0.040 4	0.694 1	0.083 2	0.000 2	0.000 1	0.000 2	0.000 3	0.083 4	0.252 2	0.260 5	0.200 1	0.160 1	0.669 2	0.111 2	0.000 2	0.000 1	0.006 2	0.169 2	0.000 1	0.007 1	0.296 2	0.032 1	0.074 1	0.139 3	0.000 2	0.321 2	0.031 1	0.108 2	0.088 2	0.157 1	0.000 1	0.231 5	0.026 5	0.000 2	0.000 1	0.356 2	0.052 2	0.000 1	0.240 1	0.147 1	0.000 1	0.015 2	0.046 3	0.144 3	0.073 3	0.414 1	0.222 4	0.000 1	0.806 1	0.343 3	0.486 3	0.000 1	0.008 1	0.038 2	0.083 1	0.002 1	0.028 2	0.074 2	0.032 2	0.150 2	0.039 2	0.008 1	0.000 1	0.250 4	0.000 1	0.125 4	0.000 1	0.052 2	0.260 3	0.000 1	0.143 5	0.000 1	0.000 1	0.543 2	0.207 2	0.404 1	0.000 1	0.003 2	0.000 1	0.000 2	0.000 1	0.037 2	0.093 4	0.272 2	0.342 1	0.039 4	0.281 2	0.249 3	0.224 1	0.000 2	0.000 1	0.074 1	0.000 1	0.000 1	0.000 2	0.278 2	0.000 1	0.000 2	0.889 1	0.323 1	0.000 2	0.014 1	0.000 2	0.000 1

LGround Inst.	0.154 3	0.275 3	0.108 3	0.060 3	0.573 3	0.381 3	0.434 3	0.654 4	0.190 4	0.141 2	0.097 3	0.000 3	0.503 3	0.180 3	0.252 3	0.242 4	0.242 3	0.881 3	0.448 1	0.494 3	0.429 3	0.078 2	0.364 5	0.024 3	0.654 2	0.213 4	0.222 3	0.239 3	0.099 3	0.616 2	0.363 3	0.000 3	0.092 3	0.444 3	0.000 3	0.383 4	0.209 5	0.815 2	0.030 3	0.000 3	0.166 3	0.002 4	0.295 5	0.099 4	0.364 2	0.778 2	0.177 3	0.001 4	0.427 5	0.585 4	0.000 2	0.470 3	0.268 5	0.205 3	0.045 3	0.642 2	0.007 3	0.000 3	0.333 5	0.148 3	0.407 3	0.130 2	1.000 1	0.000 1	0.156 4	0.189 3	0.097 4	0.169 2	0.000 5	0.000 2	0.056 2	0.400 3	0.000 3	0.000 2	0.000 1	0.000 2	0.556 1	0.278 3	0.203 3	0.323 4	0.019 4	0.000 3	0.402 4	0.026 3	0.000 2	0.000 1	0.000 3	0.044 3	0.000 1	0.000 3	0.037 4	0.000 3	0.000 3	0.181 2	0.000 2	0.127 3	0.006 4	0.028 4	0.023 3	0.115 2	0.000 1	0.327 2	0.267 2	0.000 2	0.000 1	0.000 4	0.028 3	0.000 1	0.000 3	0.000 3	0.000 1	0.003 3	0.048 2	0.135 4	0.222 2	0.089 2	0.278 1	0.000 1	0.514 3	0.333 4	0.611 2	0.000 1	0.000 3	0.000 3	0.000 3	0.000 2	0.000 3	0.037 3	0.000 3	0.000 3	0.000 3	0.000 3	0.000 1	0.322 2	0.000 1	0.209 2	0.000 1	0.000 3	0.278 2	0.000 1	0.302 3	0.000 1	0.000 1	0.143 3	0.148 3	0.000 5	0.000 1	0.000 3	0.000 1	0.000 2	0.000 1	0.015 3	0.064 5	0.000 3	0.272 2	0.031 5	0.000 4	0.257 2	0.028 2	0.000 2	0.000 1	0.041 2	0.000 1	0.000 1	0.000 2	0.222 5	0.000 1	0.000 2	0.000 2	0.000 5	0.000 2	0.000 2	0.000 2	0.000 1
David Rozenberszki, Or Litany, Angela Dai: Language-Grounded Indoor 3D Semantic Segmentation in the Wild.
Minkowski 34D Inst.	0.130 4	0.246 4	0.083 4	0.043 5	0.547 5	0.236 4	0.415 4	0.672 2	0.141 5	0.133 3	0.067 4	0.000 3	0.521 2	0.114 5	0.238 4	0.289 2	0.232 4	0.883 2	0.182 5	0.373 5	0.486 1	0.076 3	0.488 4	0.022 4	0.529 4	0.199 5	0.110 4	0.217 4	0.100 2	0.460 4	0.319 4	0.000 3	0.025 5	0.472 1	0.000 3	0.394 3	0.210 4	0.537 4	0.004 4	0.000 3	0.083 5	0.000 5	0.299 4	0.061 5	0.201 5	0.761 4	0.084 4	0.008 3	0.720 3	0.557 5	0.000 2	0.317 5	0.280 3	0.094 5	0.020 5	0.564 5	0.000 4	0.000 3	0.400 3	0.048 4	0.259 4	0.101 3	1.000 1	0.000 1	0.190 3	0.142 5	0.094 5	0.137 3	0.089 3	0.000 2	0.101 1	0.355 5	0.000 3	0.000 2	0.000 1	0.000 2	0.000 3	0.444 2	0.082 5	0.384 2	0.000 5	0.000 3	0.334 5	0.004 5	0.000 2	0.000 1	0.000 3	0.041 4	0.000 1	0.000 3	0.026 5	0.000 3	0.000 3	0.000 4	0.000 2	0.082 5	0.022 3	0.000 5	0.021 4	0.088 4	0.000 1	0.241 4	0.033 4	0.000 2	0.000 1	0.067 3	0.000 5	0.000 1	0.000 3	0.000 3	0.000 1	0.000 4	0.026 4	0.262 2	0.016 4	0.000 4	0.278 1	0.000 1	0.500 4	0.394 1	0.028 5	0.000 1	0.000 3	0.000 3	0.000 3	0.000 2	0.000 3	0.019 4	0.000 3	0.000 3	0.000 3	0.000 3	0.000 1	0.156 5	0.000 1	0.032 5	0.000 1	0.000 3	0.194 5	0.000 1	0.248 4	0.000 1	0.000 1	0.099 4	0.019 4	0.308 2	0.000 1	0.000 3	0.000 1	0.000 2	0.000 1	0.007 4	0.122 2	0.000 3	0.175 3	0.063 2	0.000 4	0.271 1	0.000 5	0.000 2	0.000 1	0.000 5	0.000 1	0.000 1	0.000 2	0.278 2	0.000 1	0.000 2	0.000 2	0.111 3	0.000 2	0.000 2	0.000 2	0.000 1
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019
CSC-Pretrain Inst.	0.123 5	0.223 5	0.082 5	0.046 4	0.564 4	0.152 5	0.394 5	0.578 5	0.235 2	0.116 5	0.034 5	0.000 3	0.348 5	0.119 4	0.297 2	0.285 3	0.202 5	0.838 4	0.323 4	0.407 4	0.184 5	0.037 5	0.516 2	0.013 5	0.424 5	0.214 3	0.093 5	0.105 5	0.078 5	0.542 3	0.250 5	0.000 3	0.064 4	0.444 3	0.000 3	0.224 5	0.231 3	0.537 4	0.001 5	0.000 3	0.126 4	0.004 3	0.308 3	0.193 3	0.244 4	0.343 5	0.228 2	0.000 5	0.441 4	0.588 3	0.000 2	0.338 4	0.275 4	0.189 4	0.030 4	0.600 4	0.000 4	0.000 3	0.378 4	0.000 5	0.108 5	0.098 4	1.000 1	0.000 1	0.096 5	0.172 4	0.144 3	0.011 5	0.125 2	0.000 2	0.000 5	0.376 4	0.000 3	0.000 2	0.000 1	0.000 2	0.000 3	0.042 5	0.141 4	0.377 3	0.051 2	0.000 3	0.483 3	0.017 4	0.000 2	0.000 1	0.000 3	0.022 5	0.000 1	0.000 3	0.065 3	0.000 3	0.000 3	0.000 4	0.000 2	0.094 4	0.000 5	0.042 3	0.000 5	0.064 5	0.000 1	0.259 3	0.089 3	0.000 2	0.000 1	0.000 4	0.022 4	0.000 1	0.000 3	0.000 3	0.000 1	0.000 4	0.018 5	0.111 5	0.000 5	0.000 4	0.278 1	0.000 1	0.444 5	0.333 4	0.333 4	0.000 1	0.000 3	0.000 3	0.000 3	0.000 2	0.000 3	0.000 5	0.000 3	0.000 3	0.000 3	0.000 3	0.000 1	0.267 3	0.000 1	0.184 3	0.000 1	0.000 3	0.211 4	0.000 1	0.378 2	0.000 1	0.000 1	0.063 5	0.000 5	0.275 3	0.000 1	0.000 3	0.000 1	0.000 2	0.000 1	0.007 5	0.105 3	0.000 3	0.032 5	0.045 3	0.198 3	0.171 4	0.028 2	0.000 2	0.000 1	0.006 3	0.000 1	0.000 1	0.000 2	0.278 2	0.000 1	0.000 2	0.000 2	0.044 4	0.000 2	0.000 2	0.000 2	0.000 1
Ji Hou, Benjamin Graham, Matthias Nießner, Saining Xie: Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts. CVPR 2021

ScanNet Benchmark

This table lists the benchmark results for the 3D semantic label scenario.

Method	avg iou	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	floor	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	wall	window

Mix3D	0.781 1	0.964 1	0.855 1	0.843 12	0.781 3	0.858 9	0.575 4	0.831 24	0.685 9	0.714 2	0.979 1	0.594 4	0.310 20	0.801 1	0.892 11	0.841 2	0.819 3	0.723 3	0.940 9	0.887 2	0.725 17
Alexey Nekrasov, Jonas Schult, Or Litany, Bastian Leibe, Francis Engelmann: Mix3D: Out-of-Context Data Augmentation for 3D Scenes. 3DV 2021 (Oral)
Swin3D	0.779 2	0.861 16	0.818 11	0.836 15	0.790 1	0.875 2	0.576 3	0.905 3	0.704 3	0.739 1	0.969 7	0.611 1	0.349 6	0.756 15	0.958 1	0.702 34	0.805 12	0.708 6	0.916 24	0.898 1	0.801 1

PPT-SpUNet-Joint	0.766 3	0.932 2	0.794 25	0.829 17	0.751 13	0.854 11	0.540 14	0.903 4	0.630 26	0.672 8	0.963 9	0.565 15	0.357 4	0.788 2	0.900 7	0.737 19	0.802 13	0.685 12	0.950 2	0.887 2	0.780 2

OctFormer	0.766 3	0.925 3	0.808 17	0.849 6	0.786 2	0.846 17	0.566 6	0.876 11	0.690 7	0.674 7	0.960 11	0.576 11	0.226 56	0.753 17	0.904 5	0.777 6	0.815 6	0.722 4	0.923 20	0.877 8	0.776 4
Peng-Shuai Wang: OctFormer: Octree-based Transformers for 3D Point Clouds. SIGGRAPH 2023
CU-Hybrid Net	0.764 5	0.924 4	0.819 9	0.840 13	0.757 9	0.853 12	0.580 1	0.848 18	0.709 2	0.643 16	0.958 14	0.587 8	0.295 26	0.753 17	0.884 15	0.758 13	0.815 6	0.725 2	0.927 19	0.867 14	0.743 9

OccuSeg+Semantic	0.764 5	0.758 50	0.796 23	0.839 14	0.746 15	0.907 1	0.562 7	0.850 17	0.680 11	0.672 8	0.978 2	0.610 2	0.335 10	0.777 5	0.819 35	0.847 1	0.830 1	0.691 10	0.972 1	0.885 4	0.727 15

O-CNN	0.762 7	0.924 4	0.823 6	0.844 11	0.770 5	0.852 13	0.577 2	0.847 20	0.711 1	0.640 20	0.958 14	0.592 5	0.217 62	0.762 12	0.888 12	0.758 13	0.813 8	0.726 1	0.932 17	0.868 13	0.744 8
Peng-Shuai Wang, Yang Liu, Yu-Xiao Guo, Chun-Yu Sun, Xin Tong: O-CNN: Octree-based Convolutional Neural Networks for 3D Shape Analysis. SIGGRAPH 2017
OA-CNN-L_ScanNet20	0.756 8	0.783 38	0.826 5	0.858 4	0.776 4	0.837 24	0.548 11	0.896 7	0.649 19	0.675 6	0.962 10	0.586 9	0.335 10	0.771 8	0.802 39	0.770 9	0.787 25	0.691 10	0.936 12	0.880 7	0.761 6

PointTransformerV2	0.752 9	0.742 57	0.809 16	0.872 1	0.758 8	0.860 8	0.552 9	0.891 8	0.610 34	0.687 3	0.960 11	0.559 18	0.304 23	0.766 10	0.926 3	0.767 10	0.797 17	0.644 26	0.942 7	0.876 11	0.722 19
Xiaoyang Wu, Yixing Lao, Li Jiang, Xihui Liu, Hengshuang Zhao: Point Transformer V2: Grouped Vector Attention and Partition-based Pooling. NeurIPS 2022
DMF-Net	0.752 9	0.906 8	0.793 27	0.802 33	0.689 30	0.825 35	0.556 8	0.867 13	0.681 10	0.602 34	0.960 11	0.555 20	0.365 3	0.779 4	0.859 20	0.747 16	0.795 21	0.717 5	0.917 23	0.856 22	0.764 5

PointConvFormer	0.749 11	0.793 35	0.790 28	0.807 28	0.750 14	0.856 10	0.524 20	0.881 10	0.588 45	0.642 19	0.977 4	0.591 6	0.274 37	0.781 3	0.929 2	0.804 3	0.796 18	0.642 27	0.947 4	0.885 4	0.715 22
Wenxuan Wu, Qi Shan, Li Fuxin: PointConvFormer: Revenge of the Point-based Convolution.
BPNet	0.749 11	0.909 6	0.818 11	0.811 25	0.752 11	0.839 23	0.485 37	0.842 21	0.673 12	0.644 15	0.957 17	0.528 29	0.305 22	0.773 7	0.859 20	0.788 4	0.818 5	0.693 9	0.916 24	0.856 22	0.723 18
Wenbo Hu, Hengshuang Zhao, Li Jiang, Jiaya Jia, Tien-Tsin Wong: Bidirectional Projection Network for Cross Dimension Scene Understanding. CVPR 2021 (Oral)
MSP	0.748 13	0.623 83	0.804 19	0.859 3	0.745 16	0.824 37	0.501 28	0.912 2	0.690 7	0.685 4	0.956 18	0.567 14	0.320 16	0.768 9	0.918 4	0.720 25	0.802 13	0.676 16	0.921 21	0.881 6	0.779 3

StratifiedFormer	0.747 14	0.901 9	0.803 20	0.845 10	0.757 9	0.846 17	0.512 24	0.825 27	0.696 6	0.645 14	0.956 18	0.576 11	0.262 47	0.744 22	0.861 19	0.742 17	0.770 34	0.705 7	0.899 37	0.860 19	0.734 10
Xin Lai, Jianhui Liu, Li Jiang, Liwei Wang, Hengshuang Zhao, Shu Liu, Xiaojuan Qi, Jiaya Jia: Stratified Transformer for 3D Point Cloud Segmentation. CVPR 2022
VMNet	0.746 15	0.870 14	0.838 2	0.858 4	0.729 21	0.850 15	0.501 28	0.874 12	0.587 46	0.658 12	0.956 18	0.564 16	0.299 24	0.765 11	0.900 7	0.716 28	0.812 9	0.631 32	0.939 10	0.858 20	0.709 23
Zeyu HU, Xuyang Bai, Jiaxiang Shang, Runze Zhang, Jiayu Dong, Xin Wang, Guangyuan Sun, Hongbo Fu, Chiew-Lan Tai: VMNet: Voxel-Mesh Network for Geodesic-Aware 3D Semantic Segmentation. ICCV 2021 (Oral)
Virtual MVFusion	0.746 15	0.771 44	0.819 9	0.848 8	0.702 28	0.865 7	0.397 74	0.899 5	0.699 4	0.664 11	0.948 45	0.588 7	0.330 12	0.746 21	0.851 27	0.764 11	0.796 18	0.704 8	0.935 13	0.866 15	0.728 13
Abhijit Kundu, Xiaoqi Yin, Alireza Fathi, David Ross, Brian Brewington, Thomas Funkhouser, Caroline Pantofaru: Virtual Multi-view Fusion for 3D Semantic Segmentation. ECCV 2020
Retro-FPN	0.744 17	0.842 22	0.800 21	0.767 45	0.740 17	0.836 26	0.541 13	0.914 1	0.672 13	0.626 23	0.958 14	0.552 21	0.272 39	0.777 5	0.886 14	0.696 35	0.801 15	0.674 18	0.941 8	0.858 20	0.717 20

EQ-Net	0.743 18	0.620 84	0.799 22	0.849 6	0.730 20	0.822 39	0.493 35	0.897 6	0.664 14	0.681 5	0.955 21	0.562 17	0.378 1	0.760 13	0.903 6	0.738 18	0.801 15	0.673 19	0.907 29	0.877 8	0.745 7
Zetong Yang, Li Jiang, Yanan Sun, Bernt Schiele, Jiaya JIa: A Unified Query-based Paradigm for Point Cloud Understanding. CVPR 2022
SAT	0.742 19	0.860 17	0.765 39	0.819 20	0.769 6	0.848 16	0.533 16	0.829 25	0.663 15	0.631 22	0.955 21	0.586 9	0.274 37	0.753 17	0.896 9	0.729 20	0.760 41	0.666 21	0.921 21	0.855 24	0.733 11

LRPNet	0.742 19	0.816 30	0.806 18	0.807 28	0.752 11	0.828 33	0.575 4	0.839 23	0.699 4	0.637 21	0.954 26	0.520 31	0.320 16	0.755 16	0.834 31	0.760 12	0.772 31	0.676 16	0.915 26	0.862 17	0.717 20

TXC	0.740 21	0.842 22	0.832 4	0.805 32	0.715 25	0.846 17	0.473 39	0.885 9	0.615 30	0.671 10	0.971 6	0.547 22	0.320 16	0.697 26	0.799 41	0.777 6	0.819 3	0.682 14	0.946 5	0.871 12	0.696 27

LargeKernel3D	0.739 22	0.909 6	0.820 8	0.806 30	0.740 17	0.852 13	0.545 12	0.826 26	0.594 44	0.643 16	0.955 21	0.541 24	0.263 46	0.723 24	0.858 22	0.775 8	0.767 35	0.678 15	0.933 15	0.848 29	0.694 28
Yukang Chen, Jianhui Liu, Xiangyu Zhang, Xiaojuan Qi, Jiaya Jia: LargeKernel3D: Scaling up Kernels in 3D Sparse CNNs. CVPR 2023
MinkowskiNet	0.736 23	0.859 18	0.818 11	0.832 16	0.709 26	0.840 22	0.521 22	0.853 16	0.660 17	0.643 16	0.951 35	0.544 23	0.286 31	0.731 23	0.893 10	0.675 43	0.772 31	0.683 13	0.874 55	0.852 27	0.727 15
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019
IPCA	0.731 24	0.890 10	0.837 3	0.864 2	0.726 22	0.873 3	0.530 19	0.824 28	0.489 77	0.647 13	0.978 2	0.609 3	0.336 9	0.624 41	0.733 49	0.758 13	0.776 29	0.570 56	0.949 3	0.877 8	0.728 13

PointTransformer++	0.725 25	0.727 65	0.811 15	0.819 20	0.765 7	0.841 21	0.502 27	0.814 33	0.621 29	0.623 25	0.955 21	0.556 19	0.284 32	0.620 42	0.866 17	0.781 5	0.757 44	0.648 24	0.932 17	0.862 17	0.709 23

SparseConvNet	0.725 25	0.647 80	0.821 7	0.846 9	0.721 23	0.869 4	0.533 16	0.754 47	0.603 40	0.614 27	0.955 21	0.572 13	0.325 14	0.710 25	0.870 16	0.724 23	0.823 2	0.628 33	0.934 14	0.865 16	0.683 31

MatchingNet	0.724 27	0.812 32	0.812 14	0.810 26	0.735 19	0.834 28	0.495 34	0.860 15	0.572 52	0.602 34	0.954 26	0.512 33	0.280 34	0.757 14	0.845 29	0.725 22	0.780 27	0.606 42	0.937 11	0.851 28	0.700 26

INS-Conv-semantic	0.717 28	0.751 53	0.759 42	0.812 24	0.704 27	0.868 5	0.537 15	0.842 21	0.609 36	0.608 30	0.953 29	0.534 26	0.293 27	0.616 43	0.864 18	0.719 27	0.793 22	0.640 28	0.933 15	0.845 33	0.663 36

PointMetaBase	0.714 29	0.835 24	0.785 29	0.821 18	0.684 32	0.846 17	0.531 18	0.865 14	0.614 31	0.596 38	0.953 29	0.500 36	0.246 52	0.674 27	0.888 12	0.692 36	0.764 37	0.624 34	0.849 70	0.844 34	0.675 33

contrastBoundary	0.705 30	0.769 47	0.775 34	0.809 27	0.687 31	0.820 42	0.439 62	0.812 34	0.661 16	0.591 40	0.945 53	0.515 32	0.171 80	0.633 38	0.856 23	0.720 25	0.796 18	0.668 20	0.889 44	0.847 30	0.689 29
Liyao Tang, Yibing Zhan, Zhe Chen, Baosheng Yu, Dacheng Tao: Contrastive Boundary Learning for Point Cloud Segmentation. CVPR2022
RFCR	0.702 31	0.889 11	0.745 51	0.813 23	0.672 35	0.818 46	0.493 35	0.815 32	0.623 27	0.610 28	0.947 47	0.470 46	0.249 51	0.594 46	0.848 28	0.705 32	0.779 28	0.646 25	0.892 42	0.823 40	0.611 50
Jingyu Gong, Jiachen Xu, Xin Tan, Haichuan Song, Yanyun Qu, Yuan Xie, Lizhuang Ma: Omni-Supervised Point Cloud Segmentation via Gradual Receptive Field Component Reasoning. CVPR2021
One Thing One Click	0.701 32	0.825 28	0.796 23	0.723 52	0.716 24	0.832 29	0.433 64	0.816 30	0.634 24	0.609 29	0.969 7	0.418 71	0.344 7	0.559 58	0.833 32	0.715 29	0.808 11	0.560 61	0.902 34	0.847 30	0.680 32

JSENet	0.699 33	0.881 13	0.762 40	0.821 18	0.667 36	0.800 59	0.522 21	0.792 39	0.613 32	0.607 31	0.935 73	0.492 38	0.205 67	0.576 51	0.853 25	0.691 37	0.758 43	0.652 23	0.872 58	0.828 37	0.649 40
Zeyu HU, Mingmin Zhen, Xuyang BAI, Hongbo Fu, Chiew-lan Tai: JSENet: Joint Semantic Segmentation and Edge Detection Network for 3D Point Clouds. ECCV 2020
One-Thing-One-Click	0.693 34	0.743 56	0.794 25	0.655 76	0.684 32	0.822 39	0.497 33	0.719 57	0.622 28	0.617 26	0.977 4	0.447 58	0.339 8	0.750 20	0.664 65	0.703 33	0.790 24	0.596 46	0.946 5	0.855 24	0.647 41
Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu: One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation. CVPR 2021
PicassoNet-II	0.692 35	0.732 61	0.772 35	0.786 37	0.677 34	0.866 6	0.517 23	0.848 18	0.509 69	0.626 23	0.952 33	0.536 25	0.225 58	0.545 64	0.704 56	0.689 40	0.810 10	0.564 60	0.903 33	0.854 26	0.729 12
Huan Lei, Naveed Akhtar, Mubarak Shah, and Ajmal Mian: Geometric feature learning for 3D meshes.
Feature_GeometricNet	0.690 36	0.884 12	0.754 46	0.795 36	0.647 42	0.818 46	0.422 66	0.802 37	0.612 33	0.604 32	0.945 53	0.462 49	0.189 75	0.563 57	0.853 25	0.726 21	0.765 36	0.632 31	0.904 31	0.821 43	0.606 54
Kangcheng Liu, Ben M. Chen: https://arxiv.org/abs/2012.09439. arXiv Preprint
FusionNet	0.688 37	0.704 70	0.741 55	0.754 49	0.656 38	0.829 31	0.501 28	0.741 52	0.609 36	0.548 47	0.950 39	0.522 30	0.371 2	0.633 38	0.756 44	0.715 29	0.771 33	0.623 35	0.861 66	0.814 45	0.658 37
Feihu Zhang, Jin Fang, Benjamin Wah, Philip Torr: Deep FusionNet for Point Cloud Semantic Segmentation. ECCV 2020
Feature-Geometry Net	0.685 38	0.866 15	0.748 48	0.819 20	0.645 44	0.794 62	0.450 51	0.802 37	0.587 46	0.604 32	0.945 53	0.464 48	0.201 70	0.554 60	0.840 30	0.723 24	0.732 53	0.602 44	0.907 29	0.822 42	0.603 57

KP-FCNN	0.684 39	0.847 21	0.758 44	0.784 39	0.647 42	0.814 49	0.473 39	0.772 42	0.605 38	0.594 39	0.935 73	0.450 56	0.181 78	0.587 47	0.805 38	0.690 38	0.785 26	0.614 38	0.882 48	0.819 44	0.632 46
H. Thomas, C. Qi, J. Deschaud, B. Marcotegui, F. Goulette, L. Guibas.: KPConv: Flexible and Deformable Convolution for Point Clouds. ICCV 2019
DGNet	0.684 39	0.712 69	0.784 30	0.782 41	0.658 37	0.835 27	0.499 32	0.823 29	0.641 21	0.597 37	0.950 39	0.487 39	0.281 33	0.575 52	0.619 68	0.647 56	0.764 37	0.620 37	0.871 61	0.846 32	0.688 30

VACNN++	0.684 39	0.728 64	0.757 45	0.776 42	0.690 29	0.804 56	0.464 45	0.816 30	0.577 51	0.587 41	0.945 53	0.508 35	0.276 36	0.671 28	0.710 54	0.663 48	0.750 47	0.589 51	0.881 49	0.832 36	0.653 39

Superpoint Network	0.683 42	0.851 20	0.728 59	0.800 35	0.653 40	0.806 54	0.468 42	0.804 35	0.572 52	0.602 34	0.946 50	0.453 55	0.239 55	0.519 69	0.822 33	0.689 40	0.762 40	0.595 48	0.895 40	0.827 38	0.630 47

PointContrast_LA_SEM	0.683 42	0.757 51	0.784 30	0.786 37	0.639 46	0.824 37	0.408 69	0.775 41	0.604 39	0.541 49	0.934 77	0.532 27	0.269 42	0.552 61	0.777 42	0.645 59	0.793 22	0.640 28	0.913 27	0.824 39	0.671 34

VI-PointConv	0.676 44	0.770 46	0.754 46	0.783 40	0.621 50	0.814 49	0.552 9	0.758 45	0.571 54	0.557 45	0.954 26	0.529 28	0.268 44	0.530 67	0.682 60	0.675 43	0.719 56	0.603 43	0.888 45	0.833 35	0.665 35
Xingyi Li, Wenxuan Wu, Xiaoli Z. Fern, Li Fuxin: The Devils in the Point Clouds: Studying the Robustness of Point Cloud Convolutions.
ROSMRF3D	0.673 45	0.789 36	0.748 48	0.763 47	0.635 48	0.814 49	0.407 71	0.747 49	0.581 50	0.573 42	0.950 39	0.484 40	0.271 41	0.607 44	0.754 45	0.649 53	0.774 30	0.596 46	0.883 47	0.823 40	0.606 54

SALANet	0.670 46	0.816 30	0.770 37	0.768 44	0.652 41	0.807 53	0.451 48	0.747 49	0.659 18	0.545 48	0.924 83	0.473 45	0.149 90	0.571 54	0.811 37	0.635 62	0.746 48	0.623 35	0.892 42	0.794 57	0.570 67

PointConv	0.666 47	0.781 39	0.759 42	0.699 61	0.644 45	0.822 39	0.475 38	0.779 40	0.564 57	0.504 65	0.953 29	0.428 65	0.203 69	0.586 49	0.754 45	0.661 49	0.753 45	0.588 52	0.902 34	0.813 47	0.642 42
Wenxuan Wu, Zhongang Qi, Li Fuxin: PointConv: Deep Convolutional Networks on 3D Point Clouds. CVPR 2019
PointASNL	0.666 47	0.703 71	0.781 32	0.751 51	0.655 39	0.830 30	0.471 41	0.769 43	0.474 80	0.537 51	0.951 35	0.475 44	0.279 35	0.635 36	0.698 59	0.675 43	0.751 46	0.553 66	0.816 77	0.806 49	0.703 25
Xu Yan, Chaoda Zheng, Zhen Li, Sheng Wang, Shuguang Cui: PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Sampling. CVPR 2020
PPCNN++	0.663 49	0.746 54	0.708 63	0.722 53	0.638 47	0.820 42	0.451 48	0.566 84	0.599 42	0.541 49	0.950 39	0.510 34	0.313 19	0.648 33	0.819 35	0.616 67	0.682 72	0.590 50	0.869 62	0.810 48	0.656 38
Pyunghwan Ahn, Juyoung Yang, Eojindl Yi, Chanho Lee, Junmo Kim: Projection-based Point Convolution for Efficient Point Cloud Segmentation. IEEE Access
DCM-Net	0.658 50	0.778 40	0.702 66	0.806 30	0.619 51	0.813 52	0.468 42	0.693 65	0.494 72	0.524 57	0.941 64	0.449 57	0.298 25	0.510 71	0.821 34	0.675 43	0.727 55	0.568 58	0.826 75	0.803 51	0.637 44
Jonas Schult, Francis Engelmann, Theodora Kontogianni, Bastian Leibe: DualConvMesh-Net: Joint Geodesic and Euclidean Convolutions on 3D Meshes. CVPR 2020 [Oral]
HPGCNN	0.656 51	0.698 72	0.743 53	0.650 77	0.564 68	0.820 42	0.505 26	0.758 45	0.631 25	0.479 70	0.945 53	0.480 42	0.226 56	0.572 53	0.774 43	0.690 38	0.735 51	0.614 38	0.853 69	0.776 72	0.597 60
Jisheng Dang, Qingyong Hu, Yulan Guo, Jun Yang: HPGCNN.
SAFNet-seg	0.654 52	0.752 52	0.734 57	0.664 74	0.583 63	0.815 48	0.399 73	0.754 47	0.639 22	0.535 53	0.942 62	0.470 46	0.309 21	0.665 29	0.539 74	0.650 52	0.708 61	0.635 30	0.857 68	0.793 59	0.642 42
Linqing Zhao, Jiwen Lu, Jie Zhou: Similarity-Aware Fusion Network for 3D Semantic Segmentation. IROS 2021
RandLA-Net	0.645 53	0.778 40	0.731 58	0.699 61	0.577 64	0.829 31	0.446 53	0.736 53	0.477 79	0.523 59	0.945 53	0.454 53	0.269 42	0.484 78	0.749 48	0.618 65	0.738 49	0.599 45	0.827 74	0.792 62	0.621 49

MVPNet	0.641 54	0.831 25	0.715 61	0.671 71	0.590 59	0.781 68	0.394 75	0.679 67	0.642 20	0.553 46	0.937 70	0.462 49	0.256 48	0.649 32	0.406 87	0.626 63	0.691 69	0.666 21	0.877 51	0.792 62	0.608 53
Maximilian Jaritz, Jiayuan Gu, Hao Su: Multi-view PointNet for 3D Scene Understanding. GMDL Workshop, ICCV 2019
PointConv-SFPN	0.641 54	0.776 42	0.703 65	0.721 54	0.557 71	0.826 34	0.451 48	0.672 69	0.563 58	0.483 69	0.943 61	0.425 68	0.162 85	0.644 34	0.726 50	0.659 50	0.709 60	0.572 55	0.875 53	0.786 67	0.559 72

PointMRNet	0.640 56	0.717 68	0.701 67	0.692 64	0.576 65	0.801 58	0.467 44	0.716 58	0.563 58	0.459 75	0.953 29	0.429 64	0.169 82	0.581 50	0.854 24	0.605 68	0.710 58	0.550 67	0.894 41	0.793 59	0.575 65

FPConv	0.639 57	0.785 37	0.760 41	0.713 59	0.603 54	0.798 60	0.392 76	0.534 89	0.603 40	0.524 57	0.948 45	0.457 51	0.250 50	0.538 65	0.723 52	0.598 72	0.696 67	0.614 38	0.872 58	0.799 52	0.567 69
Yiqun Lin, Zizheng Yan, Haibin Huang, Dong Du, Ligang Liu, Shuguang Cui, Xiaoguang Han: FPConv: Learning Local Flattening for Point Convolution. CVPR 2020
PD-Net	0.638 58	0.797 34	0.769 38	0.641 82	0.590 59	0.820 42	0.461 46	0.537 88	0.637 23	0.536 52	0.947 47	0.388 79	0.206 66	0.656 30	0.668 63	0.647 56	0.732 53	0.585 53	0.868 63	0.793 59	0.473 91

PointSPNet	0.637 59	0.734 60	0.692 74	0.714 58	0.576 65	0.797 61	0.446 53	0.743 51	0.598 43	0.437 80	0.942 62	0.403 75	0.150 89	0.626 40	0.800 40	0.649 53	0.697 66	0.557 64	0.846 71	0.777 71	0.563 70

SConv	0.636 60	0.830 26	0.697 70	0.752 50	0.572 67	0.780 70	0.445 55	0.716 58	0.529 63	0.530 54	0.951 35	0.446 59	0.170 81	0.507 73	0.666 64	0.636 61	0.682 72	0.541 72	0.886 46	0.799 52	0.594 61

Supervoxel-CNN	0.635 61	0.656 78	0.711 62	0.719 55	0.613 52	0.757 79	0.444 58	0.765 44	0.534 62	0.566 43	0.928 81	0.478 43	0.272 39	0.636 35	0.531 76	0.664 47	0.645 82	0.508 80	0.864 65	0.792 62	0.611 50

joint point-based	0.634 62	0.614 85	0.778 33	0.667 73	0.633 49	0.825 35	0.420 67	0.804 35	0.467 82	0.561 44	0.951 35	0.494 37	0.291 28	0.566 55	0.458 82	0.579 79	0.764 37	0.559 63	0.838 72	0.814 45	0.598 59
Hung-Yueh Chiang, Yen-Liang Lin, Yueh-Cheng Liu, Winston H. Hsu: A Unified Point-Based Framework for 3D Segmentation. 3DV 2019
PointMTL	0.632 63	0.731 62	0.688 77	0.675 68	0.591 58	0.784 67	0.444 58	0.565 85	0.610 34	0.492 67	0.949 43	0.456 52	0.254 49	0.587 47	0.706 55	0.599 71	0.665 78	0.612 41	0.868 63	0.791 66	0.579 64

APCF-Net	0.631 64	0.742 57	0.687 79	0.672 69	0.557 71	0.792 65	0.408 69	0.665 70	0.545 60	0.508 62	0.952 33	0.428 65	0.186 76	0.634 37	0.702 57	0.620 64	0.706 62	0.555 65	0.873 56	0.798 54	0.581 63
Haojia, Lin: Adaptive Pyramid Context Fusion for Point Cloud Perception. GRSL
3DSM_DMMF	0.631 64	0.626 82	0.745 51	0.801 34	0.607 53	0.751 80	0.506 25	0.729 56	0.565 56	0.491 68	0.866 97	0.434 60	0.197 73	0.595 45	0.630 67	0.709 31	0.705 63	0.560 61	0.875 53	0.740 82	0.491 86

PointNet2-SFPN	0.631 64	0.771 44	0.692 74	0.672 69	0.524 76	0.837 24	0.440 61	0.706 63	0.538 61	0.446 77	0.944 59	0.421 70	0.219 61	0.552 61	0.751 47	0.591 75	0.737 50	0.543 71	0.901 36	0.768 74	0.557 73

FusionAwareConv	0.630 67	0.604 87	0.741 55	0.766 46	0.590 59	0.747 81	0.501 28	0.734 54	0.503 71	0.527 55	0.919 87	0.454 53	0.323 15	0.550 63	0.420 86	0.678 42	0.688 70	0.544 69	0.896 39	0.795 56	0.627 48
Jiazhao Zhang, Chenyang Zhu, Lintao Zheng, Kai Xu: Fusion-Aware Point Convolution for Online Semantic 3D Scene Segmentation. CVPR 2020
DenSeR	0.628 68	0.800 33	0.625 89	0.719 55	0.545 74	0.806 54	0.445 55	0.597 79	0.448 86	0.519 60	0.938 69	0.481 41	0.328 13	0.489 77	0.499 81	0.657 51	0.759 42	0.592 49	0.881 49	0.797 55	0.634 45

SegGroup_sem	0.627 69	0.818 29	0.747 50	0.701 60	0.602 55	0.764 76	0.385 80	0.629 76	0.490 75	0.508 62	0.931 80	0.409 73	0.201 70	0.564 56	0.725 51	0.618 65	0.692 68	0.539 73	0.873 56	0.794 57	0.548 76
An Tao, Yueqi Duan, Yi Wei, Jiwen Lu, Jie Zhou: SegGroup: Seg-Level Supervision for 3D Instance and Semantic Segmentation. TIP 2022
SIConv	0.625 70	0.830 26	0.694 72	0.757 48	0.563 69	0.772 74	0.448 52	0.647 73	0.520 65	0.509 61	0.949 43	0.431 63	0.191 74	0.496 75	0.614 69	0.647 56	0.672 76	0.535 75	0.876 52	0.783 68	0.571 66

HPEIN	0.618 71	0.729 63	0.668 80	0.647 79	0.597 57	0.766 75	0.414 68	0.680 66	0.520 65	0.525 56	0.946 50	0.432 61	0.215 63	0.493 76	0.599 70	0.638 60	0.617 87	0.570 56	0.897 38	0.806 49	0.605 56
Li Jiang, Hengshuang Zhao, Shu Liu, Xiaoyong Shen, Chi-Wing Fu, Jiaya Jia: Hierarchical Point-Edge Interaction Network for Point Cloud Semantic Segmentation. ICCV 2019
SPH3D-GCN	0.610 72	0.858 19	0.772 35	0.489 94	0.532 75	0.792 65	0.404 72	0.643 75	0.570 55	0.507 64	0.935 73	0.414 72	0.046 99	0.510 71	0.702 57	0.602 70	0.705 63	0.549 68	0.859 67	0.773 73	0.534 79
Huan Lei, Naveed Akhtar, and Ajmal Mian: Spherical Kernel for Efficient Graph Convolution on 3D Point Clouds. TPAMI 2020
AttAN	0.609 73	0.760 49	0.667 81	0.649 78	0.521 77	0.793 63	0.457 47	0.648 72	0.528 64	0.434 82	0.947 47	0.401 76	0.153 88	0.454 80	0.721 53	0.648 55	0.717 57	0.536 74	0.904 31	0.765 75	0.485 87
Gege Zhang, Qinghua Ma, Licheng Jiao, Fang Liu and Qigong Sun: AttAN: Attention Adversarial Networks for 3D Point Cloud Semantic Segmentation. IJCAI2020
wsss-transformer	0.600 74	0.634 81	0.743 53	0.697 63	0.601 56	0.781 68	0.437 63	0.585 82	0.493 73	0.446 77	0.933 78	0.394 77	0.011 101	0.654 31	0.661 66	0.603 69	0.733 52	0.526 76	0.832 73	0.761 77	0.480 88

dtc_net	0.596 75	0.683 73	0.725 60	0.715 57	0.549 73	0.803 57	0.444 58	0.647 73	0.493 73	0.495 66	0.941 64	0.409 73	0.000 103	0.424 85	0.544 73	0.598 72	0.703 65	0.522 77	0.912 28	0.792 62	0.520 82

LAP-D	0.594 76	0.720 66	0.692 74	0.637 83	0.456 86	0.773 73	0.391 78	0.730 55	0.587 46	0.445 79	0.940 67	0.381 80	0.288 29	0.434 83	0.453 84	0.591 75	0.649 80	0.581 54	0.777 81	0.749 81	0.610 52

DPC	0.592 77	0.720 66	0.700 68	0.602 87	0.480 82	0.762 78	0.380 81	0.713 61	0.585 49	0.437 80	0.940 67	0.369 82	0.288 29	0.434 83	0.509 80	0.590 77	0.639 85	0.567 59	0.772 82	0.755 79	0.592 62
Francis Engelmann, Theodora Kontogianni, Bastian Leibe: Dilated Point Convolutions: On the Receptive Field Size of Point Convolutions on 3D Point Clouds. ICRA 2020
CCRFNet	0.589 78	0.766 48	0.659 84	0.683 66	0.470 85	0.740 83	0.387 79	0.620 78	0.490 75	0.476 71	0.922 85	0.355 85	0.245 53	0.511 70	0.511 79	0.571 80	0.643 83	0.493 84	0.872 58	0.762 76	0.600 58

ROSMRF	0.580 79	0.772 43	0.707 64	0.681 67	0.563 69	0.764 76	0.362 83	0.515 90	0.465 83	0.465 74	0.936 72	0.427 67	0.207 65	0.438 81	0.577 71	0.536 83	0.675 75	0.486 85	0.723 88	0.779 69	0.524 81

SD-DETR	0.576 80	0.746 54	0.609 93	0.445 98	0.517 78	0.643 94	0.366 82	0.714 60	0.456 84	0.468 73	0.870 96	0.432 61	0.264 45	0.558 59	0.674 61	0.586 78	0.688 70	0.482 86	0.739 86	0.733 84	0.537 78

SQN_0.1%	0.569 81	0.676 75	0.696 71	0.657 75	0.497 79	0.779 71	0.424 65	0.548 86	0.515 67	0.376 87	0.902 94	0.422 69	0.357 4	0.379 88	0.456 83	0.596 74	0.659 79	0.544 69	0.685 91	0.665 95	0.556 74

TextureNet	0.566 82	0.672 77	0.664 82	0.671 71	0.494 80	0.719 84	0.445 55	0.678 68	0.411 92	0.396 85	0.935 73	0.356 84	0.225 58	0.412 86	0.535 75	0.565 81	0.636 86	0.464 88	0.794 80	0.680 92	0.568 68
Jingwei Huang, Haotian Zhang, Li Yi, Thomas Funkerhouser, Matthias Niessner, Leonidas Guibas: TextureNet: Consistent Local Parametrizations for Learning from High-Resolution Signals on Meshes. CVPR
DVVNet	0.562 83	0.648 79	0.700 68	0.770 43	0.586 62	0.687 88	0.333 87	0.650 71	0.514 68	0.475 72	0.906 91	0.359 83	0.223 60	0.340 90	0.442 85	0.422 94	0.668 77	0.501 81	0.708 89	0.779 69	0.534 79

Pointnet++ & Feature	0.557 84	0.735 59	0.661 83	0.686 65	0.491 81	0.744 82	0.392 76	0.539 87	0.451 85	0.375 88	0.946 50	0.376 81	0.205 67	0.403 87	0.356 90	0.553 82	0.643 83	0.497 82	0.824 76	0.756 78	0.515 83

GMLPs	0.538 85	0.495 95	0.693 73	0.647 79	0.471 84	0.793 63	0.300 90	0.477 91	0.505 70	0.358 89	0.903 93	0.327 88	0.081 96	0.472 79	0.529 77	0.448 92	0.710 58	0.509 78	0.746 84	0.737 83	0.554 75

PanopticFusion-label	0.529 86	0.491 96	0.688 77	0.604 86	0.386 91	0.632 95	0.225 100	0.705 64	0.434 89	0.293 95	0.815 98	0.348 86	0.241 54	0.499 74	0.669 62	0.507 85	0.649 80	0.442 94	0.796 79	0.602 98	0.561 71
Gaku Narita, Takashi Seno, Tomoya Ishikawa, Yohsuke Kaji: PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Things. IROS 2019 (to appear)
subcloud_weak	0.516 87	0.676 75	0.591 96	0.609 84	0.442 87	0.774 72	0.335 86	0.597 79	0.422 91	0.357 90	0.932 79	0.341 87	0.094 95	0.298 92	0.528 78	0.473 90	0.676 74	0.495 83	0.602 97	0.721 87	0.349 98

Online SegFusion	0.515 88	0.607 86	0.644 87	0.579 89	0.434 88	0.630 96	0.353 84	0.628 77	0.440 87	0.410 83	0.762 101	0.307 90	0.167 83	0.520 68	0.403 88	0.516 84	0.565 90	0.447 92	0.678 92	0.701 89	0.514 84
Davide Menini, Suryansh Kumar, Martin R. Oswald, Erik Sandstroem, Cristian Sminchisescu, Luc van Gool: A Real-Time Learning Framework for Joint 3D Reconstruction and Semantic Segmentation. Robotics and Automation Letters Submission
3DMV, FTSDF	0.501 89	0.558 91	0.608 94	0.424 100	0.478 83	0.690 87	0.246 96	0.586 81	0.468 81	0.450 76	0.911 89	0.394 77	0.160 86	0.438 81	0.212 97	0.432 93	0.541 95	0.475 87	0.742 85	0.727 85	0.477 89

PCNN	0.498 90	0.559 90	0.644 87	0.560 91	0.420 90	0.711 86	0.229 98	0.414 92	0.436 88	0.352 91	0.941 64	0.324 89	0.155 87	0.238 97	0.387 89	0.493 86	0.529 96	0.509 78	0.813 78	0.751 80	0.504 85

3DMV	0.484 91	0.484 97	0.538 98	0.643 81	0.424 89	0.606 99	0.310 88	0.574 83	0.433 90	0.378 86	0.796 99	0.301 91	0.214 64	0.537 66	0.208 98	0.472 91	0.507 99	0.413 97	0.693 90	0.602 98	0.539 77
Angela Dai, Matthias Niessner: 3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation. ECCV'18
PointCNN with RGB	0.458 92	0.577 89	0.611 92	0.356 102	0.321 99	0.715 85	0.299 92	0.376 96	0.328 99	0.319 93	0.944 59	0.285 93	0.164 84	0.216 100	0.229 95	0.484 88	0.545 94	0.456 90	0.755 83	0.709 88	0.475 90
Yangyan Li, Rui Bu, Mingchao Sun, Baoquan Chen: PointCNN. NeurIPS 2018
FCPN	0.447 93	0.679 74	0.604 95	0.578 90	0.380 92	0.682 89	0.291 93	0.106 102	0.483 78	0.258 100	0.920 86	0.258 97	0.025 100	0.231 99	0.325 91	0.480 89	0.560 92	0.463 89	0.725 87	0.666 94	0.231 102
Dario Rethage, Johanna Wald, Jürgen Sturm, Nassir Navab, Federico Tombari: Fully-Convolutional Point Networks for Large-Scale Point Clouds. ECCV 2018
DGCNN_reproduce	0.446 94	0.474 98	0.623 90	0.463 96	0.366 94	0.651 92	0.310 88	0.389 95	0.349 97	0.330 92	0.937 70	0.271 95	0.126 92	0.285 93	0.224 96	0.350 99	0.577 89	0.445 93	0.625 95	0.723 86	0.394 94
Yue Wang, Yongbin Sun, Ziwei Liu, Sanjay E. Sarma, Michael M. Bronstein, Justin M. Solomon: Dynamic Graph CNN for Learning on Point Clouds. TOG 2019
PNET2	0.442 95	0.548 92	0.548 97	0.597 88	0.363 95	0.628 97	0.300 90	0.292 97	0.374 94	0.307 94	0.881 95	0.268 96	0.186 76	0.238 97	0.204 99	0.407 95	0.506 100	0.449 91	0.667 93	0.620 97	0.462 92

SurfaceConvPF	0.442 95	0.505 94	0.622 91	0.380 101	0.342 97	0.654 91	0.227 99	0.397 94	0.367 95	0.276 97	0.924 83	0.240 98	0.198 72	0.359 89	0.262 93	0.366 96	0.581 88	0.435 95	0.640 94	0.668 93	0.398 93
Hao Pan, Shilin Liu, Yang Liu, Xin Tong: Convolutional Neural Networks on 3D Surfaces Using Parallel Frames.
Tangent Convolutions	0.438 97	0.437 100	0.646 86	0.474 95	0.369 93	0.645 93	0.353 84	0.258 99	0.282 101	0.279 96	0.918 88	0.298 92	0.147 91	0.283 94	0.294 92	0.487 87	0.562 91	0.427 96	0.619 96	0.633 96	0.352 97
Maxim Tatarchenko, Jaesik Park, Vladlen Koltun, Qian-Yi Zhou: Tangent convolutions for dense prediction in 3d. CVPR 2018
3DWSSS	0.425 98	0.525 93	0.647 85	0.522 92	0.324 98	0.488 102	0.077 103	0.712 62	0.353 96	0.401 84	0.636 103	0.281 94	0.176 79	0.340 90	0.565 72	0.175 103	0.551 93	0.398 98	0.370 103	0.602 98	0.361 96

SPLAT Net	0.393 99	0.472 99	0.511 99	0.606 85	0.311 100	0.656 90	0.245 97	0.405 93	0.328 99	0.197 101	0.927 82	0.227 100	0.000 103	0.001 104	0.249 94	0.271 102	0.510 97	0.383 100	0.593 98	0.699 90	0.267 100
Hang Su, Varun Jampani, Deqing Sun, Subhransu Maji, Evangelos Kalogerakis, Ming-Hsuan Yang, Jan Kautz: SPLATNet: Sparse Lattice Networks for Point Cloud Processing. CVPR 2018
ScanNet+FTSDF	0.383 100	0.297 102	0.491 100	0.432 99	0.358 96	0.612 98	0.274 94	0.116 101	0.411 92	0.265 98	0.904 92	0.229 99	0.079 97	0.250 95	0.185 100	0.320 100	0.510 97	0.385 99	0.548 99	0.597 101	0.394 94

PointNet++	0.339 101	0.584 88	0.478 101	0.458 97	0.256 102	0.360 103	0.250 95	0.247 100	0.278 102	0.261 99	0.677 102	0.183 101	0.117 93	0.212 101	0.145 102	0.364 97	0.346 103	0.232 103	0.548 99	0.523 102	0.252 101
Charles R. Qi, Li Yi, Hao Su, Leonidas J. Guibas: pointnet++: deep hierarchical feature learning on point sets in a metric space.
SSC-UNet	0.308 102	0.353 101	0.290 103	0.278 103	0.166 103	0.553 100	0.169 102	0.286 98	0.147 103	0.148 103	0.908 90	0.182 102	0.064 98	0.023 103	0.018 104	0.354 98	0.363 101	0.345 101	0.546 101	0.685 91	0.278 99

ScanNet	0.306 103	0.203 103	0.366 102	0.501 93	0.311 100	0.524 101	0.211 101	0.002 104	0.342 98	0.189 102	0.786 100	0.145 103	0.102 94	0.245 96	0.152 101	0.318 101	0.348 102	0.300 102	0.460 102	0.437 103	0.182 103
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner: ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes. CVPR'17
ERROR	0.054 104	0.000 104	0.041 104	0.172 104	0.030 104	0.062 104	0.001 104	0.035 103	0.004 104	0.051 104	0.143 104	0.019 104	0.003 102	0.041 102	0.050 103	0.003 104	0.054 104	0.018 104	0.005 104	0.264 104	0.082 104

This table lists the benchmark results for the 3D semantic instance scenario.

Method	avg ap	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	window

Queryformer	0.583 1	0.926 2	0.702 1	0.393 21	0.504 1	0.733 6	0.276 2	0.527 19	0.373 4	0.479 1	0.534 3	0.533 8	0.697 3	0.720 15	0.436 7	0.745 2	0.592 1	0.958 3	0.363 7

PBNet	0.573 2	0.926 2	0.575 10	0.619 1	0.472 2	0.736 4	0.239 5	0.487 25	0.383 2	0.459 3	0.506 6	0.533 7	0.585 6	0.767 7	0.404 8	0.717 3	0.559 5	0.969 2	0.381 4

Mask3D	0.566 3	0.926 2	0.597 5	0.408 18	0.420 4	0.737 3	0.239 4	0.598 8	0.386 1	0.458 4	0.549 1	0.568 5	0.716 2	0.601 25	0.480 3	0.646 9	0.575 3	0.922 5	0.364 6
Jonas Schult, Francis Engelmann, Alexander Hermans, Or Litany, Siyu Tang, Bastian Leibe: Mask3D for 3D Semantic Instance Segmentation. ICRA 2023
ISBNet	0.559 4	0.926 2	0.597 6	0.390 22	0.436 3	0.722 7	0.276 3	0.556 15	0.380 3	0.450 5	0.505 7	0.583 2	0.730 1	0.575 26	0.455 5	0.603 15	0.573 4	0.979 1	0.332 13
Tuan Duc Ngo, Binh-Son Hua, Khoi Nguyen: ISBNet: a 3D Point Cloud Instance Segmentation Network with Instance-aware Sampling and Box-aware Dynamic Convolution. CVPR 2023
GraphCut	0.552 5	1.000 1	0.611 4	0.438 13	0.392 7	0.714 8	0.139 8	0.598 9	0.327 7	0.389 7	0.510 5	0.598 1	0.427 23	0.754 10	0.463 4	0.761 1	0.588 2	0.903 9	0.329 14

SPFormer	0.549 6	0.745 14	0.640 2	0.484 6	0.395 6	0.739 2	0.311 1	0.566 13	0.335 6	0.468 2	0.492 8	0.555 6	0.478 14	0.747 12	0.436 6	0.712 4	0.540 6	0.893 13	0.343 12
Sun Jiahao, Qing Chunmei, Tan Junpeng, Xu Xiangmin: Superpoint Transformer for 3D Scene Instance Segmentation. AAAI 2023 [Oral]
DKNet	0.532 7	0.815 9	0.624 3	0.517 3	0.377 9	0.749 1	0.107 10	0.509 22	0.304 9	0.437 6	0.475 9	0.581 3	0.539 9	0.775 6	0.339 13	0.640 11	0.506 9	0.901 10	0.385 3
Yizheng Wu, Min Shi, Shuaiyuan Du, Hao Lu, Zhiguo Cao, Weicai Zhong: 3D Instances as 1D Kernels. ECCV 2022
IPCA-Inst	0.520 8	0.889 6	0.551 14	0.548 2	0.418 5	0.665 18	0.064 19	0.585 10	0.260 17	0.277 19	0.471 11	0.500 9	0.644 4	0.785 4	0.369 9	0.591 18	0.511 7	0.878 18	0.362 8

SoftGroup++	0.513 9	0.704 20	0.578 9	0.398 20	0.363 14	0.704 9	0.061 20	0.647 4	0.297 14	0.378 10	0.537 2	0.343 11	0.614 5	0.828 3	0.295 17	0.710 6	0.505 11	0.875 20	0.394 1

SSTNet	0.506 10	0.738 17	0.549 15	0.497 5	0.316 19	0.693 12	0.178 7	0.377 33	0.198 22	0.330 12	0.463 13	0.576 4	0.515 11	0.857 2	0.494 1	0.637 12	0.457 15	0.943 4	0.290 23
Zhihao Liang, Zhihao Li, Songcen Xu, Mingkui Tan, Kui Jia: Instance Segmentation in 3D Scenes using Semantic Superpoint Tree Networks. ICCV2021
SoftGroup	0.504 11	0.667 27	0.579 7	0.372 25	0.381 8	0.694 11	0.072 16	0.677 2	0.303 10	0.387 8	0.531 4	0.319 15	0.582 7	0.754 9	0.318 14	0.643 10	0.492 12	0.907 8	0.388 2
Thang Vu, Kookhoi Kim, Tung M. Luu, Xuan Thanh Nguyen, Chang D. Yoo: SoftGroup for 3D Instance Segmentaiton on Point Clouds. CVPR 2022 [Oral]
TD3D	0.489 12	0.852 7	0.511 23	0.434 14	0.322 18	0.735 5	0.101 13	0.512 21	0.355 5	0.349 11	0.468 12	0.283 19	0.514 12	0.676 21	0.268 22	0.671 7	0.510 8	0.908 7	0.329 15

OccuSeg+instance	0.486 13	0.802 11	0.536 17	0.428 16	0.369 11	0.702 10	0.205 6	0.331 38	0.301 11	0.379 9	0.474 10	0.327 12	0.437 19	0.862 1	0.485 2	0.601 16	0.394 25	0.846 29	0.273 25
Lei Han, Tian Zheng, Lan Xu, Lu Fang: OccuSeg: Occupancy-aware 3D Instance Segmentation. CVPR2020
TopoSeg	0.479 14	0.704 20	0.564 11	0.467 9	0.366 12	0.633 26	0.068 17	0.554 16	0.262 16	0.328 13	0.447 15	0.323 13	0.534 10	0.722 14	0.288 19	0.614 13	0.482 13	0.912 6	0.358 10

DualGroup	0.469 15	0.815 9	0.552 13	0.398 19	0.374 10	0.683 14	0.130 9	0.539 18	0.310 8	0.327 14	0.407 18	0.276 20	0.447 18	0.535 30	0.342 12	0.659 8	0.455 16	0.900 12	0.301 19

SSEC	0.465 16	0.667 27	0.578 8	0.502 4	0.362 15	0.641 25	0.035 28	0.605 6	0.291 15	0.323 15	0.451 14	0.296 17	0.417 25	0.677 20	0.245 26	0.501 34	0.506 10	0.900 11	0.366 5

HAIS	0.457 17	0.704 20	0.561 12	0.457 10	0.364 13	0.673 15	0.046 27	0.547 17	0.194 23	0.308 16	0.426 16	0.288 18	0.454 17	0.711 16	0.262 23	0.563 25	0.434 19	0.889 15	0.344 11
Shaoyu Chen, Jiemin Fang, Qian Zhang, Wenyu Liu, Xinggang Wang: Hierarchical Aggregation for 3D Instance Segmentation. ICCV 2021
DD-UNet+Group	0.436 18	0.630 34	0.508 26	0.480 7	0.310 20	0.624 29	0.065 18	0.638 5	0.174 24	0.256 23	0.384 21	0.194 31	0.428 21	0.759 8	0.289 18	0.574 22	0.400 23	0.849 27	0.291 22
H. Liu, R. Liu, K. Yang, J. Zhang, K. Peng, R. Stiefelhagen: HIDA: Towards Holistic Indoor Understanding for the Visually Impaired via Semantic Instance Segmentation with a Wearable Solid-State LiDAR Sensor. ICCVW 2021
INS-Conv-instance	0.435 19	0.716 19	0.495 28	0.355 27	0.331 16	0.689 13	0.102 12	0.394 32	0.208 21	0.280 17	0.395 20	0.250 23	0.544 8	0.741 13	0.309 16	0.536 31	0.391 26	0.842 32	0.258 29

Mask-Group	0.434 20	0.778 12	0.516 21	0.471 8	0.330 17	0.658 19	0.029 30	0.526 20	0.249 18	0.256 22	0.400 19	0.309 16	0.384 29	0.296 46	0.368 10	0.575 21	0.425 20	0.877 19	0.362 9
Min Zhong, Xinghao Chen, Xiaokang Chen, Gang Zeng, Yunhe Wang: MaskGroup: Hierarchical Point Grouping and Masking for 3D Instance Segmentation. ICME 2022
Box2Mask	0.433 21	0.741 15	0.463 33	0.433 15	0.283 22	0.625 28	0.103 11	0.298 42	0.125 32	0.260 21	0.424 17	0.322 14	0.472 15	0.701 18	0.363 11	0.711 5	0.309 40	0.882 16	0.272 27
Julian Chibane, Francis Engelmann, Tuan Anh Tran, Gerard Pons-Moll: Box2Mask: Weakly Supervised 3D Semantic Instance Segmentation Using Bounding Boxes. ECCV 2022
RPGN	0.428 22	0.630 34	0.508 25	0.367 26	0.249 29	0.658 20	0.016 37	0.673 3	0.131 30	0.234 26	0.383 22	0.270 21	0.434 20	0.748 11	0.274 21	0.609 14	0.406 22	0.842 31	0.267 28
Shichao Dong, Guosheng Lin, Tzu-Yi Hung: Learning Regional Purity for Instance Segmentation on 3D Point Clouds. ECCV 2022
DENet	0.413 23	0.741 15	0.520 19	0.237 38	0.284 21	0.523 36	0.097 14	0.691 1	0.138 27	0.209 36	0.229 38	0.238 25	0.390 27	0.707 17	0.310 15	0.448 41	0.470 14	0.892 14	0.310 17

PointGroup	0.407 24	0.639 33	0.496 27	0.415 17	0.243 31	0.645 24	0.021 35	0.570 12	0.114 33	0.211 34	0.359 24	0.217 29	0.428 22	0.660 22	0.256 24	0.562 26	0.341 32	0.860 23	0.291 21
Li Jiang, Hengshuang Zhao, Shaoshuai Shi, Shu Liu, Chi-Wing Fu, Jiaya Jia: PointGroup: Dual-Set Point Grouping for 3D Instance Segmentation. CVPR 2020 [oral]
CSC-Pretrained	0.405 25	0.738 17	0.465 32	0.331 31	0.205 35	0.655 21	0.051 24	0.601 7	0.092 36	0.211 35	0.329 27	0.198 30	0.459 16	0.775 5	0.195 33	0.524 33	0.400 24	0.878 17	0.184 37

PE	0.396 26	0.667 27	0.467 31	0.446 12	0.243 30	0.624 30	0.022 34	0.577 11	0.106 34	0.219 29	0.340 25	0.239 24	0.487 13	0.475 37	0.225 28	0.541 30	0.350 30	0.818 33	0.273 26
Biao Zhang, Peter Wonka: Point Cloud Instance Segmentation using Probabilistic Embeddings. CVPR 2021
Dyco3D	0.395 27	0.642 32	0.518 20	0.447 11	0.259 28	0.666 17	0.050 25	0.251 46	0.166 25	0.231 27	0.362 23	0.232 26	0.331 32	0.535 29	0.229 27	0.587 19	0.438 18	0.850 25	0.317 16
Tong He; Chunhua Shen; Anton van den Hengel: DyCo3D: Robust Instance Segmentation of 3D Point Clouds through Dynamic Convolution. CVPR2021
OSIS	0.392 28	0.778 12	0.530 18	0.220 40	0.278 23	0.567 33	0.083 15	0.330 39	0.299 12	0.270 20	0.310 30	0.143 36	0.260 36	0.624 24	0.277 20	0.568 24	0.361 28	0.865 22	0.301 18

AOIA	0.387 29	0.704 20	0.515 22	0.385 23	0.225 34	0.669 16	0.005 43	0.482 26	0.126 31	0.181 39	0.269 35	0.221 28	0.426 24	0.478 36	0.218 29	0.592 17	0.371 27	0.851 24	0.242 31

SSEN	0.384 30	0.852 7	0.494 29	0.192 41	0.226 33	0.648 23	0.022 33	0.398 31	0.299 13	0.277 18	0.317 29	0.231 27	0.194 43	0.514 33	0.196 31	0.586 20	0.444 17	0.843 30	0.184 36
Dongsu Zhang, Junha Chun, Sang Kyun Cha, Young Min Kim: Spatial Semantic Embedding Network: Fast 3D Instance Segmentation with Deep Metric Learning. Arxiv
PCJC	0.375 31	0.704 20	0.542 16	0.284 35	0.197 37	0.649 22	0.006 41	0.426 27	0.138 28	0.242 24	0.304 31	0.183 34	0.388 28	0.629 23	0.141 43	0.546 29	0.344 31	0.738 39	0.283 24

SphereSeg	0.357 32	0.651 31	0.411 35	0.345 28	0.264 27	0.630 27	0.059 21	0.289 44	0.212 19	0.240 25	0.336 26	0.158 35	0.305 33	0.557 27	0.159 39	0.455 40	0.341 33	0.726 41	0.294 20

3D-MPA	0.355 33	0.457 45	0.484 30	0.299 33	0.277 24	0.591 32	0.047 26	0.332 36	0.212 20	0.217 30	0.278 32	0.193 32	0.413 26	0.410 40	0.195 32	0.574 23	0.352 29	0.849 26	0.213 34
Francis Engelmann, Martin Bokeloh, Alireza Fathi, Bastian Leibe, Matthias Nießner: 3D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentation. CVPR 2020
NeuralBF	0.353 34	0.593 36	0.511 24	0.375 24	0.264 26	0.597 31	0.008 39	0.332 37	0.160 26	0.229 28	0.274 34	0.000 56	0.206 40	0.678 19	0.155 40	0.485 36	0.422 21	0.816 34	0.254 30
Weiwei Sun, Daniel Rebain, Renjie Liao, Vladimir Tankovich, Soroosh Yazdani, Kwang Moo Yi, Andrea Tagliasacchi: NeuralBF: Neural Bilateral Filtering for Top-down Instance Segmentation on Point Clouds. WACV 2023
RWSeg	0.348 35	0.475 42	0.456 34	0.320 32	0.275 25	0.476 38	0.020 36	0.491 24	0.056 43	0.212 33	0.320 28	0.261 22	0.302 34	0.520 31	0.182 35	0.557 27	0.285 42	0.867 21	0.197 35

GICN	0.341 36	0.580 37	0.371 37	0.344 29	0.198 36	0.469 39	0.052 23	0.564 14	0.093 35	0.212 32	0.212 40	0.127 38	0.347 31	0.537 28	0.206 30	0.525 32	0.329 35	0.729 40	0.241 32

One_Thing_One_Click	0.326 37	0.472 43	0.361 38	0.232 39	0.183 38	0.555 34	0.000 49	0.498 23	0.038 45	0.195 37	0.226 39	0.362 10	0.168 44	0.469 38	0.251 25	0.553 28	0.335 34	0.846 28	0.117 45
Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu: One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation. CVPR 2021
Occipital-SCS	0.320 38	0.679 26	0.352 39	0.334 30	0.229 32	0.436 40	0.025 31	0.412 30	0.058 41	0.161 44	0.240 37	0.085 40	0.262 35	0.496 35	0.187 34	0.467 38	0.328 36	0.775 35	0.231 33

Sparse R-CNN	0.292 39	0.704 20	0.213 49	0.153 43	0.154 40	0.551 35	0.053 22	0.212 47	0.132 29	0.174 41	0.274 33	0.070 42	0.363 30	0.441 39	0.176 36	0.424 43	0.234 44	0.758 37	0.161 41

MTML	0.282 40	0.577 38	0.380 36	0.182 42	0.107 46	0.430 41	0.001 46	0.422 28	0.057 42	0.179 40	0.162 43	0.070 43	0.229 38	0.511 34	0.161 37	0.491 35	0.313 37	0.650 46	0.162 39
Jean Lahoud, Bernard Ghanem, Marc Pollefeys, Martin R. Oswald: 3D Instance Segmentation via Multi-task Metric Learning. ICCV 2019 [oral]
SALoss-ResNet	0.262 41	0.667 27	0.335 40	0.067 50	0.123 44	0.427 42	0.022 32	0.280 45	0.058 40	0.216 31	0.211 41	0.039 46	0.142 46	0.519 32	0.106 47	0.338 47	0.310 39	0.721 42	0.138 42
Zhidong Liang, Ming Yang, Hao Li, Chunxiang Wang: 3D Instance Embedding Learning With a Structure-Aware Loss Function for Point Cloud Segmentation. IEEE Robotics and Automation Letters (IROS2020)
MASC	0.254 42	0.463 44	0.249 48	0.113 44	0.167 39	0.412 44	0.000 48	0.374 34	0.073 37	0.173 42	0.243 36	0.130 37	0.228 39	0.368 42	0.160 38	0.356 45	0.208 45	0.711 43	0.136 43
Chen Liu, Yasutaka Furukawa: MASC: Multi-scale Affinity with Sparse Convolution for 3D Instance Segmentation.
3D-BoNet	0.253 43	0.519 40	0.324 43	0.251 37	0.137 43	0.345 49	0.031 29	0.419 29	0.069 38	0.162 43	0.131 45	0.052 44	0.202 42	0.338 44	0.147 42	0.301 50	0.303 41	0.651 45	0.178 38
Bo Yang, Jianan Wang, Ronald Clark, Qingyong Hu, Sen Wang, Andrew Markham, Niki Trigoni: Learning Object Bounding Boxes for 3D Instance Segmentation on Point Clouds. NeurIPS 2019 Spotlight
SPG_WSIS	0.251 44	0.380 47	0.274 46	0.289 34	0.144 41	0.413 43	0.000 49	0.311 40	0.065 39	0.113 46	0.130 46	0.029 48	0.204 41	0.388 41	0.108 46	0.459 39	0.311 38	0.769 36	0.127 44

SegGroup_ins	0.246 45	0.556 39	0.335 41	0.062 52	0.115 45	0.490 37	0.000 49	0.297 43	0.018 49	0.186 38	0.142 44	0.083 41	0.233 37	0.216 48	0.153 41	0.469 37	0.251 43	0.744 38	0.083 48
An Tao, Yueqi Duan, Yi Wei, Jiwen Lu, Jie Zhou: SegGroup: Seg-Level Supervision for 3D Instance and Semantic Segmentation. TIP 2022
PanopticFusion-inst	0.214 46	0.250 51	0.330 42	0.275 36	0.103 47	0.228 55	0.000 49	0.345 35	0.024 47	0.088 48	0.203 42	0.186 33	0.167 45	0.367 43	0.125 44	0.221 53	0.112 55	0.666 44	0.162 40
Gaku Narita, Takashi Seno, Tomoya Ishikawa, Yohsuke Kaji: PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Things. IROS 2019 (to appear)
UNet-backbone	0.161 47	0.519 40	0.259 47	0.084 46	0.059 49	0.325 51	0.002 44	0.093 52	0.009 51	0.077 50	0.064 49	0.045 45	0.044 53	0.161 50	0.045 49	0.331 48	0.180 47	0.566 47	0.033 56

3D-SIS	0.161 47	0.407 46	0.155 53	0.068 49	0.043 53	0.346 48	0.001 45	0.134 49	0.005 52	0.088 47	0.106 48	0.037 47	0.135 48	0.321 45	0.028 52	0.339 46	0.116 54	0.466 50	0.093 47
Ji Hou, Angela Dai, Matthias Niessner: 3D-SIS: 3D Semantic Instance Segmentation of RGB-D Scans. CVPR 2019
R-PointNet	0.158 49	0.356 48	0.173 51	0.113 45	0.140 42	0.359 45	0.012 38	0.023 54	0.039 44	0.134 45	0.123 47	0.008 52	0.089 49	0.149 51	0.117 45	0.221 52	0.128 52	0.563 48	0.094 46

Region-18class	0.146 50	0.175 55	0.321 44	0.080 47	0.062 48	0.357 46	0.000 49	0.307 41	0.002 53	0.066 51	0.044 51	0.000 56	0.018 55	0.036 55	0.054 48	0.447 42	0.133 50	0.472 49	0.060 51

SemRegionNet-20cls	0.121 51	0.296 50	0.203 50	0.071 48	0.058 50	0.349 47	0.000 49	0.150 48	0.019 48	0.054 52	0.034 53	0.017 51	0.052 51	0.042 54	0.013 55	0.209 54	0.183 46	0.371 51	0.057 52

3D-BEVIS	0.117 52	0.250 51	0.308 45	0.020 56	0.009 57	0.269 54	0.006 42	0.008 55	0.029 46	0.037 55	0.014 56	0.003 54	0.036 54	0.147 52	0.042 50	0.381 44	0.118 53	0.362 52	0.069 50
Cathrin Elich, Francis Engelmann, Jonas Schult, Theodora Kontogianni, Bastian Leibe: 3D-BEVIS: Birds-Eye-View Instance Segmentation.
Hier3D	0.117 52	0.222 53	0.161 52	0.054 54	0.027 54	0.289 52	0.000 49	0.124 50	0.001 55	0.079 49	0.061 50	0.027 49	0.141 47	0.240 47	0.005 56	0.310 49	0.129 51	0.153 56	0.081 49
Tan: HCFS3D: Hierarchical Coupled Feature Selection Network for 3D Semantic and Instance Segmentation.
tmp	0.113 54	0.333 49	0.151 54	0.056 53	0.053 51	0.344 50	0.000 49	0.105 51	0.016 50	0.049 53	0.035 52	0.020 50	0.053 50	0.048 53	0.013 54	0.183 55	0.173 48	0.344 53	0.054 53

ASIS	0.085 55	0.037 56	0.080 56	0.066 51	0.047 52	0.282 53	0.000 49	0.052 53	0.002 54	0.047 54	0.026 54	0.001 55	0.046 52	0.194 49	0.031 51	0.264 51	0.140 49	0.167 55	0.047 55

Sgpn_scannet	0.049 56	0.023 57	0.134 55	0.031 55	0.013 56	0.144 56	0.006 40	0.008 56	0.000 56	0.028 56	0.017 55	0.003 53	0.009 57	0.000 56	0.021 53	0.122 56	0.095 56	0.175 54	0.054 54

MaskRCNN 2d->3d Proj	0.022 57	0.185 54	0.000 57	0.000 57	0.015 55	0.000 57	0.000 47	0.006 57	0.000 56	0.010 57	0.006 57	0.107 39	0.012 56	0.000 56	0.002 57	0.027 57	0.004 57	0.022 57	0.001 57

Method	avg iou	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	floor	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	wall	window

Virtual MVFusion (R)	0.745 1	0.861 1	0.839 1	0.881 1	0.672 1	0.512 1	0.422 15	0.898 1	0.723 1	0.714 1	0.954 2	0.454 1	0.509 1	0.773 1	0.895 1	0.756 1	0.820 1	0.653 1	0.935 1	0.891 1	0.728 1
Abhijit Kundu, Xiaoqi Yin, Alireza Fathi, David Ross, Brian Brewington, Thomas Funkhouser, Caroline Pantofaru: Virtual Multi-view Fusion for 3D Semantic Segmentation. ECCV 2020
BPNet_2D	0.670 2	0.822 3	0.795 3	0.836 2	0.659 2	0.481 2	0.451 11	0.769 3	0.656 3	0.567 3	0.931 3	0.395 4	0.390 4	0.700 3	0.534 3	0.689 9	0.770 2	0.574 3	0.865 6	0.831 3	0.675 4
Wenbo Hu, Hengshuang Zhao, Li Jiang, Jiaya Jia and Tien-Tsin Wong: Bidirectional Projection Network for Cross Dimension Scene Understanding. CVPR 2021 (Oral)
CU-Hybrid-2D Net	0.636 3	0.825 2	0.820 2	0.179 20	0.648 3	0.463 3	0.549 2	0.742 6	0.676 2	0.628 2	0.961 1	0.420 2	0.379 5	0.684 6	0.381 15	0.732 2	0.723 3	0.599 2	0.827 13	0.851 2	0.634 6

CMX	0.613 4	0.681 7	0.725 9	0.502 12	0.634 5	0.297 15	0.478 9	0.830 2	0.651 4	0.537 6	0.924 4	0.375 5	0.315 12	0.686 5	0.451 12	0.714 4	0.543 18	0.504 5	0.894 4	0.823 4	0.688 3

DMMF_3d	0.605 5	0.651 8	0.744 7	0.782 3	0.637 4	0.387 4	0.536 3	0.732 7	0.590 6	0.540 5	0.856 18	0.359 9	0.306 13	0.596 11	0.539 2	0.627 18	0.706 4	0.497 7	0.785 18	0.757 16	0.476 19

MCA-Net	0.595 6	0.533 17	0.756 6	0.746 4	0.590 8	0.334 7	0.506 6	0.670 12	0.587 7	0.500 10	0.905 8	0.366 8	0.352 8	0.601 10	0.506 6	0.669 15	0.648 7	0.501 6	0.839 12	0.769 12	0.516 18

RFBNet	0.592 7	0.616 9	0.758 5	0.659 5	0.581 9	0.330 8	0.469 10	0.655 15	0.543 12	0.524 7	0.924 4	0.355 10	0.336 10	0.572 14	0.479 8	0.671 13	0.648 7	0.480 9	0.814 16	0.814 5	0.614 9

FAN_NV_RVC	0.586 8	0.510 18	0.764 4	0.079 23	0.620 7	0.330 8	0.494 7	0.753 4	0.573 8	0.556 4	0.884 13	0.405 3	0.303 14	0.718 2	0.452 11	0.672 12	0.658 5	0.509 4	0.898 3	0.813 6	0.727 2

DCRedNet	0.583 9	0.682 6	0.723 10	0.542 11	0.510 17	0.310 12	0.451 11	0.668 13	0.549 11	0.520 8	0.920 6	0.375 5	0.446 2	0.528 17	0.417 13	0.670 14	0.577 15	0.478 10	0.862 7	0.806 7	0.628 8

MIX6D_RVC	0.582 10	0.695 4	0.687 14	0.225 18	0.632 6	0.328 10	0.550 1	0.748 5	0.623 5	0.494 13	0.890 11	0.350 12	0.254 20	0.688 4	0.454 10	0.716 3	0.597 14	0.489 8	0.881 5	0.768 13	0.575 12

SSMA	0.577 11	0.695 4	0.716 12	0.439 14	0.563 11	0.314 11	0.444 13	0.719 8	0.551 10	0.503 9	0.887 12	0.346 13	0.348 9	0.603 9	0.353 17	0.709 5	0.600 12	0.457 12	0.901 2	0.786 8	0.599 11
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. International Journal of Computer Vision, 2019
UNIV_CNP_RVC_UE	0.566 12	0.569 16	0.686 16	0.435 15	0.524 14	0.294 16	0.421 16	0.712 9	0.543 12	0.463 15	0.872 14	0.320 14	0.363 7	0.611 8	0.477 9	0.686 10	0.627 9	0.443 15	0.862 7	0.775 11	0.639 5

EMSAFormer	0.564 13	0.581 13	0.736 8	0.564 10	0.546 13	0.219 20	0.517 4	0.675 11	0.486 17	0.427 19	0.904 9	0.352 11	0.320 11	0.589 12	0.528 4	0.708 6	0.464 21	0.413 19	0.847 11	0.786 8	0.611 10

SN_RN152pyrx8_RVC	0.546 14	0.572 14	0.663 18	0.638 7	0.518 15	0.298 14	0.366 21	0.633 18	0.510 15	0.446 17	0.864 16	0.296 17	0.267 17	0.542 16	0.346 18	0.704 7	0.575 16	0.431 16	0.853 10	0.766 14	0.630 7

UDSSEG_RVC	0.545 15	0.610 11	0.661 19	0.588 8	0.556 12	0.268 18	0.482 8	0.642 17	0.572 9	0.475 14	0.836 20	0.312 15	0.367 6	0.630 7	0.189 20	0.639 17	0.495 20	0.452 13	0.826 14	0.756 17	0.541 14

segfomer with 6d	0.542 16	0.594 12	0.687 14	0.146 21	0.579 10	0.308 13	0.515 5	0.703 10	0.472 18	0.498 11	0.868 15	0.369 7	0.282 15	0.589 12	0.390 14	0.701 8	0.556 17	0.416 18	0.860 9	0.759 15	0.539 16

FuseNet	0.535 17	0.570 15	0.681 17	0.182 19	0.512 16	0.290 17	0.431 14	0.659 14	0.504 16	0.495 12	0.903 10	0.308 16	0.428 3	0.523 18	0.365 16	0.676 11	0.621 11	0.470 11	0.762 19	0.779 10	0.541 14
Caner Hazirbas, Lingni Ma, Csaba Domokos, Daniel Cremers: FuseNet: Incorporating Depth into Semantic Segmentation via Fusion-based CNN Architecture. ACCV 2016
AdapNet++	0.503 18	0.613 10	0.722 11	0.418 16	0.358 23	0.337 6	0.370 20	0.479 21	0.443 19	0.368 21	0.907 7	0.207 20	0.213 22	0.464 21	0.525 5	0.618 19	0.657 6	0.450 14	0.788 17	0.721 20	0.408 22
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. International Journal of Computer Vision, 2019
3DMV (2d proj)	0.498 19	0.481 21	0.612 20	0.579 9	0.456 19	0.343 5	0.384 18	0.623 19	0.525 14	0.381 20	0.845 19	0.254 19	0.264 19	0.557 15	0.182 21	0.581 21	0.598 13	0.429 17	0.760 20	0.661 22	0.446 21
Angela Dai, Matthias Niessner: 3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation. ECCV'18
MSeg1080_RVC	0.485 20	0.505 19	0.709 13	0.092 22	0.427 20	0.241 19	0.411 17	0.654 16	0.385 23	0.457 16	0.861 17	0.053 23	0.279 16	0.503 19	0.481 7	0.645 16	0.626 10	0.365 21	0.748 21	0.725 19	0.529 17
John Lambert, Zhuang Liu, Ozan Sener, James Hays, Vladlen Koltun: MSeg: A Composite Dataset for Multi-domain Semantic Segmentation. CVPR 2020
ILC-PSPNet	0.475 21	0.490 20	0.581 21	0.289 17	0.507 18	0.067 23	0.379 19	0.610 20	0.417 21	0.435 18	0.822 22	0.278 18	0.267 17	0.503 19	0.228 19	0.616 20	0.533 19	0.375 20	0.820 15	0.729 18	0.560 13

Enet (reimpl)	0.376 22	0.264 23	0.452 23	0.452 13	0.365 21	0.181 21	0.143 23	0.456 22	0.409 22	0.346 22	0.769 23	0.164 21	0.218 21	0.359 22	0.123 23	0.403 23	0.381 23	0.313 23	0.571 22	0.685 21	0.472 20
Re-implementation of Adam Paszke, Abhishek Chaurasia, Sangpil Kim, Eugenio Culurciello: ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation.
ScanNet (2d proj)	0.330 23	0.293 22	0.521 22	0.657 6	0.361 22	0.161 22	0.250 22	0.004 23	0.440 20	0.183 23	0.836 20	0.125 22	0.060 23	0.319 23	0.132 22	0.417 22	0.412 22	0.344 22	0.541 23	0.427 23	0.109 23
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner: ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes. CVPR'17
DMMF	0.003 24	0.000 24	0.005 24	0.000 24	0.000 24	0.037 24	0.001 24	0.000 24	0.001 24	0.005 24	0.003 24	0.000 24	0.000 24	0.000 24	0.000 24	0.000 24	0.002 24	0.001 24	0.000 24	0.006 24	0.000 24

Presenting the ScanNet200 Benchmark

ScanNet200 Benchmark

ScanNet200 3D Semantic Label Benchmark

ScanNet200 3D Semantic Instance Benchmark

ScanNet Benchmark

3D Semantic Label Benchmark

3D Semantic Instance Benchmark

2D Semantic Label Benchmark

2D Semantic Instance Benchmark

Scene Type Classification Benchmark

Method	avg ap	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	window

UniDet_RVC	0.205 1	0.381 1	0.323 1	0.037 1	0.226 1	0.177 1	0.063 1	0.277 1	0.120 1	0.067 1	0.131 1	0.074 2	0.317 1	0.080 1	0.235 1	0.289 1	0.141 1	0.678 1	0.080 1

MaskRCNN_ScanNet	0.119 2	0.129 2	0.212 2	0.002 2	0.112 2	0.148 2	0.014 2	0.205 2	0.044 2	0.066 2	0.078 2	0.095 1	0.142 2	0.030 2	0.128 2	0.139 2	0.080 2	0.459 2	0.057 2
Re-implementation of Kaiming He, Georgia Gkioxari, Piotr Dollár, Ross Girshick: Mask R-CNN. ICCV'17

Method	avg recall	apartment	bathroom	bedroom / hotel	bookstore / library	conference room	copy/mail room	hallway	kitchen	laundry room	living room / lounge	misc	office	storage / basement / garage

multi-task	0.700 1	0.500 1	1.000 1	0.882 2	0.500 2	1.000 1	1.000 1	0.500 2	1.000 1	1.000 1	0.778 1	0.000 2	0.938 1	0.000 2
Shengyu Huang, Mikhail Usvyatsov, Konrad Schindler: Indoor Scene Recognition in 3D. IROS 2020
3DASPP-SCE	0.691 2	0.500 1	0.938 2	0.824 3	1.000 1	1.000 1	0.500 2	1.000 1	0.857 2	0.500 2	0.556 3	0.000 2	0.812 2	0.500 1

SE-ResNeXt-SSMA	0.498 3	0.000 4	0.812 3	0.941 1	0.500 2	0.500 3	0.500 2	0.500 2	0.429 4	0.500 2	0.667 2	0.500 1	0.625 3	0.000 2
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. arXiv
resnet50_scannet	0.353 4	0.250 3	0.812 3	0.529 4	0.500 2	0.500 3	0.000 4	0.500 2	0.571 3	0.000 4	0.556 3	0.000 2	0.375 4	0.000 2