Benchmark Results - ScanNet Benchmark

This table lists the benchmark results for the ScanNet200 3D semantic label scenario.

Method	avg iou	head iou	common iou	tail iou	backpack	bag	ball	bar	basket	bathroom cabinet	bathroom stall	bathroom stall door	bathroom vanity	bathtub	bed	bench	bicycle	bin	blackboard	blanket	blinds	board	book	bookshelf	bottle	bowl	box	broom	bucket	bulletin board	cabinet	calendar	candle	cart	case of water bottles	ceiling	ceiling light	chair	clock	closet	closet rod	clothes	clothes dryer	coat rack	coffee kettle	coffee maker	coffee table	column	computer tower	copier	couch	counter	cup	curtain	cushion	decoration	desk	dining table	dish rack	dishwasher	door	doorframe	dresser	dumbbell	end table	fan	file cabinet	fire alarm	fire extinguisher	floor	folded chair	hat	headphones	ironing board	jacket	keyboard	keyboard piano	kitchen cabinet	kitchen counter	ladder	lamp	laptop	laundry basket	laundry detergent	laundry hamper	ledge	light	light switch	machine	mailbox	mat	microwave	mini fridge	mirror	monitor	mouse	music stand	nightstand	object	office chair	oven	paper	paper bag	paper cutter	paper towel dispenser	paper towel roll	person	piano	picture	pillow	pipe	plant	plate	plunger	poster	power outlet	power strip	printer	projector	projector screen	rack	radiator	range hood	recycling bin	refrigerator	scale	seat	shelf	shoe	shower	shower curtain	shower curtain rod	shower floor	shower head	shower wall	sign	sink	soap dispenser	sofa chair	speaker	stair rail	stairs	stand	stool	storage bin	storage container	storage organizer	stove	structure	stuffed animal	suitcase	table	telephone	tissue box	toaster	toilet	toilet paper	toilet paper dispenser	towel	trash bin	trash can	tray	tube	tv	tv stand	vacuum cleaner	vent	wall	wardrobe	washing machine	water bottle	water cooler	water pitcher	whiteboard	window	windowsill

CSC-Pretrain	0.249 5	0.455 5	0.171 4	0.079 5	0.418 4	0.059 4	0.186 3	0.000 1	0.000 1	0.000 1	0.335 5	0.250 4	0.316 4	0.766 3	0.697 5	0.142 2	0.170 2	0.003 2	0.553 4	0.112 1	0.097 1	0.201 5	0.186 2	0.476 5	0.081 4	0.000 3	0.216 5	0.000 1	0.000 2	0.001 5	0.314 5	0.000 3	0.000 1	0.055 3	0.000 2	0.832 5	0.094 1	0.659 3	0.002 1	0.076 2	0.310 5	0.293 5	0.664 5	0.000 1	0.000 1	0.175 5	0.634 1	0.130 2	0.552 5	0.686 5	0.700 5	0.076 3	0.110 3	0.770 5	0.000 1	0.000 2	0.430 5	0.000 5	0.319 3	0.166 4	0.542 5	0.327 4	0.205 4	0.332 4	0.052 5	0.375 1	0.444 5	0.000 2	0.012 5	0.930 5	0.203 1	0.000 1	0.000 3	0.046 1	0.175 2	0.413 4	0.592 3	0.471 4	0.299 3	0.152 5	0.340 4	0.247 5	0.000 1	0.000 1	0.225 3	0.058 2	0.037 2	0.000 3	0.207 1	0.862 5	0.014 3	0.548 3	0.033 4	0.233 4	0.816 4	0.000 3	0.000 1	0.542 5	0.123 2	0.121 1	0.019 1	0.000 1	0.000 1	0.463 4	0.454 5	0.045 5	0.128 5	0.557 4	0.235 3	0.441 4	0.063 5	0.484 5	0.000 2	0.308 5	0.000 1	0.000 2	0.000 1	0.318 5	0.000 1	0.000 2	0.000 1	0.545 4	0.543 4	0.164 5	0.734 2	0.000 2	0.000 1	0.215 5	0.371 4	0.198 2	0.743 2	0.205 5	0.062 5	0.000 3	0.079 3	0.000 1	0.683 4	0.547 4	0.142 3	0.000 4	0.441 2	0.579 5	0.000 1	0.464 3	0.098 2	0.041 1	0.000 1	0.590 4	0.000 2	0.000 1	0.373 1	0.494 2	0.174 3	0.105 4	0.001 5	0.895 4	0.222 4	0.537 3	0.307 4	0.180 3	0.625 2	0.000 1	0.000 3	0.591 5	0.609 4	0.398 3	0.000 1	0.766 5	0.014 5	0.638 5	0.000 1	0.377 2	0.004 4	0.206 5	0.609 5	0.465 2
Ji Hou, Benjamin Graham, Matthias Nießner, Saining Xie: Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts. CVPR 2021
LGround	0.272 3	0.485 3	0.184 3	0.106 3	0.476 1	0.077 2	0.218 1	0.000 1	0.000 1	0.000 1	0.547 1	0.295 3	0.540 1	0.746 4	0.745 3	0.058 4	0.112 4	0.005 1	0.658 2	0.077 5	0.000 3	0.322 3	0.178 4	0.512 3	0.190 2	0.199 1	0.277 3	0.000 1	0.000 2	0.173 1	0.399 2	0.000 3	0.000 1	0.039 4	0.000 2	0.858 3	0.085 4	0.676 1	0.002 1	0.103 1	0.498 2	0.323 2	0.703 3	0.000 1	0.000 1	0.296 3	0.549 3	0.216 1	0.702 2	0.768 3	0.718 3	0.028 4	0.092 4	0.786 4	0.000 1	0.000 2	0.453 4	0.022 3	0.251 5	0.252 2	0.572 3	0.348 3	0.321 2	0.514 2	0.063 4	0.279 4	0.552 3	0.000 2	0.019 4	0.932 3	0.132 4	0.000 1	0.000 3	0.000 4	0.156 5	0.457 3	0.623 2	0.518 2	0.265 4	0.358 3	0.381 3	0.395 3	0.000 1	0.000 1	0.127 5	0.012 3	0.051 1	0.000 3	0.000 2	0.886 4	0.014 3	0.437 5	0.179 1	0.244 3	0.826 3	0.000 3	0.000 1	0.599 3	0.136 1	0.085 2	0.000 3	0.000 1	0.000 1	0.565 2	0.612 3	0.143 1	0.207 3	0.566 3	0.232 4	0.446 3	0.127 2	0.708 3	0.000 2	0.384 3	0.000 1	0.000 2	0.000 1	0.402 2	0.000 1	0.059 1	0.000 1	0.525 5	0.566 3	0.229 3	0.659 3	0.000 2	0.000 1	0.265 3	0.446 2	0.147 4	0.720 5	0.597 2	0.066 4	0.000 3	0.187 1	0.000 1	0.726 2	0.467 5	0.134 4	0.000 4	0.413 3	0.629 2	0.000 1	0.363 4	0.055 3	0.022 2	0.000 1	0.626 2	0.000 2	0.000 1	0.323 3	0.479 5	0.154 4	0.117 3	0.028 4	0.901 3	0.243 3	0.415 5	0.295 5	0.143 4	0.610 4	0.000 1	0.000 3	0.777 2	0.397 5	0.324 4	0.000 1	0.778 3	0.179 3	0.702 4	0.000 1	0.274 5	0.404 1	0.233 2	0.622 3	0.398 3
David Rozenberszki, Or Litany, Angela Dai: Language-Grounded Indoor 3D Semantic Segmentation in the Wild. arXiv
Minkowski 34D	0.253 4	0.463 4	0.154 5	0.102 4	0.381 5	0.084 1	0.134 5	0.000 1	0.000 1	0.000 1	0.386 4	0.141 5	0.279 5	0.737 5	0.703 4	0.014 5	0.164 3	0.000 3	0.663 1	0.092 4	0.000 3	0.224 4	0.291 1	0.531 2	0.056 5	0.000 3	0.242 4	0.000 1	0.000 2	0.013 3	0.331 4	0.000 3	0.000 1	0.035 5	0.001 1	0.858 3	0.059 5	0.650 4	0.000 3	0.056 4	0.353 4	0.299 3	0.670 4	0.000 1	0.000 1	0.284 4	0.484 4	0.071 3	0.594 4	0.720 4	0.710 4	0.027 5	0.068 5	0.813 2	0.000 1	0.005 1	0.492 3	0.164 1	0.274 4	0.111 5	0.571 4	0.307 5	0.293 3	0.307 5	0.150 2	0.163 5	0.531 4	0.002 1	0.545 1	0.932 3	0.093 5	0.000 1	0.000 3	0.002 3	0.159 3	0.368 5	0.581 4	0.440 5	0.228 5	0.406 2	0.282 5	0.294 4	0.000 1	0.000 1	0.189 4	0.060 1	0.036 3	0.000 3	0.000 2	0.897 2	0.000 5	0.525 4	0.025 5	0.205 5	0.771 5	0.000 3	0.000 1	0.593 4	0.108 4	0.044 3	0.000 3	0.000 1	0.000 1	0.282 5	0.589 4	0.094 4	0.169 4	0.466 5	0.227 5	0.419 5	0.125 3	0.757 2	0.002 1	0.334 4	0.000 1	0.000 2	0.000 1	0.357 3	0.000 1	0.000 2	0.000 1	0.582 3	0.513 5	0.337 2	0.612 5	0.000 2	0.000 1	0.250 4	0.352 5	0.136 5	0.724 4	0.655 1	0.280 2	0.000 3	0.046 5	0.000 1	0.606 5	0.559 3	0.159 2	0.102 1	0.445 1	0.655 1	0.000 1	0.310 5	0.117 1	0.000 3	0.000 1	0.581 5	0.026 1	0.000 1	0.265 5	0.483 4	0.084 5	0.097 5	0.044 3	0.865 5	0.142 5	0.588 2	0.351 3	0.272 2	0.596 5	0.000 1	0.003 2	0.622 4	0.720 2	0.096 5	0.000 1	0.771 4	0.016 4	0.772 3	0.000 1	0.302 3	0.194 2	0.214 4	0.621 4	0.197 5
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019
CeCo	0.340 1	0.551 1	0.247 1	0.181 1	0.475 2	0.057 5	0.142 4	0.000 1	0.000 1	0.000 1	0.387 3	0.463 2	0.499 3	0.924 1	0.774 1	0.213 1	0.257 1	0.000 3	0.546 5	0.100 2	0.006 2	0.615 1	0.177 5	0.534 1	0.246 1	0.000 3	0.400 1	0.000 1	0.338 1	0.006 4	0.484 1	0.609 1	0.000 1	0.083 1	0.000 2	0.873 1	0.089 3	0.661 2	0.000 3	0.048 5	0.560 1	0.408 1	0.892 1	0.000 1	0.000 1	0.586 1	0.616 2	0.000 5	0.692 3	0.900 1	0.721 1	0.162 1	0.228 1	0.860 1	0.000 1	0.000 2	0.575 1	0.083 2	0.550 1	0.347 1	0.624 1	0.410 2	0.360 1	0.740 1	0.109 3	0.321 3	0.660 1	0.000 2	0.121 2	0.939 1	0.143 2	0.000 1	0.400 1	0.003 2	0.190 1	0.564 1	0.652 1	0.615 1	0.421 1	0.304 4	0.579 1	0.547 1	0.000 1	0.000 1	0.296 2	0.000 5	0.030 4	0.096 1	0.000 2	0.916 1	0.037 2	0.551 2	0.171 2	0.376 1	0.865 2	0.286 1	0.000 1	0.633 1	0.102 5	0.027 4	0.011 2	0.000 1	0.000 1	0.474 3	0.742 1	0.133 2	0.311 1	0.824 1	0.242 2	0.503 2	0.068 4	0.828 1	0.000 2	0.429 1	0.000 1	0.063 1	0.000 1	0.781 1	0.000 1	0.000 2	0.000 1	0.665 1	0.633 1	0.450 1	0.818 1	0.000 2	0.000 1	0.429 1	0.532 1	0.226 1	0.825 1	0.510 4	0.377 1	0.709 1	0.079 3	0.000 1	0.753 1	0.683 1	0.102 5	0.063 2	0.401 4	0.620 3	0.000 1	0.619 1	0.000 5	0.000 3	0.000 1	0.595 3	0.000 2	0.000 1	0.345 2	0.564 1	0.411 1	0.603 1	0.384 2	0.945 1	0.266 1	0.643 1	0.367 2	0.304 1	0.663 1	0.000 1	0.010 1	0.726 3	0.767 1	0.898 1	0.000 1	0.784 1	0.435 1	0.861 2	0.000 1	0.447 1	0.000 5	0.257 1	0.656 1	0.377 4
: Understanding Imbalanced Semantic Segmentation Through Neural Collapse.
AWCS	0.305 2	0.508 2	0.225 2	0.142 2	0.463 3	0.063 3	0.195 2	0.000 1	0.000 1	0.000 1	0.467 2	0.551 1	0.504 2	0.773 2	0.764 2	0.142 2	0.029 5	0.000 3	0.626 3	0.100 2	0.000 3	0.360 2	0.179 3	0.507 4	0.137 3	0.006 2	0.300 2	0.000 1	0.000 2	0.172 2	0.364 3	0.512 2	0.000 1	0.056 2	0.000 2	0.865 2	0.093 2	0.634 5	0.000 3	0.071 3	0.396 3	0.296 4	0.876 2	0.000 1	0.000 1	0.373 2	0.436 5	0.063 4	0.749 1	0.877 2	0.721 1	0.131 2	0.124 2	0.804 3	0.000 1	0.000 2	0.515 2	0.010 4	0.452 2	0.252 2	0.578 2	0.417 1	0.179 5	0.484 3	0.171 1	0.337 2	0.606 2	0.000 2	0.115 3	0.937 2	0.142 3	0.000 1	0.008 2	0.000 4	0.157 4	0.484 2	0.402 5	0.501 3	0.339 2	0.553 1	0.529 2	0.478 2	0.000 1	0.000 1	0.404 1	0.001 4	0.022 5	0.077 2	0.000 2	0.894 3	0.219 1	0.628 1	0.093 3	0.305 2	0.886 1	0.233 2	0.000 1	0.603 2	0.112 3	0.023 5	0.000 3	0.000 1	0.000 1	0.741 1	0.664 2	0.097 3	0.253 2	0.782 2	0.264 1	0.523 1	0.154 1	0.707 4	0.000 2	0.411 2	0.000 1	0.000 2	0.000 1	0.332 4	0.000 1	0.000 2	0.000 1	0.602 2	0.595 2	0.185 4	0.656 4	0.159 1	0.000 1	0.355 2	0.424 3	0.154 3	0.729 3	0.516 3	0.220 3	0.620 2	0.084 2	0.000 1	0.707 3	0.651 2	0.173 1	0.014 3	0.381 5	0.582 4	0.000 1	0.619 1	0.049 4	0.000 3	0.000 1	0.702 1	0.000 2	0.000 1	0.302 4	0.489 3	0.317 2	0.334 2	0.392 1	0.922 2	0.254 2	0.533 4	0.394 1	0.129 5	0.613 3	0.000 1	0.000 3	0.820 1	0.649 3	0.749 2	0.000 1	0.782 2	0.282 2	0.863 1	0.000 1	0.288 4	0.006 3	0.220 3	0.633 2	0.542 1

This table lists the benchmark results for the ScanNet200 3D semantic instance scenario.

Method	avg ap	head ap	common ap	tail ap	backpack	bag	ball	bar	basket	bathroom cabinet	bathroom stall	bathroom stall door	bathroom vanity	bathtub	bed	bench	bicycle	bin	blackboard	blanket	blinds	board	book	bookshelf	bottle	bowl	box	broom	bucket	bulletin board	cabinet	calendar	candle	cart	case of water bottles	ceiling	ceiling light	chair	clock	closet	closet rod	clothes	clothes dryer	coat rack	coffee kettle	coffee maker	coffee table	column	computer tower	copier	couch	counter	cup	curtain	cushion	decoration	desk	dining table	dish rack	dishwasher	door	doorframe	dresser	dumbbell	end table	fan	file cabinet	fire alarm	fire extinguisher	folded chair	hat	headphones	ironing board	jacket	keyboard	keyboard piano	kitchen cabinet	kitchen counter	ladder	lamp	laptop	laundry basket	laundry detergent	laundry hamper	ledge	light	light switch	machine	mailbox	mat	microwave	mini fridge	mirror	monitor	mouse	music stand	nightstand	object	office chair	oven	paper	paper bag	paper cutter	paper towel dispenser	paper towel roll	person	piano	picture	pillow	pipe	plant	plate	plunger	poster	power outlet	power strip	printer	projector	projector screen	rack	radiator	range hood	recycling bin	refrigerator	scale	seat	shelf	shoe	shower	shower curtain	shower curtain rod	shower floor	shower head	shower wall	sign	sink	soap dispenser	sofa chair	speaker	stair rail	stairs	stand	stool	storage bin	storage container	storage organizer	stove	structure	stuffed animal	suitcase	table	telephone	tissue box	toaster	toilet	toilet paper	toilet paper dispenser	towel	trash bin	trash can	tray	tube	tv	tv stand	vacuum cleaner	vent	wardrobe	washing machine	water bottle	water cooler	water pitcher	whiteboard	window	windowsill

TD3D Scannet200	0.211 2	0.332 2	0.177 2	0.103 2	0.337 2	0.036 2	0.222 4	0.000 1	0.000 1	0.000 1	0.031 1	0.342 1	0.093 4	0.852 1	0.452 4	0.559 2	0.000 2	0.004 2	0.000 3	0.039 1	0.000 2	0.309 2	0.047 4	0.380 2	0.028 2	0.000 1	0.080 2	0.000 1	0.000 2	0.147 1	0.192 3	0.000 2	0.000 1	0.083 1	0.000 1	0.395 2	0.039 4	0.662 1	0.000 1	0.000 2	0.074 1	0.135 1	0.296 2	0.000 2	0.000 1	0.231 5	0.646 1	0.139 3	0.633 3	1.000 1	0.705 1	0.048 1	0.088 2	0.439 2	0.184 2	0.039 2	0.266 2	0.551 2	0.260 3	0.026 5	0.463 2	0.046 3	0.252 2	0.249 3	0.083 2	0.372 1	0.411 1	0.000 2	0.414 1	0.323 1	0.000 1	0.052 2	0.000 1	0.157 1	0.278 2	0.278 2	0.237 2	0.015 2	0.321 2	0.253 1	0.060 4	0.000 1	0.000 1	0.272 2	0.008 1	0.169 2	0.032 2	0.000 1	0.404 1	0.356 2	0.283 2	0.073 3	0.028 5	0.617 2	0.038 2	0.000 1	0.494 2	0.037 2	0.215 1	0.083 2	0.000 2	0.003 2	0.486 3	0.694 1	0.000 2	0.040 4	0.083 4	0.219 5	0.209 2	0.007 1	0.483 1	0.000 2	0.125 4	0.000 1	0.150 2	0.014 1	0.544 1	0.000 1	0.000 2	0.000 1	0.260 5	0.143 5	0.200 1	0.610 3	0.028 2	0.032 1	0.145 1	0.059 2	0.046 4	0.740 2	0.806 1	0.543 2	0.000 2	0.108 2	0.008 1	0.222 5	0.669 2	0.456 1	0.074 1	0.224 1	0.586 1	0.006 2	0.451 2	0.000 1	0.002 1	0.889 1	0.282 2	0.000 1	0.000 1	0.252 2	0.413 2	0.111 2	0.074 2	0.240 1	0.893 1	0.266 2	0.144 3	0.293 2	0.281 2	0.604 2	0.000 1	0.000 2	0.379 5	0.963 1	0.250 4	0.000 1	0.160 1	0.420 2	0.000 1	0.343 3	0.207 2	0.079 5	0.315 2	0.052 2

Mask3D Scannet200	0.278 1	0.383 1	0.263 1	0.168 1	0.506 1	0.068 1	0.083 5	0.000 1	0.000 1	0.000 1	0.023 2	0.149 4	0.302 1	0.778 3	0.647 1	0.569 1	0.500 1	0.031 1	0.014 2	0.027 2	0.173 1	0.311 1	0.195 1	0.351 3	0.258 1	0.000 1	0.082 1	0.000 1	0.003 1	0.037 2	0.391 1	1.000 1	0.000 1	0.014 2	0.000 1	0.572 1	0.573 1	0.661 2	0.000 1	0.003 1	0.005 4	0.082 4	0.349 1	0.028 1	0.000 1	0.605 1	0.515 3	0.509 1	0.711 1	1.000 1	0.665 3	0.015 2	0.107 1	0.402 4	0.201 1	0.083 1	0.304 1	0.759 1	0.491 1	0.378 1	0.572 1	0.119 1	0.277 1	0.013 5	0.089 1	0.283 2	0.411 2	0.267 1	0.006 3	0.156 2	0.000 1	0.116 1	0.000 1	0.105 3	0.556 1	0.514 1	0.396 1	0.275 1	0.323 1	0.215 2	0.380 1	0.000 1	0.000 1	0.356 1	0.005 2	0.208 1	0.325 1	0.000 1	0.050 4	0.400 1	0.561 1	0.258 1	0.179 1	0.722 1	0.147 1	0.000 1	0.586 1	0.063 1	0.015 2	0.139 1	0.016 1	0.028 1	0.708 1	0.418 2	0.016 1	0.048 3	0.500 1	0.489 1	0.349 1	0.001 2	0.475 2	0.086 1	0.365 1	0.000 1	0.500 1	0.000 2	0.323 3	0.000 1	0.222 1	0.000 1	0.497 1	0.626 1	0.044 3	0.795 1	0.556 1	0.008 2	0.121 4	0.265 1	0.667 1	0.789 1	0.568 2	0.579 1	0.444 1	0.176 1	0.004 2	0.474 1	0.752 1	0.233 2	0.014 2	0.002 4	0.570 2	0.007 1	0.377 5	0.000 1	0.000 2	0.000 2	0.337 1	0.000 1	0.000 1	0.384 1	0.465 1	0.287 1	0.085 1	0.048 2	0.816 5	0.467 1	0.810 1	0.377 1	0.415 1	0.744 1	0.000 1	0.004 1	0.724 1	0.778 2	0.590 1	0.000 1	0.032 2	0.441 1	0.000 1	0.377 2	0.391 1	0.427 1	0.321 1	0.192 1
Jonas Schult, Francis Engelmann, Alexander Hermans, Or Litany, Siyu Tang, Bastian Leibe: Mask3D for 3D Semantic Instance Segmentation. ICRA 2023
Minkowski 34D Inst.	0.130 4	0.246 4	0.083 4	0.043 5	0.299 4	0.000 5	0.278 1	0.000 1	0.000 1	0.000 1	0.022 3	0.175 3	0.122 2	0.537 4	0.521 2	0.400 3	0.000 2	0.000 3	0.000 3	0.008 3	0.000 2	0.048 4	0.076 3	0.182 5	0.000 4	0.000 1	0.022 4	0.000 1	0.000 2	0.000 3	0.141 5	0.000 2	0.000 1	0.000 3	0.000 1	0.210 4	0.063 2	0.547 5	0.000 1	0.000 2	0.000 5	0.100 2	0.026 5	0.000 2	0.000 1	0.241 4	0.488 4	0.000 4	0.564 5	1.000 1	0.672 2	0.000 3	0.021 4	0.486 1	0.000 3	0.000 3	0.067 4	0.000 3	0.194 5	0.033 4	0.415 4	0.026 4	0.025 5	0.271 1	0.004 4	0.094 5	0.142 5	0.000 2	0.000 4	0.111 3	0.000 1	0.000 3	0.000 1	0.088 4	0.083 5	0.278 2	0.110 4	0.000 4	0.082 5	0.199 5	0.137 3	0.000 1	0.000 1	0.000 3	0.000 3	0.041 4	0.000 3	0.000 1	0.308 2	0.067 3	0.280 3	0.016 4	0.101 3	0.373 5	0.000 3	0.000 1	0.319 4	0.007 4	0.000 3	0.000 3	0.000 2	0.000 3	0.028 5	0.355 5	0.000 2	0.101 1	0.444 2	0.289 2	0.114 5	0.000 3	0.394 3	0.000 2	0.032 5	0.000 1	0.000 3	0.000 2	0.201 5	0.000 1	0.000 2	0.000 1	0.384 2	0.248 4	0.000 5	0.529 4	0.000 3	0.000 3	0.133 3	0.020 5	0.089 3	0.720 3	0.500 4	0.099 4	0.000 2	0.000 5	0.000 3	0.238 4	0.334 5	0.190 3	0.000 3	0.000 5	0.317 5	0.000 3	0.472 1	0.000 1	0.000 2	0.000 2	0.094 5	0.000 1	0.000 1	0.082 5	0.236 4	0.004 5	0.019 4	0.000 3	0.883 2	0.061 5	0.262 2	0.217 4	0.000 4	0.557 5	0.000 1	0.000 2	0.460 4	0.761 4	0.156 5	0.000 1	0.000 3	0.259 4	0.000 1	0.394 1	0.019 4	0.084 4	0.232 4	0.000 5
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019
CSC-Pretrain Inst.	0.123 5	0.223 5	0.082 5	0.046 4	0.308 3	0.004 3	0.278 1	0.000 1	0.000 1	0.000 1	0.000 5	0.032 5	0.105 3	0.537 4	0.348 5	0.378 4	0.000 2	0.000 3	0.000 3	0.000 5	0.000 2	0.000 5	0.037 5	0.323 4	0.000 4	0.000 1	0.013 5	0.000 1	0.000 2	0.000 3	0.235 2	0.000 2	0.000 1	0.000 3	0.000 1	0.231 3	0.045 3	0.564 4	0.000 1	0.000 2	0.006 3	0.078 5	0.065 3	0.000 2	0.000 1	0.259 3	0.516 2	0.000 4	0.600 4	1.000 1	0.578 5	0.000 3	0.000 5	0.184 5	0.000 3	0.000 3	0.034 5	0.000 3	0.211 4	0.089 3	0.394 5	0.018 5	0.064 4	0.171 4	0.001 5	0.144 3	0.172 4	0.000 2	0.000 4	0.044 4	0.000 1	0.000 3	0.000 1	0.064 5	0.126 4	0.278 2	0.093 5	0.000 4	0.094 4	0.214 3	0.011 5	0.000 1	0.000 1	0.000 3	0.000 3	0.022 5	0.000 3	0.000 1	0.275 3	0.000 4	0.275 4	0.000 5	0.098 4	0.407 4	0.000 3	0.000 1	0.250 5	0.007 5	0.000 3	0.000 3	0.000 2	0.000 3	0.333 4	0.376 4	0.000 2	0.000 5	0.042 5	0.285 3	0.119 4	0.000 3	0.224 5	0.000 2	0.184 3	0.000 1	0.000 3	0.000 2	0.244 4	0.000 1	0.000 2	0.000 1	0.377 3	0.378 2	0.051 2	0.424 5	0.000 3	0.000 3	0.116 5	0.030 4	0.125 2	0.441 4	0.444 5	0.063 5	0.000 2	0.042 3	0.000 3	0.297 2	0.483 3	0.096 5	0.000 3	0.028 2	0.338 4	0.000 3	0.444 3	0.000 1	0.000 2	0.000 2	0.189 4	0.000 1	0.000 1	0.141 4	0.152 5	0.017 4	0.000 5	0.000 3	0.838 4	0.193 3	0.111 5	0.105 5	0.198 3	0.588 3	0.000 1	0.000 2	0.542 3	0.343 5	0.267 3	0.000 1	0.000 3	0.108 5	0.000 1	0.333 4	0.000 5	0.228 2	0.202 5	0.022 4
Ji Hou, Benjamin Graham, Matthias Nießner, Saining Xie: Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts. CVPR 2021
LGround Inst.	0.154 3	0.275 3	0.108 3	0.060 3	0.295 5	0.002 4	0.278 1	0.000 1	0.000 1	0.000 1	0.006 4	0.272 2	0.064 5	0.815 2	0.503 3	0.333 5	0.000 2	0.000 3	0.556 1	0.001 4	0.000 2	0.148 3	0.078 2	0.448 1	0.007 3	0.000 1	0.024 3	0.000 1	0.000 2	0.000 3	0.190 4	0.000 2	0.000 1	0.000 3	0.000 1	0.209 5	0.031 5	0.573 3	0.000 1	0.000 2	0.041 2	0.099 3	0.037 4	0.000 2	0.000 1	0.327 2	0.364 5	0.181 2	0.642 2	1.000 1	0.654 4	0.000 3	0.023 3	0.429 3	0.000 3	0.000 3	0.097 3	0.000 3	0.278 2	0.267 2	0.434 3	0.048 2	0.092 3	0.257 2	0.030 3	0.097 4	0.189 3	0.000 2	0.089 2	0.000 5	0.000 1	0.000 3	0.000 1	0.115 2	0.166 3	0.222 5	0.222 3	0.003 3	0.127 3	0.213 4	0.169 2	0.000 1	0.000 1	0.000 3	0.000 3	0.044 3	0.000 3	0.000 1	0.000 5	0.000 4	0.268 5	0.222 2	0.130 2	0.494 3	0.000 3	0.000 1	0.363 3	0.015 3	0.000 3	0.000 3	0.000 2	0.000 3	0.611 2	0.400 3	0.000 2	0.056 2	0.278 3	0.242 4	0.180 3	0.000 3	0.383 4	0.000 2	0.209 2	0.000 1	0.000 3	0.000 2	0.364 2	0.000 1	0.000 2	0.000 1	0.323 4	0.302 3	0.019 4	0.654 2	0.000 3	0.000 3	0.141 2	0.045 3	0.000 5	0.427 5	0.514 3	0.143 3	0.000 2	0.028 4	0.000 3	0.252 3	0.402 4	0.156 4	0.000 3	0.028 2	0.470 3	0.000 3	0.444 3	0.000 1	0.000 2	0.000 2	0.205 3	0.000 1	0.000 1	0.203 3	0.381 3	0.026 3	0.037 3	0.000 3	0.881 3	0.099 4	0.135 4	0.239 3	0.000 4	0.585 4	0.000 1	0.000 2	0.616 2	0.778 2	0.322 2	0.000 1	0.000 3	0.407 3	0.000 1	0.333 4	0.148 3	0.177 3	0.242 3	0.028 3
David Rozenberszki, Or Litany, Angela Dai: Language-Grounded Indoor 3D Semantic Segmentation in the Wild.

ScanNet Benchmark

This table lists the benchmark results for the 3D semantic label scenario.

Method	avg iou	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	floor	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	wall	window

PointTransformerV2	0.752 5	0.742 53	0.809 14	0.872 1	0.758 5	0.860 6	0.552 7	0.891 5	0.610 30	0.687 2	0.960 8	0.559 14	0.304 20	0.766 8	0.926 2	0.767 8	0.797 14	0.644 22	0.942 6	0.876 7	0.722 14
Xiaoyang Wu, Yixing Lao, Li Jiang, Xihui Liu, Hengshuang Zhao: Point Transformer V2: Grouped Vector Attention and Partition-based Pooling. NeurIPS 2022
IPCA	0.731 20	0.890 8	0.837 3	0.864 2	0.726 18	0.873 2	0.530 15	0.824 23	0.489 73	0.647 9	0.978 2	0.609 2	0.336 7	0.624 37	0.733 46	0.758 11	0.776 25	0.570 53	0.949 2	0.877 5	0.728 8

MSP	0.748 9	0.623 79	0.804 16	0.859 3	0.745 12	0.824 33	0.501 23	0.912 2	0.690 6	0.685 3	0.956 14	0.567 11	0.320 13	0.768 7	0.918 3	0.720 22	0.802 10	0.676 12	0.921 18	0.881 4	0.779 1

VMNet	0.746 11	0.870 12	0.838 2	0.858 4	0.729 17	0.850 12	0.501 23	0.874 8	0.587 42	0.658 8	0.956 14	0.564 12	0.299 21	0.765 9	0.900 5	0.716 25	0.812 8	0.631 28	0.939 9	0.858 16	0.709 18
Zeyu HU, Xuyang Bai, Jiaxiang Shang, Runze Zhang, Jiayu Dong, Xin Wang, Guangyuan Sun, Hongbo Fu, Chiew-Lan Tai: VMNet: Voxel-Mesh Network for Geodesic-Aware 3D Semantic Segmentation. ICCV 2021 (Oral)
EQ-Net	0.743 14	0.620 80	0.799 19	0.849 5	0.730 16	0.822 35	0.493 30	0.897 4	0.664 12	0.681 4	0.955 18	0.562 13	0.378 1	0.760 11	0.903 4	0.738 16	0.801 11	0.673 15	0.907 26	0.877 5	0.745 3
Zetong Yang, Li Jiang, Yanan Sun, Bernt Schiele, Jiaya JIa: A Unified Query-based Paradigm for Point Cloud Understanding. CVPR 2022
Virtual MVFusion	0.746 11	0.771 40	0.819 8	0.848 6	0.702 25	0.865 5	0.397 70	0.899 3	0.699 3	0.664 7	0.948 41	0.588 6	0.330 9	0.746 17	0.851 24	0.764 9	0.796 15	0.704 6	0.935 11	0.866 11	0.728 8
Abhijit Kundu, Xiaoqi Yin, Alireza Fathi, David Ross, Brian Brewington, Thomas Funkhouser, Caroline Pantofaru: Virtual Multi-view Fusion for 3D Semantic Segmentation. ECCV 2020
SparseConvNet	0.725 21	0.647 76	0.821 6	0.846 7	0.721 19	0.869 3	0.533 12	0.754 43	0.603 36	0.614 23	0.955 18	0.572 10	0.325 11	0.710 21	0.870 13	0.724 20	0.823 2	0.628 29	0.934 12	0.865 12	0.683 27

StratifiedFormer	0.747 10	0.901 7	0.803 17	0.845 8	0.757 6	0.846 14	0.512 19	0.825 22	0.696 5	0.645 10	0.956 14	0.576 9	0.262 44	0.744 18	0.861 16	0.742 15	0.770 30	0.705 5	0.899 33	0.860 15	0.734 6
Xin Lai, Jianhui Liu, Li Jiang, Liwei Wang, Hengshuang Zhao, Shu Liu, Xiaojuan Qi, Jiaya Jia: Stratified Transformer for 3D Point Cloud Segmentation. CVPR 2022
O-CNN	0.762 4	0.924 2	0.823 5	0.844 9	0.770 2	0.852 10	0.577 2	0.847 15	0.711 1	0.640 16	0.958 10	0.592 4	0.217 58	0.762 10	0.888 9	0.758 11	0.813 7	0.726 1	0.932 15	0.868 9	0.744 4
Peng-Shuai Wang, Yang Liu, Yu-Xiao Guo, Chun-Yu Sun, Xin Tong: O-CNN: Octree-based Convolutional Neural Networks for 3D Shape Analysis. SIGGRAPH 2017
Mix3D	0.781 1	0.964 1	0.855 1	0.843 10	0.781 1	0.858 7	0.575 3	0.831 19	0.685 7	0.714 1	0.979 1	0.594 3	0.310 17	0.801 1	0.892 8	0.841 2	0.819 3	0.723 3	0.940 8	0.887 1	0.725 12
Alexey Nekrasov, Jonas Schult, Or Litany, Bastian Leibe, Francis Engelmann: Mix3D: Out-of-Context Data Augmentation for 3D Scenes. 3DV 2021 (Oral)
CU-Hybrid Net	0.764 2	0.924 2	0.819 8	0.840 11	0.757 6	0.853 9	0.580 1	0.848 14	0.709 2	0.643 12	0.958 10	0.587 7	0.295 23	0.753 14	0.884 12	0.758 11	0.815 6	0.725 2	0.927 17	0.867 10	0.743 5

OccuSeg+Semantic	0.764 2	0.758 46	0.796 20	0.839 12	0.746 11	0.907 1	0.562 5	0.850 13	0.680 9	0.672 5	0.978 2	0.610 1	0.335 8	0.777 4	0.819 32	0.847 1	0.830 1	0.691 8	0.972 1	0.885 2	0.727 10

MinkowskiNet	0.736 19	0.859 15	0.818 10	0.832 13	0.709 22	0.840 18	0.521 18	0.853 12	0.660 15	0.643 12	0.951 31	0.544 19	0.286 28	0.731 19	0.893 7	0.675 39	0.772 27	0.683 9	0.874 51	0.852 22	0.727 10
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019
JSENet	0.699 29	0.881 11	0.762 36	0.821 14	0.667 32	0.800 55	0.522 17	0.792 35	0.613 28	0.607 27	0.935 69	0.492 34	0.205 63	0.576 47	0.853 22	0.691 34	0.758 39	0.652 19	0.872 54	0.828 33	0.649 36
Zeyu HU, Mingmin Zhen, Xuyang BAI, Hongbo Fu, Chiew-lan Tai: JSENet: Joint Semantic Segmentation and Edge Detection Network for 3D Point Clouds. ECCV 2020
PointMetaBase	0.714 25	0.835 21	0.785 26	0.821 14	0.684 29	0.846 14	0.531 14	0.865 10	0.614 27	0.596 34	0.953 26	0.500 32	0.246 50	0.674 23	0.888 9	0.692 33	0.764 33	0.624 30	0.849 66	0.844 30	0.675 29

Feature-Geometry Net	0.685 34	0.866 13	0.748 44	0.819 16	0.645 40	0.794 58	0.450 47	0.802 33	0.587 42	0.604 28	0.945 49	0.464 44	0.201 66	0.554 56	0.840 27	0.723 21	0.732 49	0.602 41	0.907 26	0.822 38	0.603 53

SAT	0.742 15	0.860 14	0.765 35	0.819 16	0.769 3	0.848 13	0.533 12	0.829 20	0.663 13	0.631 18	0.955 18	0.586 8	0.274 34	0.753 14	0.896 6	0.729 17	0.760 37	0.666 17	0.921 18	0.855 20	0.733 7

PointTransformer++	0.725 21	0.727 60	0.811 13	0.819 16	0.765 4	0.841 17	0.502 22	0.814 29	0.621 25	0.623 20	0.955 18	0.556 15	0.284 29	0.620 38	0.866 14	0.781 5	0.757 40	0.648 20	0.932 15	0.862 13	0.709 18

RFCR	0.702 27	0.889 9	0.745 47	0.813 19	0.672 31	0.818 42	0.493 30	0.815 27	0.623 23	0.610 24	0.947 43	0.470 42	0.249 49	0.594 42	0.848 25	0.705 29	0.779 24	0.646 21	0.892 38	0.823 36	0.611 46
Jingyu Gong, Jiachen Xu, Xin Tan, Haichuan Song, Yanyun Qu, Yuan Xie, Lizhuang Ma: Omni-Supervised Point Cloud Segmentation via Gradual Receptive Field Component Reasoning. CVPR2021
INS-Conv-semantic	0.717 24	0.751 49	0.759 38	0.812 20	0.704 24	0.868 4	0.537 11	0.842 16	0.609 32	0.608 26	0.953 26	0.534 21	0.293 24	0.616 39	0.864 15	0.719 24	0.793 19	0.640 24	0.933 13	0.845 29	0.663 32

BPNet	0.749 7	0.909 4	0.818 10	0.811 21	0.752 8	0.839 19	0.485 32	0.842 16	0.673 10	0.644 11	0.957 13	0.528 25	0.305 19	0.773 6	0.859 17	0.788 4	0.818 5	0.693 7	0.916 21	0.856 18	0.723 13
Wenbo Hu, Hengshuang Zhao, Li Jiang, Jiaya Jia, Tien-Tsin Wong: Bidirectional Projection Network for Cross Dimension Scene Understanding. CVPR 2021 (Oral)
MatchingNet	0.724 23	0.812 29	0.812 12	0.810 22	0.735 15	0.834 24	0.495 29	0.860 11	0.572 48	0.602 30	0.954 23	0.512 29	0.280 31	0.757 12	0.845 26	0.725 19	0.780 23	0.606 39	0.937 10	0.851 23	0.700 21

contrastBoundary	0.705 26	0.769 43	0.775 31	0.809 23	0.687 28	0.820 38	0.439 58	0.812 30	0.661 14	0.591 36	0.945 49	0.515 28	0.171 76	0.633 34	0.856 20	0.720 22	0.796 15	0.668 16	0.889 40	0.847 26	0.689 25
Liyao Tang, Yibing Zhan, Zhe Chen, Baosheng Yu, Dacheng Tao: Contrastive Boundary Learning for Point Cloud Segmentation. CVPR2022
PointConvFormer	0.749 7	0.793 32	0.790 24	0.807 24	0.750 10	0.856 8	0.524 16	0.881 7	0.588 41	0.642 15	0.977 4	0.591 5	0.274 34	0.781 2	0.929 1	0.804 3	0.796 15	0.642 23	0.947 3	0.885 2	0.715 17
Wenxuan Wu, Qi Shan, Li Fuxin: PointConvFormer: Revenge of the Point-based Convolution.
LRPNet	0.742 15	0.816 27	0.806 15	0.807 24	0.752 8	0.828 29	0.575 3	0.839 18	0.699 3	0.637 17	0.954 23	0.520 27	0.320 13	0.755 13	0.834 28	0.760 10	0.772 27	0.676 12	0.915 22	0.862 13	0.717 15

LargeKernel3D	0.739 18	0.909 4	0.820 7	0.806 26	0.740 13	0.852 10	0.545 9	0.826 21	0.594 40	0.643 12	0.955 18	0.541 20	0.263 43	0.723 20	0.858 19	0.775 7	0.767 31	0.678 11	0.933 13	0.848 24	0.694 24

DCM-Net	0.658 46	0.778 36	0.702 62	0.806 26	0.619 47	0.813 48	0.468 37	0.693 61	0.494 68	0.524 53	0.941 60	0.449 53	0.298 22	0.510 67	0.821 31	0.675 39	0.727 51	0.568 55	0.826 71	0.803 47	0.637 40
Jonas Schult, Francis Engelmann, Theodora Kontogianni, Bastian Leibe: DualConvMesh-Net: Joint Geodesic and Euclidean Convolutions on 3D Meshes. CVPR 2020 [Oral]
TXC	0.740 17	0.842 19	0.832 4	0.805 28	0.715 21	0.846 14	0.473 34	0.885 6	0.615 26	0.671 6	0.971 6	0.547 18	0.320 13	0.697 22	0.799 37	0.777 6	0.819 3	0.682 10	0.946 4	0.871 8	0.696 23

DMF-Net	0.752 5	0.906 6	0.793 23	0.802 29	0.689 27	0.825 31	0.556 6	0.867 9	0.681 8	0.602 30	0.960 8	0.555 16	0.365 3	0.779 3	0.859 17	0.747 14	0.795 18	0.717 4	0.917 20	0.856 18	0.764 2

3DSM_DMMF	0.631 60	0.626 78	0.745 47	0.801 30	0.607 49	0.751 76	0.506 20	0.729 52	0.565 52	0.491 64	0.866 93	0.434 56	0.197 69	0.595 41	0.630 63	0.709 28	0.705 59	0.560 57	0.875 49	0.740 78	0.491 82

Superpoint Network	0.683 38	0.851 17	0.728 55	0.800 31	0.653 36	0.806 50	0.468 37	0.804 31	0.572 48	0.602 30	0.946 46	0.453 51	0.239 53	0.519 65	0.822 30	0.689 37	0.762 36	0.595 45	0.895 36	0.827 34	0.630 43

Feature_GeometricNet	0.690 32	0.884 10	0.754 42	0.795 32	0.647 38	0.818 42	0.422 62	0.802 33	0.612 29	0.604 28	0.945 49	0.462 45	0.189 71	0.563 53	0.853 22	0.726 18	0.765 32	0.632 27	0.904 28	0.821 39	0.606 50
Kangcheng Liu, Ben M. Chen: https://arxiv.org/abs/2012.09439. arXiv Preprint
PicassoNet-II	0.696 30	0.704 65	0.790 24	0.787 33	0.709 22	0.837 20	0.459 42	0.815 27	0.543 57	0.615 22	0.956 14	0.529 23	0.250 47	0.551 59	0.790 38	0.703 30	0.799 13	0.619 34	0.908 25	0.848 24	0.700 21
Huan Lei, Naveed Akhtar, Mubarak Shah, and Ajmal Mian: Geometric feature learning for 3D meshes.
PointContrast_LA_SEM	0.683 38	0.757 47	0.784 27	0.786 34	0.639 42	0.824 33	0.408 65	0.775 37	0.604 35	0.541 45	0.934 73	0.532 22	0.269 39	0.552 57	0.777 39	0.645 55	0.793 19	0.640 24	0.913 23	0.824 35	0.671 30

KP-FCNN	0.684 35	0.847 18	0.758 40	0.784 35	0.647 38	0.814 45	0.473 34	0.772 38	0.605 34	0.594 35	0.935 69	0.450 52	0.181 74	0.587 43	0.805 35	0.690 35	0.785 22	0.614 35	0.882 44	0.819 40	0.632 42
H. Thomas, C. Qi, J. Deschaud, B. Marcotegui, F. Goulette, L. Guibas.: KPConv: Flexible and Deformable Convolution for Point Clouds. ICCV 2019
VI-PointConv	0.676 40	0.770 42	0.754 42	0.783 36	0.621 46	0.814 45	0.552 7	0.758 41	0.571 50	0.557 41	0.954 23	0.529 23	0.268 41	0.530 63	0.682 56	0.675 39	0.719 52	0.603 40	0.888 41	0.833 31	0.665 31
Xingyi Li, Wenxuan Wu, Xiaoli Z. Fern, Li Fuxin: The Devils in the Point Clouds: Studying the Robustness of Point Cloud Convolutions.
DGNet	0.684 35	0.712 64	0.784 27	0.782 37	0.658 33	0.835 23	0.499 27	0.823 24	0.641 18	0.597 33	0.950 35	0.487 35	0.281 30	0.575 48	0.619 64	0.647 52	0.764 33	0.620 33	0.871 57	0.846 28	0.688 26

VACNN++	0.684 35	0.728 59	0.757 41	0.776 38	0.690 26	0.804 52	0.464 40	0.816 25	0.577 47	0.587 37	0.945 49	0.508 31	0.276 33	0.671 24	0.710 51	0.663 44	0.750 43	0.589 48	0.881 45	0.832 32	0.653 35

DVVNet	0.562 79	0.648 75	0.700 64	0.770 39	0.586 58	0.687 84	0.333 83	0.650 67	0.514 65	0.475 68	0.906 87	0.359 79	0.223 56	0.340 86	0.442 81	0.422 90	0.668 73	0.501 77	0.708 85	0.779 65	0.534 75

SALANet	0.670 42	0.816 27	0.770 33	0.768 40	0.652 37	0.807 49	0.451 44	0.747 45	0.659 16	0.545 44	0.924 79	0.473 41	0.149 86	0.571 50	0.811 34	0.635 58	0.746 44	0.623 31	0.892 38	0.794 53	0.570 63

Retro-FPN	0.744 13	0.842 19	0.800 18	0.767 41	0.740 13	0.836 22	0.541 10	0.914 1	0.672 11	0.626 19	0.958 10	0.552 17	0.272 36	0.777 4	0.886 11	0.696 32	0.801 11	0.674 14	0.941 7	0.858 16	0.717 15

FusionAwareConv	0.630 63	0.604 83	0.741 51	0.766 42	0.590 55	0.747 77	0.501 23	0.734 50	0.503 67	0.527 51	0.919 83	0.454 49	0.323 12	0.550 60	0.420 82	0.678 38	0.688 66	0.544 65	0.896 35	0.795 52	0.627 44
Jiazhao Zhang, Chenyang Zhu, Lintao Zheng, Kai Xu: Fusion-Aware Point Convolution for Online Semantic 3D Scene Segmentation. CVPR 2020
ROSMRF3D	0.673 41	0.789 33	0.748 44	0.763 43	0.635 44	0.814 45	0.407 67	0.747 45	0.581 46	0.573 38	0.950 35	0.484 36	0.271 38	0.607 40	0.754 42	0.649 49	0.774 26	0.596 43	0.883 43	0.823 36	0.606 50

SIConv	0.625 66	0.830 23	0.694 68	0.757 44	0.563 65	0.772 70	0.448 48	0.647 69	0.520 62	0.509 57	0.949 39	0.431 59	0.191 70	0.496 71	0.614 65	0.647 52	0.672 72	0.535 71	0.876 48	0.783 64	0.571 62

FusionNet	0.688 33	0.704 65	0.741 51	0.754 45	0.656 34	0.829 27	0.501 23	0.741 48	0.609 32	0.548 43	0.950 35	0.522 26	0.371 2	0.633 34	0.756 41	0.715 26	0.771 29	0.623 31	0.861 62	0.814 41	0.658 33
Feihu Zhang, Jin Fang, Benjamin Wah, Philip Torr: Deep FusionNet for Point Cloud Semantic Segmentation. ECCV 2020
SConv	0.636 56	0.830 23	0.697 66	0.752 46	0.572 63	0.780 66	0.445 51	0.716 54	0.529 60	0.530 50	0.951 31	0.446 55	0.170 77	0.507 69	0.666 60	0.636 57	0.682 68	0.541 68	0.886 42	0.799 48	0.594 57

PointASNL	0.666 43	0.703 67	0.781 29	0.751 47	0.655 35	0.830 26	0.471 36	0.769 39	0.474 76	0.537 47	0.951 31	0.475 40	0.279 32	0.635 32	0.698 55	0.675 39	0.751 42	0.553 62	0.816 73	0.806 45	0.703 20
Xu Yan, Chaoda Zheng, Zhen Li, Sheng Wang, Shuguang Cui: PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Sampling. CVPR 2020
One Thing One Click	0.701 28	0.825 25	0.796 20	0.723 48	0.716 20	0.832 25	0.433 60	0.816 25	0.634 21	0.609 25	0.969 7	0.418 67	0.344 5	0.559 54	0.833 29	0.715 26	0.808 9	0.560 57	0.902 30	0.847 26	0.680 28

PPCNN++	0.663 45	0.746 50	0.708 59	0.722 49	0.638 43	0.820 38	0.451 44	0.566 80	0.599 38	0.541 45	0.950 35	0.510 30	0.313 16	0.648 29	0.819 32	0.616 63	0.682 68	0.590 47	0.869 58	0.810 44	0.656 34
Pyunghwan Ahn, Juyoung Yang, Eojindl Yi, Chanho Lee, Junmo Kim: Projection-based Point Convolution for Efficient Point Cloud Segmentation. IEEE Access
PointConv-SFPN	0.641 50	0.776 38	0.703 61	0.721 50	0.557 67	0.826 30	0.451 44	0.672 65	0.563 54	0.483 65	0.943 57	0.425 64	0.162 81	0.644 30	0.726 47	0.659 46	0.709 56	0.572 52	0.875 49	0.786 63	0.559 68

DenSeR	0.628 64	0.800 30	0.625 85	0.719 51	0.545 70	0.806 50	0.445 51	0.597 75	0.448 82	0.519 56	0.938 65	0.481 37	0.328 10	0.489 73	0.499 77	0.657 47	0.759 38	0.592 46	0.881 45	0.797 51	0.634 41

Supervoxel-CNN	0.635 57	0.656 74	0.711 58	0.719 51	0.613 48	0.757 75	0.444 54	0.765 40	0.534 59	0.566 39	0.928 77	0.478 39	0.272 36	0.636 31	0.531 72	0.664 43	0.645 78	0.508 76	0.864 61	0.792 58	0.611 46

dtc_net	0.596 71	0.683 69	0.725 56	0.715 53	0.549 69	0.803 53	0.444 54	0.647 69	0.493 69	0.495 62	0.941 60	0.409 69	0.000 99	0.424 81	0.544 69	0.598 68	0.703 61	0.522 73	0.912 24	0.792 58	0.520 78

PointSPNet	0.637 55	0.734 56	0.692 70	0.714 54	0.576 61	0.797 57	0.446 49	0.743 47	0.598 39	0.437 76	0.942 58	0.403 71	0.150 85	0.626 36	0.800 36	0.649 49	0.697 62	0.557 60	0.846 67	0.777 67	0.563 66

FPConv	0.639 53	0.785 34	0.760 37	0.713 55	0.603 50	0.798 56	0.392 72	0.534 85	0.603 36	0.524 53	0.948 41	0.457 47	0.250 47	0.538 61	0.723 49	0.598 68	0.696 63	0.614 35	0.872 54	0.799 48	0.567 65
Yiqun Lin, Zizheng Yan, Haibin Huang, Dong Du, Ligang Liu, Shuguang Cui, Xiaoguang Han: FPConv: Learning Local Flattening for Point Convolution. CVPR 2020
SegGroup_sem	0.627 65	0.818 26	0.747 46	0.701 56	0.602 51	0.764 72	0.385 76	0.629 72	0.490 71	0.508 58	0.931 76	0.409 69	0.201 66	0.564 52	0.725 48	0.618 61	0.692 64	0.539 69	0.873 52	0.794 53	0.548 72
An Tao, Yueqi Duan, Yi Wei, Jiwen Lu, Jie Zhou: SegGroup: Seg-Level Supervision for 3D Instance and Semantic Segmentation. TIP 2022
PointConv	0.666 43	0.781 35	0.759 38	0.699 57	0.644 41	0.822 35	0.475 33	0.779 36	0.564 53	0.504 61	0.953 26	0.428 61	0.203 65	0.586 45	0.754 42	0.661 45	0.753 41	0.588 49	0.902 30	0.813 43	0.642 38
Wenxuan Wu, Zhongang Qi, Li Fuxin: PointConv: Deep Convolutional Networks on 3D Point Clouds. CVPR 2019
RandLA-Net	0.645 49	0.778 36	0.731 54	0.699 57	0.577 60	0.829 27	0.446 49	0.736 49	0.477 75	0.523 55	0.945 49	0.454 49	0.269 39	0.484 74	0.749 45	0.618 61	0.738 45	0.599 42	0.827 70	0.792 58	0.621 45

wsss-transformer	0.600 70	0.634 77	0.743 49	0.697 59	0.601 52	0.781 64	0.437 59	0.585 78	0.493 69	0.446 73	0.933 74	0.394 73	0.011 97	0.654 27	0.661 62	0.603 65	0.733 48	0.526 72	0.832 69	0.761 73	0.480 84

PointMRNet	0.640 52	0.717 63	0.701 63	0.692 60	0.576 61	0.801 54	0.467 39	0.716 54	0.563 54	0.459 71	0.953 26	0.429 60	0.169 78	0.581 46	0.854 21	0.605 64	0.710 54	0.550 63	0.894 37	0.793 55	0.575 61

Pointnet++ & Feature	0.557 80	0.735 55	0.661 79	0.686 61	0.491 77	0.744 78	0.392 72	0.539 83	0.451 81	0.375 84	0.946 46	0.376 77	0.205 63	0.403 83	0.356 86	0.553 78	0.643 79	0.497 78	0.824 72	0.756 74	0.515 79

CCRFNet	0.589 74	0.766 44	0.659 80	0.683 62	0.470 81	0.740 79	0.387 75	0.620 74	0.490 71	0.476 67	0.922 81	0.355 81	0.245 51	0.511 66	0.511 75	0.571 76	0.643 79	0.493 80	0.872 54	0.762 72	0.600 54

ROSMRF	0.580 75	0.772 39	0.707 60	0.681 63	0.563 65	0.764 72	0.362 79	0.515 86	0.465 79	0.465 70	0.936 68	0.427 63	0.207 61	0.438 77	0.577 67	0.536 79	0.675 71	0.486 81	0.723 84	0.779 65	0.524 77

PointMTL	0.632 59	0.731 57	0.688 73	0.675 64	0.591 54	0.784 63	0.444 54	0.565 81	0.610 30	0.492 63	0.949 39	0.456 48	0.254 46	0.587 43	0.706 52	0.599 67	0.665 74	0.612 38	0.868 59	0.791 62	0.579 60

APCF-Net	0.631 60	0.742 53	0.687 75	0.672 65	0.557 67	0.792 61	0.408 65	0.665 66	0.545 56	0.508 58	0.952 30	0.428 61	0.186 72	0.634 33	0.702 53	0.620 60	0.706 58	0.555 61	0.873 52	0.798 50	0.581 59
Haojia, Lin: Adaptive Pyramid Context Fusion for Point Cloud Perception. GRSL
PointNet2-SFPN	0.631 60	0.771 40	0.692 70	0.672 65	0.524 72	0.837 20	0.440 57	0.706 59	0.538 58	0.446 73	0.944 55	0.421 66	0.219 57	0.552 57	0.751 44	0.591 71	0.737 46	0.543 67	0.901 32	0.768 70	0.557 69

MVPNet	0.641 50	0.831 22	0.715 57	0.671 67	0.590 55	0.781 64	0.394 71	0.679 63	0.642 17	0.553 42	0.937 66	0.462 45	0.256 45	0.649 28	0.406 83	0.626 59	0.691 65	0.666 17	0.877 47	0.792 58	0.608 49
Maximilian Jaritz, Jiayuan Gu, Hao Su: Multi-view PointNet for 3D Scene Understanding. GMDL Workshop, ICCV 2019
TextureNet	0.566 78	0.672 73	0.664 78	0.671 67	0.494 76	0.719 80	0.445 51	0.678 64	0.411 88	0.396 81	0.935 69	0.356 80	0.225 55	0.412 82	0.535 71	0.565 77	0.636 82	0.464 84	0.794 76	0.680 88	0.568 64
Jingwei Huang, Haotian Zhang, Li Yi, Thomas Funkerhouser, Matthias Niessner, Leonidas Guibas: TextureNet: Consistent Local Parametrizations for Learning from High-Resolution Signals on Meshes. CVPR
joint point-based	0.634 58	0.614 81	0.778 30	0.667 69	0.633 45	0.825 31	0.420 63	0.804 31	0.467 78	0.561 40	0.951 31	0.494 33	0.291 25	0.566 51	0.458 78	0.579 75	0.764 33	0.559 59	0.838 68	0.814 41	0.598 55
Hung-Yueh Chiang, Yen-Liang Lin, Yueh-Cheng Liu, Winston H. Hsu: A Unified Point-Based Framework for 3D Segmentation. 3DV 2019
SAFNet-seg	0.654 48	0.752 48	0.734 53	0.664 70	0.583 59	0.815 44	0.399 69	0.754 43	0.639 19	0.535 49	0.942 58	0.470 42	0.309 18	0.665 25	0.539 70	0.650 48	0.708 57	0.635 26	0.857 64	0.793 55	0.642 38
Linqing Zhao, Jiwen Lu, Jie Zhou: Similarity-Aware Fusion Network for 3D Semantic Segmentation. IROS 2021
SQN_0.1%	0.569 77	0.676 71	0.696 67	0.657 71	0.497 75	0.779 67	0.424 61	0.548 82	0.515 64	0.376 83	0.902 90	0.422 65	0.357 4	0.379 84	0.456 79	0.596 70	0.659 75	0.544 65	0.685 87	0.665 91	0.556 70

One-Thing-One-Click	0.693 31	0.743 52	0.794 22	0.655 72	0.684 29	0.822 35	0.497 28	0.719 53	0.622 24	0.617 21	0.977 4	0.447 54	0.339 6	0.750 16	0.664 61	0.703 30	0.790 21	0.596 43	0.946 4	0.855 20	0.647 37
Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu: One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation. CVPR 2021
HPGCNN	0.656 47	0.698 68	0.743 49	0.650 73	0.564 64	0.820 38	0.505 21	0.758 41	0.631 22	0.479 66	0.945 49	0.480 38	0.226 54	0.572 49	0.774 40	0.690 35	0.735 47	0.614 35	0.853 65	0.776 68	0.597 56
Jisheng Dang, Qingyong Hu, Yulan Guo, Jun Yang: HPGCNN.
AttAN	0.609 69	0.760 45	0.667 77	0.649 74	0.521 73	0.793 59	0.457 43	0.648 68	0.528 61	0.434 78	0.947 43	0.401 72	0.153 84	0.454 76	0.721 50	0.648 51	0.717 53	0.536 70	0.904 28	0.765 71	0.485 83
Gege Zhang, Qinghua Ma, Licheng Jiao, Fang Liu and Qigong Sun: AttAN: Attention Adversarial Networks for 3D Point Cloud Semantic Segmentation. IJCAI2020
GMLPs	0.538 81	0.495 91	0.693 69	0.647 75	0.471 80	0.793 59	0.300 86	0.477 87	0.505 66	0.358 85	0.903 89	0.327 84	0.081 92	0.472 75	0.529 73	0.448 88	0.710 54	0.509 74	0.746 80	0.737 79	0.554 71

HPEIN	0.618 67	0.729 58	0.668 76	0.647 75	0.597 53	0.766 71	0.414 64	0.680 62	0.520 62	0.525 52	0.946 46	0.432 57	0.215 59	0.493 72	0.599 66	0.638 56	0.617 83	0.570 53	0.897 34	0.806 45	0.605 52
Li Jiang, Hengshuang Zhao, Shu Liu, Xiaoyong Shen, Chi-Wing Fu, Jiaya Jia: Hierarchical Point-Edge Interaction Network for Point Cloud Semantic Segmentation. ICCV 2019
3DMV	0.484 87	0.484 93	0.538 94	0.643 77	0.424 85	0.606 95	0.310 84	0.574 79	0.433 86	0.378 82	0.796 95	0.301 87	0.214 60	0.537 62	0.208 94	0.472 87	0.507 95	0.413 93	0.693 86	0.602 94	0.539 73
Angela Dai, Matthias Niessner: 3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation. ECCV'18
PD-Net	0.638 54	0.797 31	0.769 34	0.641 78	0.590 55	0.820 38	0.461 41	0.537 84	0.637 20	0.536 48	0.947 43	0.388 75	0.206 62	0.656 26	0.668 59	0.647 52	0.732 49	0.585 50	0.868 59	0.793 55	0.473 87

LAP-D	0.594 72	0.720 61	0.692 70	0.637 79	0.456 82	0.773 69	0.391 74	0.730 51	0.587 42	0.445 75	0.940 63	0.381 76	0.288 26	0.434 79	0.453 80	0.591 71	0.649 76	0.581 51	0.777 77	0.749 77	0.610 48

subcloud_weak	0.516 83	0.676 71	0.591 92	0.609 80	0.442 83	0.774 68	0.335 82	0.597 75	0.422 87	0.357 86	0.932 75	0.341 83	0.094 91	0.298 88	0.528 74	0.473 86	0.676 70	0.495 79	0.602 93	0.721 83	0.349 94

SPLAT Net	0.393 95	0.472 95	0.511 95	0.606 81	0.311 96	0.656 86	0.245 93	0.405 89	0.328 95	0.197 97	0.927 78	0.227 96	0.000 99	0.001 100	0.249 90	0.271 98	0.510 93	0.383 96	0.593 94	0.699 86	0.267 96
Hang Su, Varun Jampani, Deqing Sun, Subhransu Maji, Evangelos Kalogerakis, Ming-Hsuan Yang, Jan Kautz: SPLATNet: Sparse Lattice Networks for Point Cloud Processing. CVPR 2018
PanopticFusion-label	0.529 82	0.491 92	0.688 73	0.604 82	0.386 87	0.632 91	0.225 96	0.705 60	0.434 85	0.293 91	0.815 94	0.348 82	0.241 52	0.499 70	0.669 58	0.507 81	0.649 76	0.442 90	0.796 75	0.602 94	0.561 67
Gaku Narita, Takashi Seno, Tomoya Ishikawa, Yohsuke Kaji: PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Things. IROS 2019 (to appear)
DPC	0.592 73	0.720 61	0.700 64	0.602 83	0.480 78	0.762 74	0.380 77	0.713 57	0.585 45	0.437 76	0.940 63	0.369 78	0.288 26	0.434 79	0.509 76	0.590 73	0.639 81	0.567 56	0.772 78	0.755 75	0.592 58
Francis Engelmann, Theodora Kontogianni, Bastian Leibe: Dilated Point Convolutions: On the Receptive Field Size of Point Convolutions on 3D Point Clouds. ICRA 2020
PNET2	0.442 91	0.548 88	0.548 93	0.597 84	0.363 91	0.628 93	0.300 86	0.292 93	0.374 90	0.307 90	0.881 91	0.268 92	0.186 72	0.238 93	0.204 95	0.407 91	0.506 96	0.449 87	0.667 89	0.620 93	0.462 88

Online SegFusion	0.515 84	0.607 82	0.644 83	0.579 85	0.434 84	0.630 92	0.353 80	0.628 73	0.440 83	0.410 79	0.762 97	0.307 86	0.167 79	0.520 64	0.403 84	0.516 80	0.565 86	0.447 88	0.678 88	0.701 85	0.514 80
Davide Menini, Suryansh Kumar, Martin R. Oswald, Erik Sandstroem, Cristian Sminchisescu, Luc van Gool: A Real-Time Learning Framework for Joint 3D Reconstruction and Semantic Segmentation. Robotics and Automation Letters Submission
FCPN	0.447 89	0.679 70	0.604 91	0.578 86	0.380 88	0.682 85	0.291 89	0.106 98	0.483 74	0.258 96	0.920 82	0.258 93	0.025 96	0.231 95	0.325 87	0.480 85	0.560 88	0.463 85	0.725 83	0.666 90	0.231 98
Dario Rethage, Johanna Wald, Jürgen Sturm, Nassir Navab, Federico Tombari: Fully-Convolutional Point Networks for Large-Scale Point Clouds. ECCV 2018
PCNN	0.498 86	0.559 86	0.644 83	0.560 87	0.420 86	0.711 82	0.229 94	0.414 88	0.436 84	0.352 87	0.941 60	0.324 85	0.155 83	0.238 93	0.387 85	0.493 82	0.529 92	0.509 74	0.813 74	0.751 76	0.504 81

3DWSSS	0.425 94	0.525 89	0.647 81	0.522 88	0.324 94	0.488 98	0.077 99	0.712 58	0.353 92	0.401 80	0.636 99	0.281 90	0.176 75	0.340 86	0.565 68	0.175 99	0.551 89	0.398 94	0.370 99	0.602 94	0.361 92

ScanNet	0.306 99	0.203 99	0.366 98	0.501 89	0.311 96	0.524 97	0.211 97	0.002 100	0.342 94	0.189 98	0.786 96	0.145 99	0.102 90	0.245 92	0.152 97	0.318 97	0.348 98	0.300 98	0.460 98	0.437 99	0.182 99
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner: ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes. CVPR'17
SPH3D-GCN	0.610 68	0.858 16	0.772 32	0.489 90	0.532 71	0.792 61	0.404 68	0.643 71	0.570 51	0.507 60	0.935 69	0.414 68	0.046 95	0.510 67	0.702 53	0.602 66	0.705 59	0.549 64	0.859 63	0.773 69	0.534 75
Huan Lei, Naveed Akhtar, and Ajmal Mian: Spherical Kernel for Efficient Graph Convolution on 3D Point Clouds. TPAMI 2020
Tangent Convolutions	0.438 93	0.437 96	0.646 82	0.474 91	0.369 89	0.645 89	0.353 80	0.258 95	0.282 97	0.279 92	0.918 84	0.298 88	0.147 87	0.283 90	0.294 88	0.487 83	0.562 87	0.427 92	0.619 92	0.633 92	0.352 93
Maxim Tatarchenko, Jaesik Park, Vladlen Koltun, Qian-Yi Zhou: Tangent convolutions for dense prediction in 3d. CVPR 2018
DGCNN_reproduce	0.446 90	0.474 94	0.623 86	0.463 92	0.366 90	0.651 88	0.310 84	0.389 91	0.349 93	0.330 88	0.937 66	0.271 91	0.126 88	0.285 89	0.224 92	0.350 95	0.577 85	0.445 89	0.625 91	0.723 82	0.394 90
Yue Wang, Yongbin Sun, Ziwei Liu, Sanjay E. Sarma, Michael M. Bronstein, Justin M. Solomon: Dynamic Graph CNN for Learning on Point Clouds. TOG 2019
PointNet++	0.339 97	0.584 84	0.478 97	0.458 93	0.256 98	0.360 99	0.250 91	0.247 96	0.278 98	0.261 95	0.677 98	0.183 97	0.117 89	0.212 97	0.145 98	0.364 93	0.346 99	0.232 99	0.548 95	0.523 98	0.252 97
Charles R. Qi, Li Yi, Hao Su, Leonidas J. Guibas: pointnet++: deep hierarchical feature learning on point sets in a metric space.
SD-DETR	0.576 76	0.746 50	0.609 89	0.445 94	0.517 74	0.643 90	0.366 78	0.714 56	0.456 80	0.468 69	0.870 92	0.432 57	0.264 42	0.558 55	0.674 57	0.586 74	0.688 66	0.482 82	0.739 82	0.733 80	0.537 74

ScanNet+FTSDF	0.383 96	0.297 98	0.491 96	0.432 95	0.358 92	0.612 94	0.274 90	0.116 97	0.411 88	0.265 94	0.904 88	0.229 95	0.079 93	0.250 91	0.185 96	0.320 96	0.510 93	0.385 95	0.548 95	0.597 97	0.394 90

3DMV, FTSDF	0.501 85	0.558 87	0.608 90	0.424 96	0.478 79	0.690 83	0.246 92	0.586 77	0.468 77	0.450 72	0.911 85	0.394 73	0.160 82	0.438 77	0.212 93	0.432 89	0.541 91	0.475 83	0.742 81	0.727 81	0.477 85

SurfaceConvPF	0.442 91	0.505 90	0.622 87	0.380 97	0.342 93	0.654 87	0.227 95	0.397 90	0.367 91	0.276 93	0.924 79	0.240 94	0.198 68	0.359 85	0.262 89	0.366 92	0.581 84	0.435 91	0.640 90	0.668 89	0.398 89
Hao Pan, Shilin Liu, Yang Liu, Xin Tong: Convolutional Neural Networks on 3D Surfaces Using Parallel Frames.
PointCNN with RGB	0.458 88	0.577 85	0.611 88	0.356 98	0.321 95	0.715 81	0.299 88	0.376 92	0.328 95	0.319 89	0.944 55	0.285 89	0.164 80	0.216 96	0.229 91	0.484 84	0.545 90	0.456 86	0.755 79	0.709 84	0.475 86
Yangyan Li, Rui Bu, Mingchao Sun, Baoquan Chen: PointCNN. NeurIPS 2018
SSC-UNet	0.308 98	0.353 97	0.290 99	0.278 99	0.166 99	0.553 96	0.169 98	0.286 94	0.147 99	0.148 99	0.908 86	0.182 98	0.064 94	0.023 99	0.018 100	0.354 94	0.363 97	0.345 97	0.546 97	0.685 87	0.278 95

ERROR	0.054 100	0.000 100	0.041 100	0.172 100	0.030 100	0.062 100	0.001 100	0.035 99	0.004 100	0.051 100	0.143 100	0.019 100	0.003 98	0.041 98	0.050 99	0.003 100	0.054 100	0.018 100	0.005 100	0.264 100	0.082 100

This table lists the benchmark results for the 3D semantic instance scenario.

Method	avg ap	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	window

PBNet	0.573 2	0.926 2	0.575 10	0.619 1	0.472 2	0.736 4	0.239 5	0.487 25	0.383 2	0.459 3	0.506 6	0.533 7	0.585 6	0.767 7	0.404 8	0.717 3	0.559 5	0.969 2	0.381 4

IPCA-Inst	0.520 8	0.889 6	0.551 14	0.548 2	0.418 5	0.665 18	0.064 19	0.585 10	0.260 17	0.277 19	0.471 11	0.500 9	0.644 4	0.785 4	0.369 9	0.591 18	0.511 7	0.878 18	0.362 8

DKNet	0.532 7	0.815 9	0.624 3	0.517 3	0.377 9	0.749 1	0.107 10	0.509 22	0.304 9	0.437 6	0.475 9	0.581 3	0.539 9	0.775 6	0.339 13	0.640 11	0.506 9	0.901 10	0.385 3
Yizheng Wu, Min Shi, Shuaiyuan Du, Hao Lu, Zhiguo Cao, Weicai Zhong: 3D Instances as 1D Kernels. ECCV 2022
SSEC	0.465 16	0.667 27	0.578 8	0.502 4	0.362 15	0.641 25	0.035 28	0.605 6	0.291 15	0.323 15	0.451 14	0.296 17	0.417 25	0.677 20	0.245 26	0.501 34	0.506 10	0.900 11	0.366 5

SSTNet	0.506 10	0.738 17	0.549 15	0.497 5	0.316 19	0.693 12	0.178 7	0.377 33	0.198 22	0.330 12	0.463 13	0.576 4	0.515 11	0.857 2	0.494 1	0.637 12	0.457 15	0.943 4	0.290 23
Zhihao Liang, Zhihao Li, Songcen Xu, Mingkui Tan, Kui Jia: Instance Segmentation in 3D Scenes using Semantic Superpoint Tree Networks. ICCV2021
SPFormer	0.549 6	0.745 14	0.640 2	0.484 6	0.395 6	0.739 2	0.311 1	0.566 13	0.335 6	0.468 2	0.492 8	0.555 6	0.478 14	0.747 12	0.436 6	0.712 4	0.540 6	0.893 13	0.343 12
Sun Jiahao, Qing Chunmei, Tan Junpeng, Xu Xiangmin: Superpoint Transformer for 3D Scene Instance Segmentation. AAAI 2023 [Oral]
DD-UNet+Group	0.436 18	0.630 34	0.508 26	0.480 7	0.310 20	0.624 29	0.065 18	0.638 5	0.174 24	0.256 23	0.384 21	0.194 31	0.428 21	0.759 8	0.289 18	0.574 22	0.400 23	0.849 27	0.291 22
H. Liu, R. Liu, K. Yang, J. Zhang, K. Peng, R. Stiefelhagen: HIDA: Towards Holistic Indoor Understanding for the Visually Impaired via Semantic Instance Segmentation with a Wearable Solid-State LiDAR Sensor. ICCVW 2021
Mask-Group	0.434 20	0.778 12	0.516 21	0.471 8	0.330 17	0.658 19	0.029 30	0.526 20	0.249 18	0.256 22	0.400 19	0.309 16	0.384 29	0.296 46	0.368 10	0.575 21	0.425 20	0.877 19	0.362 9
Min Zhong, Xinghao Chen, Xiaokang Chen, Gang Zeng, Yunhe Wang: MaskGroup: Hierarchical Point Grouping and Masking for 3D Instance Segmentation. ICME 2022
TopoSeg	0.479 14	0.704 20	0.564 11	0.467 9	0.366 12	0.633 26	0.068 17	0.554 16	0.262 16	0.328 13	0.447 15	0.323 13	0.534 10	0.722 14	0.288 19	0.614 13	0.482 13	0.912 6	0.358 10

HAIS	0.457 17	0.704 20	0.561 12	0.457 10	0.364 13	0.673 15	0.046 27	0.547 17	0.194 23	0.308 16	0.426 16	0.288 18	0.454 17	0.711 16	0.262 23	0.563 25	0.434 19	0.889 15	0.344 11
Shaoyu Chen, Jiemin Fang, Qian Zhang, Wenyu Liu, Xinggang Wang: Hierarchical Aggregation for 3D Instance Segmentation. ICCV 2021
Dyco3D	0.395 27	0.642 32	0.518 20	0.447 11	0.259 28	0.666 17	0.050 25	0.251 46	0.166 25	0.231 27	0.362 23	0.232 26	0.331 32	0.535 29	0.229 27	0.587 19	0.438 18	0.850 25	0.317 16
Tong He; Chunhua Shen; Anton van den Hengel: DyCo3D: Robust Instance Segmentation of 3D Point Clouds through Dynamic Convolution. CVPR2021
PE	0.396 26	0.667 27	0.467 31	0.446 12	0.243 30	0.624 30	0.022 34	0.577 11	0.106 34	0.219 29	0.340 25	0.239 24	0.487 13	0.475 37	0.225 28	0.541 30	0.350 30	0.818 33	0.273 26
Biao Zhang, Peter Wonka: Point Cloud Instance Segmentation using Probabilistic Embeddings. CVPR 2021
GraphCut	0.552 5	1.000 1	0.611 4	0.438 13	0.392 7	0.714 8	0.139 8	0.598 9	0.327 7	0.389 7	0.510 5	0.598 1	0.427 23	0.754 10	0.463 4	0.761 1	0.588 2	0.903 9	0.329 14

TD3D	0.489 12	0.852 7	0.511 23	0.434 14	0.322 18	0.735 5	0.101 13	0.512 21	0.355 5	0.349 11	0.468 12	0.283 19	0.514 12	0.676 21	0.268 22	0.671 7	0.510 8	0.908 7	0.329 15

Box2Mask	0.433 21	0.741 15	0.463 33	0.433 15	0.283 22	0.625 28	0.103 11	0.298 42	0.125 32	0.260 21	0.424 17	0.322 14	0.472 15	0.701 18	0.363 11	0.711 5	0.309 40	0.882 16	0.272 27
Julian Chibane, Francis Engelmann, Tuan Anh Tran, Gerard Pons-Moll: Box2Mask: Weakly Supervised 3D Semantic Instance Segmentation Using Bounding Boxes. ECCV 2022
OccuSeg+instance	0.486 13	0.802 11	0.536 17	0.428 16	0.369 11	0.702 10	0.205 6	0.331 38	0.301 11	0.379 9	0.474 10	0.327 12	0.437 19	0.862 1	0.485 2	0.601 16	0.394 25	0.846 29	0.273 25
Lei Han, Tian Zheng, Lan Xu, Lu Fang: OccuSeg: Occupancy-aware 3D Instance Segmentation. CVPR2020
PointGroup	0.407 24	0.639 33	0.496 27	0.415 17	0.243 31	0.645 24	0.021 35	0.570 12	0.114 33	0.211 34	0.359 24	0.217 29	0.428 22	0.660 22	0.256 24	0.562 26	0.341 32	0.860 23	0.291 21
Li Jiang, Hengshuang Zhao, Shaoshuai Shi, Shu Liu, Chi-Wing Fu, Jiaya Jia: PointGroup: Dual-Set Point Grouping for 3D Instance Segmentation. CVPR 2020 [oral]
Mask3D	0.566 3	0.926 2	0.597 5	0.408 18	0.420 4	0.737 3	0.239 4	0.598 8	0.386 1	0.458 4	0.549 1	0.568 5	0.716 2	0.601 25	0.480 3	0.646 9	0.575 3	0.922 5	0.364 6
Jonas Schult, Francis Engelmann, Alexander Hermans, Or Litany, Siyu Tang, Bastian Leibe: Mask3D for 3D Semantic Instance Segmentation. ICRA 2023
DualGroup	0.469 15	0.815 9	0.552 13	0.398 19	0.374 10	0.683 14	0.130 9	0.539 18	0.310 8	0.327 14	0.407 18	0.276 20	0.447 18	0.535 30	0.342 12	0.659 8	0.455 16	0.900 12	0.301 19

SoftGroup++	0.513 9	0.704 20	0.578 9	0.398 20	0.363 14	0.704 9	0.061 20	0.647 4	0.297 14	0.378 10	0.537 2	0.343 11	0.614 5	0.828 3	0.295 17	0.710 6	0.505 11	0.875 20	0.394 1

Queryformer	0.583 1	0.926 2	0.702 1	0.393 21	0.504 1	0.733 6	0.276 2	0.527 19	0.373 4	0.479 1	0.534 3	0.533 8	0.697 3	0.720 15	0.436 7	0.745 2	0.592 1	0.958 3	0.363 7

ISBNet	0.559 4	0.926 2	0.597 6	0.390 22	0.436 3	0.722 7	0.276 3	0.556 15	0.380 3	0.450 5	0.505 7	0.583 2	0.730 1	0.575 26	0.455 5	0.603 15	0.573 4	0.979 1	0.332 13
Tuan Duc Ngo, Binh-Son Hua, Khoi Nguyen: ISBNet: a 3D Point Cloud Instance Segmentation Network with Instance-aware Sampling and Box-aware Dynamic Convolution. CVPR 2023
AOIA	0.387 29	0.704 20	0.515 22	0.385 23	0.225 34	0.669 16	0.005 43	0.482 26	0.126 31	0.181 39	0.269 35	0.221 28	0.426 24	0.478 36	0.218 29	0.592 17	0.371 27	0.851 24	0.242 31

NeuralBF	0.353 34	0.593 36	0.511 24	0.375 24	0.264 26	0.597 31	0.008 39	0.332 37	0.160 26	0.229 28	0.274 34	0.000 56	0.206 40	0.678 19	0.155 40	0.485 36	0.422 21	0.816 34	0.254 30
Weiwei Sun, Daniel Rebain, Renjie Liao, Vladimir Tankovich, Soroosh Yazdani, Kwang Moo Yi, Andrea Tagliasacchi: NeuralBF: Neural Bilateral Filtering for Top-down Instance Segmentation on Point Clouds. WACV 2023
SoftGroup	0.504 11	0.667 27	0.579 7	0.372 25	0.381 8	0.694 11	0.072 16	0.677 2	0.303 10	0.387 8	0.531 4	0.319 15	0.582 7	0.754 9	0.318 14	0.643 10	0.492 12	0.907 8	0.388 2
Thang Vu, Kookhoi Kim, Tung M. Luu, Xuan Thanh Nguyen, Chang D. Yoo: SoftGroup for 3D Instance Segmentaiton on Point Clouds. CVPR 2022 [Oral]
RPGN	0.428 22	0.630 34	0.508 25	0.367 26	0.249 29	0.658 20	0.016 37	0.673 3	0.131 30	0.234 26	0.383 22	0.270 21	0.434 20	0.748 11	0.274 21	0.609 14	0.406 22	0.842 31	0.267 28
Shichao Dong, Guosheng Lin, Tzu-Yi Hung: Learning Regional Purity for Instance Segmentation on 3D Point Clouds. ECCV 2022
INS-Conv-instance	0.435 19	0.716 19	0.495 28	0.355 27	0.331 16	0.689 13	0.102 12	0.394 32	0.208 21	0.280 17	0.395 20	0.250 23	0.544 8	0.741 13	0.309 16	0.536 31	0.391 26	0.842 32	0.258 29

SphereSeg	0.357 32	0.651 31	0.411 35	0.345 28	0.264 27	0.630 27	0.059 21	0.289 44	0.212 19	0.240 25	0.336 26	0.158 35	0.305 33	0.557 27	0.159 39	0.455 40	0.341 33	0.726 41	0.294 20

GICN	0.341 36	0.580 37	0.371 37	0.344 29	0.198 36	0.469 39	0.052 23	0.564 14	0.093 35	0.212 32	0.212 40	0.127 38	0.347 31	0.537 28	0.206 30	0.525 32	0.329 35	0.729 40	0.241 32

Occipital-SCS	0.320 38	0.679 26	0.352 39	0.334 30	0.229 32	0.436 40	0.025 31	0.412 30	0.058 41	0.161 44	0.240 37	0.085 40	0.262 35	0.496 35	0.187 34	0.467 38	0.328 36	0.775 35	0.231 33

CSC-Pretrained	0.405 25	0.738 17	0.465 32	0.331 31	0.205 35	0.655 21	0.051 24	0.601 7	0.092 36	0.211 35	0.329 27	0.198 30	0.459 16	0.775 5	0.195 33	0.524 33	0.400 24	0.878 17	0.184 37

RWSeg	0.348 35	0.475 42	0.456 34	0.320 32	0.275 25	0.476 38	0.020 36	0.491 24	0.056 43	0.212 33	0.320 28	0.261 22	0.302 34	0.520 31	0.182 35	0.557 27	0.285 42	0.867 21	0.197 35

3D-MPA	0.355 33	0.457 45	0.484 30	0.299 33	0.277 24	0.591 32	0.047 26	0.332 36	0.212 20	0.217 30	0.278 32	0.193 32	0.413 26	0.410 40	0.195 32	0.574 23	0.352 29	0.849 26	0.213 34
Francis Engelmann, Martin Bokeloh, Alireza Fathi, Bastian Leibe, Matthias Nießner: 3D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentation. CVPR 2020
SPG_WSIS	0.251 44	0.380 47	0.274 46	0.289 34	0.144 41	0.413 43	0.000 49	0.311 40	0.065 39	0.113 46	0.130 46	0.029 48	0.204 41	0.388 41	0.108 46	0.459 39	0.311 38	0.769 36	0.127 44

PCJC	0.375 31	0.704 20	0.542 16	0.284 35	0.197 37	0.649 22	0.006 41	0.426 27	0.138 28	0.242 24	0.304 31	0.183 34	0.388 28	0.629 23	0.141 43	0.546 29	0.344 31	0.738 39	0.283 24

PanopticFusion-inst	0.214 46	0.250 51	0.330 42	0.275 36	0.103 47	0.228 55	0.000 49	0.345 35	0.024 47	0.088 48	0.203 42	0.186 33	0.167 45	0.367 43	0.125 44	0.221 53	0.112 55	0.666 44	0.162 40
Gaku Narita, Takashi Seno, Tomoya Ishikawa, Yohsuke Kaji: PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Things. IROS 2019 (to appear)
3D-BoNet	0.253 43	0.519 40	0.324 43	0.251 37	0.137 43	0.345 49	0.031 29	0.419 29	0.069 38	0.162 43	0.131 45	0.052 44	0.202 42	0.338 44	0.147 42	0.301 50	0.303 41	0.651 45	0.178 38
Bo Yang, Jianan Wang, Ronald Clark, Qingyong Hu, Sen Wang, Andrew Markham, Niki Trigoni: Learning Object Bounding Boxes for 3D Instance Segmentation on Point Clouds. NeurIPS 2019 Spotlight
DENet	0.413 23	0.741 15	0.520 19	0.237 38	0.284 21	0.523 36	0.097 14	0.691 1	0.138 27	0.209 36	0.229 38	0.238 25	0.390 27	0.707 17	0.310 15	0.448 41	0.470 14	0.892 14	0.310 17

One_Thing_One_Click	0.326 37	0.472 43	0.361 38	0.232 39	0.183 38	0.555 34	0.000 49	0.498 23	0.038 45	0.195 37	0.226 39	0.362 10	0.168 44	0.469 38	0.251 25	0.553 28	0.335 34	0.846 28	0.117 45
Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu: One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation. CVPR 2021
OSIS	0.392 28	0.778 12	0.530 18	0.220 40	0.278 23	0.567 33	0.083 15	0.330 39	0.299 12	0.270 20	0.310 30	0.143 36	0.260 36	0.624 24	0.277 20	0.568 24	0.361 28	0.865 22	0.301 18

SSEN	0.384 30	0.852 7	0.494 29	0.192 41	0.226 33	0.648 23	0.022 33	0.398 31	0.299 13	0.277 18	0.317 29	0.231 27	0.194 43	0.514 33	0.196 31	0.586 20	0.444 17	0.843 30	0.184 36
Dongsu Zhang, Junha Chun, Sang Kyun Cha, Young Min Kim: Spatial Semantic Embedding Network: Fast 3D Instance Segmentation with Deep Metric Learning. Arxiv
MTML	0.282 40	0.577 38	0.380 36	0.182 42	0.107 46	0.430 41	0.001 46	0.422 28	0.057 42	0.179 40	0.162 43	0.070 43	0.229 38	0.511 34	0.161 37	0.491 35	0.313 37	0.650 46	0.162 39
Jean Lahoud, Bernard Ghanem, Marc Pollefeys, Martin R. Oswald: 3D Instance Segmentation via Multi-task Metric Learning. ICCV 2019 [oral]
Sparse R-CNN	0.292 39	0.704 20	0.213 49	0.153 43	0.154 40	0.551 35	0.053 22	0.212 47	0.132 29	0.174 41	0.274 33	0.070 42	0.363 30	0.441 39	0.176 36	0.424 43	0.234 44	0.758 37	0.161 41

MASC	0.254 42	0.463 44	0.249 48	0.113 44	0.167 39	0.412 44	0.000 48	0.374 34	0.073 37	0.173 42	0.243 36	0.130 37	0.228 39	0.368 42	0.160 38	0.356 45	0.208 45	0.711 43	0.136 43
Chen Liu, Yasutaka Furukawa: MASC: Multi-scale Affinity with Sparse Convolution for 3D Instance Segmentation.
R-PointNet	0.158 49	0.356 48	0.173 51	0.113 45	0.140 42	0.359 45	0.012 38	0.023 54	0.039 44	0.134 45	0.123 47	0.008 52	0.089 49	0.149 51	0.117 45	0.221 52	0.128 52	0.563 48	0.094 46

UNet-backbone	0.161 47	0.519 40	0.259 47	0.084 46	0.059 49	0.325 51	0.002 44	0.093 52	0.009 51	0.077 50	0.064 49	0.045 45	0.044 53	0.161 50	0.045 49	0.331 48	0.180 47	0.566 47	0.033 56

Region-18class	0.146 50	0.175 55	0.321 44	0.080 47	0.062 48	0.357 46	0.000 49	0.307 41	0.002 53	0.066 51	0.044 51	0.000 56	0.018 55	0.036 55	0.054 48	0.447 42	0.133 50	0.472 49	0.060 51

SemRegionNet-20cls	0.121 51	0.296 50	0.203 50	0.071 48	0.058 50	0.349 47	0.000 49	0.150 48	0.019 48	0.054 52	0.034 53	0.017 51	0.052 51	0.042 54	0.013 55	0.209 54	0.183 46	0.371 51	0.057 52

3D-SIS	0.161 47	0.407 46	0.155 53	0.068 49	0.043 53	0.346 48	0.001 45	0.134 49	0.005 52	0.088 47	0.106 48	0.037 47	0.135 48	0.321 45	0.028 52	0.339 46	0.116 54	0.466 50	0.093 47
Ji Hou, Angela Dai, Matthias Niessner: 3D-SIS: 3D Semantic Instance Segmentation of RGB-D Scans. CVPR 2019
SALoss-ResNet	0.262 41	0.667 27	0.335 40	0.067 50	0.123 44	0.427 42	0.022 32	0.280 45	0.058 40	0.216 31	0.211 41	0.039 46	0.142 46	0.519 32	0.106 47	0.338 47	0.310 39	0.721 42	0.138 42
Zhidong Liang, Ming Yang, Hao Li, Chunxiang Wang: 3D Instance Embedding Learning With a Structure-Aware Loss Function for Point Cloud Segmentation. IEEE Robotics and Automation Letters (IROS2020)
ASIS	0.085 55	0.037 56	0.080 56	0.066 51	0.047 52	0.282 53	0.000 49	0.052 53	0.002 54	0.047 54	0.026 54	0.001 55	0.046 52	0.194 49	0.031 51	0.264 51	0.140 49	0.167 55	0.047 55

SegGroup_ins	0.246 45	0.556 39	0.335 41	0.062 52	0.115 45	0.490 37	0.000 49	0.297 43	0.018 49	0.186 38	0.142 44	0.083 41	0.233 37	0.216 48	0.153 41	0.469 37	0.251 43	0.744 38	0.083 48
An Tao, Yueqi Duan, Yi Wei, Jiwen Lu, Jie Zhou: SegGroup: Seg-Level Supervision for 3D Instance and Semantic Segmentation. TIP 2022
tmp	0.113 54	0.333 49	0.151 54	0.056 53	0.053 51	0.344 50	0.000 49	0.105 51	0.016 50	0.049 53	0.035 52	0.020 50	0.053 50	0.048 53	0.013 54	0.183 55	0.173 48	0.344 53	0.054 53

Hier3D	0.117 52	0.222 53	0.161 52	0.054 54	0.027 54	0.289 52	0.000 49	0.124 50	0.001 55	0.079 49	0.061 50	0.027 49	0.141 47	0.240 47	0.005 56	0.310 49	0.129 51	0.153 56	0.081 49
Tan: HCFS3D: Hierarchical Coupled Feature Selection Network for 3D Semantic and Instance Segmentation.
Sgpn_scannet	0.049 56	0.023 57	0.134 55	0.031 55	0.013 56	0.144 56	0.006 40	0.008 56	0.000 56	0.028 56	0.017 55	0.003 53	0.009 57	0.000 56	0.021 53	0.122 56	0.095 56	0.175 54	0.054 54

3D-BEVIS	0.117 52	0.250 51	0.308 45	0.020 56	0.009 57	0.269 54	0.006 42	0.008 55	0.029 46	0.037 55	0.014 56	0.003 54	0.036 54	0.147 52	0.042 50	0.381 44	0.118 53	0.362 52	0.069 50
Cathrin Elich, Francis Engelmann, Jonas Schult, Theodora Kontogianni, Bastian Leibe: 3D-BEVIS: Birds-Eye-View Instance Segmentation.
MaskRCNN 2d->3d Proj	0.022 57	0.185 54	0.000 57	0.000 57	0.015 55	0.000 57	0.000 47	0.006 57	0.000 56	0.010 57	0.006 57	0.107 39	0.012 56	0.000 56	0.002 57	0.027 57	0.004 57	0.022 57	0.001 57

Method	avg iou	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	floor	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	wall	window

Virtual MVFusion (R)	0.745 1	0.861 1	0.839 1	0.881 1	0.672 1	0.512 1	0.422 15	0.898 1	0.723 1	0.714 1	0.954 2	0.454 1	0.509 1	0.773 1	0.895 1	0.756 1	0.820 1	0.653 1	0.935 1	0.891 1	0.728 1
Abhijit Kundu, Xiaoqi Yin, Alireza Fathi, David Ross, Brian Brewington, Thomas Funkhouser, Caroline Pantofaru: Virtual Multi-view Fusion for 3D Semantic Segmentation. ECCV 2020
BPNet_2D	0.670 2	0.822 3	0.795 3	0.836 2	0.659 2	0.481 2	0.451 11	0.769 3	0.656 3	0.567 3	0.931 3	0.395 4	0.390 4	0.700 3	0.534 3	0.689 9	0.770 2	0.574 3	0.865 6	0.831 3	0.675 4
Wenbo Hu, Hengshuang Zhao, Li Jiang, Jiaya Jia and Tien-Tsin Wong: Bidirectional Projection Network for Cross Dimension Scene Understanding. CVPR 2021 (Oral)
DMMF_3d	0.605 5	0.651 8	0.744 7	0.782 3	0.637 4	0.387 4	0.536 3	0.732 7	0.590 6	0.540 5	0.856 18	0.359 9	0.306 13	0.596 11	0.539 2	0.627 18	0.706 4	0.497 7	0.785 18	0.757 16	0.476 19

MCA-Net	0.595 6	0.533 17	0.756 6	0.746 4	0.590 8	0.334 7	0.506 6	0.670 12	0.587 7	0.500 10	0.905 8	0.366 8	0.352 8	0.601 10	0.506 6	0.669 15	0.648 7	0.501 6	0.839 12	0.769 12	0.516 18

RFBNet	0.592 7	0.616 9	0.758 5	0.659 5	0.581 9	0.330 8	0.469 10	0.655 15	0.543 12	0.524 7	0.924 4	0.355 10	0.336 10	0.572 14	0.479 8	0.671 13	0.648 7	0.480 9	0.814 16	0.814 5	0.614 9

ScanNet (2d proj)	0.330 23	0.293 22	0.521 22	0.657 6	0.361 22	0.161 22	0.250 22	0.004 23	0.440 20	0.183 23	0.836 20	0.125 22	0.060 23	0.319 23	0.132 22	0.417 22	0.412 22	0.344 22	0.541 23	0.427 23	0.109 23
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner: ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes. CVPR'17
SN_RN152pyrx8_RVC	0.546 14	0.572 14	0.663 18	0.638 7	0.518 15	0.298 14	0.366 21	0.633 18	0.510 15	0.446 17	0.864 16	0.296 17	0.267 17	0.542 16	0.346 18	0.704 7	0.575 16	0.431 16	0.853 10	0.766 14	0.630 7

UDSSEG_RVC	0.545 15	0.610 11	0.661 19	0.588 8	0.556 12	0.268 18	0.482 8	0.642 17	0.572 9	0.475 14	0.836 20	0.312 15	0.367 6	0.630 7	0.189 20	0.639 17	0.495 20	0.452 13	0.826 14	0.756 17	0.541 14

3DMV (2d proj)	0.498 19	0.481 21	0.612 20	0.579 9	0.456 19	0.343 5	0.384 18	0.623 19	0.525 14	0.381 20	0.845 19	0.254 19	0.264 19	0.557 15	0.182 21	0.581 21	0.598 13	0.429 17	0.760 20	0.661 22	0.446 21
Angela Dai, Matthias Niessner: 3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation. ECCV'18
EMSAFormer	0.564 13	0.581 13	0.736 8	0.564 10	0.546 13	0.219 20	0.517 4	0.675 11	0.486 17	0.427 19	0.904 9	0.352 11	0.320 11	0.589 12	0.528 4	0.708 6	0.464 21	0.413 19	0.847 11	0.786 8	0.611 10

DCRedNet	0.583 9	0.682 6	0.723 10	0.542 11	0.510 17	0.310 12	0.451 11	0.668 13	0.549 11	0.520 8	0.920 6	0.375 5	0.446 2	0.528 17	0.417 13	0.670 14	0.577 15	0.478 10	0.862 7	0.806 7	0.628 8

CMX	0.613 4	0.681 7	0.725 9	0.502 12	0.634 5	0.297 15	0.478 9	0.830 2	0.651 4	0.537 6	0.924 4	0.375 5	0.315 12	0.686 5	0.451 12	0.714 4	0.543 18	0.504 5	0.894 4	0.823 4	0.688 3

Enet (reimpl)	0.376 22	0.264 23	0.452 23	0.452 13	0.365 21	0.181 21	0.143 23	0.456 22	0.409 22	0.346 22	0.769 23	0.164 21	0.218 21	0.359 22	0.123 23	0.403 23	0.381 23	0.313 23	0.571 22	0.685 21	0.472 20
Re-implementation of Adam Paszke, Abhishek Chaurasia, Sangpil Kim, Eugenio Culurciello: ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation.
SSMA	0.577 11	0.695 4	0.716 12	0.439 14	0.563 11	0.314 11	0.444 13	0.719 8	0.551 10	0.503 9	0.887 12	0.346 13	0.348 9	0.603 9	0.353 17	0.709 5	0.600 12	0.457 12	0.901 2	0.786 8	0.599 11
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. International Journal of Computer Vision, 2019
UNIV_CNP_RVC_UE	0.566 12	0.569 16	0.686 16	0.435 15	0.524 14	0.294 16	0.421 16	0.712 9	0.543 12	0.463 15	0.872 14	0.320 14	0.363 7	0.611 8	0.477 9	0.686 10	0.627 9	0.443 15	0.862 7	0.775 11	0.639 5

AdapNet++	0.503 18	0.613 10	0.722 11	0.418 16	0.358 23	0.337 6	0.370 20	0.479 21	0.443 19	0.368 21	0.907 7	0.207 20	0.213 22	0.464 21	0.525 5	0.618 19	0.657 6	0.450 14	0.788 17	0.721 20	0.408 22
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. International Journal of Computer Vision, 2019
ILC-PSPNet	0.475 21	0.490 20	0.581 21	0.289 17	0.507 18	0.067 23	0.379 19	0.610 20	0.417 21	0.435 18	0.822 22	0.278 18	0.267 17	0.503 19	0.228 19	0.616 20	0.533 19	0.375 20	0.820 15	0.729 18	0.560 13

MIX6D_RVC	0.582 10	0.695 4	0.687 14	0.225 18	0.632 6	0.328 10	0.550 1	0.748 5	0.623 5	0.494 13	0.890 11	0.350 12	0.254 20	0.688 4	0.454 10	0.716 3	0.597 14	0.489 8	0.881 5	0.768 13	0.575 12

FuseNet	0.535 17	0.570 15	0.681 17	0.182 19	0.512 16	0.290 17	0.431 14	0.659 14	0.504 16	0.495 12	0.903 10	0.308 16	0.428 3	0.523 18	0.365 16	0.676 11	0.621 11	0.470 11	0.762 19	0.779 10	0.541 14
Caner Hazirbas, Lingni Ma, Csaba Domokos, Daniel Cremers: FuseNet: Incorporating Depth into Semantic Segmentation via Fusion-based CNN Architecture. ACCV 2016
CU-Hybrid-2D Net	0.636 3	0.825 2	0.820 2	0.179 20	0.648 3	0.463 3	0.549 2	0.742 6	0.676 2	0.628 2	0.961 1	0.420 2	0.379 5	0.684 6	0.381 15	0.732 2	0.723 3	0.599 2	0.827 13	0.851 2	0.634 6

segfomer with 6d	0.542 16	0.594 12	0.687 14	0.146 21	0.579 10	0.308 13	0.515 5	0.703 10	0.472 18	0.498 11	0.868 15	0.369 7	0.282 15	0.589 12	0.390 14	0.701 8	0.556 17	0.416 18	0.860 9	0.759 15	0.539 16

MSeg1080_RVC	0.485 20	0.505 19	0.709 13	0.092 22	0.427 20	0.241 19	0.411 17	0.654 16	0.385 23	0.457 16	0.861 17	0.053 23	0.279 16	0.503 19	0.481 7	0.645 16	0.626 10	0.365 21	0.748 21	0.725 19	0.529 17
John Lambert, Zhuang Liu, Ozan Sener, James Hays, Vladlen Koltun: MSeg: A Composite Dataset for Multi-domain Semantic Segmentation. CVPR 2020
FAN_NV_RVC	0.586 8	0.510 18	0.764 4	0.079 23	0.620 7	0.330 8	0.494 7	0.753 4	0.573 8	0.556 4	0.884 13	0.405 3	0.303 14	0.718 2	0.452 11	0.672 12	0.658 5	0.509 4	0.898 3	0.813 6	0.727 2

DMMF	0.003 24	0.000 24	0.005 24	0.000 24	0.000 24	0.037 24	0.001 24	0.000 24	0.001 24	0.005 24	0.003 24	0.000 24	0.000 24	0.000 24	0.000 24	0.000 24	0.002 24	0.001 24	0.000 24	0.006 24	0.000 24

Method	avg recall	apartment	bathroom	bedroom / hotel	bookstore / library	conference room	copy/mail room	hallway	kitchen	laundry room	living room / lounge	misc	office	storage / basement / garage

multi-task	0.700 1	0.500 1	1.000 1	0.882 2	0.500 2	1.000 1	1.000 1	0.500 2	1.000 1	1.000 1	0.778 1	0.000 2	0.938 1	0.000 2
Shengyu Huang, Mikhail Usvyatsov, Konrad Schindler: Indoor Scene Recognition in 3D. IROS 2020
3DASPP-SCE	0.691 2	0.500 1	0.938 2	0.824 3	1.000 1	1.000 1	0.500 2	1.000 1	0.857 2	0.500 2	0.556 3	0.000 2	0.812 2	0.500 1

SE-ResNeXt-SSMA	0.498 3	0.000 4	0.812 3	0.941 1	0.500 2	0.500 3	0.500 2	0.500 2	0.429 4	0.500 2	0.667 2	0.500 1	0.625 3	0.000 2
Abhinav Valada, Rohit Mohan, Wolfram Burgard: Self-Supervised Model Adaptation for Multimodal Semantic Segmentation. arXiv
resnet50_scannet	0.353 4	0.250 3	0.812 3	0.529 4	0.500 2	0.500 3	0.000 4	0.500 2	0.571 3	0.000 4	0.556 3	0.000 2	0.375 4	0.000 2

Presenting the ScanNet200 Benchmark

ScanNet200 Benchmark

ScanNet200 3D Semantic Label Benchmark

ScanNet200 3D Semantic Instance Benchmark

ScanNet Benchmark

3D Semantic Label Benchmark

3D Semantic Instance Benchmark

2D Semantic Label Benchmark

2D Semantic Instance Benchmark

Scene Type Classification Benchmark

Method	avg ap	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	window

UniDet_RVC	0.205 1	0.381 1	0.323 1	0.037 1	0.226 1	0.177 1	0.063 1	0.277 1	0.120 1	0.067 1	0.131 1	0.074 2	0.317 1	0.080 1	0.235 1	0.289 1	0.141 1	0.678 1	0.080 1

MaskRCNN_ScanNet	0.119 2	0.129 2	0.212 2	0.002 2	0.112 2	0.148 2	0.014 2	0.205 2	0.044 2	0.066 2	0.078 2	0.095 1	0.142 2	0.030 2	0.128 2	0.139 2	0.080 2	0.459 2	0.057 2
Re-implementation of Kaiming He, Georgia Gkioxari, Piotr Dollár, Ross Girshick: Mask R-CNN. ICCV'17