Benchmark Results - ScanNet Benchmark

This table lists the benchmark results for the ScanNet200 3D semantic label scenario.

Method	avg iou	head iou	common iou	tail iou	backpack	bag	ball	bar	basket	bathroom cabinet	bathroom stall	bathroom stall door	bathroom vanity	bathtub	bed	bench	bicycle	bin	blackboard	blanket	blinds	board	book	bookshelf	bottle	bowl	box	broom	bucket	bulletin board	cabinet	calendar	candle	cart	case of water bottles	ceiling	ceiling light	chair	clock	closet	closet rod	clothes	clothes dryer	coat rack	coffee kettle	coffee maker	coffee table	column	computer tower	copier	couch	counter	cup	curtain	cushion	decoration	desk	dining table	dish rack	dishwasher	door	doorframe	dresser	dumbbell	end table	fan	file cabinet	fire alarm	fire extinguisher	floor	folded chair	hat	headphones	ironing board	jacket	keyboard	keyboard piano	kitchen cabinet	kitchen counter	ladder	lamp	laptop	laundry basket	laundry detergent	laundry hamper	ledge	light	light switch	machine	mailbox	mat	microwave	mini fridge	mirror	monitor	mouse	music stand	nightstand	object	office chair	oven	paper	paper bag	paper cutter	paper towel dispenser	paper towel roll	person	piano	picture	pillow	pipe	plant	plate	plunger	poster	power outlet	power strip	printer	projector	projector screen	rack	radiator	range hood	recycling bin	refrigerator	scale	seat	shelf	shoe	shower	shower curtain	shower curtain rod	shower floor	shower head	shower wall	sign	sink	soap dispenser	sofa chair	speaker	stair rail	stairs	stand	stool	storage bin	storage container	storage organizer	stove	structure	stuffed animal	suitcase	table	telephone	tissue box	toaster	toilet	toilet paper	toilet paper dispenser	towel	trash bin	trash can	tray	tube	tv	tv stand	vacuum cleaner	vent	wall	wardrobe	washing machine	water bottle	water cooler	water pitcher	whiteboard	window	windowsill

CSC-Pretrain	0.249 10	0.455 10	0.171 9	0.079 10	0.418 9	0.059 9	0.186 7	0.000 1	0.000 2	0.000 1	0.335 7	0.250 9	0.316 9	0.766 5	0.697 10	0.142 7	0.170 7	0.003 2	0.553 8	0.112 5	0.097 1	0.201 10	0.186 7	0.476 10	0.081 9	0.000 4	0.216 10	0.000 1	0.000 3	0.001 10	0.314 10	0.000 5	0.000 1	0.055 8	0.000 2	0.832 10	0.094 2	0.659 8	0.002 2	0.076 6	0.310 10	0.293 10	0.664 10	0.000 1	0.000 2	0.175 10	0.634 4	0.130 2	0.552 10	0.686 10	0.700 10	0.076 4	0.110 8	0.770 10	0.000 1	0.000 6	0.430 10	0.000 6	0.319 8	0.166 9	0.542 10	0.327 9	0.205 9	0.332 9	0.052 9	0.375 6	0.444 10	0.000 3	0.012 10	0.930 10	0.203 1	0.000 1	0.000 6	0.046 6	0.175 7	0.413 9	0.592 8	0.471 9	0.299 8	0.152 10	0.340 9	0.247 10	0.000 3	0.000 1	0.225 8	0.058 2	0.037 2	0.000 5	0.207 1	0.862 10	0.014 7	0.548 7	0.033 9	0.233 9	0.816 9	0.000 5	0.000 1	0.542 9	0.123 3	0.121 1	0.019 2	0.000 1	0.000 4	0.463 9	0.454 10	0.045 10	0.128 10	0.557 9	0.235 7	0.441 9	0.063 7	0.484 10	0.000 3	0.308 10	0.000 1	0.000 3	0.000 2	0.318 10	0.000 1	0.000 4	0.000 1	0.545 9	0.543 8	0.164 10	0.734 6	0.000 5	0.000 1	0.215 10	0.371 9	0.198 7	0.743 7	0.205 9	0.062 8	0.000 6	0.079 7	0.000 1	0.683 9	0.547 9	0.142 6	0.000 7	0.441 5	0.579 10	0.000 1	0.464 8	0.098 5	0.041 1	0.000 1	0.590 9	0.000 2	0.000 1	0.373 6	0.494 7	0.174 8	0.105 9	0.001 10	0.895 9	0.222 9	0.537 7	0.307 9	0.180 5	0.625 7	0.000 1	0.000 8	0.591 10	0.609 9	0.398 8	0.000 1	0.766 10	0.014 10	0.638 10	0.000 1	0.377 7	0.004 7	0.206 9	0.609 10	0.465 2
Ji Hou, Benjamin Graham, Matthias Nießner, Saining Xie: Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts. CVPR 2021
PonderV2 ScanNet200	0.346 2	0.552 4	0.270 3	0.175 3	0.497 4	0.070 7	0.239 4	0.000 1	0.000 2	0.000 1	0.232 10	0.412 5	0.584 1	0.842 2	0.804 3	0.212 4	0.540 4	0.000 3	0.433 10	0.106 6	0.000 5	0.590 3	0.290 6	0.548 2	0.243 4	0.000 4	0.356 6	0.000 1	0.000 3	0.062 6	0.398 7	0.441 4	0.000 1	0.104 5	0.000 2	0.888 2	0.076 7	0.682 3	0.030 1	0.094 4	0.491 5	0.351 6	0.869 6	0.000 1	0.063 1	0.403 5	0.700 2	0.000 7	0.660 8	0.881 2	0.761 1	0.050 5	0.186 4	0.852 6	0.000 1	0.007 4	0.570 4	0.100 2	0.565 2	0.326 3	0.641 5	0.431 3	0.290 7	0.621 3	0.259 2	0.408 4	0.622 5	0.125 1	0.082 6	0.950 2	0.179 3	0.000 1	0.263 2	0.424 2	0.193 4	0.558 3	0.880 1	0.545 6	0.375 4	0.727 2	0.445 5	0.499 5	0.000 3	0.000 1	0.475 4	0.002 4	0.034 4	0.083 3	0.000 3	0.924 1	0.290 2	0.636 3	0.115 7	0.400 3	0.874 3	0.186 4	0.000 1	0.611 4	0.128 2	0.113 2	0.000 4	0.000 1	0.000 4	0.584 5	0.636 4	0.103 7	0.385 5	0.843 3	0.283 2	0.603 3	0.080 5	0.825 3	0.000 3	0.377 6	0.000 1	0.000 3	0.000 2	0.457 6	0.000 1	0.000 4	0.000 1	0.574 7	0.608 5	0.481 2	0.792 3	0.394 2	0.000 1	0.357 6	0.503 6	0.261 5	0.817 6	0.504 8	0.304 3	0.472 3	0.115 4	0.000 1	0.750 3	0.677 3	0.202 1	0.000 7	0.509 3	0.729 1	0.000 1	0.519 7	0.000 9	0.000 5	0.000 1	0.620 7	0.000 2	0.000 1	0.660 3	0.560 4	0.486 2	0.384 5	0.346 4	0.952 2	0.247 7	0.667 2	0.436 5	0.269 3	0.691 3	0.000 1	0.010 3	0.787 5	0.889 2	0.880 4	0.000 1	0.810 4	0.336 3	0.860 6	0.000 1	0.606 3	0.009 5	0.248 5	0.681 4	0.392 5
Haoyi Zhu, Honghui Yang, Xiaoyang Wu, Di Huang, Sha Zhang, Xianglong He, Tong He, Hengshuang Zhao, Chunhua Shen, Yu Qiao, Wanli Ouyang: PonderV2: Pave the Way for 3D Foundataion Model with A Universal Pre-training Paradigm.
LGround	0.272 8	0.485 8	0.184 8	0.106 8	0.476 5	0.077 6	0.218 5	0.000 1	0.000 2	0.000 1	0.547 1	0.295 8	0.540 2	0.746 7	0.745 8	0.058 9	0.112 9	0.005 1	0.658 6	0.077 10	0.000 5	0.322 8	0.178 9	0.512 7	0.190 6	0.199 1	0.277 8	0.000 1	0.000 3	0.173 3	0.399 6	0.000 5	0.000 1	0.039 9	0.000 2	0.858 8	0.085 5	0.676 5	0.002 2	0.103 3	0.498 4	0.323 7	0.703 8	0.000 1	0.000 2	0.296 8	0.549 6	0.216 1	0.702 4	0.768 7	0.718 7	0.028 6	0.092 9	0.786 9	0.000 1	0.000 6	0.453 9	0.022 4	0.251 10	0.252 6	0.572 8	0.348 8	0.321 5	0.514 4	0.063 8	0.279 9	0.552 8	0.000 3	0.019 9	0.932 8	0.132 9	0.000 1	0.000 6	0.000 9	0.156 10	0.457 8	0.623 7	0.518 7	0.265 9	0.358 6	0.381 8	0.395 8	0.000 3	0.000 1	0.127 10	0.012 3	0.051 1	0.000 5	0.000 3	0.886 9	0.014 7	0.437 10	0.179 3	0.244 8	0.826 8	0.000 5	0.000 1	0.599 6	0.136 1	0.085 3	0.000 4	0.000 1	0.000 4	0.565 6	0.612 7	0.143 2	0.207 8	0.566 8	0.232 8	0.446 8	0.127 2	0.708 8	0.000 3	0.384 5	0.000 1	0.000 3	0.000 2	0.402 7	0.000 1	0.059 2	0.000 1	0.525 10	0.566 7	0.229 8	0.659 8	0.000 5	0.000 1	0.265 8	0.446 7	0.147 9	0.720 10	0.597 5	0.066 7	0.000 6	0.187 2	0.000 1	0.726 6	0.467 10	0.134 7	0.000 7	0.413 8	0.629 7	0.000 1	0.363 9	0.055 6	0.022 2	0.000 1	0.626 6	0.000 2	0.000 1	0.323 8	0.479 10	0.154 9	0.117 8	0.028 9	0.901 8	0.243 8	0.415 10	0.295 10	0.143 6	0.610 9	0.000 1	0.000 8	0.777 7	0.397 10	0.324 9	0.000 1	0.778 8	0.179 7	0.702 9	0.000 1	0.274 10	0.404 1	0.233 6	0.622 8	0.398 4
David Rozenberszki, Or Litany, Angela Dai: Language-Grounded Indoor 3D Semantic Segmentation in the Wild. arXiv
Minkowski 34D	0.253 9	0.463 9	0.154 10	0.102 9	0.381 10	0.084 4	0.134 9	0.000 1	0.000 2	0.000 1	0.386 4	0.141 10	0.279 10	0.737 9	0.703 9	0.014 10	0.164 8	0.000 3	0.663 5	0.092 9	0.000 5	0.224 9	0.291 5	0.531 5	0.056 10	0.000 4	0.242 9	0.000 1	0.000 3	0.013 8	0.331 9	0.000 5	0.000 1	0.035 10	0.001 1	0.858 8	0.059 9	0.650 9	0.000 4	0.056 9	0.353 9	0.299 8	0.670 9	0.000 1	0.000 2	0.284 9	0.484 8	0.071 5	0.594 9	0.720 9	0.710 8	0.027 7	0.068 10	0.813 7	0.000 1	0.005 5	0.492 8	0.164 1	0.274 9	0.111 10	0.571 9	0.307 10	0.293 6	0.307 10	0.150 5	0.163 10	0.531 9	0.002 2	0.545 2	0.932 8	0.093 10	0.000 1	0.000 6	0.002 8	0.159 8	0.368 10	0.581 9	0.440 10	0.228 10	0.406 4	0.282 10	0.294 9	0.000 3	0.000 1	0.189 9	0.060 1	0.036 3	0.000 5	0.000 3	0.897 7	0.000 10	0.525 8	0.025 10	0.205 10	0.771 10	0.000 5	0.000 1	0.593 7	0.108 7	0.044 4	0.000 4	0.000 1	0.000 4	0.282 10	0.589 8	0.094 9	0.169 9	0.466 10	0.227 9	0.419 10	0.125 3	0.757 7	0.002 1	0.334 9	0.000 1	0.000 3	0.000 2	0.357 8	0.000 1	0.000 4	0.000 1	0.582 6	0.513 10	0.337 7	0.612 10	0.000 5	0.000 1	0.250 9	0.352 10	0.136 10	0.724 9	0.655 3	0.280 4	0.000 6	0.046 9	0.000 1	0.606 10	0.559 8	0.159 4	0.102 1	0.445 4	0.655 4	0.000 1	0.310 10	0.117 3	0.000 5	0.000 1	0.581 10	0.026 1	0.000 1	0.265 10	0.483 9	0.084 10	0.097 10	0.044 8	0.865 10	0.142 10	0.588 6	0.351 8	0.272 2	0.596 10	0.000 1	0.003 6	0.622 9	0.720 6	0.096 10	0.000 1	0.771 9	0.016 9	0.772 8	0.000 1	0.302 8	0.194 4	0.214 8	0.621 9	0.197 10
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019
CeCo	0.340 3	0.551 5	0.247 6	0.181 2	0.475 6	0.057 10	0.142 8	0.000 1	0.000 2	0.000 1	0.387 3	0.463 3	0.499 5	0.924 1	0.774 5	0.213 3	0.257 6	0.000 3	0.546 9	0.100 7	0.006 4	0.615 1	0.177 10	0.534 4	0.246 3	0.000 4	0.400 2	0.000 1	0.338 1	0.006 9	0.484 3	0.609 2	0.000 1	0.083 6	0.000 2	0.873 5	0.089 4	0.661 7	0.000 4	0.048 10	0.560 1	0.408 3	0.892 4	0.000 1	0.000 2	0.586 1	0.616 5	0.000 7	0.692 5	0.900 1	0.721 5	0.162 1	0.228 2	0.860 4	0.000 1	0.000 6	0.575 1	0.083 3	0.550 3	0.347 2	0.624 6	0.410 6	0.360 3	0.740 2	0.109 7	0.321 8	0.660 3	0.000 3	0.121 3	0.939 6	0.143 5	0.000 1	0.400 1	0.003 7	0.190 5	0.564 2	0.652 6	0.615 5	0.421 2	0.304 8	0.579 1	0.547 2	0.000 3	0.000 1	0.296 7	0.000 6	0.030 5	0.096 2	0.000 3	0.916 3	0.037 6	0.551 6	0.171 4	0.376 4	0.865 5	0.286 2	0.000 1	0.633 2	0.102 9	0.027 5	0.011 3	0.000 1	0.000 4	0.474 7	0.742 2	0.133 3	0.311 6	0.824 5	0.242 6	0.503 7	0.068 6	0.828 2	0.000 3	0.429 3	0.000 1	0.063 2	0.000 2	0.781 1	0.000 1	0.000 4	0.000 1	0.665 1	0.633 3	0.450 3	0.818 2	0.000 5	0.000 1	0.429 2	0.532 4	0.226 6	0.825 4	0.510 7	0.377 2	0.709 1	0.079 7	0.000 1	0.753 2	0.683 2	0.102 9	0.063 3	0.401 9	0.620 8	0.000 1	0.619 2	0.000 9	0.000 5	0.000 1	0.595 8	0.000 2	0.000 1	0.345 7	0.564 3	0.411 3	0.603 1	0.384 3	0.945 4	0.266 5	0.643 3	0.367 7	0.304 1	0.663 6	0.000 1	0.010 3	0.726 8	0.767 5	0.898 3	0.000 1	0.784 6	0.435 1	0.861 5	0.000 1	0.447 5	0.000 8	0.257 4	0.656 6	0.377 6
Zhisheng Zhong, Jiequan Cui, Yibo Yang, Xiaoyang Wu, Xiaojuan Qi, Xiangyu Zhang, Jiaya Jia: Understanding Imbalanced Semantic Segmentation Through Neural Collapse. CVPR 2023
AWCS	0.305 7	0.508 7	0.225 7	0.142 4	0.463 7	0.063 8	0.195 6	0.000 1	0.000 2	0.000 1	0.467 2	0.551 1	0.504 4	0.773 4	0.764 7	0.142 7	0.029 10	0.000 3	0.626 7	0.100 7	0.000 5	0.360 7	0.179 8	0.507 8	0.137 8	0.006 3	0.300 7	0.000 1	0.000 3	0.172 4	0.364 8	0.512 3	0.000 1	0.056 7	0.000 2	0.865 7	0.093 3	0.634 10	0.000 4	0.071 8	0.396 8	0.296 9	0.876 5	0.000 1	0.000 2	0.373 7	0.436 9	0.063 6	0.749 1	0.877 3	0.721 5	0.131 2	0.124 7	0.804 8	0.000 1	0.000 6	0.515 6	0.010 5	0.452 7	0.252 6	0.578 7	0.417 4	0.179 10	0.484 6	0.171 4	0.337 7	0.606 7	0.000 3	0.115 4	0.937 7	0.142 6	0.000 1	0.008 5	0.000 9	0.157 9	0.484 7	0.402 10	0.501 8	0.339 5	0.553 3	0.529 2	0.478 7	0.000 3	0.000 1	0.404 5	0.001 5	0.022 7	0.077 4	0.000 3	0.894 8	0.219 3	0.628 4	0.093 8	0.305 7	0.886 1	0.233 3	0.000 1	0.603 5	0.112 4	0.023 6	0.000 4	0.000 1	0.000 4	0.741 2	0.664 3	0.097 8	0.253 7	0.782 7	0.264 5	0.523 6	0.154 1	0.707 9	0.000 3	0.411 4	0.000 1	0.000 3	0.000 2	0.332 9	0.000 1	0.000 4	0.000 1	0.602 3	0.595 6	0.185 9	0.656 9	0.159 3	0.000 1	0.355 7	0.424 8	0.154 8	0.729 8	0.516 6	0.220 5	0.620 2	0.084 6	0.000 1	0.707 7	0.651 6	0.173 2	0.014 6	0.381 10	0.582 9	0.000 1	0.619 2	0.049 7	0.000 5	0.000 1	0.702 2	0.000 2	0.000 1	0.302 9	0.489 8	0.317 6	0.334 6	0.392 2	0.922 7	0.254 6	0.533 8	0.394 6	0.129 10	0.613 8	0.000 1	0.000 8	0.820 2	0.649 7	0.749 7	0.000 1	0.782 7	0.282 5	0.863 4	0.000 1	0.288 9	0.006 6	0.220 7	0.633 7	0.542 1

OctFormer ScanNet200	0.326 6	0.539 6	0.265 5	0.131 5	0.499 3	0.110 1	0.522 1	0.000 1	0.000 2	0.000 1	0.318 8	0.427 4	0.455 8	0.743 8	0.765 6	0.175 5	0.842 1	0.000 3	0.828 2	0.204 1	0.033 3	0.429 6	0.335 2	0.601 1	0.312 2	0.000 4	0.357 5	0.000 1	0.000 3	0.047 7	0.423 5	0.000 5	0.000 1	0.105 4	0.000 2	0.873 5	0.079 6	0.670 6	0.000 4	0.117 2	0.471 7	0.432 2	0.829 7	0.000 1	0.000 2	0.584 2	0.417 10	0.089 3	0.684 6	0.837 5	0.705 9	0.021 8	0.178 5	0.892 2	0.000 1	0.028 3	0.505 7	0.000 6	0.457 6	0.200 8	0.662 2	0.412 5	0.244 8	0.496 5	0.000 10	0.451 3	0.626 4	0.000 3	0.102 5	0.943 5	0.138 7	0.000 1	0.000 6	0.149 4	0.291 3	0.534 5	0.722 3	0.632 4	0.331 6	0.253 9	0.453 4	0.487 6	0.000 3	0.000 1	0.479 3	0.000 6	0.022 7	0.000 5	0.000 3	0.900 6	0.128 4	0.684 2	0.164 5	0.413 2	0.854 7	0.000 5	0.000 1	0.512 10	0.074 10	0.003 7	0.000 4	0.000 1	0.000 4	0.469 8	0.613 6	0.132 4	0.529 4	0.871 2	0.227 9	0.582 4	0.026 10	0.787 5	0.000 3	0.339 8	0.000 1	0.000 3	0.000 2	0.626 3	0.000 1	0.029 3	0.000 1	0.587 5	0.612 4	0.411 4	0.724 7	0.000 5	0.000 1	0.407 3	0.552 2	0.513 1	0.849 3	0.655 3	0.408 1	0.000 6	0.296 1	0.000 1	0.686 8	0.645 7	0.145 5	0.022 5	0.414 7	0.633 6	0.000 1	0.637 1	0.224 1	0.000 5	0.000 1	0.650 4	0.000 2	0.000 1	0.622 4	0.535 6	0.343 5	0.483 2	0.230 6	0.943 5	0.289 4	0.618 4	0.596 1	0.140 8	0.679 4	0.000 1	0.022 2	0.783 6	0.620 8	0.906 1	0.000 1	0.806 5	0.137 8	0.865 3	0.000 1	0.378 6	0.000 8	0.168 10	0.680 5	0.227 9
Peng-Shuai Wang: OctFormer: Octree-based Transformers for 3D Point Clouds. SIGGRAPH 2023
PPT-SpUNet-F.T.	0.332 5	0.556 3	0.270 2	0.123 7	0.519 2	0.091 3	0.349 2	0.000 1	0.000 2	0.000 1	0.339 6	0.383 7	0.498 6	0.833 3	0.807 2	0.241 2	0.584 3	0.000 3	0.755 4	0.124 4	0.000 5	0.608 2	0.330 4	0.530 6	0.314 1	0.000 4	0.374 4	0.000 1	0.000 3	0.197 2	0.459 4	0.000 5	0.000 1	0.117 2	0.000 2	0.876 3	0.095 1	0.682 3	0.000 4	0.086 5	0.518 3	0.433 1	0.930 2	0.000 1	0.000 2	0.563 3	0.542 7	0.077 4	0.715 2	0.858 4	0.756 2	0.008 10	0.171 6	0.874 3	0.000 1	0.039 2	0.550 5	0.000 6	0.545 4	0.256 5	0.657 4	0.453 2	0.351 4	0.449 7	0.213 3	0.392 5	0.611 6	0.000 3	0.037 8	0.946 3	0.138 7	0.000 1	0.000 6	0.063 5	0.308 2	0.537 4	0.796 2	0.673 2	0.323 7	0.392 5	0.400 7	0.509 4	0.000 3	0.000 1	0.649 1	0.000 6	0.023 6	0.000 5	0.000 3	0.914 5	0.002 9	0.506 9	0.163 6	0.359 5	0.872 4	0.000 5	0.000 1	0.623 3	0.112 4	0.001 8	0.000 4	0.000 1	0.021 3	0.753 1	0.565 9	0.150 1	0.579 2	0.806 6	0.267 4	0.616 1	0.042 9	0.783 6	0.000 3	0.374 7	0.000 1	0.000 3	0.000 2	0.620 4	0.000 1	0.000 4	0.000 1	0.572 8	0.634 2	0.350 6	0.792 3	0.000 5	0.000 1	0.376 5	0.535 3	0.378 2	0.855 2	0.672 2	0.074 6	0.000 6	0.185 3	0.000 1	0.727 5	0.660 5	0.076 10	0.000 7	0.432 6	0.646 5	0.000 1	0.594 6	0.006 8	0.000 5	0.000 1	0.658 3	0.000 2	0.000 1	0.661 1	0.549 5	0.300 7	0.291 7	0.045 7	0.942 6	0.304 3	0.600 5	0.572 3	0.135 9	0.695 2	0.000 1	0.008 5	0.793 4	0.942 1	0.899 2	0.000 1	0.816 3	0.181 6	0.897 2	0.000 1	0.679 2	0.223 3	0.264 2	0.691 3	0.345 8
Xiaoyang Wu, Zhuotao Tian, Xin Wen, Bohao Peng, Xihui Liu, Kaicheng Yu, Hengshuang Zhao: Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Training.
PTv3 ScanNet200	0.393 1	0.592 1	0.330 1	0.216 1	0.520 1	0.109 2	0.108 10	0.000 1	0.337 1	0.000 1	0.310 9	0.394 6	0.494 7	0.753 6	0.848 1	0.256 1	0.717 2	0.000 3	0.842 1	0.192 2	0.065 2	0.449 5	0.346 1	0.546 3	0.190 6	0.000 4	0.384 3	0.000 1	0.000 3	0.218 1	0.505 1	0.791 1	0.000 1	0.136 1	0.000 2	0.903 1	0.073 8	0.687 2	0.000 4	0.168 1	0.551 2	0.387 4	0.941 1	0.000 1	0.000 2	0.397 6	0.654 3	0.000 7	0.714 3	0.759 8	0.752 3	0.118 3	0.264 1	0.926 1	0.000 1	0.048 1	0.575 1	0.000 6	0.597 1	0.366 1	0.755 1	0.469 1	0.474 1	0.798 1	0.140 6	0.617 1	0.692 2	0.000 3	0.592 1	0.971 1	0.188 2	0.000 1	0.133 3	0.593 1	0.349 1	0.650 1	0.717 4	0.699 1	0.455 1	0.790 1	0.523 3	0.636 1	0.301 1	0.000 1	0.622 2	0.000 6	0.017 9	0.259 1	0.000 3	0.921 2	0.337 1	0.733 1	0.210 1	0.514 1	0.860 6	0.407 1	0.000 1	0.688 1	0.109 6	0.000 9	0.000 4	0.000 1	0.151 1	0.671 4	0.782 1	0.115 6	0.641 1	0.903 1	0.349 1	0.616 1	0.088 4	0.832 1	0.000 3	0.480 1	0.000 1	0.428 1	0.000 2	0.497 5	0.000 1	0.000 4	0.000 1	0.662 2	0.690 1	0.612 1	0.828 1	0.575 1	0.000 1	0.404 4	0.644 1	0.325 3	0.887 1	0.728 1	0.009 9	0.134 5	0.026 10	0.000 1	0.761 1	0.731 1	0.172 3	0.077 2	0.528 2	0.727 2	0.000 1	0.603 4	0.220 2	0.022 2	0.000 1	0.740 1	0.000 2	0.000 1	0.661 1	0.586 1	0.566 1	0.436 3	0.531 1	0.978 1	0.457 1	0.708 1	0.583 2	0.141 7	0.748 1	0.000 1	0.026 1	0.822 1	0.871 3	0.879 5	0.000 1	0.851 1	0.405 2	0.914 1	0.000 1	0.682 1	0.000 8	0.281 1	0.738 1	0.463 3

OA-CNN-L_ScanNet200	0.333 4	0.558 2	0.269 4	0.124 6	0.448 8	0.080 5	0.272 3	0.000 1	0.000 2	0.000 1	0.342 5	0.515 2	0.524 3	0.713 10	0.789 4	0.158 6	0.384 5	0.000 3	0.806 3	0.125 3	0.000 5	0.496 4	0.332 3	0.498 9	0.227 5	0.024 2	0.474 1	0.000 1	0.003 2	0.071 5	0.487 2	0.000 5	0.000 1	0.110 3	0.000 2	0.876 3	0.013 10	0.703 1	0.000 4	0.076 6	0.473 6	0.355 5	0.906 3	0.000 1	0.000 2	0.476 4	0.706 1	0.000 7	0.672 7	0.835 6	0.748 4	0.015 9	0.223 3	0.860 4	0.000 1	0.000 6	0.572 3	0.000 6	0.509 5	0.313 4	0.662 2	0.398 7	0.396 2	0.411 8	0.276 1	0.527 2	0.711 1	0.000 3	0.076 7	0.946 3	0.166 4	0.000 1	0.022 4	0.160 3	0.183 6	0.493 6	0.699 5	0.637 3	0.403 3	0.330 7	0.406 6	0.526 3	0.024 2	0.000 1	0.392 6	0.000 6	0.016 10	0.000 5	0.196 2	0.915 4	0.112 5	0.557 5	0.197 2	0.352 6	0.877 2	0.000 5	0.000 1	0.592 8	0.103 8	0.000 9	0.067 1	0.000 1	0.089 2	0.735 3	0.625 5	0.130 5	0.568 3	0.836 4	0.271 3	0.534 5	0.043 8	0.799 4	0.001 2	0.445 2	0.000 1	0.000 3	0.024 1	0.661 2	0.000 1	0.262 1	0.000 1	0.591 4	0.517 9	0.373 5	0.788 5	0.021 4	0.000 1	0.455 1	0.517 5	0.320 4	0.823 5	0.200 10	0.001 10	0.150 4	0.100 5	0.000 1	0.736 4	0.668 4	0.103 8	0.052 4	0.662 1	0.720 3	0.000 1	0.602 5	0.112 4	0.002 4	0.000 1	0.637 5	0.000 2	0.000 1	0.621 5	0.569 2	0.398 4	0.412 4	0.234 5	0.949 3	0.363 2	0.492 9	0.495 4	0.251 4	0.665 5	0.000 1	0.001 7	0.805 3	0.833 4	0.794 6	0.000 1	0.821 2	0.314 4	0.843 7	0.000 1	0.560 4	0.245 2	0.262 3	0.713 2	0.370 7

This table lists the benchmark results for the ScanNet200 3D semantic instance scenario.

Method	avg ap	head ap	common ap	tail ap	backpack	bag	ball	bar	basket	bathroom cabinet	bathroom stall	bathroom stall door	bathroom vanity	bathtub	bed	bench	bicycle	bin	blackboard	blanket	blinds	board	book	bookshelf	bottle	bowl	box	broom	bucket	bulletin board	cabinet	calendar	candle	cart	case of water bottles	ceiling	ceiling light	chair	clock	closet	closet rod	clothes	clothes dryer	coat rack	coffee kettle	coffee maker	coffee table	column	computer tower	copier	couch	counter	cup	curtain	cushion	decoration	desk	dining table	dish rack	dishwasher	door	doorframe	dresser	dumbbell	end table	fan	file cabinet	fire alarm	fire extinguisher	folded chair	hat	headphones	ironing board	jacket	keyboard	keyboard piano	kitchen cabinet	kitchen counter	ladder	lamp	laptop	laundry basket	laundry detergent	laundry hamper	ledge	light	light switch	machine	mailbox	mat	microwave	mini fridge	mirror	monitor	mouse	music stand	nightstand	object	office chair	oven	paper	paper bag	paper cutter	paper towel dispenser	paper towel roll	person	piano	picture	pillow	pipe	plant	plate	plunger	poster	power outlet	power strip	printer	projector	projector screen	rack	radiator	range hood	recycling bin	refrigerator	scale	seat	shelf	shoe	shower	shower curtain	shower curtain rod	shower floor	shower head	shower wall	sign	sink	soap dispenser	sofa chair	speaker	stair rail	stairs	stand	stool	storage bin	storage container	storage organizer	stove	structure	stuffed animal	suitcase	table	telephone	tissue box	toaster	toilet	toilet paper	toilet paper dispenser	towel	trash bin	trash can	tray	tube	tv	tv stand	vacuum cleaner	vent	wardrobe	washing machine	water bottle	water cooler	water pitcher	whiteboard	window	windowsill

TD3D Scannet200	0.211 2	0.332 2	0.177 2	0.103 2	0.337 2	0.036 2	0.222 4	0.000 1	0.000 1	0.000 1	0.031 1	0.342 1	0.093 4	0.852 1	0.452 4	0.559 2	0.000 2	0.004 2	0.000 3	0.039 1	0.000 2	0.309 2	0.047 4	0.380 2	0.028 2	0.000 1	0.080 2	0.000 1	0.000 2	0.147 1	0.192 3	0.000 2	0.000 1	0.083 1	0.000 1	0.395 2	0.039 4	0.662 1	0.000 1	0.000 2	0.074 1	0.135 1	0.296 2	0.000 2	0.000 1	0.231 5	0.646 1	0.139 3	0.633 3	1.000 1	0.705 1	0.048 1	0.088 2	0.439 2	0.184 2	0.039 2	0.266 2	0.551 2	0.260 3	0.026 5	0.463 2	0.046 3	0.252 2	0.249 3	0.083 2	0.372 1	0.411 1	0.000 2	0.414 1	0.323 1	0.000 1	0.052 2	0.000 1	0.157 1	0.278 2	0.278 2	0.237 2	0.015 2	0.321 2	0.253 1	0.060 4	0.000 1	0.000 1	0.272 2	0.008 1	0.169 2	0.032 2	0.000 1	0.404 1	0.356 2	0.283 2	0.073 3	0.028 5	0.617 2	0.038 2	0.000 1	0.494 2	0.037 2	0.215 1	0.083 2	0.000 2	0.003 2	0.486 3	0.694 1	0.000 2	0.040 4	0.083 4	0.219 5	0.209 2	0.007 1	0.483 1	0.000 2	0.125 4	0.000 1	0.150 2	0.014 1	0.544 1	0.000 1	0.000 2	0.000 1	0.260 5	0.143 5	0.200 1	0.610 3	0.028 2	0.032 1	0.145 1	0.059 2	0.046 4	0.740 2	0.806 1	0.543 2	0.000 2	0.108 2	0.008 1	0.222 5	0.669 2	0.456 1	0.074 1	0.224 1	0.586 1	0.006 2	0.451 2	0.000 1	0.002 1	0.889 1	0.282 2	0.000 1	0.000 1	0.252 2	0.413 2	0.111 2	0.074 2	0.240 1	0.893 1	0.266 2	0.144 3	0.293 2	0.281 2	0.604 2	0.000 1	0.000 2	0.379 5	0.963 1	0.250 4	0.000 1	0.160 1	0.420 2	0.000 1	0.343 3	0.207 2	0.079 5	0.315 2	0.052 2
Maksim Kolodiazhnyi, Anna Vorontsova, Anton Konushin, Danila Rukhovich: Top-Down Beats Bottom-Up in 3D Instance Segmentation. WACV 2024
Mask3D Scannet200	0.278 1	0.383 1	0.263 1	0.168 1	0.506 1	0.068 1	0.083 5	0.000 1	0.000 1	0.000 1	0.023 2	0.149 4	0.302 1	0.778 3	0.647 1	0.569 1	0.500 1	0.031 1	0.014 2	0.027 2	0.173 1	0.311 1	0.195 1	0.351 3	0.258 1	0.000 1	0.082 1	0.000 1	0.003 1	0.037 2	0.391 1	1.000 1	0.000 1	0.014 2	0.000 1	0.572 1	0.573 1	0.661 2	0.000 1	0.003 1	0.005 4	0.082 4	0.349 1	0.028 1	0.000 1	0.605 1	0.515 3	0.509 1	0.711 1	1.000 1	0.665 3	0.015 2	0.107 1	0.402 4	0.201 1	0.083 1	0.304 1	0.759 1	0.491 1	0.378 1	0.572 1	0.119 1	0.277 1	0.013 5	0.089 1	0.283 2	0.411 2	0.267 1	0.006 3	0.156 2	0.000 1	0.116 1	0.000 1	0.105 3	0.556 1	0.514 1	0.396 1	0.275 1	0.323 1	0.215 2	0.380 1	0.000 1	0.000 1	0.356 1	0.005 2	0.208 1	0.325 1	0.000 1	0.050 4	0.400 1	0.561 1	0.258 1	0.179 1	0.722 1	0.147 1	0.000 1	0.586 1	0.063 1	0.015 2	0.139 1	0.016 1	0.028 1	0.708 1	0.418 2	0.016 1	0.048 3	0.500 1	0.489 1	0.349 1	0.001 2	0.475 2	0.086 1	0.365 1	0.000 1	0.500 1	0.000 2	0.323 3	0.000 1	0.222 1	0.000 1	0.497 1	0.626 1	0.044 3	0.795 1	0.556 1	0.008 2	0.121 4	0.265 1	0.667 1	0.789 1	0.568 2	0.579 1	0.444 1	0.176 1	0.004 2	0.474 1	0.752 1	0.233 2	0.014 2	0.002 4	0.570 2	0.007 1	0.377 5	0.000 1	0.000 2	0.000 2	0.337 1	0.000 1	0.000 1	0.384 1	0.465 1	0.287 1	0.085 1	0.048 2	0.816 5	0.467 1	0.810 1	0.377 1	0.415 1	0.744 1	0.000 1	0.004 1	0.724 1	0.778 2	0.590 1	0.000 1	0.032 2	0.441 1	0.000 1	0.377 2	0.391 1	0.427 1	0.321 1	0.192 1
Jonas Schult, Francis Engelmann, Alexander Hermans, Or Litany, Siyu Tang, Bastian Leibe: Mask3D for 3D Semantic Instance Segmentation. ICRA 2023
Minkowski 34D Inst.	0.130 4	0.246 4	0.083 4	0.043 5	0.299 4	0.000 5	0.278 1	0.000 1	0.000 1	0.000 1	0.022 3	0.175 3	0.122 2	0.537 4	0.521 2	0.400 3	0.000 2	0.000 3	0.000 3	0.008 3	0.000 2	0.048 4	0.076 3	0.182 5	0.000 4	0.000 1	0.022 4	0.000 1	0.000 2	0.000 3	0.141 5	0.000 2	0.000 1	0.000 3	0.000 1	0.210 4	0.063 2	0.547 5	0.000 1	0.000 2	0.000 5	0.100 2	0.026 5	0.000 2	0.000 1	0.241 4	0.488 4	0.000 4	0.564 5	1.000 1	0.672 2	0.000 3	0.021 4	0.486 1	0.000 3	0.000 3	0.067 4	0.000 3	0.194 5	0.033 4	0.415 4	0.026 4	0.025 5	0.271 1	0.004 4	0.094 5	0.142 5	0.000 2	0.000 4	0.111 3	0.000 1	0.000 3	0.000 1	0.088 4	0.083 5	0.278 2	0.110 4	0.000 4	0.082 5	0.199 5	0.137 3	0.000 1	0.000 1	0.000 3	0.000 3	0.041 4	0.000 3	0.000 1	0.308 2	0.067 3	0.280 3	0.016 4	0.101 3	0.373 5	0.000 3	0.000 1	0.319 4	0.007 4	0.000 3	0.000 3	0.000 2	0.000 3	0.028 5	0.355 5	0.000 2	0.101 1	0.444 2	0.289 2	0.114 5	0.000 3	0.394 3	0.000 2	0.032 5	0.000 1	0.000 3	0.000 2	0.201 5	0.000 1	0.000 2	0.000 1	0.384 2	0.248 4	0.000 5	0.529 4	0.000 3	0.000 3	0.133 3	0.020 5	0.089 3	0.720 3	0.500 4	0.099 4	0.000 2	0.000 5	0.000 3	0.238 4	0.334 5	0.190 3	0.000 3	0.000 5	0.317 5	0.000 3	0.472 1	0.000 1	0.000 2	0.000 2	0.094 5	0.000 1	0.000 1	0.082 5	0.236 4	0.004 5	0.019 4	0.000 3	0.883 2	0.061 5	0.262 2	0.217 4	0.000 4	0.557 5	0.000 1	0.000 2	0.460 4	0.761 4	0.156 5	0.000 1	0.000 3	0.259 4	0.000 1	0.394 1	0.019 4	0.084 4	0.232 4	0.000 5
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019
CSC-Pretrain Inst.	0.123 5	0.223 5	0.082 5	0.046 4	0.308 3	0.004 3	0.278 1	0.000 1	0.000 1	0.000 1	0.000 5	0.032 5	0.105 3	0.537 4	0.348 5	0.378 4	0.000 2	0.000 3	0.000 3	0.000 5	0.000 2	0.000 5	0.037 5	0.323 4	0.000 4	0.000 1	0.013 5	0.000 1	0.000 2	0.000 3	0.235 2	0.000 2	0.000 1	0.000 3	0.000 1	0.231 3	0.045 3	0.564 4	0.000 1	0.000 2	0.006 3	0.078 5	0.065 3	0.000 2	0.000 1	0.259 3	0.516 2	0.000 4	0.600 4	1.000 1	0.578 5	0.000 3	0.000 5	0.184 5	0.000 3	0.000 3	0.034 5	0.000 3	0.211 4	0.089 3	0.394 5	0.018 5	0.064 4	0.171 4	0.001 5	0.144 3	0.172 4	0.000 2	0.000 4	0.044 4	0.000 1	0.000 3	0.000 1	0.064 5	0.126 4	0.278 2	0.093 5	0.000 4	0.094 4	0.214 3	0.011 5	0.000 1	0.000 1	0.000 3	0.000 3	0.022 5	0.000 3	0.000 1	0.275 3	0.000 4	0.275 4	0.000 5	0.098 4	0.407 4	0.000 3	0.000 1	0.250 5	0.007 5	0.000 3	0.000 3	0.000 2	0.000 3	0.333 4	0.376 4	0.000 2	0.000 5	0.042 5	0.285 3	0.119 4	0.000 3	0.224 5	0.000 2	0.184 3	0.000 1	0.000 3	0.000 2	0.244 4	0.000 1	0.000 2	0.000 1	0.377 3	0.378 2	0.051 2	0.424 5	0.000 3	0.000 3	0.116 5	0.030 4	0.125 2	0.441 4	0.444 5	0.063 5	0.000 2	0.042 3	0.000 3	0.297 2	0.483 3	0.096 5	0.000 3	0.028 2	0.338 4	0.000 3	0.444 3	0.000 1	0.000 2	0.000 2	0.189 4	0.000 1	0.000 1	0.141 4	0.152 5	0.017 4	0.000 5	0.000 3	0.838 4	0.193 3	0.111 5	0.105 5	0.198 3	0.588 3	0.000 1	0.000 2	0.542 3	0.343 5	0.267 3	0.000 1	0.000 3	0.108 5	0.000 1	0.333 4	0.000 5	0.228 2	0.202 5	0.022 4
Ji Hou, Benjamin Graham, Matthias Nießner, Saining Xie: Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts. CVPR 2021
LGround Inst.	0.154 3	0.275 3	0.108 3	0.060 3	0.295 5	0.002 4	0.278 1	0.000 1	0.000 1	0.000 1	0.006 4	0.272 2	0.064 5	0.815 2	0.503 3	0.333 5	0.000 2	0.000 3	0.556 1	0.001 4	0.000 2	0.148 3	0.078 2	0.448 1	0.007 3	0.000 1	0.024 3	0.000 1	0.000 2	0.000 3	0.190 4	0.000 2	0.000 1	0.000 3	0.000 1	0.209 5	0.031 5	0.573 3	0.000 1	0.000 2	0.041 2	0.099 3	0.037 4	0.000 2	0.000 1	0.327 2	0.364 5	0.181 2	0.642 2	1.000 1	0.654 4	0.000 3	0.023 3	0.429 3	0.000 3	0.000 3	0.097 3	0.000 3	0.278 2	0.267 2	0.434 3	0.048 2	0.092 3	0.257 2	0.030 3	0.097 4	0.189 3	0.000 2	0.089 2	0.000 5	0.000 1	0.000 3	0.000 1	0.115 2	0.166 3	0.222 5	0.222 3	0.003 3	0.127 3	0.213 4	0.169 2	0.000 1	0.000 1	0.000 3	0.000 3	0.044 3	0.000 3	0.000 1	0.000 5	0.000 4	0.268 5	0.222 2	0.130 2	0.494 3	0.000 3	0.000 1	0.363 3	0.015 3	0.000 3	0.000 3	0.000 2	0.000 3	0.611 2	0.400 3	0.000 2	0.056 2	0.278 3	0.242 4	0.180 3	0.000 3	0.383 4	0.000 2	0.209 2	0.000 1	0.000 3	0.000 2	0.364 2	0.000 1	0.000 2	0.000 1	0.323 4	0.302 3	0.019 4	0.654 2	0.000 3	0.000 3	0.141 2	0.045 3	0.000 5	0.427 5	0.514 3	0.143 3	0.000 2	0.028 4	0.000 3	0.252 3	0.402 4	0.156 4	0.000 3	0.028 2	0.470 3	0.000 3	0.444 3	0.000 1	0.000 2	0.000 2	0.205 3	0.000 1	0.000 1	0.203 3	0.381 3	0.026 3	0.037 3	0.000 3	0.881 3	0.099 4	0.135 4	0.239 3	0.000 4	0.585 4	0.000 1	0.000 2	0.616 2	0.778 2	0.322 2	0.000 1	0.000 3	0.407 3	0.000 1	0.333 4	0.148 3	0.177 3	0.242 3	0.028 3
David Rozenberszki, Or Litany, Angela Dai: Language-Grounded Indoor 3D Semantic Segmentation in the Wild.

ScanNet Benchmark

This table lists the benchmark results for the 3D semantic label scenario.

Method	avg iou	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	floor	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	wall	window

PointTransformerV2	0.752 13	0.742 62	0.809 18	0.872 1	0.758 12	0.860 9	0.552 11	0.891 10	0.610 37	0.687 5	0.960 14	0.559 22	0.304 26	0.766 12	0.926 3	0.767 13	0.797 20	0.644 29	0.942 9	0.876 14	0.722 22
Xiaoyang Wu, Yixing Lao, Li Jiang, Xihui Liu, Hengshuang Zhao: Point Transformer V2: Grouped Vector Attention and Partition-based Pooling. NeurIPS 2022
IPCA	0.731 28	0.890 13	0.837 3	0.864 2	0.726 28	0.873 4	0.530 22	0.824 32	0.489 81	0.647 17	0.978 4	0.609 4	0.336 13	0.624 45	0.733 54	0.758 16	0.776 34	0.570 60	0.949 6	0.877 11	0.728 16

MSP	0.748 17	0.623 88	0.804 21	0.859 3	0.745 22	0.824 43	0.501 32	0.912 3	0.690 9	0.685 7	0.956 22	0.567 18	0.320 20	0.768 11	0.918 4	0.720 29	0.802 13	0.676 19	0.921 25	0.881 9	0.779 5

VMNet	0.746 19	0.870 17	0.838 2	0.858 4	0.729 27	0.850 18	0.501 32	0.874 13	0.587 50	0.658 16	0.956 22	0.564 20	0.299 27	0.765 13	0.900 9	0.716 32	0.812 9	0.631 35	0.939 12	0.858 24	0.709 27
Zeyu HU, Xuyang Bai, Jiaxiang Shang, Runze Zhang, Jiayu Dong, Xin Wang, Guangyuan Sun, Hongbo Fu, Chiew-Lan Tai: VMNet: Voxel-Mesh Network for Geodesic-Aware 3D Semantic Segmentation. ICCV 2021 (Oral)
OA-CNN-L_ScanNet20	0.756 10	0.783 41	0.826 5	0.858 4	0.776 7	0.837 30	0.548 13	0.896 9	0.649 22	0.675 10	0.962 13	0.586 11	0.335 14	0.771 9	0.802 45	0.770 12	0.787 30	0.691 12	0.936 14	0.880 10	0.761 8

PTv3 ScanNet	0.794 1	0.941 3	0.813 15	0.851 6	0.782 5	0.890 2	0.597 1	0.916 1	0.696 7	0.713 3	0.979 1	0.635 1	0.384 2	0.793 2	0.907 6	0.821 3	0.790 28	0.696 10	0.967 3	0.903 1	0.805 1

RPN	0.736 26	0.776 45	0.790 32	0.851 6	0.754 16	0.854 12	0.491 41	0.866 15	0.596 47	0.686 6	0.955 25	0.536 28	0.342 11	0.624 45	0.869 19	0.787 8	0.802 13	0.628 36	0.927 21	0.875 15	0.704 29

EQ-Net	0.743 22	0.620 89	0.799 26	0.849 8	0.730 26	0.822 45	0.493 39	0.897 8	0.664 16	0.681 8	0.955 25	0.562 21	0.378 3	0.760 15	0.903 8	0.738 21	0.801 17	0.673 22	0.907 32	0.877 11	0.745 10
Zetong Yang, Li Jiang, Yanan Sun, Bernt Schiele, Jiaya JIa: A Unified Query-based Paradigm for Point Cloud Understanding. CVPR 2022
OctFormer	0.766 5	0.925 6	0.808 19	0.849 8	0.786 4	0.846 24	0.566 8	0.876 12	0.690 9	0.674 11	0.960 14	0.576 15	0.226 61	0.753 20	0.904 7	0.777 10	0.815 5	0.722 5	0.923 24	0.877 11	0.776 6
Peng-Shuai Wang: OctFormer: Octree-based Transformers for 3D Point Clouds. SIGGRAPH 2023
Virtual MVFusion	0.746 19	0.771 49	0.819 10	0.848 10	0.702 33	0.865 8	0.397 79	0.899 7	0.699 5	0.664 15	0.948 50	0.588 9	0.330 16	0.746 24	0.851 32	0.764 14	0.796 21	0.704 9	0.935 15	0.866 19	0.728 16
Abhijit Kundu, Xiaoqi Yin, Alireza Fathi, David Ross, Brian Brewington, Thomas Funkhouser, Caroline Pantofaru: Virtual Multi-view Fusion for 3D Semantic Segmentation. ECCV 2020
SparseConvNet	0.725 29	0.647 85	0.821 8	0.846 11	0.721 29	0.869 5	0.533 19	0.754 52	0.603 43	0.614 32	0.955 25	0.572 17	0.325 18	0.710 29	0.870 18	0.724 27	0.823 2	0.628 36	0.934 16	0.865 20	0.683 35

StratifiedFormer	0.747 18	0.901 12	0.803 22	0.845 12	0.757 14	0.846 24	0.512 28	0.825 31	0.696 7	0.645 18	0.956 22	0.576 15	0.262 52	0.744 25	0.861 22	0.742 20	0.770 39	0.705 8	0.899 40	0.860 23	0.734 13
Xin Lai, Jianhui Liu, Li Jiang, Liwei Wang, Hengshuang Zhao, Shu Liu, Xiaojuan Qi, Jiaya Jia: Stratified Transformer for 3D Point Cloud Segmentation. CVPR 2022
O-CNN	0.762 9	0.924 7	0.823 6	0.844 13	0.770 8	0.852 16	0.577 3	0.847 23	0.711 2	0.640 24	0.958 17	0.592 7	0.217 67	0.762 14	0.888 14	0.758 16	0.813 8	0.726 2	0.932 19	0.868 17	0.744 11
Peng-Shuai Wang, Yang Liu, Yu-Xiao Guo, Chun-Yu Sun, Xin Tong: O-CNN: Octree-based Convolutional Neural Networks for 3D Shape Analysis. SIGGRAPH 2017
Mix3D	0.781 3	0.964 2	0.855 1	0.843 14	0.781 6	0.858 10	0.575 5	0.831 28	0.685 11	0.714 2	0.979 1	0.594 6	0.310 23	0.801 1	0.892 13	0.841 2	0.819 3	0.723 4	0.940 11	0.887 5	0.725 20
Alexey Nekrasov, Jonas Schult, Or Litany, Bastian Leibe, Francis Engelmann: Mix3D: Out-of-Context Data Augmentation for 3D Scenes. 3DV 2021 (Oral)
CU-Hybrid Net	0.764 7	0.924 7	0.819 10	0.840 15	0.757 14	0.853 14	0.580 2	0.848 21	0.709 3	0.643 20	0.958 17	0.587 10	0.295 29	0.753 20	0.884 17	0.758 16	0.815 5	0.725 3	0.927 21	0.867 18	0.743 12

OccuSeg+Semantic	0.764 7	0.758 55	0.796 27	0.839 16	0.746 21	0.907 1	0.562 9	0.850 20	0.680 13	0.672 12	0.978 4	0.610 3	0.335 14	0.777 6	0.819 41	0.847 1	0.830 1	0.691 12	0.972 2	0.885 7	0.727 18

ConDaFormer	0.755 11	0.927 5	0.822 7	0.836 17	0.801 1	0.849 19	0.516 27	0.864 17	0.651 21	0.680 9	0.958 17	0.584 13	0.282 36	0.759 16	0.855 28	0.728 24	0.802 13	0.678 16	0.880 54	0.873 16	0.756 9
Lunhao Duan, Shanshan Zhao, Nan Xue, Mingming Gong, Guisong Xia, Dacheng Tao: ConDaFormer : Disassembled Transformer with Local Structure Enhancement for 3D Point Cloud Understanding. Neurips, 2023
Swin3D	0.779 4	0.861 19	0.818 12	0.836 17	0.790 2	0.875 3	0.576 4	0.905 5	0.704 4	0.739 1	0.969 9	0.611 2	0.349 9	0.756 18	0.958 1	0.702 40	0.805 12	0.708 7	0.916 28	0.898 2	0.801 2

PNE	0.755 11	0.786 39	0.835 4	0.834 19	0.758 12	0.849 19	0.570 7	0.836 27	0.648 23	0.668 14	0.978 4	0.581 14	0.367 5	0.683 30	0.856 26	0.804 5	0.801 17	0.678 16	0.961 4	0.889 4	0.716 25
P. Hermosilla: Point Neighborhood Embeddings.
PonderV2	0.785 2	0.978 1	0.800 23	0.833 20	0.788 3	0.853 14	0.545 14	0.910 4	0.713 1	0.705 4	0.979 1	0.596 5	0.390 1	0.769 10	0.832 38	0.821 3	0.792 27	0.730 1	0.975 1	0.897 3	0.785 3
Haoyi Zhu, Honghui Yang, Xiaoyang Wu, Di Huang, Sha Zhang, Xianglong He, Tong He, Hengshuang Zhao, Chunhua Shen, Yu Qiao, Wanli Ouyang: PonderV2: Pave the Way for 3D Foundataion Model with A Universal Pre-training Paradigm.
MinkowskiNet	0.736 26	0.859 21	0.818 12	0.832 21	0.709 31	0.840 28	0.521 25	0.853 19	0.660 19	0.643 20	0.951 40	0.544 26	0.286 34	0.731 26	0.893 12	0.675 49	0.772 36	0.683 15	0.874 60	0.852 31	0.727 18
C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019
PPT-SpUNet-Joint	0.766 5	0.932 4	0.794 29	0.829 22	0.751 19	0.854 12	0.540 17	0.903 6	0.630 30	0.672 12	0.963 12	0.565 19	0.357 7	0.788 3	0.900 9	0.737 22	0.802 13	0.685 14	0.950 5	0.887 5	0.780 4
Xiaoyang Wu, Zhuotao Tian, Xin Wen, Bohao Peng, Xihui Liu, Kaicheng Yu, Hengshuang Zhao: Towards Large-scale 3D Representation Learning with Multi-dataset Point Prompt Training.
PointMetaBase	0.714 33	0.835 26	0.785 34	0.821 23	0.684 37	0.846 24	0.531 21	0.865 16	0.614 34	0.596 43	0.953 34	0.500 40	0.246 57	0.674 31	0.888 14	0.692 42	0.764 42	0.624 38	0.849 75	0.844 38	0.675 37

JSENet	0.699 38	0.881 16	0.762 45	0.821 23	0.667 41	0.800 64	0.522 24	0.792 44	0.613 35	0.607 36	0.935 78	0.492 42	0.205 72	0.576 56	0.853 30	0.691 43	0.758 48	0.652 26	0.872 63	0.828 42	0.649 44
Zeyu HU, Mingmin Zhen, Xuyang BAI, Hongbo Fu, Chiew-lan Tai: JSENet: Joint Semantic Segmentation and Edge Detection Network for 3D Point Clouds. ECCV 2020
Feature-Geometry Net	0.685 43	0.866 18	0.748 54	0.819 25	0.645 49	0.794 67	0.450 57	0.802 41	0.587 50	0.604 37	0.945 58	0.464 53	0.201 75	0.554 65	0.840 35	0.723 28	0.732 59	0.602 48	0.907 32	0.822 47	0.603 61

PointTransformer++	0.725 29	0.727 70	0.811 17	0.819 25	0.765 10	0.841 27	0.502 31	0.814 37	0.621 33	0.623 30	0.955 25	0.556 23	0.284 35	0.620 47	0.866 20	0.781 9	0.757 50	0.648 27	0.932 19	0.862 21	0.709 27

SAT	0.742 23	0.860 20	0.765 44	0.819 25	0.769 9	0.848 21	0.533 19	0.829 29	0.663 17	0.631 27	0.955 25	0.586 11	0.274 41	0.753 20	0.896 11	0.729 23	0.760 46	0.666 24	0.921 25	0.855 28	0.733 14

RFCR	0.702 36	0.889 14	0.745 57	0.813 28	0.672 40	0.818 52	0.493 39	0.815 36	0.623 31	0.610 33	0.947 52	0.470 51	0.249 56	0.594 51	0.848 33	0.705 37	0.779 33	0.646 28	0.892 45	0.823 45	0.611 54
Jingyu Gong, Jiachen Xu, Xin Tan, Haichuan Song, Yanyun Qu, Yuan Xie, Lizhuang Ma: Omni-Supervised Point Cloud Segmentation via Gradual Receptive Field Component Reasoning. CVPR2021
INS-Conv-semantic	0.717 32	0.751 58	0.759 47	0.812 29	0.704 32	0.868 6	0.537 18	0.842 24	0.609 39	0.608 35	0.953 34	0.534 30	0.293 30	0.616 48	0.864 21	0.719 31	0.793 25	0.640 31	0.933 17	0.845 37	0.663 40

BPNet	0.749 15	0.909 9	0.818 12	0.811 30	0.752 17	0.839 29	0.485 42	0.842 24	0.673 14	0.644 19	0.957 21	0.528 33	0.305 25	0.773 8	0.859 23	0.788 7	0.818 4	0.693 11	0.916 28	0.856 26	0.723 21
Wenbo Hu, Hengshuang Zhao, Li Jiang, Jiaya Jia, Tien-Tsin Wong: Bidirectional Projection Network for Cross Dimension Scene Understanding. CVPR 2021 (Oral)
MatchingNet	0.724 31	0.812 34	0.812 16	0.810 31	0.735 25	0.834 34	0.495 38	0.860 18	0.572 56	0.602 39	0.954 31	0.512 37	0.280 38	0.757 17	0.845 34	0.725 26	0.780 32	0.606 46	0.937 13	0.851 32	0.700 31

contrastBoundary	0.705 34	0.769 52	0.775 39	0.809 32	0.687 36	0.820 48	0.439 67	0.812 38	0.661 18	0.591 45	0.945 58	0.515 36	0.171 85	0.633 42	0.856 26	0.720 29	0.796 21	0.668 23	0.889 47	0.847 34	0.689 33
Liyao Tang, Yibing Zhan, Zhe Chen, Baosheng Yu, Dacheng Tao: Contrastive Boundary Learning for Point Cloud Segmentation. CVPR2022
LRPNet	0.742 23	0.816 32	0.806 20	0.807 33	0.752 17	0.828 39	0.575 5	0.839 26	0.699 5	0.637 25	0.954 31	0.520 35	0.320 20	0.755 19	0.834 36	0.760 15	0.772 36	0.676 19	0.915 30	0.862 21	0.717 23

PointConvFormer	0.749 15	0.793 37	0.790 32	0.807 33	0.750 20	0.856 11	0.524 23	0.881 11	0.588 49	0.642 23	0.977 7	0.591 8	0.274 41	0.781 4	0.929 2	0.804 5	0.796 21	0.642 30	0.947 7	0.885 7	0.715 26
Wenxuan Wu, Qi Shan, Li Fuxin: PointConvFormer: Revenge of the Point-based Convolution.
DCM-Net	0.658 55	0.778 43	0.702 71	0.806 35	0.619 56	0.813 58	0.468 48	0.693 70	0.494 77	0.524 62	0.941 70	0.449 63	0.298 28	0.510 76	0.821 40	0.675 49	0.727 61	0.568 62	0.826 80	0.803 56	0.637 48
Jonas Schult, Francis Engelmann, Theodora Kontogianni, Bastian Leibe: DualConvMesh-Net: Joint Geodesic and Euclidean Convolutions on 3D Meshes. CVPR 2020 [Oral]
LargeKernel3D	0.739 25	0.909 9	0.820 9	0.806 35	0.740 23	0.852 16	0.545 14	0.826 30	0.594 48	0.643 20	0.955 25	0.541 27	0.263 51	0.723 28	0.858 25	0.775 11	0.767 40	0.678 16	0.933 17	0.848 33	0.694 32
Yukang Chen, Jianhui Liu, Xiangyu Zhang, Xiaojuan Qi, Jiaya Jia: LargeKernel3D: Scaling up Kernels in 3D Sparse CNNs. CVPR 2023
DMF-Net	0.752 13	0.906 11	0.793 31	0.802 37	0.689 35	0.825 41	0.556 10	0.867 14	0.681 12	0.602 39	0.960 14	0.555 24	0.365 6	0.779 5	0.859 23	0.747 19	0.795 24	0.717 6	0.917 27	0.856 26	0.764 7
C.Yang, Y.Yan, W.Zhao, J.Ye, X.Yang, A.Hussain, B.Dong, K.Huang: Towards Deeper and Better Multi-view Feature Fusion for 3D Semantic Segmentation. ICONIP 2023
3DSM_DMMF	0.631 69	0.626 87	0.745 57	0.801 38	0.607 58	0.751 85	0.506 29	0.729 61	0.565 60	0.491 72	0.866 102	0.434 66	0.197 78	0.595 50	0.630 73	0.709 35	0.705 69	0.560 65	0.875 58	0.740 87	0.491 91

Superpoint Network	0.683 47	0.851 23	0.728 65	0.800 39	0.653 45	0.806 60	0.468 48	0.804 39	0.572 56	0.602 39	0.946 55	0.453 61	0.239 60	0.519 74	0.822 39	0.689 46	0.762 45	0.595 52	0.895 43	0.827 43	0.630 51

Feature_GeometricNet	0.690 41	0.884 15	0.754 51	0.795 40	0.647 47	0.818 52	0.422 71	0.802 41	0.612 36	0.604 37	0.945 58	0.462 54	0.189 80	0.563 62	0.853 30	0.726 25	0.765 41	0.632 34	0.904 34	0.821 48	0.606 58
Kangcheng Liu, Ben M. Chen: https://arxiv.org/abs/2012.09439. arXiv Preprint
dtc_net	0.625 75	0.703 76	0.751 53	0.794 41	0.535 79	0.848 21	0.480 43	0.676 74	0.528 68	0.469 77	0.944 64	0.454 58	0.004 107	0.464 85	0.636 72	0.704 38	0.758 48	0.548 74	0.924 23	0.787 71	0.492 90

ClickSeg_Semantic	0.703 35	0.774 47	0.800 23	0.793 42	0.760 11	0.847 23	0.471 46	0.802 41	0.463 88	0.634 26	0.968 11	0.491 43	0.271 45	0.726 27	0.910 5	0.706 36	0.815 5	0.551 71	0.878 55	0.833 39	0.570 71

PicassoNet-II	0.692 40	0.732 66	0.772 40	0.786 43	0.677 39	0.866 7	0.517 26	0.848 21	0.509 74	0.626 28	0.952 38	0.536 28	0.225 63	0.545 69	0.704 61	0.689 46	0.810 10	0.564 64	0.903 36	0.854 30	0.729 15
Huan Lei, Naveed Akhtar, Mubarak Shah, and Ajmal Mian: Geometric feature learning for 3D meshes.
PointContrast_LA_SEM	0.683 47	0.757 56	0.784 35	0.786 43	0.639 51	0.824 43	0.408 74	0.775 46	0.604 42	0.541 54	0.934 82	0.532 31	0.269 47	0.552 66	0.777 47	0.645 65	0.793 25	0.640 31	0.913 31	0.824 44	0.671 38

KP-FCNN	0.684 44	0.847 24	0.758 49	0.784 45	0.647 47	0.814 55	0.473 45	0.772 47	0.605 41	0.594 44	0.935 78	0.450 62	0.181 83	0.587 52	0.805 44	0.690 44	0.785 31	0.614 42	0.882 51	0.819 49	0.632 50
H. Thomas, C. Qi, J. Deschaud, B. Marcotegui, F. Goulette, L. Guibas.: KPConv: Flexible and Deformable Convolution for Point Clouds. ICCV 2019
VI-PointConv	0.676 49	0.770 51	0.754 51	0.783 46	0.621 55	0.814 55	0.552 11	0.758 50	0.571 58	0.557 50	0.954 31	0.529 32	0.268 49	0.530 72	0.682 65	0.675 49	0.719 62	0.603 47	0.888 48	0.833 39	0.665 39
Xingyi Li, Wenxuan Wu, Xiaoli Z. Fern, Li Fuxin: The Devils in the Point Clouds: Studying the Robustness of Point Cloud Convolutions.
DGNet	0.684 44	0.712 74	0.784 35	0.782 47	0.658 42	0.835 33	0.499 36	0.823 33	0.641 25	0.597 42	0.950 44	0.487 44	0.281 37	0.575 57	0.619 74	0.647 62	0.764 42	0.620 41	0.871 66	0.846 36	0.688 34

VACNN++	0.684 44	0.728 69	0.757 50	0.776 48	0.690 34	0.804 62	0.464 51	0.816 34	0.577 55	0.587 46	0.945 58	0.508 39	0.276 40	0.671 32	0.710 59	0.663 54	0.750 53	0.589 55	0.881 52	0.832 41	0.653 43

DVVNet	0.562 88	0.648 84	0.700 73	0.770 49	0.586 67	0.687 93	0.333 92	0.650 77	0.514 73	0.475 76	0.906 96	0.359 88	0.223 65	0.340 95	0.442 90	0.422 99	0.668 82	0.501 86	0.708 94	0.779 74	0.534 84

SALANet	0.670 51	0.816 32	0.770 42	0.768 50	0.652 46	0.807 59	0.451 54	0.747 54	0.659 20	0.545 53	0.924 88	0.473 50	0.149 95	0.571 59	0.811 43	0.635 68	0.746 54	0.623 39	0.892 45	0.794 62	0.570 71

Retro-FPN	0.744 21	0.842 25	0.800 23	0.767 51	0.740 23	0.836 32	0.541 16	0.914 2	0.672 15	0.626 28	0.958 17	0.552 25	0.272 43	0.777 6	0.886 16	0.696 41	0.801 17	0.674 21	0.941 10	0.858 24	0.717 23
Peng Xiang, Xin Wen, Yu-Shen Liu, Hui Zhang, Yi Fang, Zhizhong Han: Retrospective Feature Pyramid Network for Point Cloud Semantic Segmentation. ICCV 2023
FusionAwareConv	0.630 72	0.604 92	0.741 61	0.766 52	0.590 64	0.747 86	0.501 32	0.734 59	0.503 76	0.527 60	0.919 92	0.454 58	0.323 19	0.550 68	0.420 91	0.678 48	0.688 75	0.544 75	0.896 42	0.795 61	0.627 52
Jiazhao Zhang, Chenyang Zhu, Lintao Zheng, Kai Xu: Fusion-Aware Point Convolution for Online Semantic 3D Scene Segmentation. CVPR 2020
ROSMRF3D	0.673 50	0.789 38	0.748 54	0.763 53	0.635 53	0.814 55	0.407 76	0.747 54	0.581 54	0.573 47	0.950 44	0.484 45	0.271 45	0.607 49	0.754 50	0.649 59	0.774 35	0.596 50	0.883 50	0.823 45	0.606 58

SIConv	0.625 75	0.830 28	0.694 77	0.757 54	0.563 74	0.772 79	0.448 58	0.647 79	0.520 70	0.509 66	0.949 48	0.431 69	0.191 79	0.496 80	0.614 75	0.647 62	0.672 81	0.535 81	0.876 57	0.783 73	0.571 70

FusionNet	0.688 42	0.704 75	0.741 61	0.754 55	0.656 43	0.829 37	0.501 32	0.741 57	0.609 39	0.548 52	0.950 44	0.522 34	0.371 4	0.633 42	0.756 49	0.715 33	0.771 38	0.623 39	0.861 71	0.814 50	0.658 41
Feihu Zhang, Jin Fang, Benjamin Wah, Philip Torr: Deep FusionNet for Point Cloud Semantic Segmentation. ECCV 2020
SConv	0.636 65	0.830 28	0.697 75	0.752 56	0.572 72	0.780 75	0.445 61	0.716 63	0.529 67	0.530 59	0.951 40	0.446 65	0.170 86	0.507 78	0.666 69	0.636 67	0.682 77	0.541 78	0.886 49	0.799 57	0.594 65

PointASNL	0.666 52	0.703 76	0.781 37	0.751 57	0.655 44	0.830 36	0.471 46	0.769 48	0.474 84	0.537 56	0.951 40	0.475 49	0.279 39	0.635 40	0.698 64	0.675 49	0.751 52	0.553 70	0.816 82	0.806 54	0.703 30
Xu Yan, Chaoda Zheng, Zhen Li, Sheng Wang, Shuguang Cui: PointASNL: Robust Point Clouds Processing using Nonlocal Neural Networks with Adaptive Sampling. CVPR 2020
One Thing One Click	0.701 37	0.825 30	0.796 27	0.723 58	0.716 30	0.832 35	0.433 69	0.816 34	0.634 28	0.609 34	0.969 9	0.418 77	0.344 10	0.559 63	0.833 37	0.715 33	0.808 11	0.560 65	0.902 37	0.847 34	0.680 36

PPCNN++	0.663 54	0.746 59	0.708 68	0.722 59	0.638 52	0.820 48	0.451 54	0.566 89	0.599 45	0.541 54	0.950 44	0.510 38	0.313 22	0.648 37	0.819 41	0.616 73	0.682 77	0.590 54	0.869 67	0.810 53	0.656 42
Pyunghwan Ahn, Juyoung Yang, Eojindl Yi, Chanho Lee, Junmo Kim: Projection-based Point Convolution for Efficient Point Cloud Segmentation. IEEE Access
PointConv-SFPN	0.641 59	0.776 45	0.703 70	0.721 60	0.557 76	0.826 40	0.451 54	0.672 75	0.563 62	0.483 73	0.943 67	0.425 74	0.162 90	0.644 38	0.726 55	0.659 56	0.709 66	0.572 59	0.875 58	0.786 72	0.559 77

Supervoxel-CNN	0.635 66	0.656 83	0.711 67	0.719 61	0.613 57	0.757 84	0.444 64	0.765 49	0.534 66	0.566 48	0.928 86	0.478 48	0.272 43	0.636 39	0.531 81	0.664 53	0.645 87	0.508 85	0.864 70	0.792 67	0.611 54

DenSeR	0.628 73	0.800 35	0.625 94	0.719 61	0.545 78	0.806 60	0.445 61	0.597 84	0.448 91	0.519 65	0.938 74	0.481 46	0.328 17	0.489 82	0.499 86	0.657 57	0.759 47	0.592 53	0.881 52	0.797 60	0.634 49

PointSPNet	0.637 64	0.734 65	0.692 79	0.714 63	0.576 70	0.797 66	0.446 59	0.743 56	0.598 46	0.437 85	0.942 68	0.403 80	0.150 94	0.626 44	0.800 46	0.649 59	0.697 71	0.557 68	0.846 76	0.777 76	0.563 75

FPConv	0.639 62	0.785 40	0.760 46	0.713 64	0.603 59	0.798 65	0.392 81	0.534 94	0.603 43	0.524 62	0.948 50	0.457 56	0.250 55	0.538 70	0.723 57	0.598 78	0.696 72	0.614 42	0.872 63	0.799 57	0.567 74
Yiqun Lin, Zizheng Yan, Haibin Huang, Dong Du, Ligang Liu, Shuguang Cui, Xiaoguang Han: FPConv: Learning Local Flattening for Point Convolution. CVPR 2020
SegGroup_sem	0.627 74	0.818 31	0.747 56	0.701 65	0.602 60	0.764 81	0.385 85	0.629 81	0.490 79	0.508 67	0.931 85	0.409 79	0.201 75	0.564 61	0.725 56	0.618 71	0.692 73	0.539 79	0.873 61	0.794 62	0.548 81
An Tao, Yueqi Duan, Yi Wei, Jiwen Lu, Jie Zhou: SegGroup: Seg-Level Supervision for 3D Instance and Semantic Segmentation. TIP 2022
PointConv	0.666 52	0.781 42	0.759 47	0.699 66	0.644 50	0.822 45	0.475 44	0.779 45	0.564 61	0.504 70	0.953 34	0.428 71	0.203 74	0.586 54	0.754 50	0.661 55	0.753 51	0.588 56	0.902 37	0.813 52	0.642 46
Wenxuan Wu, Zhongang Qi, Li Fuxin: PointConv: Deep Convolutional Networks on 3D Point Clouds. CVPR 2019
RandLA-Net	0.645 58	0.778 43	0.731 64	0.699 66	0.577 69	0.829 37	0.446 59	0.736 58	0.477 83	0.523 64	0.945 58	0.454 58	0.269 47	0.484 83	0.749 53	0.618 71	0.738 55	0.599 49	0.827 79	0.792 67	0.621 53

wsss-transformer	0.600 80	0.634 86	0.743 59	0.697 68	0.601 61	0.781 73	0.437 68	0.585 87	0.493 78	0.446 82	0.933 83	0.394 82	0.011 106	0.654 35	0.661 71	0.603 75	0.733 58	0.526 82	0.832 78	0.761 82	0.480 93

PointMRNet	0.640 61	0.717 73	0.701 72	0.692 69	0.576 70	0.801 63	0.467 50	0.716 63	0.563 62	0.459 80	0.953 34	0.429 70	0.169 87	0.581 55	0.854 29	0.605 74	0.710 64	0.550 72	0.894 44	0.793 64	0.575 69

Pointnet++ & Feature	0.557 89	0.735 64	0.661 88	0.686 70	0.491 86	0.744 87	0.392 81	0.539 92	0.451 90	0.375 93	0.946 55	0.376 86	0.205 72	0.403 92	0.356 95	0.553 87	0.643 88	0.497 87	0.824 81	0.756 83	0.515 87

CCRFNet	0.589 83	0.766 53	0.659 89	0.683 71	0.470 90	0.740 88	0.387 84	0.620 83	0.490 79	0.476 75	0.922 90	0.355 90	0.245 58	0.511 75	0.511 84	0.571 85	0.643 88	0.493 89	0.872 63	0.762 81	0.600 62

ROSMRF	0.580 84	0.772 48	0.707 69	0.681 72	0.563 74	0.764 81	0.362 88	0.515 95	0.465 87	0.465 79	0.936 77	0.427 73	0.207 70	0.438 87	0.577 77	0.536 88	0.675 80	0.486 90	0.723 93	0.779 74	0.524 86

PointMTL	0.632 68	0.731 67	0.688 82	0.675 73	0.591 63	0.784 72	0.444 64	0.565 90	0.610 37	0.492 71	0.949 48	0.456 57	0.254 54	0.587 52	0.706 60	0.599 77	0.665 83	0.612 45	0.868 68	0.791 70	0.579 68

APCF-Net	0.631 69	0.742 62	0.687 84	0.672 74	0.557 76	0.792 70	0.408 74	0.665 76	0.545 64	0.508 67	0.952 38	0.428 71	0.186 81	0.634 41	0.702 62	0.620 70	0.706 68	0.555 69	0.873 61	0.798 59	0.581 67
Haojia, Lin: Adaptive Pyramid Context Fusion for Point Cloud Perception. GRSL
PointNet2-SFPN	0.631 69	0.771 49	0.692 79	0.672 74	0.524 81	0.837 30	0.440 66	0.706 68	0.538 65	0.446 82	0.944 64	0.421 76	0.219 66	0.552 66	0.751 52	0.591 80	0.737 56	0.543 77	0.901 39	0.768 79	0.557 78

MVPNet	0.641 59	0.831 27	0.715 66	0.671 76	0.590 64	0.781 73	0.394 80	0.679 72	0.642 24	0.553 51	0.937 75	0.462 54	0.256 53	0.649 36	0.406 92	0.626 69	0.691 74	0.666 24	0.877 56	0.792 67	0.608 57
Maximilian Jaritz, Jiayuan Gu, Hao Su: Multi-view PointNet for 3D Scene Understanding. GMDL Workshop, ICCV 2019
TextureNet	0.566 87	0.672 82	0.664 87	0.671 76	0.494 85	0.719 89	0.445 61	0.678 73	0.411 97	0.396 90	0.935 78	0.356 89	0.225 63	0.412 91	0.535 80	0.565 86	0.636 91	0.464 93	0.794 85	0.680 97	0.568 73
Jingwei Huang, Haotian Zhang, Li Yi, Thomas Funkerhouser, Matthias Niessner, Leonidas Guibas: TextureNet: Consistent Local Parametrizations for Learning from High-Resolution Signals on Meshes. CVPR
joint point-based	0.634 67	0.614 90	0.778 38	0.667 78	0.633 54	0.825 41	0.420 72	0.804 39	0.467 86	0.561 49	0.951 40	0.494 41	0.291 31	0.566 60	0.458 87	0.579 84	0.764 42	0.559 67	0.838 77	0.814 50	0.598 63
Hung-Yueh Chiang, Yen-Liang Lin, Yueh-Cheng Liu, Winston H. Hsu: A Unified Point-Based Framework for 3D Segmentation. 3DV 2019
SAFNet-seg	0.654 57	0.752 57	0.734 63	0.664 79	0.583 68	0.815 54	0.399 78	0.754 52	0.639 26	0.535 58	0.942 68	0.470 51	0.309 24	0.665 33	0.539 79	0.650 58	0.708 67	0.635 33	0.857 73	0.793 64	0.642 46
Linqing Zhao, Jiwen Lu, Jie Zhou: Similarity-Aware Fusion Network for 3D Semantic Segmentation. IROS 2021
SQN_0.1%	0.569 86	0.676 80	0.696 76	0.657 80	0.497 84	0.779 76	0.424 70	0.548 91	0.515 72	0.376 92	0.902 99	0.422 75	0.357 7	0.379 93	0.456 88	0.596 79	0.659 84	0.544 75	0.685 96	0.665 100	0.556 79

One-Thing-One-Click	0.693 39	0.743 61	0.794 29	0.655 81	0.684 37	0.822 45	0.497 37	0.719 62	0.622 32	0.617 31	0.977 7	0.447 64	0.339 12	0.750 23	0.664 70	0.703 39	0.790 28	0.596 50	0.946 8	0.855 28	0.647 45
Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu: One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation. CVPR 2021
HPGCNN	0.656 56	0.698 78	0.743 59	0.650 82	0.564 73	0.820 48	0.505 30	0.758 50	0.631 29	0.479 74	0.945 58	0.480 47	0.226 61	0.572 58	0.774 48	0.690 44	0.735 57	0.614 42	0.853 74	0.776 77	0.597 64
Jisheng Dang, Qingyong Hu, Yulan Guo, Jun Yang: HPGCNN.
AttAN	0.609 79	0.760 54	0.667 86	0.649 83	0.521 82	0.793 68	0.457 53	0.648 78	0.528 68	0.434 87	0.947 52	0.401 81	0.153 93	0.454 86	0.721 58	0.648 61	0.717 63	0.536 80	0.904 34	0.765 80	0.485 92
Gege Zhang, Qinghua Ma, Licheng Jiao, Fang Liu and Qigong Sun: AttAN: Attention Adversarial Networks for 3D Point Cloud Semantic Segmentation. IJCAI2020
GMLPs	0.538 90	0.495 100	0.693 78	0.647 84	0.471 89	0.793 68	0.300 95	0.477 96	0.505 75	0.358 94	0.903 98	0.327 93	0.081 101	0.472 84	0.529 82	0.448 97	0.710 64	0.509 83	0.746 89	0.737 88	0.554 80

HPEIN	0.618 77	0.729 68	0.668 85	0.647 84	0.597 62	0.766 80	0.414 73	0.680 71	0.520 70	0.525 61	0.946 55	0.432 67	0.215 68	0.493 81	0.599 76	0.638 66	0.617 92	0.570 60	0.897 41	0.806 54	0.605 60
Li Jiang, Hengshuang Zhao, Shu Liu, Xiaoyong Shen, Chi-Wing Fu, Jiaya Jia: Hierarchical Point-Edge Interaction Network for Point Cloud Semantic Segmentation. ICCV 2019
3DMV	0.484 96	0.484 102	0.538 103	0.643 86	0.424 94	0.606 104	0.310 93	0.574 88	0.433 95	0.378 91	0.796 104	0.301 96	0.214 69	0.537 71	0.208 103	0.472 96	0.507 104	0.413 102	0.693 95	0.602 103	0.539 82
Angela Dai, Matthias Niessner: 3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation. ECCV'18
PD-Net	0.638 63	0.797 36	0.769 43	0.641 87	0.590 64	0.820 48	0.461 52	0.537 93	0.637 27	0.536 57	0.947 52	0.388 84	0.206 71	0.656 34	0.668 68	0.647 62	0.732 59	0.585 57	0.868 68	0.793 64	0.473 96

LAP-D	0.594 81	0.720 71	0.692 79	0.637 88	0.456 91	0.773 78	0.391 83	0.730 60	0.587 50	0.445 84	0.940 72	0.381 85	0.288 32	0.434 89	0.453 89	0.591 80	0.649 85	0.581 58	0.777 86	0.749 86	0.610 56

subcloud_weak	0.516 92	0.676 80	0.591 101	0.609 89	0.442 92	0.774 77	0.335 91	0.597 84	0.422 96	0.357 95	0.932 84	0.341 92	0.094 100	0.298 97	0.528 83	0.473 95	0.676 79	0.495 88	0.602 102	0.721 92	0.349 103

SPLAT Net	0.393 104	0.472 104	0.511 104	0.606 90	0.311 105	0.656 95	0.245 102	0.405 98	0.328 104	0.197 106	0.927 87	0.227 105	0.000 109	0.001 109	0.249 99	0.271 107	0.510 102	0.383 105	0.593 103	0.699 95	0.267 105
Hang Su, Varun Jampani, Deqing Sun, Subhransu Maji, Evangelos Kalogerakis, Ming-Hsuan Yang, Jan Kautz: SPLATNet: Sparse Lattice Networks for Point Cloud Processing. CVPR 2018
PanopticFusion-label	0.529 91	0.491 101	0.688 82	0.604 91	0.386 96	0.632 100	0.225 105	0.705 69	0.434 94	0.293 100	0.815 103	0.348 91	0.241 59	0.499 79	0.669 67	0.507 90	0.649 85	0.442 99	0.796 84	0.602 103	0.561 76
Gaku Narita, Takashi Seno, Tomoya Ishikawa, Yohsuke Kaji: PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Things. IROS 2019 (to appear)
DPC	0.592 82	0.720 71	0.700 73	0.602 92	0.480 87	0.762 83	0.380 86	0.713 66	0.585 53	0.437 85	0.940 72	0.369 87	0.288 32	0.434 89	0.509 85	0.590 82	0.639 90	0.567 63	0.772 87	0.755 84	0.592 66
Francis Engelmann, Theodora Kontogianni, Bastian Leibe: Dilated Point Convolutions: On the Receptive Field Size of Point Convolutions on 3D Point Clouds. ICRA 2020
PNET2	0.442 100	0.548 97	0.548 102	0.597 93	0.363 100	0.628 102	0.300 95	0.292 102	0.374 99	0.307 99	0.881 100	0.268 101	0.186 81	0.238 102	0.204 104	0.407 100	0.506 105	0.449 96	0.667 98	0.620 102	0.462 97

Online SegFusion	0.515 93	0.607 91	0.644 92	0.579 94	0.434 93	0.630 101	0.353 89	0.628 82	0.440 92	0.410 88	0.762 106	0.307 95	0.167 88	0.520 73	0.403 93	0.516 89	0.565 95	0.447 97	0.678 97	0.701 94	0.514 88
Davide Menini, Suryansh Kumar, Martin R. Oswald, Erik Sandstroem, Cristian Sminchisescu, Luc van Gool: A Real-Time Learning Framework for Joint 3D Reconstruction and Semantic Segmentation. Robotics and Automation Letters Submission
FCPN	0.447 98	0.679 79	0.604 100	0.578 95	0.380 97	0.682 94	0.291 98	0.106 107	0.483 82	0.258 105	0.920 91	0.258 102	0.025 105	0.231 104	0.325 96	0.480 94	0.560 97	0.463 94	0.725 92	0.666 99	0.231 107
Dario Rethage, Johanna Wald, Jürgen Sturm, Nassir Navab, Federico Tombari: Fully-Convolutional Point Networks for Large-Scale Point Clouds. ECCV 2018
PCNN	0.498 95	0.559 95	0.644 92	0.560 96	0.420 95	0.711 91	0.229 103	0.414 97	0.436 93	0.352 96	0.941 70	0.324 94	0.155 92	0.238 102	0.387 94	0.493 91	0.529 101	0.509 83	0.813 83	0.751 85	0.504 89

3DWSSS	0.425 103	0.525 98	0.647 90	0.522 97	0.324 103	0.488 107	0.077 108	0.712 67	0.353 101	0.401 89	0.636 108	0.281 99	0.176 84	0.340 95	0.565 78	0.175 108	0.551 98	0.398 103	0.370 108	0.602 103	0.361 101

ScanNet	0.306 108	0.203 108	0.366 107	0.501 98	0.311 105	0.524 106	0.211 106	0.002 109	0.342 103	0.189 107	0.786 105	0.145 108	0.102 99	0.245 101	0.152 106	0.318 106	0.348 107	0.300 107	0.460 107	0.437 108	0.182 108
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner: ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes. CVPR'17
SPH3D-GCN	0.610 78	0.858 22	0.772 40	0.489 99	0.532 80	0.792 70	0.404 77	0.643 80	0.570 59	0.507 69	0.935 78	0.414 78	0.046 104	0.510 76	0.702 62	0.602 76	0.705 69	0.549 73	0.859 72	0.773 78	0.534 84
Huan Lei, Naveed Akhtar, and Ajmal Mian: Spherical Kernel for Efficient Graph Convolution on 3D Point Clouds. TPAMI 2020
Tangent Convolutions	0.438 102	0.437 105	0.646 91	0.474 100	0.369 98	0.645 98	0.353 89	0.258 104	0.282 106	0.279 101	0.918 93	0.298 97	0.147 96	0.283 99	0.294 97	0.487 92	0.562 96	0.427 101	0.619 101	0.633 101	0.352 102
Maxim Tatarchenko, Jaesik Park, Vladlen Koltun, Qian-Yi Zhou: Tangent convolutions for dense prediction in 3d. CVPR 2018
DGCNN_reproduce	0.446 99	0.474 103	0.623 95	0.463 101	0.366 99	0.651 97	0.310 93	0.389 100	0.349 102	0.330 97	0.937 75	0.271 100	0.126 97	0.285 98	0.224 101	0.350 104	0.577 94	0.445 98	0.625 100	0.723 91	0.394 99
Yue Wang, Yongbin Sun, Ziwei Liu, Sanjay E. Sarma, Michael M. Bronstein, Justin M. Solomon: Dynamic Graph CNN for Learning on Point Clouds. TOG 2019
PointNet++	0.339 106	0.584 93	0.478 106	0.458 102	0.256 107	0.360 108	0.250 100	0.247 105	0.278 107	0.261 104	0.677 107	0.183 106	0.117 98	0.212 106	0.145 107	0.364 102	0.346 108	0.232 108	0.548 104	0.523 107	0.252 106
Charles R. Qi, Li Yi, Hao Su, Leonidas J. Guibas: pointnet++: deep hierarchical feature learning on point sets in a metric space.
SD-DETR	0.576 85	0.746 59	0.609 98	0.445 103	0.517 83	0.643 99	0.366 87	0.714 65	0.456 89	0.468 78	0.870 101	0.432 67	0.264 50	0.558 64	0.674 66	0.586 83	0.688 75	0.482 91	0.739 91	0.733 89	0.537 83

ScanNet+FTSDF	0.383 105	0.297 107	0.491 105	0.432 104	0.358 101	0.612 103	0.274 99	0.116 106	0.411 97	0.265 103	0.904 97	0.229 104	0.079 102	0.250 100	0.185 105	0.320 105	0.510 102	0.385 104	0.548 104	0.597 106	0.394 99

3DMV, FTSDF	0.501 94	0.558 96	0.608 99	0.424 105	0.478 88	0.690 92	0.246 101	0.586 86	0.468 85	0.450 81	0.911 94	0.394 82	0.160 91	0.438 87	0.212 102	0.432 98	0.541 100	0.475 92	0.742 90	0.727 90	0.477 94

SurfaceConvPF	0.442 100	0.505 99	0.622 96	0.380 106	0.342 102	0.654 96	0.227 104	0.397 99	0.367 100	0.276 102	0.924 88	0.240 103	0.198 77	0.359 94	0.262 98	0.366 101	0.581 93	0.435 100	0.640 99	0.668 98	0.398 98
Hao Pan, Shilin Liu, Yang Liu, Xin Tong: Convolutional Neural Networks on 3D Surfaces Using Parallel Frames.
PointCNN with RGB	0.458 97	0.577 94	0.611 97	0.356 107	0.321 104	0.715 90	0.299 97	0.376 101	0.328 104	0.319 98	0.944 64	0.285 98	0.164 89	0.216 105	0.229 100	0.484 93	0.545 99	0.456 95	0.755 88	0.709 93	0.475 95
Yangyan Li, Rui Bu, Mingchao Sun, Baoquan Chen: PointCNN. NeurIPS 2018
SSC-UNet	0.308 107	0.353 106	0.290 108	0.278 108	0.166 108	0.553 105	0.169 107	0.286 103	0.147 108	0.148 108	0.908 95	0.182 107	0.064 103	0.023 108	0.018 109	0.354 103	0.363 106	0.345 106	0.546 106	0.685 96	0.278 104

ERROR	0.054 109	0.000 109	0.041 109	0.172 109	0.030 109	0.062 109	0.001 109	0.035 108	0.004 109	0.051 109	0.143 109	0.019 109	0.003 108	0.041 107	0.050 108	0.003 109	0.054 109	0.018 109	0.005 109	0.264 109	0.082 109

This table lists the benchmark results for the 3D semantic instance scenario.

Method	avg ap	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	window

PBNet	0.573 6	0.926 4	0.575 16	0.619 1	0.472 2	0.736 10	0.239 8	0.487 29	0.383 7	0.459 9	0.506 11	0.533 12	0.585 8	0.767 9	0.404 14	0.717 5	0.559 8	0.969 2	0.381 9
W.Zhao, Y.Yan, C.Yang, J.Ye,X.Yang,K.Huang: Divide and Conquer: 3D Instance Segmentation With Point-Wise Binarization. ICCV 2023
OneFormer3D	0.566 7	0.781 17	0.697 3	0.562 2	0.431 6	0.770 2	0.331 1	0.400 36	0.373 9	0.529 1	0.504 12	0.568 9	0.475 19	0.732 18	0.470 6	0.762 1	0.550 10	0.871 25	0.379 10

IPCA-Inst	0.520 13	0.889 8	0.551 20	0.548 3	0.418 9	0.665 23	0.064 25	0.585 10	0.260 22	0.277 26	0.471 16	0.500 14	0.644 5	0.785 6	0.369 15	0.591 24	0.511 12	0.878 22	0.362 14

DKNet	0.532 12	0.815 14	0.624 9	0.517 4	0.377 14	0.749 7	0.107 16	0.509 25	0.304 14	0.437 11	0.475 14	0.581 7	0.539 12	0.775 8	0.339 19	0.640 18	0.506 14	0.901 13	0.385 8
Yizheng Wu, Min Shi, Shuaiyuan Du, Hao Lu, Zhiguo Cao, Weicai Zhong: 3D Instances as 1D Kernels. ECCV 2022
SSEC	0.465 22	0.667 33	0.578 14	0.502 5	0.362 21	0.641 30	0.035 35	0.605 6	0.291 20	0.323 21	0.451 19	0.296 23	0.417 32	0.677 26	0.245 33	0.501 41	0.506 15	0.900 14	0.366 11

SSTNet	0.506 15	0.738 23	0.549 21	0.497 6	0.316 25	0.693 17	0.178 12	0.377 39	0.198 28	0.330 18	0.463 18	0.576 8	0.515 15	0.857 3	0.494 1	0.637 19	0.457 20	0.943 5	0.290 28
Zhihao Liang, Zhihao Li, Songcen Xu, Mingkui Tan, Kui Jia: Instance Segmentation in 3D Scenes using Semantic Superpoint Tree Networks. ICCV2021
UniPerception	0.588 3	0.963 2	0.667 6	0.493 7	0.472 3	0.750 6	0.229 9	0.528 21	0.468 2	0.498 6	0.542 2	0.643 1	0.530 14	0.661 28	0.463 9	0.695 10	0.599 1	0.972 1	0.420 4

SPFormer	0.549 11	0.745 20	0.640 8	0.484 8	0.395 11	0.739 8	0.311 3	0.566 13	0.335 11	0.468 8	0.492 13	0.555 11	0.478 18	0.747 14	0.436 11	0.712 6	0.540 11	0.893 16	0.343 18
Sun Jiahao, Qing Chunmei, Tan Junpeng, Xu Xiangmin: Superpoint Transformer for 3D Scene Instance Segmentation. AAAI 2023 [Oral]
DD-UNet+Group	0.436 24	0.630 41	0.508 32	0.480 9	0.310 26	0.624 35	0.065 24	0.638 5	0.174 30	0.256 30	0.384 27	0.194 38	0.428 26	0.759 10	0.289 25	0.574 28	0.400 29	0.849 32	0.291 27
H. Liu, R. Liu, K. Yang, J. Zhang, K. Peng, R. Stiefelhagen: HIDA: Towards Holistic Indoor Understanding for the Visually Impaired via Semantic Instance Segmentation with a Wearable Solid-State LiDAR Sensor. ICCVW 2021
DANCENET	0.504 16	0.926 4	0.579 12	0.472 10	0.367 17	0.626 33	0.165 13	0.432 31	0.221 24	0.408 12	0.449 20	0.411 15	0.564 10	0.746 15	0.421 13	0.707 9	0.438 23	0.846 33	0.288 29

Mask-Group	0.434 26	0.778 18	0.516 27	0.471 11	0.330 23	0.658 24	0.029 37	0.526 23	0.249 23	0.256 29	0.400 25	0.309 22	0.384 36	0.296 53	0.368 16	0.575 27	0.425 26	0.877 23	0.362 15
Min Zhong, Xinghao Chen, Xiaokang Chen, Gang Zeng, Yunhe Wang: MaskGroup: Hierarchical Point Grouping and Masking for 3D Instance Segmentation. ICME 2022
TopoSeg	0.479 20	0.704 26	0.564 17	0.467 12	0.366 18	0.633 31	0.068 23	0.554 16	0.262 21	0.328 19	0.447 21	0.323 19	0.534 13	0.722 19	0.288 26	0.614 20	0.482 18	0.912 8	0.358 16

HAIS	0.457 23	0.704 26	0.561 18	0.457 13	0.364 19	0.673 20	0.046 34	0.547 17	0.194 29	0.308 22	0.426 22	0.288 24	0.454 22	0.711 21	0.262 30	0.563 31	0.434 25	0.889 18	0.344 17
Shaoyu Chen, Jiemin Fang, Qian Zhang, Wenyu Liu, Xinggang Wang: Hierarchical Aggregation for 3D Instance Segmentation. ICCV 2021
MAFT	0.596 2	0.889 8	0.721 1	0.448 14	0.460 5	0.768 3	0.251 6	0.558 15	0.408 3	0.504 4	0.539 4	0.616 3	0.618 6	0.858 2	0.482 4	0.684 11	0.551 9	0.931 6	0.450 1

Dyco3D	0.395 33	0.642 39	0.518 26	0.447 15	0.259 35	0.666 22	0.050 31	0.251 53	0.166 31	0.231 34	0.362 29	0.232 33	0.331 39	0.535 36	0.229 34	0.587 25	0.438 24	0.850 30	0.317 21
Tong He; Chunhua Shen; Anton van den Hengel: DyCo3D: Robust Instance Segmentation of 3D Point Clouds through Dynamic Convolution. CVPR2021
PE	0.396 32	0.667 33	0.467 37	0.446 16	0.243 37	0.624 36	0.022 41	0.577 11	0.106 40	0.219 36	0.340 31	0.239 31	0.487 17	0.475 44	0.225 35	0.541 36	0.350 37	0.818 40	0.273 32
Biao Zhang, Peter Wonka: Point Cloud Instance Segmentation using Probabilistic Embeddings. CVPR 2021
GraphCut	0.552 10	1.000 1	0.611 10	0.438 17	0.392 12	0.714 13	0.139 14	0.598 9	0.327 12	0.389 13	0.510 9	0.598 4	0.427 29	0.754 12	0.463 10	0.761 2	0.588 4	0.903 12	0.329 19

TD3D	0.489 18	0.852 11	0.511 29	0.434 18	0.322 24	0.735 11	0.101 19	0.512 24	0.355 10	0.349 17	0.468 17	0.283 25	0.514 16	0.676 27	0.268 29	0.671 12	0.510 13	0.908 10	0.329 20
Maksim Kolodiazhnyi, Anna Vorontsova, Anton Konushin, Danila Rukhovich: Top-Down Beats Bottom-Up in 3D Instance Segmentation. WACV 2024
Box2Mask	0.433 27	0.741 21	0.463 39	0.433 19	0.283 29	0.625 34	0.103 17	0.298 49	0.125 38	0.260 28	0.424 23	0.322 20	0.472 20	0.701 24	0.363 17	0.711 7	0.309 47	0.882 20	0.272 33
Julian Chibane, Francis Engelmann, Tuan Anh Tran, Gerard Pons-Moll: Box2Mask: Weakly Supervised 3D Semantic Instance Segmentation Using Bounding Boxes. ECCV 2022
ExtMask3D	0.598 1	0.852 11	0.692 4	0.433 20	0.461 4	0.791 1	0.264 5	0.488 28	0.493 1	0.508 3	0.528 8	0.594 5	0.706 2	0.791 5	0.483 3	0.734 4	0.595 2	0.911 9	0.437 2

OccuSeg+instance	0.486 19	0.802 16	0.536 23	0.428 21	0.369 16	0.702 15	0.205 10	0.331 44	0.301 16	0.379 15	0.474 15	0.327 18	0.437 24	0.862 1	0.485 2	0.601 22	0.394 31	0.846 35	0.273 31
Lei Han, Tian Zheng, Lan Xu, Lu Fang: OccuSeg: Occupancy-aware 3D Instance Segmentation. CVPR2020
PointGroup	0.407 30	0.639 40	0.496 33	0.415 22	0.243 38	0.645 29	0.021 42	0.570 12	0.114 39	0.211 41	0.359 30	0.217 36	0.428 27	0.660 29	0.256 31	0.562 32	0.341 39	0.860 28	0.291 26
Li Jiang, Hengshuang Zhao, Shaoshuai Shi, Shu Liu, Chi-Wing Fu, Jiaya Jia: PointGroup: Dual-Set Point Grouping for 3D Instance Segmentation. CVPR 2020 [oral]
Mask3D	0.566 7	0.926 4	0.597 11	0.408 23	0.420 8	0.737 9	0.239 7	0.598 8	0.386 6	0.458 10	0.549 1	0.568 10	0.716 1	0.601 33	0.480 5	0.646 16	0.575 6	0.922 7	0.364 12
Jonas Schult, Francis Engelmann, Alexander Hermans, Or Litany, Siyu Tang, Bastian Leibe: Mask3D for 3D Semantic Instance Segmentation. ICRA 2023
DualGroup	0.469 21	0.815 14	0.552 19	0.398 24	0.374 15	0.683 19	0.130 15	0.539 18	0.310 13	0.327 20	0.407 24	0.276 26	0.447 23	0.535 37	0.342 18	0.659 14	0.455 21	0.900 15	0.301 24

SoftGroup++	0.513 14	0.704 26	0.578 15	0.398 25	0.363 20	0.704 14	0.061 26	0.647 4	0.297 19	0.378 16	0.537 5	0.343 17	0.614 7	0.828 4	0.295 24	0.710 8	0.505 16	0.875 24	0.394 6

Queryformer	0.583 4	0.926 4	0.702 2	0.393 26	0.504 1	0.733 12	0.276 4	0.527 22	0.373 8	0.479 7	0.534 6	0.533 13	0.697 3	0.720 20	0.436 12	0.745 3	0.592 3	0.958 3	0.363 13

AOIA	0.387 35	0.704 26	0.515 28	0.385 27	0.225 41	0.669 21	0.005 51	0.482 30	0.126 37	0.181 46	0.269 42	0.221 35	0.426 30	0.478 43	0.218 36	0.592 23	0.371 33	0.851 29	0.242 37

ISBNet	0.559 9	0.939 3	0.655 7	0.383 28	0.426 7	0.763 4	0.180 11	0.534 19	0.386 5	0.499 5	0.509 10	0.621 2	0.427 28	0.704 23	0.467 8	0.649 15	0.571 7	0.948 4	0.401 5
Tuan Duc Ngo, Binh-Son Hua, Khoi Nguyen: ISBNet: a 3D Point Cloud Instance Segmentation Network with Instance-aware Sampling and Box-aware Dynamic Convolution. CVPR 2023
NeuralBF	0.353 41	0.593 43	0.511 30	0.375 29	0.264 33	0.597 37	0.008 46	0.332 43	0.160 32	0.229 35	0.274 41	0.000 64	0.206 47	0.678 25	0.155 47	0.485 43	0.422 27	0.816 41	0.254 36
Weiwei Sun, Daniel Rebain, Renjie Liao, Vladimir Tankovich, Soroosh Yazdani, Kwang Moo Yi, Andrea Tagliasacchi: NeuralBF: Neural Bilateral Filtering for Top-down Instance Segmentation on Point Clouds. WACV 2023
SoftGroup	0.504 16	0.667 33	0.579 13	0.372 30	0.381 13	0.694 16	0.072 22	0.677 2	0.303 15	0.387 14	0.531 7	0.319 21	0.582 9	0.754 11	0.318 20	0.643 17	0.492 17	0.907 11	0.388 7
Thang Vu, Kookhoi Kim, Tung M. Luu, Xuan Thanh Nguyen, Chang D. Yoo: SoftGroup for 3D Instance Segmentaiton on Point Clouds. CVPR 2022 [Oral]
RPGN	0.428 28	0.630 41	0.508 31	0.367 31	0.249 36	0.658 25	0.016 44	0.673 3	0.131 36	0.234 33	0.383 28	0.270 27	0.434 25	0.748 13	0.274 28	0.609 21	0.406 28	0.842 37	0.267 34
Shichao Dong, Guosheng Lin, Tzu-Yi Hung: Learning Regional Purity for Instance Segmentation on 3D Point Clouds. ECCV 2022
INS-Conv-instance	0.435 25	0.716 25	0.495 34	0.355 32	0.331 22	0.689 18	0.102 18	0.394 38	0.208 27	0.280 24	0.395 26	0.250 29	0.544 11	0.741 17	0.309 22	0.536 37	0.391 32	0.842 38	0.258 35

SphereSeg	0.357 39	0.651 38	0.411 41	0.345 33	0.264 34	0.630 32	0.059 27	0.289 51	0.212 25	0.240 32	0.336 32	0.158 42	0.305 40	0.557 34	0.159 46	0.455 47	0.341 40	0.726 48	0.294 25

GICN	0.341 43	0.580 44	0.371 44	0.344 34	0.198 43	0.469 46	0.052 29	0.564 14	0.093 41	0.212 39	0.212 47	0.127 45	0.347 38	0.537 35	0.206 37	0.525 38	0.329 42	0.729 47	0.241 38

Occipital-SCS	0.320 45	0.679 32	0.352 46	0.334 35	0.229 39	0.436 47	0.025 38	0.412 35	0.058 48	0.161 51	0.240 44	0.085 47	0.262 42	0.496 42	0.187 41	0.467 45	0.328 43	0.775 42	0.231 39

CSC-Pretrained	0.405 31	0.738 23	0.465 38	0.331 36	0.205 42	0.655 26	0.051 30	0.601 7	0.092 43	0.211 42	0.329 33	0.198 37	0.459 21	0.775 7	0.195 40	0.524 39	0.400 30	0.878 21	0.184 44

RWSeg	0.348 42	0.475 49	0.456 40	0.320 37	0.275 32	0.476 45	0.020 43	0.491 27	0.056 50	0.212 40	0.320 34	0.261 28	0.302 41	0.520 38	0.182 42	0.557 33	0.285 49	0.867 26	0.197 41

3D-MPA	0.355 40	0.457 52	0.484 36	0.299 38	0.277 31	0.591 39	0.047 33	0.332 42	0.212 26	0.217 37	0.278 38	0.193 39	0.413 33	0.410 47	0.195 39	0.574 29	0.352 36	0.849 31	0.213 40
Francis Engelmann, Martin Bokeloh, Alireza Fathi, Bastian Leibe, Matthias Nießner: 3D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentation. CVPR 2020
SPG_WSIS	0.251 51	0.380 54	0.274 53	0.289 39	0.144 48	0.413 50	0.000 57	0.311 46	0.065 46	0.113 53	0.130 53	0.029 56	0.204 48	0.388 48	0.108 53	0.459 46	0.311 45	0.769 43	0.127 51

PCJC	0.375 37	0.704 26	0.542 22	0.284 40	0.197 44	0.649 27	0.006 48	0.426 32	0.138 34	0.242 31	0.304 37	0.183 41	0.388 35	0.629 30	0.141 50	0.546 35	0.344 38	0.738 46	0.283 30

SIM3D	0.575 5	0.889 8	0.675 5	0.284 41	0.401 10	0.762 5	0.329 2	0.531 20	0.408 4	0.521 2	0.541 3	0.587 6	0.646 4	0.744 16	0.467 7	0.665 13	0.579 5	0.886 19	0.425 3

PanopticFusion-inst	0.214 53	0.250 59	0.330 49	0.275 42	0.103 54	0.228 62	0.000 57	0.345 41	0.024 54	0.088 55	0.203 49	0.186 40	0.167 52	0.367 50	0.125 51	0.221 60	0.112 62	0.666 51	0.162 47
Gaku Narita, Takashi Seno, Tomoya Ishikawa, Yohsuke Kaji: PanopticFusion: Online Volumetric Semantic Mapping at the Level of Stuff and Things. IROS 2019 (to appear)
3D-BoNet	0.253 50	0.519 47	0.324 50	0.251 43	0.137 50	0.345 56	0.031 36	0.419 34	0.069 45	0.162 50	0.131 52	0.052 51	0.202 49	0.338 51	0.147 49	0.301 57	0.303 48	0.651 52	0.178 45
Bo Yang, Jianan Wang, Ronald Clark, Qingyong Hu, Sen Wang, Andrew Markham, Niki Trigoni: Learning Object Bounding Boxes for 3D Instance Segmentation on Point Clouds. NeurIPS 2019 Spotlight
DENet	0.413 29	0.741 21	0.520 25	0.237 44	0.284 28	0.523 43	0.097 20	0.691 1	0.138 33	0.209 43	0.229 45	0.238 32	0.390 34	0.707 22	0.310 21	0.448 48	0.470 19	0.892 17	0.310 22

One_Thing_One_Click	0.326 44	0.472 50	0.361 45	0.232 45	0.183 45	0.555 41	0.000 57	0.498 26	0.038 52	0.195 44	0.226 46	0.362 16	0.168 51	0.469 45	0.251 32	0.553 34	0.335 41	0.846 34	0.117 52
Zhengzhe Liu, Xiaojuan Qi, Chi-Wing Fu: One Thing One Click: A Self-Training Approach for Weakly Supervised 3D Semantic Segmentation. CVPR 2021
OSIS	0.392 34	0.778 18	0.530 24	0.220 46	0.278 30	0.567 40	0.083 21	0.330 45	0.299 17	0.270 27	0.310 36	0.143 43	0.260 43	0.624 31	0.277 27	0.568 30	0.361 35	0.865 27	0.301 23

SSEN	0.384 36	0.852 11	0.494 35	0.192 47	0.226 40	0.648 28	0.022 40	0.398 37	0.299 18	0.277 25	0.317 35	0.231 34	0.194 50	0.514 40	0.196 38	0.586 26	0.444 22	0.843 36	0.184 43
Dongsu Zhang, Junha Chun, Sang Kyun Cha, Young Min Kim: Spatial Semantic Embedding Network: Fast 3D Instance Segmentation with Deep Metric Learning. Arxiv
ClickSeg_Instance	0.366 38	0.654 37	0.375 43	0.184 48	0.302 27	0.592 38	0.050 32	0.300 48	0.093 42	0.283 23	0.277 39	0.249 30	0.426 31	0.615 32	0.299 23	0.504 40	0.367 34	0.832 39	0.191 42

MTML	0.282 47	0.577 45	0.380 42	0.182 49	0.107 53	0.430 48	0.001 54	0.422 33	0.057 49	0.179 47	0.162 50	0.070 50	0.229 45	0.511 41	0.161 44	0.491 42	0.313 44	0.650 53	0.162 46
Jean Lahoud, Bernard Ghanem, Marc Pollefeys, Martin R. Oswald: 3D Instance Segmentation via Multi-task Metric Learning. ICCV 2019 [oral]
Sparse R-CNN	0.292 46	0.704 26	0.213 56	0.153 50	0.154 47	0.551 42	0.053 28	0.212 54	0.132 35	0.174 48	0.274 40	0.070 49	0.363 37	0.441 46	0.176 43	0.424 50	0.234 51	0.758 44	0.161 48

MASC	0.254 49	0.463 51	0.249 55	0.113 51	0.167 46	0.412 51	0.000 56	0.374 40	0.073 44	0.173 49	0.243 43	0.130 44	0.228 46	0.368 49	0.160 45	0.356 52	0.208 52	0.711 50	0.136 50
Chen Liu, Yasutaka Furukawa: MASC: Multi-scale Affinity with Sparse Convolution for 3D Instance Segmentation.
R-PointNet	0.158 56	0.356 55	0.173 59	0.113 52	0.140 49	0.359 52	0.012 45	0.023 62	0.039 51	0.134 52	0.123 54	0.008 60	0.089 56	0.149 58	0.117 52	0.221 59	0.128 59	0.563 55	0.094 53

UNet-backbone	0.161 54	0.519 47	0.259 54	0.084 53	0.059 56	0.325 58	0.002 52	0.093 59	0.009 58	0.077 57	0.064 56	0.045 52	0.044 60	0.161 57	0.045 56	0.331 55	0.180 54	0.566 54	0.033 64

Region-18class	0.146 57	0.175 63	0.321 51	0.080 54	0.062 55	0.357 53	0.000 57	0.307 47	0.002 61	0.066 58	0.044 58	0.000 64	0.018 62	0.036 63	0.054 55	0.447 49	0.133 57	0.472 56	0.060 59

SemRegionNet-20cls	0.121 58	0.296 57	0.203 57	0.071 55	0.058 57	0.349 54	0.000 57	0.150 55	0.019 55	0.054 60	0.034 61	0.017 59	0.052 58	0.042 62	0.013 63	0.209 61	0.183 53	0.371 58	0.057 60

3D-SIS	0.161 54	0.407 53	0.155 61	0.068 56	0.043 60	0.346 55	0.001 53	0.134 56	0.005 59	0.088 54	0.106 55	0.037 54	0.135 55	0.321 52	0.028 60	0.339 53	0.116 61	0.466 57	0.093 54
Ji Hou, Angela Dai, Matthias Niessner: 3D-SIS: 3D Semantic Instance Segmentation of RGB-D Scans. CVPR 2019
SALoss-ResNet	0.262 48	0.667 33	0.335 47	0.067 57	0.123 51	0.427 49	0.022 39	0.280 52	0.058 47	0.216 38	0.211 48	0.039 53	0.142 53	0.519 39	0.106 54	0.338 54	0.310 46	0.721 49	0.138 49
Zhidong Liang, Ming Yang, Hao Li, Chunxiang Wang: 3D Instance Embedding Learning With a Structure-Aware Loss Function for Point Cloud Segmentation. IEEE Robotics and Automation Letters (IROS2020)
ASIS	0.085 63	0.037 64	0.080 64	0.066 58	0.047 59	0.282 60	0.000 57	0.052 60	0.002 62	0.047 62	0.026 62	0.001 63	0.046 59	0.194 56	0.031 59	0.264 58	0.140 56	0.167 63	0.047 63

SegGroup_ins	0.246 52	0.556 46	0.335 48	0.062 59	0.115 52	0.490 44	0.000 57	0.297 50	0.018 56	0.186 45	0.142 51	0.083 48	0.233 44	0.216 55	0.153 48	0.469 44	0.251 50	0.744 45	0.083 55
An Tao, Yueqi Duan, Yi Wei, Jiwen Lu, Jie Zhou: SegGroup: Seg-Level Supervision for 3D Instance and Semantic Segmentation. TIP 2022
tmp	0.113 61	0.333 56	0.151 62	0.056 60	0.053 58	0.344 57	0.000 57	0.105 58	0.016 57	0.049 61	0.035 60	0.020 58	0.053 57	0.048 61	0.013 62	0.183 63	0.173 55	0.344 61	0.054 61

Hier3D	0.117 59	0.222 61	0.161 60	0.054 61	0.027 62	0.289 59	0.000 57	0.124 57	0.001 63	0.079 56	0.061 57	0.027 57	0.141 54	0.240 54	0.005 64	0.310 56	0.129 58	0.153 64	0.081 56
Tan: HCFS3D: Hierarchical Coupled Feature Selection Network for 3D Semantic and Instance Segmentation.
Sgpn_scannet	0.049 64	0.023 65	0.134 63	0.031 62	0.013 64	0.144 64	0.006 47	0.008 64	0.000 64	0.028 64	0.017 63	0.003 61	0.009 65	0.000 64	0.021 61	0.122 64	0.095 64	0.175 62	0.054 62

3D-BEVIS	0.117 59	0.250 59	0.308 52	0.020 63	0.009 65	0.269 61	0.006 49	0.008 63	0.029 53	0.037 63	0.014 64	0.003 62	0.036 61	0.147 59	0.042 58	0.381 51	0.118 60	0.362 59	0.069 58
Cathrin Elich, Francis Engelmann, Jonas Schult, Theodora Kontogianni, Bastian Leibe: 3D-BEVIS: Birds-Eye-View Instance Segmentation.
Sem_Recon_ins	0.098 62	0.295 58	0.187 58	0.015 64	0.036 61	0.213 63	0.005 50	0.038 61	0.003 60	0.056 59	0.037 59	0.036 55	0.015 63	0.051 60	0.044 57	0.209 62	0.098 63	0.354 60	0.071 57

MaskRCNN 2d->3d Proj	0.022 65	0.185 62	0.000 65	0.000 65	0.015 63	0.000 65	0.000 55	0.006 65	0.000 64	0.010 65	0.006 65	0.107 46	0.012 64	0.000 64	0.002 65	0.027 65	0.004 65	0.022 65	0.001 65

Method	avg iou	bathtub	bed	bookshelf	cabinet	chair	counter	curtain	desk	door	floor	otherfurniture	picture	refrigerator	shower curtain	sink	sofa	table	toilet	wall	window

Virtual MVFusion (R)	0.745 1	0.861 1	0.839 1	0.881 1	0.672 1	0.512 1	0.422 15	0.898 1	0.723 1	0.714 1	0.954 2	0.454 1	0.509 1	0.773 1	0.895 1	0.756 1	0.820 1	0.653 1	0.935 1	0.891 1	0.728 1
Abhijit Kundu, Xiaoqi Yin, Alireza Fathi, David Ross, Brian Brewington, Thomas Funkhouser, Caroline Pantofaru: Virtual Multi-view Fusion for 3D Semantic Segmentation. ECCV 2020
BPNet_2D	0.670 2	0.822 3	0.795 3	0.836 2	0.659 2	0.481 2	0.451 11	0.769 3	0.656 3	0.567 3	0.931 3	0.395 4	0.390 4	0.700 3	0.534 3	0.689 9	0.770 2	0.574 3	0.865 6	0.831 3	0.675 4
Wenbo Hu, Hengshuang Zhao, Li Jiang, Jiaya Jia and Tien-Tsin Wong: Bidirectional Projection Network for Cross Dimension Scene Understanding. CVPR 2021 (Oral)
DMMF_3d	0.605 5	0.651 8	0.744 7	0.782 3	0.637 4	0.387 4	0.536 3	0.732 7	0.590 6	0.540 5	0.856 18	0.359 9	0.306 13	0.596 11	0.539 2	0.627 18	0.706 4	0.497 7	0.785 18	0.757 16	0.476 19

MCA-Net	0.595 6	0.533 17	0.756 6	0.746 4	0.590 8	0.334 7	0.506 6	0.670 12	0.587 7	0.500 10	0.905 8	0.366 8	0.352 8	0.601 10	0.506 6	0.669 15	0.648 7	0.501 6	0.839 12	0.769 12	0.516 18

RFBNet	0.592 7	0.616 9	0.758 5	0.659 5	0.581 9	0.330 8	0.469 10	0.655 15	0.543 12	0.524 7	0.924 4	0.355 10	0.336 10	0.572 14	0.479 8	0.671 13	0.648 7	0.480 9	0.814 16	0.814 5	0.614 9

ScanNet (2d proj)	0.330 23	0.293 22	0.521 22	0.657 6	0.361 22	0.161 22	0.250 22	0.004 23	0.440 20	0.183 23	0.836 20	0.125 22	0.060 23	0.319 23	0.132 22	0.417 22	0.412 22	0.344 22	0.541 23	0.427 23	0.109 23
Angela Dai, Angel X. Chang, Manolis Savva, Maciej Halber, Thomas Funkhouser, Matthias Nießner: ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenes. CVPR'17
SN_RN152pyrx8_RVC	0.546 14	0.572 14	0.663 18	0.638 7	0.518 15	0.298 14	0.366 21	0.633 18	0.510 15	0.446 17	0.864 16	0.296 17	0.267 17	0.542 16	0.346 18	0.704 7	0.575 16	0.431 16	0.853 10	0.766 14	0.630 7

UDSSEG_RVC	0.545 15	0.610 11	0.661 19	0.588 8	0.556 12	0.268 18	0.482 8	0.642 17	0.572 9	0.475 14	0.836 20	0.312 15	0.367 6	0.630 7	0.189 20	0.639 17	0.495 20	0.452 13	0.826 14	0.756 17	0.541 14

3DMV (2d proj)	0.498 19	0.481 21	0.612 20	0.579 9	0.456 19	0.343 5	0.384 18	0.623 19	0.525 14	0.381 20	0.845 19	0.254 19	0.264 19	0.557 15	0.182 21	0.581 21	0.598 13	0.429 17	0.760 20	0.661 22	0.446 21
Angela Dai, Matthias Niessner: 3DMV: Joint 3D-Multi-View Prediction for 3D Semantic Scene Segmentation. ECCV'18
EMSAFormer	0.564 13	0.581 13	0.736 8	0.564 10	0.546 13	0.219 20	0.517 4	0.675 11	0.486 17	0.427 19	0.904 9	0.352 11	0.320 11	0.589 12	0.528 4	0.708 6	0.464 21	0.413 19	0.847 11	0.786 8	0.611 10

DCRedNet	0.583 9	0.682 6	0.723 10	0.542 11	0.510 17	0.310 12	0.451 11	0.668 13	0.549 11	0.520 8	0.920 6	0.375 5	0.446 2	0.528 17	0.417 13	0.670 14	0.577 15	0.478 10	0.862 7	0.806 7	0.628 8

CMX	0.613 4	0.681 7	0.725 9	0.502 12	0.634 5	0.297 15	0.478 9	0.830 2	0.651 4	0.537 6	0.924 4	0.375 5	0.315 12	0.686 5	0.451 12	0.714 4	0.543 18	0.504 5	0.894 4	0.823 4	0.688 3

Enet (reimpl)	0.376 22	0.264 23	0.452 23	0.452 13	0.365 21	0.181 21	0.143 23	0.456 22	0.409 22	0.346 22	0.769 23	0.164 21	0.218 21	0.359 22	0.123 23	0.403 23	0.381 23	0.313 23	0.571 22	0.685 21	0.472 20
Re-implementation of Adam Paszke, Abhishek Chaurasia, Sangpil Kim, Eugenio Culurciello: ENet: A Deep Neural Network Architecture for Real-Time Semantic Segmentation.
SSMA	0.577 11	0.695 4

Presenting the ScanNet200 Benchmark

ScanNet200 Benchmark

ScanNet200 3D Semantic Label Benchmark

ScanNet200 3D Semantic Instance Benchmark

ScanNet Benchmark

3D Semantic Label Benchmark

3D Semantic Instance Benchmark

2D Semantic Label Benchmark