ScanNet200 3D Semantic Instance Benchmark
The 3D semantic instance prediction task involves detecting and segmenting the object in an 3D scan mesh.
Evaluation and metricsSimilarly to the ScanNet benchmark in ScanNet200 our evaluation ranks all methods according to the average precision for each class. We report the mean average precision AP at overlap 0.25 (AP 25%), overlap 0.5 (AP 50%), and over overlaps in the range [0.5:0.95:0.05] (AP) for all 200 categories. Note that multiple predictions of the same ground truth instance are penalized as false positives.
This table lists the benchmark results for the ScanNet200 3D semantic instance scenario.
| Method | Info | avg ap 25% | head ap 25% | common ap 25% | tail ap 25% | chair | table | door | couch | cabinet | shelf | desk | office chair | bed | pillow | sink | picture | window | toilet | bookshelf | monitor | curtain | book | armchair | coffee table | box | refrigerator | lamp | kitchen cabinet | towel | clothes | tv | nightstand | counter | dresser | stool | cushion | plant | ceiling | bathtub | end table | dining table | keyboard | bag | backpack | toilet paper | printer | tv stand | whiteboard | blanket | shower curtain | trash can | closet | stairs | microwave | stove | shoe | computer tower | bottle | bin | ottoman | bench | board | washing machine | mirror | copier | basket | sofa chair | file cabinet | fan | laptop | shower | paper | person | paper towel dispenser | oven | blinds | rack | plate | blackboard | piano | suitcase | rail | radiator | recycling bin | container | wardrobe | soap dispenser | telephone | bucket | clock | stand | light | laundry basket | pipe | clothes dryer | guitar | toilet paper holder | seat | speaker | column | bicycle | ladder | bathroom stall | shower wall | cup | jacket | storage bin | coffee maker | dishwasher | paper towel roll | machine | mat | windowsill | bar | toaster | bulletin board | ironing board | fireplace | soap dish | kitchen counter | doorframe | toilet paper dispenser | mini fridge | fire extinguisher | ball | hat | shower curtain rod | water cooler | paper cutter | tray | shower door | pillar | ledge | toaster oven | mouse | toilet seat cover dispenser | furniture | cart | storage container | scale | tissue box | light switch | crate | power outlet | decoration | sign | projector | closet door | vacuum cleaner | candle | plunger | stuffed animal | headphones | dish rack | broom | guitar case | range hood | dustpan | hair dryer | water bottle | handicap bar | purse | vent | shower floor | water pitcher | mailbox | bowl | paper bag | alarm clock | music stand | projector screen | divider | laundry detergent | bathroom counter | object | bathroom vanity | closet wall | laundry hamper | bathroom stall door | ceiling light | trash bin | dumbbell | stair rail | tube | bathroom cabinet | cd case | closet rod | coffee kettle | structure | shower head | keyboard piano | case of water bottles | coat rack | storage organizer | folded chair | fire alarm | power strip | calendar | poster | potted plant | luggage | mattress |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AQ3D-ScanNet200 | 0.527 3 | 0.743 1 | 0.477 3 | 0.324 4 | 0.930 1 | 0.784 4 | 0.886 4 | 0.947 3 | 0.631 1 | 0.410 4 | 0.893 2 | 0.328 2 | 0.955 7 | 0.795 2 | 0.926 5 | 0.925 2 | 0.816 3 | 1.000 1 | 0.754 4 | 0.960 5 | 0.858 1 | 0.556 1 | 0.805 5 | 0.396 3 | 0.929 3 | 0.707 3 | 0.839 4 | 0.835 3 | 0.360 2 | 0.764 9 | 0.896 5 | 0.087 8 | 0.778 2 | 0.576 3 | 0.160 3 | 0.879 2 | 0.901 3 | 1.000 1 | 0.089 8 | 0.023 7 | 0.895 4 | 0.161 3 | 0.862 2 | 0.549 6 | 0.667 6 | 1.000 1 | 0.546 7 | 0.435 1 | 1.000 1 | 0.935 2 | 0.113 7 | 1.000 1 | 0.831 6 | 0.778 2 | 0.602 4 | 0.938 1 | 0.279 6 | 0.025 5 | 0.567 4 | 0.458 3 | 1.000 1 | 0.750 4 | 1.000 1 | 0.833 1 | 0.392 3 | 0.991 1 | 0.479 5 | 0.434 6 | 1.000 1 | 0.071 2 | 0.428 5 | 0.868 2 | 1.000 1 | 0.333 5 | 0.281 1 | 0.000 7 | 0.533 6 | 1.000 1 | 0.671 4 | 0.838 5 | 0.534 2 | 0.664 1 | 0.819 6 | 0.768 3 | 0.083 1 | 0.009 8 | 0.000 5 | 0.465 1 | 0.000 2 | 0.337 2 | 0.667 4 | 0.030 2 | 0.172 3 | 0.250 7 | 1.000 1 | 0.738 4 | 0.513 6 | 0.712 8 | 0.368 3 | 0.366 4 | 0.016 5 | 0.489 9 | 0.600 1 | 0.083 6 | 0.563 2 | 0.400 3 | 0.923 1 | 0.500 1 | 0.736 2 | 0.607 3 | 0.500 1 | 0.837 2 | 0.843 2 | 1.000 1 | 0.658 4 | 0.318 6 | 0.500 1 | 0.000 2 | 1.000 1 | 0.333 9 | 1.000 1 | 0.000 1 | 0.105 5 | 0.000 5 | 0.500 1 | 0.000 4 | 1.000 1 | 1.000 1 | 0.000 5 | 0.141 8 | 0.026 8 | 0.000 3 | 0.000 3 | 1.000 1 | 0.000 1 | 0.714 2 | 0.000 1 | 0.621 5 | 0.750 1 | 0.000 1 | 1.000 1 | 0.000 1 | 0.000 1 | 0.714 8 | 0.667 3 | 1.000 1 | 0.167 5 | 0.667 1 | 0.000 1 | 1.000 1 | 0.000 1 | 0.088 8 | 0.873 1 | 0.517 3 | 0.556 7 | 0.073 7 | 0.434 3 | 0.458 7 | 0.707 3 | 0.083 2 | 0.000 1 | 0.803 3 | 0.000 1 | 0.000 2 | 1.000 1 | 1.000 1 | 0.000 4 | 0.056 3 | 0.000 2 | 0.200 5 | 0.143 3 | 0.000 4 | 0.250 7 | 0.000 2 | |||||||||||||||||||||||||||||
| ACGP-ScanNet200 | 0.544 1 | 0.737 2 | 0.483 2 | 0.381 1 | 0.801 9 | 0.859 1 | 0.921 2 | 0.912 5 | 0.536 6 | 0.483 1 | 0.846 7 | 0.036 4 | 0.996 4 | 0.699 5 | 0.955 3 | 0.929 1 | 0.842 2 | 1.000 1 | 0.834 1 | 0.993 1 | 0.858 2 | 0.517 4 | 0.838 1 | 0.396 4 | 0.968 2 | 0.682 4 | 0.860 2 | 0.840 2 | 0.292 4 | 0.800 6 | 0.825 8 | 0.213 4 | 0.573 6 | 0.552 4 | 0.000 5 | 0.738 5 | 0.918 2 | 1.000 1 | 0.064 9 | 1.000 1 | 0.897 3 | 0.184 2 | 0.747 4 | 0.424 7 | 0.835 3 | 1.000 1 | 0.718 2 | 0.388 4 | 1.000 1 | 0.915 3 | 0.140 6 | 0.721 8 | 0.851 4 | 0.778 2 | 0.666 2 | 0.902 3 | 0.405 4 | 0.035 4 | 0.511 6 | 0.307 6 | 0.903 3 | 0.680 7 | 1.000 1 | 0.708 2 | 0.403 2 | 0.931 3 | 0.658 3 | 0.510 3 | 1.000 1 | 0.089 1 | 0.671 3 | 0.765 6 | 1.000 1 | 0.528 3 | 0.006 4 | 0.204 4 | 1.000 1 | 0.500 3 | 0.759 1 | 0.854 3 | 0.590 1 | 0.461 3 | 0.850 3 | 0.767 4 | 0.042 2 | 0.086 5 | 0.000 5 | 0.462 2 | 0.000 2 | 0.349 1 | 1.000 1 | 0.007 4 | 0.341 2 | 0.444 6 | 1.000 1 | 0.759 3 | 0.371 10 | 0.867 3 | 0.367 4 | 0.462 1 | 0.000 8 | 0.903 2 | 0.443 7 | 0.500 3 | 0.250 3 | 0.600 2 | 0.809 2 | 0.500 1 | 0.944 1 | 0.540 5 | 0.000 6 | 0.944 1 | 0.905 1 | 0.944 3 | 0.677 3 | 0.637 2 | 0.500 1 | 0.000 2 | 1.000 1 | 0.507 3 | 1.000 1 | 0.000 1 | 0.140 3 | 0.000 5 | 0.500 1 | 0.000 4 | 1.000 1 | 1.000 1 | 0.143 4 | 0.146 7 | 0.396 2 | 0.000 3 | 0.000 3 | 1.000 1 | 0.000 1 | 0.782 1 | 0.000 1 | 0.638 4 | 0.677 6 | 0.000 1 | 0.974 2 | 0.000 1 | 0.000 1 | 0.959 3 | 0.903 1 | 0.884 6 | 1.000 1 | 0.472 2 | 0.000 1 | 0.250 7 | 0.000 1 | 0.185 1 | 0.718 4 | 0.391 6 | 0.604 6 | 0.189 5 | 0.206 8 | 0.500 5 | 0.637 4 | 0.064 3 | 0.000 1 | 0.667 4 | 0.000 1 | 0.000 2 | 1.000 1 | 1.000 1 | 0.050 3 | 0.000 6 | 0.000 2 | 0.317 4 | 0.144 2 | 0.024 3 | 1.000 1 | 0.008 1 | |||||||||||||||||||||||||||||
| Rongkun Yang, Ye Zhang, Longguang Wang, Zhiheng Fu, Lian Xu, Yulan Guo: Beyond Context Bias: Adaptive Instance Placement for Robust 3D Instance Segmentation. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Volt-SPFormer | 0.527 2 | 0.731 3 | 0.475 4 | 0.342 2 | 0.826 6 | 0.803 3 | 0.942 1 | 0.950 2 | 0.594 4 | 0.321 5 | 0.867 5 | 0.008 6 | 0.994 5 | 0.767 3 | 0.926 6 | 0.874 3 | 0.815 4 | 1.000 1 | 0.810 2 | 0.973 3 | 0.856 3 | 0.510 5 | 0.825 2 | 0.346 5 | 0.923 4 | 0.799 2 | 0.843 3 | 0.812 4 | 0.262 5 | 0.923 1 | 0.921 3 | 0.279 2 | 0.901 1 | 0.500 7 | 0.000 5 | 0.801 4 | 0.937 1 | 1.000 1 | 0.329 1 | 0.000 8 | 0.903 2 | 0.076 6 | 0.789 3 | 0.565 3 | 0.907 2 | 1.000 1 | 0.614 6 | 0.413 3 | 1.000 1 | 0.937 1 | 0.214 2 | 0.629 11 | 0.878 3 | 0.725 8 | 0.579 5 | 0.880 5 | 0.433 3 | 0.020 7 | 0.400 7 | 0.547 1 | 1.000 1 | 0.843 2 | 1.000 1 | 0.125 3 | 0.343 4 | 0.855 5 | 0.750 1 | 0.449 5 | 1.000 1 | 0.057 3 | 0.700 1 | 0.802 5 | 0.500 4 | 0.850 2 | 0.011 3 | 0.047 6 | 1.000 1 | 1.000 1 | 0.715 2 | 0.875 1 | 0.255 4 | 0.099 7 | 0.857 2 | 0.738 5 | 0.000 4 | 0.056 7 | 0.025 2 | 0.372 4 | 0.250 1 | 0.279 4 | 0.667 4 | 0.002 5 | 0.000 8 | 0.250 7 | 0.500 5 | 1.000 1 | 0.391 9 | 0.737 7 | 0.309 5 | 0.397 2 | 0.000 8 | 0.817 3 | 0.542 2 | 0.557 2 | 1.000 1 | 0.400 3 | 0.681 3 | 0.000 4 | 0.500 4 | 0.519 6 | 0.500 1 | 0.773 4 | 0.818 4 | 0.884 4 | 0.656 5 | 0.510 4 | 0.500 1 | 0.000 2 | 1.000 1 | 0.472 4 | 1.000 1 | 0.000 1 | 0.027 8 | 0.000 5 | 0.331 5 | 0.000 4 | 1.000 1 | 1.000 1 | 0.000 5 | 0.500 1 | 0.304 3 | 0.000 3 | 0.000 3 | 1.000 1 | 0.000 1 | 0.714 2 | 0.000 1 | 0.677 2 | 0.750 1 | 0.000 1 | 0.944 4 | 0.000 1 | 0.000 1 | 1.000 1 | 0.764 2 | 0.833 7 | 0.250 3 | 0.278 4 | 0.000 1 | 1.000 1 | 0.000 1 | 0.103 5 | 0.753 2 | 0.600 1 | 0.508 10 | 0.638 1 | 0.167 9 | 0.458 7 | 0.741 1 | 0.019 4 | 0.000 1 | 0.850 2 | 0.000 1 | 0.000 2 | 1.000 1 | 1.000 1 | 0.000 4 | 0.028 5 | 0.000 2 | 0.200 5 | 0.000 5 | 0.250 1 | 1.000 1 | 0.000 2 | |||||||||||||||||||||||||||||
| Kadir Yilmaz, Adrian Kruse, Tristan Höfer, Daan de Geus, Bastian Leibe: Volume Transformer: Revisiting Vanilla Transformers for 3D Scene Understanding. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| CompetitorFormer-200 | 0.469 5 | 0.676 5 | 0.401 6 | 0.296 5 | 0.901 2 | 0.729 7 | 0.885 5 | 0.829 9 | 0.380 8 | 0.320 6 | 0.873 4 | 0.400 1 | 0.998 3 | 0.711 4 | 0.980 1 | 0.847 5 | 0.854 1 | 1.000 1 | 0.696 6 | 0.989 2 | 0.759 6 | 0.556 2 | 0.806 4 | 0.240 6 | 0.918 5 | 0.650 5 | 0.818 6 | 0.629 6 | 0.224 6 | 0.839 2 | 0.933 1 | 0.247 3 | 0.711 4 | 0.540 5 | 0.021 4 | 0.543 10 | 0.900 4 | 0.903 10 | 0.118 5 | 0.125 6 | 0.916 1 | 0.057 8 | 0.692 5 | 0.410 9 | 0.747 4 | 1.000 1 | 0.664 3 | 0.424 2 | 0.933 9 | 0.839 7 | 0.207 3 | 0.703 9 | 0.748 8 | 0.700 9 | 0.610 3 | 0.869 6 | 0.270 7 | 0.068 1 | 0.878 1 | 0.244 7 | 0.794 5 | 0.698 6 | 1.000 1 | 0.000 6 | 0.325 6 | 0.770 10 | 0.482 4 | 0.452 4 | 0.025 11 | 0.015 5 | 0.293 6 | 0.829 3 | 0.663 3 | 1.000 1 | 0.013 2 | 0.385 3 | 0.250 7 | 0.500 3 | 0.491 8 | 0.850 4 | 0.214 8 | 0.131 6 | 0.878 1 | 0.617 6 | 0.000 4 | 0.085 6 | 0.009 4 | 0.278 7 | 0.000 2 | 0.295 3 | 1.000 1 | 0.000 6 | 0.160 4 | 0.500 2 | 0.500 5 | 0.342 9 | 0.534 4 | 0.901 2 | 0.474 1 | 0.222 7 | 0.011 6 | 0.724 5 | 0.542 2 | 0.125 4 | 0.083 4 | 0.336 7 | 0.500 6 | 0.083 3 | 0.565 3 | 0.587 4 | 0.500 1 | 0.827 3 | 0.829 3 | 0.750 6 | 0.508 6 | 0.018 8 | 0.500 1 | 0.000 2 | 1.000 1 | 0.667 1 | 1.000 1 | 0.000 1 | 0.173 2 | 0.286 2 | 0.500 1 | 0.000 4 | 0.125 7 | 0.489 6 | 0.000 5 | 0.500 1 | 0.269 4 | 0.000 3 | 0.050 2 | 0.834 6 | 0.000 1 | 0.581 7 | 0.000 1 | 0.677 2 | 0.467 10 | 0.000 1 | 0.886 6 | 0.000 1 | 0.000 1 | 0.820 6 | 0.144 9 | 1.000 1 | 1.000 1 | 0.103 5 | 0.000 1 | 1.000 1 | 0.000 1 | 0.175 2 | 0.410 8 | 0.330 7 | 0.701 5 | 0.257 4 | 0.292 5 | 0.285 10 | 0.574 7 | 0.157 1 | 0.000 1 | 0.863 1 | 0.000 1 | 0.056 1 | 0.250 5 | 1.000 1 | 0.000 4 | 0.109 2 | 0.000 2 | 0.400 2 | 0.025 4 | 0.000 4 | 1.000 1 | 0.000 2 | |||||||||||||||||||||||||||||
| DINO3D-Scannet200 | 0.511 4 | 0.685 4 | 0.484 1 | 0.331 3 | 0.892 3 | 0.821 2 | 0.890 3 | 0.907 6 | 0.629 2 | 0.468 2 | 0.905 1 | 0.001 8 | 1.000 1 | 0.816 1 | 0.968 2 | 0.863 4 | 0.811 5 | 0.944 9 | 0.596 10 | 0.960 6 | 0.778 4 | 0.532 3 | 0.719 10 | 0.481 1 | 0.851 9 | 0.803 1 | 0.873 1 | 0.850 1 | 0.421 1 | 0.806 5 | 0.856 7 | 0.111 6 | 0.761 3 | 0.677 1 | 0.000 5 | 0.944 1 | 0.861 5 | 1.000 1 | 0.220 2 | 0.708 4 | 0.856 6 | 0.220 1 | 0.864 1 | 0.579 1 | 1.000 1 | 0.764 11 | 0.655 4 | 0.327 5 | 1.000 1 | 0.911 4 | 0.244 1 | 0.667 10 | 0.923 1 | 0.857 1 | 0.702 1 | 0.889 4 | 0.496 2 | 0.048 2 | 0.355 11 | 0.494 2 | 0.794 5 | 0.798 3 | 1.000 1 | 0.042 5 | 0.264 8 | 0.817 7 | 0.683 2 | 0.675 1 | 0.167 5 | 0.000 6 | 0.700 1 | 0.824 4 | 0.417 7 | 0.000 6 | 0.000 5 | 0.764 1 | 0.000 8 | 0.500 3 | 0.699 3 | 0.789 7 | 0.079 9 | 0.472 2 | 0.845 4 | 0.930 1 | 0.000 4 | 0.667 1 | 0.000 5 | 0.412 3 | 0.000 2 | 0.163 6 | 1.000 1 | 0.000 6 | 0.419 1 | 0.500 2 | 1.000 1 | 0.777 2 | 0.576 3 | 0.867 4 | 0.378 2 | 0.334 5 | 0.028 3 | 0.764 4 | 0.542 2 | 0.559 1 | 0.000 5 | 0.800 1 | 0.528 5 | 0.000 4 | 0.346 6 | 0.714 1 | 0.125 5 | 0.756 5 | 0.754 6 | 0.866 5 | 0.750 1 | 0.600 3 | 0.500 1 | 0.500 1 | 1.000 1 | 0.667 1 | 1.000 1 | 0.000 1 | 0.298 1 | 0.000 5 | 0.250 6 | 0.194 2 | 0.000 8 | 0.850 4 | 0.000 5 | 0.250 5 | 0.595 1 | 0.000 3 | 0.063 1 | 0.860 5 | 0.000 1 | 0.714 2 | 0.000 1 | 0.944 1 | 0.750 1 | 0.000 1 | 0.974 2 | 0.000 1 | 0.000 1 | 0.857 4 | 0.655 4 | 0.719 10 | 0.250 3 | 0.014 7 | 0.000 1 | 1.000 1 | 0.000 1 | 0.142 4 | 0.744 3 | 0.200 8 | 0.746 3 | 0.436 3 | 0.221 7 | 0.798 1 | 0.500 8 | 0.011 5 | 0.000 1 | 0.385 8 | 0.000 1 | 0.000 2 | 0.000 6 | 0.792 7 | 0.663 1 | 0.000 6 | 0.000 2 | 0.200 5 | 0.000 5 | 0.000 4 | 1.000 1 | 0.000 2 | |||||||||||||||||||||||||||||
| Jinyuan Qu, Hongyang Li, Xingyu Chen, Shilong Liu, Yukai Shi, Tianhe Ren, Ruitao Jing and Lei Zhang: SegDINO3D: 3D Instance Segmentation Empowered by Both Image-Level and Object-Level 2D Features. AAAI 2026 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ODIN - Ins200 | 0.451 6 | 0.637 7 | 0.407 5 | 0.277 6 | 0.742 11 | 0.699 8 | 0.855 6 | 0.826 11 | 0.626 3 | 0.441 3 | 0.742 8 | 0.003 7 | 0.941 8 | 0.637 6 | 0.910 7 | 0.616 10 | 0.679 8 | 0.944 9 | 0.695 7 | 0.877 8 | 0.763 5 | 0.357 7 | 0.723 9 | 0.475 2 | 0.779 10 | 0.494 6 | 0.782 7 | 0.795 5 | 0.334 3 | 0.824 3 | 0.867 6 | 0.108 7 | 0.701 5 | 0.638 2 | 0.000 5 | 0.873 3 | 0.749 7 | 0.667 11 | 0.203 3 | 0.500 5 | 0.886 5 | 0.116 4 | 0.583 10 | 0.571 2 | 0.688 5 | 1.000 1 | 0.760 1 | 0.162 8 | 1.000 1 | 0.852 6 | 0.078 8 | 0.833 6 | 0.887 2 | 0.778 2 | 0.577 6 | 0.859 9 | 0.550 1 | 0.000 8 | 0.542 5 | 0.028 10 | 0.667 8 | 0.874 1 | 1.000 1 | 0.125 3 | 0.232 9 | 0.870 4 | 0.406 7 | 0.337 8 | 0.167 5 | 0.000 6 | 0.671 3 | 0.742 7 | 0.500 4 | 0.000 6 | 0.000 5 | 0.528 2 | 1.000 1 | 0.417 9 | 0.597 5 | 0.872 2 | 0.275 3 | 0.000 9 | 0.800 7 | 0.850 2 | 0.000 4 | 0.528 2 | 0.000 5 | 0.215 8 | 0.000 2 | 0.238 5 | 0.667 4 | 0.000 6 | 0.019 7 | 0.250 7 | 1.000 1 | 0.429 8 | 0.599 2 | 0.778 5 | 0.221 6 | 0.370 3 | 0.284 1 | 0.278 11 | 0.400 8 | 0.125 4 | 0.000 5 | 0.200 8 | 0.404 7 | 0.000 4 | 0.250 8 | 0.714 1 | 0.500 1 | 0.504 8 | 0.769 5 | 0.677 8 | 0.750 1 | 0.963 1 | 0.500 1 | 0.000 2 | 0.500 10 | 0.333 9 | 1.000 1 | 0.000 1 | 0.000 9 | 0.438 1 | 0.500 1 | 0.000 4 | 1.000 1 | 0.333 8 | 0.226 2 | 0.250 5 | 0.250 5 | 0.000 3 | 0.000 3 | 0.668 8 | 0.000 1 | 0.494 10 | 0.000 1 | 0.000 8 | 0.750 1 | 0.000 1 | 0.833 7 | 0.000 1 | 0.000 1 | 0.777 7 | 0.333 6 | 0.944 4 | 0.000 6 | 0.333 3 | 0.000 1 | 1.000 1 | 0.000 1 | 0.089 7 | 0.407 9 | 0.600 1 | 0.823 2 | 0.080 6 | 0.264 6 | 0.469 6 | 0.717 2 | 0.000 7 | 0.000 1 | 0.500 6 | 0.000 1 | 0.000 2 | 0.000 6 | 1.000 1 | 0.125 2 | 0.333 1 | 0.000 2 | 0.200 5 | 0.000 5 | 0.000 4 | 1.000 1 | 0.000 2 | |||||||||||||||||||||||||||||
| TD3D Scannet200 | 0.379 8 | 0.603 8 | 0.306 8 | 0.190 8 | 0.885 4 | 0.755 5 | 0.800 8 | 0.958 1 | 0.390 7 | 0.260 8 | 0.866 6 | 0.232 3 | 0.979 6 | 0.523 9 | 0.869 9 | 0.559 11 | 0.689 7 | 1.000 1 | 0.795 3 | 0.905 7 | 0.748 7 | 0.173 11 | 0.825 3 | 0.173 8 | 0.970 1 | 0.457 7 | 0.615 8 | 0.456 8 | 0.200 7 | 0.621 10 | 0.906 4 | 0.553 1 | 0.517 7 | 0.510 6 | 0.220 2 | 0.715 6 | 0.706 8 | 1.000 1 | 0.113 6 | 0.792 2 | 0.717 8 | 0.073 7 | 0.635 7 | 0.557 4 | 0.638 7 | 1.000 1 | 0.205 11 | 0.146 9 | 1.000 1 | 0.769 11 | 0.186 5 | 1.000 1 | 0.710 11 | 0.778 2 | 0.415 7 | 0.834 10 | 0.226 8 | 0.021 6 | 0.590 3 | 0.356 5 | 0.817 4 | 0.477 11 | 1.000 1 | 0.000 6 | 0.635 1 | 0.843 6 | 0.427 6 | 0.270 10 | 0.125 7 | 0.000 6 | 0.102 9 | 1.000 1 | 0.125 8 | 0.000 6 | 0.000 5 | 0.000 7 | 0.000 8 | 0.125 10 | 0.370 9 | 0.622 11 | 0.221 5 | 0.196 5 | 0.836 5 | 0.288 8 | 0.000 4 | 0.093 4 | 0.020 3 | 0.294 6 | 0.000 2 | 0.075 8 | 0.667 4 | 0.038 1 | 0.111 5 | 0.250 7 | 0.000 10 | 0.526 6 | 0.495 7 | 0.908 1 | 0.111 9 | 0.259 6 | 0.003 7 | 0.667 6 | 0.045 11 | 0.000 8 | 0.000 5 | 0.400 3 | 0.274 9 | 0.000 4 | 0.274 7 | 0.226 8 | 0.000 6 | 0.520 7 | 0.302 11 | 0.731 7 | 0.103 9 | 0.458 5 | 0.500 1 | 0.000 2 | 1.000 1 | 0.472 4 | 0.792 9 | 0.000 1 | 0.088 6 | 0.061 4 | 0.250 6 | 0.009 3 | 0.250 6 | 0.333 8 | 0.181 3 | 0.396 4 | 0.051 7 | 0.012 1 | 0.000 3 | 0.458 10 | 0.000 1 | 0.424 11 | 0.000 1 | 0.101 7 | 0.390 11 | 0.000 1 | 0.833 7 | 0.000 1 | 0.000 1 | 0.857 4 | 0.222 8 | 1.000 1 | 0.000 6 | 0.003 8 | 0.000 1 | 0.000 8 | 0.000 1 | 0.102 6 | 0.275 11 | 0.400 5 | 0.735 4 | 0.061 9 | 0.433 4 | 0.533 4 | 0.625 5 | 0.000 7 | 0.000 1 | 0.259 10 | 0.000 1 | 0.000 2 | 0.000 6 | 0.500 8 | 0.000 4 | 0.000 6 | 1.000 1 | 0.600 1 | 0.000 5 | 0.250 1 | 0.000 8 | 0.000 2 | |||||||||||||||||||||||||||||
| Maksim Kolodiazhnyi, Anna Vorontsova, Anton Konushin, Danila Rukhovich: Top-Down Beats Bottom-Up in 3D Instance Segmentation. WACV 2024 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Mask3D Scannet200 | 0.445 7 | 0.653 6 | 0.392 7 | 0.254 7 | 0.844 5 | 0.746 6 | 0.818 7 | 0.888 8 | 0.556 5 | 0.262 7 | 0.890 3 | 0.025 5 | 1.000 1 | 0.608 7 | 0.930 4 | 0.694 8 | 0.721 6 | 0.930 11 | 0.686 8 | 0.966 4 | 0.615 10 | 0.440 6 | 0.725 8 | 0.201 7 | 0.890 7 | 0.414 10 | 0.827 5 | 0.552 7 | 0.158 11 | 0.806 4 | 0.924 2 | 0.042 9 | 0.512 8 | 0.412 11 | 0.226 1 | 0.604 8 | 0.830 6 | 1.000 1 | 0.125 4 | 0.792 2 | 0.815 7 | 0.097 5 | 0.648 6 | 0.551 5 | 0.354 10 | 1.000 1 | 0.630 5 | 0.241 7 | 1.000 1 | 0.853 5 | 0.204 4 | 0.974 5 | 0.841 5 | 0.778 2 | 0.358 8 | 0.927 2 | 0.300 5 | 0.045 3 | 0.640 2 | 0.363 4 | 0.745 7 | 0.710 5 | 1.000 1 | 0.000 6 | 0.330 5 | 0.943 2 | 0.315 8 | 0.600 2 | 1.000 1 | 0.027 4 | 0.080 11 | 0.556 11 | 0.500 4 | 0.409 4 | 0.000 5 | 0.194 5 | 1.000 1 | 0.500 3 | 0.493 7 | 0.761 8 | 0.053 10 | 0.042 8 | 0.780 8 | 0.454 7 | 0.009 3 | 0.333 3 | 0.050 1 | 0.321 5 | 0.000 2 | 0.084 7 | 0.552 8 | 0.008 3 | 0.027 6 | 0.750 1 | 0.500 5 | 0.442 7 | 0.657 1 | 0.765 6 | 0.120 8 | 0.183 9 | 0.021 4 | 1.000 1 | 0.510 6 | 0.016 7 | 0.000 5 | 0.400 3 | 0.619 4 | 0.000 4 | 0.396 5 | 0.290 7 | 0.000 6 | 0.741 6 | 0.699 7 | 1.000 1 | 0.260 7 | 0.017 9 | 0.125 11 | 0.000 2 | 0.792 9 | 0.399 8 | 1.000 1 | 0.000 1 | 0.049 7 | 0.265 3 | 0.063 9 | 0.000 4 | 1.000 1 | 0.335 7 | 0.381 1 | 0.500 1 | 0.250 5 | 0.004 2 | 0.000 3 | 0.727 7 | 0.000 1 | 0.538 8 | 0.000 1 | 0.188 6 | 0.677 6 | 0.000 1 | 0.930 5 | 0.000 1 | 0.000 1 | 0.966 2 | 0.391 5 | 0.908 5 | 0.000 6 | 0.028 6 | 0.000 1 | 1.000 1 | 0.000 1 | 0.152 3 | 0.451 6 | 0.458 4 | 0.971 1 | 0.573 2 | 0.606 1 | 0.167 11 | 0.625 5 | 0.004 6 | 0.000 1 | 0.058 11 | 0.000 1 | 0.000 2 | 1.000 1 | 1.000 1 | 0.000 4 | 0.056 3 | 0.000 2 | 0.200 5 | 0.309 1 | 0.000 4 | 1.000 1 | 0.000 2 | |||||||||||||||||||||||||||||
| Jonas Schult, Francis Engelmann, Alexander Hermans, Or Litany, Siyu Tang, Bastian Leibe: Mask3D for 3D Semantic Instance Segmentation. ICRA 2023 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Minkowski 34D Inst. | 0.280 10 | 0.488 10 | 0.192 11 | 0.124 10 | 0.804 8 | 0.518 10 | 0.772 11 | 0.904 7 | 0.337 11 | 0.191 10 | 0.443 10 | 0.000 9 | 0.861 10 | 0.502 10 | 0.868 10 | 0.669 9 | 0.587 10 | 0.997 7 | 0.467 11 | 0.828 11 | 0.732 8 | 0.342 9 | 0.745 7 | 0.119 11 | 0.918 5 | 0.404 11 | 0.419 10 | 0.398 9 | 0.172 9 | 0.618 11 | 0.743 10 | 0.167 5 | 0.077 11 | 0.500 7 | 0.000 5 | 0.568 9 | 0.506 11 | 1.000 1 | 0.044 10 | 0.000 8 | 0.502 10 | 0.010 10 | 0.593 9 | 0.284 11 | 0.305 11 | 0.903 10 | 0.213 10 | 0.142 10 | 0.981 8 | 0.790 10 | 0.000 10 | 1.000 1 | 0.715 10 | 0.538 11 | 0.346 10 | 0.830 11 | 0.067 9 | 0.000 8 | 0.400 7 | 0.074 9 | 0.333 10 | 0.551 8 | 1.000 1 | 0.000 6 | 0.292 7 | 0.777 9 | 0.118 11 | 0.317 9 | 0.100 9 | 0.000 6 | 0.191 8 | 0.648 9 | 0.000 9 | 0.000 6 | 0.000 5 | 0.000 7 | 0.000 8 | 0.500 3 | 0.213 11 | 0.825 6 | 0.021 11 | 0.333 4 | 0.648 11 | 0.098 10 | 0.000 4 | 0.000 9 | 0.000 5 | 0.077 9 | 0.000 2 | 0.000 11 | 0.150 11 | 0.000 6 | 0.000 8 | 0.000 11 | 0.225 8 | 0.281 10 | 0.447 8 | 0.000 11 | 0.090 10 | 0.148 10 | 0.000 8 | 0.479 10 | 0.542 2 | 0.000 8 | 0.000 5 | 0.200 8 | 0.131 11 | 0.000 4 | 0.250 8 | 0.000 10 | 0.000 6 | 0.159 11 | 0.396 10 | 0.677 8 | 0.021 10 | 0.000 10 | 0.500 1 | 0.000 2 | 1.000 1 | 0.442 7 | 0.125 11 | 0.000 1 | 0.000 9 | 0.000 5 | 0.000 10 | 0.333 1 | 0.000 8 | 0.528 5 | 0.000 5 | 0.000 9 | 0.000 9 | 0.000 3 | 0.000 3 | 0.200 11 | 0.000 1 | 0.516 9 | 0.000 1 | 0.000 8 | 0.500 8 | 0.000 1 | 0.833 7 | 0.000 1 | 0.000 1 | 0.286 10 | 0.083 10 | 0.750 8 | 0.000 6 | 0.000 9 | 0.000 1 | 0.000 8 | 0.000 1 | 0.059 11 | 0.445 7 | 0.200 8 | 0.535 9 | 0.070 8 | 0.167 9 | 0.385 9 | 0.375 9 | 0.000 7 | 0.000 1 | 0.333 9 | 0.000 1 | 0.000 2 | 0.000 6 | 0.500 8 | 0.000 4 | 0.000 6 | 0.000 2 | 0.200 5 | 0.000 5 | 0.000 4 | 0.000 8 | 0.000 2 | |||||||||||||||||||||||||||||
| C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| CSC-Pretrain Inst. | 0.275 11 | 0.466 11 | 0.218 10 | 0.110 11 | 0.783 10 | 0.383 11 | 0.783 10 | 0.829 10 | 0.367 10 | 0.168 11 | 0.305 11 | 0.000 9 | 0.661 11 | 0.413 11 | 0.869 8 | 0.719 6 | 0.546 11 | 0.997 7 | 0.685 9 | 0.841 10 | 0.555 11 | 0.277 10 | 0.768 6 | 0.132 9 | 0.779 10 | 0.448 9 | 0.364 11 | 0.212 11 | 0.161 10 | 0.768 7 | 0.692 11 | 0.000 10 | 0.395 9 | 0.500 7 | 0.000 5 | 0.450 11 | 0.591 9 | 1.000 1 | 0.020 11 | 0.000 8 | 0.423 11 | 0.007 11 | 0.625 8 | 0.420 8 | 0.505 9 | 1.000 1 | 0.353 8 | 0.119 11 | 0.571 10 | 0.819 8 | 0.014 9 | 1.000 1 | 0.774 7 | 0.689 10 | 0.311 11 | 0.866 7 | 0.067 9 | 0.000 8 | 0.400 7 | 0.000 11 | 0.278 11 | 0.501 9 | 1.000 1 | 0.000 6 | 0.162 11 | 0.584 11 | 0.286 9 | 0.206 11 | 0.125 7 | 0.000 6 | 0.084 10 | 0.649 8 | 0.000 9 | 0.000 6 | 0.000 5 | 0.000 7 | 0.000 8 | 0.125 10 | 0.312 10 | 0.727 9 | 0.221 6 | 0.000 9 | 0.667 10 | 0.114 9 | 0.000 4 | 0.000 9 | 0.000 5 | 0.065 11 | 0.000 2 | 0.004 10 | 0.278 9 | 0.000 6 | 0.000 8 | 0.500 2 | 0.000 10 | 0.571 5 | 0.000 11 | 0.250 10 | 0.019 11 | 0.145 11 | 0.000 8 | 0.667 6 | 0.200 10 | 0.000 8 | 0.000 5 | 0.200 8 | 0.258 10 | 0.000 4 | 0.000 10 | 0.000 10 | 0.000 6 | 0.369 10 | 0.429 9 | 0.613 10 | 0.000 11 | 0.000 10 | 0.500 1 | 0.000 2 | 0.500 10 | 0.333 9 | 0.500 10 | 0.000 1 | 0.106 4 | 0.000 5 | 0.000 10 | 0.000 4 | 0.000 8 | 0.333 8 | 0.000 5 | 0.000 9 | 0.000 9 | 0.000 3 | 0.000 3 | 0.918 4 | 0.000 1 | 0.638 5 | 0.000 1 | 0.000 8 | 0.750 1 | 0.000 1 | 0.833 7 | 0.000 1 | 0.000 1 | 0.143 11 | 0.000 11 | 0.750 8 | 0.000 6 | 0.000 9 | 0.000 1 | 0.000 8 | 0.000 1 | 0.063 10 | 0.377 10 | 0.200 8 | 0.222 11 | 0.055 10 | 0.500 2 | 0.677 3 | 0.250 10 | 0.000 7 | 0.000 1 | 0.500 6 | 0.000 1 | 0.000 2 | 0.000 6 | 0.500 8 | 0.000 4 | 0.000 6 | 0.000 2 | 0.115 11 | 0.000 5 | 0.000 4 | 0.000 8 | 0.000 2 | |||||||||||||||||||||||||||||
| Ji Hou, Benjamin Graham, Matthias Nießner, Saining Xie: Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts. CVPR 2021 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| LGround Inst. | 0.314 9 | 0.529 9 | 0.225 9 | 0.155 9 | 0.810 7 | 0.625 9 | 0.798 9 | 0.940 4 | 0.372 9 | 0.217 9 | 0.484 9 | 0.000 9 | 0.927 9 | 0.528 8 | 0.826 11 | 0.694 7 | 0.605 9 | 1.000 1 | 0.731 5 | 0.846 9 | 0.716 9 | 0.350 8 | 0.589 11 | 0.123 10 | 0.857 8 | 0.457 8 | 0.578 9 | 0.376 10 | 0.183 8 | 0.765 8 | 0.800 9 | 0.000 10 | 0.278 10 | 0.500 7 | 0.000 5 | 0.659 7 | 0.569 10 | 1.000 1 | 0.093 7 | 0.000 8 | 0.539 9 | 0.010 9 | 0.578 11 | 0.378 10 | 0.571 8 | 1.000 1 | 0.337 9 | 0.252 6 | 0.530 11 | 0.814 9 | 0.000 10 | 0.744 7 | 0.743 9 | 0.746 7 | 0.346 9 | 0.863 8 | 0.067 9 | 0.000 8 | 0.400 7 | 0.167 8 | 0.667 8 | 0.488 10 | 1.000 1 | 0.000 6 | 0.208 10 | 0.783 8 | 0.166 10 | 0.375 7 | 0.071 10 | 0.000 6 | 0.200 7 | 0.607 10 | 0.000 9 | 0.000 6 | 0.000 5 | 0.000 7 | 1.000 1 | 0.500 3 | 0.517 6 | 0.716 10 | 0.221 6 | 0.000 9 | 0.706 9 | 0.085 11 | 0.000 4 | 0.000 9 | 0.000 5 | 0.077 10 | 0.000 2 | 0.063 9 | 0.278 9 | 0.000 6 | 0.000 8 | 0.500 2 | 0.083 9 | 0.181 11 | 0.515 5 | 0.286 9 | 0.144 7 | 0.219 8 | 0.042 2 | 0.582 8 | 0.400 8 | 0.000 8 | 0.000 5 | 0.000 11 | 0.305 8 | 0.000 4 | 0.000 10 | 0.036 9 | 0.000 6 | 0.413 9 | 0.500 8 | 0.533 11 | 0.250 8 | 0.200 7 | 0.500 1 | 0.000 2 | 1.000 1 | 0.472 4 | 1.000 1 | 0.000 1 | 0.000 9 | 0.000 5 | 0.250 6 | 0.000 4 | 0.000 8 | 0.333 8 | 0.000 5 | 0.000 9 | 0.000 9 | 0.000 3 | 0.000 3 | 0.600 9 | 0.000 1 | 0.594 6 | 0.000 1 | 0.000 8 | 0.500 8 | 0.000 1 | 0.647 11 | 0.000 1 | 0.000 1 | 0.429 9 | 0.333 6 | 0.500 11 | 0.000 6 | 0.000 9 | 0.000 1 | 0.000 8 | 0.000 1 | 0.069 9 | 0.696 5 | 0.050 11 | 0.556 7 | 0.031 11 | 0.042 11 | 0.750 2 | 0.250 10 | 0.000 7 | 0.000 1 | 0.630 5 | 0.000 1 | 0.000 2 | 0.000 6 | 0.500 8 | 0.000 4 | 0.000 6 | 0.000 2 | 0.400 2 | 0.000 5 | 0.000 4 | 0.000 8 | 0.000 2 | |||||||||||||||||||||||||||||
| David Rozenberszki, Or Litany, Angela Dai: Language-Grounded Indoor 3D Semantic Segmentation in the Wild. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
