ScanNet200 3D Semantic Instance Benchmark
The 3D semantic instance prediction task involves detecting and segmenting the object in an 3D scan mesh.
Evaluation and metricsSimilarly to the ScanNet benchmark in ScanNet200 our evaluation ranks all methods according to the average precision for each class. We report the mean average precision AP at overlap 0.25 (AP 25%), overlap 0.5 (AP 50%), and over overlaps in the range [0.5:0.95:0.05] (AP) for all 200 categories. Note that multiple predictions of the same ground truth instance are penalized as false positives.
This table lists the benchmark results for the ScanNet200 3D semantic instance scenario.
| Method | Info | avg ap 25% | head ap 25% | common ap 25% | tail ap 25% | alarm clock | armchair | backpack | bag | ball | bar | basket | bathroom cabinet | bathroom counter | bathroom stall | bathroom stall door | bathroom vanity | bathtub | bed | bench | bicycle | bin | blackboard | blanket | blinds | board | book | bookshelf | bottle | bowl | box | broom | bucket | bulletin board | cabinet | calendar | candle | cart | case of water bottles | cd case | ceiling | ceiling light | chair | clock | closet | closet door | closet rod | closet wall | clothes | clothes dryer | coat rack | coffee kettle | coffee maker | coffee table | column | computer tower | container | copier | couch | counter | crate | cup | curtain | cushion | decoration | desk | dining table | dish rack | dishwasher | divider | door | doorframe | dresser | dumbbell | dustpan | end table | fan | file cabinet | fire alarm | fire extinguisher | fireplace | folded chair | furniture | guitar | guitar case | hair dryer | handicap bar | hat | headphones | ironing board | jacket | keyboard | keyboard piano | kitchen cabinet | kitchen counter | ladder | lamp | laptop | laundry basket | laundry detergent | laundry hamper | ledge | light | light switch | luggage | machine | mailbox | mat | mattress | microwave | mini fridge | mirror | monitor | mouse | music stand | nightstand | object | office chair | ottoman | oven | paper | paper bag | paper cutter | paper towel dispenser | paper towel roll | person | piano | picture | pillar | pillow | pipe | plant | plate | plunger | poster | potted plant | power outlet | power strip | printer | projector | projector screen | purse | rack | radiator | rail | range hood | recycling bin | refrigerator | scale | seat | shelf | shoe | shower | shower curtain | shower curtain rod | shower door | shower floor | shower head | shower wall | sign | sink | soap dish | soap dispenser | sofa chair | speaker | stair rail | stairs | stand | stool | storage bin | storage container | storage organizer | stove | structure | stuffed animal | suitcase | table | telephone | tissue box | toaster | toaster oven | toilet | toilet paper | toilet paper dispenser | toilet paper holder | toilet seat cover dispenser | towel | trash bin | trash can | tray | tube | tv | tv stand | vacuum cleaner | vent | wardrobe | washing machine | water bottle | water cooler | water pitcher | whiteboard | window | windowsill |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Volt-SPFormer | 0.527 2 | 0.731 3 | 0.475 4 | 0.342 2 | 0.789 3 | 0.076 6 | 0.500 1 | 0.000 4 | 0.125 3 | 0.000 1 | 0.391 9 | 0.508 10 | 0.753 2 | 1.000 1 | 0.994 5 | 0.400 7 | 0.500 5 | 0.020 7 | 1.000 1 | 0.413 3 | 0.850 2 | 0.547 1 | 0.510 5 | 0.810 2 | 0.433 3 | 0.250 3 | 0.346 5 | 0.000 1 | 0.000 4 | 0.519 6 | 0.594 4 | 1.000 1 | 0.000 1 | 0.331 5 | 0.000 4 | 0.937 1 | 0.638 1 | 0.826 6 | 0.056 7 | 0.214 2 | 0.850 2 | 0.262 5 | 0.667 4 | 0.028 5 | 0.000 1 | 0.817 3 | 0.825 2 | 0.250 7 | 0.880 5 | 1.000 1 | 0.950 2 | 0.279 2 | 0.309 5 | 0.856 3 | 0.000 5 | 0.304 3 | 0.867 5 | 0.000 8 | 0.750 1 | 0.542 2 | 0.942 1 | 0.818 4 | 0.901 1 | 0.458 7 | 0.329 1 | 0.750 1 | 0.855 5 | 0.000 5 | 0.510 4 | 0.200 5 | 0.000 2 | 0.677 2 | 0.500 1 | 0.397 2 | 0.903 2 | 1.000 1 | 0.843 3 | 0.773 4 | 1.000 1 | 0.799 2 | 0.449 5 | 0.250 1 | 0.000 1 | 0.600 1 | 0.027 8 | 0.372 4 | 0.000 5 | 1.000 1 | 0.833 7 | 0.400 3 | 0.878 3 | 0.656 5 | 0.843 2 | 0.973 3 | 0.000 5 | 0.000 1 | 0.921 3 | 0.103 5 | 0.008 6 | 0.500 4 | 0.057 3 | 0.278 4 | 1.000 1 | 0.802 5 | 0.557 2 | 0.700 1 | 1.000 1 | 0.874 3 | 0.767 3 | 0.279 4 | 0.801 4 | 0.047 6 | 0.714 2 | 0.000 2 | 0.500 1 | 0.250 1 | 0.907 2 | 0.000 3 | 1.000 1 | 0.011 3 | 0.875 1 | 0.944 4 | 0.255 4 | 0.923 4 | 1.000 1 | 0.002 5 | 0.321 5 | 0.579 5 | 1.000 1 | 1.000 1 | 1.000 1 | 1.000 1 | 1.000 1 | 0.737 7 | 0.000 3 | 0.926 6 | 0.857 2 | 0.343 4 | 0.000 8 | 0.741 1 | 0.629 11 | 0.025 2 | 0.500 7 | 0.000 8 | 0.000 4 | 0.000 2 | 0.725 8 | 0.000 2 | 0.000 1 | 0.715 2 | 0.803 3 | 0.738 5 | 1.000 1 | 0.500 4 | 1.000 1 | 0.565 3 | 0.884 4 | 0.812 4 | 0.167 9 | 0.937 1 | 0.000 1 | 0.019 4 | 0.923 1 | 1.000 1 | 1.000 1 | 0.000 1 | 0.099 7 | 1.000 1 | 0.000 1 | 0.472 4 | 0.764 2 | 0.614 6 | 0.815 4 | 0.681 3 | |||||||||||||||||||||||||||||
| Kadir Yilmaz, Adrian Kruse, Tristan Höfer, Daan de Geus, Bastian Leibe: Volume Transformer: Revisiting Vanilla Transformers for 3D Scene Understanding. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| ODIN - Ins200 | 0.451 6 | 0.637 7 | 0.407 5 | 0.277 6 | 0.583 10 | 0.116 4 | 0.500 1 | 0.000 4 | 0.125 3 | 0.000 1 | 0.599 2 | 0.823 2 | 0.407 9 | 0.667 11 | 0.941 8 | 0.542 5 | 1.000 1 | 0.000 8 | 1.000 1 | 0.162 8 | 0.000 6 | 0.028 10 | 0.357 7 | 0.695 7 | 0.550 1 | 0.000 6 | 0.475 2 | 0.000 1 | 0.000 4 | 0.714 1 | 0.626 3 | 1.000 1 | 0.000 1 | 0.500 1 | 0.125 2 | 0.749 7 | 0.080 6 | 0.742 11 | 0.528 2 | 0.078 8 | 0.500 6 | 0.334 3 | 0.667 4 | 0.333 1 | 0.000 1 | 0.278 11 | 0.723 9 | 0.250 7 | 0.859 9 | 1.000 1 | 0.826 11 | 0.108 7 | 0.221 6 | 0.763 5 | 0.000 5 | 0.250 5 | 0.742 8 | 0.500 5 | 0.750 1 | 0.400 8 | 0.855 6 | 0.769 5 | 0.701 5 | 0.469 6 | 0.203 3 | 0.406 7 | 0.870 4 | 0.000 5 | 0.963 1 | 0.200 5 | 0.000 2 | 0.000 8 | 0.500 1 | 0.370 3 | 0.886 5 | 1.000 1 | 0.782 7 | 0.504 8 | 0.429 8 | 0.494 6 | 0.337 8 | 0.000 2 | 0.000 1 | 0.600 1 | 0.000 9 | 0.215 8 | 0.226 2 | 0.000 5 | 0.944 4 | 0.200 8 | 0.887 2 | 0.750 1 | 0.874 1 | 0.877 8 | 0.438 1 | 0.000 1 | 0.867 6 | 0.089 7 | 0.003 7 | 0.500 4 | 0.000 6 | 0.333 3 | 1.000 1 | 0.742 7 | 0.125 4 | 0.671 3 | 0.417 9 | 0.616 10 | 0.637 6 | 0.238 5 | 0.873 3 | 0.528 2 | 0.494 10 | 0.000 2 | 0.250 5 | 0.000 4 | 0.688 5 | 0.000 3 | 1.000 1 | 0.000 5 | 0.872 2 | 0.833 7 | 0.275 3 | 0.779 10 | 1.000 1 | 0.000 6 | 0.441 3 | 0.577 6 | 0.167 5 | 1.000 1 | 0.500 10 | 0.777 7 | 0.000 6 | 0.778 5 | 0.000 3 | 0.910 7 | 0.800 7 | 0.232 9 | 0.019 7 | 0.717 2 | 0.833 6 | 0.000 5 | 0.638 2 | 0.284 1 | 0.000 4 | 0.000 2 | 0.778 2 | 0.000 2 | 0.000 1 | 0.597 5 | 0.699 8 | 0.850 2 | 0.333 8 | 0.250 8 | 0.944 9 | 0.571 2 | 0.677 8 | 0.795 5 | 0.264 6 | 0.852 6 | 0.000 1 | 0.000 7 | 0.824 3 | 1.000 1 | 0.668 8 | 0.000 1 | 0.000 9 | 0.667 8 | 0.000 1 | 0.333 9 | 0.333 6 | 0.760 1 | 0.679 8 | 0.404 7 | |||||||||||||||||||||||||||||
| AQ3D-ScanNet200 | 0.527 3 | 0.743 1 | 0.477 3 | 0.324 4 | 0.862 2 | 0.161 3 | 0.500 1 | 0.500 1 | 0.833 1 | 0.000 1 | 0.513 6 | 0.556 7 | 0.873 1 | 1.000 1 | 0.955 7 | 0.567 4 | 1.000 1 | 0.025 5 | 0.533 6 | 0.435 1 | 0.333 5 | 0.458 3 | 0.556 1 | 0.754 4 | 0.279 6 | 0.167 5 | 0.396 3 | 0.000 1 | 0.083 1 | 0.607 3 | 0.631 1 | 0.250 7 | 0.000 1 | 0.500 1 | 0.000 4 | 0.901 3 | 0.073 7 | 0.930 1 | 0.009 8 | 0.113 7 | 0.803 3 | 0.360 2 | 0.667 4 | 0.056 3 | 0.000 1 | 0.489 9 | 0.805 5 | 0.250 7 | 0.938 1 | 1.000 1 | 0.947 3 | 0.087 8 | 0.368 3 | 0.858 1 | 0.160 3 | 0.026 8 | 0.893 2 | 0.023 7 | 0.750 1 | 0.600 1 | 0.886 4 | 0.843 2 | 0.778 2 | 0.458 7 | 0.089 8 | 0.479 5 | 0.991 1 | 0.143 3 | 0.318 6 | 0.200 5 | 0.000 2 | 0.621 5 | 0.500 1 | 0.366 4 | 0.895 4 | 1.000 1 | 0.839 4 | 0.837 2 | 0.738 4 | 0.707 3 | 0.434 6 | 0.000 2 | 0.000 1 | 0.517 3 | 0.105 5 | 0.465 1 | 0.000 5 | 0.563 2 | 1.000 1 | 0.400 3 | 0.831 6 | 0.658 4 | 0.750 4 | 0.960 5 | 0.000 5 | 0.000 1 | 0.896 5 | 0.088 8 | 0.328 2 | 1.000 1 | 0.071 2 | 0.667 1 | 1.000 1 | 0.868 2 | 0.083 6 | 0.428 5 | 1.000 1 | 0.925 2 | 0.795 2 | 0.337 2 | 0.879 2 | 0.000 7 | 0.714 2 | 0.000 2 | 0.141 8 | 0.000 4 | 0.667 6 | 0.000 3 | 1.000 1 | 0.281 1 | 0.838 5 | 1.000 1 | 0.534 2 | 0.929 3 | 1.000 1 | 0.030 2 | 0.410 4 | 0.602 4 | 1.000 1 | 1.000 1 | 1.000 1 | 0.714 8 | 1.000 1 | 0.712 8 | 0.000 3 | 0.926 5 | 0.819 6 | 0.392 3 | 0.172 3 | 0.707 3 | 1.000 1 | 0.000 5 | 0.576 3 | 0.016 5 | 0.000 4 | 0.000 2 | 0.778 2 | 0.000 2 | 0.000 1 | 0.671 4 | 0.784 4 | 0.768 3 | 1.000 1 | 0.736 2 | 1.000 1 | 0.549 6 | 1.000 1 | 0.835 3 | 0.434 3 | 0.935 2 | 0.000 1 | 0.083 2 | 0.764 9 | 1.000 1 | 1.000 1 | 0.000 1 | 0.664 1 | 1.000 1 | 0.000 1 | 0.333 9 | 0.667 3 | 0.546 7 | 0.816 3 | 0.923 1 | |||||||||||||||||||||||||||||
| ACGP-ScanNet200 | 0.544 1 | 0.737 2 | 0.483 2 | 0.381 1 | 0.747 4 | 0.184 2 | 0.500 1 | 0.500 1 | 0.708 2 | 0.000 1 | 0.371 10 | 0.604 6 | 0.718 4 | 1.000 1 | 0.996 4 | 0.511 6 | 1.000 1 | 0.035 4 | 1.000 1 | 0.388 4 | 0.528 3 | 0.307 6 | 0.517 4 | 0.834 1 | 0.405 4 | 1.000 1 | 0.396 4 | 0.000 1 | 0.042 2 | 0.540 5 | 0.536 6 | 1.000 1 | 0.000 1 | 0.500 1 | 0.050 3 | 0.918 2 | 0.189 5 | 0.801 9 | 0.086 5 | 0.140 6 | 0.667 4 | 0.292 4 | 1.000 1 | 0.000 6 | 0.000 1 | 0.903 2 | 0.838 1 | 0.444 6 | 0.902 3 | 1.000 1 | 0.912 5 | 0.213 4 | 0.367 4 | 0.858 2 | 0.000 5 | 0.396 2 | 0.846 7 | 1.000 1 | 0.677 6 | 0.443 7 | 0.921 2 | 0.905 1 | 0.573 6 | 0.500 5 | 0.064 9 | 0.658 3 | 0.931 3 | 0.144 2 | 0.637 2 | 0.317 4 | 0.000 2 | 0.638 4 | 0.000 6 | 0.462 1 | 0.897 3 | 1.000 1 | 0.860 2 | 0.944 1 | 0.759 3 | 0.682 4 | 0.510 3 | 0.000 2 | 0.000 1 | 0.391 6 | 0.140 3 | 0.462 2 | 0.143 4 | 0.250 3 | 0.884 6 | 0.600 2 | 0.851 4 | 0.677 3 | 0.680 7 | 0.993 1 | 0.000 5 | 0.000 1 | 0.825 8 | 0.185 1 | 0.036 4 | 1.000 1 | 0.089 1 | 0.472 2 | 1.000 1 | 0.765 6 | 0.500 3 | 0.671 3 | 0.500 3 | 0.929 1 | 0.699 5 | 0.349 1 | 0.738 5 | 0.204 4 | 0.782 1 | 0.008 1 | 0.146 7 | 0.024 3 | 0.835 3 | 0.000 3 | 0.250 7 | 0.006 4 | 0.854 3 | 0.974 2 | 0.590 1 | 0.968 2 | 1.000 1 | 0.007 4 | 0.483 1 | 0.666 2 | 1.000 1 | 1.000 1 | 1.000 1 | 0.959 3 | 1.000 1 | 0.867 3 | 0.000 3 | 0.955 3 | 0.850 3 | 0.403 2 | 0.341 2 | 0.637 4 | 0.721 8 | 0.000 5 | 0.552 4 | 0.000 8 | 0.000 4 | 0.000 2 | 0.778 2 | 0.000 2 | 0.000 1 | 0.759 1 | 0.859 1 | 0.767 4 | 1.000 1 | 0.944 1 | 1.000 1 | 0.424 7 | 0.944 3 | 0.840 2 | 0.206 8 | 0.915 3 | 0.000 1 | 0.064 3 | 0.800 6 | 1.000 1 | 1.000 1 | 0.000 1 | 0.461 3 | 0.903 3 | 0.000 1 | 0.507 3 | 0.903 1 | 0.718 2 | 0.842 2 | 0.809 2 | |||||||||||||||||||||||||||||
| Rongkun Yang, Ye Zhang, Longguang Wang, Zhiheng Fu, Lian Xu, Yulan Guo: Beyond Context Bias: Adaptive Instance Placement for Robust 3D Instance Segmentation. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| TD3D Scannet200 | 0.379 8 | 0.603 8 | 0.306 8 | 0.190 8 | 0.635 7 | 0.073 7 | 0.500 1 | 0.000 4 | 0.000 6 | 0.000 1 | 0.495 7 | 0.735 4 | 0.275 11 | 1.000 1 | 0.979 6 | 0.590 3 | 0.000 10 | 0.021 6 | 0.000 8 | 0.146 9 | 0.000 6 | 0.356 5 | 0.173 11 | 0.795 3 | 0.226 8 | 0.000 6 | 0.173 8 | 0.000 1 | 0.000 4 | 0.226 8 | 0.390 7 | 0.000 8 | 0.000 1 | 0.250 6 | 0.000 4 | 0.706 8 | 0.061 9 | 0.885 4 | 0.093 4 | 0.186 5 | 0.259 10 | 0.200 7 | 0.667 4 | 0.000 6 | 0.000 1 | 0.667 6 | 0.825 3 | 0.250 7 | 0.834 10 | 1.000 1 | 0.958 1 | 0.553 1 | 0.111 9 | 0.748 7 | 0.220 2 | 0.051 7 | 0.866 6 | 0.792 2 | 0.390 11 | 0.045 11 | 0.800 8 | 0.302 11 | 0.517 7 | 0.533 4 | 0.113 6 | 0.427 6 | 0.843 6 | 0.000 5 | 0.458 5 | 0.600 1 | 0.000 2 | 0.101 7 | 0.000 6 | 0.259 6 | 0.717 8 | 0.500 8 | 0.615 8 | 0.520 7 | 0.526 6 | 0.457 7 | 0.270 10 | 0.000 2 | 0.000 1 | 0.400 5 | 0.088 6 | 0.294 6 | 0.181 3 | 0.000 5 | 1.000 1 | 0.400 3 | 0.710 11 | 0.103 9 | 0.477 11 | 0.905 7 | 0.061 4 | 0.000 1 | 0.906 4 | 0.102 6 | 0.232 3 | 0.125 8 | 0.000 6 | 0.003 8 | 0.792 9 | 1.000 1 | 0.000 8 | 0.102 9 | 0.125 10 | 0.559 11 | 0.523 9 | 0.075 8 | 0.715 6 | 0.000 7 | 0.424 11 | 0.000 2 | 0.396 4 | 0.250 1 | 0.638 7 | 0.000 3 | 0.000 8 | 0.000 5 | 0.622 11 | 0.833 7 | 0.221 5 | 0.970 1 | 0.250 6 | 0.038 1 | 0.260 8 | 0.415 7 | 0.125 7 | 1.000 1 | 1.000 1 | 0.857 4 | 0.000 6 | 0.908 1 | 0.012 1 | 0.869 9 | 0.836 5 | 0.635 1 | 0.111 5 | 0.625 5 | 1.000 1 | 0.020 3 | 0.510 6 | 0.003 7 | 0.009 3 | 1.000 1 | 0.778 2 | 0.000 2 | 0.000 1 | 0.370 9 | 0.755 5 | 0.288 8 | 0.333 8 | 0.274 7 | 1.000 1 | 0.557 4 | 0.731 7 | 0.456 8 | 0.433 4 | 0.769 11 | 0.000 1 | 0.000 7 | 0.621 10 | 1.000 1 | 0.458 10 | 0.000 1 | 0.196 5 | 0.817 4 | 0.000 1 | 0.472 4 | 0.222 8 | 0.205 11 | 0.689 7 | 0.274 9 | |||||||||||||||||||||||||||||
| Maksim Kolodiazhnyi, Anna Vorontsova, Anton Konushin, Danila Rukhovich: Top-Down Beats Bottom-Up in 3D Instance Segmentation. WACV 2024 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Mask3D Scannet200 | 0.445 7 | 0.653 6 | 0.392 7 | 0.254 7 | 0.648 6 | 0.097 5 | 0.125 11 | 0.000 4 | 0.000 6 | 0.000 1 | 0.657 1 | 0.971 1 | 0.451 6 | 1.000 1 | 1.000 1 | 0.640 2 | 0.500 5 | 0.045 3 | 1.000 1 | 0.241 7 | 0.409 4 | 0.363 4 | 0.440 6 | 0.686 8 | 0.300 5 | 0.000 6 | 0.201 7 | 0.000 1 | 0.009 3 | 0.290 7 | 0.556 5 | 1.000 1 | 0.000 1 | 0.063 9 | 0.000 4 | 0.830 6 | 0.573 2 | 0.844 5 | 0.333 3 | 0.204 4 | 0.058 11 | 0.158 11 | 0.552 8 | 0.056 3 | 0.000 1 | 1.000 1 | 0.725 8 | 0.750 1 | 0.927 2 | 1.000 1 | 0.888 8 | 0.042 9 | 0.120 8 | 0.615 10 | 0.226 1 | 0.250 5 | 0.890 3 | 0.792 2 | 0.677 6 | 0.510 6 | 0.818 7 | 0.699 7 | 0.512 8 | 0.167 11 | 0.125 4 | 0.315 8 | 0.943 2 | 0.309 1 | 0.017 9 | 0.200 5 | 0.000 2 | 0.188 6 | 0.000 6 | 0.183 9 | 0.815 7 | 1.000 1 | 0.827 5 | 0.741 6 | 0.442 7 | 0.414 10 | 0.600 2 | 0.000 2 | 0.000 1 | 0.458 4 | 0.049 7 | 0.321 5 | 0.381 1 | 0.000 5 | 0.908 5 | 0.400 3 | 0.841 5 | 0.260 7 | 0.710 5 | 0.966 4 | 0.265 3 | 0.000 1 | 0.924 2 | 0.152 3 | 0.025 5 | 0.500 4 | 0.027 4 | 0.028 6 | 1.000 1 | 0.556 11 | 0.016 7 | 0.080 11 | 0.500 3 | 0.694 8 | 0.608 7 | 0.084 7 | 0.604 8 | 0.194 5 | 0.538 8 | 0.000 2 | 0.500 1 | 0.000 4 | 0.354 10 | 0.000 3 | 1.000 1 | 0.000 5 | 0.761 8 | 0.930 5 | 0.053 10 | 0.890 7 | 1.000 1 | 0.008 3 | 0.262 7 | 0.358 8 | 1.000 1 | 1.000 1 | 0.792 9 | 0.966 2 | 1.000 1 | 0.765 6 | 0.004 2 | 0.930 4 | 0.780 8 | 0.330 5 | 0.027 6 | 0.625 5 | 0.974 5 | 0.050 1 | 0.412 11 | 0.021 4 | 0.000 4 | 0.000 2 | 0.778 2 | 0.000 2 | 0.000 1 | 0.493 7 | 0.746 6 | 0.454 7 | 0.335 7 | 0.396 5 | 0.930 11 | 0.551 5 | 1.000 1 | 0.552 7 | 0.606 1 | 0.853 5 | 0.000 1 | 0.004 6 | 0.806 4 | 1.000 1 | 0.727 7 | 0.000 1 | 0.042 8 | 0.745 7 | 0.000 1 | 0.399 8 | 0.391 5 | 0.630 5 | 0.721 6 | 0.619 4 | |||||||||||||||||||||||||||||
| Jonas Schult, Francis Engelmann, Alexander Hermans, Or Litany, Siyu Tang, Bastian Leibe: Mask3D for 3D Semantic Instance Segmentation. ICRA 2023 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| CompetitorFormer-200 | 0.469 5 | 0.676 5 | 0.401 6 | 0.296 5 | 0.692 5 | 0.057 8 | 0.500 1 | 0.083 3 | 0.000 6 | 0.000 1 | 0.534 4 | 0.701 5 | 0.410 8 | 0.903 10 | 0.998 3 | 0.878 1 | 0.500 5 | 0.068 1 | 0.250 7 | 0.424 2 | 1.000 1 | 0.244 7 | 0.556 2 | 0.696 6 | 0.270 7 | 1.000 1 | 0.240 6 | 0.000 1 | 0.000 4 | 0.587 4 | 0.380 8 | 1.000 1 | 0.000 1 | 0.500 1 | 0.000 4 | 0.900 4 | 0.257 4 | 0.901 2 | 0.085 6 | 0.207 3 | 0.863 1 | 0.224 6 | 1.000 1 | 0.109 2 | 0.000 1 | 0.724 5 | 0.806 4 | 0.500 2 | 0.869 6 | 1.000 1 | 0.829 9 | 0.247 3 | 0.474 1 | 0.759 6 | 0.021 4 | 0.269 4 | 0.873 4 | 0.125 6 | 0.467 10 | 0.542 2 | 0.885 5 | 0.829 3 | 0.711 4 | 0.285 10 | 0.118 5 | 0.482 4 | 0.770 10 | 0.025 4 | 0.018 8 | 0.400 2 | 0.000 2 | 0.677 2 | 0.500 1 | 0.222 7 | 0.916 1 | 1.000 1 | 0.818 6 | 0.827 3 | 0.342 9 | 0.650 5 | 0.452 4 | 0.000 2 | 0.000 1 | 0.330 7 | 0.173 2 | 0.278 7 | 0.000 5 | 0.083 4 | 1.000 1 | 0.336 7 | 0.748 8 | 0.508 6 | 0.698 6 | 0.989 2 | 0.286 2 | 0.000 1 | 0.933 1 | 0.175 2 | 0.400 1 | 0.663 3 | 0.015 5 | 0.103 5 | 1.000 1 | 0.829 3 | 0.125 4 | 0.293 6 | 0.500 3 | 0.847 5 | 0.711 4 | 0.295 3 | 0.543 10 | 0.385 3 | 0.581 7 | 0.000 2 | 0.500 1 | 0.000 4 | 0.747 4 | 0.050 2 | 1.000 1 | 0.013 2 | 0.850 4 | 0.886 6 | 0.214 8 | 0.918 5 | 0.125 7 | 0.000 6 | 0.320 6 | 0.610 3 | 0.025 11 | 0.933 9 | 1.000 1 | 0.820 6 | 0.250 5 | 0.901 2 | 0.000 3 | 0.980 1 | 0.878 1 | 0.325 6 | 0.160 4 | 0.574 7 | 0.703 9 | 0.009 4 | 0.540 5 | 0.011 6 | 0.000 4 | 0.000 2 | 0.700 9 | 0.056 1 | 0.000 1 | 0.491 8 | 0.729 7 | 0.617 6 | 0.489 6 | 0.565 3 | 1.000 1 | 0.410 9 | 0.750 6 | 0.629 6 | 0.292 5 | 0.839 7 | 0.000 1 | 0.157 1 | 0.839 2 | 1.000 1 | 0.834 6 | 0.000 1 | 0.131 6 | 0.794 5 | 0.000 1 | 0.667 1 | 0.144 9 | 0.664 3 | 0.854 1 | 0.500 6 | |||||||||||||||||||||||||||||
| DINO3D-Scannet200 | 0.511 4 | 0.685 4 | 0.484 1 | 0.331 3 | 0.864 1 | 0.220 1 | 0.500 1 | 0.000 4 | 0.042 5 | 0.000 1 | 0.576 3 | 0.746 3 | 0.744 3 | 1.000 1 | 1.000 1 | 0.355 11 | 1.000 1 | 0.048 2 | 0.000 8 | 0.327 5 | 0.000 6 | 0.494 2 | 0.532 3 | 0.596 10 | 0.496 2 | 0.250 3 | 0.481 1 | 0.000 1 | 0.000 4 | 0.714 1 | 0.629 2 | 1.000 1 | 0.000 1 | 0.250 6 | 0.663 1 | 0.861 5 | 0.436 3 | 0.892 3 | 0.667 1 | 0.244 1 | 0.385 8 | 0.421 1 | 1.000 1 | 0.000 6 | 0.000 1 | 0.764 4 | 0.719 10 | 0.500 2 | 0.889 4 | 1.000 1 | 0.907 6 | 0.111 6 | 0.378 2 | 0.778 4 | 0.000 5 | 0.595 1 | 0.905 1 | 0.708 4 | 0.750 1 | 0.542 2 | 0.890 3 | 0.754 6 | 0.761 3 | 0.798 1 | 0.220 2 | 0.683 2 | 0.817 7 | 0.000 5 | 0.600 3 | 0.200 5 | 0.500 1 | 0.944 1 | 0.125 5 | 0.334 5 | 0.856 6 | 0.792 7 | 0.873 1 | 0.756 5 | 0.777 2 | 0.803 1 | 0.675 1 | 0.000 2 | 0.000 1 | 0.200 8 | 0.298 1 | 0.412 3 | 0.000 5 | 0.000 5 | 0.719 10 | 0.800 1 | 0.923 1 | 0.750 1 | 0.798 3 | 0.960 6 | 0.000 5 | 0.000 1 | 0.856 7 | 0.142 4 | 0.001 8 | 0.417 7 | 0.000 6 | 0.014 7 | 1.000 1 | 0.824 4 | 0.559 1 | 0.700 1 | 0.500 3 | 0.863 4 | 0.816 1 | 0.163 6 | 0.944 1 | 0.764 1 | 0.714 2 | 0.000 2 | 0.250 5 | 0.000 4 | 1.000 1 | 0.063 1 | 1.000 1 | 0.000 5 | 0.789 7 | 0.974 2 | 0.079 9 | 0.851 9 | 0.000 8 | 0.000 6 | 0.468 2 | 0.702 1 | 0.167 5 | 1.000 1 | 1.000 1 | 0.857 4 | 0.000 6 | 0.867 4 | 0.000 3 | 0.968 2 | 0.845 4 | 0.264 8 | 0.419 1 | 0.500 8 | 0.667 10 | 0.000 5 | 0.677 1 | 0.028 3 | 0.194 2 | 0.000 2 | 0.857 1 | 0.000 2 | 0.000 1 | 0.699 3 | 0.821 2 | 0.930 1 | 0.850 4 | 0.346 6 | 0.944 9 | 0.579 1 | 0.866 5 | 0.850 1 | 0.221 7 | 0.911 4 | 0.000 1 | 0.011 5 | 0.806 5 | 0.764 11 | 0.860 5 | 0.000 1 | 0.472 2 | 0.794 5 | 0.000 1 | 0.667 1 | 0.655 4 | 0.655 4 | 0.811 5 | 0.528 5 | |||||||||||||||||||||||||||||
| Jinyuan Qu, Hongyang Li, Xingyu Chen, Shilong Liu, Yukai Shi, Tianhe Ren, Ruitao Jing and Lei Zhang: SegDINO3D: 3D Instance Segmentation Empowered by Both Image-Level and Object-Level 2D Features. AAAI 2026 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| Minkowski 34D Inst. | 0.280 10 | 0.488 10 | 0.192 11 | 0.124 10 | 0.593 9 | 0.010 10 | 0.500 1 | 0.000 4 | 0.000 6 | 0.000 1 | 0.447 8 | 0.535 9 | 0.445 7 | 1.000 1 | 0.861 10 | 0.400 7 | 0.225 8 | 0.000 8 | 0.000 8 | 0.142 10 | 0.000 6 | 0.074 9 | 0.342 9 | 0.467 11 | 0.067 9 | 0.000 6 | 0.119 11 | 0.000 1 | 0.000 4 | 0.000 10 | 0.337 11 | 0.000 8 | 0.000 1 | 0.000 10 | 0.000 4 | 0.506 11 | 0.070 8 | 0.804 8 | 0.000 9 | 0.000 10 | 0.333 9 | 0.172 9 | 0.150 11 | 0.000 6 | 0.000 1 | 0.479 10 | 0.745 7 | 0.000 11 | 0.830 11 | 1.000 1 | 0.904 7 | 0.167 5 | 0.090 10 | 0.732 8 | 0.000 5 | 0.000 9 | 0.443 10 | 0.000 8 | 0.500 8 | 0.542 2 | 0.772 11 | 0.396 10 | 0.077 11 | 0.385 9 | 0.044 10 | 0.118 11 | 0.777 9 | 0.000 5 | 0.000 10 | 0.200 5 | 0.000 2 | 0.000 8 | 0.000 6 | 0.148 10 | 0.502 10 | 0.500 8 | 0.419 10 | 0.159 11 | 0.281 10 | 0.404 11 | 0.317 9 | 0.000 2 | 0.000 1 | 0.200 8 | 0.000 9 | 0.077 9 | 0.000 5 | 0.000 5 | 0.750 8 | 0.200 8 | 0.715 10 | 0.021 10 | 0.551 8 | 0.828 11 | 0.000 5 | 0.000 1 | 0.743 10 | 0.059 11 | 0.000 9 | 0.000 9 | 0.000 6 | 0.000 9 | 0.125 11 | 0.648 9 | 0.000 8 | 0.191 8 | 0.500 3 | 0.669 9 | 0.502 10 | 0.000 11 | 0.568 9 | 0.000 7 | 0.516 9 | 0.000 2 | 0.000 9 | 0.000 4 | 0.305 11 | 0.000 3 | 0.000 8 | 0.000 5 | 0.825 6 | 0.833 7 | 0.021 11 | 0.918 5 | 0.000 8 | 0.000 6 | 0.191 10 | 0.346 10 | 0.100 9 | 0.981 8 | 1.000 1 | 0.286 10 | 0.000 6 | 0.000 11 | 0.000 3 | 0.868 10 | 0.648 11 | 0.292 7 | 0.000 8 | 0.375 9 | 1.000 1 | 0.000 5 | 0.500 7 | 0.000 8 | 0.333 1 | 0.000 2 | 0.538 11 | 0.000 2 | 0.000 1 | 0.213 11 | 0.518 10 | 0.098 10 | 0.528 5 | 0.250 8 | 0.997 7 | 0.284 11 | 0.677 8 | 0.398 9 | 0.167 9 | 0.790 10 | 0.000 1 | 0.000 7 | 0.618 11 | 0.903 10 | 0.200 11 | 0.000 1 | 0.333 4 | 0.333 10 | 0.000 1 | 0.442 7 | 0.083 10 | 0.213 10 | 0.587 10 | 0.131 11 | |||||||||||||||||||||||||||||
| C. Choy, J. Gwak, S. Savarese: 4D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networks. CVPR 2019 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| CSC-Pretrain Inst. | 0.275 11 | 0.466 11 | 0.218 10 | 0.110 11 | 0.625 8 | 0.007 11 | 0.500 1 | 0.000 4 | 0.000 6 | 0.000 1 | 0.000 11 | 0.222 11 | 0.377 10 | 1.000 1 | 0.661 11 | 0.400 7 | 0.000 10 | 0.000 8 | 0.000 8 | 0.119 11 | 0.000 6 | 0.000 11 | 0.277 10 | 0.685 9 | 0.067 9 | 0.000 6 | 0.132 9 | 0.000 1 | 0.000 4 | 0.000 10 | 0.367 10 | 0.000 8 | 0.000 1 | 0.000 10 | 0.000 4 | 0.591 9 | 0.055 10 | 0.783 10 | 0.000 9 | 0.014 9 | 0.500 6 | 0.161 10 | 0.278 9 | 0.000 6 | 0.000 1 | 0.667 6 | 0.768 6 | 0.500 2 | 0.866 7 | 1.000 1 | 0.829 10 | 0.000 10 | 0.019 11 | 0.555 11 | 0.000 5 | 0.000 9 | 0.305 11 | 0.000 8 | 0.750 1 | 0.200 10 | 0.783 10 | 0.429 9 | 0.395 9 | 0.677 3 | 0.020 11 | 0.286 9 | 0.584 11 | 0.000 5 | 0.000 10 | 0.115 11 | 0.000 2 | 0.000 8 | 0.000 6 | 0.145 11 | 0.423 11 | 0.500 8 | 0.364 11 | 0.369 10 | 0.571 5 | 0.448 9 | 0.206 11 | 0.000 2 | 0.000 1 | 0.200 8 | 0.106 4 | 0.065 11 | 0.000 5 | 0.000 5 | 0.750 8 | 0.200 8 | 0.774 7 | 0.000 11 | 0.501 9 | 0.841 10 | 0.000 5 | 0.000 1 | 0.692 11 | 0.063 10 | 0.000 9 | 0.000 9 | 0.000 6 | 0.000 9 | 0.500 10 | 0.649 8 | 0.000 8 | 0.084 10 | 0.125 10 | 0.719 6 | 0.413 11 | 0.004 10 | 0.450 11 | 0.000 7 | 0.638 5 | 0.000 2 | 0.000 9 | 0.000 4 | 0.505 9 | 0.000 3 | 0.000 8 | 0.000 5 | 0.727 9 | 0.833 7 | 0.221 6 | 0.779 10 | 0.000 8 | 0.000 6 | 0.168 11 | 0.311 11 | 0.125 7 | 0.571 10 | 0.500 10 | 0.143 11 | 0.000 6 | 0.250 10 | 0.000 3 | 0.869 8 | 0.667 10 | 0.162 11 | 0.000 8 | 0.250 10 | 1.000 1 | 0.000 5 | 0.500 7 | 0.000 8 | 0.000 4 | 0.000 2 | 0.689 10 | 0.000 2 | 0.000 1 | 0.312 10 | 0.383 11 | 0.114 9 | 0.333 8 | 0.000 10 | 0.997 7 | 0.420 8 | 0.613 10 | 0.212 11 | 0.500 2 | 0.819 8 | 0.000 1 | 0.000 7 | 0.768 7 | 1.000 1 | 0.918 4 | 0.000 1 | 0.000 9 | 0.278 11 | 0.000 1 | 0.333 9 | 0.000 11 | 0.353 8 | 0.546 11 | 0.258 10 | |||||||||||||||||||||||||||||
| Ji Hou, Benjamin Graham, Matthias Nießner, Saining Xie: Exploring Data-Efficient 3D Scene Understanding with Contrastive Scene Contexts. CVPR 2021 | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
| LGround Inst. | 0.314 9 | 0.529 9 | 0.225 9 | 0.155 9 | 0.578 11 | 0.010 9 | 0.500 1 | 0.000 4 | 0.000 6 | 0.000 1 | 0.515 5 | 0.556 7 | 0.696 5 | 1.000 1 | 0.927 9 | 0.400 7 | 0.083 9 | 0.000 8 | 1.000 1 | 0.252 6 | 0.000 6 | 0.167 8 | 0.350 8 | 0.731 5 | 0.067 9 | 0.000 6 | 0.123 10 | 0.000 1 | 0.000 4 | 0.036 9 | 0.372 9 | 0.000 8 | 0.000 1 | 0.250 6 | 0.000 4 | 0.569 10 | 0.031 11 | 0.810 7 | 0.000 9 | 0.000 10 | 0.630 5 | 0.183 8 | 0.278 9 | 0.000 6 | 0.000 1 | 0.582 8 | 0.589 11 | 0.500 2 | 0.863 8 | 1.000 1 | 0.940 4 | 0.000 10 | 0.144 7 | 0.716 9 | 0.000 5 | 0.000 9 | 0.484 9 | 0.000 8 | 0.500 8 | 0.400 8 | 0.798 9 | 0.500 8 | 0.278 10 | 0.750 2 | 0.093 7 | 0.166 10 | 0.783 8 | 0.000 5 | 0.200 7 | 0.400 2 | 0.000 2 | 0.000 8 | 0.000 6 | 0.219 8 | 0.539 9 | 0.500 8 | 0.578 9 | 0.413 9 | 0.181 11 | 0.457 8 | 0.375 7 | 0.000 2 | 0.000 1 | 0.050 11 | 0.000 9 | 0.077 10 | 0.000 5 | 0.000 5 | 0.500 11 | 0.000 11 | 0.743 9 | 0.250 8 | 0.488 10 | 0.846 9 | 0.000 5 | 0.000 1 | 0.800 9 | 0.069 9 | 0.000 9 | 0.000 9 | 0.000 6 | 0.000 9 | 1.000 1 | 0.607 10 | 0.000 8 | 0.200 7 | 0.500 3 | 0.694 7 | 0.528 8 | 0.063 9 | 0.659 7 | 0.000 7 | 0.594 6 | 0.000 2 | 0.000 9 | 0.000 4 | 0.571 8 | 0.000 3 | 0.000 8 | 0.000 5 | 0.716 10 | 0.647 11 | 0.221 6 | 0.857 8 | 0.000 8 | 0.000 6 | 0.217 9 | 0.346 9 | 0.071 10 | 0.530 11 | 1.000 1 | 0.429 9 | 0.000 6 | 0.286 9 | 0.000 3 | 0.826 11 | 0.706 9 | 0.208 10 | 0.000 8 | 0.250 10 | 0.744 7 | 0.000 5 | 0.500 7 | 0.042 2 | 0.000 4 | 0.000 2 | 0.746 7 | 0.000 2 | 0.000 1 | 0.517 6 | 0.625 9 | 0.085 11 | 0.333 8 | 0.000 10 | 1.000 1 | 0.378 10 | 0.533 11 | 0.376 10 | 0.042 11 | 0.814 9 | 0.000 1 | 0.000 7 | 0.765 8 | 1.000 1 | 0.600 9 | 0.000 1 | 0.000 9 | 0.667 8 | 0.000 1 | 0.472 4 | 0.333 6 | 0.337 9 | 0.605 9 | 0.305 8 | |||||||||||||||||||||||||||||
| David Rozenberszki, Or Litany, Angela Dai: Language-Grounded Indoor 3D Semantic Segmentation in the Wild. | |||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||||
