Full name | DINO in the Room: Leveraging 2D Foundation Models for 3D Segmentation |
---|---|
Publication title | DINO in the Room: Leveraging 2D Foundation Models for 3D Segmentation |
Publication authors | Karim Abou Zeid, Kadir Yilmaz, Daan de Geus, Alexander Hermans, David Adrian, Timm Linder, Bastian Leibe |
Publication venue | |
Publication url | https://arxiv.org/pdf/2503.18944 |
Project link | https://visualcomputinginstitute.github.io/DITR/ |
Hardware | 2 x H100 |
Use other data | No |
Last edited | 22 May, 2025 |
mIoU | wall | ceiling | floor | table | door | ceiling lamp | cabinet | blinds | curtain | chair | storage cabinet | office chair | bookshelf | whiteboard | window | box | window frame | monitor | shelf | doorframe | pipe | heater | kitchen cabinet | sofa | windowsill | bed | shower wall | trash can | book | plant | blanket | tv | computer tower | kitchen counter | refrigerator | jacket | electrical duct | sink | bag | picture | pillow | towel | suitcase | backpack | crate | keyboard | rack | toilet | paper | printer | poster | painting | microwave | board | shoes | socket | bottle | bucket | cushion | basket | shoe rack | telephone | file folder | cloth | blind rail | laptop | plant pot | exhaust fan | cup | coat hanger | light switch | speaker | table lamp | air vent | clothes hanger | kettle | smoke detector | container | power strip | slippers | paper bag | mouse | cutting board | toilet paper | paper towel | pot | clock | pan | tap | jar | soap dispenser | binder | bowl | tissue box | whiteboard eraser | toilet brush | spray bottle | headphones | stapler | marker | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
TOP-1 | 0.52585 | 0.85935 | 0.91366 | 0.94458 | 0.80114 | 0.70836 | 0.93969 | 0.33963 | 0.90399 | 0.83785 | 0.80044 | 0.41093 | 0.89307 | 0.52980 | 0.82004 | 0.63513 | 0.60113 | 0.43720 | 0.88881 | 0.22743 | 0.44492 | 0.63853 | 0.82313 | 0.60902 | 0.81122 | 0.63262 | 0.83593 | 0.40493 | 0.86202 | 0.50391 | 0.91838 | 0.72204 | 0.96638 | 0.65635 | 0.19475 | 0.86052 | 0.71281 | 0.23559 | 0.74253 | 0.49225 | 0.56567 | 0.32119 | 0.67828 | 0.70850 | 0.56357 | 0.82622 | 0.87991 | 0.00001 | 0.87204 | 0.31401 | 0.53238 | 0.36510 | 0.00000 | 0.90194 | 0.09365 | 0.42660 | 0.48635 | 0.55420 | 0.45393 | 0.00000 | 0.21888 | 0.27797 | 0.72651 | 0.00221 | 0.07705 | 0.56163 | 0.78592 | 0.65091 | 0.55859 | 0.62099 | 0.25637 | 0.45254 | 0.54680 | 0.69187 | 0.17148 | 0.13013 | 0.78600 | 0.46824 | 0.00000 | 0.52987 | 0.49054 | 0.11447 | 0.78243 | 0.33366 | 0.30756 | 0.30138 | 0.02327 | 0.73760 | 0.49507 | 0.52417 | 0.23521 | 0.60200 | 0.01238 | 0.26876 | 0.53416 | 0.47221 | 0.65134 | 0.39993 | 0.57082 | 0.11004 | 0.00000 |
TOP-3 | 0.76247 | 0.97709 | 0.98995 | 0.98974 | 0.92985 | 0.96528 | 0.98480 | 0.76746 | 0.98163 | 0.98963 | 0.94551 | 0.80845 | 0.99552 | 0.83884 | 0.98101 | 0.92490 | 0.79256 | 0.90427 | 0.94070 | 0.53726 | 0.86064 | 0.88572 | 0.94826 | 0.82959 | 0.90933 | 0.92572 | 0.99179 | 0.95122 | 0.96175 | 0.76210 | 0.97465 | 0.91027 | 0.99402 | 0.88609 | 0.56296 | 0.96230 | 0.88449 | 0.95714 | 0.91178 | 0.77592 | 0.79479 | 0.68627 | 0.85567 | 0.79678 | 0.83485 | 0.94675 | 0.99376 | 0.04136 | 0.94517 | 0.66413 | 0.69734 | 0.82794 | 0.61008 | 0.94065 | 0.17919 | 0.92923 | 0.86823 | 0.78977 | 0.89815 | 0.46920 | 0.27911 | 0.98065 | 0.85288 | 0.08669 | 0.28751 | 0.94523 | 0.98506 | 0.94006 | 0.79840 | 0.74601 | 0.48106 | 0.95891 | 0.87347 | 0.76437 | 0.50773 | 0.47903 | 0.86578 | 0.72745 | 0.00181 | 0.71316 | 0.92445 | 0.82022 | 0.97614 | 0.81191 | 0.42556 | 0.33706 | 0.05949 | 0.78270 | 0.76298 | 0.78941 | 0.52832 | 0.82983 | 0.28987 | 0.44176 | 0.82764 | 0.77401 | 0.82774 | 0.64756 | 0.94640 | 0.21723 | 0.09317 |