Full name | Open3DIS: Open-vocabulary 3D Instance Segmentation with 2D Mask Guidance |
---|---|
Publication title | Open3DIS: Open-vocabulary 3D Instance Segmentation with 2D Mask Guidance |
Publication authors | Phuc Nguyen, Tuan Duc Ngo, Evangelos Kalogerakis, Chuang Gan, Anh Tran, Cuong Pham, Khoi Nguyen |
Publication venue | CVPR 2024 |
Publication url | https://openaccess.thecvf.com/content/CVPR2024/papers/Nguyen_Open3DIS_Open-Vocabulary_3D_Instance_Segmentation_with_2D_Mask_Guidance_CVPR_2024_paper.pdf |
Project link | open3dis.github.io/ |
Hardware | A100 x 1 |
Code | Code available with license: Apache-2.0 license |
Use other data | Yes: Grounded SAM / CLIP ViT-L/14@336 |
Last edited | 16 June, 2024 |
mean | table | door | ceiling lamp | cabinet | blinds | curtain | chair | storage cabinet | office chair | bookshelf | whiteboard | window | box | monitor | shelf | heater | kitchen cabinet | sofa | bed | trash can | book | plant | blanket | tv | computer tower | refrigerator | jacket | sink | bag | picture | pillow | towel | suitcase | backpack | crate | keyboard | rack | toilet | printer | poster | painting | microwave | shoes | socket | bottle | bucket | cushion | basket | shoe rack | telephone | file folder | laptop | plant pot | exhaust fan | cup | coat hanger | light switch | speaker | table lamp | kettle | smoke detector | container | power strip | slippers | paper bag | mouse | cutting board | toilet paper | paper towel | pot | clock | pan | tap | jar | soap dispenser | binder | bowl | tissue box | whiteboard eraser | toilet brush | spray bottle | headphones | stapler | marker | |
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
AP | 0.13096 | 0.05042 | 0.24718 | 0.16268 | 0.02252 | 0.07913 | 0.05692 | 0.20592 | 0.26783 | 0.33115 | 0.00000 | 0.33220 | 0.01814 | 0.09469 | 0.40254 | 0.20062 | 0.06392 | 0.02454 | 0.27949 | 0.12198 | 0.35951 | 0.00000 | 0.05605 | 0.00000 | 0.33468 | 0.09259 | 0.22749 | 0.03175 | 0.31663 | 0.18922 | 0.00000 | 0.27667 | 0.13688 | 0.24721 | 0.00000 | 0.02317 | 0.42082 | 0.00000 | 0.45577 | 0.37286 | 0.02056 | 0.04116 | 0.23450 | 0.00381 | 0.06684 | 0.06330 | 0.02581 | 0.35696 | 0.00000 | 0.00000 | 0.15649 | 0.00000 | 0.22751 | 0.04051 | 0.03476 | 0.19728 | 0.03392 | 0.00000 | 0.00000 | 0.00000 | 0.08935 | 0.06765 | 0.00000 | 0.08128 | 0.01026 | 0.08426 | 0.22745 | 0.11852 | 0.14958 | 0.09383 | 0.00000 | 0.48765 | 0.00000 | 0.14749 | 0.00365 | 0.07305 | 0.05725 | 0.07278 | 0.27513 | 0.19943 | 0.10620 | 0.04941 | 0.26852 | 0.33114 | 0.00000 |
AP50 | 0.20480 | 0.11202 | 0.44624 | 0.27700 | 0.03692 | 0.14178 | 0.10364 | 0.31099 | 0.36492 | 0.44686 | 0.00000 | 0.43478 | 0.04729 | 0.15896 | 0.51000 | 0.25239 | 0.10802 | 0.03333 | 0.36410 | 0.22053 | 0.48005 | 0.00000 | 0.16885 | 0.00000 | 0.37255 | 0.12821 | 0.34493 | 0.03571 | 0.47273 | 0.28512 | 0.00000 | 0.49228 | 0.23922 | 0.28846 | 0.00000 | 0.03829 | 0.63899 | 0.00000 | 0.54924 | 0.48837 | 0.02115 | 0.04633 | 0.39062 | 0.03427 | 0.11943 | 0.14530 | 0.07895 | 0.47619 | 0.00000 | 0.00000 | 0.36882 | 0.00000 | 0.50595 | 0.07292 | 0.03646 | 0.31304 | 0.10175 | 0.00000 | 0.00000 | 0.00000 | 0.25000 | 0.11765 | 0.00000 | 0.20690 | 0.04615 | 0.15584 | 0.32500 | 0.13333 | 0.23810 | 0.15556 | 0.00000 | 0.76389 | 0.00000 | 0.27548 | 0.01096 | 0.07407 | 0.11667 | 0.13393 | 0.65476 | 0.27726 | 0.10714 | 0.07453 | 0.60000 | 0.38182 | 0.00000 |
AP25 | 0.25255 | 0.16789 | 0.47953 | 0.39109 | 0.03801 | 0.16964 | 0.21455 | 0.37028 | 0.44785 | 0.49631 | 0.00000 | 0.44501 | 0.10308 | 0.25010 | 0.54643 | 0.33809 | 0.14583 | 0.07500 | 0.36508 | 0.37500 | 0.52687 | 0.00000 | 0.28600 | 0.00000 | 0.45076 | 0.20192 | 0.34708 | 0.03750 | 0.57556 | 0.32351 | 0.00000 | 0.51562 | 0.27762 | 0.35490 | 0.00000 | 0.05983 | 0.67614 | 0.00000 | 0.55126 | 0.49807 | 0.11538 | 0.04640 | 0.48750 | 0.09505 | 0.14926 | 0.32462 | 0.07937 | 0.47619 | 0.00000 | 0.00000 | 0.45127 | 0.00000 | 0.51948 | 0.07500 | 0.03906 | 0.38663 | 0.31837 | 0.00000 | 0.00000 | 0.00000 | 0.25000 | 0.11765 | 0.00000 | 0.24691 | 0.18462 | 0.15789 | 0.32933 | 0.15000 | 0.37037 | 0.15556 | 0.00000 | 1.00000 | 0.28571 | 0.46369 | 0.02212 | 0.07407 | 0.27273 | 0.13816 | 0.65476 | 0.42108 | 0.10714 | 0.15714 | 0.60000 | 0.39000 | 0.00000 |