Results for Open3DIS - only2D

Submission info

Full name	Open3DIS: Open-vocabulary 3D Instance Segmentation with 2D Mask Guidance
Publication title	Open3DIS: Open-vocabulary 3D Instance Segmentation with 2D Mask Guidance
Publication authors	Phuc Nguyen, Tuan Duc Ngo, Evangelos Kalogerakis, Chuang Gan, Anh Tran, Cuong Pham, Khoi Nguyen
Publication venue	CVPR 2024
Publication url	https://openaccess.thecvf.com/content/CVPR2024/papers/Nguyen_Open3DIS_Open-Vocabulary_3D_Instance_Segmentation_with_2D_Mask_Guidance_CVPR_2024_paper.pdf
Project link	open3dis.github.io/
Hardware	A100 x 1
Code	Code available with license: Apache-2.0 license
Use other data	Yes: Grounded SAM / CLIP ViT-L/14@336
Last edited	16 June, 2024

Method details

Use DSLR RGB: No
Use iPhone RGB-D: Yes
Use mesh geometry: No
Use high-resolution pointcloud: No

3D instance segmentation results

	mean	table	door	ceiling lamp	cabinet	blinds	curtain	chair	storage cabinet	office chair	bookshelf	whiteboard	window	box	monitor	shelf	heater	kitchen cabinet	sofa	bed	trash can	book	plant	blanket	tv	computer tower	refrigerator	jacket	sink	bag	picture	pillow	towel	suitcase	backpack	crate	keyboard	rack	toilet	printer	poster	painting	microwave	shoes	socket	bottle	bucket	cushion	basket	shoe rack	telephone	file folder	laptop	plant pot	exhaust fan	cup	coat hanger	light switch	speaker	table lamp	kettle	smoke detector	container	power strip	slippers	paper bag	mouse	cutting board	toilet paper	paper towel	pot	clock	pan	tap	jar	soap dispenser	binder	bowl	tissue box	whiteboard eraser	toilet brush	spray bottle	headphones	stapler	marker
AP	0.13096	0.05042	0.24718	0.16268	0.02252	0.07913	0.05692	0.20592	0.26783	0.33115	0.00000	0.33220	0.01814	0.09469	0.40254	0.20062	0.06392	0.02454	0.27949	0.12198	0.35951	0.00000	0.05605	0.00000	0.33468	0.09259	0.22749	0.03175	0.31663	0.18922	0.00000	0.27667	0.13688	0.24721	0.00000	0.02317	0.42082	0.00000	0.45577	0.37286	0.02056	0.04116	0.23450	0.00381	0.06684	0.06330	0.02581	0.35696	0.00000	0.00000	0.15649	0.00000	0.22751	0.04051	0.03476	0.19728	0.03392	0.00000	0.00000	0.00000	0.08935	0.06765	0.00000	0.08128	0.01026	0.08426	0.22745	0.11852	0.14958	0.09383	0.00000	0.48765	0.00000	0.14749	0.00365	0.07305	0.05725	0.07278	0.27513	0.19943	0.10620	0.04941	0.26852	0.33114	0.00000
AP50	0.20480	0.11202	0.44624	0.27700	0.03692	0.14178	0.10364	0.31099	0.36492	0.44686	0.00000	0.43478	0.04729	0.15896	0.51000	0.25239	0.10802	0.03333	0.36410	0.22053	0.48005	0.00000	0.16885	0.00000	0.37255	0.12821	0.34493	0.03571	0.47273	0.28512	0.00000	0.49228	0.23922	0.28846	0.00000	0.03829	0.63899	0.00000	0.54924	0.48837	0.02115	0.04633	0.39062	0.03427	0.11943	0.14530	0.07895	0.47619	0.00000	0.00000	0.36882	0.00000	0.50595	0.07292	0.03646	0.31304	0.10175	0.00000	0.00000	0.00000	0.25000	0.11765	0.00000	0.20690	0.04615	0.15584	0.32500	0.13333	0.23810	0.15556	0.00000	0.76389	0.00000	0.27548	0.01096	0.07407	0.11667	0.13393	0.65476	0.27726	0.10714	0.07453	0.60000	0.38182	0.00000
AP25	0.25255	0.16789	0.47953	0.39109	0.03801	0.16964	0.21455	0.37028	0.44785	0.49631	0.00000	0.44501	0.10308	0.25010	0.54643	0.33809	0.14583	0.07500	0.36508	0.37500	0.52687	0.00000	0.28600	0.00000	0.45076	0.20192	0.34708	0.03750	0.57556	0.32351	0.00000	0.51562	0.27762	0.35490	0.00000	0.05983	0.67614	0.00000	0.55126	0.49807	0.11538	0.04640	0.48750	0.09505	0.14926	0.32462	0.07937	0.47619	0.00000	0.00000	0.45127	0.00000	0.51948	0.07500	0.03906	0.38663	0.31837	0.00000	0.00000	0.00000	0.25000	0.11765	0.00000	0.24691	0.18462	0.15789	0.32933	0.15000	0.37037	0.15556	0.00000	1.00000	0.28571	0.46369	0.02212	0.07407	0.27273	0.13816	0.65476	0.42108	0.10714	0.15714	0.60000	0.39000	0.00000