Benchmark Results - ScanRefer Benchmark

This table lists the benchmark results for the ScanRefer Localization Benchmark scenario.

		Unique	Unique	Multiple	Multiple	Overall	Overall
Method	Info	acc@0.25IoU	acc@0.5IoU	acc@0.25IoU	acc@0.5IoU	acc@0.25IoU	acc@0.5IoU
Method	Info
ConcreteNet		0.8607 1	0.7923 1	0.4746 6	0.4091 1	0.5612 5	0.4950 1
Ozan Unal, Christos Sakaridis, Suman Saha, Fisher Yu, Luc Van Gool: Three Ways to Improve Verbo-visual Fusion for Dense 3D Visual Grounding.
M3DRef-SCLIP		0.7997 8	0.7123 2	0.4708 7	0.3805 8	0.5445 7	0.4549 6

M3DRef-CLIP		0.7980 9	0.7085 3	0.4692 8	0.3807 7	0.5433 8	0.4545 7
Yiming Zhang, ZeMing Gong, Angel X. Chang: Multi3DRefer: Grounding Text Description to Multiple 3D Objects. ICCV 2023
pointclip		0.8211 4	0.7082 4	0.4803 5	0.3884 5	0.5567 6	0.4601 5

cus3d		0.8384 3	0.7073 5	0.4908 4	0.4000 2	0.5688 3	0.4689 2

3DInsVG		0.8170 6	0.6925 6	0.4582 10	0.3617 9	0.5386 9	0.4359 9

DMO-3DG		0.8195 5	0.6900 7	0.4975 2	0.3967 4	0.5697 2	0.4625 3

CORE-3DVG		0.8557 2	0.6867 8	0.5275 1	0.3850 6	0.6011 1	0.4527 8

D3Net		0.7923 11	0.6843 9	0.3905 22	0.3074 16	0.4806 21	0.3919 13
Dave Zhenyu Chen, Qirui Wu, Matthias Niessner, Angel X. Chang: D3Net: A Unified Speaker-Listener Architecture for 3D Dense Captioning and Visual Grounding. 17th European Conference on Computer Vision (ECCV), 2022
Clip-pre		0.7766 19	0.6843 9	0.3617 34	0.2904 24	0.4547 26	0.3787 16

Clip		0.7733 21	0.6810 11	0.3619 32	0.2919 23	0.4542 27	0.3791 15

ContraRefer		0.7832 15	0.6801 12	0.3850 23	0.2947 18	0.4743 22	0.3811 14

M3DRef-test		0.7865 12	0.6793 13	0.4963 3	0.3977 3	0.5614 4	0.4608 4

RG-SAN		0.7964 10	0.6785 14	0.4591 9	0.3600 10	0.5348 11	0.4314 10

InstanceRefer		0.7782 18	0.6669 15	0.3457 37	0.2688 28	0.4427 32	0.3580 26
Zhihao Yuan, Xu Yan, Yinghong Liao, Ruimao Zhang, Zhen Li*, Shuguang Cui: InstanceRefer: Cooperative Holistic Understanding for Visual Grounding on Point Clouds through Instance Multi-level Contextual Referring. ICCV 2021
Se2d		0.7799 16	0.6628 16	0.3636 30	0.2823 26	0.4569 24	0.3677 20

D3Net - Pretrained		0.7659 25	0.6579 17	0.3619 32	0.2726 27	0.4525 29	0.3590 24
Dave Zhenyu Chen, Qirui Wu, Matthias Niessner, Angel X. Chang: D3Net: A Unified Speaker-Listener Architecture for 3D Dense Captioning and Visual Grounding. 17th European Conference on Computer Vision (ECCV), 2022
PointGroup_MCAN		0.7510 27	0.6397 18	0.3271 39	0.2535 30	0.4222 35	0.3401 29

HAM		0.7799 16	0.6373 19	0.4148 18	0.3324 11	0.4967 18	0.4007 11
Jiaming Chen, Weixin Luo, Ran Song, Xiaolin Wei, Lin Ma, Wei Zhang: Learning Point-Language Hierarchical Alignment for 3D Visual Grounding.
CSA-M3LM		0.8137 7	0.6241 20	0.4544 11	0.3317 12	0.5349 10	0.3972 12

secg		0.7288 32	0.6175 21	0.3696 29	0.2933 20	0.4501 30	0.3660 21

3DJCG(Grounding)		0.7675 24	0.6059 22	0.4389 13	0.3117 14	0.5126 13	0.3776 17
Daigang Cai, Lichen Zhao, Jing Zhang†, Lu Sheng, Dong Xu: 3DJCG: A Unified Framework for Joint Dense Captioning and Visual Grounding on 3D Point Clouds. CVPR2022 Oral
TransformerVG		0.7502 28	0.5977 23	0.3712 28	0.2628 29	0.4562 25	0.3379 30

TGNN		0.6834 36	0.5894 24	0.3312 38	0.2526 31	0.4102 38	0.3281 31
Pin-Hao Huang, Han-Hung Lee, Hwann-Tzong Chen, Tyng-Luh Liu: Text-Guided Graph Neural Network for Referring 3D Instance Segmentation. AAAI 2021
HGT		0.7692 23	0.5886 25	0.4141 19	0.2924 22	0.4937 19	0.3588 25

FE-3DGQA		0.7857 13	0.5862 26	0.4317 15	0.2935 19	0.5111 15	0.3592 23

3DVG-Trans +		0.7733 21	0.5787 27	0.4370 14	0.3102 15	0.5124 14	0.3704 18
Lichen Zhao∗, Daigang Cai∗, Lu Sheng†, Dong Xu: 3DVG-Transformer: Relation Modeling for Visual Grounding on Point Clouds. ICCV2021
SAVG		0.7758 20	0.5664 28	0.4236 16	0.2826 25	0.5026 16	0.3462 28

SAF		0.6348 39	0.5647 29	0.3726 27	0.3009 17	0.4314 33	0.3601 22

bo3d-1		0.7469 30	0.5606 30	0.4539 12	0.3124 13	0.5196 12	0.3680 19

3DVG-Transformer		0.7576 26	0.5515 31	0.4224 17	0.2933 20	0.4976 17	0.3512 27
Lichen Zhao∗, Daigang Cai∗, Lu Sheng†, Dong Xu: 3DVG-Transformer: Relation Modeling for Visual Grounding on Point Clouds. ICCV2021
BEAUTY-DETR		0.7848 14	0.5499 32	0.3934 21	0.2480 32	0.4811 20	0.3157 32
Ayush Jain, Nikolaos Gkanatsios, Ishita Mediratta, Katerina Fragkiadaki: Looking Outside the Box to Ground Language in 3D Scenes.
grounding		0.7298 31	0.5458 33	0.3822 25	0.2421 34	0.4538 28	0.3046 33

SR-GAB		0.7016 34	0.5202 34	0.3233 41	0.1959 38	0.4081 39	0.2686 36

henet		0.7110 33	0.5180 35	0.3936 20	0.2472 33	0.4590 23	0.3030 34

SRGA		0.7494 29	0.5128 36	0.3631 31	0.2218 35	0.4497 31	0.2871 35

TransformerRefer		0.6010 41	0.4658 37	0.2540 47	0.1730 44	0.3318 47	0.2386 40

SPANet		0.5614 43	0.4641 38	0.2800 45	0.2071 37	0.3431 46	0.2647 37

scanrefer2		0.6340 40	0.4353 39	0.3193 42	0.1947 39	0.3898 41	0.2486 39

ScanRefer		0.6859 35	0.4353 39	0.3488 36	0.2097 36	0.4244 34	0.2603 38
Dave Zhenyu Chen, Angel X. Chang, Matthias Nießner: ScanRefer: 3D Object Localization in RGB-D Scans using Natural Language. 16th European Conference on Computer Vision (ECCV), 2020
ScanRefer Baseline		0.6422 38	0.4196 41	0.3090 43	0.1832 40	0.3837 42	0.2362 41

ScanRefer_vanilla		0.6488 37	0.4056 42	0.3052 44	0.1782 42	0.3823 43	0.2292 42

pairwisemethod		0.5779 42	0.3603 43	0.2792 46	0.1746 43	0.3462 45	0.2163 43

bo3d		0.5400 44	0.1550 44	0.3817 26	0.1785 41	0.4172 37	0.1732 44

Co3d3		0.5326 45	0.1369 45	0.3848 24	0.1651 45	0.4179 36	0.1588 45

bo3d0		0.4823 47	0.1278 46	0.3271 39	0.1394 47	0.3619 44	0.1368 47

Co3d2		0.5070 46	0.1195 47	0.3569 35	0.1511 46	0.3906 40	0.1440 46

Co3d		0.0000 48	0.0000 48	0.0000 48	0.0000 48	0.0000 48	0.0000 48