Benchmark Results - ScanRefer Benchmark

This table lists the benchmark results for the ScanRefer Localization Benchmark scenario.

		Unique	Unique	Multiple	Multiple	Overall	Overall
Method	Info	acc@0.25IoU	acc@0.5IoU	acc@0.25IoU	acc@0.5IoU	acc@0.25IoU	acc@0.5IoU
Method	Info
CORE-3DVG		0.8557 2	0.6867 4	0.5275 1	0.3850 2	0.6011 1	0.4527 3

ConcreteNet		0.8607 1	0.7923 1	0.4746 2	0.4091 1	0.5612 2	0.4950 1
Ozan Unal, Christos Sakaridis, Suman Saha, Fisher Yu, Luc Van Gool: Three Ways to Improve Verbo-visual Fusion for Dense 3D Visual Grounding.
M3DRef-CLIP		0.7980 5	0.7085 2	0.4692 3	0.3807 3	0.5433 3	0.4545 2
Yiming Zhang, ZeMing Gong, Angel X. Chang: Multi3DRefer: Grounding Text Description to Multiple 3D Objects. ICCV 2023
3DInsVG		0.8170 3	0.6925 3	0.4582 4	0.3617 4	0.5386 4	0.4359 4

CSA-M3LM		0.8137 4	0.6241 14	0.4544 5	0.3317 6	0.5349 5	0.3972 6

bo3d-1		0.7469 24	0.5606 23	0.4539 6	0.3124 7	0.5196 6	0.3680 13

3DJCG(Grounding)		0.7675 18	0.6059 16	0.4389 7	0.3117 8	0.5126 7	0.3776 11
Daigang Cai, Lichen Zhao, Jing Zhang†, Lu Sheng, Dong Xu: 3DJCG: A Unified Framework for Joint Dense Captioning and Visual Grounding on 3D Point Clouds. CVPR2022 Oral
3DVG-Trans +		0.7733 15	0.5787 21	0.4370 8	0.3102 9	0.5124 8	0.3704 12
Lichen Zhao∗, Daigang Cai∗, Lu Sheng†, Dong Xu: 3DVG-Transformer: Relation Modeling for Visual Grounding on Point Clouds. ICCV2021
FE-3DGQA		0.7857 7	0.5862 20	0.4317 9	0.2935 12	0.5111 9	0.3592 16

SAVG		0.7758 14	0.5664 22	0.4236 10	0.2826 18	0.5026 10	0.3462 21

3DVG-Transformer		0.7576 20	0.5515 24	0.4224 11	0.2933 13	0.4976 11	0.3512 20
Lichen Zhao∗, Daigang Cai∗, Lu Sheng†, Dong Xu: 3DVG-Transformer: Relation Modeling for Visual Grounding on Point Clouds. ICCV2021
HAM		0.7799 10	0.6373 13	0.4148 12	0.3324 5	0.4967 12	0.4007 5
Jiaming Chen, Weixin Luo, Ran Song, Xiaolin Wei, Lin Ma, Wei Zhang: Learning Point-Language Hierarchical Alignment for 3D Visual Grounding.
HGT		0.7692 17	0.5886 19	0.4141 13	0.2924 15	0.4937 13	0.3588 18

henet		0.7110 27	0.5180 28	0.3936 14	0.2472 26	0.4590 17	0.3030 27

BEAUTY-DETR		0.7848 8	0.5499 25	0.3934 15	0.2480 25	0.4811 14	0.3157 25
Ayush Jain, Nikolaos Gkanatsios, Ishita Mediratta, Katerina Fragkiadaki: Looking Outside the Box to Ground Language in 3D Scenes.
D3Net		0.7923 6	0.6843 5	0.3905 16	0.3074 10	0.4806 15	0.3919 7
Dave Zhenyu Chen, Qirui Wu, Matthias Niessner, Angel X. Chang: D3Net: A Unified Speaker-Listener Architecture for 3D Dense Captioning and Visual Grounding. 17th European Conference on Computer Vision (ECCV), 2022
ContraRefer		0.7832 9	0.6801 8	0.3850 17	0.2947 11	0.4743 16	0.3811 8

Co3d3		0.5326 38	0.1369 38	0.3848 18	0.1651 38	0.4179 29	0.1588 38

grounding		0.7298 25	0.5458 26	0.3822 19	0.2421 27	0.4538 22	0.3046 26

bo3d		0.5400 37	0.1550 37	0.3817 20	0.1785 34	0.4172 30	0.1732 37

TransformerVG		0.7502 22	0.5977 17	0.3712 21	0.2628 22	0.4562 19	0.3379 23

secg		0.7288 26	0.6175 15	0.3696 22	0.2933 13	0.4501 24	0.3660 15

Se2d		0.7799 10	0.6628 10	0.3636 23	0.2823 19	0.4569 18	0.3677 14

SRGA		0.7494 23	0.5128 29	0.3631 24	0.2218 28	0.4497 25	0.2871 28

Clip		0.7733 15	0.6810 7	0.3619 25	0.2919 16	0.4542 21	0.3791 9

D3Net - Pretrained		0.7659 19	0.6579 11	0.3619 25	0.2726 20	0.4525 23	0.3590 17
Dave Zhenyu Chen, Qirui Wu, Matthias Niessner, Angel X. Chang: D3Net: A Unified Speaker-Listener Architecture for 3D Dense Captioning and Visual Grounding. 17th European Conference on Computer Vision (ECCV), 2022
Clip-pre		0.7766 13	0.6843 5	0.3617 27	0.2904 17	0.4547 20	0.3787 10

Co3d2		0.5070 39	0.1195 40	0.3569 28	0.1511 39	0.3906 33	0.1440 39

ScanRefer		0.6859 29	0.4353 32	0.3488 29	0.2097 29	0.4244 27	0.2603 31
Dave Zhenyu Chen, Angel X. Chang, Matthias Nießner: ScanRefer: 3D Object Localization in RGB-D Scans using Natural Language. 16th European Conference on Computer Vision (ECCV), 2020
InstanceRefer		0.7782 12	0.6669 9	0.3457 30	0.2688 21	0.4427 26	0.3580 19
Zhihao Yuan, Xu Yan, Yinghong Liao, Ruimao Zhang, Zhen Li*, Shuguang Cui: InstanceRefer: Cooperative Holistic Understanding for Visual Grounding on Point Clouds through Instance Multi-level Contextual Referring. ICCV 2021
TGNN		0.6834 30	0.5894 18	0.3312 31	0.2526 24	0.4102 31	0.3281 24
Pin-Hao Huang, Han-Hung Lee, Hwann-Tzong Chen, Tyng-Luh Liu: Text-Guided Graph Neural Network for Referring 3D Instance Segmentation. AAAI 2021
bo3d0		0.4823 40	0.1278 39	0.3271 32	0.1394 40	0.3619 37	0.1368 40

PointGroup_MCAN		0.7510 21	0.6397 12	0.3271 32	0.2535 23	0.4222 28	0.3401 22

SR-GAB		0.7016 28	0.5202 27	0.3233 34	0.1959 31	0.4081 32	0.2686 29

scanrefer2		0.6340 33	0.4353 32	0.3193 35	0.1947 32	0.3898 34	0.2486 32

ScanRefer Baseline		0.6422 32	0.4196 34	0.3090 36	0.1832 33	0.3837 35	0.2362 34

ScanRefer_vanilla		0.6488 31	0.4056 35	0.3052 37	0.1782 35	0.3823 36	0.2292 35

SPANet		0.5614 36	0.4641 31	0.2800 38	0.2071 30	0.3431 39	0.2647 30

pairwisemethod		0.5779 35	0.3603 36	0.2792 39	0.1746 36	0.3462 38	0.2163 36

TransformerRefer		0.6010 34	0.4658 30	0.2540 40	0.1730 37	0.3318 40	0.2386 33

Co3d		0.0000 41	0.0000 41	0.0000 41	0.0000 41	0.0000 41	0.0000 41