Submitted by Tuo Feng.

Submission data

Full nameAn Efficient and Effective Large Sparse Kernel 3D Neural Network
DescriptionAutonomous systems need to process large-scale, sparse, and irregular point clouds with limited compute resources. Consequently, it is essential to develop LiDAR perception methods that are both efficient and effective. Although naively enlarging 3D kernel size can enhance performance, it will also lead to a cubically-increasing overhead. Therefore, it is crucial to develop streamlined 3D large kernel designs that eliminate redundant weights and work effectively with larger kernels. In this paper, we propose an efficient and effective Large Sparse Kernel 3D Neural Network (LSK3DNet) that leverages dynamic pruning to amplify the 3D kernel size. Our method comprises two core components: Spatial-wise Dynamic Sparsity (SDS) and Channel-wise Weight Selection (CWS). SDS dynamically prunes and regrows volumetric weights from the beginning to learn a large sparse 3D kernel. It not only boosts performance but also significantly reduces model size and computational cost. Moreover, CWS selects th
Publication titleLSK3DNet: Towards Effective and Efficient 3D Perception with Large Sparse Kernels
Publication authorsTuo Feng, Wenguan Wang, Fan Ma, Yi Yang
Publication venueCVPR 2024
Publication URLhttps://openaccess.thecvf.com/content/CVPR2024/papers/Feng_LSK3DNet_Towards_Effective_and_Efficient_3D_Perception_with_Large_Sparse_CVPR_2024_paper.pdf
Input Data TypesUses Geometry        Uses 3D
Programming language(s)Python,Pytorch
HardwareV100
Websitehttps://github.com/FengZicai/LSK3DNet
Source code or download URLhttps://github.com/FengZicai/LSK3DNet
Submission creation date9 Mar, 2025
Last edited9 Mar, 2025
Last uploaded9 Mar, 2025

3D semantic label results

Infoavg ioubathtubbedbookshelfcabinetchaircountercurtaindeskdoorfloorotherfurniturepicturerefrigeratorshower curtainsinksofatabletoiletwallwindow
permissive0.7550.8990.8230.8430.7640.8380.5840.8450.7170.6380.9560.5800.2290.6400.9000.7500.8130.7290.9200.8720.757