Submitted by Weiwei Sun.

Submission data

Full nameNeural Bilateral Filtering for Top-down Instance Segmentation on Point Clouds
DescriptionWe introduce a method for instance proposal generation for 3D point clouds. Existing techniques typically directly regress proposals in a single feed-forward step, leading to inaccurate estimation. We show that this serves as a critical bottleneck, and propose a method based on iterative bilateral filtering with learned kernels. Following the spirit of bilateral filtering, we consider both the deep feature embeddings of each point, as well as their locations in the 3D space. We show via synthetic experiments that our method brings drastic improvements when generating instance proposals for a given point of interest. We further validate our method on the challenging ScanNet benchmark, achieving the best instance segmentation performance amongst the sub-category of top-down methods.
Publication titleNeuralBF: Neural Bilateral Filtering for Top-down Instance Segmentation on Point Clouds
Publication authorsWeiwei Sun, Daniel Rebain, Renjie Liao, Vladimir Tankovich, Soroosh Yazdani, Kwang Moo Yi, Andrea Tagliasacchi
Publication venueWACV 2023
Publication URLhttps://neuralbf.github.io/
Input Data TypesUses Color,Uses Geometry        Uses 3D
Programming language(s)Python/Pytorch
HardwareNVIDIA 3090
Websitehttps://neuralbf.github.io/
Source code or download URLhttps://neuralbf.github.io/
Submission creation date9 Jul, 2022
Last edited10 Jan, 2023

3D semantic instance results



Infoavg ap 50%bathtubbedbookshelfcabinetchaircountercurtaindeskdoorotherfurniturepicturerefrigeratorshower curtainsinksofatabletoiletwindow
0.5550.6670.8960.8430.5170.7510.0290.5190.4140.4390.4650.0000.4840.8570.2870.6930.6511.0000.485