Submitted by Francis Engelmann.

Submission data

Full name3D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentation
DescriptionWe present 3D-MPA, a method for instance segmentation on 3D point clouds. Given an input point cloud, we propose an object-centric approach where each point votes for its object center. We sample object proposals from the predicted object centers. Then we learn proposal features from grouped point features that voted for the same object center. A graph convolutional network introduces inter-proposal relations, providing higher-level feature learning in addition to the lower-level point features. Each proposal comprises a semantic label, a set of associated points over which we define a foreground-background mask, an objectness score and aggregation features. Previous works usually perform non-maximum-suppression (NMS) over proposals to obtain the final object detections or semantic instances. However, NMS can discard potentially correct predictions. Instead, our approach keeps all proposals and groups them together based on the learned aggregation features. We show that grouping propos
Publication title3D-MPA: Multi Proposal Aggregation for 3D Semantic Instance Segmentation
Publication authorsFrancis Engelmann, Martin Bokeloh, Alireza Fathi, Bastian Leibe, Matthias Nießner
Publication venueCVPR 2020
Publication URLhttps://francisengelmann.github.io/3D-MPA/
Input Data TypesUses Color        Uses 3D
Programming language(s)Python, TensorFlow
HardwareV100
Websitehttps://francisengelmann.github.io/3D-MPA/
Submission creation date13 Nov, 2018
Last edited5 Apr, 2020

3D semantic instance results



Infoavg ap 50%bathtubbedbookshelfcabinetchaircountercurtaindeskdoorotherfurniturepicturerefrigeratorshower curtainsinksofatabletoiletwindow
0.6111.0000.8330.7650.5260.7560.1360.5880.4700.4380.4320.3580.6500.8570.4290.7650.5571.0000.430