Document detail
ID

oai:arXiv.org:2408.09928

Topic
Computer Science - Computer Vision... Computer Science - Graphics
Author
Dumery, Corentin Fan, Aoxiang Li, Ren Talabot, Nicolas Fua, Pascal
Category

Computer Science

Year

2024

listing date

9/11/2024

Keywords
3d computer scenes masks nerfs
Metrics

Abstract

Neural Radiance Fields (NeRFs) have become a powerful tool for modeling 3D scenes from multiple images.

However, NeRFs remain difficult to segment into semantically meaningful regions.

Previous approaches to 3D segmentation of NeRFs either require user interaction to isolate a single object, or they rely on 2D semantic masks with a limited number of classes for supervision.

As a consequence, they generalize poorly to class-agnostic masks automatically generated in real scenes.

This is attributable to the ambiguity arising from zero-shot segmentation, yielding inconsistent masks across views.

In contrast, we propose a method that is robust to inconsistent segmentations and successfully decomposes the scene into a set of objects of any class.

By introducing a limited number of competing object slots against which masks are matched, a meaningful object representation emerges that best explains the 2D supervision and minimizes an additional regularization term.

Our experiments demonstrate the ability of our method to generate 3D panoptic segmentations on complex scenes, and extract high-quality 3D assets from NeRFs that can then be used in virtual 3D environments.

Dumery, Corentin,Fan, Aoxiang,Li, Ren,Talabot, Nicolas,Fua, Pascal, 2024, DiscoNeRF: Class-Agnostic Object Field for 3D Object Discovery

Document

Open

Share

Source

Articles recommended by ES/IODE AI

Comparison between Dual-Energy CT and Quantitative Susceptibility Mapping in Assessing Brain Iron Deposition in Parkinson Disease
nigra substantia healthy depositions p < 05 nucleus brain susceptibility ct bilateral dual-energy iron quantitative mapping values magnetic globus pallidus
Integration of human papillomavirus associated anal cancer screening into HIV care and treatment program in Pakistan: perceptions of policymakers, managers, and care providers
hpv hiv msm transgender women anal cancer screening integration pakistan system managers pakistan informants anal screening cancer lack healthcare hiv