Document detail
ID

oai:arXiv.org:2405.18784

Topic
Computer Science - Computer Vision...
Author
Zhang, Zhaoliang Song, Tianchen Lee, Yongjae Yang, Li Peng, Cheng Chellappa, Rama Fan, Deliang
Category

Computer Science

Year

2024

listing date

6/5/2024

Keywords
scene ratio pruning lp-3dgs
Metrics

Abstract

Recently, 3D Gaussian Splatting (3DGS) has become one of the mainstream methodologies for novel view synthesis (NVS) due to its high quality and fast rendering speed.

However, as a point-based scene representation, 3DGS potentially generates a large number of Gaussians to fit the scene, leading to high memory usage.

Improvements that have been proposed require either an empirical and preset pruning ratio or importance score threshold to prune the point cloud.

Such hyperparamter requires multiple rounds of training to optimize and achieve the maximum pruning ratio, while maintaining the rendering quality for each scene.

In this work, we propose learning-to-prune 3DGS (LP-3DGS), where a trainable binary mask is applied to the importance score that can find optimal pruning ratio automatically.

Instead of using the traditional straight-through estimator (STE) method to approximate the binary mask gradient, we redesign the masking function to leverage the Gumbel-Sigmoid method, making it differentiable and compatible with the existing training process of 3DGS.

Extensive experiments have shown that LP-3DGS consistently produces a good balance that is both efficient and high quality.

Zhang, Zhaoliang,Song, Tianchen,Lee, Yongjae,Yang, Li,Peng, Cheng,Chellappa, Rama,Fan, Deliang, 2024, LP-3DGS: Learning to Prune 3D Gaussian Splatting

Document

Open

Share

Source

Articles recommended by ES/IODE AI

Lung cancer risk and exposure to air pollution: a multicenter North China case–control study involving 14604 subjects
lung cancer case–control air pollution never-smokers nomogram model controls lung-related 14604 subjects north polluted consistent smokers quit exposure lung cancer risk air people factor smoking pollution study history