Evaluation of strategies for efficient rate-distortion NeRF streaming

detalle del documento

IDENTIFICACIÓN

oai:arXiv.org:2410.19459

Tema

Computer Science - Multimedia Computer Science - Computer Vision... Electrical Engineering and Systems...

Autor

Martin, Pedro Rodrigues, António Ascenso, João Queluz, Maria Paula

Categoría

Computer Science

Año

2024

fecha de cotización

30/10/2024

Palabras clave

computer science nerf

Métrico

Resumen

Neural Radiance Fields (NeRF) have revolutionized the field of 3D visual representation by enabling highly realistic and detailed scene reconstructions from a sparse set of images.

NeRF uses a volumetric functional representation that maps 3D points to their corresponding colors and opacities, allowing for photorealistic view synthesis from arbitrary viewpoints.

Despite its advancements, the efficient streaming of NeRF content remains a significant challenge due to the large amount of data involved.

This paper investigates the rate-distortion performance of two NeRF streaming strategies: pixel-based and neural network (NN) parameter-based streaming.

While in the former, images are coded and then transmitted throughout the network, in the latter, the respective NeRF model parameters are coded and transmitted instead.

This work also highlights the trade-offs in complexity and performance, demonstrating that the NN parameter-based strategy generally offers superior efficiency, making it suitable for one-to-many streaming scenarios.

Martin, Pedro,Rodrigues, António,Ascenso, João,Queluz, Maria Paula, 2024, Evaluation of strategies for efficient rate-distortion NeRF streaming