3D Gaussian Splatting on Mobile Devices (Tutor: Linfei Li, wechat: lifambitious)

Introduction

We want to be able to view the 3D model of an object or scene on our mobile phone as easily as viewing a picture. To achieve this, we can use 3D Gaussian Splattiing!

Requirements

1> You should use your phone to capture images or videos, and then view your reconstructed 3D scene on the phone.

2> There is no real-time requirement, but the faster the better!

3> Optional pipeline: video capture -> upload to server -> calculate poses -> 3DGS reconstruction -> display reconstruction results on phone.

References

1> Kerbl, Bernhard, et al. "3D Gaussian Splatting for Real-Time Radiance Field Rendering." ACM Trans. Graph. 42.4 (2023): 139-1.

2> Optional image pose calculation solution: COLMAP.

3> Bagdasarian, Milena T., et al. "3dgs. zip: A survey on 3d gaussian splatting compression methods." arXiv preprint arXiv:2407.09510 (2024).

Created on: Nov. 09, 2024