GS-Hider: Hiding Messages into 3D Gaussian Splatting

Xuanyu Zhang1,2*, Jiarui Meng1,2*, Runyi Li1,2, Zhipei Xu1,2, Yongbing Zhang3, Jian Zhang1,2✉
1 School of Electronic and Computer Engineering, Peking University Shenzhen Graduate School
2 Guangdong Provincial Key Laboratory of Ultra High Definition Immersive Media Technology, Peking University Shenzhen Graduate School
3 School of Computer Science and Technology, Harbin Institute of Technology (Shenzhen)
* Equal contribution, Corresponding author
Figure 1

Abstract

3D Gaussian Splatting has already become the emerging research focus in the fields of 3D scene reconstruction and novel view synthesis. Given that training a 3DGS requires a significant amount of time and computational cost, it is crucial to protect the copyright, integrity, and privacy of such 3D assets. Steganography, as a crucial technique for encrypted transmission and copyright protection, has been extensively studied. However, it still lacks profound exploration targeted at 3DGS. Unlike its predecessor NeRF, 3DGS possesses two distinct features: 1) explicit 3D representation; and 2) real-time rendering speeds. These characteristics result in the 3DGS point cloud files being public and transparent, with each Gaussian point having a clear physical significance. Therefore, ensuring the security and fidelity of the original 3D scene while embedding information into the 3DGS point cloud files is an extremely challenging task. To solve the above-mentioned issue, we first propose a steganography framework for 3DGS, dubbed GS-Hider, which can embed 3D scenes and images into original GS point clouds in an invisible manner and accurately extract the hidden messages. Specifically, we design a coupled secured feature attribute to replace the original 3DGS's spherical harmonics coefficients and then use a scene decoder and a message decoder to disentangle the original RGB scene and the hidden message. Extensive experiments demonstrated that the proposed GS-Hider can effectively conceal multimodal messages without compromising rendering quality and possesses exceptional security, robustness, capacity, and flexibility.

Overall Framework of GS-Hider

Figure 1

Overview framework of the proposed GS-Hider. It uses a coupled secured feature attribute \( \boldsymbol{f}_i \) and the rendering pipeline to fuse hidden and original information, obtaining a rendered coupled feature \( \mathbf{F}_{coup} \). Then, the scene and message decoder is adopted to decouple the rendered RGB scenes and hidden messages.

Hiding a Single Scene in a Single Scene

Original 3D Scene

Recovered Hidden 3D Scene

Hiding a Single Image in a Single Scene

Original 3D Scene

Recovered Hidden 3D Scene

Recovered Image at Fixed View

Figure 1
Figure 1
Figure 1

Hiding Multiple Scenes in a Single Scene

Original 3D Scene

Hidden 3D Scene # 1

Hidden 3D Scene # 2