3D Gaussian Splatting (3DGS) is a process that enables the direct creation of 3D objects from 2D images. This representation offers numerous advantages, including rapid training and rendering. However, a significant limitation of 3DGS is the challenge of incorporating light and shadow reflections, primarily due to the utilization of rasterization rather than ray tracing for rendering. This paper introduces RaySplats, a model that employs ray-tracing based Gaussian Splatting. Rather than utilizing the projection of Gaussians, our method employs a ray-tracing mechanism, operating directly on Gaussian primitives represented by confidence ellipses with RGB colors. In practice, we compute the intersection between ellipses and rays to construct ray-tracing algorithms, facilitating the incorporation of meshes with Gaussian Splatting models and the addition of lights, shadows, and other related effects.
3D Gaussian Splatting (3DGS) 是一种通过 2D 图像直接创建 3D 物体的过程。这种表示方法具有许多优势，包括快速训练和渲染。然而，3DGS 的一个显著局限性是难以处理光照和阴影的反射，主要因为其采用光栅化而非光线追踪进行渲染。本文介绍了 RaySplats，一种基于光线追踪的高斯 Splatting 模型。与传统的利用高斯投影的方法不同，我们的方法采用光线追踪机制，直接作用于由信心椭圆和 RGB 颜色表示的高斯原语。在实际应用中，我们计算椭圆与光线的交点，以构建光线追踪算法，从而使高斯 Splatting 模型能够与网格结合，并加入光照、阴影等相关效果。