AI & ML
Radiative Gaussian Splatting for Efficient X-ray Novel View Synthesis
arXiv eess.IV0 views
arXiv:2403.04116v4 Announce Type: replace Abstract: X-ray is widely applied for transmission imaging due to its stronger penetration than natural light. When rendering novel view X-ray projections, existing methods mainly based on NeRF suffer from long training time and slow inference speed. In this paper, we propose a 3D Gaussian splatting-based method, namely X-Gaussian, for X-ray 3D reconstruction. Firstly, we redesign a radiative Gaussian point cloud model inspired by the isotropic nature of X-ray imaging. Our model excludes the influence of view direction when learning to predict the radiation intensity of 3D points. Based on this model, we develop a Differentiable Radiative Rasterization (DRR) with CUDA implementation. Secondly, we formulate a principled Radiative Gaussian Volume Querying (RGVQ) method that defines a continuous attenuation field from the original radiative point attributes and enables direct CT volume reconstruction through CUDA-based parallel querying. Thirdly, we customize an Angle-pose Cuboid Uniform Initialization (ACUI) strategy that directly uses the parameters of the X-ray scanner to compute the camera information and then uniformly samples point positions within a cuboid enclosing the scanned object. On novel view synthesis, X-Gaussian outperforms SOTA methods by 6.5 dB while enjoying less than 15% training time and over 73x inference speed. On CT reconstruction, X-Gaussian outperforms SOTA methods by 0.40 dB and 4.34 dB on synthetic and real scenes, while achieving 4.30x faster inference of the learned CT volume. Code, models, and datasets are at https://github.com/caiyuanhao1998/X-Gaussian . More video and interactive visualizations are presented on our project page at https://caiyuanhao1998.github.io/project/X-Gaussian . We also built an online Gradio demo page on HuggingFace at https://huggingface.co/spaces/CaiYuanhao/X-Gaussian .
Source:https://arxiv.org/abs/2403.04116PreviousStructure-Aware Sparse-View X-ray 3D ReconstructionNextBinarized Spectral Compressive Imaging
Related posts
How OpenAI’s Performance Factory keeps ChatGPT fast
0OpenAI Blog
Meta’s AI agent Muse is mixing up conversations and exposing private data, report says
0TechCrunch
Google gives Gemini the ability to use your Mac for you
0TechCrunch
Linkup /research is async. Treating it as synchronous is the bug, in code and in the freeze case
0dev.to
Fuck Your AI Safeguards
0Hacker News
Chrome AI features wasting much bandwidth
0Hacker News