AI & ML
Structure-Aware Sparse-View X-ray 3D Reconstruction
arXiv eess.IV0 views
arXiv:2311.10959v4 Announce Type: replace Abstract: X-ray, known for its ability to reveal internal structures of objects, is expected to provide richer information for 3D reconstruction than visible light. Yet, existing neural radiance fields (NeRF) algorithms overlook this important nature of X-ray, leading to their limitations in capturing structural contents of imaged objects. In this paper, we propose a framework, Structure-Aware X-ray Neural Radiodensity Fields (SAX-NeRF), for sparse-view X-ray 3D reconstruction. Firstly, we design a Line Segment-based Transformer (Lineformer) as the backbone of SAX-NeRF. Linefomer captures internal structures of objects in 3D space by modeling the dependencies within each line segment of an X-ray. Secondly, we present a Masked Local-Global (MLG) ray sampling strategy to extract contextual and geometric information in 2D projection. Plus, we collect a larger-scale dataset X3D covering wider X-ray applications. Experiments on X3D show that SAX-NeRF surpasses previous NeRF-based methods by 12.56 and 2.49 dB on novel view synthesis and CT reconstruction. Code, models, and data are released at https://github.com/caiyuanhao1998/SAX-NeRF . Our project page at https://caiyuanhao1998.github.io/project/SAX-NeRF/ shows more video and interactive results. An online Gradio demo is available on HuggingFace at https://huggingface.co/spaces/CaiYuanhao/SAX-NeRF
Source:https://arxiv.org/abs/2311.10959PreviousDegradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive ImagingNextRadiative Gaussian Splatting for Efficient X-ray Novel View Synthesis
Related posts
How OpenAI’s Performance Factory keeps ChatGPT fast
0OpenAI Blog
Meta’s AI agent Muse is mixing up conversations and exposing private data, report says
0TechCrunch
Google gives Gemini the ability to use your Mac for you
0TechCrunch
Linkup /research is async. Treating it as synchronous is the bug, in code and in the freeze case
0dev.to
Fuck Your AI Safeguards
0Hacker News
Chrome AI features wasting much bandwidth
0Hacker News