Open Source
HDNet: High-resolution Dual-domain Learning for Spectral Compressive Imaging
arXiv eess.IV0 views
arXiv:2203.02149v3 Announce Type: replace Abstract: The rapid development of deep learning provides a better solution for the end-to-end reconstruction of hyperspectral image (HSI). However, existing learning-based methods have two major defects. Firstly, networks with self-attention usually sacrifice internal resolution to balance model performance against complexity, losing fine-grained high-resolution (HR) features. Secondly, even if the optimization focusing on spatial-spectral domain learning (SDL) converges to the ideal solution, there is still a significant visual difference between the reconstructed HSI and the truth. Therefore, we propose a high-resolution dual-domain learning network (HDNet) for HSI reconstruction. On the one hand, the proposed HR spatial-spectral attention module with its efficient feature fusion provides continuous and fine pixel-level features. On the other hand, frequency domain learning (FDL) is introduced for HSI reconstruction to narrow the frequency domain discrepancy. Dynamic FDL supervision forces the model to reconstruct fine-grained frequencies and compensate for excessive smoothing and distortion caused by pixel-level losses. The HR pixel-level attention and frequency-level refinement in our HDNet mutually promote HSI perceptual quality. Extensive quantitative and qualitative evaluation experiments show that our method achieves SOTA performance on simulated and real HSI datasets. Code and models will be released at https://github.com/caiyuanhao1998/MST . An online Gradio demo is available on HuggingFace at https://huggingface.co/spaces/CaiYuanhao/MST
Source:https://arxiv.org/abs/2203.02149PreviousMask-guided Spectral-wise Transformer for Efficient Hyperspectral Image ReconstructionNextDegradation-Aware Unfolding Half-Shuffle Transformer for Spectral Compressive Imaging
Related posts
ZKStamp Proof-100
0Hacker News New
Show HN: Process Watch – Monitor remote jobs and notify Codex when they finish
0Hacker News Show
Show HN: Forbear is a immediate mode GUI library that looks like the web
0Hacker News Show
Show HN: MCP-Sentry v2.0 – Zero-dependency firewall and audit proxy for MCP
0Hacker News Show
Nod Launches as an Open-Source Personal Agent for Local, User-Controlled AI
0dev.to
Show HN: Galaxy-Viz: An interactive 3D visualization of a research-paper network
0Hacker News Show