AI & ML
Synthesizing hyperspectral Data using generative Models to train spectral Unmixing Methods for low-cost Crop Residue Cover Mapping
arXiv eess.SP0 views
arXiv:2611.24827v1 Announce Type: cross Abstract: The spectral range of the Field Imaging Nanosatellite for Crop residue Hyperspectral Mapping (FINCH), developed by the University of Toronto Aerospace Team's Space System Division, poses significant challenges for hyperspectral unmixing to determine crop residue cover fractional abundances. The severe lack of standard indices necessitates the use of complex, data-driven unmixing models. Complex unmixing models require dense, well-distributed manifolds, whereas ground-truth datasets are sparse and expensive. To better leverage the information content in existing ground-truth datasets, this study presents a framework that decouples interpolation and abundance-mapping estimation via an intermediary conditional data generator, contrasting with traditional single-model unmixing pipelines. This decoupling enables the inclusion of physical prior knowledge about spectra, which is not natively accessible to unmixing models, thereby artificially expanding the dataset to serve as a Monte Carlo approximation of the population risk. To test this hypothesis, we have proposed two generator models: a 1D Conditional U-Net with Conformer Layers (GD-Streamline) and a Dual-Path Transformer Conditional Variational AutoEncoder (TCVAE), and two unmixing models: Multi-Layered Perceptrons (MLP) and Fourier Neural Operators (FNO). The results of the study indicate a need for rigorous integration and introduction of spectral priors within the scope of the proposed decoupling framework to prevent domain and mode collapse and hallucination by the generator models; otherwise, this leads to falsely approximated data manifolds, ultimately resulting in unsatisfactory and out-of-distribution unmixing performance.
Source:https://arxiv.org/abs/2611.24827PreviousFrom Points to Trajectories: Rethinking Multimodal Alignment for Physical EventsNextChirp-Permuted AFDM: A Versatile and Multifunctional Waveform for 6G
Related posts
Streaming Generative Video Compression with Embedding Alignment and In-Context Propagation
0arXiv eess.IV
Beyond Accuracy: Benchmarking Uncertainty Quantification in Retinal Disease Screening
0arXiv eess.IV
CiGS: Conduction in Gaussian Splats for Interior Temperature Field from Thermal Images
0arXiv cs.GR
Probing Physics in Motion Diffusion Models Against Their Own Estimate
0arXiv cs.GR
NIRJALA: Draining the Sea out of Gaussian Splatting with Three-Path Optics and Reversible Physics
0arXiv cs.GR
How Music LLMs Actually Work: From Tokens to Waves (MusicGen, DiT, and Building Your Own Engine)
0dev.to Machine Learning