AI & ML
FoundCause: A Foundation Model for Causal Discovery with Latent Confounders from Observational Data
arXiv stat.ML0 views
arXiv:2606.17516v2 Announce Type: replace-cross Abstract: Causal discovery from observational data requires recovering directed relations and latent confounding without interventions. We propose FoundCause, an {\em amortized causal discovery foundation model} trained only on synthetic structural causal models that maps datasets to causal graphs in a single forward pass. A permutation-equivariant transformer alternates attention over samples and variables to model cross-variable dependence and per-variable distributions. Pairwise dependence and asymmetry statistics guide its attention, edge decoder and confounder module. The decoder separates edge existence from direction, while triangular refinement incorporates evidence from chains and colliders. Learnable latent tokens predict which variable pairs share a hidden common cause, and a masked input representation handles missing data. To our knowledge, FoundCause is the first amortized causal discovery approach for i.i.d. observational data to predict latent confounding as a separate, explicit output. On 14 real-world and semi-synthetic datasets, FoundCause leads 11 classical and 7 amortized baselines in average AUROC, $F_1$, skeleton $F_1$, and normalized structural Hamming distance ($\mathrm{SHD}/d$): clearly in $\mathrm{SHD}/d$ ($0.875$ vs.\ $0.956$), narrowly in $F_1$ ($0.531$ vs.\ $0.516$). It also has the highest accuracy among amortized methods on bivariate cause--effect pairs.
Source:https://arxiv.org/abs/2606.17516PreviousGraph Cascades: Contagion-Based Mesoscopic Rewiring for Structure-Aware Graph Machine LearningNextRepresentation Learning with Quantum Signal Processing
Related posts

AMD’s Twitter brag that it ‘loves gamers’ met with savage Community Note
0Tom's Hardware

Zane Lowe shares Apple Music Radio audience numbers, recalls ‘crickets’ in the early days
09to5Mac

Google launches Gemini 4 Neon with Carbon quality at Flash speeds, live for AI Pro
09to5Google
One sentence stopped my AI agents inventing data. Bad data that looked normal still fooled them.
0dev.to

How many tokens per second should an LLM serve on one GPU?
0dev.to
The 3 Lies Your AI Coding Agent Tells You Every Day (And How to Verify Them with Deterministic MCP Gates)
0dev.to