Backend
Exploring the Privacy--Size Tradeoff for Differentially Private Self-Attentive Variational Autoencoders
arXiv cs.CR0 views
arXiv:2611.05582v1 Announce Type: cross Abstract: Data tends to be most useful when it is shared, and the data most worth sharing is often the data that privacy obligations restrict. Synthetic data from a generator trained under differential privacy (DP) is one way to reconcile the two, but its utility depends on the privacy budget $\varepsilon$ and on how much data the generator sees - a parameter that most data sharing applications of synthetic data control. We present SAVANT, a self-attentive variational autoencoder for tabular data trained with DP-SGD that, to our knowledge, is the first to combine attention, a VAE, and DP in one tabular model. We evaluate it against two marginal mechanisms, PrivBayes and MST, jointly over the privacy budget and the dataset size on two public datasets, measuring the utility a downstream classifier loses by training on synthetic rather than real data. We find that, under the same DP guarantee, more data generally means more utility. For the marginal mechanisms it absorbs most of what a strict budget costs, and a noise-scaling argument suggests DP-SGD exchanges data fo budget at a worse rate. Two independent membership-inference attacks, judged against a measured null, found no aggregate membership signal.
Source:https://arxiv.org/abs/2611.05582PreviousFrom Claws to Conferences: Device-Independent Key Agreement Beyond Non-SignalingNextGeneralized Hyperrectangular Prediction Sets in Multivariate Conformal Prediction
Related posts
TAGR: Temporally Adaptive Generative Recommendation for Industrial Live-Streaming Advertising
0arXiv cs.IR
ArcRAG: Agentic Compositional Retrieval over Knowledge Graphs
0arXiv cs.IR
From Waste to Discovery: Recycling High-Scored Unexposed Candidates in Taobao Feed Recommendation
0arXiv cs.IR
Toward a Compositional Knowledge Architecture for a Shared Organizational Cortex
0arXiv cs.IR
Turbocharging PiPNN for Proximity and $k$-NN Graph Building
0arXiv cs.IR
Combining Relevant Expert Knowledge Using Mixtures of Feedback Fuzzy Cognitive Maps
0arXiv cs.IR