Backend
VerifyPrompt: Towards Text-to-Image Models Verification Behind Black-Box APIs
arXiv cs.CR0 views
arXiv:2410.22725v5 Announce Type: replace-cross Abstract: With the rise of diverse Text-to-Image (T2I) models such as DALL-E 3, third-party platforms increasingly integrate multiple black-box APIs to deliver cost-effective services. This also raises a new and practical security question: are these third-party platforms truly offering the models they claim? Such model substitution fraud, in which a malicious third-party platform operator acts as the adversary, enables the platform to profit illicitly while undermining user interests and damaging the commercial reputation of legitimate model providers. To address this practical concern, we first define the task of T2I model verification, which determines whether a black-box target model matches a black-box oracle reference model. After that, we propose VerifyPrompt, which performs T2I model verification through a specially designed verify prompt. Intuitively, the verify prompt is an adversarial prompt for the target model, without transferability to other models. It makes the target model generate a specific image while making other models produce entirely different images. Our key idea for generating verify prompts is to enforce strong interactions between adversarial perturbations and the target model, thereby overfitting the target and producing model-specific perturbations. To enable efficient black-box search for verify prompts, we further introduce VerifyPrompt-RL, a reinforcement learning-based strategy that leverages multi-sample exploration and group relative error estimation to stabilize and accelerate the search process. Experiments show that VerifyPrompt achieves over 90\% accuracy across various T2I platforms, confirming its effectiveness in real-world third-party services.
Source:https://arxiv.org/abs/2410.22725PreviousI2I Backdoor: Backdoor Attacks against Image-to-Image TasksNextSoK: Market Microstructure for Decentralized Prediction Markets (DePMs)
Related posts
Can You Really Pentest Any Site with ARTEX AI?
0dev.to
Keeping n8n maintainable as a small team: sub-workflows, naming and a few house rules
0dev.to

Claude Jira: Built for Tickets, Slow at Team Metrics
0dev.to
Rent, License or Build a Multi-Asset Trading Terminal: What the Company Owns and When to Switch
0dev.to
The AI Verification Gap: Review AI Code Without Rubber-Stamping It
0dev.to
Why Your Next.js App Overflows PostgreSQL Connections (And How to Fix It)
0dev.to