Everyone is shipping apps built with AI now. I am too - it's the fastest way I know to go from idea to a live URL. But after building a small security scanner and running it against thousands of real, publicly listed AI-generated websites, I now look at my own deploys very differently.
Here's the data first, then the lessons.
The dataset
My side project AppSeal scans a live site with 125 checks: security headers, exposed secrets (.env, .git, AI/cloud/payment API keys), TLS config, cookies, broken links, admin panels, and basic DNS hygiene.
We collected 6,348 unique hosts from public portfolios, launch pages and "built with X" galleries, then scanned each one.
The results
| Grade | Sites | Share |
|---|---|---|
| A+ | 20 | 0.3% |
| A | 264 | 4.2% |
| B | 1,266 | 20% |
| C | 3,626 | 57% |
| D | 1,103 | 17% |
| E | 69 | 1% |
- Average score: 60/100
- Only 1 in 22 sites reaches A or better
- 94% of live sites fail at least one basic security header check
The most common header gaps across scanned sites:
| Missing / weak | Share of sites |
|---|---|
| COOP | 83% |
| Permissions-Policy | 80% |
| X-Frame-Options | 74% |
| CSP | 74% |
| Referrer-Policy | 63% |
| HSTS | 46% |
And the genuinely scary one: a number of sites exposed .env files or had live API keys for AI/cloud providers sitting in client-side code. We flag those as critical severity, and they are one-line mistakes.
Why this happens
AI builders (v0, Lovable, Bolt and friends) optimize for an amazing first screen. They don't set security headers, and they don't know which of your keys are "demo" and which are real. Neither does the person shipping the project on a Sunday evening - that's not a dig, that's exactly why I built the scanner.
Three fixes that cover most of the gap
- HSTS + basic headers in one place. If you're on Vercel, a
vercel.jsonwith aheaders()block covers X-Frame-Options, X-Content-Type-Options, Referrer-Policy, HSTS and Permissions-Policy in five lines. - CSP, even a modest one. For a static-ish site a meta CSP is fine to start. Locking
script-srcdown removes the whole class of injected-scripts problems. - Never ship real keys in client code. "But it's a free-tier key" - scanners and bots don't care, and free tiers get abused for mining.
Try it
The scanner is free, one domain, no signup: appseal.online. Full aggregated stats live here: appseal.online/stats. It's a solo project, so honest feedback on the report UI is very welcome.






