AI & ML
Operating an Agent-Driven Dataset Factory: Discovery, Construction, and Public Release
arXiv cs.SE0 views
arXiv:2611.21957v1 Announce Type: new Abstract: Turning public data into prediction datasets requires connecting source discovery, task definition, construction, and distribution. We deployed Dataset Factory to perform these steps continuously under a standing release policy. Bounded language-model tasks interpret sources, write construction code, and review task meaning; deterministic software manages state, workers, retries, and publication. Over 81.53 hours, the factory published 14 datasets at an estimated recurring operating expenditure of about \$2.74 per publication. The accounting includes failed attempts, inference, workers, and hosting. Separate agents completed prediction experiments on all twelve evaluated releases. Source review nevertheless identified a task whose construction filters contradicted its population declaration. The original reviewer accepted later-record exclusions without reconciling them with the published selection rule. This experience documents an operating source-to-release workflow and shows why successful execution and consumer use need separate checks of task meaning.
Source:https://arxiv.org/abs/2611.21957PreviousEmbedGym: Letting Coding Agents Develop and Debug Embedded Firmware Without Physical HardwareNextAgent Trajectories as Evidence for Software Quality Assurance
Related posts
Web-Perf Wednesday 018 – Soft Navigations Lift the CrUX Pass Rate
0CSS Wizardry

‘It’s a risk’: How Rockstar built the most detailed (and romantic) GTA yet
0The Verge
China dominates battery graphite, but this startup could break the monopoly
0TechCrunch
AI visibility: mentions, recommendations and citations need separate checks
0dev.to
Background AI Makes Inference a Scheduling Problem
0dev.to

DeepSeek vs Claude vs Kimi vs Codex vs Gemini: A 70-Call AI Ethics Test
0dev.to