Open Source
Multimodal Judges Flag, Humans Decide: A Review-and-Edit Framework for AI-Generated Product Video Ads
arXiv cs.HC0 views
arXiv:2611.13178v1 Announce Type: cross Abstract: Generative pipelines can now turn every product page of an e-commerce catalog into a short video ad, but deciding whether such an ad is usable is not one good-or-bad call. We describe how we operationalized the review and editing of these ads so that both can keep pace with generation: reviewers go through each ad scene by scene and answer six questions, on the product, scene quality, pronunciation, script, sound and captions; judges built from vision-language, speech and language models file each finding under the matching question, and reviewers accept or reject each finding and add what the judges missed. Each confirmed issue then opens an edit tool matched to it. The questions and the routing from a finding to its fix do not depend on the models that generate the ad. Across 120 ads from our pipeline, reviewed with judge findings on screen, reviewers marked the product wrong on 60% of scenes, and script, caption or sound problems on under 10% each. On 60 of these ads, they marked the product wrong on 58% of scenes, far more than the 26% marked by two reviewers who later saw the ads with the judges hidden; one reviewer who saw the ads both ways marked 57% with judge findings and 19% without. On 120 blind-labeled scenes, a product judge that watches the clip with the catalog photos reached AUC 0.84, while video-quality and photo-similarity scores were close to chance. We tune the judges for recall: the product judge catches nearly all defects but also flags many clean scenes, so reviewers decide; together, the judges widen what reviewers mark and reviewers add what the judges miss. Without judge findings, one reviewer's marking faded over a session. We release a review-portal template and our review data (120 ads and 562 scenes with judge findings and human marks, plus 120 blind-labeled scenes with baseline scores) at https://github.com/anoubhav/ad-review-and-edit.
Source:https://arxiv.org/abs/2611.13178PreviousTrust, but verify, audit and attribute: a human-in-the-loop framework for checking AI-produced research resultsNextMicroLens: Read, Trace, and Rewire the Residual Stream with Two Lenses
Related posts

Reverse Engineering Tools: A Free Starter Kit for Your First Binary
0dev.to
Software Refactoring Research with Large Language Models: A Systematic Literature Review
0arXiv cs.SE
Antalia-2 Mini: A 7.6-million-parameter Turkish text-to-speech model trained entirely on synthetic speech
0arXiv cs.SD
Emilia2: A Large-Scale Dataset for Controllable Long-Form Speech Generation
0arXiv cs.SD
Asymptotically good codes from Siegel modular varieties
0arXiv math.IT
On the Concavity of R\'enyi Entropy and R\'enyi Entropy Power along Heat Flows on Manifolds
0arXiv math.IT