Backend
Generative AI in Software Testing: Practitioners' Perspectives on the Benefits, Challenges, Opportunities, and Risks
arXiv cs.SE0 views
arXiv:2611.23256v1 Announce Type: new Abstract: Generative Artificial Intelligence (GenAI) increasingly supports software testing, yet empirical evidence on practitioners' perceptions remains limited. This study investigates perceived benefits, challenges, opportunities, and risks of GenAI in software testing through a questionnaire survey of 64 practitioners. Closed-ended responses were analyzed descriptively, while open-ended responses were qualitatively coded to contextualize the findings. Among the respondents, 34 were users (those with regular or experimental use of GenAI in testing) and 30 were non-users (those without prior use of GenAI in testing). Results show generally positive perceptions of GenAI for reducing effort, test generation, and debugging, alongside concerns about prompt dependence, trust, and incorrect outputs. Users were more positive about several concrete benefits while also more frequently prioritizing reliability-related risks, whereas non-users showed greater uncertainty about some technically specific challenges. Overall, the findings position GenAI as an assistive technology requiring human validation and highlight the importance of considering practitioners' experience with GenAI when interpreting perceptions of GenAI-assisted testing.
Source:https://arxiv.org/abs/2611.23256PreviousMeasuring What Matters in the Age of AI: The Research Software Metrics LandscapeNextStatePortal: Agentic Checkpoint Synthesis for Testing Deep States in Interactive Software
Related posts
Bad Genius: Counterfactual-Guided Harness Evolution Beyond Task-Specific Shortcuts
0arXiv stat.ML
Kinetic Langevin Splitting Schemes for Constrained Sampling
0arXiv stat.ML
From Data to Action: Accelerating Refinery Optimization with AI
0arXiv stat.ML
Equivariant Modeling with Polynomial Features via Minimal Homogeneous Generators
0arXiv stat.ML
Latent Action Policies from Suboptimal Data
0arXiv stat.ML
SoK: Market Microstructure for Decentralized Prediction Markets (DePMs)
0arXiv cs.CR