AI & ML
Agents as Architecture Evaluators: Automating ATAM and SAAM for Continuous Assessment
arXiv cs.SE0 views
arXiv:2611.23278v1 Announce Type: new Abstract: The long-term success of a software system relies heavily on its underlying architecture, which dictates its performance with respect to quality attributes. Software Architecture Evaluation methods, such as the Architecture Tradeoff Analysis Method (ATAM) and the Software Architecture Analysis Method (SAAM), are widely recognized for their ability to mitigate risks and ensure reliable quality attributes. However, their widespread adoption remains limited due to the significant cost, time, and human expertise required for these processes. This paper investigates the potential of agentic AI to lower these barriers and facilitate architectural assessment. To enable this preliminary study, we established a dataset by extracting human conducted evaluations from existing academic literature into a structured format. Using this dataset, we developed an agentic workflow to synthesize ATAM and SAAM evaluation reports based on these high level architectural descriptions. This approach simulates the reasoning process of human evaluators when provided with structured architectural data. We validated the approach using automated metrics and human evaluation. Agentic workflows achieve strong relevance and completeness ratings of 4.5/5 and 3.9/5 respectively. The agents successfully automated the labor-intensive phases of scenario generation and risk identification, reducing the evaluation time from weeks to under 5 minutes at a cost of less than $0.50 per run. The results confirm that agentic AI effectively lowers adoption barriers, enabling continuous, high-coverage architectural assessment.
Source:https://arxiv.org/abs/2611.23278PreviousEvidence-Carrying Contracts for Safe Claim Composition in Data Marketplace WorkflowsNextLog Analysis for LLM-Based Agents: A Lifecycle-Oriented Survey
Related posts

How I Built an Offline Voice Dictation App Using Small AI Models
0HackerNoon
FAA's $50 Billion Modernization Push Faces a Problem Money Alone Can't Fix
0HackerNoon
Why AI Agent Security Starts With Permissions, Not Prompts
0HackerNoon

I Let My AI Agent Take Over My Life. Then It Started Making Decisions for Me
0HackerNoon

Does Options Delta Really Predict the Probability of Expiring In the Money?
0HackerNoon
Building Offline AI on Android: 5 LiteRT-LM Pitfalls and Fixes
0HackerNoon