Backend
Identifying and Mitigating API Misuse in Large Language Models
arXiv cs.SE0 views
arXiv:2503.22821v3 Announce Type: replace Abstract: API misuse in code generated by large language models (LLMs) presents a serious and growing challenge in software development, as although LLMs demonstrate impressive code generation capabilities, their interactions with complex library APIs are often error-prone and can lead to software failures and vulnerabilities. In this paper, we conduct a large-scale study of API misuse patterns in LLM-generated code by analyzing both method selection and parameter usage across Python and Java, using three representative LLMs: StarCoder-7B, Qwen2.5-Coder-7B, and GitHub Copilot. Based on extensive manual annotation of 3,209 method-level and 3,492 parameter-level misuses, we identify and categorize four recurring misuse types by building on and refining prior API misuse taxonomies. Our evaluation of the three LLMs reveals persistent challenges in API usage, particularly hallucination and intent misalignment. To address these issues, we propose Dr.Fix, an LLM-based automatic repair approach guided by our taxonomy, which improves repair accuracy compared to baseline prompting and existing repair methods, achieving gains of up to 38.4 BLEU and up to 72 more exact matches on benchmark datasets. This work offers important insights into the current limitations of LLMs in API usage and points to directions for improving automated misuse repair in code generation systems.
Source:https://arxiv.org/abs/2503.22821PreviousA Taxonomy of Real Faults in Hybrid Quantum-Classical ArchitecturesNextTraining Language Model Agents to Find Vulnerabilities with CTF-Dojo
Related posts

Your LLM Wiki Compiles Away Your Permissions. Design for It Before the Team Uses It.
0dev.to OpenSource
Three more tools, three more countries: Brunei's new pension fund, Mongolia's salary tax and a Punjabi calendar that starts in March
0dev.to OpenSource
Why Chrome's 'Sanitized HAR' Export Still Leaks API Keys, Query Tokens & GraphQL Variables
0dev.to OpenSource
The runtime was as big as my 2.6 MB PII model, so I wrote a 13 KB inference engine
0dev.to OpenSource
I built Trongate CLI, a command-line toolkit for the Trongate PHP Framework
0dev.to OpenSource
sheet_route: Flutter bottom sheets as real routes, with snap points and go_router pages
0dev.to OpenSource