The Limitations of LLMs in Autonomous Vulnerability Discovery and Prioritization
Current research from IBM, the NDSS Symposium, and Boston University's PEAC Lab indicates that Large Language Models (LLMs) are fundamentally insufficient for autonomous vulnerability discovery and risk-based prioritization. While LLMs demonstrate pattern recognition capabilities, they suffer from high false-positive rates and a systemic lack of architectural context, preventing them from understanding how vulnerabilities interact with specific deployment environments. This creates an "automation paradox," where the volume of unverified LLM-generated findings increases the manual verification workload for Application Security (AppSec) professionals. Furthermore, models demonstrate a critical failure in reasoning about actual exploitability, making them unreliable for determining the real-world risk of identified security flaws.