Engineering brief

AI attacks move in minutes, so yearly pentests are no longer enough

AI Engineer3 min read · saves 16 min

At a glance

The brief is enough

Relevance
Practical value
Radar
Time horizon
This year
Warnings
  • High hype
  • Vendor pitch

Snyk says AI attackers now breach systems in minutes and 62 percent of agent output is insecure. Its answer is continuous AI pentesting on every pull request.

Security testing cadence is becoming an engineering delivery decision as AI-generated code and AI-powered attacks accelerate.

Watch if you are choosing an AI pentest vendor, or your team ships agent-generated code and still relies on annual penetration tests.

Summary

The pressure point. Snyk's data puts the problem in numbers: 218 percent more lines of code per developer, and 62 percent of LLM output insecure or broken. Even if vendor-defined, the direction matches what leaders already see: agent-generated code lands faster than security review can absorb it. The result is a backlog growing faster than remediation. This tension frames the talk.

The accelerated attacker. The talk claims AI attackers chain low-severity issues into critical exploits. One cited model breached 600 firewalls across 555 countries; that number should be treated with suspicion. The useful signal is speed: average successful AI attack in 24 to 34 minutes, fastest in four, and 43 percent of MCP servers carrying vulnerabilities. None of this is independently verified, but the direction is plausible: automated attackers do not wait for the next pentest.

The broken baseline. Cohen walks through the classic stack: SAST is cheap but blind to runtime issues like broken object level authorization; DAST throws payloads at endpoints but misses business logic; human pentesters understand context but cost too much, run once or twice a year, and deliver PDFs developers must triage. That model was designed for slow release cycles. With agents shipping code continuously, an annual test leaves hundreds of days uncovered.

The product pitch. Snyk EVO is presented as an LLM-native replacement: an orchestrator plans, a recon agent maps endpoints and APIs, specialized agents test vulnerability classes, a judge validates exploitability, and remediation plus reporting close the loop. Differentiators are continuous execution on every pull request and context from SAST, DAST, and other scanners fed into the LLM. That context-first claim is the most credible part. It is also a vendor pitch.

The buying criteria. The most reusable content is four questions for any AI pentest vendor: is it continuous, does it reason about application context, what context can it consume, and does it prove a bug is exploitable or just flag it. That is a useful procurement checklist. The tradeoff is unstated: continuous agent pentesting on every code change will generate signal, but also cost, noise, and remediation pressure. The architecture is sensible; the evidence is not measured.

What to watch. Engineering leaders should treat this as an early signal, not an imperative. The gap between point-in-time pentests and continuous attacks is real, but Snyk presents no independent benchmark, production failure data, or false positive rate. Pilot a bounded service, track whether reported exploits are real and fixable, and compare against current review costs before committing. The problem is urgent; the specific product remains unproven.

My take

I agree with the direction: point-in-time pentesting is too slow for agent-paced development. The part I'd push back on is the certainty. Snyk's numbers, 62 percent insecure output and four-minute breaches, are built to scare you, not to help you plan. I'd be careful with any vendor that leads with attack speed instead of false positive rates. Continuous testing has real operational cost: every reported exploit needs triage, remediation, and ownership. The four vendor questions are the practical takeaway. I'd run a bounded pilot against one critical API and measure how many findings are exploitable and fixable before buying. The security problem is real. The urgency should come from your own backlog, not a product launch.

What to do with this

  1. Ask security leadership which critical applications still rely on annual pentests and what the last false positive rate was.
  2. Run a bounded AI pentest pilot on one internal API and require exploitability proof for every finding before triage.
  3. Review CI release cadence and decide whether security testing should run on every pull request or every release.

Watch the video

This video is blocked due to your privacy settings. To watch this video, please accept YouTube marketing cookies.

Related breakdowns

Get TL;DW

Too Long; Didn't Watch.

A concise breakdowns of the AI and devtools videos that actually matter for engineering leaders.

Free. Weekly. No hype.

Video and thumbnails remain the property of their respective creators. tldw.news provides editorial analysis, commentary, and discovery links to original content.