Automata.
    6 min read

    AI writes the code now. That's exactly why you need senior engineers.

    Generative AI made software cheaper to produce and easier to get wrong. The bottleneck moved from writing code to knowing which code is right. Here's why the human in the loop matters more than ever, not less.

    Marc Ghannam

    Marc Ghannam

    Co-Founder & Engineer

    Share
    Senior engineers collaborating over code at a workstation in a modern office.

    Summarize this article with AI

    Key takeaways

    • AI has made writing code fast and cheap. It has not made deciding what to build, or knowing when it's correct, any easier.
    • Studies find a large share of AI-generated code ships with security flaws, and developers trust it more than the evidence warrants.
    • The scarce thing is no longer code. It's judgment. AI-powered, human-led is the model that ships software you can actually trust.

    Every founder we talk to has seen the demo. A prompt, a few seconds, and a working app appears. The natural conclusion is that software is now cheap and engineers are optional. The first half is true. The second half is where companies get hurt.

    AI has collapsed the cost of producing code. It has done almost nothing to lower the cost of producing the wrong code, shipping an insecure system, or maintaining a codebase nobody understood in the first place. Those costs are still paid by humans, and they are going up.

    What AI is genuinely good at

    We use AI on every engagement, and it is not a gimmick. It writes boilerplate, scaffolds features, drafts tests, and explores approaches faster than any human can type. On the right tasks, with the right supervision, it is a real multiplier. We ship more, sooner, because of it.

    That is the AI-powered half of how we work. The other half is the one that decides whether the software actually works.

    What AI is quietly bad at

    The model is a confident pattern-matcher. It will produce code that looks right, compiles, and passes a casual glance, while hiding a security hole, a race condition, or an assumption that breaks the moment real users arrive. It does not know your business, your edge cases, or what happens at scale. And it will never tell you that the feature you asked for is the wrong feature.

    • Security. In published tests, a large share of AI-generated code contained exploitable vulnerabilities, and developers using AI assistants wrote less secure code while feeling more confident about it.
    • Correctness at the edges. AI handles the happy path well and the unusual cases poorly, which is precisely where production software lives or dies.
    • Maintainability. More code, faster, means more code to review, refactor, and eventually rewrite. Industry data shows churn rising, not falling.
    • Judgment. It will never tell you to build less, ship later, or cut the feature. That call is yours, and ours.

    AI writes more code. Not always better code.

    76%

    of developers use or plan to use AI coding tools

    Stack Overflow, 2024

    ~40%

    of AI code suggestions were insecure in security tests

    NYU, 'Asleep at the Keyboard'

    2x

    projected rise in code churn as AI tools spread

    GitClear, 2024

    Adoption is near-universal. Trust is running ahead of the evidence, and that gap is exactly where a senior reviewer earns their keep. Source: Stack Overflow Developer Survey 2024; Pearce et al. (NYU); GitClear.Automata.

    Human-led is the differentiator now

    When anyone can generate code, the scarce thing is no longer the code. It is the judgment to architect a system that lasts, to catch the security flaw the model introduced, to say no to the feature that adds risk without value, and to own the result when it ships. That judgment comes from senior engineers who have built real systems and lived with the consequences.

    The hard part of software was never typing. It was deciding what to build and knowing when it's right. AI made the typing free. It made everything else more valuable.

    That is what AI-powered, human-led means in practice. We let AI move us fast, and we put senior engineers in front of every decision that matters: architecture, security, scope, and the final call on whether something is ready for your users. You get the speed of the new tools and the judgment that keeps them from hurting you.

    What this means for you

    If a vendor's pitch is essentially that AI builds it, so it's cheap, be careful. You may be buying speed with no one accountable for correctness. The right question is not whether your team uses AI. Everyone does now. It is who is reading what it produces, and whether they are senior enough to catch what it gets wrong.

    Frequently asked questions

    Yes, on every engagement, for the work it is genuinely good at: scaffolding, boilerplate, tests, and exploring approaches quickly. It makes us faster. But a senior engineer reviews and owns everything that ships, especially architecture and security. AI accelerates the work; it does not get the final say.

    Marc Ghannam

    Written by

    Marc Ghannam

    Co-Founder & Engineer

    Senior full-stack engineer. Led engineering at a Series A blockchain and AI company and ran a consulting practice advising teams on technical delivery and go-to-market.

    Share

    Newsletter

    Notes from the team, in your inbox.

    Occasional, practical writing on building software and hiring engineers. No spam, unsubscribe anytime.

    Ready when you are

    Tell us what you're building.

    Thirty minutes with the engineers who'd do the work. Bring the problem you're trying to solve and we'll tell you, honestly, whether and how we can build it.

    14 years shipping production softwareAI-powered, human-ledBoston based