How AI Changed the QA Engineer Job Description

    Matt Watson
    By Matt Watson · CEO of Full Scale, 4x Founder, Author of Product Driven
    9 min read
    A dark background with the text: "AI writes the tests now. Hire for the judgment. How AI Changed the QA Engineer Job Description. Matt Watson - CEO of Full Scale." Digital graphics are shown.
    In this article

    A QA engineer job description usually reads like a tooling list. Writes and executes test cases, knows Selenium or Cypress, experience with test automation, comfortable logging detailed bug reports. That list describes someone who can run tests. Running and even writing tests is the part AI now does well, so the list screens for the wrong thing.

    Here’s the shift nobody updated the job description for: AI doesn’t just write the application code, it writes the tests too. Ask a model to generate a test suite for a feature and it produces something plausible in seconds. That makes “can you write test cases” a weak filter, because the scarce skill is no longer producing tests. It’s deciding what’s worth testing, catching what the AI-generated code and the AI-generated tests both miss, and owning the risk before it ships.

    I run Full Scale, where we staff QA teams for US companies. Here’s what changed about the role, what to require instead, and a template you can copy.

    Stop hiring testers. Start hiring quality engineers.

    This reads like a word game, but I mean it literally.

    For most of the field’s history, a “tester” was the person who executes the test cases. You handed them a feature, they ran it through a script, they logged what broke. That’s the role most QA job descriptions still hire for: a pair of hands that runs the tests.

    That job is shrinking. When AI generates test cases and automation, paying someone mainly to write and run scripted checks is a poor use of the budget. And the code those tests are checking is increasingly AI-written too: Veracode found that 45% of AI-generated code carried a known security flaw, and the bigger, newer models were no safer. More code is shipping faster, and a lot of it is subtly wrong.

    So the role I hire for now is broader. A quality engineer, in the sense that matters, owns the risk: deciding what could go wrong and what it would cost, focusing testing where the danger actually is, probing the product the way a real user would, and judging whether the thing is safe to ship. Writing the checks is one slice of that, and it’s the slice AI helps with most. The judgment is the job.

    The job description has to hire for the risk owner, not the test executor.

    That’s the shift, and it’s why a list of testing tools tells you almost nothing about whether someone can do the work.

    Engineer who codes versus developer who owns the whole arc: the shrinking role and the role to hire for now.

    What a QA engineer actually does now

    A current QA engineer job description should describe a risk owner. Here’s the real shape of the role.

    • Decides what’s worth testing. Testing everything equally is a way to test nothing well. The cost of getting this wrong is enormous: CISQ estimates poor software quality cost the US about $2.41 trillion in 2022. A strong QA engineer points the effort at the risk that matters, not at hitting a coverage number.
    • Tests the way a user would, not just the way the script says. Exploratory testing, edge cases, and the “what happens if I do this weird thing” instinct are exactly what AI-generated test suites miss, because they test what the code was written to do.
    • Reviews the AI’s work, on both sides. This is the new core skill. The application code is often AI-generated and flawed, and the test suite is often AI-generated and incomplete. Someone has to know what good looks like and catch what’s wrong: in the 2025 Stack Overflow developer survey, 66% of developers said their top frustration with AI is code that’s “almost right, but not quite.”
    • Owns release safety, not just bug counts. How something ships matters as much as whether it was tested. The CrowdStrike outage in July 2024 crashed about 8.5 million Windows machines and grounded airlines and hospitals worldwide, and it was a content-validation and staged-rollout failure, not a missing unit test. A modern QA engineer thinks about blast radius and rollout, not just pass/fail.
    • Builds and directs the automation. They still build test automation. But increasingly they’re steering an AI tool through it, which takes a different skill: knowing what to ask for, and knowing when the generated tests give false confidence.

    Notice what’s missing: memorizing tool syntax. A tester who can write a Selenium selector from memory but can’t tell you which part of the product would hurt the most if it broke is the wrong hire now. What you want instead is someone who reasons about risk and reviews carefully, even if they look up the framework along the way.

    Checklist of what a developer actually does today: turns problems into requirements, designs systems, directs and reviews code, owns QA and deployment.

    The skills and requirements that still matter

    You still need a requirements section. Just aim it at the right things.

    Technical foundation (table stakes, not the whole story):

    • Test automation experience (Selenium, Cypress, Playwright, or similar) and API testing
    • A real grasp of testing types: functional, regression, integration, performance, and exploratory
    • Comfort with CI/CD, version control, and reading the application code, not just the UI
    • Comfortable using AI testing tools, and clear-eyed about where they give false confidence

    The skills that actually separate candidates:

    • Risk judgment. Can they look at a release and tell you what’s most likely to break and what it would cost?
    • A user’s instinct. Do they probe the product the way a real, slightly unreasonable user would, or only run the happy path?
    • Quality ownership. Do they think about how something ships and how it’s monitored, or stop at the bug report?
    • Communication. They have to explain a risk to people who don’t want to hear it, and push back on shipping when it isn’t safe.

    The technical list gets you someone who can run tests. The second list is what tells you whether they’ll catch the thing that matters.

    45% of AI-generated code carried a known security flaw, per the Veracode 2025 GenAI Code Security Report.

    Senior versus junior: the gap is wider now

    A senior QA engineer job description and a junior one should look more different than they used to, because AI widened the distance between them.

    A junior used to be slow because they were still learning the tools and writing test cases by hand. AI mostly erased that penalty. What it didn’t erase is judgment, and judgment is the entire senior job. A senior QA engineer knows which failure would be catastrophic, which AI-generated test is quietly checking nothing, and when to tell a team the release isn’t safe. Jay Aigner, a QA founder I had on the podcast, frames QA as the last line of defense, and that line matters more when the code and the tests are both coming out of a machine faster than anyone can read them.

    So weight a senior description toward risk strategy, release safety, mentoring, and owning quality across the product. For a junior role, screen for a testing instinct and curiosity over how many tools they can name. The junior who asks “but what happens if…” is the one worth betting on.

    How we screen for this at Full Scale

    Writing the job description is the easy half. The hard half is telling, from a stack of candidates, who can actually own quality, because anyone can list testing tools on a résumé.

    Building a development team?

    See how Full Scale can help you hire senior engineers in days, not months.

    We screen for it directly. Less than 3% of applicants make it through our process, and the bar isn’t tool trivia. We look at how someone reasons about risk, how they probe a product they’ve never seen, and how they judge AI-generated code and tests without trusting either by default. The same thinking runs through how we approach software testing strategies for clients.

    A trained team also beats a fresh job posting on speed. Our engineers go through an internal AI upskilling program, the Spartan Training Academy, so they aren’t guessing at how to use these tools. AI made it cheap to generate code and tests. It made the person who can tell you whether any of it is actually safe to ship more valuable than ever.

    How to write the developer job description: lead with judgment, product thinking, and ownership, not framework trivia.

    A QA engineer job description template you can use

    Here’s a copy-paste template built for the role as it exists now. It leads with risk and judgment on purpose, and keeps the tooling at the bottom where it belongs. Edit the bracketed parts and cut what doesn’t apply.

    Job title: QA Engineer (or Senior QA Engineer)

    About the role:

    We’re looking for a QA engineer who owns quality and risk, not just test execution. You’ll work with [team/product] to decide what’s worth testing, probe the product the way a real user would, review AI-generated code and tests, and judge whether what we build is actually safe to ship.

    What you’ll do:

    • Decide what to test based on risk, not coverage numbers
    • Run exploratory testing and find the edge cases automation misses
    • Review AI-generated application code and test suites critically
    • Build and maintain test automation where it pays off
    • Own release safety, from rollout strategy to monitoring, not just bug reports

    What we’re looking for:

    • Strong risk judgment: you can say what would hurt most if it broke
    • A real user’s testing instinct, beyond the happy path
    • Quality ownership across how something ships, not just whether it passed
    • Clear communication and the confidence to push back on an unsafe release
    • A solid technical floor: test automation ([N]+ years), API testing, CI/CD, and the testing types above

    Nice to have:

    • [Domain experience, e.g. fintech, healthcare, where failure is expensive]
    • Performance or security testing experience
    • Experience reviewing or testing AI-generated code

    Use it as a starting point. The bullets that decide your hire are the risk and judgment ones at the top, so keep them there.

    Frequently asked questions

    What does a QA engineer do?

    A QA engineer makes sure software is safe to ship. That used to mean writing and executing test cases; it now means deciding what’s worth testing based on risk, running exploratory testing, reviewing AI-generated code and tests for what they miss, and owning release safety, not just logging bugs.

    What should a QA engineer job description include?

    It should include the core technical requirements (test automation, API testing, CI/CD, and the main testing types), plus the skills that actually separate good hires now: risk judgment, a real user’s testing instinct, quality ownership across how something ships, and the ability to review AI-generated code and tests. Lead with the second set, not the tooling list.

    How has AI changed what to look for in a QA engineer?

    AI now generates both application code and test suites, so writing tests is no longer the scarce skill, and there’s more flawed code shipping faster. The value moved to judgment: deciding what’s worth testing, catching what AI-generated tests miss, and owning whether a release is safe. Screen for risk thinking over tool knowledge.

    What’s the difference between a manual and an automated QA engineer now?

    The old split mattered when writing automation was slow and manual testing was the fallback. AI changed both: automation is faster to generate, and the human value in “manual” testing was always the exploratory, risk-based judgment, not the clicking. Hire for that judgment, and expect a strong QA engineer to use automation as a tool rather than identify as one type.

    What’s the difference between a senior and a junior QA engineer job description?

    A senior description should emphasize risk strategy, release safety, mentoring, and owning quality across the product. A junior one should screen for a testing instinct and curiosity rather than how many tools the candidate can name. AI widened the gap by erasing the speed penalty of writing tests by hand while leaving risk judgment, the senior skill, untouched.

    Write the description for the job you actually have

    The job changed, so the job description has to change with it.

    If yours still leads with a list of testing tools and finishes with “writes detailed bug reports,” it measures the commodity part of the role while the part that actually decides whether the hire works out goes unmentioned. Lead with risk judgment, a user’s instinct, and quality ownership. Treat the tooling as the floor, not the ceiling.

    And if you’d rather skip the part where you screen a hundred candidates to find the one who can actually own quality, that’s what we do. Talk to us about building your QA team, and we’ll put pre-vetted quality engineers in front of you who already work this way.

    Get Product-Driven Insights

    Weekly insights on building better software teams, scaling products, and the future of offshore development.

    Subscribe on Substack

    Ready to add senior engineers to your team?

    Book a 15-minute call. Tell us your stack and where the gaps are, and we'll show you the engineers we'd put on your team.