Strategic versus tactical roles in Artificial Intelligence (AI)-augmented…
Strategic versus tactical roles in Artificial Intelligence (AI)-augmented software teams: division of labour, daily design investment, and the cost of bad code at scale
- The strongest available evidence, even allowing for the competing hypothesis that better specifications and verifiers could shift more strategic work to AI, still supports a strategist-builder split in which humans own architecture, interfaces, context, and verification policy, while AI executes bounded implementation tasks inside those constraintsBeck (2025)Anthropic (2025)GitHub (2025)Mitchell (2026)Wang et al. (2023)
- Clarification and investigation before execution are the most directly evidenced ways to improve human-AI collaboration, because they reduce guessing before code or debugging advice is emitted and measurably improve correctness or resolution qualityWang et al. (2023)Miao et al. (2025)Research (2024)Mitchell (2026)
- AI coding tools deliver genuine tactical gains on bounded work, including faster completion, better unit-test performance, and quicker code-review cycles when tasks and success criteria are explicit enough that the model is not forced to infer hidden intentPeng et al. (2023)GitHub (2024)GitHub (2023)
- Kent Beck's advice to invest continuously in design quality is best read as a compounding-risk and compounding-optionality argument, and AI plausibly increases its value because future generations inherit today's structure rather than starting from a blank slateBeck (2023)Beck (2024)Thomas (2019)Ousterhout (2018)Anthropic (2025)GitHub (2025)
- Bad code is becoming more expensive rather than less expensive at AI scale, because the best-supported current explanation for the observed downstream cost signals is that generation cost is falling faster than scrutiny, understanding, refactoring, and operational risk are falling across real development workflows, even though repository mix and delivery pressure may contribute at the marginGitClear (2025)Welter et al. (2025)Vaithilingam et al. (2022)Barcia (2025)Thoughtworks (2024)
- A dominant failure mode is human over-acceptance of locally useful output that later proves costly to integrate, explain, debug, or revise inside a larger codebaseVaithilingam et al. (2022)Liang et al. (2023)Ziegler et al. (2022)
- Human attention has highest return when spent on architecture, intent capture, tests, review standards, and prioritisation, while prompt ornamentation and manual boilerplate coding are lower-leverage uses of scarce expert timeBeck (2025)Anthropic (2025)GitHub (2025)Mitchell (2026)
Research Question
In an Artificial Intelligence (AI)-augmented software team, what is the optimal division of labour between the human developer, who owns strategic design, interface definition, and architectural oversight, and the AI assistant, which handles tactical implementation, and does Kent Beck's advice to invest daily in system design provide compounding returns in AI-heavy workflows, particularly if AI's ability to generate large volumes of code rapidly is making bad code more expensive, not cheaper, in 2026 and beyond?
Findings
Executive Summary
The best-supported operating model in Artificial Intelligence (AI)-augmented software teams keeps humans responsible for architecture, context, interface definition, clarification, and verification, while delegating bounded implementation work to AI, although stronger specifications, stronger verifiers, and more capable models could shift more strategic work to AI later than current evidence supports.
Kent Beck's advice to invest continuously in design quality is credible in this setting because coupling, where changing one element forces changes in another, cohesion, where related change pressure stays concentrated inside one element, information hiding, where design knowledge stays inside a module, and optionality, where design preserves future choices, all affect future change cost, and current workflow guidance treats repository structure as part of the context future AI generations consume.
The compounding-return claim is still indirect, because the accessible design-investment sources used here argue mechanism and workflow value rather than directly measuring a fixed daily design-investment rate against long-run team outcomes under AI-heavy delivery.
The strongest evidence for the economic side of the question points to "bad code is expensive" rather than "code is cheap," although some of the downstream cost signal may also reflect changing repository mix or broader delivery pressure, because AI can increase duplication, reduce scrutiny, and raise later understanding cost faster than teams can absorb those downstream burdens.
Key Findings
- The strongest available evidence, even allowing for the competing hypothesis that better specifications and verifiers could shift more strategic work to AI, still supports a strategist-builder split in which humans own architecture, interfaces, context, and verification policy, while AI executes bounded implementation tasks inside those constraints.
- Clarification and investigation before execution are the most directly evidenced ways to improve human-AI collaboration, because they reduce guessing before code or debugging advice is emitted and measurably improve correctness or resolution quality.
- AI coding tools deliver genuine tactical gains on bounded work, including faster completion, better unit-test performance, and quicker code-review cycles when tasks and success criteria are explicit enough that the model is not forced to infer hidden intent.
- Kent Beck's advice to invest continuously in design quality is best read as a compounding-risk and compounding-optionality argument, and AI plausibly increases its value because future generations inherit today's structure rather than starting from a blank slate.
- Bad code is becoming more expensive rather than less expensive at AI scale, because the best-supported current explanation for the observed downstream cost signals is that generation cost is falling faster than scrutiny, understanding, refactoring, and operational risk are falling across real development workflows, even though repository mix and delivery pressure may contribute at the margin.
- A dominant failure mode is human over-acceptance of locally useful output that later proves costly to integrate, explain, debug, or revise inside a larger codebase.
- Human attention has highest return when spent on architecture, intent capture, tests, review standards, and prioritisation, while prompt ornamentation and manual boilerplate coding are lower-leverage uses of scarce expert time.
Assumptions
- The accessible Beck website and interview are adequate stand-ins for blocked or paywalled Substack posts because they state the same core positions on augmented coding, taste, and design judgment.
- Whole-team role-division conclusions remain inference-level because the available evidence joins mechanism studies and longitudinal signals rather than a single integrated field experiment.
Analysis
The evidence points to a clean separation between local execution gains and whole-workflow control needs.
When goals are explicit and tests are available, AI often performs well enough that line-by-line human implementation becomes a lower-value use of expert attention.
When intent is underspecified, or when the change crosses unclear architectural boundaries, the main determinant of outcome shifts from model fluency to the quality of clarification, context selection, and verification.
This is why Beck's design-investment claim fits the AI era even without a precise measured multiplier: every improvement to names, boundaries, and tests changes the environment both humans and models operate in next time.
The long-run economic hazard is that teams may over-index on the visible speed gain and under-invest in the strategic controls that keep output reviewable and reusable.
Risks, Gaps, and Uncertainties
- No accessible source in this evidence set directly measures a universal or recommended daily design-investment percentage for AI-heavy teams.
- Clarification studies show mechanism-level gains, but they do not yet provide whole-project maintenance economics.
- Longitudinal code-quality signals are strong enough to matter, but they still stop short of a unified total-cost-of-ownership model.
Open Questions
- What is the smallest repeatable package of design artifacts that yields most of the strategist-builder benefit in day-to-day team work?
- How should team staffing, incentives, and review norms change once architectural judgment becomes more valuable than manual implementation volume?
- Which leading indicators best show that an AI-heavy team has crossed from productive delegation into unsustainable review debt?
sources
- [x] Beck (2023) Tidy First? A Personal Exercise in Empirical Software Design
- [x] Beck (2024) SE Radio 615: Kent Beck on Tidy First?
- [x] Beck (2025) Kent Beck: Software Design Pioneer
- [x] Ousterhout (2018) Modular Design lecture notes
- [x] Hunt and Thomas (2019) Tip 5: Don't Live with Broken Windows
- [x] Anthropic (2025) Claude Code best practices
- [x] GitHub (2025) How to build reliable AI workflows with agentic primitives and context engineering
- [x] Ziegler et al. (2022) Productivity Assessment of Neural Code Completion
- [x] Peng et al. (2023) The Impact of AI on Developer Productivity: Evidence from GitHub Copilot
- [x] Vaithilingam et al. (2022) Expectation vs. Experience: Evaluating the Usability of Code Generation Tools Powered by Large Language Models
- [x] Liang et al. (2023) Practices and Challenges of Using GitHub Copilot: An Empirical Study
- [x] GitHub (2024) Does GitHub Copilot improve code quality? Here's what the data says
- [x] GitHub (2023) Research: Quantifying GitHub Copilot's impact on code quality
- [x] GitHub (2022) Research: Quantifying GitHub Copilot's impact on developer productivity and happiness
- [x] Wang et al. (2023) ClarifyGPT
- [x] Miao et al. (2025) ClariGen
- [x] Addlesee et al. (2024) Clarifying Completions: Evaluating How LLMs Respond to Incomplete Questions
- [x] Microsoft Research (2024) Let's Fix this Together: Conversational Debugging with GitHub Copilot
- [x] Welter et al. (2025) From Developer Pairs to AI Copilots: A Comparative Study on Knowledge Transfer
- [x] GitClear (2025) AI Copilot Code Quality: 2025 Look Back at 12 Months of Data
- [x] Barcia (2025) I still care about the code
- [x] Thoughtworks (2024) Legacy Modernization meets GenAI
- [x] Mitchell (2026) Grill-Me technique: iterative structured interviewing for human and Artificial Intelligence (AI) alignment in code generation
- [x] Mitchell (2026) Artificial Intelligence code entropy and complexity
- [x] Mitchell (2026) Deep modules in AI-augmented development
- [x] Mitchell (2026) Fundamentals-first versus specs-to-code
- [x] Mitchell (2026) The shape of organisations when software is no longer the constraint
| version | date | commit | summary |
|---|---|---|---|
| 1.0 | 2026-04-30 | 323cc19 | Initial completion |