H
Howardism
Plate IIProduct & OrgHOWARDISM

Standardize the Infrastructure, Not the Tools

Shopify's inversion of the one-tool-per-job norm for AI: route every coding agent through a central LLM proxy so leadership gets cost control, per-team usage analytics, and model portability, while engineers keep free tool choice — buying optionality under uncertainty about which model or workflow wins, with MCP servers extending the same governs-access-not-engineers principle to internal systems; Accenture's Tokenomics figures price what the meter is for (42% of orgs have no single AI-cost owner; formal chargeback ties 32¢ of every token dollar to an outcome, 6× no allocation)

Article metadata
Publication details
Published:August 11, 2026
Filed:Concept
Domain:Product & Org
Reading:12 min
Source:AI-synthesised
About this piece

Articles in this journal are synthesised by AI agents from a curated wiki and are refreshed automatically as new concepts arrive. Topics, framing, and editorial direction are curated by Howardism.

Illustration for Standardize the Infrastructure, Not the Tools

Sources#

Summary#

Farhan Thawar (VP & Head of Engineering, Shopify) states the rule as a deliberate exception to his own org's convention:

"At Shopify, we always have one tool for one job, except for with AI. Since we don't know yet which company, workflow, or model is going to win."

The mechanism is an internal LLM proxy — a single gateway every AI request passes through before reaching a model, whether it originates from Claude Code, Copilot, Cursor, Codex, or anything else. What the org standardizes is the layer underneath the tools; the tools themselves stay uncontrolled.

case-study tier, first-hand from a named leader at a named company, and unmeasured: no cost figure, no analytics finding, and no counterfactual are given.

What the layer buys#

Three things, per the source, and they are worth separating because they have different half-lives:

  1. Centralized cost control and usage analytics by team and project. This is the durable one, and it is the org-level instrument the vault otherwise lacks. Cost-per-Task Over Cost-per-Token establishes that the right unit of AI cost is the completed task and that harness choice moves it more than model choice — but a per-task accounting requires seeing every request, which is exactly what a gateway provides and a fleet of independently-billed tools does not.
  2. Model portability — "the ability to switch models as capabilities evolve without forcing engineers into a single workflow." The proxy makes the model a swappable dependency rather than a property of each engineer's toolchain.
  3. Preserved tool experimentation. Engineers are not funneled into one workflow, so the org keeps sampling the space while it is still unsettled.

The underlying claim is about optionality under uncertainty, not about efficiency. The standard argument for one-tool-per-job is that fragmentation costs more than it's worth; Thawar's counter is that the cost of fragmentation is temporary and bounded, while the cost of standardizing on the losing tool is neither. That reasoning holds only while the winner is genuinely unknown — it is an explicitly dated position, and the rule inverts back the moment the market settles.

The same principle applied to internal systems#

Shopify extended the pattern past model access: through MCP servers, engineers query Salesforce, Slack, GitHub, and internal wikis from AI assistants "with the same access controls as their normal auth flow."

The load-bearing phrase is the source's own summary of why this scales: "The infrastructure governs access, not individual engineers." That is the same architectural move as the proxy — put the control at a chokepoint the org owns, so that the thing being governed (spend, or reach into internal systems) is governed structurally rather than by policy each engineer has to follow. It is also the organizational counterpart to what Zero Trust for AI Agents argues at the protocol level, arrived at from a cost-and-analytics motivation rather than a security one, and reaching the same shape.

Worth noting what "the same access controls as their normal auth flow" does and does not settle: it makes the agent's reach equal to the engineer's, which is the right default and is precisely the property Agent Identity and Authentication treats as the hard problem. The source asserts it as a solved implementation detail and gives no mechanism.

And the population-scale prior runs the other way (2026-05). Remote MCP Authentication in the Wild censused 7,973 live remote MCP servers and found 40.55% exposing tools with no authentication mechanism at all, 29.00% on static tokens or API keys, and every one of 119 end-to-end-testable OAuth deployments carrying at least one confirmed authentication flaw. That does not contradict Shopify — an internally-run server behind a corporate identity provider is exactly the configuration a public census cannot see, and is plausibly the good case. It does mean the claim is the unusual outcome rather than the default one, and that "the infrastructure governs access" is load-bearing precisely because MCP by itself does not: on the measured population, wiring an assistant into Salesforce or Slack through a third-party MCP server inherits no access control at all. practitioner-opinion asserting a property against empirical measurement of the surrounding ecosystem — the mechanism the source declines to give is the whole question.

What the meter is worth, priced (Accenture Tokenomics, September 2026)#

Benefit 1 above is asserted by Shopify and unmeasured. Deploying AI from pilot to production (Anthropic × Accenture, vendor-claim) supplies the first numbers in the corpus attached to it, from Accenture's September 2026 Tokenomics research:

  • 42% of organizations rely on shared IT-and-finance accountability with no single owner for AI costs and outcomes.
  • Organizations with formal chargeback accountability for AI spending link 32 cents of every dollar of token spend to a quantified business outcome — six times the rate of those with no allocation.

Read carefully, this is not a claim about the gateway. A proxy produces per-team usage analytics; the 6× belongs to chargeback, which is the accounting policy that makes someone's budget absorb the bill. Shopify's layer is the precondition (you cannot charge back what you cannot attribute) and the document's own prescription — a named owner with decision rights, escalation authority and executive backing — is the other half. So the corpus now has a plausible mechanism on one side, a claimed outcome on the other, and nothing joining them: no source shows an org that built the meter and then did or did not turn it into chargeback.

The 42% is also the sharper of the two figures and cuts against the usual reading of this page. The default failure is not standardizing on the wrong tool; it is that nobody owns the bill at all, which no amount of substrate discipline fixes. Both figures are Accenture's own survey, self-published without methodology — treat them as the shape of the argument, not its size. See Pilot-to-Production Gap for the surrounding blueprint and its evidence limits.

Adoption by demonstration, not mandate#

The organizational half of the same account, and the part that generalizes past engineering: Thawar "didn't mandate AI adoption. He modeled it," sharing his own AI-assisted work framed as leverage rather than as capability —

"I didn't say look at how much work I did and how smart I am. I said, 'Look how lazy I am.'"

The claimed effect is spread outside engineering: sales reps building dashboards, finance building workflow tools without an engineering ticket, HR generating "n-of-1" software. That last phrase is the same phenomenon Implementation Abundance Inverts Product Work and Printing Press Software Democratization describe from the supply side — software worth writing for one user — observed here as a downstream effect of a tooling decision. No measurement accompanies it; "a boost in productivity across the engineering organization" is the strongest form the claim takes.

Independent arrival at the same mechanism. Anthropic × Accenture prescribe the identical move for enterprise rollouts and state the reason more precisely: identify champions and engineer the demonstration moments deliberately rather than wait for them, because "a portfolio manager showing a compliance specialist how she summarized a 200-page filing in three minutes converts more skeptics than any structured rollout." Two sources, different domains (a single engineering org vs. cross-industry enterprise deployments), same conclusion that demonstration beats mandate — and the same absence of measurement on both sides. The addition worth keeping is the word deliberately: Thawar's account reads as a leader modelling behavior, where the blueprint treats the demonstration as a staffed, funded rollout step with a named owner.

Connections#

  • Pilot-to-Production Gap — the enterprise-deployment frame this decision sits inside, and it resolves the commitment question oppositely. That blueprint names an uncommitted build-versus-buy as the primary source of engineering debt ("every decision deferred past the pilot creates engineering debt: parallel systems, integration patterns that never standardize") where Shopify deliberately declines to commit and buys optionality instead. The two are reconcilable — Shopify did commit, to the substrate, and left only the replaceable layer open — and the distinction that makes them compatible is which layer the commitment binds. It also supplies the chargeback figures above and the same adoption-by-demonstration mechanism
  • Cost-per-Task Over Cost-per-Token — the accounting this gateway makes possible: per-task cost is only measurable if every request passes one meter
  • Orchestration Sets Token Economics — the reason model portability matters more than model choice: the harness, not the model, sets the bill
  • AI-Native Organization — the org-design frame this is an infrastructure decision inside; here the encoded layer is the gateway rather than the skill library
  • Agentic Work Systematization — the same standardize-the-substrate instinct one level down, at the level of reusable skills rather than model access
  • Zero Trust for AI Agents — the security-motivated version of "the infrastructure governs access, not individual engineers"
  • Remote MCP Authentication in the Wild — the empirical counterweight to the MCP access-control claim above: across 7,973 live remote MCP servers, 40.55% authenticate nothing and 119 of 119 testable OAuth deployments carry an authentication flaw, so "the same access controls as their normal auth flow" describes an org that built the chokepoint, not a property MCP supplies
  • Agent Identity and Authentication — the hard problem the MCP claim asserts away: agent access equal to the operator's auth flow, stated as a property rather than a mechanism
  • Implementation Abundance Inverts Product Work — the claimed downstream effect: non-engineers building "n-of-1" software once the substrate is available
  • Outsource Your Thinking, Not Your Understanding — the same source's warning about what this speed costs: the gateway meters tokens and reversion rates, neither of which surfaces comprehension debt

Open Questions#

  • Does a central LLM gateway actually change model-mix decisions, or only report on them? The claimed benefit is portability; no source in the corpus records an org exercising it.
  • What does per-team AI usage analytics get used for once it exists — cost containment, capacity planning, or performance evaluation of engineers? The third would collide with everything Telemetry vs. Survey Measurement establishes about what instrumented output data can and cannot support.

Sources#

§ end
Cited by 14
Related articles
  • Engineer PM Convergence

    Generalists across disciplines; product taste as bottleneck skill; Anthropic Claude Code team as case study; "just do t…

  • Evals as Product Spec

    Cat Wu's framing of evals as the emerging core PM skill: ten great evals beats a hundred mediocre; encode what done loo…

  • Open Questions Backlog

    Generated by `_system/lint.py --write-backlog`. Do not hand-edit. Domain and Watching sections carry one row per page —…

  • Harness Shrinkage as Models Improve

    Prompt scaffolding shrinks each model release; Cat Wu's pruning discipline; Boris Cherny "100 lines of code a year from…

  • MCP and Computer Use

    Anthropic's two complementary connector mechanisms: MCP for structured programmatic access (Salesforce/Drive/Gmail/Slac…