AI Needs Operating Models, Not Just Platforms
Why buying an AI gateway or a vector store is only 20% of the battle. How custom operating models align software teams, reviews, and risk boundaries.
Disclaimer: The ideas, arguments, and analysis in this article are my own, based on my observations and experience. I used AI tools to help refine the writing and structure (editing support), but the underlying thoughts and viewpoints are original.
Most organizations are now doing the hard parts: they are redesigning teams, modernizing data platforms, and moving toward data products. But many are still trying to run the new world with the old operating model. That’s where things start to slow down.
In my earlier post on team shift, I spoke about how AI changes org design, not just jobs. The next layer is the one that decides whether that org design actually works: Operating Models.
Because when the organization changes, the way we run work must change too. Especially around data governance and data products.
A quick note on wording: in many organizations today, “product” is increasingly used as shorthand for “data product”. That’s the real unit of ownership, delivery, and accountability now.
1. The Trap: New Org + Data Products, Old Operating Model
A surprising number of companies are doing or working towards building data products with clear ownership, setting up domain teams and product-aligned squads, and standing up AI capabilities on top—while still operating with old patterns:
- Central ticket queues
- Unclear ownership and escalations
- Governance as approvals instead of governance as design
- Inconsistent definitions and quality gates
- Audits as a phase at the very end
This is like running a train on a road. You might move for a while. But you’ll move slowly. And eventually, you’ll break reliability, compliance, delivery velocity, or trust. The result is predictable: AI becomes fragile, data products become inconsistent, teams get blocked, and the business loses confidence. Not because the platform is wrong, but because the operating model is misaligned.
2. What an Operating Model Actually Does in the AI Era
Operating models are not org charts. They answer practical, high-velocity questions:
- Who owns what?
- Who approves what?
- What is “good enough”?
- How do we detect issues early?
- How do we change safely without slowing down delivery?
An operating model is the lubricant in a well-structured organization. It reduces friction so teams can make faster, data-enabled decisions and consistently build data products. In the AI era, these questions become sharper because AI amplifies both value and risk. So the operating model must do two things at once: keep delivery moving fast, and keep data and AI trustworthy. That balance doesn’t happen through policy documents; it happens through operating rhythms.
3. Productivity Shifts From Meetings to Measurable Delivery Signals
One operating-model change is already quietly happening in high-performing teams: Productivity is moving away from daily standups and weekly status calls.
Not because communication doesn’t matter, but because in an AI-enabled delivery model, progress must be visible at any point in time without waiting for a meeting. The new standard becomes: delivery-driven, outcome-backed, and data-evidenced.
So instead of asking, “What did you do yesterday?” the system itself should answer:
- What shipped, what changed, and what is live
- What quality gates passed or failed
- What is blocked, where, and since when
- What risk is building (security, compliance, drift, data quality)
- What is trending slower than expected and why
This is bigger than Jira. Task tools track work intent. But AI-era operating models require systems that track work reality across code, data pipelines, contracts, quality checks, incidents, and production behavior. That’s how delays and blockers get elevated early, without turning governance into meetings.
4. Data Governance at the Center (Not as a side committee)
If you take one principle from this post, let it be this: Data governance is the center of the operating model in the AI era. Not because governance is fashionable, but because without it, AI outputs become unstable and unexplainable.
In practice, data governance defines:
- Ownership (domain accountability)
- Data Product Contracts (meanings, fields, SLAs)
- Quality Gates (what must be true before data is trusted)
- Lineage and Provenance (where it came from, how it changed)
- Access and Sensitivity Rules
- Versioning and Validity
When governance sits outside the operating model, it becomes a bottleneck. When it sits inside the operating model, it becomes an accelerator.
5. AI Governance Sits Around It — Enabled by the Operating Model
AI governance is often treated as a separate initiative. But strong AI governance is largely a downstream effect of strong data governance enabled by the right operating model. Most AI risks are not model risks. They are: incorrect/stale data treated as truth, uncontrolled mixing of contexts, missing provenance, unclear permissions, silent drift, and a lack of review loops.
So AI governance should not start with documents. It should start with operational mechanisms that sit on top of data governance:
- What data is eligible for AI usage
- What guardrails must be enforced at retrieval or generation
- What human review is needed and when
- How incidents are handled and fed back into the system
- How changes are approved without slowing teams down
"Data governance at the core. AI governance around it. The operating model making both executable."
6. What Aligned Looks Like (Practical, not theoretical)
When operating models match the org shift and data product shift, a few things become standard:
- Clear Ownership and Escalation Paths: Not “someone in the data team will fix it.” Real, direct domain accountability.
- Contracts Over Conventions: Data products ship with explicit enrichment contracts, not the tribal knowledge that lives only in people's heads.
- Quality Gates in the Pipeline: Governance by design, not governance by approval queues or meetings.
- Delivery Visibility Without Ceremony: Progress is measurable at any time, not dependent on daily status calls.
- Incident Response for AI: When AI is wrong, the question isn’t “who prompted it badly?” It’s: which data contract failed, which context was missing, what guardrail was bypassed?
Closing Thoughts
Many teams are investing in platforms. But platforms don’t create trust. Operating models do. You cannot redesign the organization for AI, build data products, and then run everything with the same old governance rhythms and escalation structures. That’s how you get slow delivery, broken accountability, and fragile AI.
"Because in the AI era, the competitive advantage isn’t just building models. It’s building trustworthy systems that run well every day."