Louis Landry, CTO at Teradata.
Enterprise AI spending is accelerating. Agents are being deployed into production workflows, automating decisions that used to require entire teams. The energy is real, and in many cases, the results are, too. But there’s a pattern forming underneath the momentum that should concern every CTO: We’re funding the exciting half of the AI strategy and leaving the foundation almost entirely unattended.
The gap between “impressive demo” and “trusted and sustainable” is almost entirely a data and infrastructure problem, not a model problem. It demands a different mental model than the one most enterprises are operating with today.
Here’s the shift: Stop thinking of autonomous AI as a tool you deploy as fast as possible. Start treating it as the most demanding customer your enterprise has ever served.
A high-value customer expects clean information, reliable service and clear terms of engagement. They won’t tolerate inconsistency, and they won’t pause politely when something is wrong. They’ll act on whatever you give them and hold you accountable for the result. Autonomous AI behaves the same way, except it operates at a speed and scale that amplifies every weakness in your data estate.
A human analyst encountering inconsistent field definitions across three source systems will stop and ask questions. An agent won’t. It will decide, at volume, and move on, and it may not even decide the same way twice given identical inputs.
Most enterprises are optimizing for how fast they can deploy AI. The customer mindset optimizes for something different: whether the environment you’re deploying it into is actually ready to support it.
Standardizing The Product You’re Shipping
The pattern is predictable: an enterprise deploys an agent against a data environment that was “good enough” for human analysts and, within weeks, the cracks are visible: inconsistent definitions across source systems, stale reference data and undocumented transformations buried in ETL pipelines. None of these were crises when a team of 10 analysts was writing queries. They become crises fast when an autonomous system is making thousands of decisions per hour against that same data.
The standard of consistency, reliability and thorough documentation that you’d hold a customer-facing product to has to be the same standard you hold your data to. If you wouldn’t ship a product with that level of quality, you shouldn’t be feeding it to an agent making consequential decisions on your behalf.
Governance Has To Be Structural, Not Ceremonial
In many enterprises, governance is still a compliance checkbox that the legal team asks about before launch. That framing breaks down when an agent is making decisions continuously. Governance becomes the architecture of trust, and without it, your most demanding customer is operating in the dark.
Consider what happens when this is missing. A procurement agent makes a defensible purchasing decision, but when the CFO asks why, there’s no audit trail; no way to walk back through the reasoning chain. The outcome might have been correct, but the business doesn’t lose trust in the outcome. It loses trust in the system. That’s a much harder thing to recover.
Governance designed for autonomous AI must be embedded in the infrastructure layer, not bolted on after the fact. Lineage tracking that operates at agent speed, access controls granular enough for machine-to-machine interactions and audit capabilities that can reconstruct decision paths on demand are what help you trust the system when it’s making decisions without you.
The Infrastructure Problem Nobody Planned For
This is the dimension that tends to catch enterprises off guard. Most organizations sized their data infrastructure for human-scale BI workloads. When agentic systems go live, query volumes spike by an order of magnitude, costs follow and the instinct is to throttle the agents: limit their access, constrain their query patterns and cap their compute. But throttling your autonomous AI is the equivalent of telling your highest-value customer the store is closed.
A data architecture built to serve autonomous AI needs context engines that surface precisely the right knowledge for each decision—not everything the agent could possibly need, but exactly what’s relevant. It needs a unified knowledge layer that connects meaning across data silos so agents can reason across the enterprise, not just within isolated domains. And it needs to handle both structured and unstructured data, because autonomous systems must reason about everything your business cares about, not just what fits in a table.
None of this requires breakthrough technology, but it does require a level of architectural intentionality that many enterprises have not yet needed to develop. Most organizations already have the underlying infrastructure and years of accumulated design decisions behind it. But what I rarely see asked is whether that environment was built to support autonomous AI as a first-class consumer. Evaluating infrastructure readiness for autonomous AI is still a relatively new discipline, and many organizations are only beginning to confront what that actually demands.
Where The Advantage Actually Lives
Building smarter agents alone won’t create an advantage. The model layer is commoditizing quickly, with frontier capabilities becoming more accessible and cost-efficient at a rapid pace.
As that happens, the advantage increasingly comes from what sits beneath the model: the quality of your data foundations, the maturity of your governance and the resilience of the infrastructure that supports autonomous decision-making at scale. This means doing the unglamorous work of building an environment where autonomous AI can actually thrive.
Forbes Technology Council is an invitation-only community for world-class CIOs, CTOs and technology executives. Do I qualify?
