How enterprise AI governance secures profit margins

According to SAP, enterprise AI governance secures profit margins by replacing statistical guesses with deterministic control.

Ask a consumer-grade model to count the words in a document, and it will often miss the mark by ten percent. Manos Raptopoulos, Global President of Customer Success Europe, APAC, Middle East & Africa at SAP, observes that the operational gap between near-perfect and perfect is absolute.

“The distance between 90% and 100% accuracy is not incremental. In our world, it is existential,” notes Raptopoulos.

As organisations push large language models into production environments, Raptopoulos emphasises that the evaluation criteria have formally transitioned toward precision, governance, scalability, and tangible business impact.

The pressing challenge facing corporate boards centres on the evolution from passive tools to active digital actors, a transition Raptopoulos identifies as the primary governance moment and will be among the topics that SAP will be focusing on at this year’s AI & Big Data Expo North America.

Agentic AI systems now possess the capability to plan, reason, orchestrate with other agents, and execute workflows autonomously. Because these systems interact directly with sensitive data and influence decisions at scale, Raptopoulos argues that failing to govern them exactly as one governs a human workforce exposes the organisation to severe operational risk. He warns that agent sprawl will mirror the shadow IT crises of the past decade, though the stakes are categorically higher.

Establishing agent lifecycle management, defining autonomy boundaries, enforcing policy, and instituting continuous performance monitoring are mandatory requirements, according to his framework.

Integrating modern vector databases (which map the semantic relationships of enterprise language) with legacy relational architectures demands immense engineering capital. Teams must actively restrict the agent’s inference loop to prevent hallucinations from corrupting financial or supply chain execution paths. Setting these strict parameters drives up computational latency and hyperscaler compute costs, altering initial P&L projections.

When an autonomous model requires constant, high-frequency database querying to maintain deterministic outputs, the associated token costs multiply quickly. Governance becomes a hard engineering constraint rather than a compliance checklist.

Raptopoulos argues that corporate boards must resolve three baseline issues before deploying agentic models: identifying who holds accountability for an agent’s error, establishing audit trails for machine decisions, and defining the exact thresholds for human escalation. Geopolitical fragmentation makes answering these questions harder.

Sovereign cloud infrastructures, AI models, and data localisation mandates are regulatory realities in major markets spanning New York, Frankfurt, Riyadh, and Singapore. Enterprises must embed deterministic control directly into probabilistic intelligence. Raptopoulos views this requirement as a C-suite mandate rather than an IT project.

Structuring relational intelligence for commercial operations

AI systems remain entirely dependent on the quality of the data and processes they operate upon, representing what Raptopoulos calls the data foundation moment.

Fragmented master data, siloed business systems, and over-customised ERP environments introduce dangerous unpredictability at the worst possible moments. Raptopoulos explains that if an autonomous agent relies on fragmented foundations to provide a recommendation affecting cash flow, customer relations, or compliance positions, the resulting operational damage scales instantly.

Extracting tangible enterprise value requires advancing beyond generic large language models trained on internet-scale text. True enterprise intelligence – as outlined by Raptopoulos – must be grounded in proprietary corporate data, including orders, invoices, supply chain records, and financial postings embedded directly into business processes. He argues that relational foundation models optimised specifically for structured business data will continually outperform generic models in forecasting, anomaly detection, and operational optimisation.

The sheer operational friction of making an over-customised ERP environment intelligible to a foundation model halts many deployments. Data engineering teams spend excessive cycles sanitising fragmented master data simply to create a baseline for the AI to ingest.

When a relational model needs to accurately interpret complex, proprietary supply chain records alongside raw invoice data, the underlying data pipelines must operate with zero latency. If the data ingest fails, the model’s predictive capabilities degrade instantly, rendering the agent functionally dangerous to the business.

Integrating legacy architecture with modern relational AI requires overhauling deeply entrenched data pipelines. Engineering teams face indexing decades of poorly classified planning data so that embedding models can generate accurate vector representations. Following Raptopoulos’s logic, boards must evaluate whether their current data estate is genuinely prepared, rather than simply layering probabilistic intelligence over disjointed foundations.

Designing intent-based interfaces

Enterprise application interaction is transitioning from static interfaces to generative user experiences, a development Raptopoulos flags as the employee interaction moment.

Instead of manually navigating complex software ecosystems, employees will express their intent to the system. Raptopoulos offers the example of a user instructing the software to prepare a briefing for their highest-revenue customer visit that week. The AI agents then orchestrate the necessary workflows, assemble the surrounding context, and surface recommended actions.

However, Raptopoulos stresses that adoption among the workforce remains conditional upon trust. Employees will only embrace these digital teammates when they feel confident that the system’s outputs respect established governance boundaries, reflect authentic business rules, and deliver demonstrable productivity gains.

Engineering these systems demands role-specific AI personas tailored for positions such as the CFO, the CHRO, or the head of supply chain. Raptopoulos observes that these personas must be built upon trusted data and embedded within familiar corporate workflows to successfully close the adoption gap.

Achieving this level of integration is a design decision carrying heavy consequences. Organisations willing to invest capital into AI-native architecture accelerate their return on investment, while enterprises attempting to bolt probabilistic models onto legacy interfaces struggle heavily with trust, usability, and scale.

Technology leaders trying to force modern AI orchestration onto monolithic software applications often encounter severe integration delays. The routing of probabilistic API calls through outdated enterprise middleware causes user interfaces to lag, destroying the intent-based workflow. Designing role-specific personas requires more than prompt engineering; it demands mapping complex access controls, permissions, and business logic into the model’s active memory.

Engineering competitive defense

The financial return on AI surfaces fastest during customer interactions. Raptopoulos notes that training models on proprietary records, internal rules, and historical logs creates a layer of customer-specific intelligence that rivals cannot easily copy. This setup performs best in exception-heavy workflows like dispute resolution, claims, returns, and service routing.

Deploying autonomous agents capable of classifying cases, surfacing relevant documentation, and recommending policy-aligned resolutions converts these high-cost processes into distinct competitive differentiation.

These models adapt based on the results of each interaction. Raptopoulos points out that corporate buyers prioritise reliable, relevant, and responsive service rather than technological gimmicks. Companies that deploy AI to handle heavy workloads – while maintaining strict oversight of the final outputs – construct barriers to entry that generic tools fail to penetrate

Deploying corporate intelligence requires the C-suite to orchestrate three distinct layers in parallel, which Raptopoulos defines as the strategy moment.

The initial layer involves embedded functionality, where persona-driven productivity gains are integrated directly into core applications for fast returns. The second layer demands agentic orchestration, facilitating multi-agent coordination across cross-system workflows. The final layer focuses on industry-specific intelligence, featuring deeply specialised applications co-developed to address the highest-value challenges specific to a particular sector.

A trap awaits leaders who fall victim to false sequencing. Concentrating solely on embedded tools leaves massive financial value uncaptured, while jumping aggressively toward deep industry applications without first achieving proper governance and data maturity multiplies corporate risk. 

Raptopoulos advises that scaling these models requires matching corporate ambition to actual technical readiness. Leadership teams need to fund clean core architectures, update data pipelines, and enforce cross-functional ownership to move past the pilot phase. The most profitable deployments treat AI as a central operating layer that requires the same governance as human staff.

The financial gap between 90 percent accuracy and full certainty dictates where true enterprise value lives. Governance decisions made in the coming months will dictate whether specific AI deployments become a powerful source of durable advantage, or an expensive lesson.

See also: AI agent governance takes focus as regulators flag control gaps

Want to learn more about AI and big data from industry leaders? Check out AI & Big Data Expo taking place in Amsterdam, California, and London. The comprehensive event is part of TechEx and is co-located with other leading technology events including the Cyber Security & Cloud Expo. Click here for more information.

AI News is powered by TechForge Media. Explore other upcoming enterprise technology events and webinars here.