top of page

Humans vs AI: Role Clarity, ROI, and Risk Assessment using Service Design

Writer: Rushikesh Kulkarni
Rushikesh Kulkarni
Sep 12
3 min read

Updated: Nov 4

Across industries, enterprises are racing to deploy Agentic AI to drive operational efficiency. Yet, behind the hype lies a glaring adoption bottleneck: 56% of CEOs report zero financial benefit from their AI investments to date.


The root cause isn't model performance- it's haphazard AI proliferation. Organizations routinely drop autonomous tools into unmapped, disjointed workflows as isolated point solutions. When AI is applied indiscriminately, leadership faces two critical gaps:

  • The ROI Gap: Studies across McKinsey, BCG, and Gartner show that 73% of enterprises cannot prove ROI on digital initiatives. Automating isolated tasks often creates hidden downstream friction. For instance, using AI to automate initial customer support responses may lower initial handling time, but if outputs lack nuance, human escalation rates jump by 35%—driving overall operational costs up.

  • The Unpredicted Risk Gap: According to research from the RAND Corporation, AI initiatives fail at twice the rate of standard IT projects specifically because teams skip codifying approval rules, boundary conditions, and human handoffs. In financial underwriting or clinical operations, deploying an unvetted agent to evaluate edge-case risks can trigger severe compliance violations or systemic failures because underlying policies were never explicitly documented.


AI Opportunity Evaluation Using Service Blueprints

Unlike traditional rule-based business process automation, Agentic AI operates dynamically across customer experience and backstage operational lanes. The most effective way to evaluate an AI opportunity is to map the Current State Service Blueprint against a proposed Future State Service Blueprint using a value centric service design approach for Human centered AI and digital transformation.



By laying out front stage customer interactions, backstage employee actions, and supporting technical systems, service design identifies precisely where AI should:

  • Replace one or multiple human activities with a system powered by AI.

  • Consolidate multiple system activities into a single system powered by AI.


Risk Calculation and Management

The optimal degree of automation depends on two primary axes: Environmental Stakes and the Extent of Harm if the AI fails.

To assess the level of risk, evaluate potential harm to:

  • The finances, health, well-being, reputation, and safety of customers and employees.

  • The organization's finances and reputation.


Sample Role and Decision Matrix: (Different for each business and activity performed by agentic AI)  

HARM TYPES

LOW-STAKES ENVIRONMENTS

HIGH-STAKES ENVIRONMENTS

Reversible


 

AI: Completes activity

Human: Stays informed, and reverses if needed

AI: Completes activity, seeks intermittent human review and approval

Human: Reviews intermittently and provides final approval

Manageable

AI: Completes activity and seeks final approval

Human: Approves/ Rejects/ Rectifies/ Asks AI to rectify

AI: Checks and makes suggestions

Human: Completes activity, and approves

Non Reversible

AI: Completes activity, seeks intermittent human review and approval

Human: Reviews intermittently and provides final approval

Human 1: Completes activity, seeks approval

AI: Checks and makes suggestions

Human 2: Secondary checks and approval

Note: Multi-agent systems can propagate minor errors downstream before a human ever sees them. Low-stake, reversible tasks can accumulate into high-stake, non-reversible outcomes if multi-agent pipelines are unmonitored.


Calculating True ROI from the Blueprint

Service blueprints inherently surface the core operational variables needed to model net financial return:

  1. Number of people doing the activity: The total headcount dedicated to the task.

  2. Frequency of activity: How often the activity recurs across daily operations.

  3. Time taken for the activity: Duration per task instance.

  4. Cost of technology systems: Total cost of new AI infrastructure, models, APIs, and maintenance.

To determine net benefit, compare the current labor and system footprint against the proposed AI-enabled workflow:


Labor Savings+ System Consolidation Benefits − Total AI Infrastructure Cost​

Net ROI= ----------------------------------------------------------------------------------------- X 100 Total AI Infrastructure Cost


Crucial Consideration: Labor savings must factor in human review time and potential escalation overhead to ensure downstream costs don't eat up front-end gains.










Comments


bottom of page