All posts

Research / Economics and governance

The Real Cost of an AI Workflow

Budget an AI workflow beyond tokens: licences, integration, data cleanup, human review, maintenance, and incidents. Work through a full cost example.

By Waypoint ExponentialPublished Revised
Teal and terracotta blocks form a stepped stack on a cream plinth beside small brass cubes, representing the components of an AI workflow's total cost

Budget an AI workflow from preparation through ongoing operation. The model bill is a line in that budget, alongside software, integration, data cleanup, human review, and maintenance. Keep cash spending separate from the existing staff time the workflow consumes, then calculate the cost of an accepted business outcome. That gives you a basis for comparing options and deciding whether to expand.

Define the outcome and cost boundary

Start with a business result that staff can check. For an order-entry workflow, that might be an order that passes the agreed quantity, account, and price checks. For support, it might be a case resolved to the required standard. A generated draft or successful model call can still leave the actual work unfinished.

The FinOps Foundation's unit-economics guidance distinguishes technical units, such as tokens, from business units, such as resolved cases. It recommends connecting technology spending to the outcome it supports. Use the technical meters to explain the bill and an agreed business unit to judge the workflow.

A discussion about unexpected automation bills describes overlooking token usage at working volume despite budgeting for setup. Treat it as a reader concern, not a verified benchmark. Your estimate needs observed calls per case and the work around those calls.

Write the boundary beside the calculation. State whether you include upstream data preparation, manual exceptions, source-system licences, and downstream fulfilment. If an assistant prepares an order but warehouse staff still have to correct it, identify which report includes that correction. Compare alternatives within the same boundary.

Use separate views for additional cash spending and allocated staff capacity. Existing salaries may stay unchanged while the new workflow consumes engineers' or reviewers' time. That time belongs in a resource plan even when it doesn't create a new payment. Don't add the same salary cost twice under different labels.

Budget the work before the first live case

Inventory the work required to make the first release operable. Include process observation, source-system access, connector development, and the evaluation cases the team will use to accept the result. A prototype on copied records doesn't establish the cost of operating against the live source.

Give data preparation its own estimate. Identify the records and fields that need correction, the people who can resolve ambiguous definitions, and the way corrected data reaches the source system. Cleaning a sample for a demonstration doesn't remove recurring errors from incoming work.

Include staff preparation and release support. Managers need time to agree the revised handoff, reviewers need to practise exceptions, and the receiving operator needs to test the fallback. Estimate these tasks with the people who will do them, rather than assigning a generic percentage to training.

Record external payments and internal hours separately. Show the delivery milestones, minimum commitments, and what acceptance permits the next payment or release. Distinguish work already completed from the remaining cost of continuing. An earlier payment may matter to the total investment, while the next decision depends on the spending and effort still ahead.

Keep the estimate current when the scope changes. Adding another source system, site, or action permission can create another implementation task. A connector that looks reusable may still need different field mappings, access review, or local business rules. Record the evidence behind the reuse assumption.

Find every recurring cost meter

Read the software contract and the usage reports together. A workflow may pay for staff seats, orchestration runs, model calls, document extraction, retrieval, and storage. Some charges have minimum monthly commitments; others follow requests or data volume. Check which charges the supplier already includes before adding them again.

Anthropic's current Claude pricing documentation distinguishes input, output, cache writes, and cache reads, and describes charges for particular tools. Those categories show why a flat price per request can miss the actual bill. Use the rates and terms applicable to your provider, model, routing, and contract; the example below doesn't quote a vendor tariff.

Estimate the whole sequence for a case. Count the initial call, additional context gathering, output checking, and retries that actually occur. Track abandoned or rejected attempts too. If an evaluation environment repeatedly runs the same cases, show its consumption separately from live work so the owner can explain the total.

Include the supporting service. AWS's CloudWatch pricing page lists distinct log ingestion, storage, and analysis categories. Monitoring can therefore have its own usage bill alongside the application. Inspect the actual services and retention settings your team uses, including databases, search, backups, and data transfer where applicable.

Record temporary discounts and credits with their end dates. Show the price currently paid and the estimate after the credit expires. A pilot that runs within a free allowance needs a paid-volume forecast before rollout. Keep assumptions about cache hits or batch processing tied to measured usage and acceptable delivery time.

Measure review and operating time

Observe the full review task. Include opening the evidence, deciding, correcting, and returning a disputed case to the right person. Measure different case types separately. Routine checks may take little time while ambiguous cases need another team or a customer response.

Track the proportion needing review and the time per reviewed case. A smaller model may cost less per call while producing more corrections. A change that shortens a draft can also remove context a reviewer needs. Compare the combined cost at the same acceptance standard.

Allocate ongoing technical maintenance explicitly. Include source-system changes, evaluation runs, prompt or configuration updates, and the support coverage the operating agreement requires. If a supplier's fee covers maintenance, identify its scope and exclusions before adding internal work for the same task.

Incident handling needs a plan and a cost record. Capture investigation time, affected-case reconciliation, and any extra payments when an incident occurs. For planning, test a stated disruption scenario and its recovery effort. Don't turn an invented incident frequency into an expected annual loss.

Keep the staff-capacity claim separate from a cash saving. Our guide to time saved and money saved explains that conversion. Here, the immediate task is to establish what resources the proposed workflow consumes and who provides them.

Work through a complete planning example

Consider an illustrative document-to-order workflow processing 10,000 submitted cases a month. Of those, 9,000 reach the defined accepted-order state after the required checks. The remaining 1,000 consume processing effort but stay unresolved during the reporting period. Include their costs in the numerator and don't count them as accepted outcomes.

All amounts below are assumed US dollars, not supplier quotes, client results, or market benchmarks. The software fee covers an orchestration subscription that excludes model usage. Hosting and retrieval also exclude the separately listed model and tool charges. The staffing assumptions cover this defined workflow boundary.

Illustrative monthly operating budget in US dollars
Cost componentMonthly amountPlanning treatment
Software licences$600Additional cash spending.
Model and tool usage$800Additional cash spending, including attempts that don't reach acceptance.
Hosting, retrieval, and monitoring$400Additional cash spending.
External maintenance$1,200Additional cash spending for the agreed support scope.
Internal review and rework$4,000100 hours at an assumed loaded rate of $40.
Internal ownership and release checks$1,00020 hours at an assumed loaded rate of $50.

The monthly cash requirement is $3,000. Internal staff capacity adds $5,000, giving an allocated operating cost of $8,000. At 9,000 accepted orders, those views give about $0.33 in additional cash spending per accepted order and $0.89 including the allocated internal time.

Assume setup also requires $12,000 in external integration and data-preparation payments, plus 60 internal hours at $50 for process preparation and training. Setup therefore needs $12,000 in cash and $3,000 in allocated internal capacity. These setup hours are separate from the recurring ownership hours.

  • First-year cash requirement: $12,000 + (12 × $3,000) = $48,000.
  • First-year allocated internal capacity: $3,000 + (12 × $5,000) = $63,000.
  • Combined first-year planning cost: $48,000 + $63,000 = $111,000.
  • Cost per accepted order over that year: $111,000 ÷ (12 × 9,000) = about $1.03.

The annual calculation assumes twelve months at the stated volume and cost after setup, with no ramp or additional incident cost. It excludes tax and financing effects. These are management-planning views, not a prescription for accounting treatment. Finance should reconcile the actual payments, staffing allocations, and timing for its own appraisal.

Keep downstream fulfilment and the existing source-system base costs outside this example's boundary, and disclose that exclusion. If you compare it with an alternative that includes those costs, align the scope first. The model-only figure of roughly $0.09 per accepted order doesn't describe the allocated operating cost.

Test the assumptions that change the decision

Change the measured cost drivers individually before combining them into a scenario. In the example, increasing review and rework from 100 to 150 hours raises its allocated cost from $4,000 to $6,000. Monthly allocated operating cost becomes $10,000, or about $1.11 per accepted order at the same accepted volume.

Halving the $800 model-and-tool bill reduces monthly allocated cost to $7,600, or about $0.84 per accepted order, if everything else stays unchanged. That assumption needs an evaluation: cheaper inference can alter acceptance and review effort. Compare the resulting workflow, not only the new tariff.

Test a slower rollout separately. Fewer accepted cases can leave subscription fees and support commitments unchanged. A setup delay can also consume internal hours while the business still operates its existing process. Put the monthly cash flows and available review capacity on the actual rollout calendar.

For a disruption scenario, state the repair work directly. An extra 20 internal investigation hours at $50 add $1,000 of allocated capacity cost. An external emergency fee is an additional cash item if the contract requires it. Reconcile any affected orders and lost outcomes separately; don't assume a technical repair restores the business result.

At higher volume, identify the next capacity step. Review may need another shift, an external maintainer may change their service band, or a database may need more capacity. Ask when the cost changes and whether the team can still meet the acceptance standard. A lower average unit cost doesn't establish that the next volume fits the current team.

Compare suppliers on the same workflow

Give each supplier the same input volume, case mix, acceptance criteria, and operating hours. Ask who provides the integration, reviews exceptions, maintains source mappings, and supports a failed job. Include the customer's staff duties in each proposal, even when the supplier doesn't charge for them.

Read the allowance and overage rules. Establish what counts as a billable run, whether failed attempts consume credits, and which tools or integrations cost extra. Request a sample usage statement that you can reconcile with completed cases. An included allowance is hard to budget if the measured unit is unclear.

Compare an existing assistant, a bought workflow, and a custom implementation against the same scope. An existing licence may cover part of the task while leaving manual work elsewhere. A custom build may create more control while adding maintenance work. Our build-or-buy guide covers those choices in more detail.

Include the cost of changing or ending the arrangement. Identify data export, replacement integration, knowledge transfer, and overlapping service during a transition. Estimate the required work without pretending that every exit will happen. Keep contract commitments visible beside optional future work.

Give the cost report an owner and an action

Maintain a ledger with a workflow reference, period, cost category, payment or allocated-hour treatment, owner, and evidence source. Reconcile usage charges with provider statements and staff time with the agreed measurement method. Keep credits and shared-service allocations visible so another reader can reproduce the total.

An SME can start with the bills and a measured review sample for its first workflow. A corporate team can allocate shared platform costs using a stated driver while preserving the local operating costs. A PE portfolio can share reporting definitions without assuming that different companies have identical volumes or staffing.

For venture diligence, distinguish this workflow's total operating plan from the startup's reported cost of revenue. Ask finance to explain its classification and reconciliation. Inspect implementation effort, credits, and review work by customer rather than treating a blended model bill as evidence of a sustainable margin.

Name the action a variance triggers. Rising retries may need an engineering investigation; longer review may need a workflow repair; unused seats may need a procurement decision. Assign the response to someone with authority to change the relevant work. Use the ownership guide to make that route explicit.

Before expanding, have the owner explain the cash requirement, internal capacity, accepted volume, and next cost step from the same ledger. Keep the benefit comparison alongside it using a documented baseline. Approve the next release when the estimate and operating evidence support that specific decision.

Put the work into practice

Operations consulting and business process automation

We help company leaders improve the work between people, data, and systems. Our consulting and engineering team maps the process, fixes the handoffs, and builds the automation your staff will use.