Learn › Agent Harness, the big picture › Stop 1

Stop 1 of 9 · Page

Three kinds of AI application

There are only three kinds, and one question tells them apart: who decides the next step?

1 · Single callYou askModelAnswerOne question, one answer.There is no next step.2 · WorkflowStep 1your codeStep 2modelStep 3your codeFixed steps in a fixed order.Your code decides the next step.3 · AgentModeldecidesToolsyour codeRound and round until done.The model decides the next step.more freedom for the model, so more harness is needed
Lavender boxes are model calls. Blue boxes are your own code. The kind depends on one thing: who decides the next step.

One question sorts them

Ask of any AI application: who decides the next step? There are only three answers.

KindWho decides the next stepAn insurance exampleGood atWatch out forHarness needed
Single callNobody. There is only one step.Turn a 12-page surveyor's report into five linesCheap, fast and easy to testIt only knows what you put in the requestA little: check what goes in and what comes out
WorkflowYour code. The steps and their order are written in advance.Read a claim form, pull out the fields, check the policy, send an acknowledgementPredictable: every run takes the same path, so it is easy to auditIt fails on a case that does not fit the steps you wroteSome: a check at each step
AgentThe model. It picks a tool, sees the result and picks again.A customer describes an accident in their own words; the assistant works out what to look up and what to doHandles cases nobody wrote a path forIt can take a wrong step, a costly step, or too many stepsA lot: limits, permissions, approvals and a record of every step
The same model can sit in all three.The kind is not about how clever the model is. It is about how much of the route you hand over to it.

How to choose

  1. Can one request do the whole job? Then it is a single call. Stop here.
  2. Do you know the steps before you start? Then write them down as a workflow, and use the model inside the steps that need it.
  3. Do the steps depend on what turns up along the way? Only then is it an agent.

Choose the simplest kind that does the job. Each step up buys flexibility and costs you predictability, money and testing effort.

The same three kinds in other industries

IndustrySingle callWorkflowAgent
BankingSort an incoming complaint email into the right teamCheck identity documents in a fixed order of stepsLook into an unusual payment across several systems
HotelsTranslate a guest reviewBooking confirmed, then a welcome message, then an upgrade offerA concierge that books, changes and fixes a guest's plans
RetailWrite a product description from a specification sheetReturn request, then the policy check, then the shipping labelA shopping assistant that searches, compares and places the order

Next: the agent column is where the value is, and where the trouble is. Stop 2 looks at agents that work with less and less of a person watching.