Beyond chatbots: agents perceive, decide, act, and learn.
Definition
An AI agent is software thatperceives, decides, acts, with autonomy bounded by policy.
Chatbot (yesterday)
Q&A. Stateless. Reactive.
Receives a question, returns a single answer. No memory across turns. No tool use. No goal pursuit.
Agent (today)
Goal-driven. Stateful. Tool-using.
Receives a goal, plans, calls tools, observes results, iterates until the goal is met or escalates to a human.
Anatomy
Five components every agent needs.
Part II
II
The three platforms.
Copilot Studio, GitHub Copilot Agents, Azure AI Foundry, when to use each.
Microsoft · AI agent platforms
Three platforms, three audiences, one Microsoft AI stack.
01 · Copilot Studio
Low-code business agents
For business users and citizen developers. Drag-and-drop topics, connectors to Microsoft 365, Dataverse, Power Platform. Best for HR, IT helpdesk, customer service bots.
02 · GitHub Copilot Agents
Developer agents in the IDE
For software engineers. Agent Mode, custom agents in repos, MCP tools, extensions. Best for code generation, refactoring, PR automation, tests.
03 · Azure AI Foundry
Pro-code custom agents
For ML engineers and platform teams. Full SDK, model catalog, multi-agent orchestration, fine-tuning, observability. Best for production-grade vertical agents.
Decision matrix
Pick the platform that matches the audience and the control surface.
Part III
III
Agent types.
Where each platform shines: development, productivity, business, data.
Four agent types · Where they fit
Match the agent type to the right platform.
01 · Development
Bug-fix, refactor, test gen
Lives in the repo and IDE. GitHub Copilot Agents is the home. Custom agents in .github/agents/, MCP tools for build and ticket integration.
02 · Productivity
Meeting notes, drafts, search
Inside Microsoft 365. Copilot Studio for custom topics; Microsoft 365 Copilot Agents for embedded experiences in Teams, Outlook, SharePoint.
03 · Business + processes
Onboarding, approvals, claims
Cross-system orchestration. Copilot Studio for the conversational layer; AI Foundry when SLAs, multi-agent, or fine-tuning are required.
04 · Data + analytics
NL-to-SQL, insight summaries
AI Foundry with grounding on Fabric, Synapse, or your warehouse. Strict prompt engineering, evaluation harness, and human approval before publish.
Part IV
IV
Human-in-the-Loop.
Autonomy is not the goal. Trustworthy outcomes are.
HITL · Principle
More autonomyrequires more guardrails, not fewer.
An agent that can act on regulated data, sign documents, move money, or change customer records must have explicit human checkpoints. The cost of one wrong autonomous action exceeds the savings of one hundred correct ones.
HITL · Decision matrix
Map every action to a quadrant before deploying.
HITL · Implementation patterns
Three patterns cover most cases.
Pattern 01 · Approve-before
Agent proposes, human approves.
Agent prepares the action and waits at a checkpoint. Approval logged with reviewer identity. Use for PRs, drafts, recommendations.
Pattern 02 · Sample-and-review
Agent acts, human spot-checks.
High-volume, low-individual-impact actions. Random sample audited. KPIs trigger escalation. Use for tagging, classification, routing.
Pattern 03 · Dual-control
Two humans, one action.
Irreversible or regulated. Initiator + approver, never the same person. Cryptographic signature on both. Use for finance, legal, prod data.
Part V · Case study
V
Vehicle leasing & sales.
Two real problems: traffic-fine driver indication, and tax compliance for NF-e.
Problem 01 · Traffic fines
Driver indication has a15-day deadline. Miss it, the leasing company pays.
Manual today
Mailroom → spreadsheet → chase customer.
Notifications arrive by mail, scanned by hand, transcribed into Excel. Operator emails the customer who leased the car. Some replies, many do not. Deadlines slip; the company pays + penalty.
Agent-led
Ingest → extract → route → track.
Document Intelligence agent extracts plate, date, code, value, deadline. Lookup agent finds the lessee in SAP/Salesforce. Notification agent sends portal link. Tracking agent escalates on day 7.
Every contract closure, lease termination, and inter-branch transfer must produce a valid NF-e or NFS-e. Tax rules vary by state (RICMS), municipality, and product category (NCM). Manual issuance breaks at scale; one wrong CFOP code blocks invoices for the whole month.
Architecture · NF-e compliance flow
Three agents from ERP event to SEFAZ-validated invoice.
Part VI
VI
Vertical examples.
Same pattern, different domain.
Vertical · Same pattern, different domain
Where multi-agent flows pay off in four industries.
Finance
KYC + AML triage
Document agent reads onboarding files, risk-scoring agent matches sanctions lists, escalation agent routes to compliance officer with dual-control on approval.
Healthcare
Prior authorization
Clinical-extraction agent + payer-rules RAG + HITL with physician before submission. Cuts authorization time from days to hours, all decisions logged for audit.
Retail
Returns & reverse logistics
Triage agent classifies return reason, refund agent runs policy check, logistics agent books pickup. HITL only on exceptions over the SKU threshold.
Manufacturing
Predictive maintenance
Telemetry agent watches IoT signals, diagnostics agent proposes work orders, scheduling agent slots technicians. Plant manager approves work orders over 4 hours.
Part VII
VII
Architecture best practices.
Six layers that turn pilots into platforms.
Architecture · Six layers
Build agents on top of platform primitives, not around them.
Architecture · Five principles
Five rules every Microsoft AI agent program should adopt.
01Start narrow. One use case, one agent, one team. Generalize after value is proven.
02Reuse Azure governance. Identity, RBAC, Content Safety, Purview — same controls as the rest of the stack.
03Catalogue every tool. MCP server registry, scoped tokens, audit per call. No agent talks to a random API.
04Evaluate before deploy. Golden test set per agent, regression on every model swap, latency budget per loop.
05Plan the deprecation. Version every prompt, log every change, keep the rollback — agents drift like models do.
Part VIII
VIII
Implementation roadmap.
From first pilot to production-grade fleet.
Roadmap · Five phases over 12 months
Phase by phase, with measurable exit criteria.
Closing thought
Three platforms.One Microsoft AI fabric.
Building the future of software development with AI and Agentic DevOps.