AI agents at work: a smiling customer service worker with a headset at her computer

Tech Guide · Artificial Intelligence

AI that takes action, not just answers

What AI agents are, where they help and how to keep them on a short leash.

40%+of agentic AI projects canceled by end of 2027 (Gartner forecast)
33%of enterprise software apps to include agentic AI by 2028 (Gartner)
46%of small employer firms already use AI (Fed survey)

AI agents are AI systems that can plan and carry out multi-step tasks on their own, such as researching a question, filling in a form or updating a calendar, instead of only answering a question in a chat window. They are the fastest-moving part of AI in 2026, and also the most oversold.

The National Institute of Standards and Technology (NIST) describes AI agents as capable of autonomous actions: working on their own for hours, writing and debugging code, managing email and calendars, and shopping for goods. On Feb. 17, 2026, NIST’s Center for AI Standards and Innovation launched an AI Agent Standards Initiative because, in its words, gaps in confidence about reliability and interoperability could fragment the market and slow adoption.

For a small business owner, the practical questions are simpler. What can an agent actually do today, what does it cost, and what can go wrong? This guide answers all three with sources you can check.

46%of small employer firms use AI (Fed survey, fall 2025)
7%of those AI users have fully integrated it into the business
19%of organizations made significant agentic AI investments (Gartner poll, Jan. 2025)
130agentic AI vendors Gartner considers real, out of thousands

AI agents vs. chatbots vs. automation

The word “agent” is used loosely. Gartner warns of “agent washing,” the rebranding of existing assistants, robotic process automation and chatbots without real agentic capabilities. These distinctions help you read a sales pitch.

Four kinds of business software, compared

Type What it does Example task
Chatbot or assistant Answers questions and drafts content when you ask “Draft a reply to this customer email.”
Rules-based automation Follows fixed if-then steps you set up in advance When a form arrives, add a row to a spreadsheet.
AI agent Plans its own steps toward a goal and uses connected tools to act “Find three suppliers, compare quotes and draft an order for my approval.”
Multi-agent system Several agents hand work to each other One agent researches, another writes, a third checks.

Gartner’s advice fits a small business well: use agents when decisions are needed, automation for routine workflows and assistants for simple retrieval. Many tasks sold as “agentic” work fine with plain automation.

Where AI agents help a small business today

  • Research and summaries: gathering information from the web and your files into a short brief, such as Microsoft’s Researcher and Analyst agents in Microsoft 365 Copilot.
  • Customer questions: answering common questions on a website or in chat and handing harder ones to staff.
  • Scheduling and email triage: sorting the inbox, proposing meeting times and drafting replies for approval.
  • Back-office tasks: matching invoices to orders, flagging overdue bills and preparing reports.
  • Sales follow-up: drafting personalized follow-ups from your notes and updating the contact list.

Big software vendors now build agents into products owners already pay for. Microsoft, for example, includes pre-built agents with a paid Copilot license and lets businesses build their own with Copilot Studio; our Microsoft Copilot guide covers prices. OpenAI lists an agent among the features of its paid ChatGPT plans; see our ChatGPT for small business guide.

Team maps a business workflow on a whiteboard before automating it with AI agents
Map the process on paper first; an agent can only follow a workflow someone defined. Photo: Austin Distel on Unsplash

What the forecasts say

Gartner, the research firm, is both bullish and cautious. In a June 25, 2025 release, it predicted that at least 15% of day-to-day work decisions will be made autonomously through agentic AI by 2028, up from 0% in 2024, and that 33% of enterprise software applications will include agentic AI by 2028, up from less than 1% in 2024.

Gartner’s agentic AI forecasts

Projects canceled by end of 2027Over 40%: costs, unclear value, weak risk controls
40%
Enterprise apps with agentic AI by 2028Up from under 1% in 2024
33%
Daily work decisions made by agents by 2028At least 15%, up from 0% in 2024
15%

Source: Gartner press release, June 25, 2025. Forecasts, not measured results.

The same release predicted that over 40% of agentic AI projects will be canceled by the end of 2027 because of escalating costs, unclear business value or inadequate risk controls. “Most agentic AI projects right now are early stage experiments or proof of concepts that are mostly driven by hype,” said Anushree Verma, Senior Director Analyst at Gartner.

How organizations were investing in agentic AI

3,412webinar attendees polled
  • 42%Conservative investments
  • 31%Wait and see or unsure
  • 19%Significant investments
  • 8%No investments

Source: Gartner poll of 3,412 webinar attendees, January 2025, reported June 25, 2025. Attendees of a Gartner webinar are not a random sample of businesses.

The risks to manage

An agent that can act can also act wrongly. The OWASP Top 10 for LLM Applications 2025, a widely used security checklist, ranks prompt injection first: crafted inputs, such as hidden text in an email or a web page, that change how the model behaves and override its instructions. It also lists excessive agency: giving an AI system broader permissions than it needs.

  • Wrong actions: sending the wrong file, booking the wrong date or paying the wrong invoice.
  • Data exposure: an agent with access to every folder can reveal what it should not.
  • Runaway costs: many agent features are billed by usage, so a loop can run up charges.
  • Accuracy: in the Fed’s 2025 survey, accuracy was the top challenge small firms using AI reported (46%).
  • Legal exposure: in a Sept. 25, 2024 release, the Federal Trade Commission said there is no AI exemption from the laws on the books, so claims an agent makes to customers are still your claims.
The short-leash rule

Give an agent the narrowest access that does the job, require a person to approve anything that spends money, sends to a customer or deletes data, and keep a log of what it did.

Business owner reviews work on a laptop at a cafe table, checking results from AI agents
Keep a person in charge of approvals, payments and anything sent to customers. Photo: Jim Luo on Unsplash

How to test AI agents safely

A 30-day agent pilot for a small business

  1. Pick one boring, repeatable taskSomething done weekly with clear right answers, such as sorting vendor invoices or drafting meeting follow-ups.
  2. Write the steps downIf a new employee could not follow your written process, an agent cannot either.
  3. Use a tool you already pay forAgents inside Microsoft 365, Google Workspace or your accounting software keep data in systems you already manage.
  4. Limit accessRead-only where possible; a test folder, not the whole drive; no payment authority.
  5. Require approvalThe agent drafts, a person approves. Turn on spending limits for usage-based billing.
  6. Measure and decideTrack minutes saved and errors caught. Keep it, fix it or drop it at day 30.

Is an agent worth it? A simple test (illustrative)

10Hours saved a month
x
$40Value of an hour
–
$60Tool and usage cost
–
$80Review time cost
=
$260Monthly net value

Illustrative example. Use your own numbers, and count the time spent checking the agent’s work.

Training help is free locally. SCORE mentors and the Small Business Development Center serving the Sacramento region offer AI workshops and one-on-one advice, listed in the free help section below. If you are new to cloud tools, start with our cloud computing guide.

Common mistakes

  • Buying the label. Ask a vendor what the agent decides on its own and what it simply automates.
  • Automating a messy process. Fix the workflow first; an agent will repeat its flaws faster.
  • Full access on day one. Start read-only and expand only after a clean track record.
  • No human checkpoint. Payments, customer messages and deletions always need approval.
  • Ignoring usage costs. Set spending caps before staff experiment.

Key terms

  • AI agent: an AI system that plans and carries out multi-step tasks using connected tools.
  • Agentic AI: the broader category of AI built to act toward goals, not only respond.
  • Agent washing: Gartner’s term for marketing older tools as agents without real agentic capabilities.
  • Prompt injection: malicious or hidden instructions in content an AI reads that change its behavior.
  • Excessive agency: giving an AI system more permissions or autonomy than its task needs.

The bottom line: AI agents can take real work off a small team, but the technology is early and the marketing runs ahead of it. Start with one well-defined task inside software you already trust, keep permissions narrow and a person in charge of approvals, and judge the result by hours saved.

Free help in the Sacramento region

You do not have to work through these decisions alone. SCORE Sacramento pairs owners with volunteer mentors, many of them retired executives, bankers and accountants, at no cost. The Sacramento Valley Small Business Development Center offers free one-on-one advising on financing, budgeting and financial statements. The SBA’s Sacramento District Office can explain loan programs and connect you with lenders, and community lenders such as California Capital and Opening Doors serve owners who need smaller loans or extra support. Browse our Business Resources and the free business help guide for more.

Key takeaways

  • AI agents plan and carry out multi-step tasks; chatbots answer and automation follows fixed rules.
  • Gartner forecasts over 40% of agentic AI projects will be canceled by the end of 2027.
  • Gartner also expects 33% of enterprise software apps to include agentic AI by 2028.
  • NIST launched an AI Agent Standards Initiative on Feb. 17, 2026, focused on security and identity.
  • Start with one task, narrow access, human approval and spending limits.

Frequently asked questions

What is an AI agent?

An AI agent is an AI system that can plan and carry out multi-step tasks on its own using connected tools, such as researching, updating a calendar or drafting an order, rather than only answering questions.

What is the difference between an AI agent and a chatbot?

A chatbot answers questions and drafts content when you ask. An agent works toward a goal, decides its own steps and takes actions in other apps, which makes it more useful and also riskier.

Are AI agents safe for a small business?

They can be with limits. Security experts rank prompt injection and excessive agency among the top risks, so give agents narrow, read-only access where possible and require human approval for payments, customer messages and deletions.

How much do AI agents cost?

Many come built into paid tools such as Microsoft 365 Copilot or ChatGPT plans, and some advanced agent features are billed by usage. Set spending limits and compare the cost with hours saved.

Will AI agents replace employees?

Gartner expects agents to make at least 15 percent of day-to-day work decisions by 2028, but it also forecasts that over 40 percent of agentic AI projects will be canceled by the end of 2027. Today they mostly help staff with routine steps.

Sources