AI Agents Need Identity Before They Earn Your Trust

by

AI agents are moving from helpful assistants to digital operators

If you run a Malaysian SME, you may already use AI to draft replies, summarise documents, prepare quotations or answer customer questions. The next step is more powerful: AI agents that can choose tools, retrieve information, update systems and complete several connected tasks with limited supervision.

That capability can improve daily operations, but it also creates a security question that is easy to overlook: how do you know what the agent is doing after it has logged in?

The source article, published by VentureBeat, argues that identity must come before access gateways and that organisations need “runtime trust” for autonomous AI. Its central point is practical for you: authentication can confirm which agent is connected, but it does not prove that every action the agent takes remains safe, necessary or aligned with your original instruction. Source: VentureBeat

What Happened

Enterprise AI is changing from software that follows fixed instructions into software that can decide how to achieve an objective. An agent may select an application programming interface, search a knowledge base, call an external tool, update a customer record and pass information to another agent. These decisions can happen dynamically, based on the information available at that moment. Source: VentureBeat

Traditional security asks three familiar questions: who are you, what can you access and what are you allowed to do? Identity providers, multi-factor authentication and role-based access controls remain important. However, an AI agent can possess valid credentials and still behave in an unexpected way. It may retrieve unrelated confidential information, call unnecessary tools or act on manipulated instructions found in a document or memory store.

The article describes several runtime risks. “Goal drift” occurs when an agent slowly moves away from the original task. Excessive tool invocation happens when an agent calls more systems or performs more operations than necessary. Memory poisoning inserts misleading information into a persistent memory or retrieval system. Context manipulation steers an agent through altered documents, prompts or conversation history. In a multi-agent setup, one incorrect action can also be accepted and amplified by other agents. Source: VentureBeat

Authentication verifies who an AI agent is. Runtime trust continuously verifies what it is doing.

Why This Matters for Malaysian SMEs

For a small business, the risk is not limited to a large corporate AI platform. Imagine an agent connected to your shared email, cloud drive, customer relationship system and accounting workflow. You ask it to prepare a follow-up list for customers who have not replied. If it has broad access, it might also read unrelated staff files, search sensitive documents or send messages without checking whether the content is appropriate.

A Malaysian trading company could use an agent to monitor enquiries from WhatsApp, email and a website form, then prepare draft quotations. A service business might use one to schedule technicians, retrieve customer history and update job status. A small manufacturer could connect an agent to purchase requests, stock records and supplier communications. These use cases are useful, but each connection expands the number of places where incorrect instructions, outdated data or excessive permissions can cause trouble.

Local business processes also commonly involve personal data, customer addresses, identification details, payment information, employee records and supplier documents. You should therefore treat an AI agent as a digital worker with a defined identity, not as a generic chatbot. It needs a clear job scope, limited access, activity records and approval rules. Malaysia’s Personal Data Protection Department provides guidance and information on personal data protection obligations that businesses should consider when handling personal information. Source: Personal Data Protection Department, Malaysia

What runtime trust looks like in practice

Runtime trust does not mean blocking every automated action. It means checking whether an action is reasonable while the agent is working. Before an agent sends a customer message, changes a record or accesses a sensitive file, your automation system should ask whether the action is necessary for the stated task and within the agent’s approved scope.

Control What you should implement SME example
Agent identity Give each agent its own account or service identity. Separate identities for sales follow-up and invoice processing.
Least privilege Grant only the tools and data required for one workflow. A scheduling agent can view appointment details but cannot alter payroll files.
Approval gates Require human confirmation for high-impact actions. You approve refunds, account changes and external broadcasts.
Activity logging Record tools used, records accessed and actions taken. Review why an agent opened a particular customer file.
Short-lived access Use permissions that expire after the task or session. An agent receives stock-system access only during inventory checking.

Start with a small, controlled workflow

You do not need to automate your entire business at once. Choose one workflow with a clear beginning and end, such as classifying incoming enquiries, preparing draft replies or producing a daily stock summary. List every system the agent needs, then remove any access that is not essential.

Next, define actions the agent may perform automatically and actions requiring approval. Drafting a quotation may be acceptable without confirmation, while sending it to a new customer or changing a customer’s account status may require a staff member to review it. Record the original request, the data used, the tools called and the final result.

Also decide what happens when the agent is uncertain. It should stop and ask you or a named employee rather than inventing an answer or continuing with wider access. A useful fallback message is: “I could not verify this information, so I have paused the task for review.” That simple rule can prevent an uncertain decision from becoming an operational mistake.

The Bigger Picture

The security discussion around AI often focuses on prompt injection, model weaknesses and data leakage. Those issues matter, but autonomous agents introduce a broader operational challenge. The agent may be correctly authenticated and still make a poor decision because a retrieved document was changed, a memory entry became outdated or another connected tool returned misleading information.

That is why identity, permission and monitoring should be designed together. Frameworks such as NIST’s zero-trust guidance provide a useful foundation for checking access rather than automatically trusting a connection. Source: NIST SP 800-207 For AI-specific threats, MITRE ATLAS catalogues adversarial techniques affecting machine-learning systems, while OWASP’s GenAI Security Project provides security guidance for generative AI applications. Source: MITRE ATLAS Source: OWASP GenAI Security Project

For you, the practical lesson is straightforward: do not ask only whether an AI agent can log in. Ask what it can do after logging in, which information shapes its decisions, how you will detect unusual behaviour and where a person must approve the next step.

As AI agents become part of sales, operations, administration and customer service, the businesses that benefit most will not simply give agents more access. They will give agents clearly defined identities, narrow responsibilities and visible boundaries. That approach lets you automate useful work while keeping important decisions under control.

Ready to Streamline Your Operations?

Technology moves fast. Your operations should keep up. AutoRunBiz builds AI systems that run your daily workflows — from WhatsApp order capture to accounting. Book a free 15-min ops audit →