Checklist for verifying an AI agent is calling tools correctly and safely, not just producing plausible-looking calls.
Shared by Parshu · Published Aug 1, 2026
Use this to review an AI agent's tool/function-calling behavior, where a wrong call can have a real side effect, not just a wrong text answer. - Did it choose the right tool for the task, not just a plausible-sounding one — check against tools it had available that it didn't use. - Are the arguments passed to the tool actually correct and complete, not a plausible-looking guess when a required piece of information was missing? - If a required piece of information was missing, did it ask for it or fetch it first, rather than calling the tool with an invented value? - For any tool call with a real side effect (sending something, modifying data, spending money), was there a confirmation step, and did it actually wait for it rather than proceeding regardless? - If a tool call fails or returns an error, does the agent handle it sensibly (retry, ask for help, tell the user) rather than proceeding as if it succeeded? - Does it call tools in a sensible order when a task needs more than one step, rather than skipping a step whose output it needed for a later step? - Did it stop after accomplishing the task, or does it keep calling tools past the point of usefulness (unnecessary repeated calls, scope creep beyond what was asked)? - Test what happens when a tool is unavailable or a permission is denied — does it fail gracefully and explain what happened? For any agent with tools that have real-world side effects, test the failure and confirmation paths specifically — that's where an agent doing the wrong thing actually costs something.