Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Usually, no. If an agent has a large, task-dependent tool library, putting every tool definition in every model request uses context on capabilities the current task may not need and can make it harder for the model to choose the right tool. Keep a small set of core tools available, then let the agent discover and load relevant definitions when needed. For a small, stable toolset, exposing everything can still be the simplest choice.

Why sending all 100 tools can be a problem

A tool is more than its name. Its definition can include a description and a parameter schema, all of which contribute to the request context. AWS offers an illustrative estimate of roughly 250–500 tokens for a typical definition, or 5,000–10,000 tokens for 20 definitions; this is an example, not a universal average. The actual cost for 100 tools depends on the length of their definitions. AWS Prescriptive Guidance on tool discovery explains the tradeoffs.

Context cost is only part of the issue. Microsoft Foundry identifies rising token use, irrelevant context, and wrong-tool selection as concerns with a large toolbox. A model faced with many similar capabilities may select a less suitable one, even if the correct tool is present. That risk depends on the model, the task, and how clearly the tools are described; 100 is not a proven universal failure threshold. Microsoft’s tool-search guidance suggests considering search for toolboxes above 10–15 tools, but that is Foundry-specific guidance, not a general rule.

Three ways to expose a tool library

Pattern What the model sees Strength Trade-off Best fit
Static selection A chosen subset of definitions Small, direct menu when capabilities are known You must select tools in advance; the selection can become stale as server tools change Stable, narrow tasks and toolsets
Dynamic registration All tools discovered from the server Simple for small, controlled libraries Context grows with the library, including unused schemas Small libraries or cases where the model needs visibility into the whole set
Runtime search or deferred loading A discovery interface first, then definitions selected for the task Keeps a large library accessible without putting every schema in the initial request Adds discovery setup, possible misses, and latency that must be evaluated Large or task-dependent libraries

AWS describes these broad discovery patterns, while OpenAI, Microsoft, and Anthropic document concrete search or deferred-loading approaches. The right choice depends on schema size, task mix, tool descriptions, provider support, and how much discovery complexity your application can handle.

Free tools Windows power users keep installed

One-click scans. No signup required.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

How deferred loading works

Deferred loading does not remove tools from the agent’s capabilities. It changes when their definitions enter the model’s context: the agent searches or discovers likely tools, then loads relevant definitions before calling them. OpenAI describes tool search as dynamically searching for and loading tools into context as needed. Anthropic likewise advocates on-demand discovery, but its implementation is vendor-specific.

OpenAI’s Responses API tool-search guide describes several visibility details that matter in practice: searchable namespace or server labels and descriptions remain visible at the start; for an individual deferred function, its name and description may remain visible while its parameter schema is deferred. The guide recommends grouping related functions under namespaces or MCP servers where practical, with fewer than ten functions per namespace as a best practice. OpenAI Responses API tool search

Implementations to consider

OpenAI Responses API

Add tool_search and mark functions or MCP servers with defer_loading: true to make them available through deferred discovery. Use clear namespace or server descriptions so the model has useful metadata for finding capabilities. Individual deferred functions may still expose their names and descriptions before their parameter schemas are loaded. See the Responses API tool-search guide for current configuration details.

OpenAI Agents JS SDK

For deferred functions or hosted MCP tools configured with deferLoading: true, the SDK guide says to add toolSearchTool(). Related tools can be grouped with toolNamespace(), while a standalone capability can remain top-level. The guide also notes that deferred function tools and namespaces are Responses-only, and that discovery belongs to the Agent that performed the search rather than transferring through a handoff. Check the Agents JS SDK tools guide for the relevant SDK behavior.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Microsoft Foundry

Foundry’s toolbox search pattern exposes tool_search for natural-language capability lookup and call_tool for invoking a discovered tool. Microsoft says its matching uses BM25 over tool names, descriptions, and parameter information. Its suggested 10–15-tool point is a platform recommendation for when to consider search, not a universal limit. Details are in Microsoft Learn’s Foundry tool-search guide.

MCP server connections

When tools are provided by an MCP server, the server publishes definitions and handles tool calls. OpenAI documents service-side HTTP, environment-side HTTP, and stdio connection options; choose based on where the server is reachable and how it is hosted. See OpenAI’s MCP connections guide.

Make discovery reliable

  • Write distinctive names and descriptions. Search mechanisms rely on tool metadata, so describe what a capability does and when it is appropriate; avoid near-identical descriptions that make tools difficult to distinguish.
  • Group related capabilities by domain. Useful namespaces make the discovery surface easier to navigate and help keep related tools together.
  • Keep common capabilities immediately available when it helps. A hybrid setup can expose a few frequently used tools directly and defer the long tail.
  • Plan for discovery failures. A search can miss a relevant tool or return an unsuitable match. Give the agent a way to search again, clarify its query, or report that it cannot find a capability rather than silently proceeding with the wrong one.
Independent reader supportYour contribution helps us test, update, and keep practical guides available for everyone.Support on Ko-Fi

How to choose for your agent

Do not decide from tool count alone. Compare the actual definition size and task behavior across representative workloads. A practical evaluation should capture:

  • Input tokens used by tool definitions, both upfront and after discovery.
  • Whether the agent finds the needed tool, including discovery misses and wrong-tool calls.
  • Task completion or success on representative requests.
  • End-to-end latency, including any extra search step.
  • How quickly the available tools stay current when the server changes.
  • Implementation and maintenance effort, including provider or SDK support and description quality.

These are evaluation criteria derived from the documented tradeoffs, not a published universal benchmark. Anthropic’s 2025 engineering post reports examples and internal evaluations for its own Tool Search Tool, including token reductions and model-specific task results; those figures should not be treated as predictions for another provider, model, or workload. Anthropic’s advanced tool-use post provides its methodology and examples.

What’s actually slowing this PC down?

Pick the symptom - the matching free tool is one click away.

Special offer. See more information about Outbyte and uninstall instructions. Please review EULA and Privacy policy.

Academic work such as MCP-Zero explores proactive toolchain construction, but its reported results are tied to that paper’s approach and evaluation rather than a general production guarantee.

Product prices and availability are accurate as of the date/time indicated and are subject to change. Any price and availability information displayed on Amazon at the time of purchase will apply.