Although the Agent Builder executes rather quickly inside the Agent Builder UI in development, Ive noticed that it is very slow when running from a production version (i.e. integrated within a website). Therefore Ive been trying to look at improving its performance. My workflows are starting to get rather complex, using categories, multiple agents and File Search tools.
Guardrail component adds another layer within the workflow, though I dont consider removing this as an option.
When using the File Search tool, is it recommended including it within an Agent as a tool, or use the separate component? See image below:
(this is the only way Ive been able to get the results to work when using the separate File Component, using this workflow)
I’m using GPT 4.1 Nano models, as the work involved for each agent within the workflow is not that complex. The Agent prompts I use follow typical prompt engineering techniques.
What other options / tools are there for improvements in performance?