Assistant Keeps Running in Loop, Exceeding Expected Token Usage

Assistants have their own functions injected.

gpt-3.5-turbo-0613 is not compatible with retrieval or parallel multi-tool.

The quality of the assistants framework is out of your control, where, for example, the AI might not understand the errors it already made, or is confused by having its full context injected with functions and irrelevant file knowledge.

AI is often loopy and repeat-y, and will find patterns and repeat them naturally. You have no parameters available to control such behavior with sampling, penalties, bias, etc. with assistants.

1 Like