We are using Open APIs Assistant API through Workato to power a RAG to answer questions for our internal sales teams. Its working well except that if you dont interact with it for a decent amount of time (like 10 hours overnight) it seems to give a poor response first thing in the morning. For example you can ask it word for word a question it should know but it will respond that it cant find anything in its resources. You ask the same question a few mins later and it works fine.
Im thinking this has something to do with resources not being instantly available, but am unsure how to address this besides sending some easy to respond to prompt like “look forward to working with you today” to prompt it with something low risk to “wake it up”. Any ideas the cause or how we can address this?
Thanks for the response. Migrating is tough right now because we may have a larger move to Gemini Enterprise so dont want to migrate twice in 6 months, but getting off the Assistants API is on our roadmap for Q1.
I’ll try with a basic assistant and see what outcomes we get there.