I work for a company that has 10,000’s of customers but only 100’s that need help each day. I would like to deploy an assistant API to A) Automate some tasks B) explain some company specific concepts. Currently I am working with a standard model but will eventually use a fine-tuned model.
Because of security and privacy I thought it was best to create an assistant (the same assistant, different instance) for each conversation. No one customer’s conversation should be shared with anybody else. I thought it would be safest to create an instance for each conversation. I noticed in the web interface it shows I have created 100’s of assistance (expected)… Is this going to be a problem? Does this increase cost significantly? Does this make the thing less efficient?
I believe the alternative is to create a thread for each conversation. I can do this but for piece of mind and to look good on paper I would like to say each conversation is contained in an isolated assistant and it’s not possible for messages to end-up in the wrong thread.
Thoughts? Opinions?
Thank you in advance.