st-Effective Chatbot Model for Using Provided Chat History (API Cost Inquiry)

API
,
1

Hello Community,

I’m developing a chatbot that needs to reference chat history that I will provide. I’m looking for advice on the best model to use that balances performance and cost, particularly regarding API usage.

Key points:

  • Chat History: I will provide the chat history, and the model should efficiently use it to generate responses.
  • API Cost: I’m particularly interested in understanding the API costs associated with this setup, as cost efficiency is crucial for my project.
  • Integration: The chatbot will be deployed in a mobile app that requires real-time interaction.

Could you recommend a model that meets these requirements and provide insights into the associated API costs? Any tips on managing the chat history for optimal API usage would also be appreciated.

Thank you for your guidance!

2

Either of the chat models would be fine, but, if you’re particularly price-conscious, gpt-4o-mini is the model for you.

1 Like