Hello everyone,
I am not entirely certain if it’s appropriate to post this here, but I felt it necessary to share my thoughts.
I’ve been thoroughly enjoying the June 13th API update. In particular, the function call feature has been a game changer, simplifying many tasks. For that, I am truly grateful.
However, in order to fully leverage this update, I believe there are a few areas where the documentation could use some enhancements. One such area is the token count.
The existing OpenAI Cookbook example covers up to the 0314 version only. With the 0613 version, it seems that we should use tokens_per_message=3 and tokens_per_name=1 similar to gpt-4-0314, but it’s challenging to discern how to count tokens for the new ‘functions’ argument. I would greatly appreciate it if the documentation could be updated to clarify this aspect.
Additionally, it seems plausible to use the ‘functions’ argument in conjunction with stream=true. While I have managed to figure out the usage through trial and error, having explicit explanations or examples included in the documentation would certainly be beneficial.
Thank you for considering my suggestions. I look forward to future improvements that will continue to enhance the user experience.
Best Regards,
J. Kim