Hi everyone! I’m attempting to parse chat text using the method described here, and it’s proving surprisingly difficult to get sensible output. Does anyone have experience doing something similar?
To be more specific, I’m building a chatbot and would like to be able to extract simple boolean values from user replies – questions of the type “did the user mention specific thing X?” To do this I am defining “tools” for each of my questions, and using the description fields to describe what the tools ought to do. However I’m not getting very good performance, with output often not matching the descriptions I’ve written. I’m a bit surprised, since this seems like a fairly simple parsing problem.
Have any of you tried to do something similar? Any advice on how to get it to work better? Is there a better overall approach? I haven’t tried to use the Assistants API yet since it’s just text parsing, but I suppose that’s an option. Any advice is appreciated. Thanks!