Building Structured Outputs was one of my personal highlights! The engineering side was actually super challenging, in order to get constraining to work at scale but also without impacting latency. There was a ton of work there to bring everything together in a performant way. If you want to learn more about it, we talked about it here: https://www.youtube.com/watch?v=kE4BkATIl9c :)
7 Likes