Using API Structured Output for strict classification

I wonder if at scale it takes advantage of this:

which would make it cheaper.

Alternative classification strategies might include a local cosine distance search with embeddings (though I personally have not been satisfied with the results of that due to too many things being classed as similar).

An embeddings approach would be much much cheaper though.

1 Like