Understanding Context Tokens and Generated Tokens Ratio

API
, ,
2

I’m not sure what the ratio of input tokens to output tokens would have to do with quality of assistant. Can you elaborate on what you’re thinking?

1 Like