Max token 2048 in the playground

API
,
1

In the playground, we have a maximum length of 2048 for gpt-3.5 and gpt-4, whereas documentation states there are 4000 and 8000 available for these models.

Why the playground has only a 2048 limit?
Does it mean we have the same limits in API? How to know what max-tokens limits we have for API?

We had the paid account, then we got Azure free credits, so now payments are covered by these credits. Maybe somehow our account is considered as a free and max token cut out for us?

2

The API doesn’t have the 2048 limit. I know the Playground is limited to 2048, but it’s a UI limit, not a model limit.

1 Like