Is the 2046 token limit (embeddings API) a global limit?

General API discussion
#1

Hi there –

We want to improve the Weaviate OpenAI module (GH-issue) for dealing with payloads > the maximum token limit size.

Question: is the 2046 token limit global or is it different per API / can it change over time? If it’s not global, it might be handy to get the value as an int in the error message.

Thanks :slight_smile:

1 Like