GPT-4 API - What is the Chat History Limit? And Token Completion Limit?

API
1

I need to create a sliding window context for transcription text from video content.

What is the maximum current token length I can hold within the Chat History?

I’m happy to chunk if needed, I just need to know what the token limits are please?

Best regards,

2 Likes
2

GPT-4 now has 8k tokens max, and there is a larger 32k token model on the horizon in the API.

5 Likes