How to Export Full Historical Chat Completion Logs? (API Limit of ~10k)

API
,
1

Hi developer community,

I’m working on a critical data warehousing project and need some guidance on accessing our full historical data.

The Goal: I need to fetch all chat completion logs (specifically the Input prompt, Output response, Timestamp, Tokens, Model, etc.) for our organization, starting from June 16, 2025. We estimate this is 50,000+ logs.

The Problem: I’ve run into a wall. The standard GET /v1/chat/completions API seems to be limited to recent activity. When I paginate backwards, it stops returning data after about 10,300 logs (roughly the last 30 days), and I cannot access the older logs from June/July.

What I’ve Tried So Far:

  1. List API (GET /v1/chat/completions): This was my first attempt. I built a script to paginate backwards (using after), but as mentioned, it hits a hard stop long before reaching the June 2025 data.

  2. UI Data Controls: I checked Settings -> Data Controls in the platform UI, but the “Export Data” button isn’t available on our account.

  3. Privacy Portal: I have successfully submitted a formal data request via privacy.openai.com. This only gave me the personal chats and not the completions chats.

  4. Support Ticket: I have also sent an email to the support team with the full request, which is pending.

I’m posting here while I wait for those requests, hoping the community might have a more direct solution I’ve missed.

My Questions:

  • Is this ~10k log limit on the List API expected behavior?

  • Is there another API endpoint (perhaps one I missed in the documentation) designed for bulk historical export?

  • For those who have needed full historical logs, was the Privacy Portal export the method that finally worked for you?

Any advice or insights would be greatly appreciated. We’re really excited to get this data aligned, but we’re just stuck on this first step of accessing it.

Thanks!