Let’s say I have two batch jobs below that use the same “Repetative long system instructions”. Is it possible to cache it in job 1 and resuse the cached instructions in job 2?
file_1.jsonl
{
"custom_id": "request-1",
"method": "POST",
"url": "/v1/chat/completions",
"body": {
"model": "gpt-4o-mini",
"messages": [
{ "role": "system", "content": "Repetative long system instructions" },
{ "role": "user", "content": "Unique content 1" }
]
}
}
file_2.jsonl
{
"custom_id": "request-2",
"method": "POST",
"url": "/v1/chat/completions",
"body": {
"model": "gpt-4o-mini",
"messages": [
{ "role": "system", "content": "Repetative long system instructions" },
{ "role": "user", "content": "Unique content 2" }
]
}
}