Returned files from custom GPTs aren't available in Code Interpreter

When talking to custom GPTs, files returned from actions aren’t available in /mnt/data (or other directories).

Example:

{
    "openaiFileResponse": [
        "https://url.to/some/file"
    ],
    "some_other_field": "some other value",
}
  • Agent downloads the file (on the openai servers) and if it is an image displays it in the chat.
  • User asks for example: “Use code interpreter to flip the image horizontally”
  • Code interpreter fails because it couldn’t find the image

What am I doing wrong, or are the files described in openaiFileResponse simply not accessible to code interpreter ?