I noticed this because I keep getting errors when transcribing my handwritten notes (something I’ve done hundreds of times in the last year).
The error seems to occur with image files only (PDF and JSON files seemed to respond without issue).
The error effectively prevents GPTs from using the image as context in actions. The issue also seems to impact all ChatGPT (the chat screenshot below shows regular 4o without invoking a GPT).
The error seems to effectively prevent ChatGPT from utilizing the image as context.
The error message is:
data: {"message": null, "error": "Error in message stream"}
Below is a request object, some data streams, and a screenshot of the error.
ChatGPT 4o
data: {"message": {"id": "63fd57f2-3ac2-4af3-aaa8-a9fce0496e27", "author": {"role": "assistant", "name": null, "metadata": {}}, "create_time": 1727352484.491128, "update_time": null, "content": {"content_type": "text", "parts": ["The handwritten note suggests keeping a settings configuration processor within a \"smart model.\" It implies this approach may be beneficial for \"smart collections\" as they deal with various item sub-types that require settings.\n\nThis note seems to highlight a decision to integrate or maintain configuration management capabilities directly in a model that likely deals with a diverse array of data or entities, enhancing its flexibility and efficiency in handling different settings.\n\n**Next Actions:**\n1. Evaluated the current capabilities of the smart model regarding settings management.\n2. Identified item sub-types in the smart collections that could benefit from individual settings.\n3. Initiated a plan to integrate the settings configuration processor if not already implemented."]}, "status": "finished_successfully", "end_turn": true, "weight": 1.0, "metadata": {"citations": [], "content_references": [], "gizmo_id": null, "message_type": "next", "model_slug": "gpt-4o", "default_model_slug": "gpt-4o", "pad": "A", "parent_id": "aaa29368-983c-45ed-8caf-52f98b1c6833", "model_switcher_deny": [{"slug": "o1-preview", "context": "regenerate", "reason": "unsupported_attachment", "description": "This model doesn't support file attachments."}, {"slug": "o1-preview", "context": "conversation", "reason": "unsupported_attachment", "description": "This model doesn't support file attachments."}, {"slug": "o1-mini", "context": "regenerate", "reason": "unsupported_attachment", "description": "This model doesn't support file attachments."}, {"slug": "o1-mini", "context": "conversation", "reason": "unsupported_attachment", "description": "This model doesn't support file attachments."}, {"slug": "gpt-4o-mini", "context": "regenerate", "reason": "unsupported_attachment", "description": "This model doesn't support file attachments."}, {"slug": "gpt-4o-mini", "context": "conversation", "reason": "unsupported_attachment", "description": "This model doesn't support file attachments."}]}, "recipient": "all", "channel": null}, "conversation_id": "66f54ea4-061c-8000-ac7c-e5896fc05c5c", "error": null}
data: {"message": null, "conversation_id": "66f54ea4-061c-8000-ac7c-e5896fc05c5c", "error": "Error in message stream"}
data: {"type": "title_generation", "title": "Settings Configuration in Smart Model", "conversation_id": "66f54ea4-061c-8000-ac7c-e5896fc05c5c"}
data: {"type": "conversation_detail_metadata", "banner_info": null, "blocked_features": [], "model_limits": [], "default_model_slug": "gpt-4o", "conversation_id": "66f54ea4-061c-8000-ac7c-e5896fc05c5c"}
data: [DONE]
Similarly in GPT editor
data: {"message": {"id": "a26eb267-f51a-496c-8a9c-1bd46df5ffda", "author": {"role": "assistant", "name": null, "metadata": {}}, "create_time": 1727351854.774804, "update_time": null, "content": {"content_type": "code", "language": "json", "response_format_name": null, "text": "{\"note_path\":\"2023-09-26.md\",\"note_content\":\"- May keep `settings-config processor` in `smart-model`\\n\\t- May make more sense for `SmartCollections` as more item sub-types require settings\"}"}, "status": "finished_successfully", "end_turn": false, "weight": 1.0, "metadata": {"citations": [], "content_references": [], "gizmo_id": null, "message_type": "variant", "model_slug": "gpt-4o", "default_model_slug": "gpt-4o", "parent_id": "aaa28256-1413-465b-b4b3-aec46c209dc8", "model_switcher_deny": [{"slug": "o1-preview", "context": "regenerate", "reason": "unsupported_attachment", "description": "This model doesn't support file attachments."}, {"slug": "o1-preview", "context": "conversation", "reason": "unsupported_attachment", "description": "This model doesn't support file attachments."}, {"slug": "o1-mini", "context": "regenerate", "reason": "unsupported_attachment", "description": "This model doesn't support file attachments."}, {"slug": "o1-mini", "context": "conversation", "reason": "unsupported_attachment", "description": "This model doesn't support file attachments."}, {"slug": "gpt-4o-mini", "context": "regenerate", "reason": "unsupported_attachment", "description": "This model doesn't support file attachments."}, {"slug": "gpt-4o-mini", "context": "conversation", "reason": "unsupported_attachment", "description": "This model doesn't support file attachments."}]}, "recipient": "connect_smartconnections_app__jit_plugin.create_note", "channel": null}, "conversation_id": "66f54bca-6300-8000-be77-26e90728156c", "error": null}
data: {"message": null, "conversation_id": "66f54bca-6300-8000-be77-26e90728156c", "error": "Error in message stream"}
data: {"type": "conversation_detail_metadata", "banner_info": null, "blocked_features": [], "model_limits": [], "default_model_slug": "gpt-4o", "conversation_id": "66f54bca-6300-8000-be77-26e90728156c"}
data: [DONE]