I am hoping to pull this into some vr apps when I get time to learn the api. Giving the ability to learn on music would also be supercool.
I’m not sure what your point is.
These “insiders” you’re taking about are given access specifically to test the model for OpenAI.
What about GPT 4o limitation for free users? any idea?!
The limitation is there is no free use of the API, which is this topic’s subject.
In ChatGPT, there may be some free use of GPT-4o in the future, maybe 16 uses per 3 hours.
I am impressed by the remarkable capabilities demonstrated so far. If there are any new developments or advancements in the real-time chat functionality, I would greatly appreciate it if you could keep me informed.
I understand the Omni model API does not support audio at the moment. However, is there any way to access the live language translation as shown in one of your videos?
That would involve using the audio features, so… No.
The limitations for GPT4o free users include the cap on messages per 3 hours and that your conversations train the model. Even Plus users “train the model.” Teams’ conversations and interactions through the API do not.
So _J’s right, he just doesn’t go far enough. Nothing is free, and you pay for your use either with money or with your delicious, delicious input.
Below is one of the prompts (actually one of my shortest). The input test used (i.e. the corpus of text to be assessed] is around 1200 tokens and I have the setting to max lenght = 4096. Yet, I am only getting 200 tokens output. The temp setting is between 0.1 - 0.4. Here is the prompt:
"Task: Assess the narrative of a GCF concept note against the Fund’s investment criteria.
Narrative for Evaluation: [Insert Context and Baseline narrative here.]
Assessment Criteria:
Project Intent: Does the narrative explicitly state the project’s intent to reduce climate vulnerability?
Section 1: Geographic, climatic and socio-economic context:
- Current conditions in the project areas with supporting data and statistics.
- Population demographics and density in the project areas.
- Trends in socio-economic indicators over the past decades (e.g., income levels, employment rates).
- If applicable, environmental and ecological characteristics, including biodiversity and natural resources.
Section 2: Observed historical data:
- Current conditions in the project areas with supporting data and statistics.
- Historical climate data, including temperature, precipitation, and extreme weather events.
- Historical land use and land cover changes in the project region.
Section 3: Climate change projections:
- Demonstrate that climate change is the primary driver of adverse impacts.
- Detail current and projected climate impacts like temperature changes and extreme weather events.
- Expected shifts in agricultural zones and impacts on food security.
RESPONSE GUIDE:
-
Format your assessment in the way indicated below and do not provide recommendations:
[Insert overall assessment of the narrative here with a score on a Scale of 1 - 10] -
Be sure to indicate whether or not a criterion is satisfied because it is explicitly addressed or because the narrative implies that it is addressed.
-
Format the remainder of your assessment in the way indicated below:
Section 1: Geographic, climatic and socio-economic context:
Missing criteria:
+ [Insert missing criteria 1 here]
+ [Insert missing criteria 2 here]
+ …
Note: Generate the list of missing criteria for the subsequent sections in exactly the same format.
-
End with an over all score of the narrative provided on a scale of 1 -10 based on how much the narrative satisfies all the criteria provided prompt. IF all criteria are met, then congratulate the user for the high quality narrative.
-
Do not include any superfluous punctuation marks such as Asterix “*” and “+” signs."
What am I doing wrong? Thanks!
Your prompt currently does not include any wording that you suggests that you are looking for a detailed response. Depending on where exactly you’d like to add detail in the assessment, you need to explicitly state that in your prompt.
For example:
- Be sure to indicate whether or not a criterion is satisfied because it is explicitly addressed or because the narrative implies that it is addressed.
If you’d like more details, you’d have to write something along the lines of:
- Be sure to provide a detailed justification including supporting evidence whether or not a criterion is satisfied because it is explicitly addressed or because the narrative implies that it is addressed.
What additionally may help is to include explicit examples of what you would like the output to look like in terms of length and style.
Personally, I don’t think that with this type of task - in the way it is currently structured - you’ll be able to generate significantly more than 1,000 tokens. output.
We have a similar process for the project we’re working on.
I also put my hands up for this!
Did you read the post? They said that now only vision is available by splitting a video to frames. Other capabilities will be rolled out later, including audio / image multimodality.
Anyone had any success with gpt-4o VISION in ASSISTANTS?
Using the latest (Python) api 1.30.1 I can upload files and I can mark them as ‘vision’ - but in the Assistant API for tools I can only pick file_seach and code_completion (and I must pick either) .
When uploading images with codecompletion it is hit or miss if it actually creates code to read the image. So it seems we’re getting CLOSE but not there yet ? (for Assistants)
Otherwise pretty impressed with the gpt-4o speed in Assistants.
Images for computer vision are part of messages.
Follow this link, and expand the “content” of a user message, to see how to construct a message that refers either to a file ID uploaded or a URL.
https://platform.openai.com/docs/api-reference/messages/createMessage#messages-createmessage-content
I really am looking forward to GPT-4 Omni! 
hope they fix it so we can at least not be locked into the test and be stuck on it every time we make a new chat, can’t change it back to 3.5
I am aware of that. Right now you cannot add a file tagged as ‘vision’ only file search or code completion.
In that I just did, I think you can, if you use the correct method and file purpose when uploading.
Ah I see under type. Sorry I missed that will try right away!!
That works. What baffles me is the choice to also have a type ‘image_url’ - so that now we need to use an AI to filter out image URLS from user supplied text to make sure it gets treated properly 