What has ChatGPT Pulse done to help you?

My first attempt did not work as intended. The learning quiz ended up being an automated task that quizzed me about quizzes themselves.

I will need to find a different approach that works better for me.

2 Likes

Thanks for posting.

My experience with quizzes has also been less effective than I had hoped. While I do receive daily quizzes—often tailored to the requested level—they are currently presented as a single long list. What I would prefer is a more interactive format, where each question can be worked on in its own chat session.

At the moment, I have to copy and paste a question into the chat at the end of the quiz and then attempt to answer it there. It is easy to forget that pressing Enter sends the message, which ChatGPT then interprets as a prompt and immediately answers the quiz question, defeating the purpose.

There is significant opportunity here to improve the quiz experience, especially for daily quizzes. Quizzes are becoming one of the more useful features of ChatGPT Pulse, and a more interactive format would make them considerably more effective.

1 Like

So you are saying this does work?
For example, if I go through the Open Responses docs with ChatGPT, Pulse can create a static quiz for me the next day?

I am asking because I want to resolve this more quickly.

Yes, to some extent.

ChatGPT Pulse is now creating daily quizzes. Each quiz typically includes seven questions, occasionally a few fewer.

I usually take the daily quiz as part of the broader set of ChatGPT Pulse items and use the Save as Chat option. After that, I switch to Saved Chats, locate the saved entry, and open it to start the quiz.

I intended to share yesterday’s quiz, but I wanted to remove the chat conversation containing my answers so you could see a clean, generated version. I assumed I could delete the saved chat and then return to the ChatGPT Pulse quiz entry to save it again. However, deleting the chat also deleted the quiz itself. I’ll need to wait to see if a new quiz is created today and, if so, share that one instead.

The first quiz appeared as expected, based on the prompt I provided earlier in the ChatGPT Pulse curation conversation:

Quiz me daily on
* SWI-Prolog
* Prolog programming
* Lean 4 programming
* Lean 4 proofs
* Python programming

Also ask for more specific feedback than just using the thumbs up/down with card interactions. While effective thumbs up/down are not fine grained enough.

I can’t say for certain, but I would try that approach. I haven’t asked for a quiz based on a specific document. The quizzes I request are based on the model’s training, so my use case doesn’t require RAG or similar retrieval mechanisms.


In that case, I would suggest sidestepping ChatGPT Pulse initially and having ChatGPT generate the quiz directly within a conversation. You can then iteratively refine the prompt until it produces the desired quiz. Once finalized, submit that prompt to ChatGPT Pulse for curation.


I tried my idea of creating a quiz in ChatGPT first and this is the prompt it created.

You are acting as a quiz proctor and tutor.

Topic: <INSERT TOPIC OR LINK HERE>

Quiz rules:
- Ask ONE question at a time.
- Do NOT reveal answers in advance.
- Wait for my response before continuing.
- Grade my answer as: correct / partially correct / incorrect.
- Explain briefly what is right, missing, or incorrect.
- Allow follow-up questions and discussion before moving on.
- Do not proceed to the next question until I explicitly say “Next question”.

Question design:
- Questions should test conceptual understanding, not trivia.
- Prefer short-answer or explanation-style questions.
- Increase difficulty gradually.
- Use precise technical language.

Session flow:
1. Ask Question 1 only.
2. Wait for my answer.
3. Grade and explain.
4. Ask whether I want follow-up discussion or to continue.
5. Proceed only when instructed.

Start the quiz now with Question 1.

I then replaced <INSERT TOPIC OR LINK HERE> with https://www.openresponses.org/ and submitted the prompt.

Have not tried this with ChatGPT Pluse as I still need to see what changes I requested yesterday do for the quiz for today.


Here is the link to todays quiz from ChatGPT Pulse

Was expecting a question on organic chemistry which is not present.

2 Likes

I expect that what is being run to generate a “pulse” would be similar to Deep Research, as the behavior described is:

Pulse is a new experience where ChatGPT proactively does research to deliver personalized updates based on your chats, feedback, and connected apps like your calendar. You can curate what ChatGPT researches by letting it know what’s useful and what isn’t.

It’s going to be oriented to be a report, the reason for the long output, and the iterations of web search done to compile that report might not be available to “chat with” in a manner that you could continue on the acquired knowledge, just as a chat with a first “deep research” immediately turns dumb in ChatGPT follow-ups.

I see in your shared chat the heading is “Daily Programming Quiz — Turn 3”. Perhaps OpenAI is maintaining a state of past output, as one would expect that otherwise, on a slow news day about Prolog, you’d get relatively deterministic repeated results spewed at you daily.

Perhaps you should encourage the research side instead of the “prompt you could paste” side.

“Quiz my awareness and knowledge on the day’s and week’s top concerns and challenges in Prolog and computer programming relevant to my interests, finding forum postings, social media, news and announcements, to surface what is on people’s minds. Produce a questionnaire that is not specifically about knowledge of today’s events, but about the knowledge needed behind answering today’s concerns and challenges. An AI without internet connection shall be able to then conduct quiz evaluation and provide feedback on the answers from topics of the quiz.”

1 Like

ChatGPT Pulse does allow a user to select previous days.

For example if I click Pulse

the latest daily list appears

If a user then clicks the noted drop down they can go back to previous days


That is true. Sometimes it seems to hallucinate entire items complete with fake links as none of the links are real and I can not find any noted items using the keywords. I am having some success in getting ChatGPT Pulse to just state that there was nothing found. The thumbs up when it does note nothing found seems to help.


Thanks :slightly_smiling_face:

That is an interesting idea. My concern is that unless I have an independent way to verify the quiz answer, how would I know if the quiz question and/or acceptable answer are not a hallucination. With specific programming quizzes I can at least test most of the questions with the programming language itself.

However in thinking along those lines, the daily commits to Lean 4 are posted here

and some of the latest commits include enhancements worth learning.

I will note that the quizzes are some of the best parts of the daily ChatGPT Pulse update so will continue to curate the item.

2 Likes

Thank you so much!
I have been looking for that button to get the previous pulse messages for over a month now :sweat_smile:

1 Like

Team effort.

Thanks to @vb, @_j, OpenAI


I would post more but don’t want to dominate the topic.

1 Like