"Multi-user" ChatGPT in a Forum

General API discussion
1

I’ve been so busy with code maintenance for my Discourse Chatbot adaptor for ChatGPT that I’ve not had time to experiment with this but would love to hear some opinions:

Are ChatGPT/gpt-3.5-turbo models good at dealing with user prompts that come from different users?

We tend to use ChatGPT as one on one with the LLM.

But in a forum we usually have multiple users in the same thread/topic.

I’ve had some significant success with my Summarization plugin in adding usernames to posts and Davinci seems to reliably attribute statements and information to the right users.

But will this work with chat effectively, should it? And how best to attribute? Just prepend username: in front of each post prompt`?

Is there an option to change the role to define different users?

1 Like
2

You cannot define users at the session layer using the chat completion method. There is an optional user param but it is only used by the OpenAI staff for abuse monitoring.

All sessions and dialog management happens on the client side.

HTH

:slight_smile:

2 Likes
3

I was thinking about the role value, I suppose this will be rejected or ignored?:

openai.ChatCompletion.create(
  model="gpt-3.5-turbo",
  messages=[
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "gary", "content": "Who won the world series in 2020?"},
        {"role": "assistant", "content": "The Los Angeles Dodgers won the World Series in 2020."},
        {"role": "steven", "content": "Where was it played?"}
    ]
)

Or any idea what benefit or chaos might ensue if I prepend every message with a username?

openai.ChatCompletion.create(
  model="gpt-3.5-turbo",
  messages=[
        {"role": "system", "content": "You are a helpful assistant."},
        {"role": "user", "content": "gary: Who won the world series in 2020?"},
        {"role": "assistant", "content": "The Los Angeles Dodgers won the World Series in 2020."},
        {"role": "user", "content": "steven: Where was it played?"}
    ]
)

Looking forward to a turbo playground :wink:

4

It will generate a error, like so:

{message=>'error' is not one of ['system', 'assistant', 'user'] - 'messages.0.role', type=>invalid_request_error, param=>nil, code=>nil}

:slight_smile:

1 Like
5

I have it working in a group chat. Its simple, just insert the username in each role for user. Like so

{“role”:“user”,“content”:“%USERNAME said %COMMAND%”}]}
{“role”:“user”,“content”:“John Doe said hows it going fam”}]}

My bot remembers everything a certain person told it. Favorite color, number, what type of shoes they like. And even responds to that person with their history.

3 Likes
6

Perfect, thanks. I’ll try that pattern! Thanks to you both!

7

Hi @merefield

Here is how I do it in my lab:

Screenshot 2023-03-06 at 8.52.54 AM
Screenshot 2023-03-06 at 8.52.54 AM2016×860 52 KB

Basically, I have a ChatConversation DB table, something like this:

Draft chat_conversation table:

  create_table "chat_conversations", force: :cascade do |t|
    t.string "description"
    t.string "user"
    t.string "messages"
    t.integer "total_tokens"
    t.integer "prompt_tokens"
    t.integer "completion_tokens"
    t.datetime "created_at", precision: 6, null: false
    t.datetime "updated_at", precision: 6, null: false
  end

Note, I thought about serializing the token usage but kept them separate so I could easily update them and track. However, there is nothing wrong with serializing the usage info.

Hope this helps.

:slight_smile:

1 Like