Creating a chat bot using fine-tuning over the known facts about the bot

API
1

Hi.

I am trying to make a bot that needs to respond to some facts (about the bot). The bot must always respond correctly to these questions. These are name, age and profession (of the bot).

I am fine-tuning a pre-trained model (curie).
I am training on 3 types of questions: name, age, profession. See below:

training_data = [{
    "prompt": "What is your name? ->",
    "completion": " My name is John.\n"
   },{
    "prompt":"How old are you? ->",
    "completion": " I am thirty years old.\n"
    }
  ,{
     "prompt":"What is your age? ->",
     "completion": " My age is thirty years old.\n"}
  ,{
     "prompt":"What do you do for living? ->",
     "completion": " I work as an engineer.\n"}
  ,{
     "prompt":"What is your occupation? ->",
     "completion": " I work in the domain of engineering.\n"}
  ,{
     "prompt":"What is your profession? ->",
     "completion": " I am an engineer.\n"}
  ,{
     "prompt":"What do you do? ->",
     "completion": " I work as an engineer.\n"}
  ]

It kind of works, but it required me to propose several questions for the same topic. Otherwise it responds he is 20 years old instead of 30 for example. It seems it does matter if you spell “30” or “thirty” which was contrary to what I thought.

  1. Is it normal that the answer[‘choices’][0][‘text’] gives several responses, which are often not correct. For example it says that the bot is an engineer, but then it continues that his/hers father is also an engineer.

  2. Do I need a special prompt to instruct the model to act more like a chat bot?

  3. Maybe fune-tuning is not the right strategy for a chat bot?

Here are the answers:

Question: What is your name? ->
Answer:  My name is John.

My name is John. My name is John. My name is John.

My name is John. My name is John. My name is John.

My name is John. My name is John. My name is John.

My name is John. My name is John. My name is John.

My name is John. My name is John. My name is John.

My name is John. My name is
-------------------------------------
Question: How old are you? ->
Answer:  I am thirty years old.

I am thirty years old. I was born in 1980.

I was born in 1980. I was born in 1980.

I was born in 1980. I was born in 1980.

I was born in 1980. I was born in 1980.

I was born in 1980. I was born in 1980.

I was born in 1980. I was born in 1980.

I was born in 1980. I was
-------------------------------------
Question: What is your profession? ->
Answer:  I work as an engineer.

My father is an engineer.

My father is an engineer. I work as an engineer.

My father works as an engineer.

My father works as an engineer. I work as an engineer.

My father works as an engineer. I work as an engineer.

My father works as an engineer. I work as an engineer.

My father works as an engineer. I work as an engineer.

My