ERROR in read_any_format validator: File 'my jsonl file' does not exist

API
1

Hello, I am working on fine-tuning gpt-3 for chatbot use case, my jsonl data is in this format as recommended by openai

{"prompt":"Summary: <summary of the interaction so far>\n\nSpecific information:<for example order details in natural language>\n\n###\n\nCustomer: <message1>\nAgent: <response1>\nCustomer: <message2>\nAgent:", "completion":" <response2>\n"}
{"prompt":"Summary: <summary of the interaction so far>\n\nSpecific information:<for example order details in natural language>\n\n###\n\nCustomer: <message1>\nAgent: <response1>\nCustomer: <message2>\nAgent: <response2>\nCustomer: <message3>\nAgent:", "completion":" <response3>\n"}

Now when i run this line:

!openai tools fine_tunes.prepare_data -f 'C:/Users/Salma/Downloads/FB_Messages2.jsonl'

it gives me this error:

Analyzing… ERROR in read_any_format validator: File [C:/Users/Salma/Downloads/FB_Messages2.jsonl](file:///C:/Users/Salma/Downloads/FB_Messages2.jsonl) does not exist. Aborting…

I made sure of the location of the file, I tried with removing the quotation, I tried to give it json instead of jsonl file. I am not quite sure what is the problem .

2

Just as a sanity check, is the file on your drive called blah-blah.json or .jonsl ?

3

Sorry for my late reply, I actually solved the error, I was working on ubuntu subsystem and the file is in my windows.

1 Like
4

Hey, I have the same issue. I generate a .jsonl. file from .json with the open ai tool fine_tunes.prepare_data but when I tried to use it it says not a valid .jsonl file but it starts with { and it’s a pair of values. It gives (HINT: line starts with: "b’{“pr’…”). what is thsi b’ ? I don’t see it in my file. Charset ANSI-1252 on Windows.

5

I think the problem here might be in the formatting of the json file, maybe there is a special character at the beginning of the file, or the encoding, did you try the UTF-8 encoding instead of ANSI-1252 ?

1 Like
6

Hi, I saved the file as UTF-8 (without BOM) and it worked. Thanks for the help!

1 Like
7

IMG_0626
IMG_0626828Ă—1792 247 KB