Can no longer extract accuracy and loss for fine-tuning jobs

API Bugs
1

The Python code below used to work to access accuracy and loss in csv format for fine-tuning jobs (last tested May 3):

client = OpenAI()
res = client.fine_tuning.jobs.retrieve(job_id)
result_file_id_list = res.result_files
result_file_id = result_file_id_list[0]
content = client.files.content(result_file_id).content

It now gives an uninterrupted single string consisting of lowercase, capitals and digits, e.g. (first observed May 22) :

b’c3RlcCx0cmFpbl9sb3NzLHRyYWluX2FjY3VyYWN5LHZhbGlkX2xvc3MsdmFsaWRfbWVhbl90b2tlbl9hY2N1cmFjeQoxLDEuOTA2OTEsMC43NSwsCjIsMC4wMTQwMiwxLjAsLAozLDEuOTc1NDMsMC43NSwsCjQsMC4wMDk1NywxLjAsLAo1LDEuMjU5NjYsMC43NSwsCjYsMC4wMTMyOCwxLjAsLAo3LDAuMDA2OTMsMS4wLCwKOCwwLjAxODUxLDEuMCwsCjksMi4yMTkzOCwwLjc1LCwKMTAsMC4wMDY2MSwxLjAsLAoxMSwwLjAwMDc1LDEuMCwsCjEyLDAuOTM1MzIsMC43NSwsCjEzLDEuMTIxMDYsMC43NSwsCjE0LDAuMTY0NSwxLjAsLAoxNSwwLjAwNjY2LDEuMCwsCjE2LDEuNjI2MDIsMC43NSwsCjE3LDAuMjM4NDIsMC43NSwsCjE4LDAuMDAxNjksMS4wLCwKMTksMS42MDYxNCwwLjc1LCwKMjAsMC4wMDA1NCwxLjAsLAoyMSwwLjAwMDg1LDEuMCwsCjIyLDAuMDAwMzEsMS4wLCwKMjMsMC4wMDAzLDEuMCwsCjI0LDAuNDAyOTcsMC43NSwsCjI1LDEuOTc1NzYsMC43NSwsCjI2LDAuMzE0MjIsMC43NSwsCjI3LDAuMDAwNjgsMS4wLCwKMjgsOGUtMDUsMS4wLCwKMjksMC4wMDE0OCwxLjAsLAozMCwwLjAwMDEsMS4wLCwKMzEsMC4wMDA0OSwxLjAsLAozMiwwLjAwMDUxLDEuMCwsCjMzLDAuMDEyMjMsMS4wLCwKMzQsMC40MzgzMiwwLjc1LCwKMzUsMC4zODAxNSwwLjc1LCwKMzYsMmUtMDUsMS4wLCwKMzcsMC43NTU3LDAuNzUsLAozOCwwLjM2MDI5LDAuNzUsLAozOSwwLjAwODUxLDEuMCwsCjQwLDAuMDAwMjQsMS4wLCwKNDEsMC4wMjE3NywxLjAsLAo0MiwwLjkyNjc3LDAuNzUsLAo0MywxLjQ3ODI3LDAuNzUsLAo0NCwwLjAwMDM0LDEuMCwsCjQ1LDAuMDAzODQsMS4wLCwKNDYsMC43MjA3OCwwLjc1LCwKNDcsMC4yNDM3NiwwLjc1LCwKNDgsMS4xMjE0OCwwLjc1LCwKNDksMC41NDEzOSwwLjc1LCwKNTAsMi4wMzYwNSwwLjc1LCwKNTEsMS4xODU1OSwwLjc1LCwKNTIsMC4wMDA2MSwxLjAsLAo1MywwLjEzMzMzLDEuMCwsCjU0LDAuMDAxMjMsMS4wLCwKNTUsNGUtMDUsMS4wLCwKNTYsMmUtMDUsMS4wLCwKNTcsMC42MDkxMSwwLjc1LCwKNTgsMC4wMDAzNiwxLjAsLAo1OSwwLjkzMjIyLDAuNzUsLAo2MCwwLjA1MTQ0LDEuMCwsCjYxLDJlLTA1LDEuMCwsCjYyLDAuMDQyLDEuMCwsCjYzLDAuMDAzNDUsMS4wLCwKNjQsMC4wNjUyMiwxLjAsLAo2NSwwLjA2ODIzLDEuMCwsCjY2LDAuNjgyNDUsMC43NSwsCjY3LDAuMDk3MjcsMS4wLCwKNjgsMWUtMDUsMS4wLCwKNjksMC4yOTYwOCwwLjc1LCwKNzAsMWUtMDUsMS4wLCwKNzEsMC4wMDM5OCwxLjAsLAo3MiwxZS0wNSwxLjAsLAo3Myw1ZS0wNSwxLjAsLAo3NCwwLjAxMTUxLDEuMCwsCjc1LDFlLTA1LDEuMCwsCjc2LDAuMjY3OTQsMC43NSwsCjc3LDAuMDAwMywxLjAsLAo3OCwwLjA0Nzg5LDEuMCwsCjc5LDFlLTA1LDEuMCwsCjgwLDFlLTA1LDEuMCwsCjgxLDAuMDI0MzIsMS4wLCwKODIsMS4zMjQ5OCwwLjc1LCwKODMsMC4wMjY1NSwxLjAsLAo4NCwxZS0wNSwxLjAsLAo4NSwxZS0wNSwxLjAsLAo4NiwwLjI0MTI5LDAuNzUsLAo4NywwLjEyMjk5LDEuMCwsCjg4LDAuODkyNDIsMC43NSwsCjg5LDAuMDEwMjQsMS4wLCwKOTAsMC4xMjI5LDEuMCwsCjkxLDIuMTgyMTcsMC43NSwsCjkyLDVlLTA1LDEuMCwsCjkzLDFlLTA1LDEuMCwsCjk0LDAuMDA3MTUsMS4wLCwKOTUsMmUtMDUsMS4wLCwKOTYsMC40NDAxNiwwLjc1LCwKOTcsMC41ODg3LDAuNzUsLAo5OCwwLjI5Mjc1LDAuNzUsLAo5OSwwLjAwNjA5LDEuMCwsCjEwMCwxZS0wNSwxLjAsLAo=’

Any help would be appreciated.

Thanks!

2

The “uninterrupted single string consisting of lowercase, capitals and digits” that you’ve mentioned, is base64. Just convert it into text and you get:

step,train_loss,train_accuracy,valid_loss,valid_mean_token_accuracy
1,1.90691,0.75,,
2,0.01402,1.0,,
3,1.97543,0.75,,
4,0.00957,1.0,,
5,1.25966,0.75,,
6,0.01328,1.0,,
7,0.00693,1.0,,
8,0.01851,1.0,,
9,2.21938,0.75,,
10,0.00661,1.0,,
11,0.00075,1.0,,
12,0.93532,0.75,,
13,1.12106,0.75,,
14,0.1645,1.0,,
15,0.00666,1.0,,
16,1.62602,0.75,,
17,0.23842,0.75,,
18,0.00169,1.0,,
19,1.60614,0.75,,
20,0.00054,1.0,,
21,0.00085,1.0,,
22,0.00031,1.0,,
23,0.0003,1.0,,
24,0.40297,0.75,,
25,1.97576,0.75,,
26,0.31422,0.75,,
27,0.00068,1.0,,
28,8e-05,1.0,,
29,0.00148,1.0,,
30,0.0001,1.0,,
31,0.00049,1.0,,
32,0.00051,1.0,,
33,0.01223,1.0,,
34,0.43832,0.75,,
35,0.38015,0.75,,
36,2e-05,1.0,,
37,0.7557,0.75,,
38,0.36029,0.75,,
39,0.00851,1.0,,
40,0.00024,1.0,,
41,0.02177,1.0,,
42,0.92677,0.75,,
43,1.47827,0.75,,
44,0.00034,1.0,,
45,0.00384,1.0,,
46,0.72078,0.75,,
47,0.24376,0.75,,
48,1.12148,0.75,,
49,0.54139,0.75,,
50,2.03605,0.75,,
51,1.18559,0.75,,
52,0.00061,1.0,,
53,0.13333,1.0,,
54,0.00123,1.0,,
55,4e-05,1.0,,
56,2e-05,1.0,,
57,0.60911,0.75,,
58,0.00036,1.0,,
59,0.93222,0.75,,
60,0.05144,1.0,,
61,2e-05,1.0,,
62,0.042,1.0,,
63,0.00345,1.0,,
64,0.06522,1.0,,
65,0.06823,1.0,,
66,0.68245,0.75,,
67,0.09727,1.0,,
68,1e-05,1.0,,
69,0.29608,0.75,,
70,1e-05,1.0,,
71,0.00398,1.0,,
72,1e-05,1.0,,
73,5e-05,1.0,,
74,0.01151,1.0,,
75,1e-05,1.0,,
76,0.26794,0.75,,
77,0.0003,1.0,,
78,0.04789,1.0,,
79,1e-05,1.0,,
80,1e-05,1.0,,
81,0.02432,1.0,,
82,1.32498,0.75,,
83,0.02655,1.0,,
84,1e-05,1.0,,
85,1e-05,1.0,,
86,0.24129,0.75,,
87,0.12299,1.0,,
88,0.89242,0.75,,
89,0.01024,1.0,,
90,0.1229,1.0,,
91,2.18217,0.75,,
92,5e-05,1.0,,
93,1e-05,1.0,,
94,0.00715,1.0,,
95,2e-05,1.0,,
96,0.44016,0.75,,
97,0.5887,0.75,,
98,0.29275,0.75,,
99,0.00609,1.0,,
100,1e-05,1.0,,
2 Likes