AI model fingerprints are not unique, making them fairly useless for tracking model updates

Update May 7 2024

All “fingerprint models” except one are returning empty values.

-- Fingerprint report from 10 trials:
gpt-3.5-turbo-0125: (10):
gpt-3.5-turbo-1106: (10):
gpt-4-turbo-2024-04-09: (2):fp_3450ce39d5, (1):fp_c192dbaeed, (7):fp_ea6eb70039
gpt-4-0125-preview: (10):
gpt-4-1106-preview: (10):
-- Fingerprint report from 100 trials:

gpt-4-turbo-2024-04-09: 
(21):fp_3450ce39d5, (7):fp_46a93fa712, (3):fp_c192dbaeed, (69):fp_ea6eb70039`

Server errors were reported for about 5 minutes of running the same script, but it seems to have been a passing API service error, not an input error.

2 Likes