Seed parameter is not 100% reliable

I though the “seed” inference parameter will help in 100% reproducibility. Does anyone know how it works internally and why in some scenarios, it violates reproducibility.

seed - integer or null - Optional

This feature is in Beta. If specified, our system will make a best effort to sample deterministically, such that repeated requests with the same seed and parameters should return the same result. Determinism is not guaranteed, and you should refer to the system_fingerprint response parameter to monitor changes in the backend.


1 Like