I though the “seed” inference parameter will help in 100% reproducibility. Does anyone know how it works internally and why in some scenarios, it violates reproducibility.
seed -
integer or null- OptionalThis feature is in Beta. If specified, our system will make a best effort to sample deterministically, such that repeated requests with the same
seedand parameters should return the same result. Determinism is not guaranteed, and you should refer to thesystem_fingerprintresponse parameter to monitor changes in the backend.
1 Like