I expect that seed will reproduce the parts where randomness is involved, such as when you set the temperature to 1.0 and get a different response every time by diverse sampling.
Setting the seed that the randomness of the multinomial sampler uses has it pick the same way again. That would rely on the inputs being the same, though, which they are not.
It cannot control that
- temperature of zero is not a deterministic setting (would actually be divide-by-zero),
- nor are the logits returned by the AI model of deterministic values either.
- nor can you see the logits of chat models, as that would expose the flaws in the architectural underpinnings.