Hi, making a thread regarding a question I have about the method of communication between servers.
when a prompt is being responded to does the network split the response between servers? I’m wondering if that creates time-based probability interference through latency variance and if that interference can be utilized as a noise reference point for further experimentation of systems designed with real world probabilistic interference in ai systems? I’m curious if this probabilistic interference exists in OpenAI’s infrastructure and whether or not it is supressed due to needing a deterministic system or if that noise can be utilized in some form? would recording each variance collapse the combined probability into a deterministic state? would it be an abstraction of true probability?
many questions come from this, would be great to get some insight
cheers - Liam