Being a fan of marble runs/races and wanting to experiment/learn more about the latest AI tech that has been surfacing I decided to mix the two together to bring you this early prototype.
Marble Run where GPT is the sports commentator.
Unreal Engine 5
OpenAI API (Testing done with GPT 3.5 and 4, video is recorded on 4)
11Labs for the voice synthesis.
The only thing that is baked in so far is the intro, the actual race is entirely real time.
I have some ideas for improving the AI latency aside from just switching to GPT 3.5 which seems generally faster but of course any other tips that comes to mind feel free to share.
Fresh upload so won’t be HD for another 45 minutes but SD is up.