AI NPC interaction and control in game

Nice! What model are you using? Davinci can be slow with a big prompt.

I’ve fired up UE4 again recently, and might play around with this soon…

1 Like

I am using Davinci. I believe that the problem doesn’t come from GPT-3 but rather from the AI voice generation and lip-sync animation.

1 Like

Yes that is very true. These apps are unsustainable for large scale deployment at the moment. The carbon footprint would be too big, even for 100 users. But the produced heat may be distributed in houses… is there a mention of how much CO2 per GPT-3 tokens?

2 Likes

Been working on something similar as well!:

All conversations are currently being powered by GPT3, and I’m using Unity + Google text-to-speech to bring them in the game.

Wrote some of my thoughts of where NPC systems could go, I think GPT3 (and other transformers like it) could power good chunks of that vision:

Biggest problems I’m currently thinking about is cost (I’d love if there were some flat rate or mega bulk discount), how to cement things GPT3 says into the game world (maybe codex can help with this), and game engine code.

7 Likes

Nice job! Your AI seems better behaved than mine. Cant imagine how many games will come out with the Synty artwork style :wink:

2 Likes

Impressive, how did you get the response latency so low ?

This is very impressive! :eyes:

1 Like

Look into multi-modal solutions involving perceiver

I would love to test it out.

1 Like

Very impressive and fast. :heart_eyes: Did you use fine-tuning to reduce latency? :roll_eyes:

1 Like

No finetuning used in my examples. I don’t have access to fine-tuning API for Davinci.

Does fine-tuning reduce latency? I didn’t think it did.

1 Like

Sorry my question was incomplete. I meant fine-tuned curie. Although not as creative as davinci, curie can also do a good job when given preliminary information (I tried it in Prompt, I didn’t use fine tuning). Maybe it will work with enough dialogue examples.

1 Like

Oh that makes sense! I’ll have to try it out!

One thing I’m noticing though is that the latency on DaVinci is negligible compared to the time it takes for Google’s text-to-speech to synthesize the audio.

1 Like

New video. Mostly map updates but added eyes with emotion to the AI entities.

3 Likes

My website is live www.rathergoodgames.com if you would like to see where I am going with this game.

Rob

2 Likes

Any updates?

Hi Paul. Yes my website is finally up. See previous post. Hoping to have some new stuff to share soon!

2 Likes

New work in progress video. the AI is very often unpredictable… https://youtu.be/U7jY-4EFoJA

1 Like

Hey! You should try with davinci-instruct-v3, for me, the conversations worked better than simple davinci.

1 Like

Thank you Ashoka. I had mixed results but will experiment more with it.

1 Like