Here is a Realtime Voice API Plugin for Unreal Engine and all-talking 3D Metahumans

Community
, ,
16

Regarding Unreal Engine Version: I got everything working in Unreal Engine 5.4.4 using the pre-built Runtime Audio Importer from the Marketplace. However, to get Audio2Face functioning, I had to downgrade to Unreal 5.3 since Audio2Face currently doesn’t support Unreal 5.4 or 5.5.

Regarding Virtual Cables: There’s nothing specific to configure in Unreal for virtual cables. Follow these steps:

  1. Open the Sound settings in Windows and set the system’s audio output to a virtual input cable.
  2. Connect the virtual output cable as the microphone input in the same settings.
  3. Start Audio2Face in Record or Live mode with this configuration.
  4. Before pressing play in Unreal, go back to the Sound settings and switch the input back to the real microphone instead of the virtual cable. (Yes, it’s a bit of a hack, but it works!)
  5. On the other end, use vMeeter to route the output back to the sound card. In vMeeter settings, you can adjust the output delay to compensate for the 300ms processing time required by Audio2Face.
3 Likes