How do I get LiveKit MultimodalAgent to use 4o-mini-realtime?

I’m using livekit’s node.js SDK for realtime api. Since the 4o-mini became available, I can save 90% of my variable costs for the product. Hence, the urgency.

I know it’s just been announced. But if anyone’s been able to get it to work with the new model, please share the steps you took to achieve that.

I’ve already dug into the library and changed model params where they were searchable. But that doesn’t have any effect on what the server does in the end. It still uses the the expensive 4o model according to logs.

Any advice is much appreciated!

In the python SDK, the plugins.openai.realtime.RealtimeModel class takes a model string when initializing it. The same class in the Node SDK probably has the same thing. You can pass the new model name there.

1 Like