Can I customize RealTime API for my find and Order use case?

API
,
1

I am trying the new RealTime API.

My use case is to build an Mobile App that helps a) find best Sushi place at my current location and b) Seamlessly helps place an order or book a table from my phone.

How do I go about delegating to my booking integrations from such back and forth conversation ?

Example below is current flow using the playground:

user : What is the best sushi place in Vegas?
open ai : The top-rated sushi place in Las Vegas is Kabuto. It’s famous for its authentic Edomae sushi, offering a traditional Japanese dining experience. Enjoy your meal! Anything else I can assist you with?
user : Can you place an order there?
open ai : I can’t place orders directly, but I can help you find their contact information or online ordering page. Would you like me to do that?

2

Yes. But it’s important to note that RealTime API is merely a tool for handling interactions through voice.

Everything else has to be done by yourself exactly the way it was done using the other modalities.

Also, as of now it does not work with Assistants so you may end up having to manage 2 separate agents (yuck)