OpenAI Unveils Realtime API and New Tools for Developers at 2024 DevDay
Oct 6, 2024

Sam

Did you see what OpenAI announced at their DevDay? They have this new Realtime API!

Amy

Yeah! It lets developers create apps with real-time voice responses. Pretty cool, right? You could talk to an AI assistant and get immediate replies.

Sam

Exactly! They even demoed a trip planning app where you can speak to the AI and get answers right away. That’s kind of like ChatGPT’s voice mode, isn’t it?

Amy

It’s similar, but not exactly the same. This new API is for developers to build their own apps, not just ChatGPT. Plus, it’s designed for low-latency responses, which is really important for real-time conversations.

Sam

Oh, that makes sense. And they said the API can integrate with other tools like maps, right?

Amy

Yep! In the demo, the AI could even mark restaurant locations on a map while you’re talking about where to go. It’s super interactive.

Sam

Wow! But what about the voices? Can developers use any voice they want?

Amy

Not really. OpenAI provides six voices to choose from, and you can’t use third-party voices for copyright reasons. So, no custom voices for now!

Sam

Got it. And did you hear about the model distillation feature? It sounds like developers can fine-tune smaller AI models now.

Amy

Yeah, that’s another big announcement. Developers can use larger models like GPT-4o to fine-tune smaller models, which saves money but still boosts performance.

Sam

That’s smart! It helps make AI more accessible for smaller projects, right?

Amy

Exactly. And speaking of accessibility, they’re also adding vision fine-tuning, so developers can improve how their apps understand images, not just text.

Sam

Nice! But it’s kind of surprising they didn’t release any new AI models this time.

Amy

Yeah, people were expecting that. But I think they’re still working on those, especially the new models like o1 and their video generation tool, Sora.

Sam

Well, with all these new tools, developers have plenty to play with anyway!

Amy

For sure! The Realtime API alone is going to open up so many possibilities for AI apps.