In OpenAI’s inaugural mainstream live event, CTO Mira Murati declared a focus on enhancing the accessibility of their advanced artificial intelligence (AI) tools for users worldwide. This initiative includes updates such as a revamped desktop application and the introduction of a new free tier featuring capabilities previously exclusive to the paid version of ChatGPT.
Murati emphasized their mission to democratize access to their advanced AI tools, stating, “An essential aspect of our mission is ensuring that our cutting-edge AI tools are accessible to everyone, free of charge.” To achieve this goal, OpenAI is launching a new model, GPT-4o, which provides GPT-4-level intelligence to users on the free tier of ChatGPT. Additionally, the requirement for users to sign up for ChatGPT will be eliminated.
Although speculations about a voice assistant abounded, the live demonstration showcased a Mac desktop application featuring the existing mobile Voice mode. This suggests a more interactive user experience, although it does not signify a complete takeover by a virtual assistant.
The GPT-4o update and the desktop app are expected to be rolled out gradually over the next few weeks.
Murati hinted at a significant shift in human-computer interaction with the introduction of GPT-4o, stating, “There are many aspects of communication that we often overlook.” This underscores the importance of natural interaction in their developments.
GPT-4o breaks down barriers by understanding voice, text, and visual information, enabling users to access GPT-4 level intelligence on the free tier. Murati highlighted months of development efforts to achieve this milestone.
With over 100 million regular users of ChatGPT, Murati revealed that GPT-4o is significantly more efficient than previous versions, resulting in more powerful GPTs available for free. Users can also anticipate data, code, and vision tools, enabling image analysis without any usage limitations.
The generous upgrade to the free tier with GPT-4o has led some to question the value of the $20 monthly fee for ChatGPT Plus.
Murati reassured users that there are still benefits to the paid plan. Plus subscribers will enjoy a significant advantage: five times more daily requests to the powerful GPT-4o compared to the free version. This translates to significantly more interaction and potentially faster results for those opting for the paid subscription.
Live chat gets real: GPT-4o brings live speech to OpenAI
OpenAI’s latest update, GPT-4o, takes a large bound towards natural conversation with live speech skills. Unlike previous models that relied on text record, GPT-4o can directly understand and respond to spoken audio. This opens moving options for real-time interaction.
Imagine a conversation where you don’t have to wait for gaps or complete sentences. The sample showcased this fluidity, with an OpenAI staffer even attempting some (perhaps not-so-relaxing) deep breaths into the microphone. GPT-4o, ever the supportive companion, not only picked up on the heavy breathing but even offered guidance on refining breathing techniques! It even added a touch of humour, warning the staffer, “you’re not a vacuum cleaner.”
This ability to realize and respond to emotions in real-time communication further blurs the lines between human and machine interaction. Interrupting GPT-4o mid-sentence won’t be a problem either, making conversations feel more natural and engaging.
See, chat, code: GPT-4o’s powerhouse update
Moreover, OpenAI’s latest update, GPT-4o, isn’t just about conversation anymore. It boasts impressive new vision capabilities, essentially granting it the power to “see” through your phone’s camera.
Imagine getting stuck on a math problem. In the demo, the team threw GPT-4o a curveball: a handwritten equation. While it didn’t provide a straight answer, it surprised everyone by offering step-by-step guidance, acting more like a patient tutor than a simple calculator. Even more impressive, the AI could detect changes made to the equation in real-time, adjusting its advice accordingly.
But GPT-4o isn’t just a math whiz. It can also be a charmer! Another demo showcased the AI’s ability to process written text. When shown a note reading “I heart ChatGPT,” the AI’s voice took on a more emotional tone, playfully acknowledging the affection. There was a lighter moment too, where the camera lingered on the presenter’s outfit, prompting GPT-4o to offer a compliment — a glimpse into its ability to understand and respond to visual cues in real-time conversations.
The applications extend beyond handwritten notes and heartfelt messages. Running on a Mac, GPT-4o seamlessly transitioned to analysing code. With an almost human-like voice, it could not only view the code being written but also identify potential problems.
The vision capabilities aren’t limited to phone cameras either. The desktop app demo revealed GPT-4o’s ability to see directly on the user’s screen. It effortlessly analysed a displayed graph, providing valuable insights and feedback — a powerful tool for data visualization and analysis.
OpenAI’s vision for GPT-4o paints a picture of a future where AI seamlessly integrates with our visual world, offering real-time assistance and understanding in a more natural way.
Good news for travelers
Imagine unified chats across languages. The demo emphasized ChatGPT Voice’s ability to decode spoken Italian from Mira Murati to English in real-time, and vice versa. This could be a game-changer for travelers and international communication.
Additionally, the live demo showcased facial gratitude through the camera, with the AI detecting a smile and prompting, “Want to share the reason for your good vibes?” This emotional intelligence adds a new layer of thoughtful to human-AI interaction.
These advancements, along with the inspiring voice associate capabilities, echo CEO Sam Altman’s description of GPT-4o as “magical.” It has the potential to revolutionize the way we interact with AI, potentially moving away from text-based interfaces. The update is expected to roll out in the coming weeks, so get ready for a whole new way to connect with AI.
