The features stand to be a significant upgrade to the current experience for ChatGPT free users, who were until now stuck on the text-only GPT-3.5 model, lacking the powerful capabilities of GPT-4 to analyze images and documents uploaded by users.
Now free ChatGPT users will have access to a significantly more intelligent model, web browsing, data analysis & chart creation, access to the GPT Store, and even memory so the app can store information the user wants about them and their preferences simply by typing or asking it audibly.“GPT-4o reasons across voice, text, and vision” Murati said. That includes accepting and analyzing realtime video captured by users on their ChatGPT smartphone apps, though this capability is not yet publicly available. In a blog post, OpenAI wrote: “GPT-4o is much better than any existing model at understanding and discussing the images you share.” OpenAI also noted that while it would eventually be available to free ChatGPT users, GPT-4o would first roll out to paying subscribers.
Video of the app in action:
https://twitter.com/OpenAI/status/1790072174117613963
Does the freemium model scale?
Looks like the freemium model of giving-up your privacy & data is still their preferred way of keeping this "accessible" to most. Is this a model for mass-adoption? Time will tell. It's clear however this is capable of processing way more data for tech giants than even the biggest privacy-pooper would feel comfortable with. I'm personally still betting on private FOSS AI winning-out comfortably.
Absolutely dope.