The interface that popularized generative AI – capable of producing text, images and other content on demand – will soon be able to process requests with images as well as discuss them verbally with its users.
In a statement, OpenAi gives the example of a user who photographs a monument and then “has a chat with ChatGPT” about the history of the building or who shows the software inside their refrigerator so it can suggest a recipe.
Other examples of potential uses, according to the company, include helping kids with school exercises, for example, by sending a picture of a math problem, or asking a “chatbot” to tell kids a story beforehand so they can fall asleep.
These new tools will be developed over the next two weeks for subscribers of ChatGPT Plus, which is the paid version of the chatbot, and organizations that are customers of the service.
The company announced these features in March, when introducing GPT-4, the latest version of its language model, which supports chatGPT.
GPT-4 is multimedia, meaning it can handle information as well as text or computer codes.
The success of ChatGPT since the end of 2022 has sparked a race toward generative AI by technology conglomerates, including Google and Microsoft.
But the rapid development of these programs, which are still very poorly organized, raises many concerns, especially since they tend to “hallucinate”, that is, invent answers.
OpenAI acknowledged in its statement that “visionary models pose new challenges, and hallucinations, because people can rely on the software’s interpretation of images in areas with severe consequences” for the decisions made.
The company confirmed that it had “tested the model” on topics such as extremism and scientific knowledge, but added that it relied on real-world uses and user feedback to improve it.
On the other hand, it limited ChatGPT’s capabilities to “analyze people,” because the interface “is not always accurate and these systems must respect the confidentiality of people.”
“Friendly zombie fanatic. Analyst. Coffee buff. Professional music specialist. Communicator.”