OpenAI has announced a groundbreaking upgrade to its GPT-4 Turbo large language model, expanding its Artificial Intelligence capabilities to include visual input for both ChatGPT and its third-party API users. This marks a significant leap forward as OpenAI integrates generative AI vision features into the language model, enabling it to understand and respond to videos and images for the first time.
The enhanced GPT-4 Turbo is now available through OpenAI’s Application Programming Interface (API) and to subscribers of ChatGPT Plus. In a tweet announcing the launch, OpenAI stated, “GPT-4 Turbo with Vision is now generally available in the API. Vision requests can now also use JSON mode and function calling.”
This new version of GPT-4 Turbo brings a host of improvements, including the ability to generate fully functional websites by producing genuine code and interpreting image content and context to generate meaningful output. The addition of vision features also streamlines developers’ work, allowing them to build applications that can handle both text and images with one API call.
The upgraded model not only simplifies developer workflows but also enables the creation of more efficient and versatile applications that combine text, audio, and now video. OpenAI’s previous models focused on text, images, and audio analysis, but the GPT-4 Turbo’s new video analysis capabilities anticipate a future where ChatGPT users can upload video clips for the AI to summarize or highlight key moments, broadening the application’s appeal.
According to OpenAI’s recent blog post, GPT-4 Turbo is the company’s latest generation model and boasts an updated knowledge cutoff of December 2023. It also introduces a 128k context window, which is the equivalent of 300 pages of text in a single prompt.
Anyone with an OpenAI API account and existing GPT-4 access can utilize this model by passing “gpt-4-turbo” as the model name in the API.
Notably, ChatGOT took the AI market by storm when it was first released to the masses. Since its launch, OpenAI has made many upgrades to its code, enhancing its capabilities multifold. The new release marks a major milestone in ChatGPT’s evolution, making it even more powerful than before for both personal and professional use cases.
If you have been using ChatGPT, then don’t forget to use the GPT-4 Turbo.