ChatGPT gets DALL-E 3 integration, will now be able to generate better images from text

While you were sleeping, the world of artificial intelligence has turned a new revolutionary leaf as OpenAI unveiled a new version of its DALL-E image generator and integrated it with its chatbot ChatGPT.

The text-to-image tool Dall-E 3 will now use the AI chatbot ChatGPT to help fill in prompts.

As per the company, the latest version of the tool will be available to ChatGPT Plus and Enterprise customers in October via the API. Currently, it is available as a research preview.

It will be made available to all users through OpenAI’s labs website later this year.

OpenAI has been looking to maintain its supremacy in the generative AI space, especially when competition has been rising from tech giants like Google, as well as upstarts such as Midjourney and Stability AI.

The latest move should reaffirm OpenAI’s position in the market, at least for now.

The company has claimed that DALL-E 3 can understand significantly more nuance and details than previously possible. It can now understand complex prompts to create “detailed and accurate” images.

“DALL-E 3 represents a leap forward in our ability to generate images that exactly adhere to the text you provide”, the Sam Altman-led firm said in a blog post.

It will allow users to type in a request for an image and tweak the prompt through conversations with ChatGPT.

The upgrade also improves the generation of text within an image as well as human details such as hands, which have long been a chink in the AI armor.

For the uninitiated, Dall-E and ChatGPT are both generative AI tools developed by OpenAI. While Dall-E is a text-to-image tool, ChatGPT is a chatbot.

So far, Dall-E and ChatGPT have worked separately, but now Dall-E 3 has been built natively on top of ChatGPT, allowing people to use the AI chatbot to create images from prompts ranging from simple sentences to detailed paragraphs.

“One can also ask ChatGPT to make changes to the images with short commands,” the company said.

The latest development has come on the heels of Google speeding up its own artificial intelligence presence through its chatbot Bard with deeper integration into several of its applications such as Gmail, Docs, YouTube, Search, and Maps.

Earlier this year, Google and Adobe announced the integration of Firefly and Express Graphics Suite into Bard, which will enable users to create high-quality images.

Meanwhile, OpenAI has also taken steps to restrict Dall-E 3 from generating violent, hateful, or adult content. For example, the tool will decline requests for creating images of public figures. It is also looking to help people identify if an image was created with AI.

The company is also working to limit the misuse of Dall-E 3 in generating images in the style of living artists to avoid copyright issues.