OpenAI launches GPT-4 Turbo with Vision in ChatGPT: What’s new and what can you do?

OpenAI introduces GPT-4 Turbo with Vision in ChatGPT, allowing users to generate responses from images. The enhanced AI model promises more dynamic conversations.

OpenAI introduces GPT-4 Turbo with Vision in ChatGPT, enabling image-based responses for enhanced conversational AI. (AFP)

OpenAI, a leading AI research and deployment company, has revealed the launch of GPT-4 Turbo with Vision in ChatGPT, their widely used AI chatbot. This enhancement is also accessible through the Application Programming Interface (API). With this update, users with paid accounts on ChatGPT can now input images to receive responses. Let's delve into the capabilities of the newly introduced GPT-4 Turbo with Vision.

GPT-4 Turbo with Vision: What's New?

The latest iteration, GPT-4 Turbo, boasts a capacity of up to 128,000 tokens, a significant leap compared to the 8x increase over GPT-3.5 Turbo. Tokens serve as the data chunks fed into the model for processing. This updated model incorporates information up to December of the previous year, ensuring users receive more relevant and current responses.

According to OpenAI's official blog post, "GPT-4 Turbo with Vision empowers the model to interpret images and provide answers related to them." Additionally, it can process media input via a Uniform Resource Locator (URL). Despite being the most advanced technology developed by the company, GPT-4 Turbo does come with certain limitations.

Limitations and Scope

OpenAI clarifies that the model may struggle with correctly analysing medical images such as CT scans, images containing non-English or small texts, graphs, stylised texts, panoramic or fisheye images, and more. Moreover, the system is not intended for handling CAPTCHAs. Users are permitted to upload image files in PNG (.png), JPEG (.jpeg and .jpg), WEBP (.webp), and non-animated GIF (.gif) formats, with a size restriction of 20MB per image.

"We will automatically delete the image after it has been processed by the model," OpenAI assures. In addition to its image processing capabilities, GPT-4 Turbo also offers functionalities like website creation from scratch, coding assistance, and more. Access to GPT-4 Turbo is granted to ChatGPT Plus users, with subscription prices starting from $20 per month (approximately Rs. 1660) in India.