OpenAI launches GPT-4 Turbo with Vision in ChatGPT: What’s new and what can you do?

OpenAI, a leading AI research and deployment company, has revealed the launch of GPT-4 Turbo with Vision in ChatGPT, their widely used AI chatbot. This enhancement is also accessible through the Application Programming Interface (API). With this update, users with paid accounts on ChatGPT can now input images to receive responses. Let's delve into the capabilities of the newly introduced GPT-4 Turbo with Vision.

GPT-4 Turbo with Vision: What's New?

The latest iteration, GPT-4 Turbo, boasts a capacity of up to 128,000 tokens, a significant leap compared to the 8x increase over GPT-3.5 Turbo. Tokens serve as the data chunks fed into the model for processing. This updated model incorporates information up to December of the previous year, ensuring users receive more relevant and current responses.

Also read: WhatsApp rolls out Meta AI chatbot for some users in India: What is it and how to use it

According to OpenAI's official blog post, "GPT-4 Turbo with Vision empowers the model to interpret images and provide answers related to them." Additionally, it can process media input via a Uniform Resource Locator (URL). Despite being the most advanced technology developed by the company, GPT-4 Turbo does come with certain limitations.

Also read: Alphabet to set a new record as investors happy with Google's AI progress

Limitations and Scope

OpenAI clarifies that the model may struggle with correctly analysing medical images such as CT scans, images containing non-English or small texts, graphs, stylised texts, panoramic or fisheye images, and more. Moreover, the system is not intended for handling CAPTCHAs. Users are permitted to upload image files in PNG (.png), JPEG (.jpeg and .jpg), WEBP (.webp), and non-animated GIF (.gif) formats, with a size restriction of 20MB per image.

Also read: Google adds two new AI models to its Gemma family of LLMs - Why this is important

"We will automatically delete the image after it has been processed by the model," OpenAI assures. In addition to its image processing capabilities, GPT-4 Turbo also offers functionalities like website creation from scratch, coding assistance, and more. Access to GPT-4 Turbo is granted to ChatGPT Plus users, with subscription prices starting from $20 per month (approximately Rs. 1660) in India.