Updated production-ready Gemini models, reduced 1.5 Pro pricing, increased rate limits, and more

Right this moment, we’re releasing two up to date production-ready Gemini fashions: Gemini-1.5-Professional-002 and Gemini-1.5-Flash-002 together with:

• >50% diminished worth on 1.5 Professional (each enter and output for prompts <128K)
• 2x larger price limits on 1.5 Flash and ~3x larger on 1.5 Professional
• 2x sooner output and 3x decrease latency
• Up to date default filter settings

These new fashions construct on our newest experimental mannequin releases and embrace significant enhancements to the Gemini 1.5 fashions launched at Google I/O in Could. Builders can entry our newest fashions totally free by way of Google AI Studio and the Gemini API. For bigger organizations and Google Cloud clients, the fashions are additionally out there on Vertex AI.

Improved general high quality, with bigger positive factors in math, lengthy context, and imaginative and prescient

The Gemini 1.5 sequence are fashions which can be designed for normal efficiency throughout a variety of textual content, code, and multimodal duties. For instance, Gemini fashions can be utilized to synthesize data from 1000 web page PDFs, reply questions on repos containing greater than 10 thousand strains of code, soak up hour lengthy movies and create helpful content material from them, and extra.

With the newest updates, 1.5 Professional and Flash are actually higher, sooner, and extra cost-efficient to construct with in manufacturing. We see a ~7% enhance in MMLU-Professional, a tougher model of the favored MMLU benchmark. On MATH and HiddenMath (an inner holdout set of competitors math issues) benchmarks, each fashions have made a substantial ~20% enchancment. For imaginative and prescient and code use instances, each fashions additionally carry out higher (starting from ~2-7%) throughout evals measuring visible understanding and Python code era.

We additionally improved the general helpfulness of mannequin responses, whereas persevering with to uphold our content material security insurance policies and requirements. This implies much less punting/fewer refusals and extra useful responses throughout many matters.

Each fashions now have a extra concise type in response to developer suggestions which is meant to make these fashions simpler to make use of and cut back prices. To be used instances like summarization, query answering, and extraction, the default output size of the up to date fashions is ~5-20% shorter than earlier fashions. For chat-based merchandise the place customers may favor longer responses by default, you possibly can learn our prompting strategies guide to be taught extra about how you can make the fashions extra verbose and conversational.

For extra particulars on migrating to the newest variations of Gemini 1.5 Professional and 1.5 Flash, try the Gemini API models page.

Gemini 1.5 Professional

We proceed to be blown away with the inventive and helpful purposes of Gemini 1.5 Professional’s 2 million token long context window and multimodal capabilities. From video understanding to processing 1000 page PDFs, there are such a lot of new use instances nonetheless to be constructed. Right this moment we’re asserting a 64% worth discount on enter tokens, a 52% worth discount on output tokens, and a 64% worth discount on incremental cached tokens for our strongest 1.5 sequence mannequin, Gemini 1.5 Professional, effective October 1st, 2024, on prompts lower than 128K tokens. Coupled with context caching, this continues to drive the price of constructing with Gemini down.

Elevated price limits

To make it even simpler for builders to construct with Gemini, we’re rising the paid tier price limits for 1.5 Flash to 2,000 RPM and rising 1.5 Professional to 1,000 RPM, up from 1,000 and 360, respectively. Within the coming weeks, we count on to proceed to extend the Gemini API rate limits so builders can construct extra with Gemini.

2x sooner output and 3x much less latency

Together with core enhancements to our newest fashions, over the previous few weeks we have now pushed down the latency with 1.5 Flash and considerably elevated the output tokens per second, enabling new use instances with our strongest fashions.

Up to date filter settings

Because the first launch of Gemini in December of 2023, building a safe and dependable mannequin has been a key focus. With the newest variations of Gemini (-002 fashions), we’ve made enhancements to the mannequin’s potential to observe consumer directions whereas balancing security. We are going to proceed to supply a collection of safety filters that builders might apply to Google’s fashions. For the fashions launched in the present day, the filters is not going to be utilized by default in order that builders can decide the configuration finest suited to their use case.

Gemini 1.5 Flash-8B Experimental updates

We’re releasing an additional improved model of the Gemini 1.5 mannequin we introduced in August known as “Gemini-1.5-Flash-8B-Exp-0924.” This improved model consists of vital efficiency will increase throughout each textual content and multimodal use instances. It’s out there now by way of Google AI Studio and the Gemini API.

The overwhelmingly constructive suggestions builders have shared about 1.5 Flash-8B has been unbelievable to see, and we are going to proceed to form our experimental to manufacturing launch pipeline based mostly on developer suggestions.

We’re enthusiastic about these updates and may’t wait to see what you may construct with the brand new Gemini fashions! And for Gemini Advanced customers, you’ll quickly be capable of entry a chat optimized model of Gemini 1.5 Professional-002.