Gemini Updates & Release Notes

Lyria 3.5, our best-sounding music generation model, is now available in the Gemini app and the Gemini API. Lyria 3.5 brings more expressive vocals and richer musical arrangements, allowing you to craft tracks with higher fidelity.

In the Gemini app, you can now:

• Easily select or describe your genre and choose between vocal or instrumental styles
• Use our new templates to jumpstart your creativity for anything from background music to custom birthday tracks
• Plus, you’ll now have the flexibility to choose short or longer tracks

Whether you need a custom backing track for a video, a unique brand jingle, or just a personalized ringtone, it’s easier than ever to bring your idea to life.

Lyria 3.5 is available to all users globally on the web and in the mobile app. It’s also available for artists and AI creatives in Google Flow Music, and for developers and technologists through Google AI Studio, and Google Vids.

Our flagship AI weather forecasting model now includes real-time satellite data, hourly refreshes, higher resolution, precise precipitation forecasting, and clean energy variables. It’s now integrated across Search, Gemini, Maps, Google Maps Platform, and Cloud.

The WeatherNext team

Rapid weather prediction at unprecedented resolution

Every day, the weather influences billions of decisions. Some are as simple as grabbing an umbrella before heading out the door, but others are far more consequential. Wind, rain, and extreme weather events, like heatwaves and droughts, have cascading impacts across agriculture, global supply chains, clean energy production, and national economies.

In recent years, AI has revolutionized weather forecasting, using historical records to make faster and more accurate predictions than traditional methods. Yet predicting highly local and rapidly changing weather has remained a challenge. Previous models often lacked sufficient spatial resolution, and struggled to incorporate real-time weather data from sources like satellites.

Today, Google DeepMind and Google Research are introducing WeatherNext 3, the most advanced and accurate global weather model to date, according to independent live evaluations by Brightband. Our model learns directly from real-time observations, enabling it to provide timely and more localized predictions for the weather events that impact people the most. By using raw satellite data to produce a forecast every hour in high resolution, our model makes reliable forecasts accessible across Google products worldwide.

A forecast's utility often comes down to detail and how finely it resolves both time and space. WeatherNext 3 generates hourly forecasts at multiple spatial resolutions, maintaining physical consistency from broad global wind patterns all the way down to local topography.

With WeatherNext 3, we can visualize key surface variables — like temperature and moisture — at a 5-kilometer resolution, other surface variables at 10 kilometers, and atmospheric variables, like wind speed, at 25 kilometers. Overall, this provides a global weather picture roughly five times sharper than our previous model, WeatherNext 2, which produced forecasts on a 25-kilometer grid in 6-hour increments.

Real-world data at continuous global scale

WeatherNext 3's biggest leap forward is what it learns from. Most AI weather models, including WeatherNext 2, are trained on data from numerical weather prediction (NWP) models. Although useful, NWP models are complex, supercomputer-driven physics simulations that carry a six-hour data lag. This lag can lead to biases for fast-changing variables like rain or surface temperature.

By ingesting a mosaic of live, global geostationary satellite data, our new model gains a rich, continuously updating view of the atmosphere. This allows the model to generate a new forecast every hour, each one grounded in the most recent satellite observations available, at up to 5-kilometer resolution.

This is important because critical weather develops fast. When storms, fronts, or precipitation systems materialize suddenly, our rapid update cycle and higher resolution provides earlier, more detailed insights needed to help drive an effective response.

Some variables, like temperature and humidity, can fluctuate dramatically over just a few kilometers, which is particularly relevant for communities near coastlines, valleys, or mountain ranges. Traditional models struggle here because they train on representations of the atmosphere that lack detail and miss extreme local variations.

To address this, WeatherNext 3 instead trains directly on sparse weather station observation data. This allows us to make global forecasts on a 5-kilometer grid that account for regional details like topography.

This breakthrough is particularly vital for regions across Latin America, Africa, and Asia-Pacific that have historically been underserved by high-resolution forecasting due to the immense supercomputing costs of traditional regional models. It brings localized, high-fidelity forecasting to billions of people and local businesses in these areas.

Beyond improved resolution and forecast frequency, our model introduces predictions specifically engineered for renewable energy production. The model forecasts 100-meter wind speeds (roughly at turbine-height) for precise wind-energy output, alongside high-resolution cloud cover and sun radiation levels to help solar farms estimate how much light they will receive on the ground.

This data is crucial for global clean energy planning, allowing grid operators and renewables developers to accurately predict how much power their clean energy assets will generate and match it with consumer demand.

Precipitation forecasting at breakthrough accuracy

Global weather models notoriously struggle to accurately predict precipitation. Rain and snow systems are driven by fast-moving cloud processes on tiny scales that are hard to model accurately using traditional physics-based simulations. Consequently, AI forecasts often produce blurry estimates or miss the boundaries of severe storms entirely.

To solve this, we train our model on two exceptionally high-quality sources of precipitation data: NASA’s satellite-based Integrated Multi-satellite Retrievals for GPM (IMERG) and our own global precipitation reanalysis based on satellite radar.

The result is a significant leap in precipitation forecasting accuracy. In medium-range global forecasts, evaluations against baselines show a Continuous Ranked Probability Score (CRPS) improvement of up to 60% against IMERG, 30% for MRMS, and 10% against rain gauge measurements for early lead times.

Research applied across the ecosystem

Our primary goal is to advance weather intelligence to make it universally useful — whether for an emergency responder tracking sudden wind shifts, an air traffic controller planning flight paths, or a farmer managing crops.

To bring these breakthroughs out of the lab and into the real world, we’re integrating WeatherNext 3 across Google’s core ecosystem and beyond:

• High-resolution forecast data: We’re making global weather predictions, updated hourly and ready to integrate into your workflows with no model setup required. This enables researchers, developers and businesses to query the data in BigQuery and Earth Engine, or bulk-download from Google Cloud Storage.
• Available globally: WeatherNext 3 will begin powering weather experiences within Google Search, Gemini app, Google Maps, Google Maps Platform Weather API, and Google Earth Engine starting today. The update dramatically improves longer term forecasts. When planning a day or more ahead, people will see up to 50% more accurate precipitation forecasts — with the greatest improvements in regions where forecasts have historically been less reliable. So if you’re packing for a weekend trip or deciding the best day for an outdoor activity, you’ll now get more accurate predictions to help you plan.

The atmosphere will always retain a degree of unpredictability. However, by training on real-world observations and bypassing traditional modeling constraints, WeatherNext 3 brings us closer to a future where forecasts truly match what is happening on the ground.

To learn more about geospatial platforms and AI work at Google, check out Google Earth Engine, AlphaEarth Foundations, and Earth AI.

Disclaimer: For official weather forecasts, severe weather warnings, and public safety advisories, please refer to your local meteorological agency or national weather service.

Learn more about WeatherNext 3

• Read our paper
• Build with WeatherNext 3
• Explore Weather Lab to see WeatherNext 3 visualized in real-time
• See where WeatherNext 3 ranks on independent live leaderboards from Brightband.

Earlier this year, we introduced the ability for Workspace users to set persistent custom instructions for Gemini in Google Docs. We're now expanding support for these custom instructions to additional Gemini in Workspace surfaces, specifically:

• Ask Gemini in Drive
• Ask Gemini in Chat
• Gemini side panel in Slides, Sheets, and Gmail

These instructions help personalize your interactions with Gemini and ensure that Gemini adapts to your style, tone, and formatting preferences without needing to repeat them in every conversation, ultimately saving you time and ensuring consistency.

With this update, users can build a set of custom instructions that Gemini respects across these Gemini surfaces. The update ensures that users have a consistent personalization experience across the platform based on their individual needs or preferences.

You can declare preferences in any Gemini in Workspace Surface

All saved instruction can be viewed and managed in the Personalization Setting tab

These instructions are then used to personalize Gemini’s responses across Workspace

Getting started

• Admins: There is no admin control for this feature.
• End users: Get started by opening the side panel, Ask Gemini in Drive, or Ask Gemini in Chat. You can then prompt Gemini to store a specific instruction. You can also access the ‘Your Instructions for Gemini In Workspace” Menu by selecting the hamburger menu > Settings > Personalization. Visit the Help Center to learn more about customizing Gemini in Workspace's responses with your instructions.

Rollout pace

• Rapid Release and Scheduled Release domains: Gradual rollout (up to 15 days for feature visibility) starting on September 2, 2026

Availability

• Available to all Google Workspace customers with access to Ask Gemini in Drive, Ask Gemini in Chat, and/or the Gemini side panel in Gmail, Sheets, and Slides. See more details on feature availability here.

Resources

• Google Help: Customize Gemini in Workspace's responses with your instructions

Today, we’re launching our Fairwind Program, a limited access program for governments and trusted partners to use our most advanced cyber defense capabilities.

Defenders wanting to use advanced AI have faced a difficult dilemma: adopt enormous frontier models that could be expensive to deploy and difficult to control across enterprise codebases, or turn to smaller open-weight models that might struggle with complex vulnerability remediation and require teams to build their own tooling and infrastructure from scratch. Until now.

Today, we’re launching our Fairwind Program to bring the best of Google’s AI and cyber defense capabilities to a trusted group of Google Cloud customers, government agencies, and cybersecurity partners, to help them proactively solve cyber risks at scale. As a first step, the Fairwind Program will give defenders access to powerful and advanced Gemini models to help them autonomously find and fix vulnerabilities, protecting critical infrastructure, public services, and national security.

Finding and autonomously fixing vulnerabilities

The Fairwind Program offerings bring together our most advanced cyber model, Gemini 3.8 Flash Cyber, with our CodeMender harness, to help defenders find, verify, and fix vulnerabilities at agentic scale. Spotting weaknesses creates awareness and fear; autonomously finding and fixing vulnerabilities delivers security.

CodeMender with Gemini 3.8 Flash Cyber delivers the specialized reasoning to write and validate code fixes, at a fraction of the operating cost of traditional frontier models. Instead of taking weeks to manually fix vulnerabilities, defenders can now generate verified, deployment-ready patches in minutes — within an organization’s secure cloud environment.

Scaling frontline defense

Providing early access to these powerful cyber capabilities gives trusted defenders a vital adaptation window to harden their systems before bad actors have a chance to exploit new capabilities. We’re staging initial access to government and enterprise partners most critical to society’s resilience:

• Governments and national cyber authorities: Hardening public-sector networks and citizen services against targeted intrusions.
• Critical infrastructure operators: Protecting essential services across healthcare, telecommunications, energy, and financial networks from operational disruption.
• Core technology platforms: Securing widespread software foundations to uplift digital security for millions of downstream users at once.

To ensure these powerful AI capabilities are used responsibly, participating organizations agree to strict operational standards, including limiting access to employees within their internal cybersecurity, incident response, or penetration testing teams and deploying protections like multi-factor authentication.

We have more than 650 participating partners globally, including:

What our Fairwind Program partners are saying

Trusted defenders and industry leaders are already putting Gemini 3.8 Flash Cyber into practice:

The Fairwind Program will evolve alongside our partners and users' needs. We will adapt our product offerings and expand partner access, collaborating closely with industry, governments, and open-weight community leaders to strike the right balance between open access and robust security.

While we are prioritizing Gemini 3.8 Flash Cyber access for customers in the Fairwind Program, any Google Cloud customer can proactively secure their code by using CodeMender with publicly available models hosted on Gemini Enterprise Agent Platform, in combination with industry-leading solutions offered through AI Threat Defense.

Making an ecosystem-scale impact on cyber defense

Years of Google’s pioneering zero-trust architecture, advanced AI defenses, and built-in security allow us to protect billions of accounts daily – keeping more people and organizations safe online than anyone else. The Fairwind Program builds on this experience and is part of our broader commitment to global cyber resilience across the entire digital ecosystem, including helping to fortify grassroots cyber defense.

Through Google.org, our latest commitment brings our total cybersecurity funding to more than $100 million globally. We’re pleased to release our 2026 Google.org US Cybersecurity Impact Report, which details $36 million in funding for 35 cyber clinics to date, providing free, hands-on security support to over 1,250 hospitals, public school districts, and municipal utilities in the U.S.

Providing a security advantage

The defender’s edge comes from shrinking the time between detecting a flaw and patching it. Through Google’s Fairwind Program, government and enterprise partners gain autonomous tools to repair systems faster and at scale, keeping them one step ahead of agentic-speed threats.

Our newest Gemini models deliver next-generation intelligence for agentic workflows and cybersecurity.

Building on the momentum of 3.7 Flash from three weeks ago and marking our third Flash release in only six weeks, today we’re introducing Gemini 3.8, our best reasoning & coding model yet, at the same speed and low cost of 3.7. Gemini 3.8 introduces 2 variants:

• Gemini 3.8 Flash: our most intelligent workhorse model, delivering significant improvements from 3.7 Flash across software engineering, agentic tasks, and critical, multi-step reasoning in specialized domains. It is available at the same introductory price1 as 3.7 Flash at $0.75 per million input tokens and $3.75 per million output tokens.
• Gemini 3.8 Flash Cyber: our most capable cybersecurity model with frontier-level performance in vulnerability detection and automated patching, available to trusted defenders through our new Fairwind Program.

While tailored for different deployment environments, both of today's releases are powered by the same foundational intelligence, and further accelerated by long-running agentic loops designed to recursively evaluate and refine the underlying models. The significant coding and reasoning gains across this shared core were driven by a number of innovations, including rigorous training in the highly demanding domain of cybersecurity.

Gemini 3.8 Flash: built for long-horizon coding and autonomous agents

Gemini 3.8 Flash delivers substantial gains from 3.7 Flash, often approaching the performance of higher-cost frontier models.

On DeepSWE v1.1 (Long-Horizon Software Engineering) 3.8 Flash outperforms most larger frontier models in autonomously solving complex engineering problems end to end, only at a fraction of the cost.

Additionally, 3.8 Flash exhibits the dependability required for critical enterprise autonomy, across specialized knowledge domains.

In quantitative and professional fields that require advanced analysis and reporting, 3.8 Flash outperforms 3.7 Flash and other frontier models in benchmarks like Vals Finance Agent V2 and Harvey's Legal Agent Benchmark. 3.8 Flash also achieves a 54.9% on HLE-Verified, demonstrating its ability to handle multi-step reasoning across STEM, humanities, and professional fields.

These performance gains stem from a core design choice: 3.8 Flash works harder. On complex tasks, it exhibits greater diligence — executing extra reasoning steps, and calling tools iteratively. At times, the model might use more tokens to maximize performance, especially at higher effort levels.

For applications where compute efficiency is the primary constraint, developers can utilize lower effort levels to minimize token overhead or continue to rely on Gemini 3.7 Flash, which remains fully supported for efficiency-first workloads.

Gemini 3.8 Flash Cyber: expert cyber performance

Gemini 3.8 Flash Cyber, available to a set of trusted defenders via the Fairwind Program, provides a decisive advantage in today’s complex cybersecurity landscape, with the Flash speed and cost that enables quick iteration.

Autonomous vulnerability discovery

On the standard industry benchmark for finding vulnerabilities, CyberGym, Gemini 3.8 Flash Cyber demonstrates frontier-level performance in autonomous vulnerability discovery. It surpasses both 3.5 Flash Cyber as well as significantly larger frontier models.

To better capture real-world defensive needs which are not limited to just C/C++ codebases like in CyberGym, we also evaluated Gemini 3.8 Flash Cyber against a comprehensive internal benchmark in which the model has to discover a wide range of vulnerabilities across complex codebases spanning 20 programming languages. Here, the model showcases an impressive leap over our previous models and reaches a success rate exceeding 70%.

Automated patching

With Gemini 3.8 Flash Cyber, we focused specifically on equipping defenders with expert capabilities that give them an advantage over attackers. This is why we have invested in vulnerability fixing from the start, and prioritized it over offensive capabilities like exploitation.

CWE-Bench, run by Collinear, is a challenging external benchmark for patching capabilities. On this benchmark, Gemini 3.8 Flash Cyber is on the Pareto frontier: with a pass@1 of 47.2% compared to a leading frontier model at 47.8%, yet offered at a significantly lower cost.

Real-world impact: securing Google’s code

We’re already using Gemini 3.8 Flash Cyber to secure code across Google. For example:

• The Chrome Security team found that 3.8 Flash Cyber produced 2.6 times more correct patches to vulnerabilities in Chrome than the best commercial models that are much larger.
• Wiz found that Gemini 3.8 Flash Cyber achieves +7.5-9.7% higher recall on their internal penetration testing benchmark for a 2.3-5.2x lower cost compared to other leading frontier models.
• Google’s Cloud Vulnerability Research team leveraged the 3.8 Flash Cyber model to find a critical foundational vulnerability in less than 2 hours, a vulnerability for which research and discovery usually takes months.

What our Fairwind Program partners are saying

[Quotes from partners shown as images]

Built with safety in mind

3.8 Flash ships with safeguards against misuse in the domains of Chemical, Biological, Radiological, and Nuclear (CBRN) and cyber offense, while enabling beneficial use cases, as per our Frontier Safety Framework. 3.8 Flash Cyber ships with a more permissive set of mitigations for cybersecurity, and as such, is only available to trusted defenders who require a more comprehensive set of cyber capabilities.

Gemini 3.8 models have also made a significant leap in prompt injection robustness as measured by Gray Swan, protecting Gemini model users from prompt-injection related malicious attacks.

Gemini 3.8 Flash and Cyber: get started today

• Developers: Build with 3.8 Flash and explore agent-first workflows in Google Antigravity or start building today in the Gemini API via Google AI Studio and Android Studio, or generate UIs in Stitch. Get started with our developer docs.
• Enterprises: Access 3.8 Flash in Gemini Enterprise.
• Consumers: 3.8 Flash is available to Google AI Pro and Ultra subscribers across the Gemini app, AI Mode in Google Search and Gemini in Google Sheets.
• Cyber: Through our new Fairwind Program, we’re providing trusted government authorities, as well as critical infrastructure operators and software maintainers with prioritized access to Gemini 3.8 Flash Cyber. Apply for access.

Here’s a recap of some of our biggest AI updates from August, including the launch of Gemini 3.7 Flash, Gemini 3.5 Transcribe, and the all-new Pixel 11 series of devices.

For more than 20 years, we’ve invested in machine learning and AI research, tools, and infrastructure to build products that make everyday life better for more people. Teams across Google are working on ways to unlock AI’s benefits in fields as wide-ranging as healthcare, crisis response, and education. To keep you posted on our progress, we're doing a regular roundup of Google's most recent AI news.

Here’s a look back at some of our AI announcements from August.

In August, we continued advancing AI responsibly — making it faster, more accessible, and truly practical for everyone, from software developers and students to creatives and scientists. We’re bringing intelligence directly to where people work and live, with powerful new hardware designed for Gemini in the Pixel 11 series, cost-efficient developer models like Gemini 3.7 Flash, the rollout of Gemini in Chrome on Android, and hands-free voice tools across Google Workspace and Gemini Live. As the Gemini app officially crossed 1 billion monthly users, we also expanded our creative and scientific footprint, introducing studio-quality video and music generation alongside open-source AI models that predict weather patterns and tackle climate challenges. Overall, August marked a shift toward AI that isn't just powerful in theory, but useful in everyday reality.

Build better agents at a lower cost with Gemini 3.7 Flash.

We released Gemini 3.7 Flash as our most intelligent workhorse model yet for coding and agents. It arrived just three weeks after our launch of 3.6 Flash, delivering substantial improvements across software engineering, knowledge work, and web development workflows — with an introductory price of half the original 3.6 Flash cost per million tokens.

Try the new Pixel 11 series, designed for Gemini Intelligence.

At Made by Google 2026, we unveiled Pixel 11, Pixel 11 Pro, Pixel 11 Pro XL, and Pixel 11 Pro Fold. These devices come with major camera upgrades, enhanced durability, and our fastest, most powerful chip, Google Tensor G6, that runs the latest Gemini Nano model. They’re also designed for Gemini Intelligence to deliver time-saving, personal help. See all the announcements from Made by Google 2026.

Start the semester with one year of Gemini, on us.

We’re offering one year of a Google AI plan free of charge for eligible college students around the world — plus new and enhanced study tools — so students can make the most of this school year. We’ve also got tools to help teachers and students as they head back to school, including a dedicated student hub, new teacher-led tools, and SAT prep in Gemini.

Level up your learning with Search.

To help you start the semester with confidence, we've added new AI-powered learning features in Search — all built to be safe by design. With these updates, Search can help you grasp complex concepts through interactive visuals, generate practice quizzes for exams like the SAT, ACT, GRE, and LSAT, learn step-by-step with Lens, and stay organized with notebooks.

Get more intelligent transcription with Gemini 3.5 Transcribe.

Our latest speech-to-text model delivers precise, intelligent real-time transcription for developer workflows like voice agents, live captioning, and post-call analytics. Unlike conventional models that struggle with noise and jargon, Gemini 3.5 Transcribe converts raw audio directly into accurate, polished, context-aware understanding.

Get more done with new productivity features in Gemini Live.

Gemini Live is moving beyond conversation to handle complex tasks on your behalf. With new features like Personal Intelligence, Daily Brief, Spark, and hands-free inbox management, you can easily talk through your day and delegate your to-dos without missing a beat.

See how more than 1 billion people are using the Gemini app every month.

The Gemini app officially surpassed 1 billion monthly users, making it the fastest-growing product in Google’s history. To mark the milestone, we shared some usage insights, such as: 63% percent of users now talk directly to Gemini, including more “voice only” users — with busy parents 43% more likely to use it for everyday tasks. Gemini now generates 150 million+ images every day, and small businesses are power users, relying on Gemini's all-in-one image, video, and audio creation to craft marketing materials.

Generate videos with more control using Gemini Omni 1.1 Flash.

We introduced Gemini Omni 1.1 Flash to bring people even more precision and control for generating videos. The new capabilities deliver studio-quality video production — including scene extension, first-and-last-frame interpolation, crisp 4K upscaling, and faster prototyping. Omni 1.1 Flash is now available in Google Flow, Google AI Studio, the Gemini Enterprise Agent Platform, and the Gemini app.

Explore how Gemma is offline everywhere from outer space to underwater.

We released Gemma to help developers build responsible, innovative AI applications anywhere. Over one billion downloads later, Gemma supports environments from phones and edge infrastructure to space. You can explore some of the ways people are using it — from researching interspecies communication to driving medical breakthroughs — and share, discover, and collaborate in our new community repository.

Learn about Operation Blue Skies, a project to reduce aviation climate impact with AI.

Our AI-powered forecasts already help flight crews and air traffic controllers adjust routes to avoid forming contrails — all within normal flight operations. Now, we’re partnering with the UK Government and aviation leaders to expand this technology across the North Atlantic, helping airlines reduce aviation’s climate impact on a global scale.

See how WeatherNext 2 demonstrated a massive leap forward in predicting cyclones.

In a Nature paper, our researchers showed that WeatherNext 2 predicts cyclone track, intensity, and wind structure with state-of-the-art accuracy — delivering a decade of meteorological progress in one model. Now, we’re open-sourcing WeatherNext 2 to the research community to help build global climate resilience.

Our new agentic feature for video analysis cuts token consumption by up to 88%, reduces costs by up to 66%, and boosts quality by up to 7%.

Today, we’re launching agentic video understanding across our latest models: Gemini 3.7 Flash, 3.6 Flash and 3.5 Flash-Lite. This new capability improves accuracy while dramatically reducing token usage and costs for video analysis. Similar to agentic vision, which combines code execution with Gemini models’ native image understanding, agentic video understanding uses Gemini’s native video tools to improve performance and unlock new capabilities for video processing like sub-second moment retrieval, more accurate anomaly detection, precise counting and more.

The feature is available today for video uploads and YouTube videos via the Gemini API in Google AI Studio and the Gemini Enterprise Agent Platform.

Benchmarks

Unlike current ‘static’ processing, where the model ingests the video at a fixed frames-per-second rate (default 1 FPS, adjustable via API), agentic video understanding pairs the model’s core reasoning with native video tools to dynamically search, scan, and inspect target video segments across visual frames, audio, and transcripts. Across standard video analysis benchmarks, Gemini models with agentic video understanding reduce analysis costs by up to 66% and token consumption by up to 88%, while improving accuracy by up to 7%.

These efficiency gains are especially pronounced on long-form video (from 10-minute how-to guides to 90-minute lectures and multi-hour recordings), where static processing forces developers to choose between high token costs or techniques that drop critical details.

Activating agentic video understanding drops token consumption by up to 88% and boosts accuracy by up to 7% with Gemini 3.7 Flash.

While these gains span all three supported models, Gemini 3.7 Flash with agentic understanding offers the best possible quality overall and the best combination of quality and cost efficiency, putting it at the accuracy-to-cost pareto frontier among tested models for video understanding.

Using agentic video understanding places Gemini 3.7 Flash at the accuracy-to-cost pareto frontier for video analysis.

How it works

Instead of static processing where the model ingests media streams at a fixed frame rate, agentic video understanding enables Gemini to take an active, goal-directed role in determining what to watch, at what speed, and through which modality (frames, audio, or transcript), fetching only the moments and signals needed. While developers could previously do this manually, with agentic video understanding, Gemini can accomplish it through an agentic loop, invoking an internal tool to load the relevant part of the video file, significantly reducing development overheads.

Capabilities and use cases

Agentic video understanding transforms how developers can process long-form video content across a variety of demanding applications.

• Sub-second moment retrieval: Pinpoint split-second state changes and tight cut boundaries that are easily missed at 1 FPS, making precise automated video editing possible.
• Long-form needle-in-a-haystack search: Answer complex queries across multi-hour videos without consuming millions of tokens.
• Anomaly detection: Resample interesting time windows at higher FPS to inspect rapid motion and subtle visual artifacts.
• Counting action & object: Accurately track repeated physical movements and distinct objects over time.

Real-world results

Many of our early access partners saw strong performance while testing with agentic video understanding. Here’s what they have to say:

Getting started

Agentic video understanding is available via the Gemini API in Google AI Studio and Gemini Enterprise Agent Platform, launching across Gemini 3.7 Flash, 3.6 Flash, and 3.5 Flash-Lite. It uses standard Gemini API token pricing with no additional feature fee.

To enable it, simply set processing to "agentic" in the API configuration. Read our developer guide to get more insights into the feature and how to get started.

We are also bringing the efficiency and quality improvements of agentic video understanding to billions of users across Google products. The feature will roll out to all users in the Gemini app across Flash and Flash-Lite models soon. And in the coming months, agentic video understanding will also power YouTube's ‘Ask YouTube’ feature on the video watch page, leveraging Gemini to deliver higher-quality answers grounded in the visuals.

Acknowledgement for their contribution to this work:
Sergi Caelles, Filip Pavetić, Ahmet Iscen, Suhas Yogin, and the Agentic Vision team.

Building trust in proprietary model benchmarks using cryptographically secure environments

Imagine a student is set to take a high-stakes exam. If they accidentally peek at the test questions in advance, achieving a perfect score is influenced by this knowledge, making it a meaningless accomplishment. To truly measure what they know, they must have no visibility of the test questions until it's time to take the exam. That is the exact challenge the industry faces when evaluating advanced AI models. If a model has already seen the test questions - a problem known as benchmark contamination - the results can only be trusted to an extent.

Today, we’re introducing the world’s first double-blind evaluation of a proprietary, frontier class AI model, which keeps external evaluations confined to a cryptographic “box” where they can’t be used by models later to optimize performance ahead of testing. We're partnering with the Singapore AI Safety Institute, OpenMined, AVERI, and MLCommons, to test a Gemini Flash Lite model against confidential benchmarks in a privacy-preserving environment, increasing evaluation integrity.

At Google, we assess our AI systems using a broad spectrum of evaluations throughout model development and deployment, but we don’t rely on internal testing alone. To identify potential blindspots, we work with a diverse group of external partners, including specialized research labs, civil society and national AI Safety and Security Institutes (AISIs), using their unique expertise to stress-test our models.

As AI models become more capable, ensuring the model has not seen the test questions or prompts in advance is critical, as this can skew the results. Policymakers, researchers, and enterprises need to trust that AI benchmarks accurately reflect a model's true capabilities and safety, but if models are able to “peek” at the evaluation questions in advance, it can artificially inflate scores and undermine this trust.

Although zero-logging protocols and rigorous contractual safeguards have long kept external test prompts confidential, incorporating technical and cryptographic safeguards marks a major step forward in secure model evaluation.

How double-blind evaluations work

Historically, high-stakes external evaluations required a tradeoff. Either evaluators handed over their testing prompts (risking the model provider seeing the test questions in advance), or the model provider handed over their model weights (risking their intellectual property).

Double-blind evaluations eliminate this compromise. By using Confidential Space within Google Cloud’s Confidential Computing portfolio, we can cryptographically verify that both the external evaluation data and the proprietary model remain private to their respective owners. The evaluator cannot see the Gemini model weights, and Google cannot see the evaluator’s test prompts.

A novel approach to building trust in model evaluations

This cryptographic evidence helps prevent benchmark contamination and protects sensitive data. As models become more capable this becomes particularly important for highly sensitive evaluations, such as those used for cybersecurity or by government bodies. Double-blind evaluations unlock the ability for independent organizations to rigorously test advanced models without compromising data sovereignty or security.

We hope this pilot establishes a new frontier for model oversight, helping the broader industry build safer, more reliable, and widely trusted AI systems. To learn more about our methodology and findings, read our technical report.

Extend scenes for longer storytelling

Scene extension allows you to take an existing video and continue generating footage seamlessly from where it left off.
With Omni 1.1, the model can now analyze up to 10 seconds of prior context — a leap from previous models that only referenced the final second. The result is improved visual consistency and narrative adherence, letting you build longer stories or branch into new creative directions. You can extend videos in 10-second increments up to a total cumulative length of 40 seconds.

Here’s how you can extend your scene with the Gemini API:

from google import genai

client = genai.Client()

interaction = client.interactions.create(
    model="gemini-omni-1.1-flash",
    previous_interaction_id=previous_video_interaction.id,
    input=[
        {
            "type": "text",
            "text": "Continue the scene."
        }
    ],
    response_format={
        "resolution": "360p",
    },
)

Specify first and last frames

Achieve smooth transitions and camera movements by specifying the starting and ending frames of a shot. Omni 1.1 generates continuous video between two keyframes, making it ideal for complex camera orbits, zoom transitions, or seamless looping clips.

Draft videos more efficiently in 360p

Generate lightweight previews in 360p resolution up to 60% faster* and at a third of the cost compared to Omni 1.1’s standard 720p resolution. This is helpful for rapid prototyping, storyboard iteration, and quick rendering in developer platforms.

*Up to 60% faster generation based on system throughput of 360p vs. 720p resolution

Upscale up to 4K resolution

Generate polished, high-resolution 1080p or 4K outputs that are ready for professional production with Omni 1.1.

Add video references in your multimodal input

Reference up to three seconds of video when crafting your scene, allowing you to maintain visual context and character consistency based on video references.

Inspiring concepts for what you can build

Here are a few ideas showing how developers can put these new capabilities into action across custom tools and creative workflows.

See how customers are putting Omni Flash in production

Our customers are already driving real-world production with Gemini Omni Flash via the Agent Platform API. Explore the videos they've created and hear about how they are using the model below.

Build with Gemini Omni 1.1 Flash Today

Omni 1.1 is rolling out across the Google developer ecosystem:

• Start building in Google AI Studio: Try out Omni 1.1 directly in Google AI Studio.
• Build on Gemini Enterprise Agent Platform: Enterprises can build with Omni 1.1 directly via Agent Platform API.
• Explore the developer documentation: Check out the official documentation, the cookbook and prompting guides to learn how to integrate scene extensions, video references, and upscaling into your applications.

Omni 1.1 is also available to all Google AI Plus, Pro and Ultra subscribers globally in Google Flow, starting today. Scene extension is available to all Google AI Plus, Pro and Ultra subscribers globally in the Gemini app.

Gemini Live is moving beyond conversation to handle complex tasks on your behalf. With new features like Personal Intelligence, Daily Brief, Spark, and hands-free inbox management, you can seamlessly talk through your day and delegate your to-dos without missing a beat.

Life moves fast, and speaking a prompt out loud is often the quickest way to get help with Gemini. We know how important this speed is to you: 63% of users talk to Gemini out loud. Today we're rolling out a major productivity upgrade to Gemini Live, bringing in powerful agentic capabilities so you can do more with your voice than ever before.

Let Gemini do the heavy lifting

Gemini Live is integrating with Spark, so you can now use natural voice commands to set up complex, multi-step tasks that run entirely on their own.

Spark works seamlessly across Google Docs, Sheets, Drive, and the web, remembering your goals as it goes. It handles long-running, scheduled jobs across days or weeks, even when you aren't actively using the app.

• Brainstorming a big idea? Just ramble your unstructured thoughts, ideas, and half-baked plans out loud to Gemini while you're on the go. Spark can take that conversational brain dump, organize your key themes, and turn them into a neatly structured outline in Google Docs by the time you sit down to work.
• Simplifying meal prep? Just ask Gemini to maintain a weekly meal plan for your family. You can have it plan a high-protein vegetarian menu and instantly create a grocery list based on recipes saved in your Docs.

Get a head start on your morning

Start your day with instant clarity. You can now access your Daily Brief in Gemini Live, providing a ready-to-go spoken summary of everything on your to-do list for the day. Just say, “What’s my daily brief?” and Gemini will combine your most important updates from Gmail, and Calendar into one concise digest. It's the perfect way to answer "what should I care about today?" without ever looking at a screen.

Manage your inbox hands-free

We're introducing a new feature to help you tackle your inbox using just your voice. Gemini acts as your conversational partner for quick email sorting from your Gmail. Just ask, "Any new emails?" or "Are there any urgent emails from the kids’ school today?" You can search, summarize, star, archive, or delete messages hands-free.

Pick up where you left off

Gemini Live now remembers the things you've chatted about and that matter to you, so you never have to start from scratch. With Personal Intelligence, Gemini connects the dots across your past conversations and your Google apps like Gmail, Photos, Search, and YouTube — to make your assistant uniquely helpful for you.

Just ask, "What was the name of that restaurant we went to when we visited New York last summer?" or "Can you pull up the recipe we talked about yesterday?" and Gemini will seamlessly pull from your chat history and connected apps to give you the exact answer.

Just talk, Gemini handles the rest

You shouldn't have to guess whether a task requires Spark, a Daily Brief, or a quick inbox search. The real magic of Gemini Live is that you never need to figure out which tool to use — it connects the dots across your day in a single, unbroken conversation.

You can ask, "What does my day look like?" while you're making coffee. Gemini will brief you on your morning schedule and mention a few school newsletters and sports schedules sitting in your inbox. Then you can follow up: "Can you grab those event invites from my email, create family calendar events for them, and include the driving times?" Gemini instantly hands the job to Spark to handle in the background while you finish getting ready.

To get started, make sure you have chosen to connect your apps in your Gemini Personal Intelligence settings. Tap the Live icon in the Gemini app and simply start talking.

Clear out the mental clutter and get back to your day with a little help from Gemini Live.

Our latest speech-to-text model designed for precise and intelligent real-time transcription.

Today, we’re introducing Gemini 3.5 Transcribe, our most precise speech-to-text model yet, designed for intelligent voice interactions.

Unlike conventional speech recognition models that struggle with background noise, complex jargon, and disfluency cleanup, Gemini 3.5 Transcribe converts raw audio directly into accurate, polished, formatted text.

Across our products like the Gemini app and on Android, we’ve seen consumers already benefiting from this transcription model with new voice capabilities like Rambler on Android and in the Gemini app on macOS. Now, developers can build similar capabilities with Gemini 3.5 Transcribe in the Gemini API in Google AI Studio and Gemini Enterprise Agent Platform.

We've built 3.5 Transcribe to plug seamlessly into your developer workflows, whether you’re building voice agents, real-time captioning tools, or post-call analytics pipelines. The model is available across two separate APIs:

• Real-time streaming: Delivers continuous, bidirectional streaming with sub-second latency for interactive voice apps via the Live API using gemini-3.5-transcribe-live.
• Pre-recorded audio processing: Transcribes recorded audio, meetings, call logs, and more with speaker attribution and word-level timestamps via the Interactions API using gemini-3.5-transcribe.

Get more precise and intelligent transcription

Gemini 3.5 Transcribe is designed to capture your natural speaking style to better understand your intent and recognize custom vocabulary, so you can execute tasks with your voice.

• Smart transcription: Seamlessly handles self-corrections (like "let’s meet Tuesday—no, Wednesday"), removes filler words (“ums” and ‘“ahs"), auto-formats your text.
• Function calling: The model can delegate complex tasks (such as image generation and file analysis) to other Gemini models via function calls. Currently available in the Gemini macOS app.
• More precise transcription: As measured by Artificial Analysis, achieves an average Word Error Rate (WER) of 4.0% for streaming and 2.6% for non-streaming use-cases. It shows strong performance across noisy, real-world environments, accurately capturing alphanumeric entities like postal codes and order IDs.
• Custom vocabulary: Recognizes specialized jargon and unique spellings by seamlessly adapting transcriptions to your provided custom vocabulary.
• Global language support: Automatically detects and transcribes over 85 languages, seamlessly handling regional accents and diverse dialects.
• Multi-speaker identification: Accurately attributes speech in pre-recorded audio with timestamps for up to three speakers (support for 3+ speakers is experimental).

Gemini 3.5 Transcribe’s performance represents a major advancement from our previous transcription model, Chirp 3, offering new capabilities, improved word error rates, and significantly better latency. As measured by Artificial Analysis, time to final transcription, for example, improves by 70%. On the FLEURS benchmark across a set of top languages and locales, the model delivers precise multilingual performance, improving over Chirp 3, and achieving a 5.50% WER in streaming mode and 5.04% WER in non-streaming use-cases.

Experience smart transcription and advanced dictation

In addition to the Gemini API in the Google AI Studio and Gemini Enterprise Agent Platform, 3.5 Transcribe goes further than standard speech-to-text to make working across Google feel more natural and intuitive. By bringing context-aware understanding directly into everyday surfaces like Gboard, Antigravity, the Gemini app, and Chrome, it captures nuances, intent, and inline edits with ease.

• On Gboard on Android, through the new Rambler feature, 3.5 Transcribe transforms spoken thoughts into well-formatted text, filtering out filler words. You can also use your voice to make edits, correct misspellings, and change the writing style.
• On Google Antigravity, 3.5 Transcribe pairs screen context and chat history, with your permission, to ensure pinpoint transcription accuracy across file names, agent thoughts, and active documents.
• In Google AI Studio, you can access 3.5 Transcribe in Build mode to vibe code apps with your voice on the fly.
• In the Gemini app on macOS, 3.5 Transcribe not only transcribes your free natural speech into clean formatted text, but also enables voice commands that can pair seamlessly with screen context to power complex workflows. By calling on other Gemini models in the background to handle the heavy lifting, the model makes it effortless to summarize local files, repurpose text across apps, or generate images right at your cursor—using just your voice.
• Coming soon to Chrome, you’ll be able to talk to type in any web field — making it effortless to dictate replies, draft posts, or prompt Gemini in Chrome more naturally and easily with your voice.

Read the early reviews

By leveraging the Gemini Live API, developer platforms such as Agora, Fishjam, LangChain, LiveKit, Pipecat, Vercel, and Vision Agents enable developers to build and deploy high-performance voice-driven interfaces with ease. These platforms manage complex real-time media streaming infrastructure behind the scenes, allowing developers to focus entirely on crafting the user experience.

Companies like Vivo, Intellitek Health, and Lingopal have also shared positive feedback on 3.5 Transcribe, highlighting its impressive latency, accuracy, and expansive language support.

Start using 3.5 Transcribe today

• For developers: In public preview in the Gemini API via Google AI Studio and Google Antigravity.
• For enterprises: In public preview via Gemini Enterprise Agent Platform and coming soon to Gemini Enterprise for Customer Experience.
• For everyone: In Gemini app on macOS in English, Rambler on Android in select countries and languages, and coming soon to Chrome.

We recently introduced a new way to create, edit, and summarize in the Gemini app for macOS using just your voice, right where you’re already working. This intelligent dictation feature allows you to speak naturally into any window on your desktop, transcribing your spoken words into clean, polished text. It automatically removes the “ums” and “ahs,” catches mid-sentence corrections, and drops the formatted text instantly at your cursor.

See this feature in action — and learn how to turn it on — in the video below.

Admins can now access Google Chat usage metrics in the Gemini reports dashboard across both organization- and user-level reports.

At the organization level, this allows admins to track active Gemini users in Google Chat, analyze usage trends, and identify who benefits most from Gemini-powered summarization and generation features.

At the user level, admins can now view the level of Gemini adoption for specific users who actively engage with the app.

This launch also updates a few Gemini summarization interactions in Chat to “Active” as they are initiated by the user. Given this, you may see updated metrics reported for active users and overall usage of Chat.

Getting started

• Admins: Visit the Help Center to learn more about Gemini reports.
• End users: There is no end user impact or action required.

Rollout pace

• Rapid Release and Scheduled Release domains: Available now

Availability

• Business: Business Starter, Standard, and Plus
• Enterprise: Enterprise Starter, Standard, and Plus
• Education Add-ons: Google AI Pro for Education

Resources

• Google Workspace Admin Help: Gemini Reports Dashboard Help
• Google Developer Documentation: Gemini in Workspace Apps Activity Events

Google Chat is the central hub for real-time collaboration in Workspace, and starting August 26, 2026, it becomes the place where you can bring the power of Gemini into your flow of teamwork. We’re introducing Ask Gemini in Google Chat, a unified command line for your work, powered by Workspace Intelligence.

Ask Gemini in Chat helps you navigate your day, stay on top of the flow of collaboration, find what you’re looking for, and help you take action.

• Find answers quickly: Search across your Workspace data (like Gmail, Drive, or Calendar) to gather information.
• Create content: Generate images or draft critical updates without leaving the conversation.
• Stay on top of discussions: Catch up on all your conversations in one place.
• Manage tasks and events: Schedule your meetings and manage tasks without breaking your flow.
• Organize your work: Structure your conversations with individual sessions to revisit and continue work on specific topics over time.

Ask Gemini helps you reduce time spent searching for information and toggling between tabs, to ensure you have everything you need to take action and keep up with the busy pace of modern teamwork.

Ask Gemini is available in the Shortcuts menu in Chat

Important changes to Gemini side panel in Chat

• Ask Gemini in Chat provides many of the functions previously available in the Gemini side panel in Chat, including finding files, capturing action items and summarizing conversations. With this launch, you’ll no longer see the side panel in Chat.
• In addition, you’ll no longer be able to access Gems via Gemini side panel in Chat. However, Gems will remain available in the Gemini side panel of other Workspace apps.
• Your conversation history from the Gemini side panel in Chat will not migrate to the new Ask Gemini surface in Chat. However, admins will be able to export Gemini conversation history, including conversation history from the Chat side panel, and if permitted by their organization, end users will be able to download their conversation history as well. Note that in the Data Export tool and Google Takeout, this data is stored under “Gemini in Workspace,” not “Google Chat.”

Language availability

This change will only affect users who have English as their Google account language. Users with other language preferences will be able to continue using the side panel as this update will not apply to them. Support for more languages will be added in the future.

Getting started

• Admins: This feature is available by default if Gemini in Workspace in Chat and Workspace Intelligence for all apps are enabled.
• End users: To use Ask Gemini features, you must be enrolled in Workspace Smart Features. Once enabled, Ask Gemini will be available on the left under "Shortcuts" in Google Chat. You can also quickly access it using the keyboard shortcut (Ctrl + g on ChromeOS/Windows or Command + g on macOS). Visit the Help Center to learn more about Ask Gemini in Chat.

Through October 1, 2026, Workspace customers will get promotional access to higher limits for Ask Gemini in Chat, allowing users to experiment with this feature. Usage limits will apply after that date; we’ll provide more information in the Help Center in advance of updated usage limits going into effect.

Rollout pace

• Rapid Release and Scheduled Release domains: Gradual rollout (up to 15 days for feature visibility) starting on August 26, 2026

Availability

• Business: Business Standard and Plus
• Enterprise: Enterprise Standard and Plus
• Education Add-ons: Google AI Pro for Education

Resources

• Google Chat Help: Get started with Ask Gemini in Google Chat

We’re offering one year of a Google AI plan free of charge for eligible college students around the world — plus new and enhanced study tools — so students can make the most of this school year.

The beginning of a new college year is always filled with anticipation — new classes, professors, and the promise of a fresh start. To help get you started, Google is offering student plans for one year at no cost and launching new and enhanced study tools.

Here are five steps you can take to make the most of this school year with the help of Gemini.

1. Sign up for your 12-month student plan, free of charge.

Starting today, we’re introducing new offers on our Google AI plans so that college students heading back to campus can unlock more of Gemini.

For eligible college students in the U.S., we’re offering one year of Google AI Pro for free (valued at $19.99/mo). This offer unlocks 4x higher usage limits in Gemini, access to Gemini Spark, Gemini in Google apps like Gmail and Google Docs, 5 TB of storage, Google Health Premium, and more.

For eligible college students outside the U.S., we’re offering one year of Google AI Plus, free of charge. This offer provides access to Gemini Omni, 2x higher usage limits in Gemini, 400 GB of storage, and more.

Finally, for students who want ad-free music and video streaming, we’re offering a bundle of Google AI Pro and a YouTube Premium subscription for up to 70% off.

Claim your offer today.

2. Get organized with the new student hub.

New in the Gemini app, we’ve built a dedicated hub to get you started with all of Gemini's tools and offers, just for students. The hub helps keep you organized; start a study notebook, create flashcards, take a practice quiz and more. As Gemini creates more learning tools, you’ll find them here in your student hub.

Access it at gemini.google.com/students.

3. Set up your study notebooks.

Studying can feel overwhelming when you don’t know what to tackle first. That’s why we launched study notebooks in June to guide you step-by-step through the learning process. Once you’ve uploaded your own class materials like lecture notes, Gemini sets up your study notebook with a gameplan to break down your learning topics. It gives you the option to take a diagnostic quiz to identify your unique knowledge gaps so that it can craft custom, bite-sized lessons and quizzes for you — complete with a real-time progress dashboard to track your milestones.

In the coming weeks, study notebooks will be even more helpful with graphs and images as part of your lessons. And so you never miss a deadline, Gemini will even schedule your key dates (like exams and assignment due dates) in Google Calendar from your syllabus — with your permission. And with access to Google AI Plus and Google AI Pro, you can create even more notebooks with even more sources.

Get started here or click “+ New notebook” in the student hub.

4. Dive deeper with interactive visualizations.

Prefer learning with visuals? With interactive visualizations, Gemini can generate functional 3D simulations to help you better understand the topic you’re asking about. Responses include visual elements — like tables, grids, and simulations — made specifically for your question. For example, ask about a topic that could be explained visually, like “show me how DNA works in 3D,” and you’ll be able to interactively rotate and zoom into a 3D DNA structure. Or ask to watch a pendulum trade energy back and forth, or learn about cash burn rates through an interactive table.

5. Talk through research with Gemini Live.

Gemini Live provides a natural, conversational way to study — especially on the go. You can talk through your problem set or chat through materials from your Drive, and now when you want to explore a topic in more depth, Gemini Live will be ready.

Rolling out today, we’re bringing the power of Deep Research into Gemini Live so you can launch comprehensive, multi-step research reports and chat with Gemini about them. Just ask Gemini to research a topic, then feel free to close the chat, lock your screen, or keep chatting about other things. Gemini works asynchronously in the background and sends a notification when your report is ready. Once it is, you can chat through the results, ask follow-up questions, or refine the details hands-free.

By seamlessly switching from typing to talking — while keeping the full context of your deep research report front and center — Gemini Live truly becomes the ultimate conversational study partner.

The student hub, study notebooks, interactive visualizations, and Deep Research in Gemini Live are rolling out today to all Gemini app users. Whether your goal this semester is to stay effortlessly organized, explore a new major, or ace your classes, Gemini’s here to help. It’s your personalized study buddy, grounded in all of your class materials ready to help you tackle whatever comes your way.

Explore more of Gemini’s helpful learning tools, and claim one year of Gemini, on us.