Gemini Omni 1.1 Flash Lets You Build with More Control
Google updated Gemini Omni 1.1 Flash to give developers granular control over generative video, including scene extension and first-to-last frame interpolation.
Deep dive
- Features include scene extension up to 40 seconds with 10 seconds of context awareness.
- Supports user-defined start/end frames for precise camera moves.
- Includes cost-effective 360p prototyping and 4K upscaling.
- Enables multi-modal inputs with video references for character consistency.
- Already deployed by Figma Weave, Adobe Firefly, and Runway.
Decoder
- Interpolation: The process of creating intermediate frames between two existing images or keyframes to produce smooth motion.
- Multimodal: AI systems capable of processing and generating multiple types of input/output, such as text, images, and video simultaneously.
Original article
Gemini Omni 1.1 Flash lets you build with more control
Omni now delivers studio-quality video production, including the ability to extend a scene, first and last frame interpolation, crisp 4K upscaling, faster prototyping, and more.
Today, we’re introducing Gemini Omni 1.1 Flash, a new suite of creative controls and generative video capabilities to support developers. Gemini Omni brought real-world reasoning to generative creation, and today’s updates make Omni 1.1 production-ready for professional use via the Gemini API in Google AI Studio.
Whether you’re building generative video workflows, creative tools, or media editing software, these updates make generative video more controllable, faster to iterate on, and polished for real-world deployment. Here’s a look at what’s new:
Extend scenes for longer storytelling
Scene extension allows you to take an existing video and continue generating footage seamlessly from where it left off.
With Omni 1.1, the model can now analyze up to 10 seconds of prior context — a leap from previous models that only referenced the final second. The result is improved visual consistency and narrative adherence, letting you build longer stories or branch into new creative directions. You can extend videos in 10-second increments up to a total cumulative length of 40 seconds.
from google import genai
client = genai.Client()
interaction = client.interactions.create(
model="gemini-omni-1.1-flash",
previous_interaction_id=previous_video_interaction.id,
input=[
{"type": "text", "text": "Continue the scene."}
],
response_format={
"resolution": "360p",
},
)
Specify first and last frames
Achieve smooth transitions and camera movements by specifying the starting and ending frames of a shot. Omni 1.1 generates continuous video between two keyframes, making it ideal for complex camera orbits, zoom transitions, or seamless looping clips.
Draft videos more efficiently in 360p
Generate lightweight previews in 360p resolution up to 60% faster and at a third of the cost compared to Omni 1.1’s standard 720p resolution. This is helpful for rapid prototyping, storyboard iteration, and quick rendering in developer platforms.
Upscale up to 4K resolution
Generate polished, high-resolution 1080p or 4K outputs that are ready for professional production with Omni 1.1.
Add video references in your multimodal input
Reference up to three seconds of video when crafting your scene, allowing you to maintain visual context and character consistency based on video references.
Inspiring concepts for what you can build
Here are a few ideas showing how developers can put these new capabilities into action across custom tools and creative workflows.
See how customers are putting Omni Flash in production
Our customers are already driving real-world production with Gemini Omni Flash via the Agent Platform API.
“Gemini Omni Flash is one of the strongest video models available in Figma Weave, where the canvas helps creative teams build on every generation — attaching references, branching different versions, and shaping something unique. With extensions, richer reference material, and 4K resolution, Gemini Omni Flash takes teams beyond generating videos to truly directing them.” - Itay Schiff, Creative Director, Figma Weave.
“At GMI Cloud, we give creators centralized access to the world’s most capable models. What stands out about Gemini Omni Flash is its accuracy: the details hold up under scrutiny. For customers creating educational and explanatory content, where getting things right is essential, that reliability matters more than any single feature. Omni has made AI video viable for a segment that previously couldn’t rely on it.” - Louisa Guo, VP of Marketing, GMI Cloud.
“Omni Flash fits naturally into how people already use Runway: start with a prompt, an image or a video, then generate or edit from there. It's another way for our users to move quickly between ideas.” – Jamie Umpherson, Chief Creative Officer, Runway.
Build with Gemini Omni 1.1 Flash Today
Omni 1.1 is rolling out across the Google developer ecosystem:
- Start building in Google AI Studio: Try out Omni 1.1 directly in Google AI Studio.
- Build on Gemini Enterprise Agent Platform: Enterprises can build with Omni 1.1 directly via Agent Platform API.
- Explore the developer documentation: Check out the official documentation, the cookbook and prompting guides to learn how to integrate scene extensions, video references, and upscaling into your applications.
Omni 1.1 is also available to all Google AI Plus, Pro and Ultra subscribers globally in Google Flow, starting today. Scene extension is available to all Google AI Plus, Pro and Ultra subscribers globally in the Gemini app.
Fresh dev news, AI-digested daily. Never miss a trend at devoured.fyi