Adobe is significantly upgrading its AI video-generation application, Firefly, with a powerful new video editor. This update introduces precise prompt-based editing capabilities, allowing users to modify specific elements, colors, and camera angles within a video using text commands. Previously, Firefly only supported prompt-based generation, meaning any undesired part required recreating the entire clip. Now, users gain granular control, complemented by a new timeline view for easy adjustments of frames, sounds, and other characteristics.
First announced in private beta last October, this advanced video editor is now rolling out to all Firefly users.
Further enhancing its generative AI offerings, Adobe is integrating several leading third-party models. With Runway's Aleph model, Firefly users can issue highly specific instructions, such as "Change the sky to overcast and lower the contrast" or "Zoom in slightly on the main subject," to achieve desired video modifications.
Adobe's proprietary Firefly Video model also sees new capabilities, enabling users to upload a starting frame and a reference video of camera motion. This allows the AI to recreate that specific camera angle for their current video project, streamlining complex shot replication.
For enhanced visual quality, Topaz Labs' Astra model is now integrated, empowering users to upscale videos to impressive 1080p or even 4K resolution. Additionally, Black Forest Labs' FLUX.2 image generation model is being added to the app, alongside a new collaborative boards feature. FLUX.2 is immediately available across all Firefly platforms, with Adobe Express users gaining access starting in January.
These comprehensive updates reflect Adobe's strategic push to deepen user engagement and remain competitive in the rapidly evolving generative AI landscape. As competitors release new models for image and video creation, Adobe aims to solidify Firefly's position as a leading creative tool. To celebrate these advancements, subscribers to Firefly Pro, Firefly Premium, 7,000-credit, and 50,000-credit plans will receive unlimited generations from all image models and the Adobe Firefly Video Model within the Firefly app until January 15.
This year has seen a flurry of innovations for Adobe's Firefly ecosystem. Earlier, the company launched subscriptions offering various tiers of image and video generation access. This was followed by the release of a new Firefly web app and dedicated mobile applications, alongside continuous integration of more third-party models within the Firefly platform.
