Adobe releases generative AI for video

In future, the generative AI Adobe Firefly will generate video clips as well as images. In Premiere Pro, it extends clips beyond their original length.

listen Print view
An AI-enhanced scene in a video in edit mode

In Premiere Pro video editing, the new Adobe Firefly video model adds additional images to existing video clips.

(Image: Adobe)

3 min. read
Contents

Software manufacturer Adobe has added a video model to its generative AI service Firefly. Users have already been able to generate images, vector models and simple layouts with Firefly.

On the occasion of its in-house Max trade fair, Adobe also released a beta version of its Premiere Pro video editing software, in which video clips can be expanded in terms of content.

In Photoshop, the most requested function is "generative filling", i.e. the expansion of existing material using artificial intelligence. The Firefly tools for Premiere Pro are intended to build on this.

Videos by heise

The "generative enhancement" in Premiere Pro inserts new material at the end of existing video clips based on the existing – both video and audio.

The Firefly web app also generates videos based on text and image prompts. For example, images can be animated or completely new ideas can be implemented as video clips based on text input.

As with the image generator, the output of the video model in the web app can also be specified via a palette menu. For example, you can select the aspect ratio and frame rate. In the camera menu, Firefly offers movement patterns such as "Zoom in" and "Zoom out". You can also set the camera angle.

In the Adobe Firefly web app, the aspect ratio, frame rate and camera movements, among other things, can be set via the sidebar for the video model.

(Image: Adobe)

According to Adobe, it has also trained the video model of its AI service with data from the Adobe Stock photo agency, as well as with public domain videos and videos for which the copyright has already expired.

This is intended to rule out copyright infringements: According to Adobe, the images, graphics, layouts and videos generated are "commercially safe", i.e. legally unobjectionable for commercial use.

Adobe also integrates Firefly into the Content Authenticity Initiative (CAI) to certify the origin of the generated data. Adobe's Firefly service marks the created content in the metadata with a note that identifies it as AI-generated.

The full Creative Cloud subscription including Photoshop, Illustrator, InDesign, Lightroom, Premiere Pro and After Effects costs €66.45 per month, a subscription for a single application costs €20.78 per month. Adobe charges €11.89 per month for the Adobe Express design app and the photo subscription with Lightroom.

Creative Cloud subscribers receive 1000 credits per month, Lightroom users 100 credits and subscribers to the other individual apps 500 credits each. In the Firefly subscription, 100 credits can be added for 5.49 euros per month. Adobe deducts one credit for each element generated with Firefly. Unused credits expire at the end of the month.

(akr)

Don't miss any news – follow us on Facebook, LinkedIn or Mastodon.

This article was originally published in German. It was translated with technical assistance and editorially reviewed before publication.