Adobe Premiere Pro searches, generates and translates with AI

Premiere Pro searches, expands clips and translates subtitles with the help of the AI Firefly. After Effects should run faster than its predecessor.

listen Print view

Premiere Pro video editing now extends video clips including the soundtrack using Adobe Firefly artificial intelligence.

(Image: Adobe)

3 min. read
Contents

Adobe has released new versions of the video editing software Premiere Pro and the animation program After Effects. The new features include an intelligent search function and automatically translated subtitles. The “generative enhancement” introduced as a beta version in fall 2024 is now also part of the full version. The hardware-hungry After Effects gets an update for smoother performance and extended 3D support.

Adobe calls its smart search for Premiere Pro “Media Intelligence”. It determines the content of video clips. This allows you to search for information such as objects, locations, and camera settings in natural language and find matching clips. Premiere Pro provides an input line for the new search function in the top right-hand corner.

This search function can also be used to filter for classic metadata such as the camera used, the focal length used or the date of recording.

The new "Media Intelligence" search system analyzes the image content so that it can be found using natural language.

(Image: Adobe)

The Premiere Pro “Generative Extend” tool uses the artificial intelligence behind Adobe Firefly to extend video clips. It has been available in a public beta version of Premiere Pro since fall 2024. Now it is part of the full version. Previously, it only supported 1080p resolution. In the final version, it now also works with 4K material. Unlike AI video generators, which can only generate images but no sounds, Premiere Pro also adds background sound.

In the timeline, Premiere Pro marks the extended area as AI-generated. Beta testers had requested the marker, as otherwise it is easy to lose track of what is the original and what is generated in larger projects. A context menu allows you to generate alternatives or change the AI-generated area back to the original.

Adobe marks the artificially added area in the timeline. It can be changed or removed at any time via a context menu.

(Image: Adobe)

Premiere Pro uses artificial intelligence to create subtitles from the audio track, and can now translate them into 27 languages during video editing. In addition to English, German, Spanish and French, the program also supports Danish, Dutch, Hindi, and Japanese.

Videos by heise

There is a button in the subtitle control panel that recognizes the source language at the touch of a button and translates it into a desired language. An online connection is required for this.

Premiere Pro translates automatically generated subtitles into different languages. The target languages are selected via checkboxes.

(Image: Adobe)

Adobe promises faster and longer playback for the animation program After Effects, even on older devices with little memory. According to Adobe, After Effects achieves this through a continuous cache.

3D models can be imported and illuminated with a single click. The 3D tools in After Effects previously supported the GLB (GL Transmission Format Binary), GLTF (Graphics Language Transmission Format) and OBJ (Wavefront OBJ) formats. Now the Filmbox format FBX, which was previously only supported in beta, has also been added to the final version.

(akr)

Don't miss any news – follow us on Facebook, LinkedIn or Mastodon.

This article was originally published in German. It was translated with technical assistance and editorially reviewed before publication.