Adobe Premiere Pro and After Effects: AI tools for editing and effects

Adobe is expanding its video editing software Premiere Pro and animation program After Effects with AI functions for masks, 3D design, and collaboration.

listen Print view

Adobe Premiere Pro will mask and track people with AI support in the future.

(Image: Adobe)

3 min. read
Contents

A new AI tool for object selection is intended to simplify selective work in the video editing program Adobe Premiere Pro. The function is designed to recognize, isolate, and create masks based on the selection of people and objects in the image with a single click of the mouse pointer. According to the manufacturer, the masks can be automatically tracked across multiple frames.

The underlying AI model works entirely locally on the computer, according to Adobe. User data is not used for training. Colored overlays or a black-and-white view are available for preview.

Videos by heise

In addition to AI object selection, Adobe has revised the familiar ellipse, rectangle, and pen masks. They can be created via icons in the toolbar and moved, rotated, and blurred in the preview monitor.

According to Adobe, the tracking works faster than before and supports forward and backward tracking. Furthermore, masks can be attached to surfaces such as screens or walls in the video and aligned perspectively. A live preview indicates problematic areas during tracking.

For post-production corrections, Premiere Pro has received a new editing mode. Changes to individual frames are automatically combined with existing tracking data. This is intended to reduce manual effort for complex masks.

Premiere connects Firefly Boards as a planning and idea tool. Image sequences, drafts, and generated content can be compiled there. Individual or multiple elements can be directly transferred to a video project and further processed there.

Adobe is also integrating a new version of the Frame.io palette into Premiere Pro. Comments, media, and versioning information from Adobe's online service for collaborating on video and media projects will appear there, as well as within the timeline. Feedback remains visible while editing continues. However, according to Adobe, the function is still in beta testing.

Premiere Pro also accesses Adobe Stock directly. Users can search, preview, license, and import millions of videos without leaving the application.

Media and comments from Frame.io, Adobe's online service for collaborating on video and media projects, will soon appear directly in the corresponding palette of Premiere Pro.

(Image: Adobe)

After Effects receives new tools for three-dimensional design. Users can create and combine parametric primitives such as cubes, spheres, or cylinders. New light types improve shadow rendering.

Additionally, SVG files from Illustrator can be imported as editable shape layers. Gradients and transparencies are preserved.

The text tool in After Effects will support variable fonts in the future, which can be controlled via keyframes. Furthermore, an extensive collection of materials from the Substance 3D library is available, which can be applied to custom or imported 3D models.

Adobe also adds new audio effects and a tool for removing black or white backgrounds.

Adobe is making the new versions of Premiere and After Effects available through Creative Cloud starting this week.

(akr)

Don't miss any news – follow us on Facebook, LinkedIn or Mastodon.

This article was originally published in German. It was translated with technical assistance and editorially reviewed before publication.