Adobe brings four highly-requested Premiere Pro AI features out of beta

1 day ago 3
generative-extend-4
Adobe

Adobe has continually implemented AI features into its suite of applications to help creatives build and execute projects more seamlessly. Now, it's bringing some of Adobe Premiere's cutting-edge AI features out of beta so that more users can benefit.

Also: I've tried lots of AI image generators, and Nvidia and MIT's is the one to beat for speed

On Tuesday, Adobe made several features -- Generative Extend, Media Intelligence, Auto-Translate caption, and Premiere Color Management -- generally available in Premiere Pro. The release incorporates feedback collected from the beta and features new, highly requested tools. 

Generative Extend

The Generative Extend feature creates new frames for video shots to extend the clip a bit longer. Like Photoshop's viral Generative Fill, this feature adds more content necessary to complete your project, even if you didn't initially capture it. Using it is simple: Select Generative Extend, drag the clip out, and watch it generate the new content in the background. 

The feature is powered by Adobe Firefly, meaning that the added clips boast the same protections as those used with Firefly models, including being commercially safe, protected from indemnification, and adding Content Credentials. The feature can now add an extra 4K frames, so you don't have to sacrifice quality. 

Also: ChatGPT's new image generator shattered my expectations - and now it's free to try

Currently, Generative Extend is available for users to try out at no additional cost. However, according to Adobe, it will eventually transition to using Firefly generative credits depending on the generated clip's format, frame rate, and resolution. 

Media Intelligence

If you have edited a project in Premiere, you are likely familiar with the struggle of finding the right clip to add to your project's edit. Media Intelligence uses AI to help you filter through all the prompts using natural language that describes the scene or angle or includes a spoken word or element from the metadata, such as the shoot date or the camera type. 

media-intelligence-search-panel-3
Adobe

I watched a demo of the feature in action. It's as simple as using a term such as "close-up shots" to sort through your media library and populate the clips that meet that criteria. This media analysis takes place on your system, meaning you don't need to rely on the internet to use it. Adobe also lets users know their data is never used to train the models. 

Auto translate 

Adding captions to your projects is a good way to increase accessibility and ensure your content reaches a wider audience. However, this process is often lengthy and costly, relying on third-party services. Now, with the help of AI within Adobe, users can automatically translate captions into 27 languages. 

caption-translation-1
Adobe

Multiple closed caption tracks in different languages can be generated and visible simultaneously. This can be helpful for your audience and for helping you work through the edit if the content is in a language you don't understand. 

Color management improvements

Creatives often prefer recording raw or log videos to give them more control and options when editing. However, before editing, the video can be dull and gray. To combat this issue, Premiere Color Management Premiere Pro can transform your original files directly into SDR or HDR without using look-up tables.  

Additionally, Premiere Color Management has a new wide-gamut color pipeline that allows Premier to utilize the clips' log and raw data for an improved experience and options when color grading in Lumetri. Although these settings may sound complicated, Premiere Color Management is easy to use since all editors must do is select one of six new color management presets.

After Effects

In addition to all of Premiere Pro's features, After Effects also received a revamp. Some of the new features include 3D tools such as Animated Environment Lights, the native integration of 3D FBX models, new one-click menu items, new HDR monitoring, and a new High-Performance Preview Playback caching system. The Adobe blog post has the full list of After Effects features.

Want more stories about AI? Sign up for Innovation, our weekly newsletter.

Read Entire Article