ANR Tools

ANR AI Upscaler - Matcher

Brings a low-resolution image up to plate size with an AI upscaler, then lines it up with the original plate and matches its colour.

  • Essential
  • Comp & Depth pack
  • Upscaler models
  • 3 inputs
  • 24 controls

Overview

The AI Upscaler - Matcher brings a small image back to full size: a frame repainted in another program or by an AI image tool, a low-resolution render, an old element. It upscales the Low rez input with the AI model you choose. In Match + upscale mode it then lines the result up with the Original plate and matches its colour, so the edit drops back onto the plate.

AI model offers Real-ESRGAN x2plus and x4plus, and SeedVR2, a heavier generative model. AI output keeps the whole model result, or adds only the fine detail the model made on top of a plain resize, keeping the original colours.

Alignment corrects a small shift and size difference between the upscaled image and the Original. Colour match fits a gain and offset per channel, or a full colour matrix, on the pixels the two images share: what you changed in the edit stands out and is left out of the fit. Exclude keeps areas out of both.

Nothing runs while you scrub. Process works through the frames you choose, on this computer, and saves the results as image files in the Cache folder; the node then plays them back without running the model again.

Inputs

Low rezOriginalExcludeAI Upscaler - MatcherOutput
  1. Low rezrequired

    The image to upscale: the low-resolution edit, render or element.

  2. Originaloptional

    The full-resolution plate the Low rez was made from. Needed in Match + upscale mode: the result is aligned to it and matched to its colour, and with Output size 2x or 4x its shape sets the height.

  3. Excludeoptional

    A matte of areas to leave out of the alignment and the colour match, such as a large part you changed. It must have the Original's format.

Output. The upscaled (and matched) image at the size set by Output size, played back from the cache. Before anything is processed, the node shows the Low rez; frames outside the processed range are black, and a single processed frame shows on every frame. View and write from the ANR_Output Reformat under the node: it carries the result's format.

Quick start

  1. Add ANR AI Upscaler - Matcher. The menu also adds a Reformat named ANR_Output under it: view and write from that one.
  2. Connect the low-resolution image to Low rez. To match it to the plate, connect the plate to Original and leave Mode on Match + upscale; without a plate, choose Upscale only.
  3. Choose a Cache folder, or press Generate Autofill to make a new one next to the saved script.
  4. Choose the AI model and the Output size: the project format by default, or 2x, 4x or a custom format.
  5. Set Process to Current frame to try one frame, or to Frame range with First frame and Last frame.
  6. Turn proxy mode off, press the Process button, then view ANR_Output: processing starts when the viewer asks for the frame. A progress window follows each stage and can cancel.
  7. Check the result. Keep the node, which plays the cached files back, or press Import result for a Read of them.

The panel

The node's panel as Nuke shows it, with the values of a new node. Click any control to see what it does; tabs and sections work as in Nuke.

ANR_AI_Upscaler_-_Matcher1
ModeMatch + upscale
AI modelReal-ESRGAN x2plus
AI outputFull model output
AI strength1
Seed1
AlignmentTranslate + scale
Colour matchGain / offset
Match strength1
Output sizeProject format
Width1920
Height1080
Pixel aspect1
ReformatFit
Output filesPNG (16 bit)
Generate Autofill
Cache folder
ProcessCurrent frame
First frame1
Last frame100
Process
Cancel
Import result
Open output folder
StatusChoose cache folder, connect Low rez and view this node. Then Process.

All controls

ANR AI Upscaler - Matcher24 controls
ModeMenumode

Match + upscale upscales the Low rez, then aligns it to the Original and matches its colour. Upscale only needs no Original and turns the matching controls off.

Default: Match + upscaleOptions: Match + upscale Upscale only

AI modelMenuupscaler

The AI model. Real-ESRGAN x2plus works at twice the size and x4plus at four times; the result is then resized to Output size. SeedVR2 is a heavier generative model that needs a larger GPU.

Default: Real-ESRGAN x2plusOptions: Real-ESRGAN x2plus Real-ESRGAN x4plus SeedVR2 (local GPU)

AI outputMenuai_output

Full model output keeps the model's result. Detail only (preserve colour) adds only the fine detail it made to a plain resize, keeping the original colours and tones.

Default: Full model outputOptions: Full model output Detail only (preserve colour)

AI strengthSliderai_strength

How much of the AI change goes on top of a plain resize: 1 is the full model result, 0 skips the model.

Default: 1

SeedSliderseed

SeedVR2 only: another seed gives another version of the generated detail. The Real-ESRGAN models ignore it.

Default: 1

AlignmentMenualignment

How the upscaled image is lined up with the Original: shift and size, shift only, or not at all.

Default: Translate + scaleOptions: Translate + scale Translation Off

Colour matchMenucolour

Gain / offset fits each channel on its own; Colour matrix also corrects shifts between channels, such as a hue change. Pixels that differ between the two images are left out of the fit.

Default: Gain / offsetOptions: Gain / offset Colour matrix Off

Match strengthSlidercolour_strength

How much of the colour correction is applied, from 0 to 1.

Default: 1

Output sizeMenusize_mode

The result's size: the project format, twice or four times the Low rez width (the height follows the Original's shape, or the Low rez's in Upscale only), or the Width, Height and Pixel aspect below.

Default: Project formatOptions: Project format 2x 4x Custom format

WidthSliderwidth

Custom format only: the result's width in pixels.

Default: 1920

HeightSliderheight

Custom format only: the result's height in pixels.

Default: 1080

Pixel aspectSliderpixel_aspect

Custom format only: the result's pixel aspect ratio.

Default: 1

ReformatMenuresize_fit

When the result's shape differs from the image's: Fit keeps the whole image with transparent borders, Fill fills the frame and crops, Stretch changes the aspect.

Default: FitOptions: Fit Fill Stretch

Output filesMenucache_format

PNG (16 bit) by default; PNG (8 bit) is smaller. EXR (float / HDR) keeps values outside 0 to 1 and, when matching, adds a match.confidence channel: 1 where the result agrees with the Original.

Default: PNG (16 bit)Options: PNG (16 bit) EXR (float / HDR) PNG (8 bit)

Generate AutofillButtonanrCacheAutoFill

Create a new node-type/footage_letter_4digits folder on every click, then stop. Previous caches are kept. Enter a folder to choose a custom base.

Cache folderFilecache_folder

Required. Completed image files only; private processing files are cleaned automatically.

Default: empty

ProcessMenuframes_mode

Current frame processes the frame you are on; Frame range processes First frame to Last frame.

Default: Current frameOptions: Current frame Frame range

First frameSliderfirst

No description.

Default: 1

Last frameSliderlast

No description.

Default: 100

ProcessButtonprocess

Queues a run with the current settings. It starts when the node is viewed at full resolution, with a progress window.

CancelButtoncancel

Stops the run; the previous result stays.

Import resultButtonimport_result

Makes a Read of the finished files beside the node (with a Premult for PNG), in one undoable step.

Open output folderButtonopen_folder

Opens the Cache folder in Explorer.

StatusStatusstatus

What the node is doing: what to connect, the progress of a run, or why it stopped.

Tips

  • Try one frame with Current frame before a long range: every frame goes through the model.
  • If the model shifts colours or tones, choose Detail only (preserve colour) or lower AI strength.
  • With AI strength at 0 the node skips the model: it resizes, aligns and matches only, and needs no GPU.
  • If the colour match fails or is pulled by a large change, connect a matte of the changed area to Exclude.
  • For a plate with values above 1, choose EXR (float / HDR) in Output files: PNG clips them.
  • Generate Autofill makes a new folder on every click, so earlier results are kept. To put cache folders next to the footage instead of the script, use ANR > Cache Folders > Location in Nuke's menu bar.
  • A Read made by Import result stays as it is when you process again: each run writes new files with their own name.

Good to know

  • The AI models need an NVIDIA GPU. SeedVR2 needs one with 8 GB of memory or more, and 8 GB of free system memory, and takes longer than the Real-ESRGAN models.
  • The models are a separate download. If they are not on this computer, the node offers them when you add it or choose SeedVR2, and Nuke stays usable while they download; then press Process again.
  • A Cache folder is required: nothing is processed without one. It holds only the finished image files, and a failed or cancelled run keeps the previous result.
  • Processing runs on this computer: nothing is uploaded. Changing a setting does not run the model again; press Process.
  • Alignment corrects small differences only. If the Low rez is far off the Original in position, size or rotation, line it up roughly with a Transform first, or set Alignment to Off.
  • Each frame is processed on its own, with no link between frames: check a sequence for flicker in the generated detail.
  • AI detail is added only where the image is between 0 and 1; brighter or negative pixels keep a plain resize.
  • Limits: 16 to 16384 pixels per side and at most 64 megapixels, up to 10000 frames per run, and Low rez and Original need the same pixel aspect.

Something unclear or missing? Write to [email protected].