ANR Tools

ANR Edge Detail Extension

Removes the old background from the soft edges of a cut-out, hair and motion blur included, so it sits cleanly over a new background.

  • Masking
  • Masking pack
  • Masking models
  • 3 inputs
  • 8 controls

Overview

Every soft pixel of a cut-out, in hair, fur, motion blur or an antialiased edge, is a mix of the subject's colour and the background it was shot against. AI mattes also call some pixels solid that still carry background. Comped over a new background, that old colour shows as a fringe or a halo.

Edge Detail Extension solves each soft pixel back into its two parts, the subject's own colour and the original background, in a band round the edge. It replaces only the colour there and keeps the plate's own texture, so fine strands are not smeared into one flat colour. The inside of the matte stays exactly as it was.

It also carries the clean edge colour a little past the matte, so later blurs and filters do not pull black or old background into the edge. The node runs no AI model; it works on any matte, from a key, a roto or ANR Matte Creator.

Inputs

SourcePlateMaskEdge Detail ExtensionOutput
  1. Sourcerequired

    The cut-out: premultiplied RGBA (the usual case), or the untouched picture with the matte in alpha (set Input Is to Straight (RGB + alpha)).

  2. Plateoptional

    The original, uncut plate, lined up with the cut-out. When connected, the solve also sees the real background just outside the edge, which helps on thin hair.

  3. Maskoptional

    Limits where the fix is applied (its alpha): outside the mask the input passes through.

Output. By default the fixed cut-out, premultiplied, ready to Merge over the new background. Output can also give the clean colour unpremultiplied with the matte in alpha, or the estimated original background.

Quick start

  1. Make your cut-out as usual, for example ANR Matte Creator with Display set to Premultiplied.
  2. Add ANR Edge Detail Extension and connect the cut-out to Source. If you have the original plate, connect it to Plate.
  3. Merge the result over the new background and compare it with the old edge.
  4. If a fringe remains just inside the edge, raise Edge Width or Colour From Inside.
  5. If the edge looks blotchy, raise Smoothness; if it looks too flat, lower it.

The panel

The node's panel as Nuke shows it, with the values of a new node. Click any control to see what it does; tabs and sections work as in Nuke.

ANR_Edge_Detail_Extension1
Connect a premultiplied cut-out; the original plate to Plate when you have it; a Mask to limit where the node works.
Input IsPremultiplied
OutputPremultiplied
Colour From Inside0.5
Edge Width6
Smoothness1
Colour Spread32
Quality2
Mix1

All controls

ANR Edge Detail Extension8 controls
Input IsMenuinputIs

Premultiplied: RGB already multiplied by the alpha (the usual cut-out). Straight: RGB is the untouched picture with the matte in alpha.

Default: PremultipliedOptions: Premultiplied Straight (RGB + alpha)

OutputMenuoutput

Premultiplied: the fixed cut-out, ready to Merge over the new background. Straight: the subject's clean colour, extended past the edge, with the matte in alpha (Premult it yourself). Estimated Background: the other half of the solve, the background the subject was shot against.

Default: PremultipliedOptions: Premultiplied Straight (clean colour + alpha) Estimated Background

Colour From InsideSliderfromInside

0: each soft pixel's colour is solved from its own value and its alpha (exact when the matte is exact). 1: the colour comes from the more opaque neighbours instead, like an edge extend that still respects the matte. Raise it when the matte reads a little too soft or too wide, as AI mattes tend to. The plate's own texture is kept either way.

Default: 0.5

Edge WidthSlideredgeWidth

How far inside the matte's edge the fix reaches, in pixels. AI mattes call pixels opaque that still carry background, so the fringe sits just inside the edge; this band is treated as uncertain by the amount of Colour From Inside and its colour comes from deeper in. 0 fixes only the soft pixels.

Default: 6

SmoothnessSlidersmoothness

How strongly the solved colours are held smooth across the edge. Lower keeps more of the plate's own colour variation in the edge; higher gives cleaner, flatter colour in hair and blur.

Default: 1

Colour SpreadSliderspread

How far past the matte the clean colour is carried, in pixels. Only filtering after premultiplication ever sees it; 32 is plenty.

Default: 32

QualitySliderquality

Solver sweeps per level. 2 is the published default; 4 for stubborn edges, at a cost in speed.

Default: 2

MixSlidermix

Blend between the input as given (0) and the fixed edges (1).

Default: 1

Tips

  • AI mattes tend to read a little wide or soft; Colour From Inside above 0.5 takes more of the edge colour from the solid core and hides the old background better.
  • Output > Estimated Background shows what the node thinks the subject was shot against, which is a quick way to see what it is taking out of the edge.
  • Use Output > Straight (clean colour + alpha) when you need to grade or filter the subject before premultiplying it yourself.
  • Raise Quality to 4 for a stubborn edge; it costs speed.
  • Mix compares the fix with the original edge; a Mask limits the fix to the problem area, such as the hair.

Good to know

  • The node runs no AI model and needs no graphics card.
  • Connect Plate only if it lines up exactly with the cut-out; a shifted plate puts the wrong background into the solve.
  • Set Input Is to match what you connect: a straight picture read as premultiplied (or the reverse) gives wrong edge colours.

Something unclear or missing? Write to [email protected].