Improving flow of EbSynth

In the example of the previous article, there were still some annoying vibrations that have to be corrected by hand, this can be very annoying if the animation is long.

Con este script se puede mejorar aún más la calidad de transición entre cuadros y en el caso de que sea necesario generar nuevos cuadros de transición, agregando a la técnica un

With this script, the quality of the transition between frames can be further improved and in the event that it is necessary to generate new transition frames, adding a bilateral filter, deepflow y color_flow_map.

The bilateral filter helps EbSynth not mix colors or grays with each other, generating subtle transitions or large contrasts depending on the image in question.

bilateral_filter in.png bl.png 0.01 128 16

Deepflow is a technique to see the difference between two images by generating a FLO file that is almost capable of recreating one image from the other.

deepflow2 bl1.png bl2.png map.flo -d .4 -iter 5

DeepFlow seen with DeepMatching

Color flow map converts this FLO file into a gradient map which helps EbSynth create a smoother image with less skipping and “noise”.

color_flow_map map.flo map.png 0

warp degrade

We can also recreate the image using Image Magick, but it has very low quality.

convert in.png map.png -fx 'p{(v.r*w),(v.g*h)}' result.png

EbSynth, being a neural network, is able to use the gradient as a reference to put together the new image and the bilateral image as an aid for the parts it does not know.

ebsynth -uniformity 0 -style style.png -guide bl1.png bl2.png -weight 500 -guide map.png map1.png -weight 1000 -output result.png

Result

View script

Taking advantage of this we can generate a bit more extreme example like this winter version.

nena versión invernal

Posted in Experiment, Tutorials and tagged , , , , , .