• January 28, 2021, 01:35:32 PM

Login with username, password and session length

« Light of Beauty - Mandelbrot Set Zoom vs Julia Set | You Got Something - In Memory Of JJ Cale »
Pages: [1]

Author Topic: (Kalles Fraktaler) Neural Style Transfer enhanced Mandelbrot zoom  (Read 554 times)

0 Members and 1 Guest are viewing this topic.

Offline schizo

  • Fractal Friend
  • **
  • Posts: 13
    • Psykick
(Kalles Fraktaler) Neural Style Transfer enhanced Mandelbrot zoom
« on: September 27, 2020, 09:49:09 PM »
Hello fractal friends,

for a long time I want to apply neural style transfer to a fractal animation. I found a script that does fast neural style transfer and so it was possible to render a FullHD style transfer effect.
Base animation was rendered in 4K with Kalles Fraktaler.
This was my first experiment and I think I will dive deeper into neural style transfer fractal animations.


Enjoy!

Linkback: https://fractalforums.org/fractal-movie-gallery/19/neural-style-transfer-enhanced-mandelbrot-zoom/3789/
Logged

Offline aeroz

  • Fractal Freshman
  • *
  • Posts: 1
Re: Neural Style Transfer enhanced Mandelbrot zoom
« Reply #1 on: December 13, 2020, 10:35:14 AM »
Very cool, thanks for sharing!

Have you thought about whether there is an algorithm to make the output "zoom consistent" (so the artifacts created by the neural net scale with the zoom as opposed to staying the same size in black areas). I feel like it would make it more pleasant.

Probably not easy to achieve with pure neural networks but maybe it could be done by calculating a single high-resolution output and zooming on that and somehow gradually blending it with a next zoomed in layer.
Logged

Offline schizo

  • Fractal Friend
  • **
  • Posts: 13
    • Psykick
Re: Neural Style Transfer enhanced Mandelbrot zoom
« Reply #2 on: December 13, 2020, 09:48:23 PM »
Yeah, I use that zoom+mix trick at a still unreleased deep dream animation of such Mandelbrot zooms. Worked quite well after finding the right zoom parameter. I couldn't use that trick here at the style transfer version as I have used a prewritten style transfer script where I have less experience and so less control. This script also renders the images in a random order. Really need to get style transfer running on my local machine, so I can dig deeper in the code.
Logged

Offline Tas_mania

  • Fractal Feline
  • **
  • Posts: 163
    • West Tamar Talk
Re: Neural Style Transfer enhanced Mandelbrot zoom
« Reply #3 on: December 13, 2020, 10:09:25 PM »
It works but whats the point? Applying a style transfer to something that is already 100% mathematical equation is similar to introducing another fractal into another slot.

I suspect you are looking for video effects applied to fractal animations. I can recommend a free version of davinci resolve or similar. Effects like wind, waves, vortex's etc are easy to do in good video editors.  :-/
Logged

Offline schizo

  • Fractal Friend
  • **
  • Posts: 13
    • Psykick
Re: Neural Style Transfer enhanced Mandelbrot zoom
« Reply #4 on: December 13, 2020, 10:41:40 PM »
I want to use style transfer simply as postprocessing to already existing animations (fractals and other stuff).
But...
  • not os easy to use under Windows compared to Linux
  • standard style transfer is much slower than deep dream, so you need a good graphic card
  • fast style transfer is faster but quality not so good (missing the fine details)

But thanks for the davinci resolve hint. Will check it out as other effects are also welcome.
Logged

Offline Tas_mania

  • Fractal Feline
  • **
  • Posts: 163
    • West Tamar Talk
Re: Neural Style Transfer enhanced Mandelbrot zoom
« Reply #5 on: December 14, 2020, 09:11:36 AM »
His schizo.
Your fractal zoom and audio is very good. In a way the neural style transfer makes the zoom more '3d'. It's subjective, but I see a lot of fractals here are '2d'. I use Mandelbulber which makes 3d fractals. At least I think they are 3d.

I did set-up neural style on ubuntu but I could only get it to do static images. Video style transfer was too hard but I was disappointed with the results on still images.

I think it would be interesting to use a video stream to neural style transfer another video stream.  :thumbs:
Logged

Offline schizo

  • Fractal Friend
  • **
  • Posts: 13
    • Psykick
Re: Neural Style Transfer enhanced Mandelbrot zoom
« Reply #6 on: December 22, 2020, 09:31:14 PM »
Hey Tas_mania,

in the past I also mostly did 3D fractal animations using Mandelbulb 3D - even 360° VR stuff. This was one of my first 2D fractal animation made with Kalles Fraktaler  :)

Well with style transfer I have already much fun and cool results creating still images. So I think animation stuff could be better (more details) and I will continue to work on it.
If you want to check where my target line is, then you can find my big style transfer collection at facebook - mostly styled using other fractals:
https://www.facebook.com/pg/PsychedelicDeepStyleTripArt/photos/

A good example of a styled fractal is this one:
https://www.facebook.com/PsychedelicDeepStyleTripArt/photos/505406670077113

Have a great Christmas time!
Logged
Pages: [1]
« Light of Beauty - Mandelbrot Set Zoom vs Julia Set | You Got Something - In Memory Of JJ Cale »

* Similar Topics

clip
A new style of fractal imagery using fractal neural style transfer

Started by iRyanBell on Fractal Image Gallery

3 Replies
619 Views 		Last post October 03, 2020, 10:50:39 PM
by Jimw338
clip
Neural Style Transfer with Fractal Art

Started by reallybigname on Other Artforms

1 Replies
635 Views 		Last post July 20, 2019, 04:25:41 PM
by reallybigname
xx
"Time Span"

Started by cricke49 on Fractal Image Gallery

0 Replies
777 Views 		Last post August 02, 2018, 07:05:21 AM
by cricke49
xx
Birdie Style

Started by gannjondal on Fractal Image Gallery

1 Replies
783 Views 		Last post May 08, 2018, 02:39:37 PM
by who8mypnuts
xx
Buddhabrot-style Burning Ship [65536x24576]

Started by programagor on Fractal Image Gallery

12 Replies
1189 Views 		Last post October 10, 2018, 02:12:39 AM
by 3DickUlus