Today we are going to look at two vastly different AI powered art generation tools, Luminar and NVIDIA GauGAN Beta. Luminar is a powerful art processing tool, a cross between Photoshop and Lightroom, but AI assisted. We recently covered Luminar hands-on including how to use it with Affinity Photo here and it is currently (2021-01-05) in the final 24 hours of a Humble Bundle sale.
NVIDIA GauGAN on the other-hand is a web based application that is part of the NVIDIA AI Playground. GauGAN is described as:
GauGAN, named after post-Impressionist painter Paul Gauguin, creates photorealistic images from segmentation maps, which are labeled sketches that depict the layout of a scene.
Artists can use paintbrush and paint bucket tools to design their own landscapes with labels like river, rock and cloud. A style transfer algorithm allows creators to apply filters — changing a daytime scene to sunset, or a photorealistic image to a painting. Users can even upload their own filters to layer onto their masterpieces, or upload custom segmentation maps and landscape images as a foundation for their artwork
You can learn more about GauGAN here, while technical details of the algorithm in the open source implementation hosted on GitHub. You can try an already trained version of the algorithm in action here in your browser.
These are not unique examples in terms of machine learning or AI enhanced art creation tools. In early 2020 Unity acquired Artomatix, the creator of ArtEngine, an AI driven material creation tool. Another project that was recently featured on this site is Cascadeur, a physics based animation tool that uses machine learning to help with animations. DeepMotion Animate 3D is another recently featured machine learning based application, that takes simple 2D footage and makes a 3D rig and animation from the results.
The key thing in all of these tools thus far is they don’t seek to replace the artist, but augment them using deep or machine learning algorithms. You can check out NVIDIA GauGAN and Luminar in action in the video below. For a VERY limited time you can get Luminar on Humble Bundle here. [Expires 01/06! — GFS can receive a commission on Humble purchases]. So what do you say, are AI powered art tools the future?