Collaborative Art, Deep Learning, & an iPAD
For this interactive installation, one of my customized painting robot arms will invite volunteers to create a digital painting on an iPad (or if Apple has a larger format touchscreen in development, the larger touchscreen. See below.).
The robot will watch briefly, then paint a portrait of the volunteer combining inspiration from their painting, the robot's own artificially creative algorithms, and historic pieces of art.
To help audience better understand the robot's creative process, it will describe and display detailed visualizations of the algorithms that are being used, as they are being used.
Once complete, the portrait will be printed and given to the volunteer.
This installation will work at a number of venues including SXSW, Burning Man, arts and music festivals, and even at Apple Stores. As I am a Northern Virginia based artist, I would love to install this at your first Apple Store in Tysons Corner.
I am a painter, but my art is trying to capture my own creativity in algorithms.
My exploration of creativity and Art has been recognized by multiple organizations over the years including NPR, Google, The Barbican, Microsoft, Elastic, Intel, and NVIDIA. I recently gave a TEDx Talk on my art in Washington DC and was just named Top Technical Contributor to the international Robot Art 2017 competition. Exhibition history, awards, and several press write ups can also be seen at http://www.cloudpainter.com/press/.
I have been collaborating with my robots to make portraits for over twelve years. Database records indicate that we have probably painted over a thousand portraits though I don't have an exact count. While the style and process behind each creation has varied, they were all painted with a brush on canvas. Some of these portraits, most approximately 14"x18", can be seen above.
This installation will be debuting 3 of my 7th generation custom painting robots arms - the 6th gen version was recently awarded the top technical prize by Robot Art 2017, so imagine that these will be even cooler.
In the space, each 4' tall robot arm will have its own 12.9" iPad Pro open to a painting program. In view of robot but at safe distance, a second 12.9" iPad Pro will be set up with same program open. The installation consists of 3 of these 10'x10' stations in center of a 30'x30' space.
When people enter space they will see people painting on iPad Pros, and robots painting portraits of them using the same program. They will have option to join in and in turn get their portrait painted by a robot. When complete, and image of both artworks will be printed and given to the volunteer.
Am obsessed with where my own creativity comes from so I try to capture it in algorithms and teach it to robots. But this often upset people as the creativity behind my robots become uncanny. Viewers who don't like idea of creativity machines are not only unsettled, but also confused. It is not obvious if my robots are being truly creative, or if it is just a gimmick.
This interactive project attempts to make my robot's artificial creativity more relatable and transparent by letting people paint alongside them in a collaborative art exchange. As volunteers paint, the robot will look at them, their work in progress, then start a portrait of them in a style similar to their artwork. It doesn't matter if the human artwork is good, bad, or even abstract. The robot will use deep learning to find patterns in it and paint a portrait of its creator with those patterns.
Is the robot being creative, or just imitating, or is it a collaboration? Will be up to the audience to decide.
Philosophy Behind Installation
Creativity and especially Art are often thought of as exclusively human capabilities. While some other animals show signs of creativity, the general public has yet to accept anything as Art that was not created by a human.
I also used to believe that creativity and Art were exclusively human, but as the AI behind my robots grew in sophistication, my opinion started to change. While I believe Art is still uniquely human, I now think that machines are capable of near human levels of creativity due to the effectiveness of Deep Learning. For example, my past work has demonstrated that within the constraints of portraiture, machines can independently make most of the creative decisions made by an artist. They can even use Deep Learning to apply abstraction in unique and intentional ways. Is robot created portraiture Art? Not yet, but it looks exactly like Art and is probably the result of creativity.
In this installation volunteers will be making portraits of the robots, and the robots will be painting the volunteers in the style of their artwork.
Is the robot being creative, just imitating, or collaborating?
The robot paintings will have so much apparent creativity, that I am hoping it will convince some that it is in fact being creative. Related to this, I am hoping it encourages some to question whether their own portraits of the robot are being created by a process similar to the robots use of Deep Learning, and therefore creative, but not Art either.
The Creative Software
The software behind my robots use a variety of artificial intelligence and machine learning including Feedback Loops, OpenCV, Style Transfer, Convolutional Neural Nets, and Generative Adversarial Neural Nets. A brief overview of my art with the robot can be seen in the August 3rd, 2017 HBO Vice Interview below as well as in my TEDx Talk from last year. Details regarding some of the more recent innovations can be seen in the animation below them...
I am an artist based in Tysons Corner, just outside of D.C. This installation will work at a number of venues including SXSW, Burning Man, any of a number of conventions, and even at Apple Stores. Actually, I would love to install this at your Flagship Tysons Corner Apple Store.
Pindar Van Arman