Forster Art Complex
Ross Gallery: April 1 - 5, 2024 |
![gallery view: north wall](01%20gallery%201.jpg) |
![gallery view: east wall](02%20gallery%203.jpg) |
![gallery view: south wall](03%20gallery%202.jpg) |
![title card](04%20title.jpg) |
Over the summer, during my undergraduate research experience, I
learned humans do not understand what happens inside an artificial
neural network. Similar to humans, Al agents are presented with
data and analyze it to make informed decisions in future
situations. Yet, during this training and decision process, humans
are not fully aware of the inner workings of the Al agent. For my
senior conference Interaction, I want to explore using artificial
neural networks in my art.
I programmed a style transfer artificial neural network with the
help of a tutorial on TensorFlow (listed below). It uses a
pre-trained neural network that identifies edges on the original
pieces (essentially the important components) and trains a neural
network on another art piece received. The model then applies the
style of the art piece to the original piece while trying to avoid
distorting the main components. The output is the model's attempt
to apply the style to the original photo. I use photography,
watercolor, acrylic, and oil paintings to see what my model could
produce. I explored pattern recognition, color application,
switching inputs, and using Al as a tool for larger photos. My
ultimate goal is to show some interesting things Al can produce as
a collaborator. Below, I have highlighted certain elements of each
piece.
(All pieces are meant to be viewed from left to right.)
Tutorial:
https://www.tensorflow.org/tutorials/generative/style_transfer |
![2 small square watercolors, mostly blue, and the AI result](05%20watercolor%201.jpg)
Watercolor Experiment 1
Despite using a photo with the same color, it produced an odd
green, yellow color in the bottom right corner. |
![two small square watercolors and the AI result](06%20watercolor%202.jpg)
Watercolor Experiment 2
The Al recognized the linear pattern. You can see it emphasize
some of the faint lines of the original piece on the top. |
![landscape photo, small square watercolor in blue, and the resulting AI combination](07%20watercolor%203.jpg)
Watercolor Experiment 3
This piece is my first attempt at applying my Al to a larger
photo. It ultimately gave a blue tint to the photo and made the
photo look like it was on watercolor paper. |
![original watercolor: colorful hill with yellow sky](08%20watercolor%204a.jpg)
Watercolor Experiment 4 (1 of 2) |
![3 landscape photos and the AI results](09%20watercolor%204b.jpg)
Watercolor Experiment 4 (2 of 2)
I attempted to apply the pastel watercolor from the piece to
photos. Perhaps the green of the original photos or the lightness
of the watercolor caused the colors to come out unsaturated and
muddy. |
![TV displaying video of process](10%20TV.jpg)
(click image for link to video on YouTube) |
![square abstract painting of bright colors](11%20acrylic%20&%20oil%201a.jpg)
Acrylic and Oil Paint Experiment 1 (1 of 2) |
![3 landscape photos and AI results](12%20acrylic%20&%20oil%201b.jpg)
Acrylic and Oil Paint Experiment 1 (2 of 2)
The colors from the acrylic came out brighter than the watercolor. |
![oil painting that looks like a diagram of magnetic fields](13%20acrylic%20&%20oil%202a.jpg)
Acrylic and Oil Paint Experiment 2*Oil (1 of 2) |
![original landscape photo and several AI iterations](14%20acrylic%20&%20oil%202b.jpg)
Acrylic and Oil Paint Experiment 2 (2 of 2)
This transfer is another piece where the Al recognized a pattern.
You can see a white line, similar to the painting, form in the top
right branch of the photo. |
![oil painting of brain with flowers on round canvas](15%20acrylic%20&%20oil%203a.jpg)
Acrylic and Oil Paint Experiment 3*Oil (1 of 2) |
![2 AI versions with photo sources below each](16%20acrylic%20&%20oil%203b.jpg)
Acrylic and Oil Paint Experiment 3 (2 of 2)
This piece was a trial to see what would happen if I switched the
inputs. Surprisingly, a prominent pattern was still applied. |
![abstract painting, green blue and brown bands on square canvas](17%20acrylic%20&%20oil%204a.jpg)
Acrylic and Oil Paint Experiment 4 (1 of 3) |
![photo of Austin College Ida Center](18%20acrylic%20&%20oil%204b.jpg)
Acrylic and Oil Paint Experiment 4 (2 of 3) |
![digital print of AI results](19%20acrylic%20&%20oil%204c.jpg)
Acrylic and Oil Paint Experiment 4 (3 of 3)
I wanted to create a bigger photo, but the large amount of data
made this difficult. I finally settled on splitting the photo into
larger chunks and attempted to create a gradient effect, where the
style is applied heavily to the left side. (I did this by limiting
the amount of iterations the original photo went through the
artificial neural network.) |