At this stage it was really important that I began experimenting with different ideas and technologies etc. I decided that I would start by creating something using Modul8 to create a ‘sensory overload’ experience focusing on sight and sound. Using an extract from Zoella’s story I started collecting stock videos – I didn’t initially want film my own footage, at this point its volume and variety over quality.
“Concept Development: Real-time video mixing” blog post begins to explain how versatile the Modul8 software can be. In this example I have used four video’s (without sound) and layered them, creating different compositions and applying affects to make it more visually stimulating. Initially I wanted to use a Wacom tablet as the midi controller but this proved to be challenging. I discover it isn’t as simple as just plugging in a keyboard and mapping it. You have to install a specific program, this software was created by Steve Gibson (my experiential design professor at Northumbria University) and Justin Love. The files were 9 years old and unfortuntely the hyperlinks were broken. I was able to find an alternative software and was unable to install it and get it working correctly (alongside email Modul8 who weren’t exactly helpful and was unable to offer a solution). I had wasted a lot of time and was no further on than when I started so for the time being I decided to use my laptop keyboard as the midi controller.
It became very clear, very quickly that using a keyboard as a midi controller is not functional at all; it’s clunky, difficult to remember what keys control what, transitions are not fluid and smooth and the overall experience is atrocious! As you can see in the image below I have highlighted some knobs – these knobs allow you to transition through the effect smoothly and seamlessly. Using a laptop keyboard as the controller eliminates the transition meaning you can only have two states either on or off. Everything inbetween is lost. Never the less it does help to illustrate the idea and show what can be achieved. If I was going to take this project further I would consider using motion sensor this would make the experience engaging, enjoyable and memorable.
02. Paint Module
The Paint module allows the user to mix a live graphical experience with live videos or existing media. It works by applying pressure to the tablets interface using the pen, users can draw either a dot, shape or line on the currently selected layer or create a new layer specifically for the paint. One of the most interesting features about the module is how it supports pressure sensitivity allowing for a more natural and expressive line. There are numerous ways this would be utilised – which I will explore later.
The paint layer can have multiple modules and be used on different layers.
There are lots of different ways that this feature could be utilised. I like the idea of potentially using this feature alongside record for animation (see below) to document my audiences experience and how the video insulation makes them feel.
03. Recording for animation overlay
An extension to the Paint feature is that Model8 allows users to record and save a session to QuickTime movie. This feature can be utilised in multiple different ways and is a useful way yo play back performances for installations or even for creating quick visualisations for your chosen production environment.
As previously mentioned the can be used as a tool for primary research to document a users emotions and ideas towards the video installation. Does it create the desired affect?
The Modul8 master record feature records everything that happens in the Modul8 interface. It records the exact movements made at any given time after the record button is pressed. This is a really great feature that allows the user to record and document there installation.
This experimentation has allowed me to learn features on Modul8 I didn’t know existed. It has given me the tools to create something that’s the capacity to be much more engaging and interactive. That being said the content I have used feels dull partly due to the videos being in grey scale but also the content. I don’t really feel as though it’s an overload of the senses. In my next iteration sound and colour will play a key component in helping to enhance the feeling of overload and confusion. Furthermore, I think focusing on a specific experience can be a tricky, in my example I focused of public transport. This has meant that the message has become lost in translation. I think it would be more affective and a more accurate portrayal of Social Anxiety Disorder if I used a wide array of different triggers and examples, showing how it affects every single aspect of life rather than individual actions.
Katin, I. Modul8: User Manual. garageCUBE, Boris Edelstein. Retrieved from http://www.modul8.ch/documentation/manual/modul8_manual_EN.pdf
Sugg, Z. (2012). Dealing with Panic Attacks and Anxiety. Retrieved from https://www.youtube.com/watch?v=7-iNOFD27G4