Elie and I finally had some “free” time to go back to the multi-touch interface. We worked on the core library called Distal. Distal enables us to quickly put together a multi-touch GUI. It takes care of all the contact points [touchPoints], and their interaction with the GUI components [toggle button, dragable button, slider, dock, etc.]. We are also using ezGesture, which is a gesture recognition library for Processing recently released by Elie. So far, it is only used to interact with the docks containing the GUI ; one finger sliding from right to left in a specific area of the surface will make the dock appears.
Here are some visuals created using facecloth and a video showing the interaction/process.
Elie and I met early afternoon. We turned on the computers, plugged in the cam, wired the projector and finally lit the LEDs. While working on some code (multi-touch UI) we have on ‘track’, we set a goal to produce something by the end of the afternoon. Here, sur(ta)face came to life. sur(ta)face will be the name/repository for a collection of projects/experimentations using the multi-touch interface.
sur(ta)face > faceCloth is the first project/experimentation under this label. The original faceCloth, by Elie, is an exploration of the relationship between real and virtual control. Live video is mapped onto a digital cloth, which reacts to its environment in a realistic fashion. The user selects the desired image and then manipulates the display geometry in order to create rich visual compositions. I like to say that sur(ta)face > faceCloth came in to existence to fill one of Elie’s anxieties about his “pursuit to build a decent physical controller.” (see here).
Really…. I believe that our interest here is to work with video (must it be lived or pre recorded) as a malleable material. To distort and stretch time as well as splatter and freeze ‘alive’ pixels on a surface…. A performative surface.
On theses photos and video sur(ta)face > faceCloth runs using Lost Se03 Ep18 as video texture.
collectiveShadow is an interactive event that utilizes electronic shadows as raw materials and paints them into an architectural spatial form. The responsive environment explores the organic connection of human actions in an interactive collaborative environment by encouraging people to become both physical and social aspect of the participatory installation.
Project Team: Maxime Bergeron, Hugues Bruyère and Jason Safir.
In collectiveShadow, shadows immaterial form symbolizes a representation of distinct individuality. The interdependence of persons within the environment establishes a conscious and unconscious relation between one another by the means of diffused shadows, silhouettes. Representing the participant’s physical presence as data rather then tangible objects exposes a unique sense of body, self, and representation. The defamilarized social interaction collectiveShadow generates, creates a meaningful distinction between collective and individual shadows. The interacting of mere shadows investigates the individual’s conception of social identity and representation in a new light.
Presence [a.k.a Soft & Silky] is an interactive installation in which users are invited to engage, through motion and touch, with the tactile interface itself and other users. This installation is based on a simple, inexpensive, and scalable setup/technique enabling a range of movement from multi-touch to full body sensing on a double sided performative surface.
Presence project is particularly interested in the role of human effectual choreography in a physical environment and regard the importance of the reciprocal influence between multiple human interactions and architectural space.
With the use of the double-sided interactive wall, the Presence installation focuses on the idea of building an interface that calls upon humans to use, perform, and to engage in the poetic of space. In this space, the users have a direct experience with human interconnection – flesh to flesh and flesh to digital- creating a container for them to rethink their immutable monumentality of physical construction.
By removing the barriers to personal interactions and exploring the encounter of bodies and digital artifacts, Presence piece has taken step back toward to flesh to flesh communication and increase authentic wholistic interaction.
We believe that the concept of double sided interactive surface has a lot of potential as conceptual framework to explore and to use for triggering creativity and designing interesting interactions in fields such as performance, design, and public intervention/space.
Presence is the first, in a series of interactive pieces that will explore the concept of double sided interactive surface. Future technical work will include improving the computer vision processor to gain in accuracy and in tracking capabilities. In addition to these elements, we hope to implement a speech input and treatment with the intention of creating another layer of interactivity, and augment “The bandwidth of reality”[David Rokeby].
The choice of a soft and silky wall interface highlights the sensual and intimate experience for the users. This tactile quality is definitely an interface elements that we wish to explore further in the future. We observed that the flexibility/malleability of the surface had considerable impact on the users’ awareness of their interconnectivity with others touch. The elasticity of the membrane gives a 3D aspect to the interface surface and can be manipulated in more interesting ways than a hard 2D surface.
This is our [ Thierry Giles and myself ] first prototype in the field of multi-touch surfaces. As the well know project of Jeff Han, our interface uses the FTIR technique. Infrared light and computer vision are used to track users’ fingers motion/interaction with the surface.
