Part of my research project is to investigate the way humans perceive and remember their surroundings, from an architectural point of view. Results from the first set of experiment using 3D Virtual Environment (3DVE), see ArchiMemory XP 2.3, brought me some insights on what architectural features are most efficient at enhancing participants memory.
This is typically a top-down approach: by placing architectural elements (doors, windows, arches …) at specific locations inside a 3DVE, we can use them as triggers or symbols to construct a meaningful journey for the participant. For example, a door is used as a transition from one type of information to another; a window is used as a digression device to give a hint on something else without taking you away from the main subject.
Lets look through that window, for a mo!
A few month ago, I had the opportunity to work on an important project about syrian’s prison with a special research group in Goldsmiths: Forensic Architecture (FA). I couldn’t say much until the official release of the website we worked on due to the secrecy of the mission. Now that Amnesty International has released the website, I am taking the opportunity to briefly explain the project in the light of my own research.
The purpose of this project is to make the public aware of the existence of torture prison in Syria where humans right are baffles everyday. No NGO or any journalist have ever been inside, we don’t have any document, picture or report on this prison. What we do have is a satellite view and a few ex-prisoners testimonies.
FA investigation started by doing long interviews of those witnesses. Based on their memories, an architect and a sound designer rebuild in real-time a 3D model of the prison. Because prisoners were blindfolded when arriving at the prison, most of their memories are based on sounds, movements and proprioception. Only after a few weeks, they got to their main cell, they were able to see the walls and the other people faces. Even though, sounds were a big part of their memories, my job was to focus on the visuals including 3D models, lights and textures. I will explain more about this in a separate post.
Back to the main room.
Working on this project gave me the opportunity to understand my research topic from a bottom-up approach. In this case, memories are already in participant’s minds. They are vivid and strongly attach to all sort of emotions and perceptions due to the high stress environment where they happend. In a opposite direction as my previous method, here the process was to extract and rebuild those spaces from memory.
Those interviews were a constant demonstration of how memory works. The further we got in the interviews, the more we realised that memory is triggered by details like objects, architectural elements or colors. Being in a cell with no window or arche, those triggers can take very different shapes. It can be a water pipe with his specific sound, re-purposed as a communication device or a hatch in the door through which the food was coming.
Before closing the door.
Even though those two methodologies are very different by essence, one being to enhance memory, the other being to retrieve information from existing memories, they have a lot of common ground. From a cognitive psychology point of view, the main factor activating those memories is “trigger”. Either we find them by telling the stories we remember and go in as much details as we can, or we place those triggers along a new journey to create that story.
To have a hint of those prisoners memory, visit the website and explore the 360 panoramas (more about this in next post) here: Saydnaya Project
Smoothly organized event, with drinks and nibbles, Vitamin Clinic was exploring our evolving relationship between our physical and virtual/digital world.
Artwork, 3D printing, Virtual Reality and Augmented Reality installations and devices were available to challenge the way we perceive and interact with our environment and the digital realm. Here are just a few of the company demonstrating their expertise:
Drawandcode was presenting a maze game using a mixed of AR and VR to make a very social interaction.
Phygital is a pretty exciting company showing different setup for VR and AR: VR chair for the roler coaster experience using Oculus Rift, a huge touch screen showing many of their different interactive installations.
Recall of my first experience with the HTC Vive:
During the evening, I had the opportunity to try the HTC Vive with different applications. Upstairs was a relax setting in a corner of the room. A laptop on a coffee table, a couple of chaps sitting in a sofa as spectators, two cameras on their tripot opposite to each other four meters apart.
I placed the headset over my eyes and got the two controllers in my hands. Suddenly, I find myself with a sword in my right hand. Really, moving the sword in the air, to the right, to the left. Then, I took a couple of step forward and started to cut those fruits falling from no where into pieces, not the bombs! Fun!
The second experience with the same settings, transported me on a roof in a futuristic city under drone attack. With a shield in my left hand to protect myself from the drones’ strikes, I was able to choose between different energy field to shoot at them with the gun in my right hand.
Using whole body to move around to avoid being hit and shooting at the same time in all directions, this was full on. A very immersive experience even though, that is not why I am excited by Virtual Reality.
The best experience of the evening with the HTC Vive was the Tilt Brush one. This happened downstairs with more space dedicated between the two cameras. Again, headset on, controllers in the hands, although this time I got in a very different environment: a dark neutral background and a define round surface to walk on. My left arm was equipped with a bulky futuristic device from which I was able to choose between different colors, tools like paintbrushes and sizes. The brush I choose extended my right hand. I started by drawing three feet, then a table top, filled it in. I had to turn around the table to make the fourth feet. Then I painted leaves on the table, stacked some more, tried another tool and started to sculpt over very bright and colorful shapes of all type. Liberating! No more restriction of the page or the screen. I was creating something with no constraints. It can be small in front of you in the air or on a stand, or it can be big all around you.
The only thing that reminded me the physical world was the bunch of cable hanging from my head to the powerful computer running the software. Otherwise, that was the most immersive and mind blowing VR experience so far. By creating my own environment in real-time, the feeling of freedom and creativity got me in a flow in a snap.
Even from the outside, looking at someone exercising his creativity using the Tilt Brush is fascinating. You can see the person moving around, doing big arm movements, then on the screen appears the painting-sculpture.