A-me: Augmented Memories





Author(s):




Exhibition:


SIGGRAPH Asia 2013: Art Gallery

Category:


Paper

Abstract/Summary/Introduction:

A-me is a fictitious memory-evoking apparatus at the intersection of science, art and technology. The system enables users to experience other people’s memories as well as store their own by interacting with a volumetric representation (MR) of a human brain. The user retrieves or stores memories (audio traces) by pointing and clicking at precise voxels locations. Triggered by their exploratory action, a story is slowly revealed and recomposed in the form of whispering voices revealing intimate stories. A-me it’s a public receptacle for private memories, thus exploring the possibility of a collective physical brain.

The installation introduces an original optical see-through AR setup for neuronavigation capable of overlaying a volume rendered MR scan onto a physical dummy head. Implementing such a system also forced us to address technical questions on quality assessment of AR systems for brain visualization.

[View PDF]

References:

BEAULIEU, J.A. 2000. The Space Inside the Skull.

BIMBER, O. AND RASKAR, R. 2005. Spatial augmented reality. A K Peters Ltd.

BJÖRK, J. 2010. Evaluation of a Holographic 3D Display.

CASARES, A.B. 1974. L’invention de Morel. DONALD, M. 1991. Origins of the Modern Mind. Harvard University Press.

DRASCIC, D. AND MILGRAM, P. 1996. Perceptual issues in augmented reality. Proceedings-Spie The International Society For Optical Engineering, 123–134. GATEWAYS TO THE MIND. 1958. Gateways to the Mind.

KALKOFEN, D., TATZGERN, M., AND SCHMALSTIEG, D. 2009. Explosion Diagrams in Augmented Reality. 71–78. KAUFMAN, A. AND MUELLER, K. 2005. Overview of volume rendering. The visualization handbook, 127–174.

KLANTEN, R., EHMANN, S., AND FEIREISS, L. 2011. A Touch of Code. Die Gestalten Verlag.

KURZWEIL, R. 2006. The Singularity Is Near. Penguin.

MENDEZ, E. AND SCHMALSTIEG, D. 2009. Importance masks for revealing occluded objects in augmented reality. Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology, 247–248.

NISHIMOTO, S., VU, A.T., NASELARIS, T., BENJAMINI, Y., YU, B., AND GALLANT, J.L. 2011. Reconstructing Visual Experiences from Brain Activity Evoked by Natural Movies. Current Biology 21, 19, 1641–1646.

PUIG, J., PERKIS, A., LINDSETH, F., AND EBRAHIMI, T. 2012. Towards an Efficient Methodology for Evaluation of Quality of Experience in Augmented Reality. Proc. of Quality of Multimedia Experience (QoMEX). IEEE.

YATES, F.A. 1966. The Art of Memory. Yates.

YOU, J., REITER, U., HANNUKSELA, M.M., GABBOUJ, M., AND PERKIS, A. 2010. Perceptual-based quality assessment for audio–visual services: A survey. Signal Processing: Image Communication 25, 7, 482–501.