Hidden Infrastructure Visualization and Interaction Techniques in Outdoor AR

Ryan Bane, Tobias Höllerer


This project aims to explore visualization techniques to display multiple occluded layers of a complex object. In addition, work will be done on interactive tools to work with the visualization.


Occlusion is one of the basic truths of vision: if one opaque object is in front of another, the second object is occluded from view and can't be seen. There are applications, however, in which a user might want to work around this problem. A construction worker might want to view some internal structure of a building from outside its walls, or a paramedic might need to see the location of a specific room inside a building.

For Superman, this task was easy. The script says he can see through just what he needs to, but we don't have this luxury. Instead, this research is aimed at designing a system to use augmented reality technology to display the infrastructure of complicated objects over the real world view of those objects. By using a 3d model of a building and a tracking system for the user, the model can be viewed at the same angle and in the same apparent position as the building.

Techniques for viewing the internals of the building build off of previous work done in the paper "Resolving Multiple Occluded Layers in Augmented Reality" by Mark A. Livingston, J. Edward Swan II, Joseph L. Gabbard, Tobias Höllerer, Deborah Hix, Simon J. Julier, Yohan Baillot and Dennis Brown.

Due to the complex nature of the infrastructure being visualized, interactive tools for working with the visualization are explored. These will include tools to focus in on specific regions of the building, tools to view cross sections of the infrastructure and tools to mark up the visualization.


Ryan Bane and Tobias Höllerer.
Interactive Tools for Virtual X-Ray Vision in Mobile Augmented Reality.
In Proc. ISMAR '04 (Intl Symp. on Mixed and Augmented Reality), Nov. 2--5, 2004, Arlington, VA.


 Interactive Tools for Virtual X-Ray Vision

Related Projects

Resolving Multiple Occluded Layers in Augmented Reality