MARS - A Mobile Augmented Reality System for Training Applications

Definition of the project:

Augmented Reality (AR) is an active research area with a variety of applications. It refers to techniques to enhance real images with computer-generated information (see picture). At the University of Augsburg, the research project Triokulus deals specifically with the development of small, embedded systems that can perform the necessary, complex image processing steps.

The aim of this project work is the development of a mobile AR system, which can be used for training purposes. It should optically identify development boards and devices, such as those used for example in our laboratory, and label them appropriately.

A Panda Board with an OMAP4 Chip serves as a hardware platform. Such chips are also found in many cell phones and smartphones - they contain complete systems with one or more processor cores (ARM) and other modules, such as signal processors (DSP), graphics accelerators or in-/output modules. 2-3 FPGA based intelligent cameras stand by the OMAP chip. They can perform the recognition of distinctive image features autonomously, thus relieving the main system. A system (FPGA logic + software) for recognition and pose estimation of objects has already been developed by us within the Triokulus project and can be used.