Skip to content

hsnk/ARAM

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

16 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

ARAM: Augmented Reality for Application on Medical field library

ARAM is a C++ library for Augmented Reality on Medical Applications based on the extraction and identification of fiducial markers in real time. Based on Opencv, several technologies and approaches are combined to resolve the various problems related to the accuracy, robustness and occlusions. This library is provided under BSD license.

Introduction

The library deals with the identification of markers in the presence of occlusions without sacrificing the accuracy of the pose camera estimation. These markers are generated using Hamming Code including error correction. In order to assess the accuracy of camera pose estimation, specifically when high levels of accuracy are required on medical field, it is mandatory to carry out a thorough analysis of the errors occurring in the whole process. Consequently, this library deals with the performance analysis of the 3D pose estimation. The suggested analysis focuses on the error estimation affecting the edge detection process.

Mono tracking example Mono tracking example

Description

The image processing software performs real-time 3D camera pose estimation. Firstly, the camera is carefully calibrated off-line. The extraction of edge information is the first fundamental processing step of the whole pose estimation procedure. The edge or contour point detection relies on well-known gradient-based methods. Following contour point extraction, chains of contour points are determined to form possibly closed contours. This latter are then reduced to a minimal number of vertices according to a specified tolerance. Finally, only the polygons containing the “good” marker are selected to compute the camera pose.

The processing steps of AR marker detection procedure can be summarized as follows:

  • Calibration of the camera (offline),
  • Segmentation of the acquired image and determination of contour point lists,
  • Classification of the edge point lists (Edge linking),
  • Polyline Simplification (Iterative Endpoint Fit)
  • Image Sampling
  • Pose estimation using the calibration parameters.

Main class

The library main classes are divided as following:

  • aram::TagDetector<TagType,ROIDetector> : main aram class, used to detect markers in a frame.
  • aram::IROIDetector : Interface for ROI Detection
  • aram::EdgeDetector : currently best IROIDetector implementation
  • aram::ITag : Interface for Tag validation
  • aram::HammingTag : currently best ITag implementation
  • aram::Intrinscis : store camera intrinsics parameters
  • aram::Extrinsics : compute extrinsics parameters
  • aram::ICoordinate : compute extrinsics parameters, using multi tracking method
  • aram::Chessboard : currently best ICoordinate implementation, to deal with multi tracking

Multi tracking example Multi tracking example

Doxygen documentation : http://altranresearchmedica.github.io/ARAM/

Compile

Requirements

  • OpenCv >= 2.4.8
  • CMake >= 2.8

Compiler

Tested with Microsoft Visual C++ (Express Edition 2010) and gcc 4.6.3

  • Use CMake to generate the solution (.sln or makefile)
  • Compile

Samples

To test the library, a video sample is provided with its camera calibration parameters (record.avi, camera_data.xml).

A test video is also available : https://github.com/AltranResearchMedica/ARAM/raw/master/samples/capture/multiTracking.avi

FirstApp

  • Check CMakeLists.txt ''' include_directories("C:/Tracking/ARAM/include") link_directories("C:/Tracking/ARAM/build/lib/Debug") '''

  • Use CMake to generate the solution (.sln or makefile)

  • Compile

  • Running: FirstApp circle corners of "good" marker.

MultiTracking

  • Check CMakeLists.txt ''' include_directories("C:/Tracking/ARAM/include") link_directories("C:/Tracking/ARAM/build/lib/Debug") '''

  • Use CMake to generate the solution (.sln or makefile)

  • Compile

  • Running: MultiTracking use ARAM abilities to track a chessboard of marker.


Acknowledgment

This work is contributed by Alexandre KORNMANN in the framework of his final project assignment in Altran Research Medic@ under the responsibility of Dr. Abdelkrim BELHAOUA. Altran Research Medic@ is a research program aimed to integrate innovative augmented reality technologies in order to improve medical operating services.


Contact

Please report any bugs, comments about error and/or suggest enhancements to Abdelkrim BELHAOUA support-medica@altran.com

About

Augmented Reality for Application on Medical field library

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published