ARAM is a C++ library for Augmented Reality on Medical Applications based on the extraction and identification of fiducial markers in real time. Based on Opencv, several technologies and approaches are combined to resolve the various problems related to the accuracy, robustness and occlusions. This library is provided under BSD license.
The library deals with the identification of markers in the presence of occlusions without sacrificing the accuracy of the pose camera estimation. These markers are generated using Hamming Code including error correction. In order to assess the accuracy of camera pose estimation, specifically when high levels of accuracy are required on medical field, it is mandatory to carry out a thorough analysis of the errors occurring in the whole process. Consequently, this library deals with the performance analysis of the 3D pose estimation. The suggested analysis focuses on the error estimation affecting the edge detection process.
The image processing software performs real-time 3D camera pose estimation. Firstly, the camera is carefully calibrated off-line. The extraction of edge information is the first fundamental processing step of the whole pose estimation procedure. The edge or contour point detection relies on well-known gradient-based methods. Following contour point extraction, chains of contour points are determined to form possibly closed contours. This latter are then reduced to a minimal number of vertices according to a specified tolerance. Finally, only the polygons containing the “good” marker are selected to compute the camera pose.
The processing steps of AR marker detection procedure can be summarized as follows:
- Calibration of the camera (offline),
- Segmentation of the acquired image and determination of contour point lists,
- Classification of the edge point lists (Edge linking),
- Polyline Simplification (Iterative Endpoint Fit)
- Image Sampling
- Pose estimation using the calibration parameters.
The library main classes are divided as following:
- aram::TagDetector<TagType,ROIDetector> : main aram class, used to detect markers in a frame.
- aram::IROIDetector : Interface for ROI Detection
- aram::EdgeDetector : currently best IROIDetector implementation
- aram::ITag : Interface for Tag validation
- aram::HammingTag : currently best ITag implementation
- aram::Intrinscis : store camera intrinsics parameters
- aram::Extrinsics : compute extrinsics parameters
- aram::ICoordinate : compute extrinsics parameters, using multi tracking method
- aram::Chessboard : currently best ICoordinate implementation, to deal with multi tracking
Doxygen documentation : http://altranresearchmedica.github.io/ARAM/
- OpenCv >= 2.4.8
- CMake >= 2.8
Tested with Microsoft Visual C++ (Express Edition 2010) and gcc 4.6.3
- Use CMake to generate the solution (.sln or makefile)
- Compile
To test the library, a video sample is provided with its camera calibration parameters (record.avi, camera_data.xml).
A test video is also available : https://github.com/AltranResearchMedica/ARAM/raw/master/samples/capture/multiTracking.avi
-
Check CMakeLists.txt ''' include_directories("C:/Tracking/ARAM/include") link_directories("C:/Tracking/ARAM/build/lib/Debug") '''
-
Use CMake to generate the solution (.sln or makefile)
-
Compile
-
Running: FirstApp circle corners of "good" marker.
-
Check CMakeLists.txt ''' include_directories("C:/Tracking/ARAM/include") link_directories("C:/Tracking/ARAM/build/lib/Debug") '''
-
Use CMake to generate the solution (.sln or makefile)
-
Compile
-
Running: MultiTracking use ARAM abilities to track a chessboard of marker.
This work is contributed by Alexandre KORNMANN in the framework of his final project assignment in Altran Research Medic@ under the responsibility of Dr. Abdelkrim BELHAOUA. Altran Research Medic@ is a research program aimed to integrate innovative augmented reality technologies in order to improve medical operating services.
Please report any bugs, comments about error and/or suggest enhancements to Abdelkrim BELHAOUA support-medica@altran.com