The RealSense Plugin provides support for the Intel RealSense SDK to Unreal Engine 4 developers by exposing features of the SDK to the Blueprints Visual Scripting System.
The plugin is architected as a set of components, each of which encapsulates a specific set of features. Is also makes use of an actor known as the RealSense Session Manager, which manages access to the RealSense SDK functions and maintains the master copy of all RealSense data. It is instantiated automatically when the first RealSense component is created and it allows for the use of multiple instances of the same RealSense component class, easing the process of sharing data between objects.
RealSense processing takes place on its own dedicated thread. On every tick of the game thread, the RealSense Session Manager polls for new RealSense data, and updates the RealSense components accordingly. This separation helps keep the game thread running quickly even when the RealSense thread is doing some heavy lifting.
For more details, you can read this article.
You can also check out these tutorial videos to get started using the RealSense plugin:
- RealSense Camera: F200 Front-Facing RealSense Camera OR R200 World-Facing RealSense Camera
- 4th Generation Intel(R) CPU or higher
- Intel(R) RealSense(TM) SDK R5
- Unreal Engine 4.8 or higher
- Windows 8.1 or 10
- Visual Studio 2013 or higher
- Camera Streams - Provides access to raw color and depth image buffers
- Scan 3D - Supports the scanning of faces and objects into 3D models
- Head Tracking - Provides data for the user's head position and rotation
- Scene Perception - Supports the scanning of small scenes into 3D models