The goal of this project is to explore high-level data-flow and DSL programming techniques for implementing SKA SDP pipelines (or programs something sufficiently close to it).
This repository is structured into several milestones, each with different priorities as we learn more about the desirable characteristics of the pipeline implementation. They often share code, but will vary significantly in functionality.
-
MS1: First experiments with Erlang-inspired actor languages
-
MS2: DNA library for distribution and resource allocation, first attempts at gridding using Halide and C++ / Cuda kernels.
-
MS3: Systematic performance comparison of gridding implementation, introduction of profiling
-
MS4: First complete imaging pipeline, abstraction over kernels
Our libraries for data flow and actor interfaces are documented on the github wiki of this repository