https://github.com/springnz/sparkplug
GitHub - springnz/sparkplug: A framework for creating composable and pluggable data processing...
A framework for creating composable and pluggable data processing pipelines using Apache Spark, and running them on a cluster. - springnz/sparkplug