Pilot-SparkΒΆ

Pilot-Spark allows development of Apache Spark based applications/workflows on Scientific clusters using Pilot-API, by abstracting the details of managing the Spark cluster from the application.