Apache Spark is fast becoming the established platform for developing big data applications both in batch processing and, more recently, processing real-time data with the use of Spark streaming. For