Apache Spark

Apache Spark is an open-source cluster-computing framework. Spark includes several libraries: SQL, DataFrames, MLlib, GraphX and Spark Streaming. You can run it on Hadoop, Kubernetes, standalone, Mesos or in the cloud.