Spark DataHub

Spark Data Hub for Analytics

Apache Spark is an unified data analytics engine for large scale data processing. It is widely used for both batch and streaming data processing. Spark also provides many high level operators that can be leveraged from Scala, Python as well as from SQL.

Spark can run standalone but it really scales well when its run on a cluster. The cluster can run standalone, with Hadoop or Kubernetes on-premise and on the cloud

Spark also provides libraries which can be used for Machine Learning, Graph processing, Stream processing as well as SQL processing.