# Spark DataHub ## Spark Data Hub for Analytics Apache Spark is an unified data analytics engine for large scale data processing. It is widely used for both batch and streaming data processing. Spark also provides many high level operators that can be leveraged from Scala, Python as well as from SQL. Spark can run standalone but it really scales well when its run on a cluster. The cluster can run standalone, with Hadoop or Kubernetes on-premise and on the cloud Spark also provides libraries which can be used for Machine Learning, Graph processing, Stream processing as well as SQL processing. --- # Agent Instructions: Querying This Documentation If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on the current page URL with the `ask` query parameter: ``` GET https://docs.invariant.io/data-science/apache-spark.md?ask= ``` The question should be specific, self-contained, and written in natural language. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.