https://www.databricks.com/research/apache-spark-a-unified-engine-for-big-data-processing
Apache Spark: Unified Big Data Engine | Databricks
Research Paper: Read about how as data sizes have outpaced single machines, users have needed new systems to scale out computations to multiple nodes.
big data engineapache sparkunifieddatabricks