SPARK & Databricks

Apache Spark & Databricks

---

Apache Spark™ is a fast and general engine for large-scale data processing.Run programs up to 100x faster than Hadoop MapReduce in memory, or 10x faster on disk.Write applications quickly in Java, Scala, Python, R.Combine SQL, streaming, and complex analytics.Spark runs on Hadoop, Mesos, standalone, or in the cloud. It can access diverse data sources including HDFS, Cassandra, HBase, and S3.

Building a Recommendation Engine

* Collaborative filtering for recommendations with Spark
* Loading and exploring the sample data set with Spark
* Using Spark MLlib's Alternating Least Squares algorithm to make movie recommendations
* Testing the results of the recommendations

---