Spark RDD

Resilient Distributed Datasets

Resilient Distributed Datasets (RDD) is a fundamental data structure of Spark.

There are two ways to create RDDs − parallelizing an existing collection in your driver program, or referencing a dataset in an external storage system, such as a shared file system, HDFS, HBase, or any data source offering a Hadoop Input Format.

Iterative Operations on MapReduce

Interactive Operations on MapReduce

Iterative Operations on Spark RDD

Interactive Operations on Spark RDD