Driver Program on Spark


#1

Hello,

May someone please explain what is the driver program on Spark? How does it differ from the cluster with all the worker nodes?

Many thanks,
Patrick


#2

A Spark driver is an application that creates a SparkContext for executing one or more jobs in the Spark cluster. It states the transformations and actions on RDDs of data

Watch this video for more understanding