Control arguments using spark-submit

Originally published at: http://www.itversity.com/topic/control-arguments-using-spark-submit/

Let us see control arguments that can be used with spark-submit We will use lab to demonstrate the usage of control arguments effectively Let us review the capacity of the cluster workernodes – 5 Memory – 32 GB each node (total 160 GB) YARN nodemanager memory = 24 GB each node(total 120 GB) Total cores…