HDPCD - Concepts and Architecture


Originally published at: http://www.itversity.com/topic/hdpcd-concepts-and-architecture/

Introduction As part of this series we will talk about Architecture Cluster Modes – Overview Different modules in Spark Accessing Documentation Important concepts Architecture Overview We will see the architecture of the Spark Driver Program Cluster Manager Worker Node Executor Architecture Diagram Cluster Modes – Overview Following are the different cluster modes Local Mode YARN…