Apache Flume and Kafka

Originally published at: http://www.itversity.com/lessons/apache-flume-and-kafka/

Introduction As part of this lesson we will see Apache Flume architecture Getting data from different sources Loading streaming data into HDFS Using Kafka as channel to load data into HDFS By the end of the course we will see how to extract data from web logs and store into HDFS using Flume and/or Kafka