Ganesh - Career transition from BI/DW consultant to Big Data Solutions Architect

High level plan

  • Learn setting up the cluster
  • Understand different distributions - Cloudera, Hortonworks, AWS EMR etc
  • Identify data set and do a PoC
  • Learn Sqoop, Hive, Spark with Scala/Python
  • Understand tools such as Kafka, Flume etc
  • Generate reports using Tableau

Server cost: 135$ per month (64 GB dedicated server from OVH)
Distribute time between cluster set up and PoC
2 to 3 hours live interaction per week