Please find below my reply:
Does Spark2-shell was available?
I used python with spark 1.6 so I am not sure if it is available.
how did you handle avro ? did u import using com.databricks.spark.avro._
Avro package is already imported in the cluster.
any streaming/flume questions were there?
any spark-submit/conf question were there?
whether hive context was enabled by default? so that u can directly use
codec compress lib was available?? so that you can directly use the io.compress libs in option and sqoop import?
Bookmark Share Flag Reply Premium Content
You will receive notifications because you created this topic.
Topic Category Replies Views Activity
Error while using toDF() function to convert RDD to DataFrame 3
8 2.1k Jun '17
Find the following from the given products.csv (for those who are preparing for CCA175) 5
apache-spark bigdata scala
10 1.3k Feb '17
No able to use hostname
0 3 2h
PySpark app running in yarn driver mode without utilizing the cluster capacity
0 8 6h
Streaming applications using Kafka and Scala
1 8 8h
There are 2 unread and 10 new topics remaining, or browse other topics in