When i launch pyspark using
pyspark --master yarn --packages com.databricks:spark-avro_2.10:2.0.1
and trying to import com.databricks.spark.avro._
I get error as follows :
ImportError: No module named com.databricks.spark.avro._
But when i try to launch spark-shell using packages and import it works fine. I want to program in python.
Please let me know where i am doing wrong.