Hi Team, I am trying to load pyspark shell with packages options on my Cloudera VM using the below command.
pyspark --packages com.databricks:spark-avro_2.10:2.0.1
I am getting the “UNRESOLVED DEPENDENCIES” error while loading the pyspark shell. I have searched the forum for similar issues, I have found some questions related, however those are not the same issues as mine.
While trying on Itversity labs I am able to launch the shell with packages successfully. Could you please help me resolve this issue. In case I need to provide you any additional info to troubleshoot this issue, please let me know. I have installed CDH 5 distribution on Virtual box.