(org.apache.hadoop.security.AccessControlException

#1

Hi team,

I am getting below error while running spark-submit command:-

“Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.security.AccessControlException): Permission denied: user=moumita12, access=WRITE, inode=”/home/moumita12/real_time_analytics_dashboard/tgtData/cnt-1559349300000/_temporary/0":hdfs:hdfs:drwxr-xr-x"

My spark submit command is:-

spark-submit
–conf spark.ui.port=12376
–master yarn
–class real_time_analytics_dashboard
–packages org.apache.spark:spark-streaming-kafka_2.10:1.6.3
–jars “/usr/hdp/2.6.5.0-292/kafka/libs/spark-streaming-kafka_2.10-1.6.3.jar,/usr/hdp/2.5.0.0-1245/kafka/libs/kafka_2.10-0.8.2.1.jar,/usr/hdp/2.6.5.0-292/kafka/libs/metrics-core-2.2.0.jar”
/home/moumita12/real_time_analytics_dashboard/target/scala-2.10/realtime-dashboard_2.10-1.0.jar yarn-client

Please help!

0 Likes

#2

Please use the path - /user/moumita12 and try.

0 Likes