Getting error message in cloudera quick start vm for pyspark

#1

Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources

0 Likes

#2

@vishwanath You will get this message when there are not sufficient resources available in cluster.

For example, if you have a cluster with 4 cpu cores and 15GB memory available and if you try to launch the job by requesting around 6 cpu or more than 15GB memory then you will see this error.

Can you provide your cluster details like available cpu and memory ? And also can you paste your spark-submit command here?

0 Likes