Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources
@vishwanath You will get this message when there are not sufficient resources available in cluster.
For example, if you have a cluster with 4 cpu cores
and 15GB memory
available and if you try to launch the job by requesting around 6 cpu
or more than 15GB
memory then you will see this error.
Can you provide your cluster details like available cpu
and memory
? And also can you paste your spark-submit
command here?