Initial job has not accepted any resources; check your cluster UI to ensure that workers are registered and have sufficient resources
@vishwanath You will get this message when there are not sufficient resources available in cluster.
For example, if you have a cluster with
4 cpu cores and
15GB memory available and if you try to launch the job by requesting around
6 cpu or more than
15GB memory then you will see this error.
Can you provide your cluster details like available
memory ? And also can you paste your
spark-submit command here?