I did follow the same command from course video it didnt work , only client mode was launched.
Use master in yarn-client
spark-shell –master yarn-client
Contact support. On the gw2 server it works.
It has a property in spark-defaults.xml that is spark.yarn.driver.memoryOverhead 384
And it works correctly if you want to investigate a bit I send you a link. But I think it’s a configuration issue of spark.yarn.driver.memoryOverhead
Thanks for the advise , will have a check with support.