Iam not able to launch spark shell using console.Below is the error:
@itversity, multiple versions of spark are installed but the SPARK_MAJOR_VERSION is not set. What might have been the issue?
Hmm, it is new issue. Let me see what is going on.
Major version is not the main issue. Issue is with memory over allocation. We need to revisit spark memory settings.
@itversity, also with the log messages being generated trying to connect to different spark.ui.port, is there a fix for that from the back end or should we run the command to reduce the log messages.