Spark-shell issue

Iam not able to launch spark shell using console.Below is the error:

@itversity, multiple versions of spark are installed but the SPARK_MAJOR_VERSION is not set. What might have been the issue?

Hmm, it is new issue. Let me see what is going on.

1 Like

Major version is not the main issue. Issue is with memory over allocation. We need to revisit spark memory settings.

1 Like

@itversity, also with the log messages being generated trying to connect to different spark.ui.port, is there a fix for that from the back end or should we run the command to reduce the log messages.