When i tried to open the spark-shell i am getting the response like mentioned below

apache-spark

#1

i am getting the blank screen with the field details.

18/09/29 10:35:12 INFO Client: Application report for application_1533622723243_29009 (state: ACCEPTED)

image


#2

@loganathan,

It is not a problem. Ignore them.
Use sc.setLogLevel("ERROR") to stop them.


#3

Hi,

I am also getting the same error and not able to login to the screen and type the below command.
sc.setLogLevel(“ERROR”).

Please tell us how to login to pyspark command window…


#4

Hi ,

It seems the Spark Context object is not being initialized when a pyspark shell is launched. I tried setting the log level to ERROR but get the following error:

18/09/29 22:03:30 INFO Client: Application report for application_1533622723243_29301 (state: ACCEPTED)
sc.setLogLevel(“ERROR”)18/09/29 22:03:31 INFO Client: Application report for application_1533622723243_29301 (state: ACCEPTED)
Traceback (most recent call last):
File “”, line 1, in
NameError: name ‘sc’ is not defined

Regards,
Ivan


#5

Its working fine. Launch pyspark as below command:

pyspark --master yarn --conf spark.ui.port=12888


#6

thanks i think the issue resolved now , it looks good


#7