How to launch Spark2?


#1

How to launch Spark2???


#2

/usr/hdp/current/spark2-client/bin/spark-shell --conf spark.ui.port=22325 --master yarn-client

 [nerellavinod@gw01 spark2-client]$ /usr/hdp/current/spark2-client/bin/spark-shell --conf spark.ui.port=22325 --master yarn-client
    Warning: Master yarn-client is deprecated since 2.0. Please use master "yarn" with specified deploy mode instead.
    Setting default log level to "WARN".
    To adjust logging level use sc.setLogLevel(newLevel).
    17/11/08 13:01:43 WARN SparkContext: Use an existing SparkContext, some configuration may not take effect.
    Spark context Web UI available at http://172.16.1.100:22325
    Spark context available as 'sc' (master = yarn, app id = application_1507687444776_8040).
    Spark session available as 'spark'.
    Welcome to
          ____              __
         / __/__  ___ _____/ /__
        _\ \/ _ \/ _ `/ __/  '_/
       /___/ .__/\_,_/_/ /_/\_\   version 2.0.0.2.5.0.0-1245
          /_/
             
    Using Scala version 2.11.8 (Java HotSpot(TM) 64-Bit Server VM, Java 1.8.0_77)
    Type in expressions to have them evaluated.
    Type :help for more information.

    scala>

#3