About the Apache Spark category


#1

We have state of the art Big Data cluster with Hadoop, Spark etc supported by https://labs.itversity.com

This subcategory of big data is all about discussing Apache Spark

  • Transformations and actions
  • Data Frames
  • Data Sets
  • Spark using scala, python, java
  • and every thing else about Spark

Here are the Udemy coupons for our certification courses. Our coupons include 1 month lab access as well.

  • Click here for $35 coupon for CCA 175 Spark and Hadoop Developer using Python.
  • Click here for $35 coupon for CCA 175 Spark and Hadoop Developer using Scala.
  • Click here for $25 coupon for HDPCD:Spark using Python.
  • Click here for $25 coupon for HDPCD:Spark using Scala.
  • Click here for access to state of the art 13 node Hadoop and Spark Cluster


#2

PYSPARK is not working. Getting below error. Please look into this asap.

return self._jvm.JavaSparkContext(jconf)
File “/usr/hdp/2.5.0.0-1245/spark/python/lib/py4j-0.9-src.zip/py4j/java_gateway.py”, line 1062, in call
File “/usr/hdp/2.5.0.0-1245/spark/python/lib/py4j-0.9-src.zip/py4j/java_gateway.py”, line 631, in send_command
File “/usr/hdp/2.5.0.0-1245/spark/python/lib/py4j-0.9-src.zip/py4j/java_gateway.py”, line 624, in send_command
File “/usr/hdp/2.5.0.0-1245/spark/python/lib/py4j-0.9-src.zip/py4j/java_gateway.py”, line 579, in _get_connection
File “/usr/hdp/2.5.0.0-1245/spark/python/lib/py4j-0.9-src.zip/py4j/java_gateway.py”, line 585, in _create_connection
File “/usr/hdp/2.5.0.0-1245/spark/python/lib/py4j-0.9-src.zip/py4j/java_gateway.py”, line 697, in start
py4j.protocol.Py4JNetworkError: An error occurred while trying to connect to the Java server