I want to compare average and varaince of two dataframe

pyspark

#1

Hi

I am having two data frame one from CSV file and other from hive table. After that, I want to compare the average and variance of both two data frame of integer and decimal columns of both the data frame.


Learn Spark 1.6.x or Spark 2.x on our state of the art big data labs

  • Click here for access to state of the art 13 node Hadoop and Spark Cluster