Exercise 16: Get NYSE data in ascending order by date and descending order by volume ( scala code please...)


#1

Instructions
Get NYSE data in ascending order by date and descending order by volume

Data Description
NYSE data with “,” as delimiter is available in HDFS

NYSE data information:

HDFS location: /public/nyse
There is no header in the data
Output Requirements
Save data back to HDFS
Column order: stockticker, transactiondate, openprice, highprice, lowprice, closeprice, volume
File Format: text
Delimiter: :
Place the sorted NYSE data in the HDFS directory
/user/whoami/problem16/solution/
Replace whoami with your OS user name
End of Problem


Learn Spark 1.6.x or Spark 2.x on our state of the art big data labs

  • Click here for access to state of the art 13 node Hadoop and Spark Cluster