Saving Data Frame

If the question says to save the data frame i.e after using spark.read.csv, to a text file with a delimiter do we need to convert the DF to RDD and map each element and then use save as text file or can we save the DF using df.write.csv.option(‘sep’,’’;’).


Prepare for certifications on our state of the art labs which have Hadoop, Spark, Kafka, Hive and other Big Data technologies

  • Click here for signing up for our state of the art 13 node Hadoop and Spark Cluster