Renaming part file created by pyspark


I have written a pyspark program to write the part-files to an AWS S3 location. However I want to rename the long part-file name with something meaningful. Is there any way to achieve this?

Thanks & Regards,

Learn Spark 1.6.x or Spark 2.x on our state of the art big data labs

  • Click here for access to state of the art 13 node Hadoop and Spark Cluster