I have written a pyspark program to write the part-files to an AWS S3 location. However I want to rename the long part-file name with something meaningful. Is there any way to achieve this?
Thanks & Regards,
Learn Spark 1.6.x or Spark 2.x on our state of the art big data labs
- Click here for access to state of the art 13 node Hadoop and Spark Cluster