Failed CCA175 on 15 Sep 2018. this is why

pyspark
apache-spark

#1

failed the exam due to this error: “UnicodeEncodeError: ‘ascii’ codec can’t encode character u’\xxxx’ in position xxxx: ordinal not in range(128)” for PYSPARK when i trying to save my output to target HDFS location.

I performed all operations with DF/SPARKSQL then transferred back to RDD, but when trying to running yourrdd.saveAsTextFile function, this error shows up. any idea how to solve this??? Thanks…


#2

Hi, did you face the same issue using df.write.text(“folder_path”)?