CCA175 exam-- compression process


#1

During exam for compression instead of use SqlContext.setConf() can we use below thing

df.write.format(“parquet”).option(“compress”,“snappy”).save(“dir”)

so uncompressed command will not be in use after setConf operation

@itversity1 and @dgadiraju can you confirm if this approach is applicable in exam?


Learn Spark 1.6.x or Spark 2.x on our state of the art big data labs

  • Click here for access to state of the art 13 node Hadoop and Spark Cluster


#2

yes you can use df.write.format(“parquet”).option(“compress”,“snappy”).save(“dir”) as well