Snappy/Gzip compression on ORC files using Scala

Snappy/Gzip compression on ORC files using Scala
0.0 0


How do I generate compressed ORC files?
sqlContext.setConf(“spark.sql.orc.compression.codec”,“snappy”) does not works. I tried sqlContext.setConf(“”,“snappy”) as well. This didn’t work either.

Please advise.


As per github code of spark repo :
They are providing none, uncompressed, snappy, zlib, lzo . And snappy compression is default codec.
However I am not able to store using with different format



If you find any information please let me know.


It seems ORC and Snappy is not working as expected.


any update on this? even I am not able to set any codec for ORC.
It could be an exercise on CCA exams!!!


Run using this:
spark-shell --master yarn


snappy is the default codec for ORC file, but other codecs are not working


Are you able to found a fix for this issue as other compression are not working for orc?