Happy to share that I have cleared CCA-175 on 15th’Aug, 2021
My deepest gratitude goes to Durga and Itversity, brilliant duo and one stop point for CCA-175 exam preparation.
Glad to share my experience which might be useful to others preparing for the same.
Exam questions were super easy and Durga’s course covers it all.
Exam environment was a bit demotivating to me. I was given a remote desktop (which opens in Chrome). The Caps-Lock didn’t work so I had to manage with Shift+[Key]. The RDC was slow and I got disconnected once during the exam. But no worries, the proctor will pause the timer the moment you get disconnected.
Couple of topics I would like to emphasize on are,
- (a) Be familiar with all different types of file formats and compression techniques. You don’t need to learn the internals of these FF and Compressions, but how to write your answers in the destination directory with different FF and compression.
Whenever in doubt, use the FMOS rule (I figured this myself ) which is as follows:
F = format() || M = mode() || O = option() || S = save() / saveAsTable()
Example - 1:
Example - 2:
All different types of FF and Compression can be used with FMOS rule (Yes, including avro)
(b) Be familiar with How to save an output with a specific_character delimitted text format.
I was asked to save almost 6 out of 9 outputs, in tab(\t) delimited TEXT format (and I used TEXT format, not CSV)
Example: Say, your output DataFrame/SQL Table has N columns.
First, convert the table into tab delimited TEXT format:
result_to_save = output.selectExpr("concat_ws('\t', *) AS result")
Then, save result_to_save in destination dir:
I didn’t include
--packageswhile launching pyspark shell, to work with avro format. It’s already integrated in the environment. I used only
pysparkcommand to launch the shell, with no other parameters, still I could finish my test in 90-95 minutes (One revision included), probably because I launched
pysparkshell only once and answered all the questions. Remember, every time you are launching pyspark shell, it’s consuming time. (Solely my opinion, you may choose a different approach)
You are allowed to open more than one terminal, to browse the HDFS. A text editor will be provided in the remote desktop.
That’s about it !! Let me know in the reply section, should you have any other queries and I would be happy to answer them to the best of my knowledge.
Prepare for certifications on our state of the art labs which have Hadoop, Spark, Kafka, Hive and other Big Data technologies
- Click here for signing up for our state of the art 13 node Hadoop and Spark Cluster