Advanced Transformations


#1

Originally published at: https://kaizen.itversity.com/topic/advanced-transformations/

As we understand basic transformations such as map, flatMap, reduce etc, now let us look at few advanced operations. mapPartitions ranking using groupByKey mapPartitions APIs such as map, filter, flatMap work on individual records. We can implement any of this functionality using mapPartitions, but the difference is in its execution. For map, filter, flatMap –…