Set Operations


#1

Originally published at: https://kaizen.itversity.com/topic/cca175-set-operations-scala/

Let us get into set operations using Spark APIs. Spark support union intersection distinct minus – subtract When union is performed, data will not be unique Typically we have to use distinct after union to eliminate duplicates