Sqoop Import - Customizing split logic


Originally published at: https://kaizen.itversity.com/topic/sqoop-import-customizing-split-logic/

Let us explore how we can customize split logic By default number of mappers is 4, it can be changed with –num-mappers Split logic will be applied on primary key, if exists If primary key does not exists and if we use number of mappers more than 1, then sqoop import will fail At that…


Do we have to remember -Dorg.apache.sqoop.splitter.allow_text_splitter=true or is there a way we can go and refer in any of the config files like we have for --compression-codec values