Usage of --autoreset-to-one-mapper


#1

Hi Team,

I am trying to use --autoreset-to-one-mapper to copy data into hdfs using below code,

sqoop import-all-tables
–connect jdbc:mysql://ms.itversity.com:3306/hr_db
–username hr_user
–password itversity
–autoreset-to-one-mapper
–warehouse-dir /user/srikarelaprolu2018/sqoop_import

I am getting an error as below,
ERROR tool.ImportAllTablesTool: Encountered IOException running import job: java.io.IOException: Generating splits for a textual index column allowed only in case of “-Dorg.apache.sqoop.splitter.allow_text_splitter=true” property passed as a parameter.

I understood that we need to set the property but don’t know how to do it.


#2

@srikarEC

Please go through the below link:


#4

Thank You for the reply.

The code should include the parameter like below,
sqoop import-all-tables
-Dorg.apache.sqoop.splitter.allow_text_splitter=true
–connect jdbc:mysql://ms.itversity.com:3306/hr_db
–username hr_user
–password itversity
–autoreset-to-one-mapper
–warehouse-dir /user/srikarelaprolu2018/sqoop_import


#5