Broken Symlinks - import-all-tables - asavrodatafile

#1

Trying to execute the below code for import all tables as avrodatafile in SQOOP, getting broken symlinks error

sqoop import-all-tables
-m 4
–connect “jdbc:mysql://nn01.itversity.com:3306/retail_db”
–username=retail_dba
–password=itversity
–as-avrodatafile
–autoreset-to-one-mapper
–warehouse-dir /user/gnanaprakasam/sqoop_import

Map Reduce job
http://nn01.itversity.com:19888/jobhistory/job/job_1479205146585_0106

Any input on this ?

0 Likes

#2

@itversity - I have tried again with department tables import as avro, still facing the same problem. Any input on this ? it’s working fine with --as-textfile

The url to track the job: http://nn01.itversity.com:8088/proxy/application_1479205146585_0578/

sqoop import
–m 1
–connect “jdbc:mysql://nn01.itversity.com:3306/retail_db”
–username=retail_dba
–password=itversity
–table departments
–as-avrodatafile
–warehouse-dir=/apps/hive/warehouse/gnanaprakasam.db

0 Likes

#3

It seems there is known issue in hortonworks.

https://community.hortonworks.com/questions/60890/sqoop-import-to-avro-failing-which-jars-to-be-used.html

0 Likes

#4

@itversity Thank You!

0 Likes