Sqoop command with avrodatafile format. i dont get avsc file in local gateway

[rkathiravan@gw01 ~]$ sqoop-import --connect “jdbc:mysql://nn01.itversity.com:3306/retail_db”\

–username retail_dba
–password itversity
–table departments
–as-avrodatafile
–target-dir “/user/rkathiravan/rkathiravan_sqoop_import/departments”
-m 2
–outdir javafiles
–fields-terminated-by ‘|’
–lines-terminated-by '\n’
Warning: /usr/hdp/2.5.0.0-1245/accumulo does not exist! Accumulo imports will fail.
Please set $ACCUMULO_HOME to the root of your Accumulo installation.
17/03/01 15:49:27 INFO sqoop.Sqoop: Running Sqoop version: 1.4.6.2.5.0.0-1245
17/03/01 15:49:27 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
17/03/01 15:49:27 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
17/03/01 15:49:27 INFO tool.CodeGenTool: Beginning code generation
17/03/01 15:49:27 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM departments AS t LIMIT 1
17/03/01 15:49:27 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM departments AS t LIMIT 1
17/03/01 15:49:27 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /usr/hdp/2.5.0.0-1245/hadoop-mapreduce
Note: /tmp/sqoop-rkathiravan/compile/43d839e338d3edf5d11b66d1d5b42036/departments.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
17/03/01 15:49:28 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-rkathiravan/compile/43d839e338d3edf5d11b66d1d5b42036/departments.jar
17/03/01 15:49:28 WARN manager.MySQLManager: It looks like you are importing from mysql.
17/03/01 15:49:28 WARN manager.MySQLManager: This transfer can be faster! Use the --direct
17/03/01 15:49:28 WARN manager.MySQLManager: option to exercise a MySQL-specific fast path.
17/03/01 15:49:28 INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql)
17/03/01 15:49:28 INFO mapreduce.ImportJobBase: Beginning import of departments
17/03/01 15:49:29 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM departments AS t LIMIT 1
17/03/01 15:49:29 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM departments AS t LIMIT 1
17/03/01 15:49:29 INFO mapreduce.DataDrivenImportJob: Writing Avro schema file: /tmp/sqoop-rkathiravan/compile/43d839e338d3edf5d11b66d1d5b42036/departments.avsc
17/03/01 15:49:30 INFO impl.TimelineClientImpl: Timeline service address: http://rm01.itversity.com:8188/ws/v1/timeline/
17/03/01 15:49:30 INFO client.RMProxy: Connecting to ResourceManager at rm01.itversity.com/172.16.1.106:8050
17/03/01 15:49:30 INFO client.AHSProxy: Connecting to Application History server at rm01.itversity.com/172.16.1.106:10200
17/03/01 15:49:37 INFO db.DBInputFormat: Using read commited transaction isolation
17/03/01 15:49:37 INFO db.DataDrivenDBInputFormat: BoundingValsQuery: SELECT MIN(department_id), MAX(department_id) FROM departments
17/03/01 15:49:37 INFO db.IntegerSplitter: Split size: 49; Num splits: 2 from: 2 to: 100
17/03/01 15:49:37 INFO mapreduce.JobSubmitter: number of splits:2
17/03/01 15:49:37 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1485099329996_7757
17/03/01 15:49:38 INFO impl.YarnClientImpl: Submitted application application_1485099329996_7757
17/03/01 15:49:38 INFO mapreduce.Job: The url to track the job: http://rm01.itversity.com:8088/proxy/application_1485099329996_7757/
17/03/01 15:49:38 INFO mapreduce.Job: Running job: job_1485099329996_7757
17/03/01 15:49:44 INFO mapreduce.Job: Job job_1485099329996_7757 running in uber mode : false
17/03/01 15:49:44 INFO mapreduce.Job: map 0% reduce 0%
17/03/01 15:49:49 INFO mapreduce.Job: map 100% reduce 0%
17/03/01 15:49:50 INFO mapreduce.Job: Job job_1485099329996_7757 completed successfully
17/03/01 15:49:50 INFO mapreduce.Job: Counters: 30
File System Counters
FILE: Number of bytes read=0
FILE: Number of bytes written=320390
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=245
HDFS: Number of bytes written=857
HDFS: Number of read operations=8
HDFS: Number of large read operations=0
HDFS: Number of write operations=4
Job Counters
Launched map tasks=2
Other local map tasks=2
Total time spent by all maps in occupied slots (ms)=13446
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=6723
Total vcore-milliseconds taken by all map tasks=6723
Total megabyte-milliseconds taken by all map tasks=10326528
Map-Reduce Framework
Map input records=7
Map output records=7
Input split bytes=245
Spilled Records=0
Failed Shuffles=0
Merged Map outputs=0
GC time elapsed (ms)=89
CPU time spent (ms)=3680
Physical memory (bytes) snapshot=511168512
Virtual memory (bytes) snapshot=6547619840
Total committed heap usage (bytes)=400556032
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=857
17/03/01 15:49:50 INFO mapreduce.ImportJobBase: Transferred 857 bytes in 20.3152 seconds (42.1851 bytes/sec)
17/03/01 15:49:50 INFO mapreduce.ImportJobBase: Retrieved 7 records.
[rkathiravan@gw01 ~]$ ls -ltr
total 128
-rw-r–r-- 1 rkathiravan students 693 Feb 26 15:59 deckofcards.txt
-rw-r–r-- 1 rkathiravan students 14126 Feb 28 16:47 categories.java
-rw-r–r-- 1 rkathiravan students 27628 Feb 28 16:47 customers.java
-rw-r–r-- 1 rkathiravan students 11575 Feb 28 16:48 departments.java
-rw-r–r-- 1 rkathiravan students 22557 Feb 28 16:48 order_items.java
-rw-r–r-- 1 rkathiravan students 16346 Feb 28 16:48 orders.java
-rw-r–r-- 1 rkathiravan students 20951 Feb 28 16:49 products.java
drwxr-xr-x 2 rkathiravan students 4096 Feb 28 21:58 javafiles

did i miss something?? avsc file not found in the local gaeway where run the sqoop import. help me out!!

@Revathi_K Please check the link Avro data file extension is not avsc

Friendly message to everyone, before creating a new post please do search, most likely there should be a match for the problem what you are trying to address :slight_smile: