Validating avro Files using avro-tools


Let us understand how to validate files in Avro format using avro-tools

  • avro-tools is external tool that can be used to convert Avro files to JSON/Text or vice-versa.
  • Once data is imported we can copy the files from HDFS to local file system.
  • We can run avro-tools tojson command to convert Avro file into JSON.
  • We can redirect the output to a file using Linux redirect operator.
  • e. g.: avro-tools tojson part-m-00000.avro > part-m-00000.json