Reviewing Logs for Hive Queries

#1

Let us go through the details related to logs for Hive Queries.

  • Once the query is submitted details will be logged to /tmp/OS_USER_NAME/hive.log by default.
  • As Hive will be running as Map Reduce jobs, we can actually go through Map Reduce Job logs using Job History Server UI.
  • We can also go to Job Configuration and get more details about run time details of associated Map Reduce jobs.
    • Running Query
    • Number of reducers
    • Input Directory
    • and any other run time property for the underlying Map Reduce jobs.

Practice hive on state of the art Big Data cluster - https://labs.itversity.com
You can sign up for our courses on Udemy using $10 coupons - Udemy Coupons - Big Data Courses


0 Likes