Hive Metastore - question is for my understanding


#1

With regards to spark, hive metastore is used by spark and pig as a metastore and in addition, it is used as the central schema repository.

Sometimes, in a cluster running spark, the hive metastore stops randomly and I am wondering if you have any idea why that may happen. I think that it may have to do with running out of memory or processing a significant amount of data.

Do you have any thoughts about this or can you give tips on how to troubleshoot.

Thanks
ONU


#2

@ondukwe,

Please increase HiveServer & HiveServer2 heap space if it more than 1 GB it would be better.
Please refer below: