java.lang.OutOfMemoryError: GC overhead limit exceeded in cloudera quickstart VM

hive
#1

Hi,

Lot of Hive querries execution after i am facing the java.lang.OutOfMemoryError: GC overhead limit exceeded
error.

For this i have increases heap size in this manner :
export HADOOP_CLIENT_OPTS="-XX:-UseGCOverheadLimit -Xmx5g"
but still i am facing .

Please help me on this.

Thanks,
Syam.

0 Likes

#2

What is the memory you have given to the virtual machine? These are quite common in virtual machines.

0 Likes

#3

Hi,

Thanks for the response.
My memory allocation :

0 Likes

#4

What is the configuration of your machine? It seems you have given 20 GB to the VM.

Also, how much data you are trying to process?

0 Likes

#5

Thanks for the reply,

I am trying to process 50MB data.
My VM system configurtion is
HD - 35 GB
Ram - 16GB

Thanks,
Syam

0 Likes

#6

Ok, how much memory you have given to the virtual machine?
On virtual machines, running into out of memory on some of the hive queries is very common.

0 Likes