Cannot allocate memory’ (errno=12)


#1

[prasadgt02@gw03 ~]$ spark-shell --master yarn \

–conf spark.ui.port=12345
–num-executors 6
–executor-core 2
–executor-memory 2g
Multiple versions of Spark are installed but SPARK_MAJOR_VERSION is not set
Spark1 will be picked by default
Java HotSpot™ 64-Bit Server VM warning: INFO: os::commit_memory(0x0000000671d00000, 350748672, 0) failed; error=‘Cannot allocate memory’ (errno=12)
[prasadgt02@gw03 ~]$ spark-shell --master yarn --conf spark.ui.port=12345 --num-executors 6 --executor-core 2 --executor-memory 2G
Multiple versions of Spark are installed but SPARK_MAJOR_VERSION is not set
Spark1 will be picked by default
Java HotSpot™ 64-Bit Server VM warning: INFO: os::commit_memory(0x0000000671d00000, 350748672, 0) failed; error=‘Cannot allocate memory’ (errno=12)


#2

Hi @Pgangadharth
Can you try now and let us know?


#3

@Pgangadharth Issue resolved. Due to high usage of resources caused the error. Now you can practice.