Sqoop import-Queue's AM resource limit exceeded


#1

Hi team,

I am trying to run the below sqoop statements:-
sqoop import
–connect jdbc:mysql://ms.itversity.com/retail_export
–username retail_user
–password itversity
–table products_replica_m
–fields-terminated-by ‘|’
–lines-terminated-by ‘\n’
–null-string “NOT-AVAILABLE”
–null-non-string “-1”
–as-textfile
–target-dir /user/moumita12/ArunProblems/Problem5/products-text
–where ‘product_id >=1 and product_id <=1000’
–num-mappers 3
–boundary-query “select min(product_id),max(product_id) from products_replica_m where product_id between 1 and 1000”

But the jobs hangs and when i tracked the status in the url, it says:-

“[Thu Nov 01 14:00:16 -0400 2018] Application is added to the scheduler and is not yet activated. Queue’s AM resource limit exceeded. Details : AM Partition = <DEFAULT_PARTITION>; AM Resource Request = <memory:2048, vCores:1>; Queue Resource Limit for AM = <memory:24576, vCores:1>; User AM Resource Limit of the queue = <memory:24576, vCores:1>; Queue AM Resource Usage = <memory:23552, vCores:17>;”

Could you please check?

Thanks!


#2

@atimuom There is no issue with the sqoop command.

You ran the JOB when all resources are busy with other applications. To understand about resources available in labs visite http://rm01.itversity.com:19288/cluster/apps/RUNNING