While running flume agent with memory as channel, getting error: There is insufficient memory for the Java Runtime Environment to continue

flume

#1

I am trying to run flume agent with memory as channel as below:

flume-ng agent -n wh -f /home/pathirippilly/flume_demo/wslogstohdfs/wshdfs.conf

But ended up in below error:

    # There is insufficient memory for the Java Runtime Environment to continue.
    # Native memory allocation (mmap) failed to map 350748672 bytes for committing reserved memory.
    # Possible reasons:
    #   The system is out of physical RAM or swap space
    #   In 32 bit mode, the process size limit was hit
    # Possible solutions:
    #   Reduce memory load on the system
    #   Increase physical memory or swap space
    #   Check if swap backing store is full
    #   Use 64 bit Java on a 64 bit OS
    #   Decrease Java heap size (-Xmx/-Xms)
    #   Decrease number of Java threads
    #   Decrease Java thread stack sizes (-Xss)
    #   Set larger code cache with -XX:ReservedCodeCacheSize=
    # This output file may be truncated or incomplete.
    #
    #  Out of Memory Error (os_linux.cpp:2627), pid=3091, tid=139652813973248

Below is my wshdfs.conf:

    # example.conf: A single-node Flume configuration
     
    # Name the components on this agent
    wh.sources = ws
    wh.sinks = k1
    wh.channels = mem
     
    # Describe/configure the source
    wh.sources.ws.type = hdfs
    wh.sources.ws.command =  tail -F /opt/gen_logs/logs/access.log
    # Describe the sink
    wh.sinks.k1.type = logger
     
    # Use a channel which buffers events in memory
    wh.channels.mem.type = memory
    wh.channels.mem.capacity = 1000
    wh.channels.mem.transactionCapacity = 100
     
    # Bind the source and sink to the channel
    wh.sources.ws.channels = mem
    wh.sinks.k1.channel = mem

And I am using itversity Lab . Could you please tell me what is the reason?


#2

@akhil_pathirippilly Issue resolved. Now you can run the flume.


#3

Yeah Jus now tried. Its running. Thanks for the quick response


#4