Flume conf file run issues


#1

Hi Team , the flume conf file is trying to write the logs in /tmp/flume/flume.log which is failing with Permission denied for my id. Please grant access.

Name the components on this agent

wh.sources = ws
wh.sinks = hd
wh.channels = mem

Describe/configure the source

wh.sources.ws.type = exec
wh.sources.ws.command = tail -F /opt/gen_logs/logs/access.log

Describe the sink

wh.sinks.hd.type = hdfs
wh.sinks.hd.hdfs.command = hdfs://nn01.itversity.com:8020/user/anidaki84/flume_demo

Use a channel which buffers events in memory

wh.channels.mem.type = memory
wh.channels.mem.capacity = 1000
wh.channels.mem.transactionCapacity = 100

Bind the source and sink to the channel

wh.sources.ws.channels = mem
wh.sinks.hd.channel = mem

Error:
2019-01-31 01:06:11,348 main ERROR RollingFileManager (/tmp/flume/flume.log) java.io.FileNotFoundException: /tmp/flume/flume.log (Permission denied) java.io.FileNotFoundException: /tmp/flume/flume.log (Permission denied)


#2

you have to give as:

wh.sink.hd.hdfs.path = hdfs://nn01.itversity.com:8020/user/anidaki84/flume_demo

you can ignore the exception.