Flume not able to initiate the agent and not able ping

sqoop

#1

Hello Team

I am not able to ping flume with below commands now also:

[shubhaprasadsamal@gw03 ~]$ telnet gw01.itversity.com 44444
Trying 172.16.1.100…
telnet: connect to address 172.16.1.100: Connection refused
[shubhaprasadsamal@gw03 ~]$ telnet nn01.itversity.com 44444
Trying 172.16.1.101…
telnet: connect to address 172.16.1.101: Connection refused
[shubhaprasadsamal@gw03 ~]$ telnet nn01.itversity.com 12345
Trying 172.16.1.101…
telnet: connect to address 172.16.1.101: Connection refused
[shubhaprasadsamal@gw03 ~]$ telnet (nc) nn01.itversity.com 12345
-bash: syntax error near unexpected token nc' [shubhaprasadsamal@gw03 ~]$ telnet (or nc) nn01.itversity.com 12345 -bash: syntax error near unexpected tokenor’
[shubhaprasadsamal@gw03 ~]$ nc nn01.itversity.com 44444
Ncat: Connection refused.
[shubhaprasadsamal@gw03 ~]$ nc nn01.itversity.com:44444
Ncat: Could not resolve hostname “nn01.itversity.com:44444”: Name or service not known. QUITTING.
[shubhaprasadsamal@gw03 ~]$

Is this issue is not fixed or am I doing something wrong.

Also, below is my flume agent:

[shubhaprasadsamal@gw03 ~]$ cd /home/shubhaprasadsamal/flume
[shubhaprasadsamal@gw03 flume]$ ls
derby.log problem7_1
[shubhaprasadsamal@gw03 flume]$ vi example.conf
[shubhaprasadsamal@gw03 flume]$ ls
derby.log example.conf problem7_1
[shubhaprasadsamal@gw03 flume]$ cat example.conf
a1.sources = r1
a1.sinks = k1
a1.channels = c1

a1.sources.r1.type = netcat
a1.sources.r1.bind = gw01.itversity.com
a1.sources.r1.port = 44444

a1.sinks.k1.type = logger

a1.channels.c1.type = memory
a1.channels.c1.capacity = 1000
a1.channels.c1.transactionCapacity = 100

a1.sources.r1.channels = c1
a1.sinks.k1.channel = c1

[shubhaprasadsamal@gw03 flume]$ flume-ng agent -n a1 --conf /home/shubhaprasadsamal/flume/ --conf-file example.conf

Facing below ERROR:

18/04/25 14:44:59 INFO node.Application: Starting Channel c1
18/04/25 14:45:00 INFO instrumentation.MonitoredCounterGroup: Monitored counter group for type: CHANNEL, name: c1: Successfully registered new MBean.
18/04/25 14:45:00 INFO instrumentation.MonitoredCounterGroup: Component type: CHANNEL, name: c1 started
18/04/25 14:45:00 INFO node.Application: Starting Sink k1
18/04/25 14:45:00 INFO node.Application: Starting Source r1
18/04/25 14:45:00 INFO source.NetcatSource: Source starting
18/04/25 14:45:00 ERROR source.NetcatSource: Unable to bind to socket. Exception follows.
java.net.BindException: Cannot assign requested address
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:433)
at sun.nio.ch.Net.bind(Net.java:425)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:67)
at org.apache.flume.source.NetcatSource.start(NetcatSource.java:162)
at org.apache.flume.source.EventDrivenSourceRunner.start(EventDrivenSourceRunner.java:44)
at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:251)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
18/04/25 14:45:00 ERROR lifecycle.LifecycleSupervisor: Unable to start EventDrivenSourceRunner: { source:org.apache.flume.source.NetcatSource{name:r1,state:IDLE} } - Exception follows.
org.apache.flume.FlumeException: java.net.BindException: Cannot assign requested address
at org.apache.flume.source.NetcatSource.start(NetcatSource.java:168)
at org.apache.flume.source.EventDrivenSourceRunner.start(EventDrivenSourceRunner.java:44)
at org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:251)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180)
at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
Caused by: java.net.BindException: Cannot assign requested address
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:433)
at sun.nio.ch.Net.bind(Net.java:425)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)

Can you help me?

Thanks


#2

@shubhaprasadsamal
Here is the flume invoke command

flume-ng agent --name flume agent name --conf-file file name.conf -D flume.root.logger=INFO,console


#3

@nikhil23 - No luck!


#4

It’s working from Durga Sir’s session but not working for me.

Please find my code snippet:

gw03 login: shubhaprasadsamal
Password:
Last login: Wed Apr 25 18:32:52 on pts/45
CentOS Linux 7 (Core)
Linux gw03.itversity.com 3.10.0-693.11.6.el7.x86_64 #1 SMP Thu Jan 4 01:06:37 UTC 2018 x86_64 x86_64 x86_64 GNU/Linux
Server : 274218
IPv4 : 149.56.31.128
IPv6 : 2607:5300:61:e80::
Hostname : gw03.itversity.com
[shubhaprasadsamal@gw03 ~]$ nc gw01.itversity.com 44444
Ncat: Connection refused.
[shubhaprasadsamal@gw03 ~]$


#5

Is there any configuration got changed? @dgadiraju Sir.

Thanks,
Shitansu


#6

Issue not yet resolved. Is there any issue with Flume?


#7

@dgadiraju sir … Please help