I wrote the actual problem in My first message drpc server not working I hot zeros in the columns of storm ui like emitted and transferred , result file is empty
On Wednesday, January 27, 2016, Erik Weathers <[email protected]> wrote: > Your mail client is wrapping the log lines prematurely, I have a really > really hard time reading wrapped lines, I'd look into fixing that if I were > you. Here they are unwrapped: > > 2016-01-27 01:41:00 c.n.c.f.i.CuratorFrameworkImpl [INFO] Starting > 2016-01-27 01:41:00 o.a.z.ZooKeeper [INFO] Initiating client connection, > connectString=localhost:2181 sessionTimeout=20000 > watcher=com.netflix.curator.ConnectionState@2fa423d2 > 2016-01-27 01:41:00 o.a.z.ClientCnxn [INFO] Opening socket connection to > server localhost/127.0.1.1:2181. Will not attempt to authenticate using > SASL (unknown error) > 2016-01-27 01:41:00 o.a.z.ClientCnxn [INFO] Socket connection established > to localhost/127.0.1.1:2181, initiating session > 2016-01-27 01:41:00 o.a.z.ClientCnxn [INFO] Session establishment complete > on server localhost/127.0.1.1:2181, sessionid = 0x152804f3a3a0002, > negotiated timeout = 20000 > 2016-01-27 01:41:00 b.s.zookeeper [INFO] Zookeeper state update: > :connected:none > 2016-01-27 01:41:00 o.a.z.ZooKeeper [INFO] Session: 0x152804f3a3a0002 > closed > 2016-01-27 01:41:00 o.a.z.ClientCnxn [INFO] EventThread shut down > 2016-01-27 01:41:00 c.n.c.f.i.CuratorFrameworkImpl [INFO] Starting > 2016-01-27 01:41:00 o.a.z.ZooKeeper [INFO] Initiating client connection, > connectString=localhost:2181/storm sessionTimeout=20000 > watcher=com.netflix.curator.ConnectionState@2ee8b0bf > 2016-01-27 01:41:00 o.a.z.ClientCnxn [INFO] Opening socket connection to > server user-Lenovo-G50-70/127.0.0.1:2181. Will not attempt to authenticate > using SASL (unknown error) > 2016-01-27 01:41:00 o.a.z.ClientCnxn [INFO] Socket connection established > to user-Lenovo-G50-70/127.0.0.1:2181, initiating session > 2016-01-27 01:41:00 o.a.z.ClientCnxn [INFO] Session establishment complete > on server user-Lenovo-G50-70/127.0.0.1:2181, sessionid = > 0x152804f3a3a0003, > negotiated timeout = 20000 > > None of those indicate a problem, they look pretty standard to me. > > Please spend a bit more time zeroing in on what the actual problem is so > that the members of the list(s) can provide help. > > - Erik > > On Tue, Jan 26, 2016 at 10:15 PM, researcher cs <[email protected] > <javascript:;>> > wrote: > > > yes i tried in local and worked well > > and about /etc/hosts . i'm feeling that this file has a mistake , i made > > alot of changes in this file and didn't remember what was default > > > > In nimbus log file when it connected zookeeper i got > > 2016-01-27 01:41:00 c.n.c.f.i.CuratorFrameworkImpl [INFO] Starting > > 2016-01-27 01:41:00 o.a.z.ZooKeeper [INFO] Initiating client connection, > > connectString=localhost:2181 sessionTimeout=20000 > > watcher=com.netflix.curator.ConnectionState@2fa423d2 > > 2016-01-27 01:41:00 o.a.z.ClientCnxn [INFO] Opening socket connection to > > server localhost/127.0.1.1:2181. Will not attempt to authenticate using > > SASL (unknown error) > > 2016-01-27 01:41:00 o.a.z.ClientCnxn [INFO] Socket connection established > > to localhost/127.0.1.1:2181, initiating session > > 2016-01-27 01:41:00 o.a.z.ClientCnxn [INFO] Session establishment > complete > > on server localhost/127.0.1.1:2181, sessionid = 0x152804f3a3a0002, > > negotiated timeout = 20000 > > 2016-01-27 01:41:00 b.s.zookeeper [INFO] Zookeeper state update: > > :connected:none > > 2016-01-27 01:41:00 o.a.z.ZooKeeper [INFO] Session: 0x152804f3a3a0002 > > closed > > 2016-01-27 01:41:00 o.a.z.ClientCnxn [INFO] EventThread shut down > > 2016-01-27 01:41:00 c.n.c.f.i.CuratorFrameworkImpl [INFO] Starting > > 2016-01-27 01:41:00 o.a.z.ZooKeeper [INFO] Initiating client connection, > > connectString=localhost:2181/storm sessionTimeout=20000 > > watcher=com.netflix.curator.ConnectionState@2ee8b0bf > > 2016-01-27 01:41:00 o.a.z.ClientCnxn [INFO] Opening socket connection to > > server user-Lenovo-G50-70/127.0.0.1:2181. Will not attempt to > authenticate > > using SASL (unknown error) > > 2016-01-27 01:41:00 o.a.z.ClientCnxn [INFO] Socket connection established > > to user-Lenovo-G50-70/127.0.0.1:2181, initiating session > > 2016-01-27 01:41:00 o.a.z.ClientCnxn [INFO] Session establishment > complete > > on server user-Lenovo-G50-70/127.0.0.1:2181, sessionid = > > 0x152804f3a3a0003, > > negotiated timeout = 20000 > > > > and i set for drpc.server : localhost > > storm.zookeeper.server : localhost > > nimbus.host : localhost > > > > in my /etc/hosts > > 127.0.0.1 user-Lenovo-G50-70 localhost > > 127.0.1.1 localhost > > > > is that right ? > > > > > > On Wed, Jan 27, 2016 at 6:12 AM, Erik Weathers < > > [email protected]> wrote: > > > > > You said: "except the statement of drpc server trying to connect" > > > > > > Maybe you are confused about what "b.s.d.drpc [INFO] Starting > Distributed > > > RPC servers..." implies? > > > That is just saying that the server is being started. It's a server, > > not > > > a client, so it's basic operation is *not* to connect to some other > > thing. > > > It's up and waiting for you to tell it to do stuff. > > > > > > Have you gotten the Local-mode version of DRPC working? > > > > > > - > > > > > > > > > https://storm.apache.org/documentation/Distributed-RPC.html#local-mode-drpc > > > > > > Not sure what you're asking with regards to DNS and /etc/hosts, those > > seem > > > unrelated to your basic issue. > > > > > > - Erik > > > > > > On Tue, Jan 26, 2016 at 6:58 PM, researcher cs < > > [email protected] <javascript:;>> > > > wrote: > > > > > > > There is no error except the statement of drpc server trying to > connect > > > . I > > > > guess I have problem with Dns . if you have any idea about this > pleaes > > > help > > > > > > > > > > > > I want to submit topology with single machine > > > > Only on my laptop without any other devices as a first step so > > > > What this file /etc/hosts should contains ? > > > > As I set in drpc.server : localhost > > > > Storm.zookeeper. server: localhost > > > > Nimbus.host:localhost > > > > > > > > As this file contains 127.0.1.1 and 127.0.0.1 and my IP address ? > > > > > > > > What should I use and what should I hash it to not using it ? > > > > > > > > > > > > > > > > On Wednesday, January 27, 2016, Erik Weathers > > > > <[email protected]> > > > > wrote: > > > > > > > > > What does the client code that is supposed to make the DRPC > > connection > > > > > telling you? i.e., you should see some exception or log about not > > > > > establishing the connection, right? > > > > > > > > > > Alternatively, perhaps the connections aren't persistent and > there's > > no > > > > > actual problem? > > > > > > > > > > - Erik > > > > > > > > > > On Tue, Jan 26, 2016 at 4:55 PM, researcher cs < > > > > [email protected] <javascript:;> > > > > > <javascript:;>> > > > > > wrote: > > > > > > > > > > > thanks for replying , i read the documentation before , i > imported > > > > > project > > > > > > supposed to work well but not working with me > > > > > > i checked port by lsof -i gave me all ports i connected it for > > storm > > > > > > java 10675 root 20u IPv4 98126 0t0 TCP *:52022 > > > > (LISTEN) > > > > > > java 10675 root 26u IPv4 98131 0t0 TCP *:2181 > > > (LISTEN) > > > > > > java 10675 root 27u IPv4 101944 0t0 TCP > > > > > > localhost:2181->user-Lenovo-G50-70:38150 (ESTABLISHED) > > > > > > java 10675 root 29u IPv4 98974 0t0 TCP > > > > > > user-Lenovo-G50-70:2181->user-Lenovo-G50-70:50526 (ESTABLISHED) > > > > > > java 10675 root 30u IPv4 99105 0t0 TCP > > > > > > localhost:2181->user-Lenovo-G50-70:38165 (ESTABLISHED) > > > > > > java 10715 root 90u IPv4 98953 0t0 TCP > > > > > > user-Lenovo-G50-70:38150->localhost:2181 (ESTABLISHED) > > > > > > java 10715 root 91u IPv4 98245 0t0 TCP *:6627 > > > (LISTEN) > > > > > > java 10792 root 90u IPv4 99973 0t0 TCP > > > > > > user-Lenovo-G50-70:50526->user-Lenovo-G50-70:2181 (ESTABLISHED) > > > > > > java 10864 root 82u IPv4 102425 0t0 TCP *:3772 > > > (LISTEN) > > > > > > java 10864 root 84u IPv4 102429 0t0 TCP *:3773 > > > (LISTEN) > > > > > > java 10864 root 92u IPv4 102197 0t0 TCP > > > > > > user-Lenovo-G50-70:3773->user-Lenovo-G50-70:50825 (ESTABLISHED) > > > > > > java 10928 root 81u IPv4 102070 0t0 TCP > *:http-alt > > > > > (LISTEN) > > > > > > java 11087 root 81u IPv4 100091 0t0 TCP > > > > > > user-Lenovo-G50-70:50825->user-Lenovo-G50-70:3773 (ESTABLISHED) > > > > > > java 11087 root 91u IPv4 102196 0t0 TCP > > > > > > user-Lenovo-G50-70:38165->localhost:2181 (ESTABLISHED) > > > > > > java 11087 root 94u IPv4 102561 0t0 TCP *:7660 > > > (LISTEN) > > > > > > > > > > > > > > > > > > here you can see that 3772 not established > > > > > > > > > > > > On Wed, Jan 27, 2016 at 2:47 AM, Erik Weathers < > > > > > > [email protected]> wrote: > > > > > > > > > > > > > hey, > > > > > > > > > > > > > > The DRPC server is up and listening on port 3772. Why do you > > > expect > > > > > > > established connections? > > > > > > > > > > > > > > I'm not familiar with using Storm's DRPC feature, but I'm sure > > you > > > > need > > > > > > to > > > > > > > write code that interacts with the DRPC server, and you've made > > no > > > > > > mention > > > > > > > of doing so in your email. I'd start here: > > > > > > > > > > > > > > - > https://storm.apache.org/documentation/Distributed-RPC.html > > > > > > > > > > > > > > - Erik > > > > > > > > > > > > > > On Tue, Jan 26, 2016 at 4:29 PM, researcher cs < > > > > > > [email protected] <javascript:;> <javascript:;>> > > > > > > > wrote: > > > > > > > > > > > > > > > I set in the code > > > > > > > > conf.put(Config.DRPC_SERVERS, dprcServers); > > > > > > > > conf.put(Config.DRPC_PORT, 3772); > > > > > > > > but when i submit topolgoy i found at the end of the file > > > > > > > > b.s.d.drpc [INFO] Starting Distributed RPC servers... > > > > > > > > > > > > > > > > i checked port 3772 by > > > > > > > > > > > > > > > > sudo netstat -ap | grep 3772 > > > > > > > > > > > > > > > > i got > > > > > > > > > > > > > > > > tcp 0 0 *:3772 *:* LISTEN 10864/java > > > > > > > > unix 3 [ ] STREAM CONNECTED 13772 > > > > > > > > 587/dbus-daemon /var/run/dbus/system_bus_socket > > > > > > > > > > > > > > > > > > > > > > > > why it's not established ? > > > > > > > > > > > > > > > > can i find help ? > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > >
