No, I was not getting register with master. I set the --ip= and it is working fine now :)
Thanks! /******************************************* Joe Stein Founder, Principal Consultant Big Data Open Source Security LLC http://www.stealth.ly Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> ********************************************/ On Fri, Feb 21, 2014 at 11:55 AM, Ross Allen <[email protected]> wrote: > Joe, do you ever get a line in your slave output that mentions registering > with the master? The output you pasted doesn't show that happening. The > lines should look something like this (bold added by me): > > I0221 10:20:13.964689 230219776 slave.cpp:501] New master detected at > [email protected]:5050 > > I0221 10:20:13.964833 228073472 status_update_manager.cpp:162] New master > detected at [email protected]:5050 > > I0221 10:20:13.964891 230219776 slave.cpp:526] Detecting new master > > *I0221 10:20:13.965553 227000320 slave.cpp:544] Registered with master > [email protected]:5050 <http://[email protected]:5050>; given slave > ID 201402211020-1929488576-5050-59729-0* > > Ross Allen > [email protected] > > > On 21 February 2014 01:52, Joe Stein <[email protected]> wrote: > > > from master > > > > root@oss001:/home/jstein# /usr/local/sbin/mesos-master --zk=zk:// > > 138.113.121.10:2181,/etc > > I0221 00:49:22.075003 17646 main.cpp:126] Build: 2014-02-06 19:32:44 by > > root > > I0221 00:49:22.075582 17646 main.cpp:167] Starting Mesos master > > I0221 00:49:22.075772 17650 master.cpp:283] Master started on > > 138.138.138.10:5050 > > I0221 00:49:22.075848 17650 master.cpp:297] Master ID: > > 201402210049-176851594-5050-17646 > > I0221 00:49:22.075932 17650 master.cpp:307] Master allowing > unauthenticated > > frameworks to register!! > > 2014-02-21 00:49:22,076:17646(0x7fbf0e3e4700):ZOO_INFO@log_env@658: > Client > > environment:zookeeper.version=zookeeper C client 3.3.4 > > 2014-02-21 00:49:22,076:17646(0x7fbf0e3e4700):ZOO_INFO@log_env@662: > Client > > environment:host.name=oss001 > > 2014-02-21 00:49:22,076:17646(0x7fbf0e3e4700):ZOO_INFO@log_env@669: > Client > > environment:os.name=Linux > > 2014-02-21 00:49:22,076:17646(0x7fbf0e3e4700):ZOO_INFO@log_env@670: > Client > > environment:os.arch=3.8.0-29-generic > > 2014-02-21 00:49:22,076:17646(0x7fbf0e3e4700):ZOO_INFO@log_env@671: > Client > > environment:os.version=#42~precise1-Ubuntu SMP Wed Aug 14 16:19:23 UTC > 2013 > > 2014-02-21 00:49:22,076:17646(0x7fbf0f3e6700):ZOO_INFO@log_env@658: > Client > > environment:zookeeper.version=zookeeper C client 3.3.4 > > 2014-02-21 00:49:22,076:17646(0x7fbf0f3e6700):ZOO_INFO@log_env@662: > Client > > environment:host.name=oss001 > > 2014-02-21 00:49:22,076:17646(0x7fbf0f3e6700):ZOO_INFO@log_env@669: > Client > > environment:os.name=Linux > > 2014-02-21 00:49:22,076:17646(0x7fbf0f3e6700):ZOO_INFO@log_env@670: > Client > > environment:os.arch=3.8.0-29-generic > > 2014-02-21 00:49:22,076:17646(0x7fbf0f3e6700):ZOO_INFO@log_env@671: > Client > > environment:os.version=#42~precise1-Ubuntu SMP Wed Aug 14 16:19:23 UTC > 2013 > > I0221 00:49:22.078568 17649 contender.cpp:121] Joining the ZK group with > > data: '[email protected]:5050' > > 2014-02-21 00:49:22,106:17646(0x7fbf0e3e4700):ZOO_INFO@log_env@679: > Client > > environment:user.name=jstein > > 2014-02-21 00:49:22,106:17646(0x7fbf0e3e4700):ZOO_INFO@log_env@687: > Client > > environment:user.home=/root > > 2014-02-21 00:49:22,106:17646(0x7fbf0e3e4700):ZOO_INFO@log_env@699: > Client > > environment:user.dir=/home/jstein > > 2014-02-21 00:49:22,106:17646(0x7fbf0e3e4700):ZOO_INFO@zookeeper_init > @727: > > Initiating client connection, host=138.113.121.10:2181, > > sessionTimeout=10000 watcher=0x7fbf18045e60 sessionId=0 > > sessionPasswd=<null> context=0x7fbef0000f90 flags=0 > > 2014-02-21 00:49:22,106:17646(0x7fbefffff700):ZOO_INFO@check_events > @1585: > > initiated connection to server [138.113.121.10:2181] > > 2014-02-21 00:49:22,108:17646(0x7fbefffff700):ZOO_INFO@check_events > @1632: > > session establishment complete on server [138.113.121.10:2181], > > sessionId=0x14452bb562c0017, negotiated timeout=10000 > > I0221 00:49:22.109210 17648 group.cpp:310] Group process ((5)@ > > 138.138.138.10:5050) connected to ZooKeeper > > I0221 00:49:22.109261 17648 group.cpp:752] Syncing group operations: > queue > > size (joins, cancels, datas) = (0, 0, 0) > > I0221 00:49:22.109295 17648 group.cpp:367] Trying to create path '/etc' > in > > ZooKeeper > > 2014-02-21 00:49:22,132:17646(0x7fbf0f3e6700):ZOO_INFO@log_env@679: > Client > > environment:user.name=jstein > > 2014-02-21 00:49:22,132:17646(0x7fbf0f3e6700):ZOO_INFO@log_env@687: > Client > > environment:user.home=/root > > 2014-02-21 00:49:22,132:17646(0x7fbf0f3e6700):ZOO_INFO@log_env@699: > Client > > environment:user.dir=/home/jstein > > 2014-02-21 00:49:22,132:17646(0x7fbf0f3e6700):ZOO_INFO@zookeeper_init > @727: > > Initiating client connection, host=138.113.121.10:2181, > > sessionTimeout=10000 watcher=0x7fbf18045e60 sessionId=0 > > sessionPasswd=<null> context=0x7fbf08003360 flags=0 > > 2014-02-21 00:49:22,133:17646(0x7fbefeffd700):ZOO_INFO@check_events > @1585: > > initiated connection to server [138.113.121.10:2181] > > 2014-02-21 00:49:22,134:17646(0x7fbefeffd700):ZOO_INFO@check_events > @1632: > > session establishment complete on server [138.113.121.10:2181], > > sessionId=0x14452bb562c0018, negotiated timeout=10000 > > I0221 00:49:22.134649 17650 group.cpp:310] Group process ((3)@ > > 138.138.138.10:5050) connected to ZooKeeper > > I0221 00:49:22.134721 17650 group.cpp:752] Syncing group operations: > queue > > size (joins, cancels, datas) = (1, 0, 0) > > I0221 00:49:22.134757 17650 group.cpp:367] Trying to create path '/etc' > in > > ZooKeeper > > I0221 00:49:22.136303 17647 contender.cpp:237] New candidate (id='0', > > data=' > > [email protected]:5050') has entered the contest for leadership > > I0221 00:49:22.136605 17649 detector.cpp:134] Detected a new leader: > > (id='0') > > I0221 00:49:22.136806 17650 group.cpp:629] Trying to get > '/etc/0000000000' > > in ZooKeeper > > I0221 00:49:22.137348 17654 detector.cpp:354] A new leading master (UPID= > > [email protected]:5050) is detected > > I0221 00:49:22.137433 17650 master.cpp:728] The newly elected leader is > > [email protected]:5050 > > I0221 00:49:22.137487 17650 master.cpp:736] Elected as the leading > master! > > > > from slave > > > > root@oss002:~# /usr/local/sbin/mesos-slave --master=zk:// > > 138.113.121.10:2181 > > ,/etc > > I0221 00:53:39.928858 12586 main.cpp:118] Build: 2014-02-06 19:32:44 by > > root > > I0221 00:53:39.929018 12586 main.cpp:120] Creating "process" isolator > > I0221 00:53:39.929405 12586 main.cpp:132] Starting Mesos slave > > I0221 00:53:39.929795 12590 slave.cpp:111] Slave started on 1)@ > > 138.138.138.11:5051 > > 2014-02-21 00:53:39,929:12586(0x7f2d31e57700):ZOO_INFO@log_env@658: > Client > > environment:zookeeper.version=zookeeper C client 3.3.4 > > 2014-02-21 00:53:39,929:12586(0x7f2d31e57700):ZOO_INFO@log_env@662: > Client > > environment:host.name=oss002 > > 2014-02-21 00:53:39,929:12586(0x7f2d31e57700):ZOO_INFO@log_env@669: > Client > > environment:os.name=Linux > > 2014-02-21 00:53:39,929:12586(0x7f2d31e57700):ZOO_INFO@log_env@670: > Client > > environment:os.arch=3.8.0-29-generic > > 2014-02-21 00:53:39,930:12586(0x7f2d31e57700):ZOO_INFO@log_env@671: > Client > > environment:os.version=#42~precise1-Ubuntu SMP Wed Aug 14 16:19:23 UTC > 2013 > > I0221 00:53:39.930083 12590 slave.cpp:211] Slave resources: cpus(*):4; > > mem(*):15020; disk(*):115201; ports(*):[31000-32000] > > I0221 00:53:39.932523 12591 state.cpp:33] Recovering state from > > '/tmp/mesos/meta' > > I0221 00:53:39.932719 12591 state.cpp:62] Failed to find the latest slave > > from '/tmp/mesos/meta' > > I0221 00:53:39.932811 12591 status_update_manager.cpp:186] Recovering > > status update manager > > I0221 00:53:39.932881 12591 process_isolator.cpp:317] Recovering isolator > > I0221 00:53:39.932955 12591 slave.cpp:2752] Finished recovery > > 2014-02-21 00:53:39,960:12586(0x7f2d31e57700):ZOO_INFO@log_env@679: > Client > > environment:user.name=root > > 2014-02-21 00:53:39,960:12586(0x7f2d31e57700):ZOO_INFO@log_env@687: > Client > > environment:user.home=/root > > 2014-02-21 00:53:39,960:12586(0x7f2d31e57700):ZOO_INFO@log_env@699: > Client > > environment:user.dir=/root > > 2014-02-21 00:53:39,961:12586(0x7f2d31e57700):ZOO_INFO@zookeeper_init > @727: > > Initiating client connection, host=138.113.121.10:2181, > > sessionTimeout=10000 watcher=0x7f2d392b3e60 sessionId=0 > > sessionPasswd=<null> context=0x7f2d08000cc0 flags=0 > > 2014-02-21 00:53:39,961:12586(0x7f2d2da22700):ZOO_INFO@check_events > @1585: > > initiated connection to server [138.113.121.10:2181] > > 2014-02-21 00:53:39,963:12586(0x7f2d2da22700):ZOO_INFO@check_events > @1632: > > session establishment complete on server [138.113.121.10:2181], > > sessionId=0x14452bb562c0019, negotiated timeout=10000 > > I0221 00:53:39.963670 12590 group.cpp:310] Group process ((2)@ > > 138.138.138.11:5051) connected to ZooKeeper > > I0221 00:53:39.963760 12590 group.cpp:752] Syncing group operations: > queue > > size (joins, cancels, datas) = (0, 0, 0) > > I0221 00:53:39.963809 12590 group.cpp:367] Trying to create path '/etc' > in > > ZooKeeper > > I0221 00:53:39.964941 12593 detector.cpp:134] Detected a new leader: > > (id='0') > > I0221 00:53:39.965073 12593 group.cpp:629] Trying to get > '/etc/0000000000' > > in ZooKeeper > > I0221 00:53:39.965636 12588 detector.cpp:354] A new leading master (UPID= > > [email protected]:5050) is detected > > I0221 00:53:39.965703 12593 slave.cpp:500] New master detected at > > [email protected]:5050 > > I0221 00:53:39.965816 12588 status_update_manager.cpp:160] New master > > detected at [email protected]:5050 > > I0221 00:53:39.965916 12593 slave.cpp:525] Detecting new master > > I0221 00:54:39.931643 12593 slave.cpp:2602] Current usage 1.58%. Max > > allowed age: 6.189622121059202days > > > > /******************************************* > > Joe Stein > > Founder, Principal Consultant > > Big Data Open Source Security LLC > > http://www.stealth.ly > > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> > > ********************************************/ > > > > > > On Fri, Feb 21, 2014 at 2:22 AM, Vinod Kone <[email protected]> wrote: > > > > > Hey Joe. Some logs would help diagnose the issue. > > > > > > @vinodkone > > > Sent from my mobile > > > > > > > On Feb 20, 2014, at 10:58 PM, Joe Stein <[email protected]> > wrote: > > > > > > > > Hi, setting up a new cluster right now with 1x master, 1xZk and 2x > > slaves > > > > > > > > the slaves see the master leader election when I take it down and > back > > up > > > > > > > > and the slaves are showing Current usage 1.58%. Max allowed age: > > > > 6.189622802823576days > > > > > > > > but the slave information is not in the mesos user interface still > > > showing > > > > 0 slaves > > > > > > > > not sure what is wrong or what to-do next to fix whatever I am doing > > > wrong > > > > > > > > thanks in advance > > > > > > > > /******************************************* > > > > Joe Stein > > > > Founder, Principal Consultant > > > > Big Data Open Source Security LLC > > > > http://www.stealth.ly > > > > Twitter: @allthingshadoop <http://www.twitter.com/allthingshadoop> > > > > ********************************************/ > > > > > >
