Thanks Vinod. Seems like the mesos slaves didn't have enough resources to run the job. I got the issue fixed by adding more memory to the VM.
Now the job fails at the slave, just like you experienced sometime back here: http://goo.gl/3892hQ My slave log says E0825 23:12:33.692514 14798 slave.cpp:2310] Container '7f728847-bf84-4c53-ba2e-1e1b14498e1a' for executor 'myTopo-1-1409008217' of framework '20140825-225607-253864128-5050-15735-0002' failed to start: Invalid user: nonexistent What does "Invalid user: nonexistent" means? Any idea? Thanks, Eran Chinthaka Withana On Mon, Aug 25, 2014 at 2:51 PM, Vinod Kone <[email protected]> wrote: > I don't know enough about storm, but on the mesos side you can run the > master with more logging (by setting GLOG_v=1 in the environment). That > will show you how many resources are being offered to the framework. FWICT, > it looks like the storm framework is declining the offer(s) possible > because the offer doesn't contain enough resources to launch the topology. > > > On Mon, Aug 25, 2014 at 1:40 PM, Eran Chinthaka Withana < > [email protected]> wrote: > >> Hi, >> >> I have mesos master and storm setup on the same node and two mesos >> slaves. >> >> I followed the instructions given here: >> https://mesosphere.io/learn/run-storm-on-mesos/. Everything went fine >> and I submitted the topology. But seems like storm is not getting any slots >> from mesos. Here is what I see in nimbus log[1]. >> >> Then I looked at the master.log in mesos master and here[2] is what I see >> there. Framework 20140823-165131-253864128-5050-12340-0002 is storm. >> >> Then I looked at slave but it doesn't have anything related to the >> framework in any of the logs. >> >> Seems like the mesos slaves doesn't have slots to run but the master says >> (in UI) that both the slaves are idle. Really appreciate if some one can >> help me to understand whats happening and possibly to fix this. >> >> Thanks, >> Eran >> >> >> >> [1] >> >> 2014-08-25 20:23:19 s.m.MesosNimbus [INFO] Number of available slots: 0 >> >> 2014-08-25 20:23:29 s.m.MesosNimbus [INFO] Currently have 0 offers >> buffered >> >> 2014-08-25 20:23:29 s.m.MesosNimbus [INFO] Topologies that need >> assignments: #{"myTopo2-2-1408992722"} >> >> 2014-08-25 20:23:29 s.m.MesosNimbus [INFO] Number of available slots: 0 >> >> 2014-08-25 20:23:39 s.m.MesosNimbus [INFO] Currently have 1 offers >> buffered >> >> 2014-08-25 20:23:39 s.m.MesosNimbus [INFO] Topologies that need >> assignments: #{"myTopo2-2-1408992722"} >> >> 2014-08-25 20:23:39 s.m.MesosNimbus [INFO] Number of available slots: 0 >> >> 2014-08-25 20:23:49 s.m.MesosNimbus [INFO] Currently have 0 offers >> buffered >> >> 2014-08-25 20:23:49 s.m.MesosNimbus [INFO] Topologies that need >> assignments: #{"myTopo2-2-1408992722"} >> >> 2014-08-25 20:23:49 s.m.MesosNimbus [INFO] Number of available slots: 0 >> >> 2014-08-25 20:23:59 s.m.MesosNimbus [INFO] Currently have 0 offers >> buffered >> >> 2014-08-25 20:23:59 s.m.MesosNimbus [INFO] Topologies that need >> assignments: #{"myTopo2-2-1408992722"} >> >> 2014-08-25 20:23:59 s.m.MesosNimbus [INFO] Number of available slots: 0 >> >> 2014-08-25 20:24:09 s.m.MesosNimbus [INFO] Currently have 1 offers >> buffered >> >> 2014-08-25 20:24:09 s.m.MesosNimbus [INFO] Topologies that need >> assignments: #{"myTopo2-2-1408992722"} >> >> 2014-08-25 20:24:09 s.m.MesosNimbus [INFO] Number of available slots: 0 >> >> 2014-08-25 20:24:19 s.m.MesosNimbus [INFO] Currently have 0 offers >> buffered >> >> 2014-08-25 20:24:19 s.m.MesosNimbus [INFO] Topologies that need >> assignments: #{"myTopo2-2-1408992722"} >> >> 2014-08-25 20:24:19 s.m.MesosNimbus [INFO] Number of available slots: 0 >> >> 2014-08-25 20:24:29 s.m.MesosNimbus [INFO] Currently have 0 offers >> buffered >> >> >> [2] >> >> I0825 20:34:27.507935 5968 master.cpp:2933] Sending 1 offers to >> framework 20140823-165131-253864128-5050-12340-0002 >> >> I0825 20:34:28.033262 5973 master.cpp:1889] Processing reply for offers: >> [ 20140825-193117-253864128-5050-5956-2432 ] on slave >> 20140823-165940-253864128-5050-19121-1 at slave(1)@192.168.33.17:5051 >> (192.168.33.17) for framework 20140823-165131-253864128-5050-12340-0002 >> >> I0825 20:34:28.033370 5973 hierarchical_allocator_process.hpp:589] >> Framework 20140823-165131-253864128-5050-12340-0002 filtered slave >> 20140823-165940-253864128-5050-19121-1 for 5secs >> >> I0825 20:34:28.508379 5970 master.cpp:2933] Sending 1 offers to >> framework 20140823-165131-253864128-5050-12340-0002 >> >> Thanks, >> Eran Chinthaka Withana >> > >
