Re: Optimal resource allocation
Hi Dario, Cool! I will look forward for that. Regards, Pradeep On 5 February 2015 at 14:09, Dario Rexin da...@mesosphere.io wrote: Hi Pradeep, I am actually working on a patch for ARM support. I already have Mesos running on ARMv7, just need to polish it a bit and I still have 1 failing test. Expect news about this soon. Cheers, Dario On Feb 5, 2015, at 1:46 PM, Pradeep Kiruvale pradeepkiruv...@gmail.com wrote: Hi Dario, Thanks for the reply and clarification. How hard is to port to ARM? is there lot of architecture related code? Any idea? Regards, Pradeep On 5 February 2015 at 12:01, Dario Rexin da...@mesosphere.io wrote: There is currently no support for ARM cpus. GPUs and FPGAs could be added to the resources in the future but are also not supported yet. Scheduling tasks on machines that have a specific configuration (powerful GPU or sth like that) can be done with attributes. There's however no way to isolate those resources like we do with CPU and RAM. On 05.02.2015, at 11:10, Chengwei Yang chengwei.yang...@gmail.com wrote: On Thu, Feb 05, 2015 at 12:00:28AM +0100, Pradeep Kiruvale wrote: Hi All, I am new to Mesos and I have heard and read lot about it. I have few doubts regarding the resource allocation by the mesos, please help me to clarify my doubts. In a data center, if there are thousands of heterogeneous nodes (x86,arm,gpu,fpgas) then is the mesos can really allocate a co-located First, does mesos can run on arm, gpu, fpga? Seconds, does your tasks run on all archs? -- Thanks, Chengwei resources for any incoming application to finish the task faster? How these resource constraints are solved? what kind of a constraint solver it uses? Is the policy maker configurable? Thanks Regards, Pradeep
Re: Optimal resource allocation
Hi Timothy, Thanks for your reply. Ya, even I also would like to consider all the dimensions while scheduling an application, but here I just mentioned one dimension. But I did not understand what do you mean by the two level scheduler? You mean some scheduling decisions happen in master level and some in slave level? And how these decisions are made? is it uses best fit algorithm at master? Regards, Pradeep On 5 February 2015 at 14:55, Timothy Chen t...@mesosphere.io wrote: Hi Pradeep, First of all I think the notion of optimal is not just a single dimension of being task duration, but also considering lots of other dimensions such as throughput, fairness, latency, SLA and more. Mesos is a two level scheduler, which means it's not doing all the scheduling at a single point (master), but instead cooperate with frameworks to have a good scheduling decision. So Mesos can achieve it with multiple attributes or resources as you mentioned with the help of frameworks. Tim On Feb 5, 2015, at 9:09 PM, Dario Rexin da...@mesosphere.io wrote: Hi Pradeep, I am actually working on a patch for ARM support. I already have Mesos running on ARMv7, just need to polish it a bit and I still have 1 failing test. Expect news about this soon. Cheers, Dario On Feb 5, 2015, at 1:46 PM, Pradeep Kiruvale pradeepkiruv...@gmail.com wrote: Hi Dario, Thanks for the reply and clarification. How hard is to port to ARM? is there lot of architecture related code? Any idea? Regards, Pradeep On 5 February 2015 at 12:01, Dario Rexin da...@mesosphere.io wrote: There is currently no support for ARM cpus. GPUs and FPGAs could be added to the resources in the future but are also not supported yet. Scheduling tasks on machines that have a specific configuration (powerful GPU or sth like that) can be done with attributes. There's however no way to isolate those resources like we do with CPU and RAM. On 05.02.2015, at 11:10, Chengwei Yang chengwei.yang...@gmail.com wrote: On Thu, Feb 05, 2015 at 12:00:28AM +0100, Pradeep Kiruvale wrote: Hi All, I am new to Mesos and I have heard and read lot about it. I have few doubts regarding the resource allocation by the mesos, please help me to clarify my doubts. In a data center, if there are thousands of heterogeneous nodes (x86,arm,gpu,fpgas) then is the mesos can really allocate a co-located First, does mesos can run on arm, gpu, fpga? Seconds, does your tasks run on all archs? -- Thanks, Chengwei resources for any incoming application to finish the task faster? How these resource constraints are solved? what kind of a constraint solver it uses? Is the policy maker configurable? Thanks Regards, Pradeep
Re: Optimal resource allocation
Hi Chengwei, Find my replies inline On Thu, Feb 05, 2015 at 12:00:28AM +0100, Pradeep Kiruvale wrote: Hi All, I am new to Mesos and I have heard and read lot about it. I have few doubts regarding the resource allocation by the mesos, please help me to clarify my doubts. In a data center, if there are thousands of heterogeneous nodes (x86,arm,gpu,fpgas) then is the mesos can really allocate a co-located First, does mesos can run on arm, gpu, fpga? I dont have any idea. Seconds, does your tasks run on all archs? Especially HPC workloads will be. Regards, Pradeep -- Thanks, Chengwei resources for any incoming application to finish the task faster? How these resource constraints are solved? what kind of a constraint solver it uses? Is the policy maker configurable? Thanks Regards, Pradeep
Re: Optimal resource allocation
Hi Pradeep, First of all I think the notion of optimal is not just a single dimension of being task duration, but also considering lots of other dimensions such as throughput, fairness, latency, SLA and more. Mesos is a two level scheduler, which means it's not doing all the scheduling at a single point (master), but instead cooperate with frameworks to have a good scheduling decision. So Mesos can achieve it with multiple attributes or resources as you mentioned with the help of frameworks. Tim On Feb 5, 2015, at 9:09 PM, Dario Rexin da...@mesosphere.io wrote: Hi Pradeep, I am actually working on a patch for ARM support. I already have Mesos running on ARMv7, just need to polish it a bit and I still have 1 failing test. Expect news about this soon. Cheers, Dario On Feb 5, 2015, at 1:46 PM, Pradeep Kiruvale pradeepkiruv...@gmail.com wrote: Hi Dario, Thanks for the reply and clarification. How hard is to port to ARM? is there lot of architecture related code? Any idea? Regards, Pradeep On 5 February 2015 at 12:01, Dario Rexin da...@mesosphere.io wrote: There is currently no support for ARM cpus. GPUs and FPGAs could be added to the resources in the future but are also not supported yet. Scheduling tasks on machines that have a specific configuration (powerful GPU or sth like that) can be done with attributes. There's however no way to isolate those resources like we do with CPU and RAM. On 05.02.2015, at 11:10, Chengwei Yang chengwei.yang...@gmail.com wrote: On Thu, Feb 05, 2015 at 12:00:28AM +0100, Pradeep Kiruvale wrote: Hi All, I am new to Mesos and I have heard and read lot about it. I have few doubts regarding the resource allocation by the mesos, please help me to clarify my doubts. In a data center, if there are thousands of heterogeneous nodes (x86,arm,gpu,fpgas) then is the mesos can really allocate a co-located First, does mesos can run on arm, gpu, fpga? Seconds, does your tasks run on all archs? -- Thanks, Chengwei resources for any incoming application to finish the task faster? How these resource constraints are solved? what kind of a constraint solver it uses? Is the policy maker configurable? Thanks Regards, Pradeep
Re: Mesos-slave start error
Hi Siva, it looks like you bumped into https://issues.apache.org/jira/browse/MESOS-2276. Feel free to upvote! On Thu, Feb 5, 2015 at 1:56 PM, Sivaram Kannan sivara...@gmail.com wrote: Hi, I am our deployments of mesos-slave, we are getting the following error during start up. I understand the slave is failing due to large number of fd's being opened. I have increased the ulimit of fd's to 4096 from 1024 but still the same behavior. What can I do to solve this problem, and what should I do to prevent it. Thanks, ./Siva. Initiating client connection, host=11.0.190.1:2181 sessionTimeout=1 watcher=0x7f6de4 Feb 05 12:33:58 node-d4856455ad5c sh[32162]: I0205 12:33:58.07628915 slave.cpp:169] Slave started on 1)@11.1.6.1:5051 Feb 05 12:33:58 node-d4856455ad5c sh[32162]: I0205 12:33:58.07654415 slave.cpp:289] Slave resources: cpus(*):24; mem(*):47336; disk(*):469416; ports(*):[31000-32000] Feb 05 12:33:58 node-d4856455ad5c sh[32162]: I0205 12:33:58.07657515 slave.cpp:318] Slave hostname: 11.1.6.1 Feb 05 12:33:58 node-d4856455ad5c sh[32162]: I0205 12:33:58.07658215 slave.cpp:319] Slave checkpoint: true Feb 05 12:33:58 node-d4856455ad5c sh[32162]: I0205 12:33:58.07813525 state.cpp:33] Recovering state from '/var/lib/mesos/slave/meta' Feb 05 12:33:58 node-d4856455ad5c sh[32162]: I0205 12:33:58.07823320 status_update_manager.cpp:197] Recovering status update manager Feb 05 12:33:58 node-d4856455ad5c sh[32162]: I0205 12:33:58.07833320 docker.cpp:767] Recovering Docker containers Feb 05 12:33:58 node-d4856455ad5c sh[32162]: 2015-02-05 12:33:58,102:6(0x7f6dc3fff700):ZOO_INFO@check_events@1703: initiated connection to server [11.0.190.1:2181] Feb 05 12:33:58 node-d4856455ad5c sh[32162]: 2015-02-05 12:33:58,104:6(0x7f6dc3fff700):ZOO_INFO@check_events@1750: session establishment complete on server [11.0.190.1:2181], sessionId=0x14b3c82555299c7, Feb 05 12:33:58 node-d4856455ad5c sh[32162]: I0205 12:33:58.10467130 group.cpp:313] Group process (group(1)@11.1.6.1:5051) connected to ZooKeeper Feb 05 12:33:58 node-d4856455ad5c sh[32162]: I0205 12:33:58.10470830 group.cpp:790] Syncing group operations: queue size (joins, cancels, datas) = (0, 0, 0) Feb 05 12:33:58 node-d4856455ad5c sh[32162]: I0205 12:33:58.10472530 group.cpp:385] Trying to create path '/mesos' in ZooKeeper Feb 05 12:33:58 node-d4856455ad5c sh[32162]: I0205 12:33:58.10637622 detector.cpp:138] Detected a new leader: (id='3') Feb 05 12:33:58 node-d4856455ad5c sh[32162]: I0205 12:33:58.10647725 group.cpp:659] Trying to get '/mesos/info_03' in ZooKeeper Feb 05 12:33:58 node-d4856455ad5c sh[32162]: I0205 12:33:58.10729330 detector.cpp:433] A new leading master (UPID=master@11.1.4.1:5050) is detected Feb 05 12:33:58 node-d4856455ad5c sh[32162]: Failed to perform recovery: Collect failed: Failed to create pipe: Too many open files Feb 05 12:33:58 node-d4856455ad5c sh[32162]: To remedy this do as follows: Feb 05 12:33:58 node-d4856455ad5c sh[32162]: Step 1: rm -f /var/lib/mesos/slave/meta/slaves/latest Feb 05 12:33:58 node-d4856455ad5c sh[32162]: This ensures slave doesn't recover old live executors. Feb 05 12:33:58 node-d4856455ad5c sh[32162]: Step 2: Restart the slave. Feb 05 12:33:58 node-d4856455ad5c systemd[1]: mesos-slave.service: main process exited, code=exited, status=1/FAILURE Feb 05 12:33:58 node-d4856455ad5c docker[3351]: mesos_slave Feb 05 12:33:58 node-d4856455ad5c systemd[1]: Unit mesos-slave.service entered failed state.
Re: Optimal resource allocation
Hi Billy, Thanks for the reply. This is helpful for understanding the Mesos deeper. Regards, Pradeep On 5 February 2015 at 10:01, Billy Bones gael.ther...@gmail.com wrote: WARNING: The following assumption is based on my little understanding of mesos architecture and internals, you should not take it as a definitive answer and may wait for more experimented suggestions. About my little understanding of the mesos ressource allocation process, I think that on your kind of environnements (ARM / x86 / GPU / FPGA) it will not really allocate them wisely as the default algorithm is not so smart and consider ressources as commodities and not their real speed etc. I read some topics earlier about the necessity to improve this specific part of the kernel, but It didn't mention your archs and focused deeply on the x86 family. I think that integrate the GPUs and FPGAs would be awesome! One nice feature would be that the master look at the registered slaves deeper regarding their archs and ressources perfomance before offers any ressource to a task. This kind of feature could be implement when the slave try to register to the master as a pre-fly test (Benchmark??). That would then add smartest offers and ressource scheduling. Anyway, long story short, I don't think so, but you should way for more experimented answers. 2015-02-05 0:00 GMT+01:00 Pradeep Kiruvale pradeepkiruv...@gmail.com: Hi All, I am new to Mesos and I have heard and read lot about it. I have few doubts regarding the resource allocation by the mesos, please help me to clarify my doubts. In a data center, if there are thousands of heterogeneous nodes (x86,arm,gpu,fpgas) then is the mesos can really allocate a co-located resources for any incoming application to finish the task faster? How these resource constraints are solved? what kind of a constraint solver it uses? Is the policy maker configurable? Thanks Regards, Pradeep
Re: Optimal resource allocation
Hi Pradeep, I am actually working on a patch for ARM support. I already have Mesos running on ARMv7, just need to polish it a bit and I still have 1 failing test. Expect news about this soon. Cheers, Dario On Feb 5, 2015, at 1:46 PM, Pradeep Kiruvale pradeepkiruv...@gmail.com wrote: Hi Dario, Thanks for the reply and clarification. How hard is to port to ARM? is there lot of architecture related code? Any idea? Regards, Pradeep On 5 February 2015 at 12:01, Dario Rexin da...@mesosphere.io mailto:da...@mesosphere.io wrote: There is currently no support for ARM cpus. GPUs and FPGAs could be added to the resources in the future but are also not supported yet. Scheduling tasks on machines that have a specific configuration (powerful GPU or sth like that) can be done with attributes. There's however no way to isolate those resources like we do with CPU and RAM. On 05.02.2015, at 11:10, Chengwei Yang chengwei.yang...@gmail.com mailto:chengwei.yang...@gmail.com wrote: On Thu, Feb 05, 2015 at 12:00:28AM +0100, Pradeep Kiruvale wrote: Hi All, I am new to Mesos and I have heard and read lot about it. I have few doubts regarding the resource allocation by the mesos, please help me to clarify my doubts. In a data center, if there are thousands of heterogeneous nodes (x86,arm,gpu,fpgas) then is the mesos can really allocate a co-located First, does mesos can run on arm, gpu, fpga? Seconds, does your tasks run on all archs? -- Thanks, Chengwei resources for any incoming application to finish the task faster? How these resource constraints are solved? what kind of a constraint solver it uses? Is the policy maker configurable? Thanks Regards, Pradeep
Re: Optimal resource allocation
Hi Alex, Thanks for the clarification. Regards, Pradeep On 5 February 2015 at 15:23, Alex Rukletsov a...@mesosphere.io wrote: Pradeep, by two level scheduling is meant that the decision on how to use a certain resource offer is delegated to the framework. It's a framework's scheduler that decides whether to make use of the incoming offer or to reject it and wait for another more suitable one based on the resource type it's offered and / or attributes associated with the offered slave. On Thu, Feb 5, 2015 at 3:02 PM, Pradeep Kiruvale pradeepkiruv...@gmail.com wrote: Hi Timothy, Thanks for your reply. Ya, even I also would like to consider all the dimensions while scheduling an application, but here I just mentioned one dimension. But I did not understand what do you mean by the two level scheduler? You mean some scheduling decisions happen in master level and some in slave level? And how these decisions are made? is it uses best fit algorithm at master? Regards, Pradeep On 5 February 2015 at 14:55, Timothy Chen t...@mesosphere.io wrote: Hi Pradeep, First of all I think the notion of optimal is not just a single dimension of being task duration, but also considering lots of other dimensions such as throughput, fairness, latency, SLA and more. Mesos is a two level scheduler, which means it's not doing all the scheduling at a single point (master), but instead cooperate with frameworks to have a good scheduling decision. So Mesos can achieve it with multiple attributes or resources as you mentioned with the help of frameworks. Tim On Feb 5, 2015, at 9:09 PM, Dario Rexin da...@mesosphere.io wrote: Hi Pradeep, I am actually working on a patch for ARM support. I already have Mesos running on ARMv7, just need to polish it a bit and I still have 1 failing test. Expect news about this soon. Cheers, Dario On Feb 5, 2015, at 1:46 PM, Pradeep Kiruvale pradeepkiruv...@gmail.com wrote: Hi Dario, Thanks for the reply and clarification. How hard is to port to ARM? is there lot of architecture related code? Any idea? Regards, Pradeep On 5 February 2015 at 12:01, Dario Rexin da...@mesosphere.io wrote: There is currently no support for ARM cpus. GPUs and FPGAs could be added to the resources in the future but are also not supported yet. Scheduling tasks on machines that have a specific configuration (powerful GPU or sth like that) can be done with attributes. There's however no way to isolate those resources like we do with CPU and RAM. On 05.02.2015, at 11:10, Chengwei Yang chengwei.yang...@gmail.com wrote: On Thu, Feb 05, 2015 at 12:00:28AM +0100, Pradeep Kiruvale wrote: Hi All, I am new to Mesos and I have heard and read lot about it. I have few doubts regarding the resource allocation by the mesos, please help me to clarify my doubts. In a data center, if there are thousands of heterogeneous nodes (x86,arm,gpu,fpgas) then is the mesos can really allocate a co-located First, does mesos can run on arm, gpu, fpga? Seconds, does your tasks run on all archs? -- Thanks, Chengwei resources for any incoming application to finish the task faster? How these resource constraints are solved? what kind of a constraint solver it uses? Is the policy maker configurable? Thanks Regards, Pradeep
Re: Difficulties building mesos-21.1-rc2 {rc1, .1 , .0}. Linux
stout, libprocess should have all their headers installed during 'make
install' currently.
MESOS-2096[1] tracks some of it. Other bits have happened as people tried
building with the various flags and find bugs.
Some bugs in the area which have been fixed are MESOS-2113, MESOS-1839,
MESOS-1843
[1] https://issues.apache.org/jira/browse/MESOS-2096
On Thu, Feb 5, 2015 at 10:13 AM, Alexander Gallego agall...@rbonut.com
wrote:
Thanks Cody.
I'll start work from the master branch on github and see how far I get.
I guess we'll just need to ensure stout,http parser, etc are copied to
/usr/local and have our own build of mesos.
Thanks again for your help. Are there specific Jira issues I can monitor?
I'm building a messaging infrastructure and mesos is the foundation.
-ag
Sent from my iPhone
On Feb 4, 2015, at 8:32 PM, Cody Maloney c...@mesosphere.io wrote:
Some of the --with options are broken, and others have only been recently
fixed. The best option with 0.21.1 is to use --disable-bundled at which
point your system search paths just need to be configured correctly to find
everything.
The story around the `--with-{glog,zlib,curl,sasl}` and the like should be
getting better with 0.22.0 because people are working on building mesos
modules outside of the mesos source tree, which requires the module and
mesos use the same version of dependent libraries in many cases.
On Wed, Feb 4, 2015 at 5:26 PM, Alexander Gallego agall...@rbonut.com
wrote:
In fact, I took the one from inside mesos (didn't apply the .patch file
though), but other libs depend on it, that don't depend on mesos (i.e.
fbthrif )
Sincerely,
Alexander Gallego
On Wed, Feb 4, 2015 at 8:24 PM, Alexander Gallego agall...@rbonut.com
wrote:
Ian,
Thanks for taking a look. I am running 0.3.3 (latest i think)
Sincerely,
Alexander Gallego
On Wed, Feb 4, 2015 at 8:09 PM, Ian Downes idow...@twitter.com wrote:
What version of glog are you trying to us? It appears the
CheckOpMessageBuilder class was introduced in 0.3.3
http://upstream.rosalinux.ru/compat_reports/glog/0.3.2_to_0.3.3/abi_compat_report.html
On Wed, Feb 4, 2015 at 4:52 PM, Alexander Gallego agall...@rbonut.com
wrote:
I did a little more exploration and to be concise, this is more or
less what I want
(valid configuration)
./configure \
--with-gnu-ld \
--enable-static=no \
--with-gmock=/home/agallego/.bolt/gmock-1.6.0 \
--with-glog=/usr/local \
--with-zlib=/usr/local \
--with-sasl=/usr/local \
--with-curl=/usr/local \
--with-zookeeper=/usr/local \
--enable-optimize
Attached is my Makefile (./configure generates) the error log (glog
mentioned in my earlier gist)
Thanks!
Sincerely,
Alexander Gallego
On Wed, Feb 4, 2015 at 4:28 PM, Alexander Gallego agall...@rbonut.com
wrote:
I wanted to post configuration formatted, so gisted my issue.
Thank you in advance.
https://gist.github.com/senior7515/bc1a03edcbbe9b7cd7bf
Not sure if I should inline the question too. Tips appreciated.
-ag
Sincerely,
Alexander Gallego
Re: Optimal resource allocation
HI Tim, Thanks for the clarification and for the url. I will go through it. Regards, Pradeep On 5 February 2015 at 15:23, Tim Chen t...@mesosphere.io wrote: Hi Pradeep, You can find more information here http://mesos.apache.org/documentation/latest/mesos-architecture/, and also the paper that is in the web page. But yes, resource offers are chosen by the master based on the scheduler chosen (although the only implementation is based on dominant resource fairness), and frameworks based on the offers choose to launch tasks with them or not with local scheduling decisions. Tim On Thu, Feb 5, 2015 at 10:02 PM, Pradeep Kiruvale pradeepkiruv...@gmail.com wrote: Hi Timothy, Thanks for your reply. Ya, even I also would like to consider all the dimensions while scheduling an application, but here I just mentioned one dimension. But I did not understand what do you mean by the two level scheduler? You mean some scheduling decisions happen in master level and some in slave level? And how these decisions are made? is it uses best fit algorithm at master? Regards, Pradeep On 5 February 2015 at 14:55, Timothy Chen t...@mesosphere.io wrote: Hi Pradeep, First of all I think the notion of optimal is not just a single dimension of being task duration, but also considering lots of other dimensions such as throughput, fairness, latency, SLA and more. Mesos is a two level scheduler, which means it's not doing all the scheduling at a single point (master), but instead cooperate with frameworks to have a good scheduling decision. So Mesos can achieve it with multiple attributes or resources as you mentioned with the help of frameworks. Tim On Feb 5, 2015, at 9:09 PM, Dario Rexin da...@mesosphere.io wrote: Hi Pradeep, I am actually working on a patch for ARM support. I already have Mesos running on ARMv7, just need to polish it a bit and I still have 1 failing test. Expect news about this soon. Cheers, Dario On Feb 5, 2015, at 1:46 PM, Pradeep Kiruvale pradeepkiruv...@gmail.com wrote: Hi Dario, Thanks for the reply and clarification. How hard is to port to ARM? is there lot of architecture related code? Any idea? Regards, Pradeep On 5 February 2015 at 12:01, Dario Rexin da...@mesosphere.io wrote: There is currently no support for ARM cpus. GPUs and FPGAs could be added to the resources in the future but are also not supported yet. Scheduling tasks on machines that have a specific configuration (powerful GPU or sth like that) can be done with attributes. There's however no way to isolate those resources like we do with CPU and RAM. On 05.02.2015, at 11:10, Chengwei Yang chengwei.yang...@gmail.com wrote: On Thu, Feb 05, 2015 at 12:00:28AM +0100, Pradeep Kiruvale wrote: Hi All, I am new to Mesos and I have heard and read lot about it. I have few doubts regarding the resource allocation by the mesos, please help me to clarify my doubts. In a data center, if there are thousands of heterogeneous nodes (x86,arm,gpu,fpgas) then is the mesos can really allocate a co-located First, does mesos can run on arm, gpu, fpga? Seconds, does your tasks run on all archs? -- Thanks, Chengwei resources for any incoming application to finish the task faster? How these resource constraints are solved? what kind of a constraint solver it uses? Is the policy maker configurable? Thanks Regards, Pradeep
Re: Mesos Community Meetings
Heads up that this is happening in an hour. On Tue, Jan 20, 2015 at 4:10 PM, Vinod Kone vinodk...@gmail.com wrote: Thanks for the interest. The next meeting will be on 5th February, 3-5 pm PST. The hangout link: https://plus.google.com/hangouts/_/twitter.com/mesos-sync On Tue, Jan 6, 2015 at 9:13 AM, Tim St Clair tstcl...@redhat.com wrote: +1, also +1 re: calendar. -- *From: *David J. Palaitis david.j.palai...@gmail.com *To: *user@mesos.apache.org *Sent: *Tuesday, January 6, 2015 6:02:40 AM *Subject: *Re: Mesos Community Meetings I'm also interested. Thanks for organizing. On Mon, Jan 5, 2015 at 11:02 PM, James DeFelice james.defel...@gmail.com wrote: +1 for open meetings --sent from my phone On Jan 5, 2015 10:09 PM, Dave Lester daveles...@gmail.com wrote: I'm a big fan of this idea, thanks Niklas for proposing it! On Mon, Jan 5, 2015 at 6:27 PM, Arunabha Ghosh arunabha...@gmail.com wrote: +1 to hangouts, but I think hangouts has a limit of max 10 people in the hangout. On Mon, Jan 5, 2015 at 4:52 PM, Tom Arnfeld t...@duedil.com wrote: +1 also! Very interesting to hear what’s being discussed. +1 on the google hangouts if these meetings are happening in person so we can listen along. -- Tom Arnfeld Developer // DueDil On Monday, Dec 29, 2014 at 4:12 pm, Chris Aniszczyk caniszc...@gmail.com, wrote: +1 to opening up meetings! How about create a google calendar with the meetings, agenda and info? Also someone should take meeting minutes and publish them to the list after each meeting for those who can't attend (on top of making information more discoverable via search). Another approach is to use IRC meetings which there's a bot to record meetings, but that lacks the visual aspect of GH (e.g., see IRC meeting notes from Aurora: http://mail-archives.apache.org/mod_mbox/incubator-aurora-dev/201412.mbox/%3C20141201192131.4888419FD5%40urd.zones.apache.org%3E ) Anyways, glad to see this finally happening. On Mon, Dec 29, 2014 at 7:46 AM, Niklas Nielsen nik...@mesosphere.io wrote:Hi everyone, Mesosphere and Twitter has been meeting up regularly to brief and discuss current joint efforts in the Mesos project. While this has worked great for the engineering teams, it should be a community wide meeting as we discuss our agendas, timelines etc. which is useful for a broader audience. Unfortunately, we cannot host people on-site, but we can open Google hangouts for all upcoming meetings. Any thoughts or suggestions? Best regards, Niklas -- Cheers, Chris Aniszczyk http://aniszczyk.org +1 512 961 6719 -- Cheers, Timothy St. Clair Red Hat Inc.
Re: Mesos Community Meetings
Thanks much for the invite. Good to see faces associated with much great work going on in the community. Sorry, had to drop out a bit sooner due to some family chore popping up On Thu, Feb 5, 2015 at 1:55 PM, Vinod Kone vinodk...@apache.org wrote: Heads up that this is happening in an hour. On Tue, Jan 20, 2015 at 4:10 PM, Vinod Kone vinodk...@gmail.com wrote: Thanks for the interest. The next meeting will be on 5th February, 3-5 pm PST. The hangout link: https://plus.google.com/hangouts/_/twitter.com/mesos-sync On Tue, Jan 6, 2015 at 9:13 AM, Tim St Clair tstcl...@redhat.com wrote: +1, also +1 re: calendar. -- *From: *David J. Palaitis david.j.palai...@gmail.com *To: *user@mesos.apache.org *Sent: *Tuesday, January 6, 2015 6:02:40 AM *Subject: *Re: Mesos Community Meetings I'm also interested. Thanks for organizing. On Mon, Jan 5, 2015 at 11:02 PM, James DeFelice james.defel...@gmail.com wrote: +1 for open meetings --sent from my phone On Jan 5, 2015 10:09 PM, Dave Lester daveles...@gmail.com wrote: I'm a big fan of this idea, thanks Niklas for proposing it! On Mon, Jan 5, 2015 at 6:27 PM, Arunabha Ghosh arunabha...@gmail.com wrote: +1 to hangouts, but I think hangouts has a limit of max 10 people in the hangout. On Mon, Jan 5, 2015 at 4:52 PM, Tom Arnfeld t...@duedil.com wrote: +1 also! Very interesting to hear what’s being discussed. +1 on the google hangouts if these meetings are happening in person so we can listen along. -- Tom Arnfeld Developer // DueDil On Monday, Dec 29, 2014 at 4:12 pm, Chris Aniszczyk caniszc...@gmail.com, wrote: +1 to opening up meetings! How about create a google calendar with the meetings, agenda and info? Also someone should take meeting minutes and publish them to the list after each meeting for those who can't attend (on top of making information more discoverable via search). Another approach is to use IRC meetings which there's a bot to record meetings, but that lacks the visual aspect of GH (e.g., see IRC meeting notes from Aurora: http://mail-archives.apache.org/mod_mbox/incubator-aurora-dev/201412.mbox/%3C20141201192131.4888419FD5%40urd.zones.apache.org%3E ) Anyways, glad to see this finally happening. On Mon, Dec 29, 2014 at 7:46 AM, Niklas Nielsen nik...@mesosphere.io wrote:Hi everyone, Mesosphere and Twitter has been meeting up regularly to brief and discuss current joint efforts in the Mesos project. While this has worked great for the engineering teams, it should be a community wide meeting as we discuss our agendas, timelines etc. which is useful for a broader audience. Unfortunately, we cannot host people on-site, but we can open Google hangouts for all upcoming meetings. Any thoughts or suggestions? Best regards, Niklas -- Cheers, Chris Aniszczyk http://aniszczyk.org +1 512 961 6719 -- Cheers, Timothy St. Clair Red Hat Inc.
Re: Mesosphere on Centos 6.6
This is due to the upstart scripts shipped with the RPM. mesos has been shipping these since at least 0.17.x (as that's when we started using it). Where's the repo to send a PR to correct the docs? On 5 February 2015 at 09:48, Chengwei Yang chengwei.yang...@gmail.com wrote: On Mon, Feb 02, 2015 at 04:58:43PM -0800, Viswanathan Ramachandran wrote: Hi, I followed instructions to setup multi-node mesos cluster on CentOS 6.6 using http://mesosphere.com/docs/getting-started/datacenter/install/ I found that I was able to install zookeeper, mesos and marathon using yum without any issues. No errors during install. However, there was no service mesos-master or mesos-slave or marathon installed. Any restart command issued would result in unrecognized service. Try # start mesos-master/mesos-slave instead. -- Thanks, Chengwei That said the binaries were all in tact. I used ubuntu-trusty VMs instead, and was able to install as per instructions. Any updated instructions for CentOS 6 available? Thanks Vish
Re: Optimal resource allocation
On Thu, Feb 05, 2015 at 12:00:28AM +0100, Pradeep Kiruvale wrote: Hi All, I am new to Mesos and I have heard and read lot about it. I have few doubts regarding the resource allocation by the mesos, please help me to clarify my doubts. In a data center, if there are thousands of heterogeneous nodes (x86,arm,gpu,fpgas) then is the mesos can really allocate a co-located First, does mesos can run on arm, gpu, fpga? Seconds, does your tasks run on all archs? -- Thanks, Chengwei resources for any incoming application to finish the task faster? How these resource constraints are solved? what kind of a constraint solver it uses? Is the policy maker configurable? Thanks Regards, Pradeep signature.asc Description: Digital signature
Re: Optimal resource allocation
On 02/04/2015 06:00 PM, Pradeep Kiruvale wrote: In a data center, if there are thousands of heterogeneous nodes (x86,arm,gpu,fpgas) then is the mesos can really allocate a co-located resources for any incoming application to finish the task faster? Thanks Regards, Pradeep Hello Pradeep, We have similar interest, only I'm working on a small scale to prototype ( 50 systems). I think we need a special work group to address GPU, aarch64 (arm 64 bit) and FPGA codes that could work with mesos. I think custom frameworks, that are problem-domain specific is the current best approach for code development on specialized processors. Drop me some private email or post to a new thread on specific hardware you have in mind and what you think is the path forward. I have an extensive background in embedded linux on a myriad of processors. I do think a sVinit centric solution is the best path forward. Look at a previous thread: cluster wide init. My mesos on gentoo seems to be working fine, using openrc, but I've not completed testing deeply of the features and other codes on top of mesos listed here: [1]. Therefore, I'd like to see mesos robustly support both systemd and sVinit (openrc is my choice, as I use gentoo linux) because the vast majority of embedded linux systems use sVinit or even more primitive mechanisms to achieve a minimal footprint of the executable binaries. hth, James [1] https://github.com/dharmeshkakadia/awesome-mesos
Re: Difficulties building mesos-21.1-rc2 {rc1, .1 , .0}. Linux
Thanks Cody.
I'll start work from the master branch on github and see how far I get.
I guess we'll just need to ensure stout,http parser, etc are copied to
/usr/local and have our own build of mesos.
Thanks again for your help. Are there specific Jira issues I can monitor? I'm
building a messaging infrastructure and mesos is the foundation.
-ag
Sent from my iPhone
On Feb 4, 2015, at 8:32 PM, Cody Maloney c...@mesosphere.io wrote:
Some of the --with options are broken, and others have only been recently
fixed. The best option with 0.21.1 is to use --disable-bundled at which point
your system search paths just need to be configured correctly to find
everything.
The story around the `--with-{glog,zlib,curl,sasl}` and the like should be
getting better with 0.22.0 because people are working on building mesos
modules outside of the mesos source tree, which requires the module and mesos
use the same version of dependent libraries in many cases.
On Wed, Feb 4, 2015 at 5:26 PM, Alexander Gallego agall...@rbonut.com
wrote:
In fact, I took the one from inside mesos (didn't apply the .patch file
though), but other libs depend on it, that don't depend on mesos (i.e.
fbthrif )
Sincerely,
Alexander Gallego
On Wed, Feb 4, 2015 at 8:24 PM, Alexander Gallego agall...@rbonut.com
wrote:
Ian,
Thanks for taking a look. I am running 0.3.3 (latest i think)
Sincerely,
Alexander Gallego
On Wed, Feb 4, 2015 at 8:09 PM, Ian Downes idow...@twitter.com wrote:
What version of glog are you trying to us? It appears the
CheckOpMessageBuilder class was introduced in 0.3.3
http://upstream.rosalinux.ru/compat_reports/glog/0.3.2_to_0.3.3/abi_compat_report.html
On Wed, Feb 4, 2015 at 4:52 PM, Alexander Gallego agall...@rbonut.com
wrote:
I did a little more exploration and to be concise, this is more or less
what I want
(valid configuration)
./configure \
--with-gnu-ld \
--enable-static=no \
--with-gmock=/home/agallego/.bolt/gmock-1.6.0 \
--with-glog=/usr/local \
--with-zlib=/usr/local \
--with-sasl=/usr/local \
--with-curl=/usr/local \
--with-zookeeper=/usr/local \
--enable-optimize
Attached is my Makefile (./configure generates) the error log (glog
mentioned in my earlier gist)
Thanks!
Sincerely,
Alexander Gallego
On Wed, Feb 4, 2015 at 4:28 PM, Alexander Gallego agall...@rbonut.com
wrote:
I wanted to post configuration formatted, so gisted my issue.
Thank you in advance.
https://gist.github.com/senior7515/bc1a03edcbbe9b7cd7bf
Not sure if I should inline the question too. Tips appreciated.
-ag
Sincerely,
Alexander Gallego
Unsubscribe
Unsubscribe
