Increasing a number of ports for a Docker container

[Rad Gruchalski]

Hi everyone,  

I remember reading somewhere in the documentation that there’s a limit of 
number of port mappings for a single task / container. I believe it is 10, 
however, I can’t find the specific documentation link describing this.
Is it possible to increase this number? Say, I need 15 not 10.










Kind regards,

Radek Gruchalski

ra...@gruchalski.com (mailto:ra...@gruchalski.com)
 
(mailto:ra...@gruchalski.com)
de.linkedin.com/in/radgruchalski/ (http://de.linkedin.com/in/radgruchalski/)

Confidentiality:
This communication is intended for the above-named person and may be 
confidential and/or legally privileged.
If it has come to you in error you must take no action based on it, nor must 
you copy or show it to anyone; please delete/destroy and inform the sender 
immediately.

Re: OS X build

[DiGiorgio, Mr. Rinaldo S.]

Hi,

   I have built the current tip of the mesos repository on three different 
physicall instances of OSX 10.10.5 without issue. I used homebrew for 
dependencies.  The only change I had to make was change my .m2/settings.xml 
file to use a proxy for getting to the maven repos.


   If you can provide a github ref for what to build I will run the build on 
some additional OSX machines I have.


Rinaldo

On Oct 1, 2015, at 03:07, Michael Park 
> wrote:

Hi Vaibhav,

What version of OS X do you have? Do you not have /usr/include/apr-1 or 
/usr/include/apr-1.0 available?
I also installed apr-1.5.2 via brew install apr and ../configure 
--with-apr=/usr/local/Cellar/apr/1.5.2/libexec worked fine for me.

As far as how configure.ac is written, when --with-apr is 
specified, it prepends -I${with_apr}/include/apr-1 
-I${with_apr}/include/apr-1.0 and
-L${with_apr}/lib. if --with-apr is not specified, it uses -I/usr/include/apr-1 
-I/usr/include/apr-1.0.

I hope this helps a little. Please keep us posted.

Thanks,

MPark.

On Sun, Sep 27, 2015 at 9:25 PM James Peach 
> wrote:

> On Sep 27, 2015, at 4:15 PM, Vaibhav Khanduja 
> > wrote:
>
> Probably yes,
>
> The issue which I am pointing out is with the configure script not accepting 
> option "—with-arp"

OK then I'm confused because there is a --with-apr option, and it works AFAICT

jpeach$ ./configure --help | grep apr
  --with-apr=[=DIR]   specify where to locate the apr-1 library

>
> On Sat, Sep 26, 2015 at 9:26 PM, James Peach 
> > wrote:
>
> > On Sep 26, 2015, at 12:01 PM, Vaibhav Khanduja 
> > > wrote:
> >
> > I am running into issues with build on my MAC - OSX … the configure scripts 
> > complaints about libapr-1 not present. I was able to find a workaround by 
> > passing configure with —with-apr option. Looks like the script checks for 
> > variable to be valid shell variable, if not it is rejected.
> >
> > I was able workaround with having quotes and missing a “-“ for the variable
> >
> >  ../configure -disable-python --disable-java 
> > "-with-apr=/usr/local/Cellar/apr/1.5.2/libexec/“
> >
> > the configure —help though suggests to use —with-apr
>
> AFAICT you are supposed to use apr-1-config to fish out the libapr path when 
> using Homebrew. I think that is would be reasonable for the Mesos build to 
> just automatically use apr-1-config if it is present.
>
> ./configure --with-apr=$(apr-1-config --prefix)
>
> >
> >
> > am I missing something here?
> >
> > Thx
>
>

Running a task in Mesos cluster

[Pradeep Kiruvale]

Hi All,

I am new to Mesos. I have set up a Mesos cluster with 1 Master and 3 Slaves.

One slave runs on the Master Node itself and Other slaves run on different
nodes. Here node means the physical boxes.

I tried running the tasks by configuring one Node cluster. Tested the task
scheduling using mesos-execute, works fine.

When I configure three Node cluster (1master and 3 slaves) and try to see
the resources on the master (in GUI) only the Master node resources are
visible.
 The other nodes resources are not visible. Some times visible but in a
de-actived state.

*Please let me know what could be the reason. All the nodes are in the same
network. *

When I try to schedule a task using

/src/mesos-execute --master=192.168.0.102:5050 --name="cluster-test"
--command="/usr/bin/hackbench -s 4096 -l 10845760 -g 2 -f 2 -P"
--resources="cpus(*):3;mem(*):2560"

The tasks always get scheduled on the same node. The resources from the
other nodes are not getting used to schedule the tasks.

I*s it required to register the frameworks from every slave node on the
Master?*

*I have configured this cluster using the git-hub code.*


Thanks & Regards,
Pradeep

[RESULT][VOTE] Release Apache Mesos 0.22.2 (rc1)

[Adam Bordelon]

Hi all,

The vote for Mesos 0.22.2 (rc1) has passed with the following votes.

+1 (Binding)
--
Adam B
Brenden Matthews
Benjamin Mahler

+1 (Non-binding)
--
haosdent

There were no 0 or -1 votes.

Please find the release at:
https://dist.apache.org/repos/dist/release/mesos/0.22.2

It is recommended to use a mirror to download the release:
http://www.apache.org/dyn/closer.cgi

The CHANGELOG for the release is available at:
https://git-wip-us.apache.org/repos/asf?p=mesos.git;a=blob_plain;f=CHANGELOG;hb=0.22.2

The mesos-0.22.2.jar has been released to:
https://repository.apache.org

The website (http://mesos.apache.org) already has the download link.

Thanks,
-Adam-

Re: OS X build

[Michael Park]

Hi Vaibhav,

What version of OS X do you have? Do you not have */usr/include/apr-1* or
*/usr/include/apr-1.0* available?
I also installed *apr-1.5.2* via *brew install apr* and *../configure
--with-apr=/usr/local/Cellar/apr/1.5.2/libexec* worked fine for me.

As far as how *configure.ac * is written, when
*--with-apr* is specified, it prepends *-I${with_apr}/include/apr-1*
*-I${with_apr}/include/apr-1.0* and
*-L${with_apr}/lib*. if *--with-apr* is not specified, it uses
*-I/usr/include/apr-1
-I/usr/include/apr-1.0*.

I hope this helps a little. Please keep us posted.

Thanks,

MPark.

On Sun, Sep 27, 2015 at 9:25 PM James Peach  wrote:

>
> > On Sep 27, 2015, at 4:15 PM, Vaibhav Khanduja 
> wrote:
> >
> > Probably yes,
> >
> > The issue which I am pointing out is with the configure script not
> accepting option "—with-arp"
>
> OK then I'm confused because there is a --with-apr option, and it works
> AFAICT
>
> jpeach$ ./configure --help | grep apr
>   --with-apr=[=DIR]   specify where to locate the apr-1 library
>
> >
> > On Sat, Sep 26, 2015 at 9:26 PM, James Peach  wrote:
> >
> > > On Sep 26, 2015, at 12:01 PM, Vaibhav Khanduja <
> vaibhavkhand...@gmail.com> wrote:
> > >
> > > I am running into issues with build on my MAC - OSX … the configure
> scripts complaints about libapr-1 not present. I was able to find a
> workaround by passing configure with —with-apr option. Looks like the
> script checks for variable to be valid shell variable, if not it is
> rejected.
> > >
> > > I was able workaround with having quotes and missing a “-“ for the
> variable
> > >
> > >  ../configure -disable-python --disable-java
> "-with-apr=/usr/local/Cellar/apr/1.5.2/libexec/“
> > >
> > > the configure —help though suggests to use —with-apr
> >
> > AFAICT you are supposed to use apr-1-config to fish out the libapr path
> when using Homebrew. I think that is would be reasonable for the Mesos
> build to just automatically use apr-1-config if it is present.
> >
> > ./configure --with-apr=$(apr-1-config --prefix)
> >
> > >
> > >
> > > am I missing something here?
> > >
> > > Thx
> >
> >
>
>

Re: Running a task in Mesos cluster

[Guangya Liu]

Hi Pradeep,

Please check some of my questions in line.

Thanks,

Guangya

On Fri, Oct 2, 2015 at 12:55 AM, Pradeep Kiruvale  wrote:

> Hi All,
>
> I am new to Mesos. I have set up a Mesos cluster with 1 Master and 3
> Slaves.
>
> One slave runs on the Master Node itself and Other slaves run on different
> nodes. Here node means the physical boxes.
>
> I tried running the tasks by configuring one Node cluster. Tested the task
> scheduling using mesos-execute, works fine.
>
> When I configure three Node cluster (1master and 3 slaves) and try to see
> the resources on the master (in GUI) only the Master node resources are
> visible.
>  The other nodes resources are not visible. Some times visible but in a
> de-actived state.
>
Can you please append some logs from mesos-slave and mesos-master? There
should be some logs in either master or slave telling you what is wrong.

>
> *Please let me know what could be the reason. All the nodes are in the
> same network. *
>
> When I try to schedule a task using
>
> /src/mesos-execute --master=192.168.0.102:5050 --name="cluster-test"
> --command="/usr/bin/hackbench -s 4096 -l 10845760 -g 2 -f 2 -P"
> --resources="cpus(*):3;mem(*):2560"
>
> The tasks always get scheduled on the same node. The resources from the
> other nodes are not getting used to schedule the tasks.
>
Based on your previous question, there is only one node in your cluster,
that's why other nodes are not available. We need first identify what is
wrong with other three nodes first.

>
> I*s it required to register the frameworks from every slave node on the
> Master?*
>
It is not required.

>
> *I have configured this cluster using the git-hub code.*
>
>
> Thanks & Regards,
> Pradeep
>
>

Hadoop on Mesos Memory Configuration Question

[Ajit Jagdale]

Hi all,

I'm new to Mesos and to using Hadoop over Mesos.  I've been trying to
determine if Mesos memory configurations are affecting the memory that I
allocate to Hadoop mappers and reducers (in Hadoop's mapped-site.xml
file).  When I set values to the mappers, something seems to interfere with
allocating that memory.

Cluster setup:
- 1 master node and 6 slave nodes
- There is no /etc/mesos-slave/resource file, so memory is configured by
Mesos.  My understanding of this is that since there are no explicit memory
settings on each slave node, Mesos is giving the asking application
(Hadoop) all of the available memory minus 1GB for running the OS.

But there still must be some mesos memory configuration somewhere, right?
Something that knows how much a slice of memory is.  I'm not sure if I know
where that is.

Any suggestions of how mesos' process of memory allocation could be
affecting how Hadoop affects memory allocation would be appreciated.

Thanks,
Ajit