ok now i started hadoop, i have just to wait the pull process end.
mesos assign a port to this task but if i go to the SLAVE_IP:PORT i cannot
see anything.
On which pot hadoop is commonly viewable?
2016-04-27 15:13 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
> Since i already mentioned, anyone of you tried to run hadoop as docker
> container from marathon?
> i tried with this simple json:
>
> {
>
> "id": "hadoop",
>
> "cpus": 1,
>
> "mem": 1000,
>
> "container": {
>
> "type": "DOCKER",
>
> "docker": {
>
> "image": "sequenceiq/hadoop-docker:2.7.1",
>
> "network": "HOST"
>
> }
>
> }
>
> }
>
> the app appears as running but the bar is yellow and on mesos i see staged.
> The container is more or less 800 MB probably i need to wait that pull
> operation ends? Maybe the i need to give more ram and also some storage?
>
> 2016-04-27 14:07 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>
>> Thank you Guillermo Rodriguez
>> I will try your solution as soon as possible since wordpress is not the
>> goal task i wanna run, it was just an example to understand how to launch a
>> docker container, and of course i have chosen the easiest one :P
>> However, i correctly run Jenkins, Jupyter and Owncloud, now i'm trying to
>> do the same with hadoop.
>> Thanks to all guys.
>>
>> 2016-04-27 12:54 GMT+02:00 Guillermo Rodriguez <gu...@spritekin.com>:
>>
>>> Sorry if it has been answered before.
>>> You need mesos-dns.
>>> Start your mysql service on marathon, then mesos-dns will have an entry
>>> called mysql.marathon.mesos regardless of where the service is started you
>>> can always use that URL to resolve the mysql service.
>>>
>>> Then you start wordpress and specify that your mysql server is
>>> mysql.marathon.mesos. If you need to setup an env variable in the wordpress
>>> definition you use the env section like:
>>> {
>>> "id": "wordpress",
>>> "cpus": 1,
>>> "mem": 512,
>>> "container": {
>>> "type": "DOCKER",
>>> "docker": {
>>> "image": "wordpress",
>>> "network": "HOST"
>>> }
>>> },
>>> "env": {
>>> "WORDPRESS_DB_HOST": "mysql.marathon.mesos:3306",
>>> }
>>> }
>>>
>>> Marathon also allows to add dependencies on startup so you can request
>>> marathon to start the mysql service before starting the wordpress.service.
>>> Search for the Marathon REST API for more information.
>>>
>>> Luck!
>>>
>>>
>>>
>>>
>>>
>>>
>>>
>>> ------------------------------
>>> *From*: "Stefano Bianchi" <jazzist...@gmail.com>
>>> *Sent*: Wednesday, April 27, 2016 2:53 AM
>>>
>>> *To*: user@mesos.apache.org
>>> *Subject*: Re: Launch docker container from Marathon UI
>>>
>>> Yes i guess i understood, so when i star a socker container like
>>> wordpress this app could have the need to contact another container as
>>> mysql, here project calico should be an efficient way to make this.
>>> Ok i will try, just to understand, first i run the mysql, then mesos
>>> will allocate it on a certain slave, then i need to run wordpress. How can
>>> i specify where is the mysql container in marathon UI?
>>>
>>> 2016-04-26 17:48 GMT+02:00 June Taylor <j...@umn.edu>:
>>>
>>>> Stefano,
>>>>
>>>> You would want to search for an appropriate image on Docker Hub. Here
>>>> is one I have NO experience with: https://hub.docker.com/_/mysql/
>>>>
>>>> You would then need to learn about how the image is expecting to be
>>>> configured, so you can set it up appropriately.
>>>>
>>>> This is not really a fully thought out solution. I assume you're trying
>>>> to do this for more of a proof-of-concept, though. So it may be fine for
>>>> your needs.
>>>>
>>>>
>>>> Thanks,
>>>> June Taylor
>>>> System Administrator, Minnesota Population Center
>>>> University of Minnesota
>>>>
>>>> On Tue, Apr 26, 2016 at 10:43 AM, Stefano Bianchi <jazzist...@gmail.com
>>>> > wrote:
>>>>
>>>>> My problem is this, where can i find the mysql container? I have just
>>>>> said to marathon to rim a wordpress docker container, without specify
>>>>> mysql
>>>>> one.
>>>>> Il 26/apr/2016 17:39, "Aaron Carey" <aca...@ilm.com> ha scritto:
>>>>>
>>>>>> If you run the wordpress container on a different host to the mysql
>>>>>> container and use --link on the command line, does that work?
>>>>>>
>>>>>>
>>>>>> --
>>>>>>
>>>>>> Aaron Carey
>>>>>> Production Engineer - Cloud Pipeline
>>>>>> Industrial Light & Magic
>>>>>> London020 3751 9150
>>>>>>
>>>>>> ------------------------------
>>>>>> *From:* Stefano Bianchi [jazzist...@gmail.com]
>>>>>> *Sent:* 26 April 2016 16:23
>>>>>> *To:* user@mesos.apache.org
>>>>>> *Subject:* RE: Launch docker container from Marathon UI
>>>>>>
>>>>>>
>>>>>>
>>>>>> Hi Aaron
>>>>>> Actually both mesos-dns and calico are running even though these
>>>>>> containers im running are not, yet, using the calico ipaddr specific in
>>>>>> json description.
>>>>>> So i guess it is a problem of bridging, i guess simply specify HOST
>>>>>> option on container field in Marathon UI
>>>>>> Il 26/apr/2016 16:59, "Aaron Carey" <aca...@ilm.com> ha scritto:
>>>>>>
>>>>>>> --link in docker should really be avoided when using marathon/mesos
>>>>>>> as it implies the containers are on the same host, but this will not
>>>>>>> always
>>>>>>> be the case when mesos schedules your containers (also I think it's
>>>>>>> being
>>>>>>> deprecated in docker anyway.. not sure though?).
>>>>>>>
>>>>>>> This problem looks like one of service discovery within the mesos
>>>>>>> cluster: how does one service contact the other when it doesn't know
>>>>>>> which
>>>>>>> host the other service may have landed on?
>>>>>>>
>>>>>>> There are several different solutions for service discovery, you can
>>>>>>> look into some like Project Calico to offer a network layer to docker or
>>>>>>> try dns based solutions like Mesos-dns or Consul (along with
>>>>>>> mesos-consul).
>>>>>>> I think marathon also has some concept of service discovery built in
>>>>>>> too if
>>>>>>> you use something like haproxy.
>>>>>>>
>>>>>>> I hope this helps!
>>>>>>>
>>>>>>> Aaron
>>>>>>>
>>>>>>>
>>>>>>> --
>>>>>>>
>>>>>>> Aaron Carey
>>>>>>> Production Engineer - Cloud Pipeline
>>>>>>> Industrial Light & Magic
>>>>>>> London020 3751 9150
>>>>>>>
>>>>>>> ------------------------------
>>>>>>> *From:* June Taylor [j...@umn.edu]
>>>>>>> *Sent:* 26 April 2016 15:22
>>>>>>> *To:* user@mesos.apache.org
>>>>>>> *Subject:* Re: Launch docker container from Marathon UI
>>>>>>>
>>>>>>>
>>>>>>> Stefano,
>>>>>>>
>>>>>>> The docker run flag --link is intended to connect the container to
>>>>>>> another running container. I do not know how this would operate in
>>>>>>> marathon. Perhaps it would be an application group which starts up the
>>>>>>> mysql docker image first, then the Wordpress docker image after it.
>>>>>>>
>>>>>>>
>>>>>>> Thanks,
>>>>>>> June Taylor
>>>>>>> System Administrator, Minnesota Population Center
>>>>>>> University of Minnesota
>>>>>>>
>>>>>>> On Tue, Apr 26, 2016 at 9:20 AM, Stefano Bianchi <
>>>>>>> jazzist...@gmail.com> wrote:
>>>>>>>
>>>>>>>> Thanks *Rad* Gruchalski, actually i'm trying to make a json file
>>>>>>>> that "translate" this command in marathon:
>>>>>>>>
>>>>>>>> docker run --name some-wordpress --link some-mysql:mysql -d
>>>>>>>> wordpress
>>>>>>>>
>>>>>>>> i guess the error is relate to the fact that i'm not specifying --link
>>>>>>>> some-mysql:mysql
>>>>>>>> My problem is that i don't know how to do that, i tried to fill
>>>>>>>> environment variable fields:
>>>>>>>>
>>>>>>>> Key = link
>>>>>>>> Value = some-mysql:mysql
>>>>>>>>
>>>>>>>> But in this way the app does not work as well. How can i configure
>>>>>>>> these env variables?
>>>>>>>>
>>>>>>>> 2016-04-26 16:01 GMT+02:00 Rad Gruchalski <ra...@gruchalski.com>:
>>>>>>>>
>>>>>>>>> It says exactly what the problem is.
>>>>>>>>>
>>>>>>>>> Start a marathon task with correct environment variables in env
>>>>>>>>> and you will be fine.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Best regards,?
>>>>>>>>> Radek Gruchalski
>>>>>>>>> ?ra...@gruchalski.com? <ra...@gruchalski.com>
>>>>>>>>>
>>>>>>>>> de.linkedin.com/in/radgruchalski/
>>>>>>>>>
>>>>>>>>> *Confidentiality:*
>>>>>>>>> This communication is intended for the above-named person and may
>>>>>>>>> be confidential and/or legally privileged.
>>>>>>>>> If it has come to you in error you must take no action based on
>>>>>>>>> it, nor must you copy or show it to anyone; please delete/destroy and
>>>>>>>>> inform the sender immediately.
>>>>>>>>>
>>>>>>>>> On Tuesday, 26 April 2016 at 15:56, Stefano Bianchi wrote:
>>>>>>>>>
>>>>>>>>> jupyter is working fine.
>>>>>>>>> i tried to run wordpress and i get this error in stderr of mesos:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> error: missing WORDPRESS_DB_HOST and MYSQL_PORT_3306_TCP
>>>>>>>>> environment variables
>>>>>>>>>
>>>>>>>>> Did you forget to --link some_mysql_container:mysql or set an
>>>>>>>>> external db
>>>>>>>>>
>>>>>>>>> with -e WORDPRESS_DB_HOST=hostname:port?
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Some one of you know this issue?
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> 2016-04-26 15:51 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>>>>>>
>>>>>>>>> However thank you so much to all!
>>>>>>>>>
>>>>>>>>> 2016-04-26 15:22 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>>>>>>
>>>>>>>>> i found the answer by my self sorry if i disturbed you.
>>>>>>>>>
>>>>>>>>> 2016-04-26 15:19 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>>>>>>
>>>>>>>>> Now that it is running, how can i check the User Interface?
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> 2016-04-26 15:18 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>>>>>>
>>>>>>>>> Yes, now it's running!!! June you are awesome!!!
>>>>>>>>>
>>>>>>>>> 2016-04-26 15:16 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>>>>>>
>>>>>>>>> i have done these 2 commands, now jupyter is in deploying in
>>>>>>>>> marathon, staging in mesos.
>>>>>>>>> Is there some additional configuration needed?
>>>>>>>>>
>>>>>>>>> 2016-04-26 15:13 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>>>>>>
>>>>>>>>> June i tried to run your json, but the task is waiting, and if
>>>>>>>>> starts it failed immediately.
>>>>>>>>>
>>>>>>>>> I guess because i did not type this commands:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> 1.
>>>>>>>>>
>>>>>>>>> echo 'docker,mesos' > /etc/mesos-slave/containerizers
>>>>>>>>>
>>>>>>>>> 2.
>>>>>>>>>
>>>>>>>>> $ echo '5mins' > /etc/mesos-slave/executor_registration_timeout
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> Could it be the problem?
>>>>>>>>>
>>>>>>>>> 2016-04-26 15:02 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>>>>>>
>>>>>>>>> Thank you June taylor, it is axactly what i was intending.
>>>>>>>>> if it is not disturbing you, i try jupyter notebook as well, just
>>>>>>>>> to make some tests on how to launch marathon.
>>>>>>>>> stay tuned :)
>>>>>>>>>
>>>>>>>>> 2016-04-26 14:58 GMT+02:00 Stefano Bianchi <jazzist...@gmail.com>:
>>>>>>>>>
>>>>>>>>> thanks haosdent.
>>>>>>>>> actually i have run this kind of apps through rest api.
>>>>>>>>> Now i want learn how to laung docker files. I found this exaple:
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> {
>>>>>>>>> "container": {
>>>>>>>>> "type": "DOCKER",
>>>>>>>>> "docker": {
>>>>>>>>> "network": "HOST",
>>>>>>>>> "image": "group/image"
>>>>>>>>> },
>>>>>>>>> "volumes": [
>>>>>>>>> {
>>>>>>>>> "containerPath": "/etc/a",
>>>>>>>>> "hostPath": "/var/data/a",
>>>>>>>>> "mode": "RO"
>>>>>>>>> },
>>>>>>>>> {
>>>>>>>>> "containerPath": "/etc/b",
>>>>>>>>> "hostPath": "/var/data/b",
>>>>>>>>> "mode": "RW"
>>>>>>>>> }
>>>>>>>>> ]
>>>>>>>>> }}
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> I am able to link the correspondent field in the marathon UI with
>>>>>>>>> what is written in this json.
>>>>>>>>> What i need to understand is, what i should write in:
>>>>>>>>>
>>>>>>>>> "image": "group/image"
>>>>>>>>>
>>>>>>>>> i mean, with what i have to replace group and image?
>>>>>>>>> For instance, if i would run wordpress container on docker hub
>>>>>>>>> what i should put replacing "group/image" ?
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> 2016-04-26 14:30 GMT+02:00 haosdent <haosd...@gmail.com>:
>>>>>>>>>
>>>>>>>>> This is marathon REST API document:
>>>>>>>>> https://mesosphere.github.io/marathon/docs/rest-api.html#post-v2-apps
>>>>>>>>> . Usually we define a task json file and call the rest api.
>>>>>>>>>
>>>>>>>>> For example, create tasks.json which content is
>>>>>>>>>
>>>>>>>>> ```
>>>>>>>>> {
>>>>>>>>> "id": "/test-sleep",
>>>>>>>>> "cmd": "sleep 200"
>>>>>>>>> }
>>>>>>>>> ```
>>>>>>>>>
>>>>>>>>> And
>>>>>>>>>
>>>>>>>>> ```
>>>>>>>>> curl -X POST -H "Content-type: application/json"
>>>>>>>>> http://${YOUR_MARATHON_ADDR}:8080/v2/apps
>>>>>>>>> -d @tasks.json
>>>>>>>>> ```
>>>>>>>>>
>>>>>>>>> You could find more field definitions in their document.
>>>>>>>>>
>>>>>>>>> On Tue, Apr 26, 2016 at 8:24 PM, Stefano Bianchi <
>>>>>>>>> jazzist...@gmail.com> wrote:
>>>>>>>>>
>>>>>>>>> Hi guys
>>>>>>>>>
>>>>>>>>> i'm trying to follow the instructions on mesosphere documentation,
>>>>>>>>> but it is a little bit unlear for me that i am new to this world.
>>>>>>>>> i' would like to launch a wordpress container, present on docker
>>>>>>>>> hub here https://hub.docker.com/_/wordpress/ , from marathon UI
>>>>>>>>> but i don't understand the mechanism.
>>>>>>>>> I understood that i don't have to specify a command in "Command"
>>>>>>>>> field, but i don't know how to fill the dockers fields in marathon UI
>>>>>>>>> to
>>>>>>>>> launch wordpress container.
>>>>>>>>> Could you please help me or tell me where i can find a clearer
>>>>>>>>> documentation?
>>>>>>>>>
>>>>>>>>> Thanks.
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>> --
>>>>>>>>> Best Regards,
>>>>>>>>> Haosdent Huang
>>>>>>>>>
>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>
>
