[jira] [Commented] (MYRIAD-178) Add UI to support flexup/down services in Myriad

2016-02-23 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/MYRIAD-178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15160243#comment-15160243 ] Yuliya Feldman commented on MYRIAD-178: --- I would imagine that tools we are using should be similar

[jira] [Commented] (MYRIAD-178) Add UI to support flexup/down services in Myriad

2016-02-23 Thread Zachary Jaffee (JIRA)
[ https://issues.apache.org/jira/browse/MYRIAD-178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15160214#comment-15160214 ] Zachary Jaffee commented on MYRIAD-178: --- How do you envision this looking, a possible option is to

Re: Not able to launch Node Managers via Myriad

2016-02-23 Thread Santosh Marella
This probably requires a code change in Myriad. Currently Myriad uses "$YARN_HOME/bin/yarn nodemanager" as the command to launch the NM. This makes the NM's log4j output to be streamed to stdout. (

Re: Not able to launch Node Managers via Myriad

2016-02-23 Thread Mayank Bansal
Thanks Santosh for the prompt reply and all the great help. Is there a way I can redirect mesos task logs to NodeManager logs. Users/Admins/tools are used to look at the logs in specific location. Its very hard to change all of it. Is there any way we can achieve that? Thanks, Mayank On Tue,

Re: Not able to launch Node Managers via Myriad

2016-02-23 Thread Santosh Marella
Great to hear your cluster is up. 1. I am not seeing Nodemanager logs, I see YARN LOG DIR is set however logs are not going there NM logs are accessible via the Mesos UI (click on the sandbox for nm.medium.xxx task and then on stderr link). Since NMs are launched via Mesos, the NM logs currently

Re: Not able to launch Node Managers via Myriad

2016-02-23 Thread Mayank Bansal
Hi Santosh, Thanks for looking into it. I got it working and now I am able to run Node Managers through Myriad. There are couple of issues which i am still facing , I am sure you guys would have faced those and already have the solutions for those. 1. I am not seeing Nodemanager logs, I see

Re: Not able to launch Node Managers via Myriad

2016-02-23 Thread Santosh Marella
>What makes me wonder is that I do have a running Myriad, i.e. I can >access the Myriad UI on port 8192, but it does not show up in Mesos. It's possible you have a wrong Myriad configuration. Can you please check the mesosMaster address in your myriad-config-default.yml file? e.g.:

Re: Not able to launch Node Managers via Myriad

2016-02-23 Thread yuliya Feldman
Could you provide your yarn-site.xml and myriad-config-default.yml ? Let's make sure you have following in your yarn-site.xml:       yarn.resourcemanager.scheduler.class    com.ebay.myriad.scheduler.yarn.MyriadFairScheduler    One can configure other scehdulers as well from following list:

Re: Not able to launch Node Managers via Myriad

2016-02-23 Thread Björn Hagemeier
Hi all, Am 23.02.2016 um 12:55 schrieb Björn Hagemeier: > Hi Santosh, > > Am 23.02.2016 um 01:21 schrieb Santosh Marella: >> Hey guys.. the flow of things is as below: >> >> 1. Myriad registers itself as a Mesos framework. (Frameworks view on Mesos >> UI should show this) does Myriad register

Re: Not able to launch Node Managers via Myriad

2016-02-23 Thread Björn Hagemeier
Hi Santosh, Am 23.02.2016 um 01:21 schrieb Santosh Marella: > Hey guys.. the flow of things is as below: > > 1. Myriad registers itself as a Mesos framework. (Frameworks view on Mesos > UI should show this) I think this is where it is already failing for me. I do not see the Myriad framework in