Re: [DISCUSS] Leave Apache and the Incubator
+1, non-binding :) On Sat, Jan 4, 2020 at 5:56 AM Oscar Fernandez wrote: > +1 > > Maybe we can reboot the project outside the ASF Incubator > > On Fri, Jan 3, 2020 at 6:12 PM Darin Johnson > wrote: > > > +1 > > > > On Fri, Jan 3, 2020 at 11:14 AM John Yost wrote: > > > > > +1 > > > > > > > On Jan 2, 2020, at 11:51 PM, Javi Roman > > > wrote: > > > > > > > > Please vote to retire Myriad from the ASF Incubator. My take is that > > > > Myriad has failed to get adequate community traction in the ASF > > > > Incubator and the administrative work of the ASF is more of a burden > > > > than a benefit to the project. Exiting incubation right now seems > like > > > > the obvious benefit to everyone -- the decision to return can always > be > > > > made later and should be easier to execute the second time around. > > > > > > > > [ ] +1 to retire > > > > [ ] -1 Not retiring because.. > > > > > > > > Here's my +1 > > > > > > > > This will be open for at least 72 hours and is a Majority vote. > > > > -- > > > > Javi Roman > > > > > > > > Twitter: @javiromanrh > > > > GitHub: github.com/javiroman > > > > Linkedin: es.linkedin.com/in/javiroman > > > > Big Data Blog: dataintensive.info > > > > Apache Id: javiroman > > > > > > > > >
Re: [Vote] Retire Myriad
+1 On Tue, Jun 20, 2017 at 10:13 PM Brandon Gulla <gulla.bran...@gmail.com> wrote: > +1 (if the vote is open to non-comitters) > > > > On Tue, Jun 20, 2017 at 9:22 AM, Darin Johnson <dar...@apache.org> wrote: > > > Based on previous discussions it seems the best course of action. I'm > > holding the vote open for 3 business days. > > > > I'm +1 binding. > > > > Darin > > > > > > -- > Brandon > -- Regards, Da (Klaus), Ma (马达), PMP® | Software Architect IBM Platform Development & Support, STG, IBM GCG +86-10-8245 4084 | mad...@cn.ibm.com | http://k82.me
[jira] [Resolved] (MYRIAD-235) Made Myriad to use reserved resource firstly.
[ https://issues.apache.org/jira/browse/MYRIAD-235?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Klaus Ma resolved MYRIAD-235. - Resolution: Fixed Fix Version/s: Myriad 0.3.0 The PR (https://github.com/apache/incubator-myriad/pull/94) was merged at Oct 18, 2016. > Made Myriad to use reserved resource firstly. > - > > Key: MYRIAD-235 > URL: https://issues.apache.org/jira/browse/MYRIAD-235 > Project: Myriad > Issue Type: Bug > Components: Scheduler > Reporter: Klaus Ma > Fix For: Myriad 0.3.0 > > > Currently, Myriad ignore resources's reserved info; it may dispatch tasks to > un-reserved resources firstly, although there's enough reserved resources for > it. > This fix is to make Myriad to used reserved offer firstly, then unreserved > resources. > This fix is not done much algorithm on how to use reserved/unreserved better, > will update a separate patches for it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
Re: [DISCUSS] handling roles in Myriad code
ob/master/ > >>> myriad-scheduler/src/main/java/org/apache/myriad/scheduler/resource/ > >>> RangeResource.java#L140 > >>> > >>> > >>> From: Darin Johnson <dbjohnson1...@gmail.com> > >>> To: Dev <dev@myriad.incubator.apache.org>; yuliya Feldman < > >>> yufeld...@yahoo.com> > >>> Sent: Wednesday, October 19, 2016 6:04 PM > >>> Subject: Re: [DISCUSS] handling roles in Myriad code > >>> > >>> Yuyiya, > >>> > >>> Yes on master a lot of refactoring was done, in particular you specify > >>> ports other than 0 in the myriad-default.yaml, it will only return > those > >>> ports (not random ones). This was done in part because the we were > >>> attempting the use the JHS on a port like 32001, but it the port was > >>> already in use by another app and hence the port wasn't offered myriad > >> was > >>> still launching the JHS only to have it crash. > >>> > >>> If you want to use static ports you can just not put anything in the > >>> myriad-default.yaml and configure the yarn-site.xml and mapred-site.xml > >> as > >>> usual (they should be outside the range mesos offers). To handle > >>> nodemanager persistence I think we should work with Klaus's PR's to get > >> the > >>> correct ports, though we'll need to use some disk persistance as well > to > >>> keep the NM state. > >>> > >>> As for a bug in NM's getting zero ports could you send a copy of your > >>> configuration and I'll try to recreate the problem? > >>> > >>> On Wed, Oct 19, 2016 at 3:29 PM, yuliya Feldman > >>> <yufeld...@yahoo.com.invalid > >>>> wrote: > >>> > >>>> Hello there, > >>>> I wanted to discuss current handling of roles in Myriad code. > >>> Specifically > >>>> on "master" branch. Most likely due to heavy refactoring. > >>>> As far as I can see we try to handle presence or absence of a role on > a > >>>> resource(s) based on the fact that framework may or may not have a > >>> role.On > >>>> the other hand we always set framework role to "*" - which means it > >> will > >>>> always have a role, just that role will be "default". > >>>> So far I encountered couple of bugs related to roles in RangeResource > >>>> related to ports and inability to spin up NodeManagers, as no ports > >> were > >>>> assigned because of the fact how we handle roles. > >>>> I would like @Adam and other Mesosphere folks to comment on how should > >> we > >>>> handle relationship between frameworkRole and resource role(s) > >>>> Thanks,Yuliya > >> > >> > >> > >> > -- Regards, Da (Klaus), Ma (马达), PMP® | Software Architect IBM Platform Development & Support, STG, IBM GCG +86-10-8245 4084 | mad...@cn.ibm.com | http://k82.me
[jira] [Commented] (MYRIAD-235) Made Myriad to use reserved resource firstly.
[ https://issues.apache.org/jira/browse/MYRIAD-235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15400912#comment-15400912 ] Klaus Ma commented on MYRIAD-235: - WIP: https://github.com/apache/incubator-myriad/pull/88 cc [~adam-mesos], is there anyone can help to review it when it's ready? > Made Myriad to use reserved resource firstly. > - > > Key: MYRIAD-235 > URL: https://issues.apache.org/jira/browse/MYRIAD-235 > Project: Myriad > Issue Type: Bug > Components: Scheduler > Reporter: Klaus Ma > > Currently, Myriad ignore resources's reserved info; it may dispatch tasks to > un-reserved resources firstly, although there's enough reserved resources for > it. > This fix is to make Myriad to used reserved offer firstly, then unreserved > resources. > This fix is not done much algorithm on how to use reserved/unreserved better, > will update a separate patches for it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (MYRIAD-235) Made Myriad to use reserved resource firstly.
Klaus Ma created MYRIAD-235: --- Summary: Made Myriad to use reserved resource firstly. Key: MYRIAD-235 URL: https://issues.apache.org/jira/browse/MYRIAD-235 Project: Myriad Issue Type: Bug Components: Scheduler Reporter: Klaus Ma Currently, Myriad ignore resources's reserved info; it may dispatch tasks to un-reserved resources firstly, although there's enough reserved resources for it. This fix is to make Myriad to used reserved offer firstly, then unreserved resources. This fix is not done much algorithm on how to use reserved/unreserved better, will update a separate patches for it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Closed] (MYRIAD-231) Failed to regist zero profile to ResourceManager (2.7.2)
[
https://issues.apache.org/jira/browse/MYRIAD-231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Klaus Ma closed MYRIAD-231.
---
Resolution: Fixed
Configuration issue; updated document in
https://github.com/apache/incubator-myriad/pull/82/
> Failed to regist zero profile to ResourceManager (2.7.2)
>
>
> Key: MYRIAD-231
> URL: https://issues.apache.org/jira/browse/MYRIAD-231
> Project: Myriad
> Issue Type: Bug
> Reporter: Klaus Ma
>
> Here's the error message of NodeManager:
> {code}
> 16/06/29 16:27:50 ERROR nodemanager.NodeStatusUpdaterImpl: Unexpected error
> starting NodeStatusUpdater
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
> 16/06/29 16:27:50 INFO service.AbstractService: Service
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl failed in
> state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:202)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
> Caused by: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved
> SHUTDOWN signal from Resourcemanager ,Registration of NodeManager failed,
> Message from ResourceManager: NodeManager from dcos33.private.dns.zone
> doesn't satisfy minimum allocations, Sending SHUTDOWN signal to the
> NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
> ... 6 more
> 16/06/29 16:27:50 INFO service.AbstractService: Service NodeManager failed in
> state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHU
[jira] [Commented] (MYRIAD-231) Failed to regist zero profile to ResourceManager (2.7.2)
[
https://issues.apache.org/jira/browse/MYRIAD-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15357033#comment-15357033
]
Klaus Ma commented on MYRIAD-231:
-
thanks :).
> Failed to regist zero profile to ResourceManager (2.7.2)
>
>
> Key: MYRIAD-231
> URL: https://issues.apache.org/jira/browse/MYRIAD-231
> Project: Myriad
> Issue Type: Bug
> Reporter: Klaus Ma
>
> Here's the error message of NodeManager:
> {code}
> 16/06/29 16:27:50 ERROR nodemanager.NodeStatusUpdaterImpl: Unexpected error
> starting NodeStatusUpdater
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
> 16/06/29 16:27:50 INFO service.AbstractService: Service
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl failed in
> state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:202)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
> Caused by: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved
> SHUTDOWN signal from Resourcemanager ,Registration of NodeManager failed,
> Message from ResourceManager: NodeManager from dcos33.private.dns.zone
> doesn't satisfy minimum allocations, Sending SHUTDOWN signal to the
> NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
> ... 6 more
> 16/06/29 16:27:50 INFO service.AbstractService: Service NodeManager failed in
> state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManage
[jira] [Commented] (MYRIAD-231) Failed to regist zero profile to ResourceManager (2.7.2)
[
https://issues.apache.org/jira/browse/MYRIAD-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15356386#comment-15356386
]
Klaus Ma commented on MYRIAD-231:
-
Pull request to handle this issue; [~darinj], would you help to review it?
https://github.com/apache/incubator-myriad/pull/82/
> Failed to regist zero profile to ResourceManager (2.7.2)
>
>
> Key: MYRIAD-231
> URL: https://issues.apache.org/jira/browse/MYRIAD-231
> Project: Myriad
> Issue Type: Bug
> Reporter: Klaus Ma
>
> Here's the error message of NodeManager:
> {code}
> 16/06/29 16:27:50 ERROR nodemanager.NodeStatusUpdaterImpl: Unexpected error
> starting NodeStatusUpdater
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
> 16/06/29 16:27:50 INFO service.AbstractService: Service
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl failed in
> state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:202)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
> Caused by: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved
> SHUTDOWN signal from Resourcemanager ,Registration of NodeManager failed,
> Message from ResourceManager: NodeManager from dcos33.private.dns.zone
> doesn't satisfy minimum allocations, Sending SHUTDOWN signal to the
> NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
> ... 6 more
> 16/06/29 16:27:50 INFO service.AbstractService: Service NodeManager failed in
> state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHU
[jira] [Commented] (MYRIAD-231) Failed to regist zero profile to ResourceManager (2.7.2)
[
https://issues.apache.org/jira/browse/MYRIAD-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15356333#comment-15356333
]
Klaus Ma commented on MYRIAD-231:
-
[~darinj] , where's the email list? I seems not work to me :(.
> Failed to regist zero profile to ResourceManager (2.7.2)
>
>
> Key: MYRIAD-231
> URL: https://issues.apache.org/jira/browse/MYRIAD-231
> Project: Myriad
> Issue Type: Bug
> Reporter: Klaus Ma
>
> Here's the error message of NodeManager:
> {code}
> 16/06/29 16:27:50 ERROR nodemanager.NodeStatusUpdaterImpl: Unexpected error
> starting NodeStatusUpdater
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
> 16/06/29 16:27:50 INFO service.AbstractService: Service
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl failed in
> state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:202)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
> Caused by: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved
> SHUTDOWN signal from Resourcemanager ,Registration of NodeManager failed,
> Message from ResourceManager: NodeManager from dcos33.private.dns.zone
> doesn't satisfy minimum allocations, Sending SHUTDOWN signal to the
> NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
> ... 6 more
> 16/06/29 16:27:50 INFO service.AbstractService: Service NodeManager failed in
> state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
&
[jira] [Commented] (MYRIAD-231) Failed to regist zero profile to ResourceManager (2.7.2)
[
https://issues.apache.org/jira/browse/MYRIAD-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15355461#comment-15355461
]
Klaus Ma commented on MYRIAD-231:
-
OK, thanks. I'll try it tomorrow :).
> Failed to regist zero profile to ResourceManager (2.7.2)
>
>
> Key: MYRIAD-231
> URL: https://issues.apache.org/jira/browse/MYRIAD-231
> Project: Myriad
> Issue Type: Bug
> Reporter: Klaus Ma
>
> Here's the error message of NodeManager:
> {code}
> 16/06/29 16:27:50 ERROR nodemanager.NodeStatusUpdaterImpl: Unexpected error
> starting NodeStatusUpdater
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
> 16/06/29 16:27:50 INFO service.AbstractService: Service
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl failed in
> state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:202)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
> Caused by: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved
> SHUTDOWN signal from Resourcemanager ,Registration of NodeManager failed,
> Message from ResourceManager: NodeManager from dcos33.private.dns.zone
> doesn't satisfy minimum allocations, Sending SHUTDOWN signal to the
> NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
> ... 6 more
> 16/06/29 16:27:50 INFO service.AbstractService: Service NodeManager failed in
> state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeMa
[jira] [Comment Edited] (MYRIAD-231) Failed to regist zero profile to ResourceManager (2.7.2)
[
https://issues.apache.org/jira/browse/MYRIAD-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15355205#comment-15355205
]
Klaus Ma edited comment on MYRIAD-231 at 6/29/16 1:22 PM:
--
Here's my yarn-site.xml's configuration:
https://github.com/k82/incubator-myriad/blob/master/yarn-conf/yarn-site.xml
And can you share the possibilities?
was (Author: klaus1982):
Here's my yarn-site.xml's configuration:
https://github.com/k82/incubator-myriad/blob/master/yarn-conf/yarn-site.xml
> Failed to regist zero profile to ResourceManager (2.7.2)
>
>
> Key: MYRIAD-231
> URL: https://issues.apache.org/jira/browse/MYRIAD-231
> Project: Myriad
> Issue Type: Bug
> Reporter: Klaus Ma
>
> Here's the error message of NodeManager:
> {code}
> 16/06/29 16:27:50 ERROR nodemanager.NodeStatusUpdaterImpl: Unexpected error
> starting NodeStatusUpdater
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
> 16/06/29 16:27:50 INFO service.AbstractService: Service
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl failed in
> state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:202)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
> Caused by: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved
> SHUTDOWN signal from Resourcemanager ,Registration of NodeManager failed,
> Message from ResourceManager: NodeManager from dcos33.private.dns.zone
> doesn't satisfy minimum allocations, Sending SHUTDOWN signal to the
> NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
> ... 6 more
> 16/06/29 16:27:50 INFO service.AbstractService: Service NodeManager failed in
> state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minim
[jira] [Commented] (MYRIAD-231) Failed to regist zero profile to ResourceManager (2.7.2)
[
https://issues.apache.org/jira/browse/MYRIAD-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15355205#comment-15355205
]
Klaus Ma commented on MYRIAD-231:
-
Here's my yarn-site.xml's configuration:
https://github.com/k82/incubator-myriad/blob/master/yarn-conf/yarn-site.xml
> Failed to regist zero profile to ResourceManager (2.7.2)
>
>
> Key: MYRIAD-231
> URL: https://issues.apache.org/jira/browse/MYRIAD-231
> Project: Myriad
> Issue Type: Bug
> Reporter: Klaus Ma
>
> Here's the error message of NodeManager:
> {code}
> 16/06/29 16:27:50 ERROR nodemanager.NodeStatusUpdaterImpl: Unexpected error
> starting NodeStatusUpdater
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
> 16/06/29 16:27:50 INFO service.AbstractService: Service
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl failed in
> state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:202)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
> Caused by: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved
> SHUTDOWN signal from Resourcemanager ,Registration of NodeManager failed,
> Message from ResourceManager: NodeManager from dcos33.private.dns.zone
> doesn't satisfy minimum allocations, Sending SHUTDOWN signal to the
> NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
> ... 6 more
> 16/06/29 16:27:50 INFO service.AbstractService: Service NodeManager failed in
> state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHU
[jira] [Issue Comment Deleted] (MYRIAD-231) Failed to regist zero profile to ResourceManager (2.7.2)
[
https://issues.apache.org/jira/browse/MYRIAD-231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Klaus Ma updated MYRIAD-231:
Comment: was deleted
(was: [~darinj], any suggestion?)
> Failed to regist zero profile to ResourceManager (2.7.2)
>
>
> Key: MYRIAD-231
> URL: https://issues.apache.org/jira/browse/MYRIAD-231
> Project: Myriad
> Issue Type: Bug
> Reporter: Klaus Ma
>
> Here's the error message of NodeManager:
> {code}
> 16/06/29 16:27:50 ERROR nodemanager.NodeStatusUpdaterImpl: Unexpected error
> starting NodeStatusUpdater
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
> 16/06/29 16:27:50 INFO service.AbstractService: Service
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl failed in
> state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:202)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
> Caused by: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved
> SHUTDOWN signal from Resourcemanager ,Registration of NodeManager failed,
> Message from ResourceManager: NodeManager from dcos33.private.dns.zone
> doesn't satisfy minimum allocations, Sending SHUTDOWN signal to the
> NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
> ... 6 more
> 16/06/29 16:27:50 INFO service.AbstractService: Service NodeManager failed in
> state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManage
[jira] [Commented] (MYRIAD-231) Failed to regist zero profile to ResourceManager (2.7.2)
[
https://issues.apache.org/jira/browse/MYRIAD-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15354815#comment-15354815
]
Klaus Ma commented on MYRIAD-231:
-
[~darinj], any suggestion?
> Failed to regist zero profile to ResourceManager (2.7.2)
>
>
> Key: MYRIAD-231
> URL: https://issues.apache.org/jira/browse/MYRIAD-231
> Project: Myriad
> Issue Type: Bug
> Reporter: Klaus Ma
>
> Here's the error message of NodeManager:
> {code}
> 16/06/29 16:27:50 ERROR nodemanager.NodeStatusUpdaterImpl: Unexpected error
> starting NodeStatusUpdater
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
> 16/06/29 16:27:50 INFO service.AbstractService: Service
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl failed in
> state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:202)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
> Caused by: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved
> SHUTDOWN signal from Resourcemanager ,Registration of NodeManager failed,
> Message from ResourceManager: NodeManager from dcos33.private.dns.zone
> doesn't satisfy minimum allocations, Sending SHUTDOWN signal to the
> NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
> ... 6 more
> 16/06/29 16:27:50 INFO service.AbstractService: Service NodeManager failed in
> state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManage
[jira] [Commented] (MYRIAD-231) Failed to regist zero profile to ResourceManager (2.7.2)
[
https://issues.apache.org/jira/browse/MYRIAD-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15354816#comment-15354816
]
Klaus Ma commented on MYRIAD-231:
-
[~darinj], any suggestion?
> Failed to regist zero profile to ResourceManager (2.7.2)
>
>
> Key: MYRIAD-231
> URL: https://issues.apache.org/jira/browse/MYRIAD-231
> Project: Myriad
> Issue Type: Bug
> Reporter: Klaus Ma
>
> Here's the error message of NodeManager:
> {code}
> 16/06/29 16:27:50 ERROR nodemanager.NodeStatusUpdaterImpl: Unexpected error
> starting NodeStatusUpdater
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
> 16/06/29 16:27:50 INFO service.AbstractService: Service
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl failed in
> state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:202)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
> at
> org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
> Caused by: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved
> SHUTDOWN signal from Resourcemanager ,Registration of NodeManager failed,
> Message from ResourceManager: NodeManager from dcos33.private.dns.zone
> doesn't satisfy minimum allocations, Sending SHUTDOWN signal to the
> NodeManager.
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
> ... 6 more
> 16/06/29 16:27:50 INFO service.AbstractService: Service NodeManager failed in
> state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
> minimum allocations, Sending SHUTDOWN signal to the NodeManager.
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
> org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
> signal from Resourcemanager ,Registration of NodeManager failed, Message from
> ResourceManager: NodeManage
[jira] [Created] (MYRIAD-231) Failed to regist zero profile to ResourceManager (2.7.2)
Klaus Ma created MYRIAD-231:
---
Summary: Failed to regist zero profile to ResourceManager (2.7.2)
Key: MYRIAD-231
URL: https://issues.apache.org/jira/browse/MYRIAD-231
Project: Myriad
Issue Type: Bug
Reporter: Klaus Ma
Here's the error message of NodeManager:
{code}
16/06/29 16:27:50 ERROR nodemanager.NodeStatusUpdaterImpl: Unexpected error
starting NodeStatusUpdater
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
signal from Resourcemanager ,Registration of NodeManager failed, Message from
ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
minimum allocations, Sending SHUTDOWN signal to the NodeManager.
at
org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
at
org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at
org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
16/06/29 16:27:50 INFO service.AbstractService: Service
org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl failed in state
STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
signal from Resourcemanager ,Registration of NodeManager failed, Message from
ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
minimum allocations, Sending SHUTDOWN signal to the NodeManager.
org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
signal from Resourcemanager ,Registration of NodeManager failed, Message from
ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
minimum allocations, Sending SHUTDOWN signal to the NodeManager.
at
org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:202)
at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at
org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:486)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:533)
Caused by: org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved
SHUTDOWN signal from Resourcemanager ,Registration of NodeManager failed,
Message from ResourceManager: NodeManager from dcos33.private.dns.zone doesn't
satisfy minimum allocations, Sending SHUTDOWN signal to the NodeManager.
at
org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:270)
at
org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:196)
... 6 more
16/06/29 16:27:50 INFO service.AbstractService: Service NodeManager failed in
state STARTED; cause: org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
signal from Resourcemanager ,Registration of NodeManager failed, Message from
ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
minimum allocations, Sending SHUTDOWN signal to the NodeManager.
org.apache.hadoop.yarn.exceptions.YarnRuntimeException:
org.apache.hadoop.yarn.exceptions.YarnRuntimeException: Recieved SHUTDOWN
signal from Resourcemanager ,Registration of NodeManager failed, Message from
ResourceManager: NodeManager from dcos33.private.dns.zone doesn't satisfy
minimum allocations, Sending SHUTDOWN signal to the NodeManager.
at
org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.serviceStart(NodeStatusUpdaterImpl.java:202)
at
org.apache.hadoop.service.AbstractService.start(AbstractService.java:193)
at
org.apache.hadoop.service.CompositeService.serviceStart(CompositeService.java:120)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.serviceStart(NodeManager.java:271)
at
org.apache.hadoop.service.AbstractService.start
Re: Myraid Slack
Could you help to send an invitation or google calendar link? Da (Klaus), Ma (??), PMP(r)| Advisory Software Engineer Platform DCOS Development & Support, STG, IBM GCG +86-10-8245 4084 | mad...@cn.ibm.com | http://k82.me <http://k82.me/> From: Adam Bordelon <a...@mesosphere.io> Sent: Wednesday, June 29, 2016 2:34:38 AM To: dev@myriad.incubator.apache.org Subject: Re: Myraid Slack (Next dev sync is tomorrow, 9am Pacific time) On Tue, Jun 28, 2016 at 12:32 PM, Darin Johnson <dbjohnson1...@gmail.com> wrote: > We also have a dev sync every other Wednesday via Google Hangouts: > https://plus.google.com/hangouts/_/mesosphere.io/myriad > > Darin > > On Thu, Jun 23, 2016 at 3:01 AM, Swapnil Daingade < > swapnil.daing...@gmail.com> wrote: > > > Hi Sam, > > > > Myriad is a fairly new project. The IPMC vote for Myriad 0.2 just passed > > this week. > > Given we are early in the incubation stage, its not uncommon for one or > > two vendors > > to back the project. > > > > I'll let other community members talk about their experiences deploying > > Myriad > > but Its really great that you are considering deploying Myriad in > > production. > > Your feedback will definitely help shape the road map for Myriad going > > forward. > > > > Regards > > Swapnil > > > > > > > > On 06/22/2016 11:24 PM, Sam Chen wrote: > > > >> Hi Swapnil, > >> MapR is one company to give Myriad support, right? Any reference ? > >> > >> Regards, > >> Sam > >> > >> > >> Sent from my iPhone > >> > >> On Jun 23, 2016, at 10:39 AM, Swapnil Daingade < > >>> swapnil.daing...@gmail.com> wrote: > >>> > >>> MapR supports Myriad 0.1 currently > >>> > >>> https://www.mapr.com/products/whats-included > >>> https://www.mapr.com/products/product-overview/apache-myriad > >>> > >>> Regards > >>> Swapnil > >>> > >>> > >>> On Wed, Jun 22, 2016 at 6:51 PM, Sam Chen <rc...@linkernetworks.com> > >>>> wrote: > >>>> > >>>> Hi Darin, > >>>> Thanks for you reply. Makes sense to use Slack. Btw, we are going to > use > >>>> Myriad in production, any company have capability to support this ? > And > >>>> is > >>>> there any reference in production ? > >>>> > >>>> Regards, > >>>> Sam > >>>> > >>>> Sent from my iPhone > >>>> > >>>> On Jun 23, 2016, at 2:30 AM, Darin Johnson <dbjohnson1...@gmail.com> > >>>>>> > >>>>> wrote: > >>>>> > >>>>> Sam, > >>>>> > >>>>> I don't believe so. But we do have an IRC channel #myriad on > FreeNode. > >>>>> > >>>> I > >>>> > >>>>> know the mesosphere guys set up slackbots to interact with it. I'm > >>>>> only > >>>>> there occasionally or by appointment. I did notice Kudu now uses > slack, > >>>>> > >>>> so > >>>> > >>>>> maybe slack makes more sense than IRC these days, or Gitter Chat. > >>>>> > >>>>> Darin > >>>>> > >>>>> On Wed, Jun 22, 2016 at 1:55 AM, Sam Chen <rc...@linkernetworks.com> > >>>>>> > >>>>> wrote: > >>>> > >>>>> Guys, > >>>>>> Do we have Slack for Myraid? > >>>>>> > >>>>>> Regards , > >>>>>> Sam > >>>>>> > >>>>>> Sent from my iPhone > >>>>>> > >>>>> > >>>> > >>>> > >> > >> > > >
[jira] [Commented] (MYRIAD-228) Duplicated NM opts
[
https://issues.apache.org/jira/browse/MYRIAD-228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15354390#comment-15354390
]
Klaus Ma commented on MYRIAD-228:
-
[~darinj] , that's great. If there's anything I can contribute, please ping me
:)
> Duplicated NM opts
> --
>
> Key: MYRIAD-228
> URL: https://issues.apache.org/jira/browse/MYRIAD-228
> Project: Myriad
> Issue Type: Bug
> Reporter: Klaus Ma
>
> In {{NMExecutorCLGenImpl.java:addYarnNodemanagerOpt}}, it keep appending NM
> Opts. It'll make arguments too long.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (MYRIAD-228) Duplicated NM opts
[
https://issues.apache.org/jira/browse/MYRIAD-228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15338295#comment-15338295
]
Klaus Ma commented on MYRIAD-228:
-
That's great :). Thanks very much :).
Thanks
Klaus
> Duplicated NM opts
> --
>
> Key: MYRIAD-228
> URL: https://issues.apache.org/jira/browse/MYRIAD-228
> Project: Myriad
> Issue Type: Bug
> Reporter: Klaus Ma
>
> In {{NMExecutorCLGenImpl.java:addYarnNodemanagerOpt}}, it keep appending NM
> Opts. It'll make arguments too long.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Comment Edited] (MYRIAD-228) Duplicated NM opts
[
https://issues.apache.org/jira/browse/MYRIAD-228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15337978#comment-15337978
]
Klaus Ma edited comment on MYRIAD-228 at 6/18/16 3:31 PM:
--
It seems we should clear environments when generate command, draft code diff:
{code}
index db945ec..424ecf6 100644
---
a/myriad-scheduler/src/main/java/org/apache/myriad/scheduler/NMExecutorCLGenImpl.java
+++
b/myriad-scheduler/src/main/java/org/apache/myriad/scheduler/NMExecutorCLGenImpl.java
@@ -68,14 +68,17 @@ public class NMExecutorCLGenImpl implements
ExecutorCommandLineGenerator {
protected void generateEnvironment(ServiceResourceProfile profile, NMPorts
ports) {
+// clear old environment.
+environment.clear();
+
//yarnEnvironemnt configuration from yaml file
Map<String, String> yarnEnvironmentMap = cfg.getYarnEnvironment();
if (yarnEnvironmentMap != null) {
{code}
[~adam-mesos], any comments on that?
was (Author: klaus1982):
It seems we should clear environments when generate command, draft code diff:
{code}
index db945ec..424ecf6 100644
---
a/myriad-scheduler/src/main/java/org/apache/myriad/scheduler/NMExecutorCLGenImpl.java
+++
b/myriad-scheduler/src/main/java/org/apache/myriad/scheduler/NMExecutorCLGenImpl.java
@@ -68,14 +68,17 @@ public class NMExecutorCLGenImpl implements
ExecutorCommandLineGenerator {
protected void generateEnvironment(ServiceResourceProfile profile, NMPorts
ports) {
+// clear old environment.
+environment.clear();
+
//yarnEnvironemnt configuration from yaml file
Map<String, String> yarnEnvironmentMap = cfg.getYarnEnvironment();
if (yarnEnvironmentMap != null) {
{code}
> Duplicated NM opts
> --
>
> Key: MYRIAD-228
> URL: https://issues.apache.org/jira/browse/MYRIAD-228
> Project: Myriad
> Issue Type: Bug
>Reporter: Klaus Ma
>
> In {{NMExecutorCLGenImpl.java:addYarnNodemanagerOpt}}, it keep appending NM
> Opts. It'll make arguments too long.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Issue Comment Deleted] (MYRIAD-228) Duplicated NM opts
[
https://issues.apache.org/jira/browse/MYRIAD-228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Klaus Ma updated MYRIAD-228:
Comment: was deleted
(was: It seems we should clear environments when generate command, draft code
diff:
{code}
index db945ec..424ecf6 100644
---
a/myriad-scheduler/src/main/java/org/apache/myriad/scheduler/NMExecutorCLGenImpl.java
+++
b/myriad-scheduler/src/main/java/org/apache/myriad/scheduler/NMExecutorCLGenImpl.java
@@ -68,14 +68,17 @@ public class NMExecutorCLGenImpl implements
ExecutorCommandLineGenerator {
protected void generateEnvironment(ServiceResourceProfile profile, NMPorts
ports) {
+// clear old environment.
+environment.clear();
+
//yarnEnvironemnt configuration from yaml file
Map<String, String> yarnEnvironmentMap = cfg.getYarnEnvironment();
if (yarnEnvironmentMap != null) {
{code})
> Duplicated NM opts
> --
>
> Key: MYRIAD-228
> URL: https://issues.apache.org/jira/browse/MYRIAD-228
> Project: Myriad
> Issue Type: Bug
>Reporter: Klaus Ma
>
> In {{NMExecutorCLGenImpl.java:addYarnNodemanagerOpt}}, it keep appending NM
> Opts. It'll make arguments too long.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (MYRIAD-228) Duplicated NM opts
[
https://issues.apache.org/jira/browse/MYRIAD-228?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15337978#comment-15337978
]
Klaus Ma commented on MYRIAD-228:
-
It seems we should clear environments when generate command, draft code diff:
{code}
index db945ec..424ecf6 100644
---
a/myriad-scheduler/src/main/java/org/apache/myriad/scheduler/NMExecutorCLGenImpl.java
+++
b/myriad-scheduler/src/main/java/org/apache/myriad/scheduler/NMExecutorCLGenImpl.java
@@ -68,14 +68,17 @@ public class NMExecutorCLGenImpl implements
ExecutorCommandLineGenerator {
protected void generateEnvironment(ServiceResourceProfile profile, NMPorts
ports) {
+// clear old environment.
+environment.clear();
+
//yarnEnvironemnt configuration from yaml file
Map<String, String> yarnEnvironmentMap = cfg.getYarnEnvironment();
if (yarnEnvironmentMap != null) {
{code}
> Duplicated NM opts
> --
>
> Key: MYRIAD-228
> URL: https://issues.apache.org/jira/browse/MYRIAD-228
> Project: Myriad
> Issue Type: Bug
>Reporter: Klaus Ma
>
> In {{NMExecutorCLGenImpl.java:addYarnNodemanagerOpt}}, it keep appending NM
> Opts. It'll make arguments too long.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Re: Question on Mesos Reservation
Hi Adam, Just go through the code of Myriad on resource usage, there's some behaviour I'd like to confirm with you. 1. Myriad can not use reserved resource and normal resource together 2. There's no priority on which resources will be used firstly, reserved resource vs. normal resources If any comments, please let me know :). Da (Klaus), Ma (??), PMP(r)| Advisory Software Engineer Platform DCOS Development & Support, STG, IBM GCG +86-10-8245 4084 | mad...@cn.ibm.com | http://k82.me <http://k82.me/> From: Adam Bordelon <a...@mesosphere.io> Sent: Tuesday, June 14, 2016 6:00:40 PM To: dev@myriad.incubator.apache.org Subject: Re: Question on Mesos Reservation The Myriad framework can register with a Mesos role if you set the 'frameworkRole' config param. Then you can configure Mesos agents to have static reservations, or use the operator endpoints to grant dynamic reservations to that role, or configure a minimum resource quota for that role. See http://mesos.apache.org/documentation/latest/roles/ and http://mesos.apache.org/documentation/latest/reservation/ and http://mesos.apache.org/documentation/latest/quota/ There is currently no support yet for Myriad to create dynamic reservations on its own (I just created MYRIAD-221 <https://issues.apache.org/jira/browse/MYRIAD-221> to track it), nor for Myriad to take advantage of revocable resources (MYRIAD-179 <https://issues.apache.org/jira/browse/MYRIAD-179>). These would be great features for Myriad 0.3, but I don't think we have anybody committed to work on them yet. Your comments/help are appreciated. On Tue, Jun 14, 2016 at 2:24 AM, Sam Chen <rc...@linkernetworks.com> wrote: > Guys, > Talking about the latest Myriad distribution, can it support the feature > of Mesos Reservation? If no, what's the roadmap and plan on this? > Appreciated. > > Regards, > Sam > > Sent from my iPhone
