Re: [Vote] Release apache-myriad-0.2.0-incubating (release candidate 4)

[Darin Johnson]

The vote for 0.2.0 RC4 has concluded and passed.  Thanks to everyone who
verified the release and voted!

Binding +1's
Darin Johnson
Santosh Marella
Mohit Soni

Non-Binding +1's
John Yost
Sarjeet Signh
Brandon Gulla

I'll submit the release to the IPMC to vote.

Darin

On Thu, Jun 9, 2016 at 8:49 PM, Adam Bordelon  wrote:

> Looks like we got our 3rd binding vote! Let's announce the result and ask
> Incubator PMC to begin their vote. Darin, let me/Santosh know if you need
> advice on this part of the process.
>
>
> On Thu, Jun 9, 2016 at 5:44 PM, Brandon Gulla 
> wrote:
>
> > +1
> >
> > built and tested on a test cluster. great work guys.
> >
> > On Thu, Jun 9, 2016 at 6:39 PM, mohit soni 
> > wrote:
> >
> > > +1 (Binding)
> > >
> > > - Verified signature
> > > - Verified MD5 and SHA512 hashes
> > > - Builds from source tar ball.
> > > - Installed Myriad on a Mesos cluster and ran sanity tests.
> > >
> > > Thanks
> > > Mohit
> > >
> > > On Thu, Jun 2, 2016 at 7:25 AM, John Yost 
> wrote:
> > >
> > > > I'm voting +1
> > > >
> > > > --John
> > > >
> > > > On Tue, May 24, 2016 at 10:46 PM, Darin Johnson <
> > dbjohnson1...@gmail.com
> > > >
> > > > wrote:
> > > >
> > > > > I'm voting +1 (Binding)
> > > > >
> > > > > Verified md5/sha hashes.  Compiled with gradle build, gradle
> > > > buildRMDocker
> > > > > (on OSX with docker-machine).
> > > > >
> > > > > Ran remote distribution (with cgroups) on a 4 node cluster (Ubuntu,
> > > > > hadoop-2.6.0, hadoop 2.7.0) with one CGS NM and 3 FGS NM.  Ran 8
> > > > > simultaneous jobs.  Shut down Framework.  Restarted NodeManager,
> ran
> > an
> > > > > additional 3 jobs.
> > > > >
> > > > > Ran the same with docker (minus cgroups).
> > > > >
> > > > > Darin
> > > > >
> > > > > On Tue, May 24, 2016 at 10:40 PM, Darin Johnson <
> > > dbjohnson1...@gmail.com
> > > > >
> > > > > wrote:
> > > > >
> > > > > > Hi All,
> > > > > >
> > > > > > I have created a source tar ball for Apache Myriad
> > 0.2.0-incubating,
> > > > > > release candidate 3 based off the feed back received from release
> > > > > > candidate 1,2 & 3.  Thanks Sarjeet for a very thorough review!
> > > > > >
> > > > > > Here’s the release notes:
> > > > > > https://cwiki.apache.org/confluence/display/MYRIAD/Release+Notes
> > > > > >
> > > > > > The commit to be voted upon is tagged with
> > > > "myriad-0.2.0-incubating-rc4"
> > > > > > and is available here:
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=incubator-myriad.git;a=shortlog;h=refs/tags/myriad-0.2.0-incubating-rc
> > > > > > <
> > > > >
> > > >
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=incubator-myriad.git;a=shortlog;h=refs/tags/myriad-0.2.0-incubating-rc4
> > > > > >
> > > > > > 4
> > > > > >
> > > > > > The artifacts to be voted upon are located below. Please note
> that
> > > this
> > > > > is
> > > > > > a source release:
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/incubator/myriad/myriad-0.2.0-incubating-rc4/
> > > > > >
> > > > > > Release artifacts are signed with the following key:
> > > > > > *https://home.apache.org/~darinj/gpg/2AAE9E3F.asc
> > > > > > *
> > > > > >
> > > > > > **Please note that the release tar ball does not include the
> > gradlew
> > > > > script
> > > > > > to build. You need to install gradle in order to build.**
> > > > > >
> > > > > > Please try out the release candidate and vote. The vote is open
> > for a
> > > > > > minimum of 3 business days (Friday May 27) or until the necessary
> > > > number
> > > > > > of votes (3 binding +1s)
> > > > > > is reached.
> > > > > >
> > > > > > If/when this vote succeeds, I will call for a vote with IPMC
> > seeking
> > > > > > permission to release RC3 as Apache Myriad 0.2.0 (incubating).
> > > > > >
> > > > > > [ ] +1 Release this package as Apache Myriad 0.2.0-incubating
> > > > > > [ ]  0 I don't feel strongly about it, but I'm okay with the
> > release
> > > > > > [ ] -1 Do not release this package because...
> > > > > >
> > > > > > Thanks,
> > > > > > Darin
> > > > > >
> > > > >
> > > >
> > >
> >
> >
> >
> > --
> > Brandon
> >
>

Re: [Vote] Release apache-myriad-0.2.0-incubating (release candidate 4)

[Adam Bordelon]

Looks like we got our 3rd binding vote! Let's announce the result and ask
Incubator PMC to begin their vote. Darin, let me/Santosh know if you need
advice on this part of the process.


On Thu, Jun 9, 2016 at 5:44 PM, Brandon Gulla 
wrote:

> +1
>
> built and tested on a test cluster. great work guys.
>
> On Thu, Jun 9, 2016 at 6:39 PM, mohit soni 
> wrote:
>
> > +1 (Binding)
> >
> > - Verified signature
> > - Verified MD5 and SHA512 hashes
> > - Builds from source tar ball.
> > - Installed Myriad on a Mesos cluster and ran sanity tests.
> >
> > Thanks
> > Mohit
> >
> > On Thu, Jun 2, 2016 at 7:25 AM, John Yost  wrote:
> >
> > > I'm voting +1
> > >
> > > --John
> > >
> > > On Tue, May 24, 2016 at 10:46 PM, Darin Johnson <
> dbjohnson1...@gmail.com
> > >
> > > wrote:
> > >
> > > > I'm voting +1 (Binding)
> > > >
> > > > Verified md5/sha hashes.  Compiled with gradle build, gradle
> > > buildRMDocker
> > > > (on OSX with docker-machine).
> > > >
> > > > Ran remote distribution (with cgroups) on a 4 node cluster (Ubuntu,
> > > > hadoop-2.6.0, hadoop 2.7.0) with one CGS NM and 3 FGS NM.  Ran 8
> > > > simultaneous jobs.  Shut down Framework.  Restarted NodeManager, ran
> an
> > > > additional 3 jobs.
> > > >
> > > > Ran the same with docker (minus cgroups).
> > > >
> > > > Darin
> > > >
> > > > On Tue, May 24, 2016 at 10:40 PM, Darin Johnson <
> > dbjohnson1...@gmail.com
> > > >
> > > > wrote:
> > > >
> > > > > Hi All,
> > > > >
> > > > > I have created a source tar ball for Apache Myriad
> 0.2.0-incubating,
> > > > > release candidate 3 based off the feed back received from release
> > > > > candidate 1,2 & 3.  Thanks Sarjeet for a very thorough review!
> > > > >
> > > > > Here’s the release notes:
> > > > > https://cwiki.apache.org/confluence/display/MYRIAD/Release+Notes
> > > > >
> > > > > The commit to be voted upon is tagged with
> > > "myriad-0.2.0-incubating-rc4"
> > > > > and is available here:
> > > > >
> > > > >
> > > >
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=incubator-myriad.git;a=shortlog;h=refs/tags/myriad-0.2.0-incubating-rc
> > > > > <
> > > >
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=incubator-myriad.git;a=shortlog;h=refs/tags/myriad-0.2.0-incubating-rc4
> > > > >
> > > > > 4
> > > > >
> > > > > The artifacts to be voted upon are located below. Please note that
> > this
> > > > is
> > > > > a source release:
> > > > >
> > > > >
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/incubator/myriad/myriad-0.2.0-incubating-rc4/
> > > > >
> > > > > Release artifacts are signed with the following key:
> > > > > *https://home.apache.org/~darinj/gpg/2AAE9E3F.asc
> > > > > *
> > > > >
> > > > > **Please note that the release tar ball does not include the
> gradlew
> > > > script
> > > > > to build. You need to install gradle in order to build.**
> > > > >
> > > > > Please try out the release candidate and vote. The vote is open
> for a
> > > > > minimum of 3 business days (Friday May 27) or until the necessary
> > > number
> > > > > of votes (3 binding +1s)
> > > > > is reached.
> > > > >
> > > > > If/when this vote succeeds, I will call for a vote with IPMC
> seeking
> > > > > permission to release RC3 as Apache Myriad 0.2.0 (incubating).
> > > > >
> > > > > [ ] +1 Release this package as Apache Myriad 0.2.0-incubating
> > > > > [ ]  0 I don't feel strongly about it, but I'm okay with the
> release
> > > > > [ ] -1 Do not release this package because...
> > > > >
> > > > > Thanks,
> > > > > Darin
> > > > >
> > > >
> > >
> >
>
>
>
> --
> Brandon
>

Re: [Vote] Release apache-myriad-0.2.0-incubating (release candidate 4)

[Brandon Gulla]

+1

built and tested on a test cluster. great work guys.

On Thu, Jun 9, 2016 at 6:39 PM, mohit soni  wrote:

> +1 (Binding)
>
> - Verified signature
> - Verified MD5 and SHA512 hashes
> - Builds from source tar ball.
> - Installed Myriad on a Mesos cluster and ran sanity tests.
>
> Thanks
> Mohit
>
> On Thu, Jun 2, 2016 at 7:25 AM, John Yost  wrote:
>
> > I'm voting +1
> >
> > --John
> >
> > On Tue, May 24, 2016 at 10:46 PM, Darin Johnson  >
> > wrote:
> >
> > > I'm voting +1 (Binding)
> > >
> > > Verified md5/sha hashes.  Compiled with gradle build, gradle
> > buildRMDocker
> > > (on OSX with docker-machine).
> > >
> > > Ran remote distribution (with cgroups) on a 4 node cluster (Ubuntu,
> > > hadoop-2.6.0, hadoop 2.7.0) with one CGS NM and 3 FGS NM.  Ran 8
> > > simultaneous jobs.  Shut down Framework.  Restarted NodeManager, ran an
> > > additional 3 jobs.
> > >
> > > Ran the same with docker (minus cgroups).
> > >
> > > Darin
> > >
> > > On Tue, May 24, 2016 at 10:40 PM, Darin Johnson <
> dbjohnson1...@gmail.com
> > >
> > > wrote:
> > >
> > > > Hi All,
> > > >
> > > > I have created a source tar ball for Apache Myriad 0.2.0-incubating,
> > > > release candidate 3 based off the feed back received from release
> > > > candidate 1,2 & 3.  Thanks Sarjeet for a very thorough review!
> > > >
> > > > Here’s the release notes:
> > > > https://cwiki.apache.org/confluence/display/MYRIAD/Release+Notes
> > > >
> > > > The commit to be voted upon is tagged with
> > "myriad-0.2.0-incubating-rc4"
> > > > and is available here:
> > > >
> > > >
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=incubator-myriad.git;a=shortlog;h=refs/tags/myriad-0.2.0-incubating-rc
> > > > <
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=incubator-myriad.git;a=shortlog;h=refs/tags/myriad-0.2.0-incubating-rc4
> > > >
> > > > 4
> > > >
> > > > The artifacts to be voted upon are located below. Please note that
> this
> > > is
> > > > a source release:
> > > >
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/incubator/myriad/myriad-0.2.0-incubating-rc4/
> > > >
> > > > Release artifacts are signed with the following key:
> > > > *https://home.apache.org/~darinj/gpg/2AAE9E3F.asc
> > > > *
> > > >
> > > > **Please note that the release tar ball does not include the gradlew
> > > script
> > > > to build. You need to install gradle in order to build.**
> > > >
> > > > Please try out the release candidate and vote. The vote is open for a
> > > > minimum of 3 business days (Friday May 27) or until the necessary
> > number
> > > > of votes (3 binding +1s)
> > > > is reached.
> > > >
> > > > If/when this vote succeeds, I will call for a vote with IPMC seeking
> > > > permission to release RC3 as Apache Myriad 0.2.0 (incubating).
> > > >
> > > > [ ] +1 Release this package as Apache Myriad 0.2.0-incubating
> > > > [ ]  0 I don't feel strongly about it, but I'm okay with the release
> > > > [ ] -1 Do not release this package because...
> > > >
> > > > Thanks,
> > > > Darin
> > > >
> > >
> >
>



-- 
Brandon

Re: [Vote] Release apache-myriad-0.2.0-incubating (release candidate 4)

[mohit soni]

+1 (Binding)

- Verified signature
- Verified MD5 and SHA512 hashes
- Builds from source tar ball.
- Installed Myriad on a Mesos cluster and ran sanity tests.

Thanks
Mohit

On Thu, Jun 2, 2016 at 7:25 AM, John Yost  wrote:

> I'm voting +1
>
> --John
>
> On Tue, May 24, 2016 at 10:46 PM, Darin Johnson 
> wrote:
>
> > I'm voting +1 (Binding)
> >
> > Verified md5/sha hashes.  Compiled with gradle build, gradle
> buildRMDocker
> > (on OSX with docker-machine).
> >
> > Ran remote distribution (with cgroups) on a 4 node cluster (Ubuntu,
> > hadoop-2.6.0, hadoop 2.7.0) with one CGS NM and 3 FGS NM.  Ran 8
> > simultaneous jobs.  Shut down Framework.  Restarted NodeManager, ran an
> > additional 3 jobs.
> >
> > Ran the same with docker (minus cgroups).
> >
> > Darin
> >
> > On Tue, May 24, 2016 at 10:40 PM, Darin Johnson  >
> > wrote:
> >
> > > Hi All,
> > >
> > > I have created a source tar ball for Apache Myriad 0.2.0-incubating,
> > > release candidate 3 based off the feed back received from release
> > > candidate 1,2 & 3.  Thanks Sarjeet for a very thorough review!
> > >
> > > Here’s the release notes:
> > > https://cwiki.apache.org/confluence/display/MYRIAD/Release+Notes
> > >
> > > The commit to be voted upon is tagged with
> "myriad-0.2.0-incubating-rc4"
> > > and is available here:
> > >
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=incubator-myriad.git;a=shortlog;h=refs/tags/myriad-0.2.0-incubating-rc
> > > <
> >
> https://git-wip-us.apache.org/repos/asf?p=incubator-myriad.git;a=shortlog;h=refs/tags/myriad-0.2.0-incubating-rc4
> > >
> > > 4
> > >
> > > The artifacts to be voted upon are located below. Please note that this
> > is
> > > a source release:
> > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/incubator/myriad/myriad-0.2.0-incubating-rc4/
> > >
> > > Release artifacts are signed with the following key:
> > > *https://home.apache.org/~darinj/gpg/2AAE9E3F.asc
> > > *
> > >
> > > **Please note that the release tar ball does not include the gradlew
> > script
> > > to build. You need to install gradle in order to build.**
> > >
> > > Please try out the release candidate and vote. The vote is open for a
> > > minimum of 3 business days (Friday May 27) or until the necessary
> number
> > > of votes (3 binding +1s)
> > > is reached.
> > >
> > > If/when this vote succeeds, I will call for a vote with IPMC seeking
> > > permission to release RC3 as Apache Myriad 0.2.0 (incubating).
> > >
> > > [ ] +1 Release this package as Apache Myriad 0.2.0-incubating
> > > [ ]  0 I don't feel strongly about it, but I'm okay with the release
> > > [ ] -1 Do not release this package because...
> > >
> > > Thanks,
> > > Darin
> > >
> >
>

[jira] [Commented] (MYRIAD-213) Better Resource Matching/Task Resource Creation

[DarinJ (JIRA)]

[ 
https://issues.apache.org/jira/browse/MYRIAD-213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15322805#comment-15322805
 ] 

DarinJ commented on MYRIAD-213:
---

I've looked into this a bit, I think I'll break it into the following subtasks:

1. Resolve NMPorts by adding a more general Ports container class, Refactor 
ExecutorCommandLineGenerator classes to use this class (will resolve Myriad-214 
in the process).  Refactor TackFactory classes as necessary to work with this.  
This adds a few methods to TaskUtils to get port Resources.

2. Refactor ResourceOffersEventHandler, here I'll actually create a 
ResourceProfile which will be passed to the TaskFactories.  I'll then refactor 
TaskFactories appropriately.  This should made everything more modular and 
remove a lot of redundant code (which is executed more than needed).


> Better Resource Matching/Task Resource Creation
> ---
>
> Key: MYRIAD-213
> URL: https://issues.apache.org/jira/browse/MYRIAD-213
> Project: Myriad
>  Issue Type: Bug
>  Components: Scheduler
>Affects Versions: Myriad 0.2.0
>Reporter: DarinJ
>Priority: Minor
>
> Currently ResourceOffersEventHandler matches resources in an offer to tasks 
> then TaskFactory adds them to a task.  However, they both have to cycle 
> through the offers.  This is inefficient and could be optimized. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (MYRIAD-200) Increase JUnit Test Coverage

[John Yost (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MYRIAD-200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

John Yost updated MYRIAD-200:
-
Summary: Increase JUnit Test Coverage  (was: Increased JUnit Test Coverage)

> Increase JUnit Test Coverage
> 
>
> Key: MYRIAD-200
> URL: https://issues.apache.org/jira/browse/MYRIAD-200
> Project: Myriad
>  Issue Type: Bug
>  Components: Executor, Scheduler
>Reporter: DarinJ
>Assignee: John Yost
>
> Currently Unit Test coverage is weak in places also, a good integration test 
> framework would be helpful.  (potentially [minimesos|http://minimesos.org]?) 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (MYRIAD-216) Make OfferLifecycleManager thread safe

[John Yost (JIRA)]

John Yost created MYRIAD-216:


 Summary: Make OfferLifecycleManager thread safe
 Key: MYRIAD-216
 URL: https://issues.apache.org/jira/browse/MYRIAD-216
 Project: Myriad
  Issue Type: Bug
  Components: Scheduler
Reporter: John Yost
 Fix For: Myriad 0.3.0


There is a TODO note indicating that parts of OfferLifecycleManager are not 
thread-safe. We should fix this.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (MYRIAD-200) Increased JUnit Test Coverage

[John Yost (JIRA)]

 [ 
https://issues.apache.org/jira/browse/MYRIAD-200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

John Yost updated MYRIAD-200:
-
Summary: Increased JUnit Test Coverage  (was: Increased Unit Test and 
Integration Testing)

> Increased JUnit Test Coverage
> -
>
> Key: MYRIAD-200
> URL: https://issues.apache.org/jira/browse/MYRIAD-200
> Project: Myriad
>  Issue Type: Bug
>  Components: Executor, Scheduler
>Reporter: DarinJ
>Assignee: John Yost
>
> Currently Unit Test coverage is weak in places also, a good integration test 
> framework would be helpful.  (potentially [minimesos|http://minimesos.org]?) 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)