[jira] [Assigned] (MYRIAD-202) minimesos-based integration tests

2016-06-02 Thread John Yost (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MYRIAD-202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

John Yost reassigned MYRIAD-202:


Assignee: John Yost

> minimesos-based integration tests
> -
>
> Key: MYRIAD-202
> URL: https://issues.apache.org/jira/browse/MYRIAD-202
> Project: Myriad
>  Issue Type: Improvement
>Reporter: John Yost
>Assignee: John Yost
>
> Implement integration tests with mini-mesos to bridge the gap between a unit 
> test harness and deployment to a mesos cluster.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Commented] (MYRIAD-134) Support Zookeeper based implementation of RMStateStore for storing Myriad state

2016-06-02 Thread Swapnil Daingade (JIRA) 

[ 
https://issues.apache.org/jira/browse/MYRIAD-134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15312461#comment-15312461
 ] 

Swapnil Daingade commented on MYRIAD-134:
-

You will need to extend the ZKRMStateStore that Hadoop already provides with 
Myriad specific information. See here
https://github.com/apache/hadoop/blob/trunk/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/recovery/ZKRMStateStore.java

> Support Zookeeper based implementation of RMStateStore for storing Myriad 
> state
> ---
>
> Key: MYRIAD-134
> URL: https://issues.apache.org/jira/browse/MYRIAD-134
> Project: Myriad
>  Issue Type: Task
>  Components: Scheduler
>Reporter: Swapnil Daingade
>Assignee: Zachary Jaffee
>
> Currently we support a DFS based implementation of RMStateStore for storing 
> Myriad State (MyriadFileSystemRMStateStore). We need to similarly support a 
> Zookeeper base one.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Updated] (MYRIAD-134) Support Zookeeper based implementation of RMStateStore for storing Myriad state

2016-06-02 Thread DarinJ (JIRA) 

 [ 
https://issues.apache.org/jira/browse/MYRIAD-134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

DarinJ updated MYRIAD-134:
--
Assignee: Zachary Jaffee  (was: Swapnil Daingade)

> Support Zookeeper based implementation of RMStateStore for storing Myriad 
> state
> ---
>
> Key: MYRIAD-134
> URL: https://issues.apache.org/jira/browse/MYRIAD-134
> Project: Myriad
>  Issue Type: Task
>  Components: Scheduler
>Reporter: Swapnil Daingade
>Assignee: Zachary Jaffee
>
> Currently we support a DFS based implementation of RMStateStore for storing 
> Myriad State (MyriadFileSystemRMStateStore). We need to similarly support a 
> Zookeeper base one.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: [Vote] Release apache-myriad-0.2.0-incubating (release candidate 4)

2016-06-02 Thread Darin Johnson 
Hey all I need one more committer vote for RC4.  John and I have a lot of
other improvements we want to start working on but are waiting to cut a
stable release first.

Darin

On Mon, May 30, 2016 at 4:33 PM, sarjeet singh  wrote:

> +1 (Non-binding)
>
> Verified md5 and sha512 checksums.
> D/L myriad-0.2.0-incubating-rc4.tar.gz, Compiled & deployed it on a 1 node
> MapR cluster.
> Tried FGS/CGS flex up/down, and ran long/short running M/R jobs.
> Tried framework shutdown from UI/API, and tried re-launching myriad again.
> Tried Cgroups and able to launch NMs w/ cgroups enabled successfully.
>
> - Sarjeet Singh
>
> On Fri, May 27, 2016 at 3:36 PM, Santosh Marella 
> wrote:
>
> > +1 (Binding).
> >
> > - Verified signature
> > - Verified MD5 and SHA512 hashes
> > - Builds from source tar ball.
> > - Ran Apache RAT. Verified that all the sources have license headers.
> > - Verified CGS/FGS behaviors with MapReduce jobs on a 4 node Mesos/Yarn
> > cluster.
> >
> > Thanks,
> > Santosh
> >
> > On Tue, May 24, 2016 at 7:46 PM, Darin Johnson 
> > wrote:
> >
> > > I'm voting +1 (Binding)
> > >
> > > Verified md5/sha hashes.  Compiled with gradle build, gradle
> > buildRMDocker
> > > (on OSX with docker-machine).
> > >
> > > Ran remote distribution (with cgroups) on a 4 node cluster (Ubuntu,
> > > hadoop-2.6.0, hadoop 2.7.0) with one CGS NM and 3 FGS NM.  Ran 8
> > > simultaneous jobs.  Shut down Framework.  Restarted NodeManager, ran an
> > > additional 3 jobs.
> > >
> > > Ran the same with docker (minus cgroups).
> > >
> > > Darin
> > >
> > > On Tue, May 24, 2016 at 10:40 PM, Darin Johnson <
> dbjohnson1...@gmail.com
> > >
> > > wrote:
> > >
> > > > Hi All,
> > > >
> > > > I have created a source tar ball for Apache Myriad 0.2.0-incubating,
> > > > release candidate 3 based off the feed back received from release
> > > > candidate 1,2 & 3.  Thanks Sarjeet for a very thorough review!
> > > >
> > > > Here’s the release notes:
> > > > https://cwiki.apache.org/confluence/display/MYRIAD/Release+Notes
> > > >
> > > > The commit to be voted upon is tagged with
> > "myriad-0.2.0-incubating-rc4"
> > > > and is available here:
> > > >
> > > >
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=incubator-myriad.git;a=shortlog;h=refs/tags/myriad-0.2.0-incubating-rc
> > > > <
> > >
> >
> https://git-wip-us.apache.org/repos/asf?p=incubator-myriad.git;a=shortlog;h=refs/tags/myriad-0.2.0-incubating-rc4
> > > >
> > > > 4
> > > >
> > > > The artifacts to be voted upon are located below. Please note that
> this
> > > is
> > > > a source release:
> > > >
> > > >
> > >
> >
> https://dist.apache.org/repos/dist/dev/incubator/myriad/myriad-0.2.0-incubating-rc4/
> > > >
> > > > Release artifacts are signed with the following key:
> > > > *https://home.apache.org/~darinj/gpg/2AAE9E3F.asc
> > > > *
> > > >
> > > > **Please note that the release tar ball does not include the gradlew
> > > script
> > > > to build. You need to install gradle in order to build.**
> > > >
> > > > Please try out the release candidate and vote. The vote is open for a
> > > > minimum of 3 business days (Friday May 27) or until the necessary
> > number
> > > > of votes (3 binding +1s)
> > > > is reached.
> > > >
> > > > If/when this vote succeeds, I will call for a vote with IPMC seeking
> > > > permission to release RC3 as Apache Myriad 0.2.0 (incubating).
> > > >
> > > > [ ] +1 Release this package as Apache Myriad 0.2.0-incubating
> > > > [ ]  0 I don't feel strongly about it, but I'm okay with the release
> > > > [ ] -1 Do not release this package because...
> > > >
> > > > Thanks,
> > > > Darin
> > > >
> > >
> >
>