[Vote] Release apache-myriad-0.2.0-incubating (release candidate 3)

2016-05-23 Thread Darin Johnson 
Hi All,

I have created a source tar ball for Apache Myriad 0.2.0-incubating,
release candidate 3 based off the feed back received from release candidate
1 & 2.  Specifically, this corrected some documentation and a minor typo.

Here’s the release notes:
https://cwiki.apache.org/confluence/display/MYRIAD/Release+Notes

The commit to be voted upon is tagged with "myriad-0.2.0-incubating-rc2"
and is available here:
https://git-wip-us.apache.org/repos/asf?p=incubator-myriad.git;a=shortlog;h=refs/tags/myriad-0.2.0-incubating-rc

3

The artifacts to be voted upon are located below. Please note that this is
a source release:
https://dist.apache.org/repos/dist/dev/incubator/myriad/myriad-0.2.0-incubating-rc3/

Release artifacts are signed with the following key:
*https://home.apache.org/~darinj/gpg/2AAE9E3F.asc
*

**Please note that the release tar ball does not include the gradlew script
to build. You need to install gradle in order to build.**

Please try out the release candidate and vote. The vote is open for a
minimum of 3 business days (Friday May 27) or until the necessary number of
votes (3 binding +1s)
is reached.

If/when this vote succeeds, I will call for a vote with IPMC seeking
permission to release RC3 as Apache Myriad 0.2.0 (incubating).

[ ] +1 Release this package as Apache Myriad 0.2.0-incubating
[ ]  0 I don't feel strongly about it, but I'm okay with the release
[ ] -1 Do not release this package because...

Thanks,
Darin

Re: Issues related to RM docker container on Myriad RC2.

2016-05-23 Thread Sarjeet Singh 
AFAIK, I might have few configuration and setup issue related to docker
issues. I'll still look into it more once I have some more time. But
overall, RC2 looks good and docker issue is not a blocker as such.

Let me know if anyone else is able to try docker stuff successfully and
willing to share the story :).

-Sarjeet

On Sun, May 22, 2016 at 8:54 PM, sarjeet singh 
wrote:

> I tried following to try out docker from myriad rc2, but couldn't past
> after RM is launched and not able to launch NMs.
>
> Here is the formatted output for the RM docker launch:
>
> root@qa101-139:~/myriad/myriad-0.2.0-incubating-rc2/docker# docker run
> --net=host -v $PWD/dist -v $PWD/config:/usr/local/hadoop/etc/hadoop
> --name='myriad-resourcemanager' -t sarjeet/myriad
>
> 2016-05-23 03:38:21,431 INFO  [main] myriad.Main
> (Main.java:initHealthChecks(140)) - Initializing HealthChecks
>
> 2016-05-23 03:38:21,445 INFO  [main] myriad.Main
> (Main.java:initProfiles(148)) - Initializing Profiles
>
> 2016-05-23 03:38:21,450 INFO  [main] scheduler.ServiceProfileManager
> (ServiceProfileManager.java:add(40)) - Adding profile zero with CPU: 0.0
> and Memory: 0.0
>
> 2016-05-23 03:38:21,450 INFO  [main] scheduler.ServiceProfileManager
> (ServiceProfileManager.java:add(40)) - Adding profile small with CPU: 2.0
> and Memory: 2048.0
>
> 2016-05-23 03:38:21,450 INFO  [main] scheduler.ServiceProfileManager
> (ServiceProfileManager.java:add(40)) - Adding profile medium with CPU: 4.0
> and Memory: 4096.0
>
> 2016-05-23 03:38:21,450 INFO  [main] scheduler.ServiceProfileManager
> (ServiceProfileManager.java:add(40)) - Adding profile large with CPU: 10.0
> and Memory: 12288.0
>
> 2016-05-23 03:38:21,451 INFO  [main] myriad.Main
> (Main.java:validateNMInstances(175)) - Validating nmInstances..
>
> 2016-05-23 03:38:21,451 INFO  [main] myriad.Main
> (Main.java:initServiceConfigurations(238)) - Initializing
> initServiceConfigurations
>
> 2016-05-23 03:38:21,534 INFO  [main] myriad.Main
> (Main.java:startMesosDriver(119)) - starting mesosDriver..
>
> 2016-05-23 03:38:21,534 INFO  [main] scheduler.MyriadDriverManager
> (MyriadDriverManager.java:startDriver(51)) - Starting driver...
>
> 2016-05-23 03:38:21,534 INFO  [main] scheduler.MyriadDriver
> (MyriadDriver.java:start(49)) - Starting driver
>
> 2016-05-23 03:38:21,535:7(0x7f4e9b3ac700):ZOO_INFO@log_env@712: Client
> environment:zookeeper.version=zookeeper C client 3.4.5
>
> 2016-05-23 03:38:21,535:7(0x7f4e9b3ac700):ZOO_INFO@log_env@716: Client
> environment:host.name=qa101-139
>
> 2016-05-23 03:38:21,535:7(0x7f4e9b3ac700):ZOO_INFO@log_env@723: Client
> environment:os.name=Linux
>
> 2016-05-23 03:38:21,535:7(0x7f4e9b3ac700):ZOO_INFO@log_env@724: Client
> environment:os.arch=3.13.0-57-generic
>
> 2016-05-23 03:38:21,535:7(0x7f4e9b3ac700):ZOO_INFO@log_env@725: Client
> environment:os.version=#95-Ubuntu SMP Fri Jun 19 09:28:15 UTC 2015
>
> I0523 03:38:21.53564624 sched.cpp:222] Version: 0.28.1
>
> 2016-05-23 03:38:21,535 INFO  [main] scheduler.MyriadDriver
> (MyriadDriver.java:start(51)) - Driver started with status: DRIVER_RUNNING
>
> 2016-05-23 03:38:21,536 INFO  [main] scheduler.MyriadDriverManager
> (MyriadDriverManager.java:startDriver(53)) - Driver started with status:
> DRIVER_RUNNING
>
> 2016-05-23 03:38:21,536 INFO  [main] myriad.Main
> (Main.java:startMesosDriver(121)) - started mesosDriver..
>
> 2016-05-23 03:38:21,536:7(0x7f4e8d685700):ZOO_INFO@check_events@1703:
> initiated connection to server [10.10.101.139:5181]
>
> 2016-05-23 03:38:21,536 INFO  [main] interceptor.CompositeInterceptor
> (CompositeInterceptor.java:register(74)) - Registered
> org.apache.myriad.policy.LeastAMNodesFirstPolicy into the registry.
>
> 2016-05-23 03:38:21,539 INFO  [main] myriad.Main
> (Main.java:startNMInstances(226)) - Launching 1 NM(s) with profile medium
>
> 2016-05-23 03:38:21,540 INFO  [main] scheduler.MyriadOperations
> (MyriadOperations.java:flexUpCluster(80)) - Adding 1 NM instances to cluster
>
> 2016-05-23 03:38:21,555:7(0x7f4e8d685700):ZOO_INFO@check_events@1750:
> session establishment complete on server [10.10.101.139:5181],
> sessionId=0x15314ddb816d02b, negotiated timeout=1
>
> I0523 03:38:21.55587197 group.cpp:349] Group process (group(1)@
> 10.10.101.139:57196) connected to ZooKeeper
>
> I0523 03:38:21.55594597 group.cpp:831] Syncing group operations: queue
> size (joins, cancels, datas) = (0, 0, 0)
>
> I0523 03:38:21.55597997 group.cpp:427] Trying to create path '/mesos'
> in ZooKeeper
>
> I0523 03:38:21.55707398 detector.cpp:152] Detected a new leader:
> (id='1')
>
> I0523 03:38:21.55723575 group.cpp:700] Trying to get
> '/mesos/json.info_01' in ZooKeeper
>
> I0523 03:38:21.55800297 detector.cpp:479] A new leading master (UPID=
> master@10.10.101.139:5050) is detected
>
> I0523 03:38:21.55811676 sched.cpp:326] New master detected at
> master@10.10.101.139:5050
>
> I0523 03:38:21.55844276 sched.cpp:336] No credentials

Re: [Vote] Release apache-myriad-0.2.0-incubating (release candidate 2)

2016-05-23 Thread Sarjeet Singh 
+1 (Non-binding)

Verified md5 and sha512 checksums.
D/L myriad-0.2.0-incubating-rc2.tar.gz, Compiled & deployed it on a 1 node
MapR cluster.
Tried FGS/CGS flex up/down, and ran long/short running M/R jobs.
Tried framework shutdown from UI/API, and tried re-launching myriad again.
Tried Cgroups and able to launch NMs w/ cgroups enabled successfully.

-Sarjeet

On Thu, May 19, 2016 at 8:21 PM, Darin Johnson 
wrote:

> I'm voting +1.
> Build, ran multiple map/reduce jobs, a few spark and flink jobs.
>
> Darin
>
> On Tue, May 17, 2016 at 9:24 PM, Darin Johnson 
> wrote:
>
> > Hi All,
> >
> > I have created a source tar ball for Apache Myriad 0.2.0-incubating,
> > release candidate 2 based off the feed back received from release
> > candidate 1.  Specifically, the NOTICE file has been updated to 2016 and
> > the framework properly shuts down when using the web ui.
> >
> > Here’s the release notes:
> > https://cwiki.apache.org/confluence/display/MYRIAD/Release+Notes
> >
> > The commit to be voted upon is tagged with "myriad-0.2.0-incubating-rc2"
> > and is available here:
> >
> >
> https://git-wip-us.apache.org/repos/asf?p=incubator-myriad.git;a=shortlog;h=refs/tags/myriad-0.2.0-incubating-rc2
> >
> > The artifacts to be voted upon are located below. Please note that this
> is
> > a source release:
> >
> >
> https://dist.apache.org/repos/dist/dev/incubator/myriad/myriad-0.2.0-incubating-rc2/
> >
> > Release artifacts are signed with the following key:
> > *https://home.apache.org/~darinj/gpg/2AAE9E3F.asc
> > *
> >
> > **Please note that the release tar ball does not include the gradlew
> script
> > to build. You need to install gradle in order to build.**
> >
> > Please try out the release candidate and vote. The vote is open for a
> > minimum of 3 business days (Friday May 20) or until the necessary number
> > of votes (3 binding +1s)
> > is reached.
> >
> > If/when this vote succeeds, I will call for a vote with IPMC seeking
> > permission to release RC1 as Apache Myriad 0.2.0 (incubating).
> >
> > [ ] +1 Release this package as Apache Myriad 0.2.0-incubating
> > [ ]  0 I don't feel strongly about it, but I'm okay with the release
> > [ ] -1 Do not release this package because...
> >
> > Thanks,
> > Darin
> >
>