Re: Some thoughts after a crash course installation

Take a look at https://github.com/mesos/myriad/pull/83. I think this addresses your question, if so its being worked on. On Apr 21, 2015 7:35 AM, Zhongyue Luo zhongyue@gmail.com wrote: Hi team, I finally got Myriad installed in our small Mesos cluster but I have some questions regarding

Re: skip chown in mesos patched

That will eventually simplify the getCommandInfo in TaskFactory.java code I submitted. That's essentially what I had to do to keep the permissions correct, definitely belongs in mesos proper. On Wed, Apr 8, 2015 at 5:32 PM, Adam Bordelon a...@mesosphere.io wrote: Saw that. Thanks! Added the

Re: Odd Errors

Could you paste the stderr/stdout of the executor as well? I think this may be a bug so you won't get booted:). Darin On Aug 18, 2015 3:07 PM, John Omernik j...@omernik.com wrote: I am working to stumble through this as Santosh helped me get a pre incubator version of Myriad running, and now

Re: Complete Myriad HA implementation

Sweet, look forward to checking it out. Hi All, I have updated my pull request with the complete Myriad HA implementation rebased on top of the FGS changes here https://github.com/mesos/myriad/pull/123 I am planning to send out another email with details on how to configure it. Regards Swapnil

Re: Myriad 0.1 release scope

John, The remote distribution doesn't require the nm to be run from marathon though it's possible. Essentially, it's the same configuration for the rm you'd do for the non remote version + adding a uri for the tarball. I've got jsons for running the rm in marathon, I'll try to get them and some

Re: Issues 16 and Issue 12

not address task reconciliation yet). I was planning to work on it next. Regards Swapnil On Mon, Aug 3, 2015 at 12:08 PM, Darin Johnson dbjohnson1...@gmail.com wrote: Is anyone actively working these? I'm interested in both of these and should have some cycles to work on them. One question

Re: Myriad 0.1 release scope

. Thanks, Santosh On Fri, Aug 7, 2015 at 12:12 PM, Darin Johnson dbjohnson1...@gmail.com wrote: It will make working on HA easier. However, one concern that's been addressed previously is that FGS works for Hadoop 2.6.0+. Do we plan to support 2.5.X (anything lower?) also

Re: Myriad 0.1 release scope

It will make working on HA easier. However, one concern that's been addressed previously is that FGS works for Hadoop 2.6.0+. Do we plan to support 2.5.X (anything lower?) also as Santosh has a way to do that, if so how do we facilitate that? Profiles? Darin On Fri, Aug 7, 2015 at 1:46 PM,

Re: JIRA work for 0.1.0

andomization, but it > is much lower chance then consistently getting the same port w/o > randomization. > Thanks,Yuliya From: Darin Johnson <dbjohnson1...@gmail.com> > To: Dev <dev@myriad.incubator.apache.org>; yuliya Feldman < > yufeld...@yahoo.com> > Sent:

Re: JIRA work for 0.1.0

gt; Great list. > I would include MYRIAD-160 to the list - I am working on that one. Of > course as a workaround we could not use Mesos ports and let NM ports > randomization kick in.I also almost done with MYRIAD-148 - it was really > tricky. Should submit PR tonight. > Thanks,Yu

Re: JIRA work for 0.1.0

I think this sounds good about right. A few Jim marked were new features, gotta leave something for the 0.2.0 release :). On Thu, Oct 22, 2015 at 8:08 AM, Santosh Marella wrote: > I looked at the JIRAs currently marked with fix version "myriad-0.1.0". > There were 19 of

Re: [VOTE] Release apache-myriad-0.1.0-incubating (release candidate 1)

rn-* scripts and > releasing. We can then decide to revamp or permanently remove the Vagrant > setup for a separate release. > > > > On Tue, Nov 10, 2015 at 10:42 PM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: > > > +1 > > D/L'd tar ball verified checksums &

Re: [VOTE] Release apache-myriad-0.1.0-incubating (release candidate 2)

gt; to get the IPMC to vote on it. > > Great work, team! > > On Sun, Nov 15, 2015 at 4:13 PM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: > > > +1 > > On Nov 15, 2015 6:33 PM, "yuliya Feldman" <yufeld...@yahoo.com.invalid> > > wrote: > > &g

Re: [VOTE] Release apache-myriad-0.1.0-incubating (release candidate 2)

+1 On Nov 15, 2015 6:33 PM, "yuliya Feldman" wrote: > Thank you Jim > You are not late - it is still 3:30 PM PDT :) > Committers - we need at least one more vote from you for RC2 - you have > 1.5 hours left. > Thanks,Yuliya > From: Jim Klucar

Re: New Committer: Swapnil Daingade

Congrats Swapnil! On Thu, Nov 5, 2015 at 11:16 AM, Sarjeet Singh wrote: > Congrats Swapnil, Very nice work on HA :) > > On Thu, Nov 5, 2015 at 8:13 AM, Santosh Marella > wrote: > > > Congratulations Swapnil. > > > > -- > >

Re: Struggling with Permissions

Yuliya: Are you referencing yarn.nodemanager.hostname or a mapr specific option? I'm working right now on passing a -Dyarn.nodemanager.hostname=offer.getHostName(). Useful if you've got extra ip's for a san or management network. John: Yeah the permissions on the tarball are a pain to get

Re: Google Hangout Link

Ken, Was going through the dcos guide, are there any service discovery options in dcos for finding webservice ports haproxy, nginx? Thanks, Darin PS sorry bought missing the sync I'm on vacation in the Midwest. On Aug 26, 2015 12:05 PM, Ken Sipe k...@mesosphere.io wrote: I sent an invite… and

Re: Flex API

One additional thing I'd like is the ability to flexup a nmnode on all agents with a certain attribute as opposed to a fixed number. Also, when I get back from vacation I plan on scoping mesos-1739 (dynamic attributes) which would allow for tighter integration with the hdfs framework. An

Re: Complete Myriad HA implementation

and Myriad HA makes it to phase1, I'll move it to a more permanent place like perhaps the wiki. Regards Swapnil On Thu, Aug 20, 2015 at 11:39 AM, Darin Johnson dbjohnson1...@gmail.com wrote: Sweet, look forward to checking it out. Hi All, I have updated my pull request

Re: Complete Myriad HA implementation

/myriad/pull/123 I am wondering, if there are no further review comments by Friday, can we considering merging this pull request ? Regards Swapnil On Mon, Aug 24, 2015 at 7:58 PM, Darin Johnson <dbjohnson1...@gmail.com> wrote: > Swapnil, > > Generally no, they don't which makes it con

Re: Complete Myriad HA implementation

//github.com/mesos/myriad/pull/123 > > Regards > Swapnil > > > On Fri, Sep 4, 2015 at 9:55 AM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: > > > I've got some more comments but can really respond adequately until > > tomorrow due to travel. I'll defer if

Re: Question about the Wiki Instructions on yarn-site.xml

Hey John I'm going to try to recreate issue using vanilla hadoop later today. Any other settings I should know about? Darin On Sep 9, 2015 9:42 AM, "John Omernik" wrote: > This was another "slipped in" question in my other thread, I am breaking > out for specific instructions.

Re: Myriad Open Source Doc Review

Ruth, Looked briefly at this there are significant changes that need to be made to this document since Swapnil's last PR. I'll see what I can do about updating these, I'm rebuilding my dev environment at the moment so this is a convenient time. I am traveling early in the week though so it

Re: Yarn-Site

sudo rm $YARN_HOME/etc/hadoop/yarn-site.xml <- This is slightly off, I'll go correct. On Mon, Oct 5, 2015 at 4:38 PM, Darin Johnson <dbjohnson1...@gmail.com> wrote: > John, I'm running off: https://github.com/apache/incubator-myriad, it > seems to run OK there's a couple of NP

Re: [PROPOSAL(s)] Use Release Branches, and Delete Obsolete Branches

My experience with alt 1 is it takes a lot of discipline or it devolves into develop just being master. I'd be curious how others have found it. On Dec 3, 2015 10:07 PM, "Darin Johnson" <dbjohnson1...@gmail.com> wrote: > +1 A, +1 B. > On Dec 3, 2015 7:12 PM, &quo

Re: [PROPOSAL(s)] Use Release Branches, and Delete Obsolete Branches

+1 A, +1 B. On Dec 3, 2015 7:12 PM, "Sarjeet Singh" wrote: > +1 for Proposal A -> Alt 1, and +1 for Proposal B. > > Should we also maintain 'develop' & 'master' branch as described on > nvie.com, > it was easy to read through the branching model, and understand the >

Re: Merges to Myriad master branch

I like Adam's idea for RCs, but I also really like the idea of a 0.1.0 branch for bug fixes. That way we can cut a 0.1.1 maintenance release much easier than trying to cut off master. Seems like a lot of apache projects handle it that way. Darin Otherwise there will likely be some really ugly

Re: Myriad is 0.1.0

Sweet, thanks for all the work on the release guys! On Thu, Dec 10, 2015 at 1:31 PM, mohit soni wrote: > WooHoo! Perfect holiday gift. Thanks everyone. > > On Thu, Dec 10, 2015 at 10:19 AM, Aashreya Shankar > wrote: > > > This is great ! > > Good

Re: Next dev sync hangout will be on 1/6/2016

Trying to join On Jan 6, 2016 12:06 PM, "yuliya Feldman" wrote: > Do we have a sync today? > > > From: Santosh Marella > To: dev@myriad.incubator.apache.org > Sent: Wednesday, December 16, 2015 9:47 AM > Subject: Next dev sync hangout

Re: Struggling with Permissions

cause I am stumped at how these are > > getting set. > > > > > > > > > > > yarn.resourcemanager.addresshadoopmapr2:8032programatically > > mapr.hosthadoopmapr2.brewingintel.com > > > > > > > yarn.resourcemanager.resource-tracker

Re: [VOTE] Release apache-myriad-0.1.0-incubating (release candidate 3)

+1 D/L'd built and ran and 4 node vanilla hadoop cluster (remote distro). verified md5 and sha hashes Ran M/R Job on CGS/FGS Flexup and down nodes. killed RM with HA enabled verified nodes up noticed if JHS is up in HA mode and the RM is restarted a new JHS is launched resulting in two JHS

Re: [VOTE] Release apache-myriad-0.1.0-incubating (release candidate 3)

Any guidance on why we can't include the gradlew script? I took a look at Apache Kafka and Apache Tapestry, their artifacts both include gradlew, just not the jar. Meanwhile I'll check the release ... Darin On Mon, Nov 23, 2015 at 4:55 PM, yuliya Feldman wrote:

Re: Next dev sync hangout will be on 1/6/2016

; > On Wed, Jan 6, 2016 at 11:22 AM, Paul Curtis <pcur...@maprtech.com> wrote: > > > I attempted to join as well it seems that no one was in the > > hangout. I gave up after about 15 minutes. > > > > paul > > > > On Wed, Jan 6, 2016 at 12:19 PM,

Re: Next dev sync hangout will be on 1/6/2016

> > > Can we confirm this for tomorrow if this is happening? > > > > -Sarjeet > > > > On Fri, Jan 8, 2016 at 6:53 PM, Darin Johnson <dbjohnson1...@gmail.com> > > wrote: > > > > > Sounds good to me. I think we might have another possible east coast

Re: problem getting fine grained scaling workig

That is correct you need at least one node manager with the minimum requirements to launch an ApplicationMaster. Otherwise YARN will throw an exception. On Fri, Jun 3, 2016 at 10:52 AM, yuliya Feldman wrote: > I believe you need at least one NM that is not subject

Re: problem getting fine grained scaling working

That is normal behavior, Myriad keeps the resources to flexup a node manager incase a job comes in of a few seconds and then releases them. The info statement is arguably chatty and will probably go to debug in a few more releases. On Fri, Jun 3, 2016 at 9:18 AM, Stephen Gran

Re: problem getting fine grained scaling workig

nks very much for looking. > > Cheers, > > On 05/06/16 12:51, Darin Johnson wrote: > > Hey Steven can you please send your yarn-site.xml, I'm guessing you're on > > the right track. > > > > Darin > > Hi, > > > > OK. That helps, thank you. I thin

Re: problem getting fine grained scaling workig

ake any difference, sadly. > > This is hadoop 2.7.2 > > Cheers, > > On 05/06/16 14:45, Darin Johnson wrote: > > Hey Stephen, > > > > I think you're pretty close. > > > > Looking at the config I'd suggest removing these properties: > > >

Re: problem getting fine grained scaling workig

isplay/MYRIAD/Fine-grained+Scaling > > This gives the strong impression that you don't need an NM with non-zero > resources. I think this is what initially steered me down the wrong path. > > Cheers, > > On 03/06/16 16:38, Darin Johnson wrote: > > That is correct you ne

Re: problem getting fine grained scaling workig

you very much, > > On 05/06/16 18:09, Darin Johnson wrote: > > Stephen, > > > > I was able to recreate the problem (specific due to 2.7.2, they changed > the > > defaults on the following two properties to true). Setting them to false > > allowed me to agai

Re: [Vote] Release apache-myriad-0.2.0-incubating (release candidate 4)

The vote for 0.2.0 RC4 has concluded and passed. Thanks to everyone who verified the release and voted! Binding +1's Darin Johnson Santosh Marella Mohit Soni Non-Binding +1's John Yost Sarjeet Signh Brandon Gulla I'll submit the release to the IPMC to vote. Darin On Thu, Jun 9, 2016 at 8:49

Re: Myriad hangout tomorrow?

I'm planning on calling in. Darin On Tue, Jun 14, 2016 at 4:25 PM, Swapnil Daingade < swapnil.daing...@gmail.com> wrote: > Hi All, > > Was wondering if we have a Myriad hangout tomorrow. > > Regards > Swapnil >

Re: [Vote] Release apache-myriad-0.2.0-incubating (release candidate 4)

> - Builds from source tar ball. > > - Ran Apache RAT. Verified that all the sources have license headers. > > - Verified CGS/FGS behaviors with MapReduce jobs on a 4 node Mesos/Yarn > > cluster. > > > > Thanks, > > Santosh > > > > On Tue, May 24, 2

Re: Podling Report Reminder - June 2016

n Wed, Jun 1, 2016 at 2:50 PM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: > > > Santosh looks good thanks! > > On Jun 1, 2016 5:35 PM, "Santosh Marella" <smare...@maprtech.com> wrote: > > > > > Hi Adam, > > > > >

Re: Myraid Slack

Sam, I don't believe so. But we do have an IRC channel #myriad on FreeNode. I know the mesosphere guys set up slackbots to interact with it. I'm only there occasionally or by appointment. I did notice Kudu now uses slack, so maybe slack makes more sense than IRC these days, or Gitter Chat.

[RESULT] [VOTE] Release Apache Myriad 0.2.0 (incubating)

The vote passed with 3 +1 binding votes from IPMC members and no -1s. +1 binding votes: Justin Mclean Drew Farris John Ament We will proceed with the post release activities: - Make the release artifacts available from [1] and [2] - github tag with "myriad-0.2.0-incubating" - Close the

Re: Myriad Vagrant Setup Issue

Hey Matt, if you look at the mesos ui is there any information in the stderr or stdout of the Slave Host it's staging on? Darin On Fri, Jan 15, 2016 at 10:36 AM, Matthew J. Loppatto < mloppa...@keywcorp.com> wrote: > I've gotten a little farther on this issue by increasing the mesos slave >

Re: Myriad Vagrant Setup Issue

ntents of my mesos slave logs in /var/log/mesos to this public Gist: > https://gist.github.com/FearTheParrot/b00aa7eee9ae169498d3 > > Matt > > -----Original Message- > From: Darin Johnson [mailto:dbjohnson1...@gmail.com] > Sent: Friday, January 15, 2016 10:55 AM > To: Dev

0.2.0 release

We've talked about a 0.2.0 release slated for mid April at the dev sync. I'd like to nail down any features people would like and have time to work on. I've been spend some time fixing major bugs to the FGS feature and plan to address MYRIAD-136 and MYRIAD-189. I'd also be willing to be the

Re: NM does not start with cgroups enabled

Hey Bjorn, Can you copy paste the relevant part of the Myriad and yarn-site.xml? Also, can you ensure you are running the mesos-slave with --isolation="cpu/cgroups,memory/cgroups?. I'll try to recreate the problem and/or tell you what's missing in the config. Darin On Mon, Mar 14, 2016 at 6:19

Re: 0.2.0 release

, "Adam Bordelon" <a...@mesosphere.io> wrote: > +1 on Darin as release manager > > I'd like to see 0.2 have: > - Usable FGS > - Dockerized NM (for multitenancy) > > On Tue, Mar 15, 2016 at 9:46 AM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: &

Re: NM does not start with cgroups enabled

what does your container-executor.cfg look like? Seems like yarn.nodemanager.linux-container-executor.group isn't set, or possibly bannerusers= hasn't been set (some distro's). On Tue, Mar 15, 2016 at 12:52 PM, Darin Johnson <dbjohnson1...@gmail.com> wrote: > Bjorn, > > Y

Myriad 0.1.1 Release

Hi, I'm the release manager for Myriad 0.1.1, which we're hoping to get out in the next couple weeks. Here's the list of PR's and JIRA's that I think should go into the release since 0.1.0: Complete: #56 MYRIAD-181 Build failure due to dependency on zookeeper test jar

Re: Myriad 0.1.1 Release

o I vote against its inclusion. MYRIAD-191 could be worth including, depending on the root-cause. On Wed, Apr 6, 2016 at 11:06 AM, Darin Johnson <dbjohnson1...@gmail.com> wrote: > Hi, > > I'm the release manager for Myriad 0.1.1, which we're hoping to get out in > the next cou

Re: NM does not start with cgroups enabled

Hey Bjorn, I think I figured out the issue. Some of the values for cgroups are still hardcoded in myriad. I'll add a JIRA Ticket hopefully we can get an update for 0.2.0. I'll also respond to this thread after a pull request is submitted in case you'd like to test it. Darin Hi all, I have

Re: NM does not start with cgroups enabled

n, > > thanks a lot for this. But what about the other case below, when cgroups > is disabled? > > > Björn > > Am 18.03.2016 um 00:25 schrieb Darin Johnson: > > Hey Bjorn, > > > > I think I figured out the issue. Some of the values for cgroups are > still >

Re: 0.2.0 release

ovide > container ip addresses behind interfaces. User should be able to switch > implementations by making simple changes in configuration files. > > Regards > Swapnil > > > On Tue, Mar 22, 2016 at 8:20 AM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: > > &g

Re: Myriad talk link for MesosCon?

Yeah I didn't see one either. Darin On Wed, Mar 23, 2016 at 1:10 PM, Sarjeet Singh wrote: > I couldn't find any associated link of myriad talk for MesosCon voting. > Anyone? > > Though, I found these proposal doc: > > Developers: http://bit.ly/1RpZPvj > Users:

Re: Challenges after MapR 5.1 Upgrade.

Hey John, I noticed these lines in your yarn-site.xml: yarn.scheduler.minimum-allocation-mb 512 yarn.scheduler.minimum-allocation-vcores 1 If your attempting to launch a zero resource nodemanager for fgs that will result in the first stack

Re: 0.2.0 release

Swapnil, Any help would be appreciated. I'll try to write up what I'm working on tomorrow. But essentially the ideas are: 1. Ability to launch the resource manager and node managers in docker containers 2. Use host networking for now (Ports configured to be pulled from mesos - ability to use

Observations on Fine Grained Scaling

I've been running a number of tests on the Fine Grained scaling aspect on Myriad. Here's a few notes: 1. After the patches it seems stable, I'm able to run multiple terasort/pi jobs and a few scalding jobs without difficulty. 2. Noticed with jobs with short map tasks (8-12 secs), I rarely got

Re: Myriad Releases

elon <a...@mesosphere.io> > wrote: > > > > > +1 to skipping 0.1.1 if 0.2.0 is coming soon enough > > > I don't think we have any production users eagerly awaiting the 0.1.1 > > fixes > > > > > > On Wed, Apr 20, 2016 at 5:52 PM, Darin Johnson <

Re: [Vote] Release apache-myriad-0.2.0-incubating (release candidate 2)

I'm voting +1. Build, ran multiple map/reduce jobs, a few spark and flink jobs. Darin On Tue, May 17, 2016 at 9:24 PM, Darin Johnson <dbjohnson1...@gmail.com> wrote: > Hi All, > > I have created a source tar ball for Apache Myriad 0.2.0-incubating, > release candidate 2 based

[Vote] Release apache-myriad-0.2.0-incubating (release candidate 3)

Hi All, I have created a source tar ball for Apache Myriad 0.2.0-incubating, release candidate 3 based off the feed back received from release candidate 1 & 2. Specifically, this corrected some documentation and a minor typo. Here’s the release notes:

Re: [Vote] Release apache-myriad-0.2.0-incubating (release candidate 3)

nd a minor typo > > Darin, RC3 is missing PR#75 changes. I D/L'ed the tar and manually checked > the changes and wasn't there. > > -Sarjeet > > On Mon, May 23, 2016 at 9:15 PM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: > > > Hi All, > > > > I

[Vote] Release apache-myriad-0.2.0-incubating (release candidate 4)

Hi All, I have created a source tar ball for Apache Myriad 0.2.0-incubating, release candidate 3 based off the feed back received from release candidate 1,2 & 3. Thanks Sarjeet for a very thorough review! Here’s the release notes: https://cwiki.apache.org/confluence/display/MYRIAD/Release+Notes

Spark and Flink

Just wanted to let people know I tried running a Spark and a Flink job today on Myriad with zero sized node managers. It just worked! This shouldn't be interpreted as it's not going to had issues. However, there is some initial progress. Darin

Re: gradle Issue when building RM docker on MacOSX

I've seen that error if I used a terminal that wasn't loaded with docker-machine. I think you can also solve with evaluation (`docker-machine env`) On May 22, 2016 8:37 PM, "sarjeet singh" wrote: Observed following issue when tried to build RM docker image from mac

Re: Need help with cgroup troubleshooting or setup issue with NM launch.

Sarjeet: Can you try adding this to your yarn-site.xml: yarn.nodemanager.linux-container-executor.cgroups.hierarchy ${yarn.nodemanager.linux-container-executor.cgroups.hierachy} this should change the hierarchy to /sys/fs/cgroup/cpu/mesos/XXX-TASK-ID-XXX, which will be rightable. and

Myriad PR's

In preparation for the 0.2.0 release I'm going to start merging PR's I've looked over Mohit's, If anyone want's to look over any of the PR's that'd be great, otherwise I'm going to assume anything that's been up for over 3 business days with no negative comments is considered to be OK unless

[Vote] Release apache-myriad-0.2.0-incubating (release candidate 2)

Hi All, I have created a source tar ball for Apache Myriad 0.2.0-incubating, release candidate 2 based off the feed back received from release candidate 1. Specifically, the NOTICE file has been updated to 2016 and the framework properly shuts down when using the web ui. Here’s the release

[Vote] Release apache-myriad-0.2.0-incubating (release candidate 1)

Hi All, Firstly, thanks everyone for the valuable contributions to the project and for holding on tight as we move along the release process. I have created a source tar ball for Apache Myriad 0.2.0-incubating, release candidate 1. Here’s the release notes:

Myriad Release update

OK, I got the updates merged. I'm going to be updating documentation and testing tomorrow. If all goes well we should have a release tomorrow evening. Darin

Re: cgroups suggestions

he task finishes, the agent should unmount the $TASK_ID. Are you > saying > that's not happening for NMs ? > > Santosh > > On Wed, May 4, 2016 at 10:30 AM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: > > > I've been digging into groups support, there's a fe

cgroups suggestions

I've been digging into groups support, there's a few things that are easy fixes but a few things become problematic so I'd like to discuss. First the code makes certain options dictated that can be placed in the yarn-site.xml - this should be done to remove code and provide flexibility. That's

Re: cgroups suggestions

It turns out everything works if you set permissions appropriately of $CGROUP_ROOT/mesos/$TASKID/ so the yarn user can write to the hierarchy. Then all works exactly as expected. I spent a while running through the container-executor code and when it mounts a cgroup subsystem it changes the

Re: NM does not start with cgroups enabled

On Wed, Mar 23, 2016 at 8:17 AM, Darin Johnson <dbjohnson1...@gmail.com> wrote: > Hey, Bjorn sorry for the delay, looking at the difference between the > exceptions and my own experience I believe you left some cgroup configs in > yarn-site.xml of the node manager. > On Ma

Re: Hello Guys

Hey Sam, I'm already myriad alongside a CM managed hadoop cluster. It's a little hacky right now, I'm working on stream lining this, it may involve CM and/or some docker integration. Here are my current steps: 0. I strongly recommend pulling of master and building from source - it has some

Re: Myriad Releases

be > able to get it out earlier than the 0.2.0 release. Since it looks like they > will be released at the same time essentially, the reason to release 0.1.1 > over just waiting to release 0.2.0 goes away. > > On Wed, Apr 20, 2016 at 5:29 PM, Darin Johnson <dbjohnson1...@gmail

Myriad Releases

During the dev sync today we discussed the upcoming 0.1.1 and 0.2.0 releases. Currently, the only out standing issue for 0.1.1 is MYRIAD-192 (Cgroups), for Myriad 0.2.0 the outstanding issues are Myriad-36 and Myriad 192 (Configuration and Docker/Appc support). Currently I have a WIP PR for

Re: Observations on Fine Grained Scaling

ld ideally see lot more than 2-3 containers per node. > > Isn't that happening? How many map tasks does your job have? > > Thanks, > Santosh > > On Wed, Apr 13, 2016 at 8:34 AM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: > > > I've been running a number of tes

Re: 答复: Hello Guys

ement of CM.. > > > > > > Regards, > > Yongyu > > > Begin forwarded message: > > *From:* Darin Johnson <dbjohnson1...@gmail.com> > *Date:* April 21, 2016 at 8:50:22 PM GMT+8 > *To:* Dev <dev@myriad.incubator.apache.org> > *Subject:* *Re: Hel

Sync tomorrow?

Is there going to be a sync tomorrow? Darin

Re: vagrant install doesn't show new framework registering

Hey David, Thanks for the info. I haven't used the vagrant install for a while, so it may be good for me to start a fresh instance to check it. In the meantime though any notes you have would be great! We'd be happy to update the documentation. On Jul 26, 2016 6:24 PM, "Reno, David"

Sync today?

Couldn't connect

Re: Sync tomorrow?

Ended up in another meeting taking longer than I thought. Sorry. On Tue, Jul 26, 2016 at 2:27 PM, Adam Bordelon <a...@mesosphere.io> wrote: > Yes, I'll be there. Sorry for not making it last time. > > On Tue, Jul 26, 2016 at 11:20 AM, Darin Johnson <dbjohnson1...@

Sync tomorrow?

Trying to plan my day tomorrow.

Re: NPE in removing container

ll. Anything I can do to help. > > I've attached the log file for the relevant time period. This is hadoop > 2.7.2 - you have a good memory :) > > Cheers, > > On 30/06/16 22:56, Darin Johnson wrote: > > Hey Steven, > > > > Looks like this might be sligh

Re: Myraid Slack

ernetworks.com> >>>> wrote: >>>> >>>> Hi Darin, >>>> Thanks for you reply. Makes sense to use Slack. Btw, we are going to use >>>> Myriad in production, any company have capability to support this ? And >>>> is >>>> there

Myriad is 0.2.0!

I've used the release script to publish the source tarball which is available here: https://www.apache.org/dist/incubator/myriad/myriad-0.2.0-incubating/ In addition, I've written a short release note and updated the downloads page, in the following PR:

Re: NPE in removing container

Steven, thanks. I thought I had fixed that but perhaps a regression was made in another merge. I'll look into it, can you answer a few questions? Was the node (slave2) a zero sided nodemanager (for fgs)? In the node manager logs had it recently become unhealthy? I'm pretty concerned about this

Re: Myraid Slack

Having issues getting on, is anybody else able to connect? On Jun 28, 2016 10:34 PM, "Adam Bordelon" <a...@mesosphere.io> wrote: > (Next dev sync is tomorrow, 9am Pacific time) > > On Tue, Jun 28, 2016 at 12:32 PM, Darin Johnson <dbjohnson1...@gmail.com> > wr

Re: Myraid Slack

Maybe you can post the link? Maybe mine is old. On Jun 29, 2016 12:05 PM, "Ken Sipe" <k...@mesosphere.io> wrote: > I am on > > On Jun 29, 2016, at 11:04 AM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: > > > > Having issues getting on, is anybod

Re: Myraid Slack

iya Feldman <yufeld...@yahoo.com.INVALID> > wrote: > > > > no luck joining so far > > > > From: Ken Sipe <k...@mesosphere.io> > > To: dev@myriad.incubator.apache.org > > Sent: Wednesday, June 29, 2016 9:04 AM > > Subject: Re: Myrai

Re: Myraid Slack

Still no luck On Wed, Jun 29, 2016 at 12:17 PM, Ken Sipe <k...@mesosphere.io> wrote: > Darin try one more time… I think we had a miss configuration > > On Jun 29, 2016, at 11:15 AM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: > > > > Still no luck off wif

Website is updated, 0.2.0 is official!

http://myriad.apache.org/ Tell your friends!

Re: Resource manager error

Hey Mathew, my coworker found the same issue recently, I fixed it on my last pull request, if you'd like to pull from master. Alternatively, you could comment out the appendCgroups line in myriad-scheduler /src

Re: Resource manager error

ole got rid of the log message about > > > the missing role, but I'm still seeing the "n must be positive" > > exception. > > > > > > The only other thing of interest I see in the log is WARN fair. > > AllocationFileLoaderService: > > >

Re: Do we have sync up today, or I am too late?

Adam and I showed up. I'm willing to hop back on a chat if you want. On Wed, Aug 24, 2016 at 12:21 PM, yuliya Feldman < yufeld...@yahoo.com.invalid> wrote: > >

Re: [DISCUSS] handling roles in Myriad code

y morning and I did not get the same impression > > > > Thanks, > > Yuliya > > > > > On Oct 19, 2016, at 8:50 PM, Darin Johnson <dbjohnson1...@gmail.com> > > wrote: > > > > > > We use roles extensively to ensure different frameworks can (

  1   2   >