Re: [RESULT] [DISCUSS] Leave Apache and the Incubator

Need to inform the incubator list as well. Cheers, Darin On Mon, Jan 20, 2020, 1:51 AM Javi Roman wrote: > The community has voted retired Myriad project from Apache Incubator: > > +1 6 votes > -1 0 votes. > > We will start the retirement process accordingly with IPMC guidelines. > -- > Javi

Re: [DISCUSS] Leave Apache and the Incubator

+1 On Fri, Jan 3, 2020 at 11:14 AM John Yost wrote: > +1 > > > On Jan 2, 2020, at 11:51 PM, Javi Roman > wrote: > > > > Please vote to retire Myriad from the ASF Incubator. My take is that > > Myriad has failed to get adequate community traction in the ASF > > Incubator and the administrative

Re: Myriad 0.3.0 Release Planning

I think the big issue here is going to be getting committers to vote on the release. Suggest giving them plenty of time. On Sun, Nov 18, 2018, 7:09 AM Javi Roman I would like to offer myself as release manager for Myriad 0.3.0. > I guess, we have to try release a new version of Apache Myriad,

Re: Myriad running at Mesos 1.5.x

Cool thanks for working this. On Mon, Nov 19, 2018, 4:16 AM JP Gilaberte Hi Javi, I'm happy too. Thank you very much for the effort to all. I think > it's a very important first step.This helps us to align with Mesosphere, it > gives us greater visibility and allows the probability that the

Re: Podling Report Reminder - March 2018

avi Roman > > > > Twitter: @javiromanrh > > GitHub: github.com/javiroman > > Linkedin: es.linkedin.com/in/javiroman > > Big Data Blog: dataintensive.info > > > > > > On Mon, Mar 5, 2018 at 4:05 PM, Darin Johnson <dbjohnson1...@gmail.com> > > wrote:

Re: Podling Report Reminder - March 2018

Javi please email gene...@incubator.apache.org And ask for write access to the wireless. You can then edit the wiki. Thanks, Darin On Sun, Mar 4, 2018 at 7:15 AM, Javi Roman wrote: > Project Name: > Myriad > > Project Description: > Myriad enables co-existence of

Re: [DISCUSS] Retire Myriad?

+1 On Mon, Jan 29, 2018 at 11:10 PM, John D. Ament wrote: > Hi All, > > It seems that Myriad has more or less stopped activity. Recent user > question has lead to a recommendation to avoid using Myriad in production > [1], git commits seem to have stopped a long time ago

Re: Please do not retire Myriad

If people are interested in working on it, it's possible to fork the project and continue. If anyone wants to fork and continue I'd be happy to work with them (I'll even create the fork). However, the community is so small and distracted it's not ideal to continue developing within Apache. I

Re: Regarding Big Data Mesos Frameworks and Myriad

Javi, I can't speak for Kafka definitively (Does Kafka have a YARN runner nowdays? I use the Mesos one), however I did run Map/Reduce, Spark and Flink via YARN Using Myriad. Darin On Wed, Jan 31, 2018 at 1:51 PM, Swapnil Daingade < swapnil.daing...@gmail.com> wrote: > yes, you don't need a new

Re: Myriad status?

Nicolas, we're currently in a bit of a lull. I'd strongly discourage you from using Myriad in a production environment. More than happy to field questions getting it up and running though. Darin On Mon, Dec 11, 2017 at 3:04 PM, Nicolas Tilmans wrote: > Hi! > > We were

Re: Myriad Sync 11/29

/calendar/ > > > bW9oaXRzb25pMTk4OUBnbWFpbC5jb20.ajan3qfvb8c48egfc8rpc92b10 > > > > > > On Tue, Nov 28, 2017 at 8:51 AM, Darin Johnson < > dbjohnson1...@gmail.com> > > > wrote: > > > > > > > Can you put a link to the Hangouts in the threa

Re: Myriad Sync 11/29

Can you put a link to the Hangouts in the thread? On Nov 28, 2017 8:47 AM, "mohit soni" wrote: > Hi All, > > I'm planning to attend the Myriad sync tomorrow. Please join if you would > like to discuss the upcoming changes to the project. > > Best > Mohit >

Re: Myriad Sync - 11/15/17

+1 for advanced notice. On Nov 15, 2017 1:30 PM, "yuliya Feldman" wrote: > Could it be a bit more advance notice? Or I missed that notice? > On Wednesday, November 15, 2017, 10:03:37 AM PST, mohit soni < > mohitsoni1...@gmail.com> wrote: > > Hi > > Please

Re: [jira] [Commented] (MYRIAD-256) Cannot launch with vagrant

Appears to be a Java version error. Will need to upgrade that I guess. On Nov 7, 2017 3:19 AM, "Kwang-in (Dennis) JUNG (JIRA)" wrote: > > [ https://issues.apache.org/jira/browse/MYRIAD-256?page= > com.atlassian.jira.plugin.system.issuetabpanels:comment- >

Re: [DISCUSS] Retire Myriad

I certainly think the project is relevant but I'm concerned if it belongs in Apache. When I was active it was difficult to get people to review pull requests and when releasing v0.2.0 it was hard to even get people to vote for a release. If only a few people are going to work on it, maybe it's

Re: Report

I'll second that sentiment. On Tue, Oct 10, 2017 at 11:45 AM, yuliya Feldman < yufeld...@yahoo.com.invalid> wrote: > Feels like project is dead, Wonder if anybody at MapR and/or Mesosphere > interested in continuing the project? > On Tuesday, October 10, 2017, 4:42:56 AM PDT, Ted Dunning <

Re: Podling Report Reminder - September 2017

+1 retire On Sun, Sep 10, 2017 at 8:41 PM, John D. Ament wrote: > All, > > A discussion back in July indicated the project had enough people to stay > alive. There has been no report submitted and no on list activity since > then. > > Should we plan to retire Myriad

Re: Podling Report Reminder - July 2017

Swapnil, generally a request on incubator does it. On Jul 7, 2017 5:23 AM, "Swapnil Daingade" wrote: > I created an account on the wiki but was not able to edit the page. > Do I need permissions to edit it? I'll try to figure it out but any > pointers would > be

Re: [Vote] Retire Myriad

for more discussion. > > Unfortunately my situation too is no different, at least for the next 3-4 > months. > > I am happy to vote -1 to buy us more time or we can cancel the vote. > > Regards > Swapnil > > > On Thu, Jun 22, 2017 at 9:41 AM, Darin Johnson <dbjohnson1...@g

Re: [Vote] Retire Myriad

lt;yufeld...@yahoo.com.INVALID> > > > wrote: > > > > > > > > Sorry for chiming in late. I was out of town. > > > > I think we should keep the project going if there is an activity on > the > > > project. > >

Re: [Vote] Retire Myriad

gt; > > wrote: > > > > > > > +1 (if the vote is open to non-comitters) > > > > > > > > > > > > > > > > On Tue, Jun 20, 2017 at 9:22 AM, Darin Johnson <dar...@apache.org> > > >

[Vote] Retire Myriad

Based on previous discussions it seems the best course of action. I'm holding the vote open for 3 business days. I'm +1 binding. Darin

Re: Is Apache Myriad dead?

Can you name the 3-5 active PMC members who will vet the next release? I'm willing to vet next release and contribute additional work we did to Myriad but only if I get a solid commitment from others. Otherwise I'm happy to retire and let mapr host their fork. On Jun 6, 2017 2:29 AM, "Ted

Re: Is Apache Myriad dead?

Swapnil, the reasons Ted mentioned are precisely the reasons I've stopped committing to Myriad (we're running a fork). Apache is more overhead than this project needs and actually hinders the project from developing to a maturity level where a community can form. Darin On Jun 5, 2017 5:53 PM,

Re: Podling Report Reminder - June 2017

I'm willing to write this, but I think it'll be with the recommendation to retire. Does anyone else wish to volunteer? On Jun 1, 2017 7:43 AM, wrote: > Dear podling, > > This email was sent by an automated system on behalf of the Apache > Incubator PMC. It is an initial

Re: Is Apache Myriad dead?

n a coma, and I'm not sure if/when it'll wake up > again. > I'm not opposed to retiring, except that moving off of Apache infra sounds > like work. > > On Fri, Apr 28, 2017 at 5:46 AM, Klaus Ma <k8...@icloud.com> wrote: > > > +1 on retire > > > > > On 2

Sync today?

Tried joining.

Re: will miss standup today - doc appt.

the dcos universe package for Myriad nearly > complete. > https://github.com/mesosphere/universe/pull/841 > Just need to write up an example usage doc to go with it. > Let's do any updates over email this week. > > On Wed, Jan 11, 2017 at 8:34 AM, Darin Johnson <dbjohnson1...@

Unable to join dev sync

Eom

Hangout today

Missed due to another meeting going long. Anyone else attend?

Re: [DISCUSS] handling roles in Myriad code

py the resources from the offer and reduce the cpu/mem > values or select ports from the range if necessary. > > On Wed, Nov 2, 2016 at 4:44 AM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: > > > Adam to clarify with an example. An offer may have an offer with reserved >

Re: [DISCUSS] handling roles in Myriad code

e you have questions about > any of it. > Cheers, > -Adam- > > > On Fri, Oct 28, 2016 at 4:10 PM, yuliya Feldman > <yufeld...@yahoo.com.invalid > > wrote: > > > We clearly need a word from Adam, Mohit, Ken > > My impression is that Myriad will not get any r

Re: [DISCUSS] handling roles in Myriad code

y morning and I did not get the same impression > > > > Thanks, > > Yuliya > > > > > On Oct 19, 2016, at 8:50 PM, Darin Johnson <dbjohnson1...@gmail.com> > > wrote: > > > > > > We use roles extensively to ensure different frameworks can (

Re: [DISCUSS] handling roles in Myriad code

not, what if in the > future we will have multiple rolesNot even sure if presence/absence of role > should play role (no pun intended :) ). > > From: Darin Johnson <dbjohnson1...@gmail.com> > To: Dev <dev@myriad.incubator.apache.org>; yuliya Feldman < > yufeld...

Re: [DISCUSS] handling roles in Myriad code

rce/ > > RangeResource.java#L85 > > [2] https://github.com/apache/incubator-myriad/blob/master/ > > myriad-scheduler/src/main/java/org/apache/myriad/scheduler/resource/ > > RangeResource.java#L128 > > > > [3] https://github.com/apache/incubator-myriad/blob/master/ >

Re: [DISCUSS] handling roles in Myriad code

Yuyiya, Yes on master a lot of refactoring was done, in particular you specify ports other than 0 in the myriad-default.yaml, it will only return those ports (not random ones). This was done in part because the we were attempting the use the JHS on a port like 32001, but it the port was already

Re: Do we have sync up today, or I am too late?

Adam and I showed up. I'm willing to hop back on a chat if you want. On Wed, Aug 24, 2016 at 12:21 PM, yuliya Feldman < yufeld...@yahoo.com.invalid> wrote: > >

Re: Resource manager error

ole got rid of the log message about > > > the missing role, but I'm still seeing the "n must be positive" > > exception. > > > > > > The only other thing of interest I see in the log is WARN fair. > > AllocationFileLoaderService: > > >

Re: Resource manager error

Hey Mathew, my coworker found the same issue recently, I fixed it on my last pull request, if you'd like to pull from master. Alternatively, you could comment out the appendCgroups line in myriad-scheduler /src

Sync tomorrow?

Trying to plan my day tomorrow.

Re: Sync tomorrow?

Ended up in another meeting taking longer than I thought. Sorry. On Tue, Jul 26, 2016 at 2:27 PM, Adam Bordelon <a...@mesosphere.io> wrote: > Yes, I'll be there. Sorry for not making it last time. > > On Tue, Jul 26, 2016 at 11:20 AM, Darin Johnson <dbjohnson1...@

Re: vagrant install doesn't show new framework registering

Hey David, Thanks for the info. I haven't used the vagrant install for a while, so it may be good for me to start a fresh instance to check it. In the meantime though any notes you have would be great! We'd be happy to update the documentation. On Jul 26, 2016 6:24 PM, "Reno, David"

Sync tomorrow?

Is there going to be a sync tomorrow? Darin

Sync today?

Couldn't connect

Re: NPE in removing container

ll. Anything I can do to help. > > I've attached the log file for the relevant time period. This is hadoop > 2.7.2 - you have a good memory :) > > Cheers, > > On 30/06/16 22:56, Darin Johnson wrote: > > Hey Steven, > > > > Looks like this might be sligh

Re: NPE in removing container

Steven, thanks. I thought I had fixed that but perhaps a regression was made in another merge. I'll look into it, can you answer a few questions? Was the node (slave2) a zero sided nodemanager (for fgs)? In the node manager logs had it recently become unhealthy? I'm pretty concerned about this

Website is updated, 0.2.0 is official!

http://myriad.apache.org/ Tell your friends!

Re: Myraid Slack

Still no luck On Wed, Jun 29, 2016 at 12:17 PM, Ken Sipe <k...@mesosphere.io> wrote: > Darin try one more time… I think we had a miss configuration > > On Jun 29, 2016, at 11:15 AM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: > > > > Still no luck off wif

Re: Myraid Slack

iya Feldman <yufeld...@yahoo.com.INVALID> > wrote: > > > > no luck joining so far > > > > From: Ken Sipe <k...@mesosphere.io> > > To: dev@myriad.incubator.apache.org > > Sent: Wednesday, June 29, 2016 9:04 AM > > Subject: Re: Myrai

Re: Myraid Slack

Maybe you can post the link? Maybe mine is old. On Jun 29, 2016 12:05 PM, "Ken Sipe" <k...@mesosphere.io> wrote: > I am on > > On Jun 29, 2016, at 11:04 AM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: > > > > Having issues getting on, is anybod

Re: Myraid Slack

Having issues getting on, is anybody else able to connect? On Jun 28, 2016 10:34 PM, "Adam Bordelon" <a...@mesosphere.io> wrote: > (Next dev sync is tomorrow, 9am Pacific time) > > On Tue, Jun 28, 2016 at 12:32 PM, Darin Johnson <dbjohnson1...@gmail.com> > wr

Myriad is 0.2.0!

I've used the release script to publish the source tarball which is available here: https://www.apache.org/dist/incubator/myriad/myriad-0.2.0-incubating/ In addition, I've written a short release note and updated the downloads page, in the following PR:

Re: Myraid Slack

ernetworks.com> >>>> wrote: >>>> >>>> Hi Darin, >>>> Thanks for you reply. Makes sense to use Slack. Btw, we are going to use >>>> Myriad in production, any company have capability to support this ? And >>>> is >>>> there

Re: Myraid Slack

Sam, I don't believe so. But we do have an IRC channel #myriad on FreeNode. I know the mesosphere guys set up slackbots to interact with it. I'm only there occasionally or by appointment. I did notice Kudu now uses slack, so maybe slack makes more sense than IRC these days, or Gitter Chat.

[RESULT] [VOTE] Release Apache Myriad 0.2.0 (incubating)

The vote passed with 3 +1 binding votes from IPMC members and no -1s. +1 binding votes: Justin Mclean Drew Farris John Ament We will proceed with the post release activities: - Make the release artifacts available from [1] and [2] - github tag with "myriad-0.2.0-incubating" - Close the

Re: Myriad hangout tomorrow?

I'm planning on calling in. Darin On Tue, Jun 14, 2016 at 4:25 PM, Swapnil Daingade < swapnil.daing...@gmail.com> wrote: > Hi All, > > Was wondering if we have a Myriad hangout tomorrow. > > Regards > Swapnil >

Re: [Vote] Release apache-myriad-0.2.0-incubating (release candidate 4)

The vote for 0.2.0 RC4 has concluded and passed. Thanks to everyone who verified the release and voted! Binding +1's Darin Johnson Santosh Marella Mohit Soni Non-Binding +1's John Yost Sarjeet Signh Brandon Gulla I'll submit the release to the IPMC to vote. Darin On Thu, Jun 9, 2016 at 8:49

Re: problem getting fine grained scaling workig

isplay/MYRIAD/Fine-grained+Scaling > > This gives the strong impression that you don't need an NM with non-zero > resources. I think this is what initially steered me down the wrong path. > > Cheers, > > On 03/06/16 16:38, Darin Johnson wrote: > > That is correct you ne

Re: problem getting fine grained scaling workig

you very much, > > On 05/06/16 18:09, Darin Johnson wrote: > > Stephen, > > > > I was able to recreate the problem (specific due to 2.7.2, they changed > the > > defaults on the following two properties to true). Setting them to false > > allowed me to agai

Re: problem getting fine grained scaling workig

ake any difference, sadly. > > This is hadoop 2.7.2 > > Cheers, > > On 05/06/16 14:45, Darin Johnson wrote: > > Hey Stephen, > > > > I think you're pretty close. > > > > Looking at the config I'd suggest removing these properties: > > >

Re: problem getting fine grained scaling workig

nks very much for looking. > > Cheers, > > On 05/06/16 12:51, Darin Johnson wrote: > > Hey Steven can you please send your yarn-site.xml, I'm guessing you're on > > the right track. > > > > Darin > > Hi, > > > > OK. That helps, thank you. I thin

Re: problem getting fine grained scaling workig

That is correct you need at least one node manager with the minimum requirements to launch an ApplicationMaster. Otherwise YARN will throw an exception. On Fri, Jun 3, 2016 at 10:52 AM, yuliya Feldman wrote: > I believe you need at least one NM that is not subject

Re: problem getting fine grained scaling working

That is normal behavior, Myriad keeps the resources to flexup a node manager incase a job comes in of a few seconds and then releases them. The info statement is arguably chatty and will probably go to debug in a few more releases. On Fri, Jun 3, 2016 at 9:18 AM, Stephen Gran

Re: [Vote] Release apache-myriad-0.2.0-incubating (release candidate 4)

> - Builds from source tar ball. > > - Ran Apache RAT. Verified that all the sources have license headers. > > - Verified CGS/FGS behaviors with MapReduce jobs on a 4 node Mesos/Yarn > > cluster. > > > > Thanks, > > Santosh > > > > On Tue, May 24, 2

Re: Podling Report Reminder - June 2016

n Wed, Jun 1, 2016 at 2:50 PM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: > > > Santosh looks good thanks! > > On Jun 1, 2016 5:35 PM, "Santosh Marella" <smare...@maprtech.com> wrote: > > > > > Hi Adam, > > > > >

[Vote] Release apache-myriad-0.2.0-incubating (release candidate 4)

Hi All, I have created a source tar ball for Apache Myriad 0.2.0-incubating, release candidate 3 based off the feed back received from release candidate 1,2 & 3. Thanks Sarjeet for a very thorough review! Here’s the release notes: https://cwiki.apache.org/confluence/display/MYRIAD/Release+Notes

Re: [Vote] Release apache-myriad-0.2.0-incubating (release candidate 3)

nd a minor typo > > Darin, RC3 is missing PR#75 changes. I D/L'ed the tar and manually checked > the changes and wasn't there. > > -Sarjeet > > On Mon, May 23, 2016 at 9:15 PM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: > > > Hi All, > > > > I

[Vote] Release apache-myriad-0.2.0-incubating (release candidate 3)

Hi All, I have created a source tar ball for Apache Myriad 0.2.0-incubating, release candidate 3 based off the feed back received from release candidate 1 & 2. Specifically, this corrected some documentation and a minor typo. Here’s the release notes:

Re: gradle Issue when building RM docker on MacOSX

I've seen that error if I used a terminal that wasn't loaded with docker-machine. I think you can also solve with evaluation (`docker-machine env`) On May 22, 2016 8:37 PM, "sarjeet singh" wrote: Observed following issue when tried to build RM docker image from mac

Re: Need help with cgroup troubleshooting or setup issue with NM launch.

Sarjeet: Can you try adding this to your yarn-site.xml: yarn.nodemanager.linux-container-executor.cgroups.hierarchy ${yarn.nodemanager.linux-container-executor.cgroups.hierachy} this should change the hierarchy to /sys/fs/cgroup/cpu/mesos/XXX-TASK-ID-XXX, which will be rightable. and

Re: [Vote] Release apache-myriad-0.2.0-incubating (release candidate 2)

I'm voting +1. Build, ran multiple map/reduce jobs, a few spark and flink jobs. Darin On Tue, May 17, 2016 at 9:24 PM, Darin Johnson <dbjohnson1...@gmail.com> wrote: > Hi All, > > I have created a source tar ball for Apache Myriad 0.2.0-incubating, > release candidate 2 based

Spark and Flink

Just wanted to let people know I tried running a Spark and a Flink job today on Myriad with zero sized node managers. It just worked! This shouldn't be interpreted as it's not going to had issues. However, there is some initial progress. Darin

[Vote] Release apache-myriad-0.2.0-incubating (release candidate 2)

Hi All, I have created a source tar ball for Apache Myriad 0.2.0-incubating, release candidate 2 based off the feed back received from release candidate 1. Specifically, the NOTICE file has been updated to 2016 and the framework properly shuts down when using the web ui. Here’s the release

[Vote] Release apache-myriad-0.2.0-incubating (release candidate 1)

Hi All, Firstly, thanks everyone for the valuable contributions to the project and for holding on tight as we move along the release process. I have created a source tar ball for Apache Myriad 0.2.0-incubating, release candidate 1. Here’s the release notes:

Myriad Release update

OK, I got the updates merged. I'm going to be updating documentation and testing tomorrow. If all goes well we should have a release tomorrow evening. Darin

Myriad PR's

In preparation for the 0.2.0 release I'm going to start merging PR's I've looked over Mohit's, If anyone want's to look over any of the PR's that'd be great, otherwise I'm going to assume anything that's been up for over 3 business days with no negative comments is considered to be OK unless

Re: NM does not start with cgroups enabled

On Wed, Mar 23, 2016 at 8:17 AM, Darin Johnson <dbjohnson1...@gmail.com> wrote: > Hey, Bjorn sorry for the delay, looking at the difference between the > exceptions and my own experience I believe you left some cgroup configs in > yarn-site.xml of the node manager. > On Ma

Re: cgroups suggestions

It turns out everything works if you set permissions appropriately of $CGROUP_ROOT/mesos/$TASKID/ so the yarn user can write to the hierarchy. Then all works exactly as expected. I spent a while running through the container-executor code and when it mounts a cgroup subsystem it changes the

Re: cgroups suggestions

he task finishes, the agent should unmount the $TASK_ID. Are you > saying > that's not happening for NMs ? > > Santosh > > On Wed, May 4, 2016 at 10:30 AM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: > > > I've been digging into groups support, there's a fe

cgroups suggestions

I've been digging into groups support, there's a few things that are easy fixes but a few things become problematic so I'd like to discuss. First the code makes certain options dictated that can be placed in the yarn-site.xml - this should be done to remove code and provide flexibility. That's

Re: 答复: Hello Guys

ement of CM.. > > > > > > Regards, > > Yongyu > > > Begin forwarded message: > > *From:* Darin Johnson <dbjohnson1...@gmail.com> > *Date:* April 21, 2016 at 8:50:22 PM GMT+8 > *To:* Dev <dev@myriad.incubator.apache.org> > *Subject:* *Re: Hel

Re: Myriad Releases

elon <a...@mesosphere.io> > wrote: > > > > > +1 to skipping 0.1.1 if 0.2.0 is coming soon enough > > > I don't think we have any production users eagerly awaiting the 0.1.1 > > fixes > > > > > > On Wed, Apr 20, 2016 at 5:52 PM, Darin Johnson <

Re: Hello Guys

Hey Sam, I'm already myriad alongside a CM managed hadoop cluster. It's a little hacky right now, I'm working on stream lining this, it may involve CM and/or some docker integration. Here are my current steps: 0. I strongly recommend pulling of master and building from source - it has some

Re: Myriad Releases

be > able to get it out earlier than the 0.2.0 release. Since it looks like they > will be released at the same time essentially, the reason to release 0.1.1 > over just waiting to release 0.2.0 goes away. > > On Wed, Apr 20, 2016 at 5:29 PM, Darin Johnson <dbjohnson1...@gmail

Myriad Releases

During the dev sync today we discussed the upcoming 0.1.1 and 0.2.0 releases. Currently, the only out standing issue for 0.1.1 is MYRIAD-192 (Cgroups), for Myriad 0.2.0 the outstanding issues are Myriad-36 and Myriad 192 (Configuration and Docker/Appc support). Currently I have a WIP PR for

Re: Observations on Fine Grained Scaling

ld ideally see lot more than 2-3 containers per node. > > Isn't that happening? How many map tasks does your job have? > > Thanks, > Santosh > > On Wed, Apr 13, 2016 at 8:34 AM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: > > > I've been running a number of tes

Observations on Fine Grained Scaling

I've been running a number of tests on the Fine Grained scaling aspect on Myriad. Here's a few notes: 1. After the patches it seems stable, I'm able to run multiple terasort/pi jobs and a few scalding jobs without difficulty. 2. Noticed with jobs with short map tasks (8-12 secs), I rarely got

Re: Myriad 0.1.1 Release

o I vote against its inclusion. MYRIAD-191 could be worth including, depending on the root-cause. On Wed, Apr 6, 2016 at 11:06 AM, Darin Johnson <dbjohnson1...@gmail.com> wrote: > Hi, > > I'm the release manager for Myriad 0.1.1, which we're hoping to get out in > the next cou

Myriad 0.1.1 Release

Hi, I'm the release manager for Myriad 0.1.1, which we're hoping to get out in the next couple weeks. Here's the list of PR's and JIRA's that I think should go into the release since 0.1.0: Complete: #56 MYRIAD-181 Build failure due to dependency on zookeeper test jar

Re: Challenges after MapR 5.1 Upgrade.

Hey John, I noticed these lines in your yarn-site.xml: yarn.scheduler.minimum-allocation-mb 512 yarn.scheduler.minimum-allocation-vcores 1 If your attempting to launch a zero resource nodemanager for fgs that will result in the first stack

Re: Myriad talk link for MesosCon?

Yeah I didn't see one either. Darin On Wed, Mar 23, 2016 at 1:10 PM, Sarjeet Singh wrote: > I couldn't find any associated link of myriad talk for MesosCon voting. > Anyone? > > Though, I found these proposal doc: > > Developers: http://bit.ly/1RpZPvj > Users:

Re: 0.2.0 release

ovide > container ip addresses behind interfaces. User should be able to switch > implementations by making simple changes in configuration files. > > Regards > Swapnil > > > On Tue, Mar 22, 2016 at 8:20 AM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: > > &g

Re: NM does not start with cgroups enabled

n, > > thanks a lot for this. But what about the other case below, when cgroups > is disabled? > > > Björn > > Am 18.03.2016 um 00:25 schrieb Darin Johnson: > > Hey Bjorn, > > > > I think I figured out the issue. Some of the values for cgroups are > still >

Re: 0.2.0 release

Swapnil, Any help would be appreciated. I'll try to write up what I'm working on tomorrow. But essentially the ideas are: 1. Ability to launch the resource manager and node managers in docker containers 2. Use host networking for now (Ports configured to be pulled from mesos - ability to use

Re: NM does not start with cgroups enabled

Hey Bjorn, I think I figured out the issue. Some of the values for cgroups are still hardcoded in myriad. I'll add a JIRA Ticket hopefully we can get an update for 0.2.0. I'll also respond to this thread after a pull request is submitted in case you'd like to test it. Darin Hi all, I have

Re: 0.2.0 release

, "Adam Bordelon" <a...@mesosphere.io> wrote: > +1 on Darin as release manager > > I'd like to see 0.2 have: > - Usable FGS > - Dockerized NM (for multitenancy) > > On Tue, Mar 15, 2016 at 9:46 AM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: &

Re: NM does not start with cgroups enabled

what does your container-executor.cfg look like? Seems like yarn.nodemanager.linux-container-executor.group isn't set, or possibly bannerusers= hasn't been set (some distro's). On Tue, Mar 15, 2016 at 12:52 PM, Darin Johnson <dbjohnson1...@gmail.com> wrote: > Bjorn, > > Y

0.2.0 release

We've talked about a 0.2.0 release slated for mid April at the dev sync. I'd like to nail down any features people would like and have time to work on. I've been spend some time fixing major bugs to the FGS feature and plan to address MYRIAD-136 and MYRIAD-189. I'd also be willing to be the

Re: NM does not start with cgroups enabled

Hey Bjorn, Can you copy paste the relevant part of the Myriad and yarn-site.xml? Also, can you ensure you are running the mesos-slave with --isolation="cpu/cgroups,memory/cgroups?. I'll try to recreate the problem and/or tell you what's missing in the config. Darin On Mon, Mar 14, 2016 at 6:19

Re: Myriad Vagrant Setup Issue

Hey Matt, if you look at the mesos ui is there any information in the stderr or stdout of the Slave Host it's staging on? Darin On Fri, Jan 15, 2016 at 10:36 AM, Matthew J. Loppatto < mloppa...@keywcorp.com> wrote: > I've gotten a little farther on this issue by increasing the mesos slave >

  1   2   >