Re: Myriad Vagrant Setup Issue

2016-01-15 Thread Darin Johnson
ntents of my mesos slave logs in /var/log/mesos to this public Gist: > https://gist.github.com/FearTheParrot/b00aa7eee9ae169498d3 > > Matt > > -----Original Message- > From: Darin Johnson [mailto:dbjohnson1...@gmail.com] > Sent: Friday, January 15, 2016 10:55 AM > To: Dev

Re: Next dev sync hangout will be on 1/6/2016

2016-01-12 Thread Darin Johnson
> > > Can we confirm this for tomorrow if this is happening? > > > > -Sarjeet > > > > On Fri, Jan 8, 2016 at 6:53 PM, Darin Johnson <dbjohnson1...@gmail.com> > > wrote: > > > > > Sounds good to me. I think we might have another possible east coast

Re: Next dev sync hangout will be on 1/6/2016

2016-01-08 Thread Darin Johnson
; > On Wed, Jan 6, 2016 at 11:22 AM, Paul Curtis <pcur...@maprtech.com> wrote: > > > I attempted to join as well it seems that no one was in the > > hangout. I gave up after about 15 minutes. > > > > paul > > > > On Wed, Jan 6, 2016 at 12:19 PM,

Re: Next dev sync hangout will be on 1/6/2016

2016-01-06 Thread Darin Johnson
Trying to join On Jan 6, 2016 12:06 PM, "yuliya Feldman" wrote: > Do we have a sync today? > > > From: Santosh Marella > To: dev@myriad.incubator.apache.org > Sent: Wednesday, December 16, 2015 9:47 AM > Subject: Next dev sync hangout

Re: Myriad is 0.1.0

2015-12-10 Thread Darin Johnson
Sweet, thanks for all the work on the release guys! On Thu, Dec 10, 2015 at 1:31 PM, mohit soni wrote: > WooHoo! Perfect holiday gift. Thanks everyone. > > On Thu, Dec 10, 2015 at 10:19 AM, Aashreya Shankar > wrote: > > > This is great ! > > Good

Re: [PROPOSAL(s)] Use Release Branches, and Delete Obsolete Branches

2015-12-03 Thread Darin Johnson
My experience with alt 1 is it takes a lot of discipline or it devolves into develop just being master. I'd be curious how others have found it. On Dec 3, 2015 10:07 PM, "Darin Johnson" <dbjohnson1...@gmail.com> wrote: > +1 A, +1 B. > On Dec 3, 2015 7:12 PM, &quo

Re: [PROPOSAL(s)] Use Release Branches, and Delete Obsolete Branches

2015-12-03 Thread Darin Johnson
+1 A, +1 B. On Dec 3, 2015 7:12 PM, "Sarjeet Singh" wrote: > +1 for Proposal A -> Alt 1, and +1 for Proposal B. > > Should we also maintain 'develop' & 'master' branch as described on > nvie.com, > it was easy to read through the branching model, and understand the >

Re: Merges to Myriad master branch

2015-12-01 Thread Darin Johnson
I like Adam's idea for RCs, but I also really like the idea of a 0.1.0 branch for bug fixes. That way we can cut a 0.1.1 maintenance release much easier than trying to cut off master. Seems like a lot of apache projects handle it that way. Darin Otherwise there will likely be some really ugly

Re: [VOTE] Release apache-myriad-0.1.0-incubating (release candidate 3)

2015-11-23 Thread Darin Johnson
+1 D/L'd built and ran and 4 node vanilla hadoop cluster (remote distro). verified md5 and sha hashes Ran M/R Job on CGS/FGS Flexup and down nodes. killed RM with HA enabled verified nodes up noticed if JHS is up in HA mode and the RM is restarted a new JHS is launched resulting in two JHS

Re: [VOTE] Release apache-myriad-0.1.0-incubating (release candidate 3)

2015-11-23 Thread Darin Johnson
Any guidance on why we can't include the gradlew script? I took a look at Apache Kafka and Apache Tapestry, their artifacts both include gradlew, just not the jar. Meanwhile I'll check the release ... Darin On Mon, Nov 23, 2015 at 4:55 PM, yuliya Feldman wrote:

Re: Struggling with Permissions

2015-11-17 Thread Darin Johnson
Yuliya: Are you referencing yarn.nodemanager.hostname or a mapr specific option? I'm working right now on passing a -Dyarn.nodemanager.hostname=offer.getHostName(). Useful if you've got extra ip's for a san or management network. John: Yeah the permissions on the tarball are a pain to get

Re: Struggling with Permissions

2015-11-17 Thread Darin Johnson
cause I am stumped at how these are > > getting set. > > > > > > > > > > > yarn.resourcemanager.addresshadoopmapr2:8032programatically > > mapr.hosthadoopmapr2.brewingintel.com > > > > > > > yarn.resourcemanager.resource-tracker

Re: [VOTE] Release apache-myriad-0.1.0-incubating (release candidate 2)

2015-11-16 Thread Darin Johnson
gt; to get the IPMC to vote on it. > > Great work, team! > > On Sun, Nov 15, 2015 at 4:13 PM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: > > > +1 > > On Nov 15, 2015 6:33 PM, "yuliya Feldman" <yufeld...@yahoo.com.invalid> > > wrote: > > &g

Re: [VOTE] Release apache-myriad-0.1.0-incubating (release candidate 2)

2015-11-15 Thread Darin Johnson
+1 On Nov 15, 2015 6:33 PM, "yuliya Feldman" wrote: > Thank you Jim > You are not late - it is still 3:30 PM PDT :) > Committers - we need at least one more vote from you for RC2 - you have > 1.5 hours left. > Thanks,Yuliya > From: Jim Klucar

Re: [VOTE] Release apache-myriad-0.1.0-incubating (release candidate 1)

2015-11-11 Thread Darin Johnson
rn-* scripts and > releasing. We can then decide to revamp or permanently remove the Vagrant > setup for a separate release. > > > > On Tue, Nov 10, 2015 at 10:42 PM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: > > > +1 > > D/L'd tar ball verified checksums &

Re: New Committer: Swapnil Daingade

2015-11-05 Thread Darin Johnson
Congrats Swapnil! On Thu, Nov 5, 2015 at 11:16 AM, Sarjeet Singh wrote: > Congrats Swapnil, Very nice work on HA :) > > On Thu, Nov 5, 2015 at 8:13 AM, Santosh Marella > wrote: > > > Congratulations Swapnil. > > > > -- > >

Re: JIRA work for 0.1.0

2015-10-23 Thread Darin Johnson
andomization, but it > is much lower chance then consistently getting the same port w/o > randomization. > Thanks,Yuliya From: Darin Johnson <dbjohnson1...@gmail.com> > To: Dev <dev@myriad.incubator.apache.org>; yuliya Feldman < > yufeld...@yahoo.com> > Sent:

Re: JIRA work for 0.1.0

2015-10-23 Thread Darin Johnson
gt; Great list. > I would include MYRIAD-160 to the list - I am working on that one. Of > course as a workaround we could not use Mesos ports and let NM ports > randomization kick in.I also almost done with MYRIAD-148 - it was really > tricky. Should submit PR tonight. > Thanks,Yu

Re: JIRA work for 0.1.0

2015-10-22 Thread Darin Johnson
I think this sounds good about right. A few Jim marked were new features, gotta leave something for the 0.2.0 release :). On Thu, Oct 22, 2015 at 8:08 AM, Santosh Marella wrote: > I looked at the JIRAs currently marked with fix version "myriad-0.1.0". > There were 19 of

Re: Yarn-Site

2015-10-05 Thread Darin Johnson
sudo rm $YARN_HOME/etc/hadoop/yarn-site.xml <- This is slightly off, I'll go correct. On Mon, Oct 5, 2015 at 4:38 PM, Darin Johnson <dbjohnson1...@gmail.com> wrote: > John, I'm running off: https://github.com/apache/incubator-myriad, it > seems to run OK there's a couple of NP

Re: Myriad Open Source Doc Review

2015-09-26 Thread Darin Johnson
Ruth, Looked briefly at this there are significant changes that need to be made to this document since Swapnil's last PR. I'll see what I can do about updating these, I'm rebuilding my dev environment at the moment so this is a convenient time. I am traveling early in the week though so it

Re: Question about the Wiki Instructions on yarn-site.xml

2015-09-09 Thread Darin Johnson
Hey John I'm going to try to recreate issue using vanilla hadoop later today. Any other settings I should know about? Darin On Sep 9, 2015 9:42 AM, "John Omernik" wrote: > This was another "slipped in" question in my other thread, I am breaking > out for specific instructions.

Re: Complete Myriad HA implementation

2015-09-05 Thread Darin Johnson
//github.com/mesos/myriad/pull/123 > > Regards > Swapnil > > > On Fri, Sep 4, 2015 at 9:55 AM, Darin Johnson <dbjohnson1...@gmail.com> > wrote: > > > I've got some more comments but can really respond adequately until > > tomorrow due to travel. I'll defer if

Re: Complete Myriad HA implementation

2015-09-04 Thread Darin Johnson
/myriad/pull/123 I am wondering, if there are no further review comments by Friday, can we considering merging this pull request ? Regards Swapnil On Mon, Aug 24, 2015 at 7:58 PM, Darin Johnson <dbjohnson1...@gmail.com> wrote: > Swapnil, > > Generally no, they don't which makes it con

Re: Flex API

2015-08-27 Thread Darin Johnson
One additional thing I'd like is the ability to flexup a nmnode on all agents with a certain attribute as opposed to a fixed number. Also, when I get back from vacation I plan on scoping mesos-1739 (dynamic attributes) which would allow for tighter integration with the hdfs framework. An

Re: Google Hangout Link

2015-08-26 Thread Darin Johnson
Ken, Was going through the dcos guide, are there any service discovery options in dcos for finding webservice ports haproxy, nginx? Thanks, Darin PS sorry bought missing the sync I'm on vacation in the Midwest. On Aug 26, 2015 12:05 PM, Ken Sipe k...@mesosphere.io wrote: I sent an inviteā€¦ and

Re: Complete Myriad HA implementation

2015-08-24 Thread Darin Johnson
and Myriad HA makes it to phase1, I'll move it to a more permanent place like perhaps the wiki. Regards Swapnil On Thu, Aug 20, 2015 at 11:39 AM, Darin Johnson dbjohnson1...@gmail.com wrote: Sweet, look forward to checking it out. Hi All, I have updated my pull request

Re: Complete Myriad HA implementation

2015-08-20 Thread Darin Johnson
Sweet, look forward to checking it out. Hi All, I have updated my pull request with the complete Myriad HA implementation rebased on top of the FGS changes here https://github.com/mesos/myriad/pull/123 I am planning to send out another email with details on how to configure it. Regards Swapnil

Re: Odd Errors

2015-08-18 Thread Darin Johnson
Could you paste the stderr/stdout of the executor as well? I think this may be a bug so you won't get booted:). Darin On Aug 18, 2015 3:07 PM, John Omernik j...@omernik.com wrote: I am working to stumble through this as Santosh helped me get a pre incubator version of Myriad running, and now

Re: Myriad 0.1 release scope

2015-08-18 Thread Darin Johnson
John, The remote distribution doesn't require the nm to be run from marathon though it's possible. Essentially, it's the same configuration for the rm you'd do for the non remote version + adding a uri for the tarball. I've got jsons for running the rm in marathon, I'll try to get them and some

Re: Myriad 0.1 release scope

2015-08-07 Thread Darin Johnson
. Thanks, Santosh On Fri, Aug 7, 2015 at 12:12 PM, Darin Johnson dbjohnson1...@gmail.com wrote: It will make working on HA easier. However, one concern that's been addressed previously is that FGS works for Hadoop 2.6.0+. Do we plan to support 2.5.X (anything lower?) also

Re: Myriad 0.1 release scope

2015-08-07 Thread Darin Johnson
It will make working on HA easier. However, one concern that's been addressed previously is that FGS works for Hadoop 2.6.0+. Do we plan to support 2.5.X (anything lower?) also as Santosh has a way to do that, if so how do we facilitate that? Profiles? Darin On Fri, Aug 7, 2015 at 1:46 PM,

Re: Issues 16 and Issue 12

2015-08-03 Thread Darin Johnson
not address task reconciliation yet). I was planning to work on it next. Regards Swapnil On Mon, Aug 3, 2015 at 12:08 PM, Darin Johnson dbjohnson1...@gmail.com wrote: Is anyone actively working these? I'm interested in both of these and should have some cycles to work on them. One question

Re: Some thoughts after a crash course installation

2015-04-21 Thread Darin Johnson
Take a look at https://github.com/mesos/myriad/pull/83. I think this addresses your question, if so its being worked on. On Apr 21, 2015 7:35 AM, Zhongyue Luo zhongyue@gmail.com wrote: Hi team, I finally got Myriad installed in our small Mesos cluster but I have some questions regarding

Re: skip chown in mesos patched

2015-04-08 Thread Darin Johnson
That will eventually simplify the getCommandInfo in TaskFactory.java code I submitted. That's essentially what I had to do to keep the permissions correct, definitely belongs in mesos proper. On Wed, Apr 8, 2015 at 5:32 PM, Adam Bordelon a...@mesosphere.io wrote: Saw that. Thanks! Added the

<    1   2