Re: proposal to change time for Myriad biweekly meeting

2015-05-05 Thread yuliya Feldman
for tomorrow or only from next week? Kannan On May 5, 2015 4:07 PM, Brandon Gulla gulla.bran...@gmail.com wrote: East coaster here. 9am pst is good with me. On May 5, 2015 4:26 PM, Danese Cooper dan...@gmail.com wrote: Fine by me. On May 4, 2015, at 11:14 AM, yuliya Feldman yufeld

Re: Hangout

2015-07-01 Thread yuliya Feldman
Wonder if the link is still valid From: Darin Johnson dbjohnson1...@gmail.com To: dev@myriad.incubator.apache.org Sent: Wednesday, July 1, 2015 8:58 AM Subject: Hangout Are we doing a hangout today? Cheers, Darin

Re: Hangout

2015-07-01 Thread yuliya Feldman
Is there is a different link or what not - I don't think people can connect. Thanks,Yuliya From: Darin Johnson dbjohnson1...@gmail.com To: dev@myriad.incubator.apache.org Sent: Wednesday, July 1, 2015 8:58 AM Subject: Hangout Are we doing a hangout today? Cheers, Darin

Re: myriad scheduler startup with HDP2.7

2015-08-19 Thread yuliya Feldman
This method is part of JsonFactory class which is part of jackson-core jar See if you have some other jars on the classpath (different versions) that precede jackson-core-2.5.1.jar From: Bill Sparks jspa...@cray.com To: dev@myriad.incubator.apache.org dev@myriad.incubator.apache.org

Re: myriad scheduler startup with HDP2.7

2015-08-19 Thread yuliya Feldman
@myriad.incubator.apache.org Cc: yuliya Feldman yufeld...@yahoo.com Sent: Wednesday, August 19, 2015 10:48 AM Subject: Re: myriad scheduler startup with HDP2.7 Well thats the point, I do have 2.2.3 installed as that's the version shipped with HDP 2.3 and that gets loaded first in the classpath

Re: Myriad 0.1 release scope

2015-08-18 Thread yuliya Feldman
mesos/myriad is the right one so far From: John Omernik j...@omernik.com To: dev@myriad.incubator.apache.org; yuliya Feldman yufeld...@yahoo.com Sent: Tuesday, August 18, 2015 1:44 PM Subject: Re: Myriad 0.1 release scope (So if I clone that repo, am I cloning the right one

making contributor

2015-08-19 Thread yuliya Feldman
Hello guys, Could you make me contributor to Myriad, so I could assign JIRAs to myself? Thanks,Yuliya

Licensing for new files

2015-08-24 Thread yuliya Feldman
Hello here, What licensing should we use for newly created files in Myriad source code - pure Apache? Thanks,Yuliya

Re: Complete Myriad HA implementation

2015-08-20 Thread yuliya Feldman
Cool!!!  Way to go From: Swapnil Daingade swapnil.daing...@gmail.com To: dev@myriad.incubator.apache.org Sent: Wednesday, August 19, 2015 8:52 PM Subject: Complete Myriad HA implementation Hi All, I have updated my pull request with the complete Myriad HA implementation rebased on

Re: Trying to build/run Myriad

2015-08-17 Thread yuliya Feldman
I second Adam here. Also - is your job failed to run or it is hanging  - AM is not starting? From: Adam Bordelon a...@mesosphere.io To: Evgeniy Chupriyanov t...@tchu.ru; dev@myriad.incubator.apache.org Sent: Sunday, August 16, 2015 11:28 PM Subject: Re: Trying to build/run Myriad ++

Re: JobHistoryServer running as MyriadTask

2015-07-23 Thread yuliya Feldman
: Darin Johnson dbjohnson1...@gmail.com To: dev@myriad.incubator.apache.org; yuliya Feldman yufeld...@yahoo.com Sent: Thursday, July 23, 2015 9:19 AM Subject: Re: JobHistoryServer running as MyriadTask I was planning to run the resource manager (hopefully two via marathon once ha is done

Re: Establish versions to target for first incubator release?

2015-07-14 Thread yuliya Feldman
+1 on 2.7 From: Jim Klucar klu...@gmail.com To: dev@myriad.incubator.apache.org Sent: Tuesday, July 14, 2015 5:36 PM Subject: Establish versions to target for first incubator release? The FGS discussion made me wonder if we've put a line in the sand about what versions of YARN and

Re: Question about build

2015-07-19 Thread Yuliya Feldman
19, 2015, at 10:08 PM, Yuliya Feldman yufeld...@yahoo.com.INVALID wrote: I am wondering about usage of fat jar in principal - fat jar unless it has the same versions of jars inside fat one and outside can create issues. slf jars , mesos jars What is your experience? Ours so far

Re: Question for Mesos gurus

2015-08-25 Thread yuliya Feldman
masters/slaves can use them Thanks,Yuliya From: Adam Bordelon a...@mesosphere.io To: dev@myriad.incubator.apache.org; yuliya Feldman yufeld...@yahoo.com Sent: Tuesday, August 25, 2015 10:06 AM Subject: Re: Question for Mesos gurus Mesos guarantees forward and backward compatibility by one

Question for Mesos gurus

2015-08-25 Thread yuliya Feldman
Hello guys, I wonder about compatibility of Mesos protobuf for Myriad usage. If I complied Myriad with Mesos version 0.22.1/0.21.1 but on the cluster I have Mesos 0.23 - is it suppose to be compatible? Yesterday our guys came across an exception(see below). When switching jars to mesos-0.21.1

Re: JIRA work for 0.1.0

2015-10-23 Thread yuliya Feldman
pache.org>; yuliya Feldman <yufeld...@yahoo.com> Sent: Friday, October 23, 2015 9:57 AM Subject: Re: JIRA work for 0.1.0 On MYRIAD-160, it's a really bad idea to let Myriad pick a random port outside of Mesos as other frameworks might select that port the probability of that happening is

Re: JIRA work for 0.1.0

2015-10-22 Thread yuliya Feldman
Great list. I would include MYRIAD-160 to the list - I am working on that one. Of course as a workaround we could not use Mesos ports and let NM ports randomization kick in.I also almost done with MYRIAD-148 - it was really tricky. Should submit PR tonight. Thanks,Yuliya From: Darin

Re: [VOTE] Release apache-myriad-0.1.0-incubating (release candidate 0)

2015-11-09 Thread yuliya Feldman
We have found an issue with MYRIAD-162 Executor values (cpu, mem) counted twice.  It is not a big issue, since it is only adding additional 0.2 CPU and some amount of memory. I have a fix for this - will submit PR shortly. Other then that  +1 (non-binding) Checked signatureDownloaded tar.gzBuilt

Re: [VOTE] Release apache-myriad-0.1.0-incubating (release candidate 0)

2015-11-09 Thread yuliya Feldman
Are you saying we should have rc1 after you are done? From: Brandon Gulla To: dev@myriad.incubator.apache.org Sent: Monday, November 9, 2015 5:33 AM Subject: Re: [VOTE] Release apache-myriad-0.1.0-incubating (release candidate 0) I am adjusting the version

Re: New Committer: Swapnil Daingade

2015-11-05 Thread yuliya Feldman
Congratulations Swapnil!!! Well done Yuliya From: Adam Bordelon To: dev@myriad.incubator.apache.org Sent: Thursday, November 5, 2015 4:38 AM Subject: New Committer: Swapnil Daingade The Podling Project Management Committee (PPMC) for Apache Myriad has asked

Re: New committer: Darin J

2015-11-05 Thread yuliya Feldman
Congratulations Darrin!!! Great news. Yuliya From: Adam Bordelon To: dev@myriad.incubator.apache.org Sent: Thursday, November 5, 2015 4:36 AM Subject: New committer: Darin J The Podling Project Management Committee (PPMC) for Apache Myriad has asked Darin to

PR 121 is ready for review

2015-10-07 Thread yuliya Feldman
Hello here, I have updated PR: https://github.com/mesos/myriad/pull/121   (Myriad-Issue-60 Added ability to launch JHS) With latest set of changes based on prior feedback. Will appreciate your review. Thanks,Yuliya

Re: apache rat plugin

2015-10-15 Thread yuliya Feldman
Yes, we should do it - it forces not to forget license From: Santosh Marella To: dev@myriad.incubator.apache.org Sent: Thursday, October 15, 2015 2:53 PM Subject: Re: apache rat plugin Great idea Jim. Integrating it into the build would be very helpful.

Re: Myriad 0.1.0 Release Planning

2015-10-16 Thread yuliya Feldman
I had quite a hard time rebasing all 15 commits on top of latest NM Constraints feature, so I end up squashing all my 15 commits into one. On top of it I screwed up branch I had everything on, so had to create a separate branch and subsequently it created a new PR. Codewise it is the same as was

Re: https://github.com/mesos/myriad/pull/121 ready for review (again)

2015-10-11 Thread yuliya Feldman
I have addressed majority of review comments. Thanks,Yuliya From: yuliya Feldman <yufeld...@yahoo.com> To: Dev <dev@myriad.incubator.apache.org> Sent: Thursday, October 1, 2015 1:14 AM Subject: https://github.com/mesos/myriad/pull/121 ready for review (again) Hello here,

Re: Struggling with Permissions

2015-11-17 Thread yuliya Feldman
Please change workdir directory for mesos slave to one that is not /tmp and make sure that dir is owned by root. There is one more caveat with binary distro and MapR - in Myriad code for binary distro configuration is copied from RM to NMs - it doe snot work for MapR since we need hostname (yes

Re: [jira] [Commented] (MYRIAD-129) Creating custom profiles requires configurations changes on all nodes.

2015-09-08 Thread yuliya Feldman
is small, could this be done in Zookeeper? On Tue, Sep 8, 2015 at 12:59 PM, Yuliya Feldman (JIRA) <j...@apache.org> wrote: > >    [ > https://issues.apache.org/jira/browse/MYRIAD-129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735288#comment-14735288 &

Re: Getting Nodes to be "Running" in Mesos

2015-09-08 Thread yuliya Feldman
Take a look at :   https://github.com/mesos/myriad/pull/128 for yarn-site.xml updates From: John Omernik To: dev@myriad.incubator.apache.org Sent: Tuesday, September 8, 2015 12:38 PM Subject: Getting Nodes to be "Running" in Mesos So I am playing around with a

Re: Getting Nodes to be "Running" in Mesos

2015-09-08 Thread yuliya Feldman
,Yuliya From: John Omernik <j...@omernik.com> To: dev@myriad.incubator.apache.org; yuliya Feldman <yufeld...@yahoo.com> Sent: Tuesday, September 8, 2015 1:31 PM Subject: Re: Getting Nodes to be "Running" in Mesos interesting... when I did root as the fra

Marathon version 0.11 dependency on Java 8

2015-10-01 Thread yuliya Feldman
Hello guys, Is it true that Java 8 is a requirement to run Marathon 0.11? It feels a bit strange that it would not support Java 7. Thanks,Yuliya

Re: Understanding Myriad workflows

2015-09-21 Thread yuliya Feldman
Myriad implementation does not depend on Marathon, so you don't need to start MyraidScheduler/RM using Marathon. In this case you need to take care of MyriadScheduler/RM restart in case of it's failure yourself. Myriad HA feature will take care of preserving state, but restart and

Re: [PROPOSAL(s)] Use Release Branches, and Delete Obsolete Branches

2015-12-03 Thread yuliya Feldman
I fully second Todd. Thanks,Yuliya From: Todd Richmond To: dev@myriad.incubator.apache.org Sent: Thursday, December 3, 2015 8:59 AM Subject: Re: [PROPOSAL(s)] Use Release Branches, and Delete Obsolete Branches excellent pro/con list +1 for either A or + .5

Re: Myriad is 0.1.0

2015-12-10 Thread yuliya Feldman
Yes, indeed kudos to Santosh for managing this release!!! Yuliya From: Swapnil Daingade To: dev@myriad.incubator.apache.org Sent: Thursday, December 10, 2015 7:14 PM Subject: Re: Myriad is 0.1.0 Congratulations and thank you everyone for all the hard

Re: Myriad is 0.1.0

2015-12-13 Thread yuliya Feldman
Great news!!! The very first release Thanks everybody,Yuliya From: Santosh Marella To: dev@myriad.incubator.apache.org Sent: Sunday, December 13, 2015 10:35 PM Subject: Re: Myriad is 0.1.0 Updated the Apache Myriad website with 0.1.0 release news, download

Re: Next dev sync hangout will be on 1/6/2016

2016-01-06 Thread yuliya Feldman
Do we have a sync today? From: Santosh Marella To: dev@myriad.incubator.apache.org Sent: Wednesday, December 16, 2015 9:47 AM Subject: Next dev sync hangout will be on 1/6/2016 We have decided to hold the next dev sync on 1/6/2016 (instead of 12/30/2015).

Re: Struggling with Permissions

2015-11-19 Thread yuliya Feldman
You mean that if you enable cgroups in yarn /tmp as a slave temp dir works just fine? From: John Omernik <j...@omernik.com> To: dev@myriad.incubator.apache.org; yuliya Feldman <yufeld...@yahoo.com> Sent: Thursday, November 19, 2015 8:02 AM Subject: Re: Struggling with Permis

Re: [VOTE] Release apache-myriad-0.1.0-incubating (release candidate 3)

2015-11-23 Thread yuliya Feldman
When I download release gradlew file is not there, so I can not build Am I missing anything? Thanks,Yuliya From: Santosh Marella To: dev@myriad.incubator.apache.org Sent: Monday, November 23, 2015 12:36 PM Subject: Re: [VOTE] Release apache-myriad-0.1.0-incubating

Re: [VOTE] Release apache-myriad-0.1.0-incubating (release candidate 3)

2015-11-23 Thread yuliya Feldman
Thank you Santosh Probably question to Ken: Just wonder why do we need to download gradle to use it to generate gradlew and then gradlew downloads gradle again? Thanks,Yuliya From: Santosh Marella <smare...@maprtech.com> To: yuliya Feldman <yufeld...@yahoo.

Re: [VOTE] Release apache-myriad-0.1.0-incubating (release candidate 3)

2015-11-23 Thread yuliya Feldman
+1 (non-binding) Checked signature Downloaded tar.gz Built from tar.gz Deployed on a one node cluster Tested NM/JHS flexup/down Run M/R job successfully Tested RM HA Thanks,Yuliya From: Santosh Marella To: dev@myriad.incubator.apache.org Sent: Monday, November 23,

Re: Issues while deploying Myriad

2016-02-07 Thread yuliya Feldman
Hello Jonatan, You are welcome to bring up issues on this email thread or open JIRA if you feel like it. From: "jonatan.e...@rai.usc.es" To: dev@myriad.incubator.apache.org Sent: Wednesday, February 3, 2016 8:44 AM Subject: Issues while deploying Myriad

Re: Not able to launch Node Managers via Myriad

2016-02-23 Thread yuliya Feldman
Could you provide your yarn-site.xml and myriad-config-default.yml ? Let's make sure you have following in your yarn-site.xml:       yarn.resourcemanager.scheduler.class    com.ebay.myriad.scheduler.yarn.MyriadFairScheduler    One can configure other scehdulers as well from following list:

Re: Pending Flex Up Tasks

2016-02-22 Thread yuliya Feldman
ache.org Sent: Monday, February 22, 2016 12:35 AM Subject: Re: Pending Flex Up Tasks Dear Yuliya, thank you for the warm welcome. Am 19.02.2016 um 18:22 schrieb yuliya Feldman: > Hello Bjorn, > Welcome to Myriad. > Few questions that could help to help you. > 1. Do you just have

Re: Challenges after MapR 5.1 Upgrade.

2016-04-04 Thread yuliya Feldman
Hello John, Did you upgrade to 5.1 or installed new one? Feels like MapR default properties were not loaded - I need to poke around and then I will ask you for additional info Thanks,Yuliya From: John Omernik To: dev@myriad.incubator.apache.org Sent: Monday, April 4,

Re: Challenges after MapR 5.1 Upgrade.

2016-04-04 Thread yuliya Feldman
YarnDefaultProperties.java that defines class for mapr_direct_shuffle should be there even in 5.0, so nothing new there even if maprfs jar is outdated - could you also check that? Also could you paste content of your yarn-site.xml here? Thanks,Yuliya From: yuliya Feldman <yuf

Re: Challenges after MapR 5.1 Upgrade.

2016-04-04 Thread yuliya Feldman
class:  YarnDefaultProperties Thanks,Yuliya From: John Omernik <j...@omernik.com> To: dev@myriad.incubator.apache.org; yuliya Feldman <yufeld...@yahoo.com> Sent: Monday, April 4, 2016 2:18 PM Subject: Re: Challenges after MapR 5.1 Upgrade. This was a Upgrade from 5.0. 

Re: Observations on Fine Grained Scaling

2016-04-13 Thread yuliya Feldman
>>> Noticed with jobs with short map tasks (8-12 secs), I rarely got morethan >>>two containers per node, I'm curious if I'm not consuming resources fast enough Yes, we have noticed that too. I think because heartbeat between Mesos and RM is 5 sec (I think) we may not get enough resources with

Re: Sync today?

2016-07-13 Thread yuliya Feldman
same - can not connect From: Darin Johnson To: Dev Sent: Wednesday, July 13, 2016 9:09 AM Subject: Sync today? Couldn't connect

Re: Sync today?

2016-07-13 Thread yuliya Feldman
I guess nobody from Mesosphere today to start hangout. From: yuliya Feldman <yufeld...@yahoo.com.INVALID> To: "dev@myriad.incubator.apache.org" <dev@myriad.incubator.apache.org> Sent: Wednesday, July 13, 2016 9:10 AM Subject: Re: Sync today? same - can not conn

Re: Sync tomorrow?

2016-08-10 Thread yuliya Feldman
I won't be there tomorrow - will have a meeting From: Adam Bordelon To: dev@myriad.incubator.apache.org Sent: Tuesday, August 9, 2016 5:32 PM Subject: Re: Sync tomorrow? Yeah, I'll be there. Don't have a lot of news though. On Tue, Aug 9, 2016 at 5:21 PM, Darin

Re: Myraid Slack

2016-06-29 Thread yuliya Feldman
no luck joining so far From: Ken Sipe To: dev@myriad.incubator.apache.org Sent: Wednesday, June 29, 2016 9:04 AM Subject: Re: Myraid Slack I am on > On Jun 29, 2016, at 11:04 AM, Darin Johnson wrote: > > Having issues getting on, is

Re: Myraid Slack

2016-06-29 Thread yuliya Feldman
nope - hanging in "Requesting to join" :( From: Ken Sipe <k...@mesosphere.io> To: dev@myriad.incubator.apache.org; yuliya Feldman <yufeld...@yahoo.com> Sent: Wednesday, June 29, 2016 9:11 AM Subject: Re: Myraid Slack https://plus.google.com/hangouts/_/mesosp

Re: Website is updated, 0.2.0 is official!

2016-06-29 Thread yuliya Feldman
Great news. Thank you Darrin and everybody for the 2.0 release!!! From: Darin Johnson To: Dev Sent: Wednesday, June 29, 2016 2:05 PM Subject: Website is updated, 0.2.0 is official! http://myriad.apache.org/ Tell your

Do we have a call today? I am not able to get it

2016-09-21 Thread yuliya Feldman

Re: Do we have a call today? I am not able to get it

2016-09-21 Thread yuliya Feldman
ok Unfortunately I have to leave now :( From: Adam Bordelon <a...@mesosphere.io> To: dev@myriad.incubator.apache.org; yuliya Feldman <yufeld...@yahoo.com> Sent: Wednesday, September 21, 2016 9:14 AM Subject: Re: Do we have a call today? I am not able to get it I'm stuc

Do we have sync up today, or I am too late?

2016-08-24 Thread yuliya Feldman

[DISCUSS] handling roles in Myriad code

2016-10-19 Thread yuliya Feldman
Hello there, I wanted to discuss current handling of roles in Myriad code. Specifically on "master" branch. Most likely due to heavy refactoring. As far as I can see we try to handle presence or absence of a role on a resource(s) based on the fact that framework may or may not have a role.On the

Re: [DISCUSS] Using defined ports versus provided by Mesos

2016-10-19 Thread yuliya Feldman
To add to the previous - in case of work preserving NodeManager we would also need consistent port assignment in case NM restarts. From: yuliya Feldman <yufeld...@yahoo.com> To: Dev <dev@myriad.incubator.apache.org> Sent: Wednesday, October 19, 2016 12:34 PM Subject: [DI

[DISCUSS] Using defined ports versus provided by Mesos

2016-10-19 Thread yuliya Feldman
Hello there, I wanted to discuss usage of hardcoded ports instead of ones provided by Mesos as a resource.On master branch - probably due to significant code refactoring we pretty much do NOT allow any ports (range resource) that is NOT provided by Mesos. Earlier on we could have "reserved"

Re: [DISCUSS] handling roles in Myriad code

2016-10-19 Thread yuliya Feldman
ole) && !role.equals("*") in a few places. Though it may be better to pass think about a better approach here. Darin On Wed, Oct 19, 2016 at 9:28 PM, yuliya Feldman <yufeld...@yahoo.com.invalid > wrote: > Hello Darrin, > I kind of see the point regarding JHS ports. Ma

Re: Hangout today

2016-11-16 Thread yuliya Feldman
Sorry - could not attend - was on the road From: Darin Johnson To: Dev Sent: Wednesday, November 16, 2016 9:33 AM Subject: Hangout today Missed due to another meeting going long.  Anyone else attend?

Re: [DISCUSS] handling roles in Myriad code

2016-10-28 Thread yuliya Feldman
> > don't pay attention you can miss a lot of the resources you're given. > I > > > wish it was we didn't have to do all the book keeping our selves, but I > > > suppose there are good reasons for delegating it to the framework, for > > > instan

will miss standup today - doc appt.

2017-01-11 Thread yuliya Feldman

Re: Sync today?

2017-03-08 Thread yuliya Feldman
sorry - forgot From: Darin Johnson To: Dev Sent: Wednesday, March 8, 2017 9:06 AM Subject: Sync today? Tried joining.

Re: [Vote] Retire Myriad

2017-06-20 Thread yuliya Feldman
Sorry for chiming in late. I was out of town. I think we should keep the project going if there is an activity on the project. I can definitely contribute time to vet the release, review and merge. I may not be able to actively work on the project as it is not inline with my current work

Re: Report

2017-10-10 Thread yuliya Feldman
Feels like project is dead, Wonder if anybody at MapR and/or Mesosphere interested in continuing the project? On Tuesday, October 10, 2017, 4:42:56 AM PDT, Ted Dunning wrote: The incubator report for myriad seems to be missing. Is anybody up for filing it?

Re: Myriad Sync - 11/15/17

2017-11-15 Thread yuliya Feldman
Could it be a bit more advance notice? Or I missed that notice? On Wednesday, November 15, 2017, 10:03:37 AM PST, mohit soni wrote: Hi Please join: https://hangouts.google.com/hangouts/_/uiq2idcclngybc3hlifznfdxi4e for today's Myriad Sync. Best Mohit

Re: Apache Slider and Apache Myriad

2018-04-24 Thread yuliya Feldman
Are you suggesting using Myriad as meta-scheduler for Mesos? If yes, then:1. Why would one need Mesos or Myriad at all - use YARN for everything?2. Mesos scheduler is much more robust then YARN scheduler as it's based on the offers - it was done having multiple subsystems in mind unlike YARN

Re: [Proposal] Migrate to gitbox

2018-09-14 Thread yuliya Feldman
at 7:30 PM yuliya Feldman wrote: > >  Hello there, > I am trying to figure out what are the real advantages for Myriad in moving > it to gitbox >  - JIRA linking can be enabled on request to the Apache Infra team, which >  will automatically link a PR with its corresponding JIRA

Re: [Proposal] Migrate to gitbox

2018-09-13 Thread yuliya Feldman
Hello there, I am trying to figure out what are the real advantages for Myriad in moving it to gitbox   - JIRA linking can be enabled on request to the Apache Infra team, which   will automatically link a PR with its corresponding JIRA in I believe it is already there    - It will make our code

Re: Multiple versions of Apache Hadoop YARN as a Service

2019-09-27 Thread yuliya Feldman
gt;> as you please. Even today I believe we need to make sure locality is taken >>> care of. We have enabled comments in the doc, maybe you can help us make this pros and cons list with the new design. >>> Thanks Thank you, all this help is appreciated On Wed, Sep 25, 201

Re: Multiple versions of Apache Hadoop YARN as a Service

2019-09-24 Thread yuliya Feldman
it was my opinion :). You guys know better and closer to it. Thanks,Yuliya On Tuesday, September 24, 2019, 11:32:32 AM PDT, Javi Roman wrote: On Tue, Sep 24, 2019 at 7:48 PM yuliya Feldman wrote: > >  >>> I guess we are talking about the concept of multi-service scheduler

Re: Multiple versions of Apache Hadoop YARN as a Service

2019-09-24 Thread yuliya Feldman
great if you would provide write up with pros and cons for your approach or any alternative approaches. On Tuesday, September 24, 2019, 11:38:13 AM PDT, Javi Roman wrote: On Tue, Sep 24, 2019 at 7:58 PM yuliya Feldman wrote: > >  Hello, > Again I apologize for the late r

Re: Multiple versions of Apache Hadoop YARN as a Service

2019-09-24 Thread yuliya Feldman
Hello, Again I apologize for the late reply. I think I replied to the thread, but will add more direct notes here What you are proposing is to have yet another daemon that would start Yarn Clusters on demand within Mesos framework. Meaning - it would be another layer of abstraction.  In this

Re: Multiple versions of Apache Hadoop YARN as a Service

2019-09-24 Thread yuliya Feldman
>>> I guess we are talking about the concept of multi-service schedulerAre you >>>proposing to have a multi service scheduler? I thought that's what Mesos is >>>for?What am I missing here? Thanks,Yuliya On Tuesday, September 24, 2019, 10:00:39 AM PDT, Javi Roman wrote: I guess we

Re: Multiple versions of Apache Hadoop YARN as a Service

2019-09-25 Thread yuliya Feldman
v list ;-) > -- > Javi Roman > > Twitter: @javiromanrh > GitHub: github.com/javiroman > Linkedin: es.linkedin.com/in/javiroman > Big Data Blog: dataintensive.info > Apache Id: javiroman > > On Tue, Sep 24, 2019 at 8:55 PM yuliya Feldman > wrote: > > > >  I

[jira] [Commented] (MYRIAD-121) Myriad-Issue-60 Added ability to launch JHS ...

2015-08-19 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/MYRIAD-121?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14703996#comment-14703996 ] Yuliya Feldman commented on MYRIAD-121: --- All the comments are going on https

[jira] [Commented] (MYRIAD-18) staging - pending loop

2015-10-21 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/MYRIAD-18?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14967852#comment-14967852 ] Yuliya Feldman commented on MYRIAD-18: -- I believe now you can flex down those, since we changed

[jira] [Assigned] (MYRIAD-148) /api/config missing myriadExecutorConfiguration & nodeManagerConfiguration's param key value.

2015-10-23 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/MYRIAD-148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuliya Feldman reassigned MYRIAD-148: - Assignee: Yuliya Feldman > /api/config missing myriadExecutorConfigurat

[jira] [Commented] (MYRIAD-148) /api/config missing myriadExecutorConfiguration & nodeManagerConfiguration's param key value.

2015-10-23 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/MYRIAD-148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14970520#comment-14970520 ] Yuliya Feldman commented on MYRIAD-148: --- Submitted PR: https://github.com/apache/incubator-myriad

[jira] [Updated] (MYRIAD-172) More resources assigned to executor

2015-11-09 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/MYRIAD-172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuliya Feldman updated MYRIAD-172: -- Assignee: DarinJ (was: Yuliya Feldman) > More resources assigned to execu

[jira] [Assigned] (MYRIAD-172) More resources assigned to executor

2015-11-09 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/MYRIAD-172?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuliya Feldman reassigned MYRIAD-172: - Assignee: Yuliya Feldman > More resources assigned to execu

[jira] [Commented] (MYRIAD-170) Myriad initialization fails with "parameter 5 of org.apache.myriad.scheduler.MyriadOperations.() is not @Nullable"

2015-11-05 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/MYRIAD-170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14993193#comment-14993193 ] Yuliya Feldman commented on MYRIAD-170: --- Thank you for reporting the issue. We will try to provide

[jira] [Commented] (MYRIAD-170) Myriad initialization fails with "parameter 5 of org.apache.myriad.scheduler.MyriadOperations.() is not @Nullable"

2015-11-05 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/MYRIAD-170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14993007#comment-14993007 ] Yuliya Feldman commented on MYRIAD-170: --- Thanks for reporting the issue. Are you using apache

[jira] [Resolved] (MYRIAD-60) Integrate YARN timeline server/job history server with Myriad.

2015-10-08 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/MYRIAD-60?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuliya Feldman resolved MYRIAD-60. -- Resolution: Duplicate MYRIAD-121 supersedes this one > Integrate YARN timeline server/

[jira] [Comment Edited] (MYRIAD-158) License string <-- Licensed ...--> is showing up on myriad UI.

2015-10-19 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/MYRIAD-158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964485#comment-14964485 ] Yuliya Feldman edited comment on MYRIAD-158 at 10/20/15 4:15 AM

[jira] [Commented] (MYRIAD-158) License string <-- Licensed ...--> is showing up on myriad UI.

2015-10-19 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/MYRIAD-158?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14964485#comment-14964485 ] Yuliya Feldman commented on MYRIAD-158: --- It is important to fix - it doe snot look pretty. Looks

[jira] [Created] (MYRIAD-159) Change default mesos version to 0.24

2015-10-19 Thread Yuliya Feldman (JIRA)
Yuliya Feldman created MYRIAD-159: - Summary: Change default mesos version to 0.24 Key: MYRIAD-159 URL: https://issues.apache.org/jira/browse/MYRIAD-159 Project: Myriad Issue Type

[jira] [Commented] (MYRIAD-140) NullPointerException on NM flex up/down API when no params passed to HTTP PUT request.

2015-10-20 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/MYRIAD-140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14965604#comment-14965604 ] Yuliya Feldman commented on MYRIAD-140: --- Submitted PR: https://github.com/apache/incubator-myriad

[jira] [Commented] (MYRIAD-129) Creating custom profiles requires configurations changes on all nodes.

2015-09-08 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/MYRIAD-129?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14735288#comment-14735288 ] Yuliya Feldman commented on MYRIAD-129: --- I think we should have API/UI to add/remove/modify profiles

[jira] [Created] (MYRIAD-136) Need to handle TASK_ERROR in StatusUpdateEventHandler

2015-09-14 Thread Yuliya Feldman (JIRA)
Yuliya Feldman created MYRIAD-136: - Summary: Need to handle TASK_ERROR in StatusUpdateEventHandler Key: MYRIAD-136 URL: https://issues.apache.org/jira/browse/MYRIAD-136 Project: Myriad Issue

[jira] [Commented] (MYRIAD-131) Timeout for tasks in Pending or Staging state

2015-09-18 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/MYRIAD-131?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14876073#comment-14876073 ] Yuliya Feldman commented on MYRIAD-131: --- Feature Santosh is working on to enhance flexup/flexdown

[jira] [Commented] (MYRIAD-136) Need to handle TASK_ERROR in StatusUpdateEventHandler

2015-09-18 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/MYRIAD-136?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=14876062#comment-14876062 ] Yuliya Feldman commented on MYRIAD-136: --- I wanted to get opinion on how to handle TASK_ERROR

[jira] [Created] (MYRIAD-141) Include myriad framework name into task name

2015-09-22 Thread Yuliya Feldman (JIRA)
Yuliya Feldman created MYRIAD-141: - Summary: Include myriad framework name into task name Key: MYRIAD-141 URL: https://issues.apache.org/jira/browse/MYRIAD-141 Project: Myriad Issue Type

[jira] [Created] (MYRIAD-142) NMExecutorCLGenImpl has to define myriad.mapreduce.shuffle.port just as port, not address

2015-09-22 Thread Yuliya Feldman (JIRA)
Yuliya Feldman created MYRIAD-142: - Summary: NMExecutorCLGenImpl has to define myriad.mapreduce.shuffle.port just as port, not address Key: MYRIAD-142 URL: https://issues.apache.org/jira/browse/MYRIAD-142

[jira] [Updated] (MYRIAD-140) NullPointerException on NM flex up/down API when no params passed to HTTP PUT request.

2015-12-02 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/MYRIAD-140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuliya Feldman updated MYRIAD-140: -- Fix Version/s: Myriad 0.1.0 > NullPointerException on NM flex up/down API when no params pas

[jira] [Created] (MYRIAD-178) Add UI to support flexup/down services in Myriad

2015-12-02 Thread Yuliya Feldman (JIRA)
Yuliya Feldman created MYRIAD-178: - Summary: Add UI to support flexup/down services in Myriad Key: MYRIAD-178 URL: https://issues.apache.org/jira/browse/MYRIAD-178 Project: Myriad Issue Type

[jira] [Resolved] (MYRIAD-140) NullPointerException on NM flex up/down API when no params passed to HTTP PUT request.

2015-12-02 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/MYRIAD-140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yuliya Feldman resolved MYRIAD-140. --- Resolution: Fixed https://github.com/apache/incubator-myriad/pull/16 > NullPointerExcept

[jira] [Commented] (MYRIAD-178) Add UI to support flexup/down services in Myriad

2016-02-23 Thread Yuliya Feldman (JIRA)
[ https://issues.apache.org/jira/browse/MYRIAD-178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15160243#comment-15160243 ] Yuliya Feldman commented on MYRIAD-178: --- I would imagine that tools we are using should be similar

[jira] [Created] (MYRIAD-243) support authentication for Myriad REST and UI

2016-10-04 Thread Yuliya Feldman (JIRA)
Yuliya Feldman created MYRIAD-243: - Summary: support authentication for Myriad REST and UI Key: MYRIAD-243 URL: https://issues.apache.org/jira/browse/MYRIAD-243 Project: Myriad Issue Type

[jira] [Created] (MYRIAD-245) Add ability to set secure communication between Myriad Scheduler and Mesos

2016-10-04 Thread Yuliya Feldman (JIRA)
Yuliya Feldman created MYRIAD-245: - Summary: Add ability to set secure communication between Myriad Scheduler and Mesos Key: MYRIAD-245 URL: https://issues.apache.org/jira/browse/MYRIAD-245 Project

  1   2   >