[
https://issues.apache.org/jira/browse/MYRIAD-96?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15557947#comment-15557947
]
John Omernik commented on MYRIAD-96:
All, I've implemented Calico Networks on my Mesos cluster. Now, I
You do
> have them set below to 0, however I'm in certain which would take
> precedence.
> On Apr 4, 2016 5:19 PM, "John Omernik" <j...@omernik.com> wrote:
>
> > This was a Upgrade from 5.0. I will post here, note: I have removed the
> > mapr_shuffle to
[
https://issues.apache.org/jira/browse/MYRIAD-195?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15228178#comment-15228178
]
John Omernik commented on MYRIAD-195:
-
You may want to consider an upgrade to 5.1 with MapR. MapR 5.1
one?
> Feels like MapR default properties were not loaded - I need to poke around
> and then I will ask you for additional info
> Thanks,Yuliya
>
> From: John Omernik <j...@omernik.com>
> To: dev@myriad.incubator.apache.org
> Sent: Monday, April 4, 2016 12:2
So prior to the upgrade, I had this code block commented out, however, it
doesn't work without the comments either:
yarn.scheduler.minimum-allocation-vcores
0
yarn.scheduler.minimum-allocation-vcores
0
On Mon, Apr 4, 2016 at 3:04 PM, John
stack trace, sounds like a missing jar on you class path. On the second
> I'm interested in knowing what MyriadScheduler your attempting to run,
> FAIR, CAPACITY, etc (Will be in your yarn-site.xml).
>
> Darin
>
> On Mon, Apr 4, 2016 at 3:29 PM, John Omernik <j...@omernik.com> wr
I had at one point Myriad working fine in MapR 5.0. I updated to 5.1, and
repackaged my hadoop tgz for remote distribution and now I have two
problems occurring.
1. At first when I had the mapr direct shuffle enabled per the
yarn-site.xml on the myriad documentaion, node managers would not
[
https://issues.apache.org/jira/browse/MYRIAD-182?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15193187#comment-15193187
]
John Omernik commented on MYRIAD-182:
-
I am not sure that's the case as I believe it's failing
Hey all,
I am attending Strata this year in San Jose, and was wondering as part of
community building if we should have a meetup, even if it's just to have a
few drinks and get to know folks on list. I've not done one of these types
of conferences before, so I don't know what's normal, but
[
https://issues.apache.org/jira/browse/MYRIAD-184?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15074202#comment-15074202
]
John Omernik commented on MYRIAD-184:
-
Looking at the code referenced:
@Override
public String
John Omernik created MYRIAD-184:
---
Summary: RM Ports are Hardcoded in NMExecutorCLGenImpl.java
Key: MYRIAD-184
URL: https://issues.apache.org/jira/browse/MYRIAD-184
Project: Myriad
Issue Type
John Omernik created MYRIAD-182:
---
Summary: Ability to ignore certificate warnings on config download
from SSL secured RM
Key: MYRIAD-182
URL: https://issues.apache.org/jira/browse/MYRIAD-182
Project
Hey all, just curious if there has been any discussion around supporting
oversubscription in Myriad. Based on my reading of things, Myriad would be
an awesome use case for over subscription, especially when you combine it
with the FGS. Based on what I've read on oversubscription, if Myriad was
.
>
> In that sense, FGS/CGS do not interfere with "min allocation vcores".
> Rather
> FGS and CGS just influence the NM capacities.
>
> Hope this helps.
>
> Thanks,
> Santosh
>
> On Tue, Nov 24, 2015 at 9:25 AM, John Omernik <j...@omernik.com> w
Since a vast majority of my posts are me struggling with something or
breaking something, I thought I'd take the time to craft a story of Myriad
success.
Over the weekend, I took the time to run Elastic Search on Yarn using the
es-yarn package that elastic search has. This is a beta package, and
the nature of CSS.
>
> I have a ticket out there to revamp the UI, so this may be OBE soonish.
>
> Jim
>
> On Tue, Nov 24, 2015 at 10:41 AM, John Omernik <j...@omernik.com> wrote:
>
> > I am looking at the UI, and wanted to confirm others are seeing this too
> >
I am looking at the UI, and wanted to confirm others are seeing this too
before I JIRAed it. But in Firefox, on the "Tasks" page, the header bar at
the top (with the Local, menu items and config string) end halfway through
the "Active Tasks" header. It's fine.. i.e it's not a concern from a
x the local volume creation script to be faster.
>
> --
> Sent from mobile
> On Nov 19, 2015 9:13 AM, "John Omernik" <j...@omernik.com> wrote:
>
> > Is there a setting for Nodemanager startup timeout? Some of my nodes are
> on
> > r
So my last weird issue may be a MapR specific issue, but I wanted to lay it
out here because it's odd. If you recall, I was talking about the mapr.host
not being correct and that was causing some "issues" in that when the
nodemanager tried to run, it would use the wrong hostname for the locality
Is there a setting for Nodemanager startup timeout? Some of my nodes are on
really rough boxes, and the time for the MapR local volume script to start
is taking too long (I think) and the task is failing without an exit code
or anything. I am "thinking" it's a timeout thing, because neither the
dir works
> just fine?
> From: John Omernik <j...@omernik.com>
> To: dev@myriad.incubator.apache.org; yuliya Feldman <yufeld...@yahoo.com>
> Sent: Thursday, November 19, 2015 8:02 AM
> Subject: Re: Struggling with Permissions
>
> Ok all I now have a real answ
ation"
sudo rm -rf ./${HADOOP_VER}
sudo rm ./${HADOOP_VER}.tgz
On Wed, Nov 18, 2015 at 9:40 AM, yuliya Feldman <yufeld...@yahoo.com.invalid
> wrote:
> I would love to have that piece of code "configurable", but it is not at
> the moment.
> Will send you patch offline.
&g
Jul 09
05:38 yarn-site.xml.template
On Wed, Nov 18, 2015 at 12:41 PM, John Omernik <j...@omernik.com> wrote:
> So there are two issues currently I am looking into. The first is the
> permissions of directories. I'd still like to get the feelings from the
> group on th
)
On Tue, Nov 17, 2015 at 1:25 PM, John Omernik <j...@omernik.com> wrote:
> Hey all, I am struggling with permissions on myriad, trying to get the
> right permissions in the tgz as well as who to run as. I am running in
> MapR, which means I need to run as mapr or root (otherwise my vo
sake of local volumes) to be
> unique.
> MapR will have Myriad release to handle this situation.
> From: John Omernik <j...@omernik.com>
> To: dev@myriad.incubator.apache.org
> Sent: Tuesday, November 17, 2015 11:37 AM
> Subject: Re: Struggling with Permissions
>
> Oh
"Why would you want to do that?"
As a potential user of Myriad, in the enterprise I see a number of reasons
I'd "want to do that" they are:
- The ability to use Mesos' purpose built and well design resource
management with Map Reduce. Right now Yarn is is the only option to run Map
Reduce V2
This was another "slipped in" question in my other thread, I am breaking
out for specific instructions. Basically, I was struggling with with some
things in the wiki on this page:
https://cwiki.apache.org/confluence/display/MYRIAD/Installing+for+Administrators
In step 5:
Step 5: Configure YARN
, 2015 at 10:45 AM, Darin Johnson <dbjohnson1...@gmail.com>
wrote:
> Hey John I'm going to try to recreate issue using vanilla hadoop later
> today. Any other settings I should know about?
> Darin
> On Sep 9, 2015 9:42 AM, "John Omernik" <j...@omernik.com> wrot
anks, Ruth
>
> On Wed, Sep 9, 2015 at 8:52 AM, Darin Johnson <dbjohnson1...@gmail.com>
> wrote:
>
> > John,
> > Understood I don't think making the tempdir be setup that way is ideal.
> > We've had issues with other frameworks in the past.
> > Darin
>
, John Omernik <j...@omernik.com> wrote:
> Also a side note: The Flexing up and now having to have at least one node
> manager specified at startup:
>
> nmInstances: # NMs to start with. Requires at least 1 NM with a non-zero
> profile.
>
> medium: 1 #
>
>
&g
(1 minute delay after kicking off Myriad) do we NEED to
have a non-0 profile nodemanager startup with the resource manager?
On Tue, Sep 8, 2015 at 3:16 PM, John Omernik <j...@omernik.com> wrote:
> Cool. Question about the yarn-site.xml in general.
>
> I was struggling with some thi
igurable (ZK vs DFS) by the admin.
>
> Santosh
>
> On Tue, Sep 8, 2015 at 11:27 AM, John Omernik <j...@omernik.com> wrote:
>
> > Since the profile information is small, could this be done in Zookeeper?
> >
> > On Tue, Sep 8, 2015 at 12:59 PM, Yuliya Feldman (JIRA) <
(Shell.java:722)
at
org.apache.hadoop.yarn.server.nodemanager.LinuxContainerExecutor.init(LinuxContainerExecutor.java:182)
... 4 more
15/09/08 15:30:38 INFO nodemanager.NodeManager: SHUTDOWN_MSG:
On Tue, Sep 8, 2015 at 3:26 PM, John Omernik <j...@omernik.com> wrote:
> So some pr
awesome thanks for sharing!
On Fri, Aug 21, 2015 at 12:57 PM, Jim Klucar klu...@gmail.com wrote:
If you want to watch live, its being broadcast on Periscope.
https://t.co/dm0i4CugfK
the where on this for the future
Those are the items that come to mind thus far. I hope the tone of my
email is correct, this is a great project, and I want others to try it as I
have.
John Omernik
So thanks everyone on the NMInstances bug. I am not getting a different
issue with Myriad in that I have a permissions error with the remote tar
ball distribution.
In my old setup (Hadoop 2.5.0, MapR 4.1, some preincubator version of
Myriad)
I would run with the config having
nodemanager:
. Tech. Writer
rhar...@mapr.com
On Wed, Aug 19, 2015 at 11:37 AM, John Omernik j...@omernik.com wrote:
Thanks Adam, I signed up with mandoskippy.
I am honored to help in this capacity, for updating etc, do we go through
some kind of review? Is it better to ask questions on the dev list
access.
(I'll let others answer your specific questions)
On Wed, Aug 19, 2015 at 6:28 AM, John Omernik j...@omernik.com wrote:
Today, I will be playing the role of the fool/jester trying to get Myriad
running. Basically, since getting Myriad running with Santosh quite a
while
ago, and now
Fundamentally, I would imagine that the goals of Myriad, even using a
distribution's build of hadoop, is to have the classpath be entirely
contained. I.e. There should be no need for any classpath on a node to run
resource manager or node manager. This may post challenges, in that I know
in MapR
that is on the classpath: like .../etc/hadoop
From: John Omernik j...@omernik.com
To: dev@myriad.incubator.apache.org
Sent: Tuesday, August 18, 2015 1:35 PM
Subject: Re: Myriad 0.1 release scope
On the release scope, will having the myriad configuration file exist
outside the jar
Feldman yufeld...@yahoo.com.invalid
wrote:
mesos/myriad is the right one so far
From: John Omernik j...@omernik.com
To: dev@myriad.incubator.apache.org; yuliya Feldman yufeld...@yahoo.com
Sent: Tuesday, August 18, 2015 1:44 PM
Subject: Re: Myriad 0.1 release scope
(So if I clone
On the release scope, will having the myriad configuration file exist
outside the jar (i.e. you can change configuration without rebuilding) be
part of the .1 release scope?
On Mon, Aug 10, 2015 at 10:01 PM, Santosh Marella smare...@maprtech.com
wrote:
Hello All,
I've merged the FGS changes
at 3:06 PM, John Omernik j...@omernik.com wrote:
I am working to stumble through this as Santosh helped me get a pre
incubator version of Myriad running, and now I upgraded a bunch of stuff
and wanted to try some of the more recent features. I setup the remote
distribution, created what I
I am working to stumble through this as Santosh helped me get a pre
incubator version of Myriad running, and now I upgraded a bunch of stuff
and wanted to try some of the more recent features. I setup the remote
distribution, created what I think would be a good a json for marathon and
then I am
Would it be made so older versions of Yarn wouldn't work with the incubator
release, or just allow a way to run on older versions, but gracefully not
allow FGS on older versions of Yarn?
On Tuesday, July 14, 2015, yuliya Feldman yufeld...@yahoo.com.invalid
wrote:
+1 on 2.7
From: Jim
of NM to pass
the mesos allocated ports to NM for the above interfaces. We can try
to use variable
expansion
http://hadoop.apache.org/docs/r2.4.1/api/org/apache/hadoop/conf/Configuration.html
mechanism hadoop has to achieve this.
Thanks,
Santosh
On Thu, May 7, 2015 at 3:51 AM, John
46 matches
Mail list logo
