Re: [VOTE] Release Apache Myriad 0.1.0 (incubating)

[Santosh Marella]

Thanks Justin. Please see inline.

>For the LICENSE:
>- The appendix part of the LICENSE isn’t correct (i.e. the Apache licence
can apply to non ASF licensed software). Best to use the stock one and not
>modify it [1]

I didn't understand what's not correct in the appendix part of the LICENSE.
I compared the appendix section with that from the stock, and couldn't spot
a difference. Can you please clarify?

>- LICENSE mentions sub components but there are none listed
>- LICENSE is missing normalise.css which is MIT licensed see [2]

(This may be a question for Jim Klucar (Myriad's UI developer), but if you
are familiar with bootstrap's licensing, your guidance is much appreciated.)

The bootstrap-myriad.css[1] file shows it is Apache 2 licensed, but I see
v3.2.0 of bootstrap.css[2] is MIT licensed. I wonder which one is correct.

Also, the bootstrap-myriad.css[1] file mentions normalize.css as MIT
licensed. However, [3] doesn't return anything. I found [4], but it doesn't
seem to be MIT licensed. Just trying to figure out what should go into the
"sub components" section of Myriad's LICENSE file.

1.
https://github.com/apache/incubator-myriad/blob/master/myriad-scheduler/src/main/resources/webapp/css/bootstrap-myriad.css
2. https://github.com/twbs/bootstrap/blob/v3.2.0/LICENSE
3. http://git.io/normalize
4. https://github.com/necolas/normalize.css/blob/3.0.2/LICENSE.md

Santosh

On Wed, Nov 18, 2015 at 11:34 PM, Justin Mclean 
wrote:

> Hi,
>
> >  I've a few questions to ask regarding the update to LICENSE. I'll ask
> > them on the general@ thread.
>
> Ask away. Also happy to review it before it get to the incubator if you
> want.
>
> Thanks,
> Justin
>

Re: [VOTE] Release Apache Myriad 0.1.0 (incubating)

[Santosh Marella]

Great. Thanks once again! We'll try to get the necessary changes
incorporated and prepare a new RC ASAP.

Santosh

On Thu, Nov 19, 2015 at 12:56 AM, Justin Mclean 
wrote:

> Hi,
>
> > I didn't understand what's not correct in the appendix part of the
> LICENSE.
> > I compared the appendix section with that from the stock, and couldn't
> spot
> > a difference. Can you please clarify?
>
> Yep the text should be this:
>Copyright [] [name of copyright owner]
>
> Not this:
>   Copyright 2012-present Apache Software Foundation
>
> Just replace the whole file with the official version here [1].
>
> Thanks,
> Justin
>
> 1. http://www.apache.org/licenses/LICENSE-2.0.txt
>
>
>

Re: [VOTE] Release Apache Myriad 0.1.0 (incubating)

[Justin Mclean]

Hi,

> (This may be a question for Jim Klucar (Myriad's UI developer), but if you
> are familiar with bootstrap's licensing, your guidance is much appreciated.)

Different versions of bootstrap have had different licenses you need to respect 
the version you have bundled not the current license.

> Also, the bootstrap-myriad.css[1] file mentions normalize.css as MIT
> licensed.

Looks MIT to me compare [1] with [2]. The principal here is [3].

Thanks,
Justin

1. https://github.com/necolas/normalize.css/blob/master/LICENSE.md 

2. https://opensource.org/licenses/MIT 
3. http://www.apache.org/dev/licensing-howto.html#guiding-principle 

Re: [VOTE] Release Apache Myriad 0.1.0 (incubating)

[Justin Mclean]

Hi,

> I didn't understand what's not correct in the appendix part of the LICENSE.
> I compared the appendix section with that from the stock, and couldn't spot
> a difference. Can you please clarify?

Yep the text should be this:
   Copyright [] [name of copyright owner]

Not this:
  Copyright 2012-present Apache Software Foundation

Just replace the whole file with the official version here [1].

Thanks,
Justin

1. http://www.apache.org/licenses/LICENSE-2.0.txt

Re: Nodemanager Startup Timeout

[John Omernik]

Thank you, that fixed the issue, it was exactly that.

On Thu, Nov 19, 2015 at 11:29 AM, Santosh Marella 
wrote:

> There is an executor timeout setting for mesos slave. Default is 1 min
> IIRC. Please increase that to, say, 5 minutes.
>
> MapR will fix the local volume creation script to be faster.
>
> --
> Sent from mobile
> On Nov 19, 2015 9:13 AM, "John Omernik"  wrote:
>
> > Is there a setting for Nodemanager startup timeout? Some of my nodes are
> on
> > really rough boxes, and the time for the MapR local volume script to
> start
> > is taking too long (I think) and the task is failing without an exit code
> > or anything. I am "thinking" it's a timeout thing, because neither the
> mapr
> > volume script, nor yarn is returning any sort of error codes.
> >
>

Re: [VOTE] Release Apache Myriad 0.1.0 (incubating)

[Jim Klucar]

I have a script that pulls all the licenses from the node stuff. I guess we
only need the ones delivered, not the ones pulled down to make the build.
(Like gulp)

On Thursday, November 19, 2015, Santosh Marella 
wrote:

> Incorporated feedback from IPMC and submitted a PR for review [1].
>
> @Justin - it'll be great if you can review the PR as well. Thanks!
>
> [1] https://github.com/apache/incubator-myriad/pull/49
>
> Santosh
>
> On Thu, Nov 19, 2015 at 1:02 AM, Santosh Marella  >
> wrote:
>
> > Great. Thanks once again! We'll try to get the necessary changes
> > incorporated and prepare a new RC ASAP.
> >
> > Santosh
> >
> > On Thu, Nov 19, 2015 at 12:56 AM, Justin Mclean <
> jus...@classsoftware.com >
> > wrote:
> >
> >> Hi,
> >>
> >> > I didn't understand what's not correct in the appendix part of the
> >> LICENSE.
> >> > I compared the appendix section with that from the stock, and couldn't
> >> spot
> >> > a difference. Can you please clarify?
> >>
> >> Yep the text should be this:
> >>Copyright [] [name of copyright owner]
> >>
> >> Not this:
> >>   Copyright 2012-present Apache Software Foundation
> >>
> >> Just replace the whole file with the official version here [1].
> >>
> >> Thanks,
> >> Justin
> >>
> >> 1. http://www.apache.org/licenses/LICENSE-2.0.txt
> >>
> >>
> >>
> >
>

Re: [VOTE] Release Apache Myriad 0.1.0 (incubating)

[Santosh Marella]

I think so too.

--
Sent from mobile
On Nov 19, 2015 4:14 PM, "Jim Klucar"  wrote:

> I have a script that pulls all the licenses from the node stuff. I guess we
> only need the ones delivered, not the ones pulled down to make the build.
> (Like gulp)
>
> On Thursday, November 19, 2015, Santosh Marella 
> wrote:
>
> > Incorporated feedback from IPMC and submitted a PR for review [1].
> >
> > @Justin - it'll be great if you can review the PR as well. Thanks!
> >
> > [1] https://github.com/apache/incubator-myriad/pull/49
> >
> > Santosh
> >
> > On Thu, Nov 19, 2015 at 1:02 AM, Santosh Marella  > >
> > wrote:
> >
> > > Great. Thanks once again! We'll try to get the necessary changes
> > > incorporated and prepare a new RC ASAP.
> > >
> > > Santosh
> > >
> > > On Thu, Nov 19, 2015 at 12:56 AM, Justin Mclean <
> > jus...@classsoftware.com >
> > > wrote:
> > >
> > >> Hi,
> > >>
> > >> > I didn't understand what's not correct in the appendix part of the
> > >> LICENSE.
> > >> > I compared the appendix section with that from the stock, and
> couldn't
> > >> spot
> > >> > a difference. Can you please clarify?
> > >>
> > >> Yep the text should be this:
> > >>Copyright [] [name of copyright owner]
> > >>
> > >> Not this:
> > >>   Copyright 2012-present Apache Software Foundation
> > >>
> > >> Just replace the whole file with the official version here [1].
> > >>
> > >> Thanks,
> > >> Justin
> > >>
> > >> 1. http://www.apache.org/licenses/LICENSE-2.0.txt
> > >>
> > >>
> > >>
> > >
> >
>

Re: [VOTE] Release Apache Myriad 0.1.0 (incubating)

[Justin Mclean]

Hi,

> @Justin - it'll be great if you can review the PR as well. Thanks!
> 
> [1] https://github.com/apache/incubator-myriad/pull/49 
> 
Looks good to me.

Thanks,
Justin

Re: [VOTE] Release Apache Myriad 0.1.0 (incubating)

[Santosh Marella]

Incorporated feedback from IPMC and submitted a PR for review [1].

@Justin - it'll be great if you can review the PR as well. Thanks!

[1] https://github.com/apache/incubator-myriad/pull/49

Santosh

On Thu, Nov 19, 2015 at 1:02 AM, Santosh Marella 
wrote:

> Great. Thanks once again! We'll try to get the necessary changes
> incorporated and prepare a new RC ASAP.
>
> Santosh
>
> On Thu, Nov 19, 2015 at 12:56 AM, Justin Mclean 
> wrote:
>
>> Hi,
>>
>> > I didn't understand what's not correct in the appendix part of the
>> LICENSE.
>> > I compared the appendix section with that from the stock, and couldn't
>> spot
>> > a difference. Can you please clarify?
>>
>> Yep the text should be this:
>>Copyright [] [name of copyright owner]
>>
>> Not this:
>>   Copyright 2012-present Apache Software Foundation
>>
>> Just replace the whole file with the official version here [1].
>>
>> Thanks,
>> Justin
>>
>> 1. http://www.apache.org/licenses/LICENSE-2.0.txt
>>
>>
>>
>

Last weird issue

[John Omernik]

So my last weird issue may be a MapR specific issue, but I wanted to lay it
out here because it's odd. If you recall, I was talking about the mapr.host
not being correct and that was causing some "issues" in that when the
nodemanager tried to run, it would use the wrong hostname for the locality
of the shuffle volumes.  I addressed that specific issue with setting the
mapr.host to be the hostname using

yarnEnvironment:

  YARN_HOME: hadoop-2.7.0

  YARN_NODEMANAGER_OPTS: "-Dnodemanager.resource.io-spindles=4.0
-Dmapr.host=$(hostname -f)"


in the Myriad config. This runs the hostname -f command and sets the
mapr.host to be correct at run time.

The weird thing is was that while the resourcemanager.hostname is correct
from my yarn-site.xml


yarn.resourcemanager.hostname myriad.marathon.mesos - yarn-site.xml


There were a number of settings that were using the hostname of my box (and
I found it came from the mapr.host through some testing, when I saw it it
was using hostname -f, I ran it once with just hostname, and no FQDN in
this setup, therefore these items are using mapr.host)  that are related to
the resource manager.

Looking below, you can see that resourcemanager.address,
resourcemanager.scheduler.address, resourcemanager.admin.address,
resourcemanager.resource-tracker.address all seem to be being filled AFTER
I set the the mapr.host,


Yet, if you look at
https://hadoop.apache.org/docs/r2.7.0/hadoop-yarn/hadoop-yarn-common/yarn-default.xml
it states that it should be using
yarn.resourcemanager.admin.address${yarn.resourcemanager.hostname}:8033

yarn.resourcemanager.hostname (I believe all of these settings are like
this) for the settings, yet it's obviously using mapr.host instead.  What
components would be setting this? Overwriting the default?  mapr.host is
weird in that it's mapr only, but I thought I addressed that, and you can
see that the conf shows yarn.resourcemanager.hostname to be correct, thus I
am at loss here.

In addition, the other strange thing is my node managers are working, I am
not sure where these settings may hurt me, but I don't like that that they
are obviously RM settings using the NM hostname, and while I don't see
errors now, I am sure there will be errors at some point.

Any thoughts on this would be welcome.

Settings: (Note: UB stands for Ubuntu, it's which of my boxes this setting
came from)

The format is


name

UB: value - source


yarn.resourcemanager.address

UB: hadoopmapr5:8032 - programatically

yarn.resourcemanager.hostname

UB: myriad.marathon.mesos - yarn-site.xml

yarn.resourcemanager.scheduler.address

UB: hadoopmapr5:8030 - programatically

mapr.host

UB: hadoopmapr5.brewingintel.com -

yarn.resourcemanager.admin.address

UB: hadoopmapr5:8033 - programatically

yarn.resourcemanager.resource-tracker.address

UB: hadoopmapr5:8031 - programatically

Re: Struggling with Permissions

[yuliya Feldman]

You mean that if you enable cgroups in yarn /tmp as a slave temp dir works just 
fine?
  From: John Omernik 
 To: dev@myriad.incubator.apache.org; yuliya Feldman  
 Sent: Thursday, November 19, 2015 8:02 AM
 Subject: Re: Struggling with Permissions
   
Ok all I now have a real answer and a solution to the needing to change
/tmp locations in Mesos Slaves.

Basically, it wasn't a difference between Redhat and Ubuntu, it was a
mistake I made in my yarn-site.xml for the resource manager.  Basically I
copied the yarn-site from the wiki but on one I had uncommented the cgroups
section. My hypothesis: when running with Cgroups information, Yarn doesn't
see the /tmp and it's permissions, therefore creating the tgz with the
script I posted earlier works.  The permissions are what Yarn requires.
Once I set that on my Redhat cluster, all was well.  I realized that in
comparing configs.  That addresses most of my concerns, and I recommend
people use that where possible to avoid the Mesos Slave changes.  We also
may want to do some notes in the wiki around this, but I found it through
hacking, and I'd welcome more "from a point of view of understanding"
comments, I just made it work :)

I'll send another email shortly on my last issue.

On Wed, Nov 18, 2015 at 3:16 PM, John Omernik  wrote:

> Baffling... so as I said, I fixed the mapr.host that works well (as long
> as I have one NM per physical node) and I got my Ubuntu based Mesos cluster
> to work with Myriad.  At this point I am baffled on why Myriad/Yarn would
> complain about permissions on Redhat but not Ubuntu, below I've pulled
> files in /, /hadoop-2.7.0, /hadoop-2.7.0/bin and down the etc tree so you
> can see how they are setup the same. I am running as the same users in
> marathon etc. Same myriad configs... but I am getting the permissions issue
> for Redhat, and Ubuntu is working fine (and more than just getting the NMs
> running, I flexed up 6 NMs and was running hive queries with no issues!)
>
> The only differences I can see is that the java versions are different
> (1.8.0_45 for Ubuntu and 1.8.0_65 for Redhat) and the apparently the builds
> of hadoop-2.7.0 are different from MapR. (They are different in size as
> well, but that may be the difference between a RPM Redhat install and a
> Debian Ubuntu install, I guess I didn't expect different hadoop builds
> between platforms though...)
>
> If you can see anything else, please let me know, I'd love to have this
> working.
>
> John
>
>
> Here are the dumps:  Ubuntu... this is working:
>
> STARTUP_MSG:  build = g...@github.com:mapr/private-hadoop-common.git -r
> fc95119f587541fb3a9af0dbeeed23c974178115; compiled by 'root' on
> 2015-08-19T20:02Z
> STARTUP_MSG:  java = 1.8.0_45-internal
>
> No Error
> Ubuntu
>
> marathon user: mapr
> myriadframeuser: mapr
> myriadsuperuser: mapr
>
> /
> drwxr-xr-x 10 mapr mapr 4 KB Sep 10 14:40 hadoop-2.7.0
> -rw-r--r-- 1 mapr mapr 77 KB Nov 18 12:48 conf
> -rw-r--r-- 1 mapr mapr 282 MB Nov 18 12:48 hadoop-2.7.0.tgz
> -rw-r--r-- 1 mapr mapr 156 KB Nov 18 14:04 stderr
> -rw-r--r-- 1 mapr mapr 743 B Nov 18 12:48 stdout
>
> /hadoop-2.7.0/
>
> drwxrwxrwx 3 mapr root 4 KB Nov 18 12:48 logs
> drwxr-xr-x 2 mapr root 4 KB Sep 10 14:40 bin
> drwxr-xr-x 3 mapr root 4 KB Sep 10 14:40 etc
> drwxr-xr-x 2 mapr root 4 KB Sep 10 14:40 include
> drwxr-xr-x 3 mapr root 4 KB Sep 10 14:40 lib
> drwxr-xr-x 2 mapr root 4 KB Sep 10 14:40 libexec
> drwxr-xr-x 2 mapr root 4 KB Sep 10 14:40 sbin
> drwxr-xr-x 4 mapr root 4 KB Sep 10 14:40 share
> -rw-r--r-- 1 mapr root 15 KB Jul 09 04:36 LICENSE.txt
> -rw-r--r-- 1 mapr root 101 B Jul 09 04:36 NOTICE.txt
> -rw-r--r-- 1 mapr root 1 KB Jul 09 04:36
>
> /hadoop-2.7.0/bin
>
> -rwxr-xr-x 1 mapr root 9 KB Jul 09 04:36 hadoop
> -rwxr-xr-x 1 mapr root 10 KB Jul 09 04:36 hadoop.cmd
> -rwxr-xr-x 1 mapr root 12 KB Jul 09 04:36 hdfs
> -rwxr-xr-x 1 mapr root 7 KB Jul 09 04:36 hdfs.cmd
> -rwxr-xr-x 1 mapr root 7 KB Jul 09 04:36 mapred
> -rwxr-xr-x 1 mapr root 6 KB Jul 09 04:36 mapred.cmd
> -rwxr-xr-x 1 mapr root 2 KB Jul 09 04:36 rcc
> -rwxr-xr-x 1 mapr root 172 KB Jul 09 04:36 test-container-executor
> -rwxr-xr-x 1 mapr root 14 KB Jul 09 04:36 yarn
> -rwxr-xr-x 1 mapr root 11 KB Jul 09 04:36 yarn.cmd
> r-x--- 1 root mapr 140 KB Jul 09 04:36 container-executor
>
> /hadoop-2.7.0/etc
>
> drwxr-xr-x 2 mapr root 4 KB Nov 18 12:48 hadoop
>
> /hadoop-2.7.0/etc/hadoop/
>
> rw-r--r-- 1 mapr root 4 KB Jul 09 04:36 capacity-scheduler.xml
> -rw-r--r-- 1 mapr root 1 KB Jul 09 04:36 configuration.xsl
> -rw-r--r-- 1 root root 168 B Oct 06 08:37 container-executor.cfg
> -rw-r--r-- 1 mapr root 775 B Oct 06 08:37 core-site.xml
> -rw-r--r-- 1 mapr root 631 B Jul 09 04:36 fair-scheduler.xml
> -rw-r--r-- 1 mapr root 4 KB Jul 09 04:36 hadoop-env.cmd
> -rw-r--r-- 1 mapr root 4 KB Jul 09 04:36 hadoop-env.sh
> -rw-r--r-- 1 mapr root 2 KB Jul 09 04:36 hadoop-metrics.properties
> -rw-r--r-- 1 mapr root 3 KB Jul 09 04:36 

[VOTE] Release apache-myriad-0.1.0-incubating (release candidate 3)

[Santosh Marella]

Hi All,

Firstly, thanks everyone for the valuable contributions to the project and
for holding on tight as we move along the release process. We're almost
home!

I have created a source tar ball for Apache Myriad 0.1.0-incubating,
release candidate 3. This includes the feedback from the recent IPMC
voting.
Here’s the release notes:
https://cwiki.apache.org/confluence/display/MYRIAD/Release+Notes

The commit to be voted upon is tagged with "myriad-0.1.0-incubating-rc3"
and is available here:
https://git-wip-us.apache.org/repos/asf?p=incubator-myriad.git;a=shortlog;h=refs/tags/myriad-0.1.0-incubating-rc3

The artifacts to be voted upon are located below. Please note that this is
a source release:
https://dist.apache.org/repos/dist/dev/incubator/myriad/myriad-0.1.0-incubating-rc3/

Release artifacts are signed with the following key:
https://people.apache.org/keys/committer/smarella.asc

**Please note that the release tar ball does not include the gradlew script
to build. You need to generate one in order to build.**

Please try out the release candidate and vote. The vote is open for a
minimum of 72 hours or until the necessary number of votes (3 binding +1s)
is reached.

If/when this vote succeeds, I will call for a vote with IPMC seeking
permission to release RC3 as Apache Myriad 0.1.0 (incubating).

[ ] +1 Release this package as Apache Myriad 0.1.0-incubating
[ ]  0 I don't feel strongly about it, but I'm okay with the release
[ ] -1 Do not release this package because...

Thanks,
Santosh

Nodemanager Startup Timeout

[John Omernik]

Is there a setting for Nodemanager startup timeout? Some of my nodes are on
really rough boxes, and the time for the MapR local volume script to start
is taking too long (I think) and the task is failing without an exit code
or anything. I am "thinking" it's a timeout thing, because neither the mapr
volume script, nor yarn is returning any sort of error codes.

Re: Struggling with Permissions

[John Omernik]

Yes, but only in the yarn-site.xml, I have not set cgroups: true in the
myriad config, so I am not sure the relationship there...



On Thu, Nov 19, 2015 at 10:33 AM, yuliya Feldman <
yufeld...@yahoo.com.invalid> wrote:

> You mean that if you enable cgroups in yarn /tmp as a slave temp dir works
> just fine?
>   From: John Omernik 
>  To: dev@myriad.incubator.apache.org; yuliya Feldman 
>  Sent: Thursday, November 19, 2015 8:02 AM
>  Subject: Re: Struggling with Permissions
>
> Ok all I now have a real answer and a solution to the needing to change
> /tmp locations in Mesos Slaves.
>
> Basically, it wasn't a difference between Redhat and Ubuntu, it was a
> mistake I made in my yarn-site.xml for the resource manager.  Basically I
> copied the yarn-site from the wiki but on one I had uncommented the cgroups
> section. My hypothesis: when running with Cgroups information, Yarn doesn't
> see the /tmp and it's permissions, therefore creating the tgz with the
> script I posted earlier works.  The permissions are what Yarn requires.
> Once I set that on my Redhat cluster, all was well.  I realized that in
> comparing configs.  That addresses most of my concerns, and I recommend
> people use that where possible to avoid the Mesos Slave changes.  We also
> may want to do some notes in the wiki around this, but I found it through
> hacking, and I'd welcome more "from a point of view of understanding"
> comments, I just made it work :)
>
> I'll send another email shortly on my last issue.
>
> On Wed, Nov 18, 2015 at 3:16 PM, John Omernik  wrote:
>
> > Baffling... so as I said, I fixed the mapr.host that works well (as long
> > as I have one NM per physical node) and I got my Ubuntu based Mesos
> cluster
> > to work with Myriad.  At this point I am baffled on why Myriad/Yarn would
> > complain about permissions on Redhat but not Ubuntu, below I've pulled
> > files in /, /hadoop-2.7.0, /hadoop-2.7.0/bin and down the etc tree so you
> > can see how they are setup the same. I am running as the same users in
> > marathon etc. Same myriad configs... but I am getting the permissions
> issue
> > for Redhat, and Ubuntu is working fine (and more than just getting the
> NMs
> > running, I flexed up 6 NMs and was running hive queries with no issues!)
> >
> > The only differences I can see is that the java versions are different
> > (1.8.0_45 for Ubuntu and 1.8.0_65 for Redhat) and the apparently the
> builds
> > of hadoop-2.7.0 are different from MapR. (They are different in size as
> > well, but that may be the difference between a RPM Redhat install and a
> > Debian Ubuntu install, I guess I didn't expect different hadoop builds
> > between platforms though...)
> >
> > If you can see anything else, please let me know, I'd love to have this
> > working.
> >
> > John
> >
> >
> > Here are the dumps:  Ubuntu... this is working:
> >
> > STARTUP_MSG:  build = g...@github.com:mapr/private-hadoop-common.git -r
> > fc95119f587541fb3a9af0dbeeed23c974178115; compiled by 'root' on
> > 2015-08-19T20:02Z
> > STARTUP_MSG:  java = 1.8.0_45-internal
> >
> > No Error
> > Ubuntu
> >
> > marathon user: mapr
> > myriadframeuser: mapr
> > myriadsuperuser: mapr
> >
> > /
> > drwxr-xr-x 10 mapr mapr 4 KB Sep 10 14:40 hadoop-2.7.0
> > -rw-r--r-- 1 mapr mapr 77 KB Nov 18 12:48 conf
> > -rw-r--r-- 1 mapr mapr 282 MB Nov 18 12:48 hadoop-2.7.0.tgz
> > -rw-r--r-- 1 mapr mapr 156 KB Nov 18 14:04 stderr
> > -rw-r--r-- 1 mapr mapr 743 B Nov 18 12:48 stdout
> >
> > /hadoop-2.7.0/
> >
> > drwxrwxrwx 3 mapr root 4 KB Nov 18 12:48 logs
> > drwxr-xr-x 2 mapr root 4 KB Sep 10 14:40 bin
> > drwxr-xr-x 3 mapr root 4 KB Sep 10 14:40 etc
> > drwxr-xr-x 2 mapr root 4 KB Sep 10 14:40 include
> > drwxr-xr-x 3 mapr root 4 KB Sep 10 14:40 lib
> > drwxr-xr-x 2 mapr root 4 KB Sep 10 14:40 libexec
> > drwxr-xr-x 2 mapr root 4 KB Sep 10 14:40 sbin
> > drwxr-xr-x 4 mapr root 4 KB Sep 10 14:40 share
> > -rw-r--r-- 1 mapr root 15 KB Jul 09 04:36 LICENSE.txt
> > -rw-r--r-- 1 mapr root 101 B Jul 09 04:36 NOTICE.txt
> > -rw-r--r-- 1 mapr root 1 KB Jul 09 04:36
> >
> > /hadoop-2.7.0/bin
> >
> > -rwxr-xr-x 1 mapr root 9 KB Jul 09 04:36 hadoop
> > -rwxr-xr-x 1 mapr root 10 KB Jul 09 04:36 hadoop.cmd
> > -rwxr-xr-x 1 mapr root 12 KB Jul 09 04:36 hdfs
> > -rwxr-xr-x 1 mapr root 7 KB Jul 09 04:36 hdfs.cmd
> > -rwxr-xr-x 1 mapr root 7 KB Jul 09 04:36 mapred
> > -rwxr-xr-x 1 mapr root 6 KB Jul 09 04:36 mapred.cmd
> > -rwxr-xr-x 1 mapr root 2 KB Jul 09 04:36 rcc
> > -rwxr-xr-x 1 mapr root 172 KB Jul 09 04:36 test-container-executor
> > -rwxr-xr-x 1 mapr root 14 KB Jul 09 04:36 yarn
> > -rwxr-xr-x 1 mapr root 11 KB Jul 09 04:36 yarn.cmd
> > r-x--- 1 root mapr 140 KB Jul 09 04:36 container-executor
> >
> > /hadoop-2.7.0/etc
> >
> > drwxr-xr-x 2 mapr root 4 KB Nov 18 12:48 hadoop
> >
> > /hadoop-2.7.0/etc/hadoop/
> >
> > rw-r--r-- 1 mapr root 4 KB Jul 09 04:36 capacity-scheduler.xml
> > -rw-r--r-- 1 mapr root 1 KB Jul 09 04:36