unsubscribe

Re: YARN timelineserver process taking 600% CPU

Thanks Naga for your input, (I'm sorry for a late response, I was out for some time). So you believe that Spark is actually doing the PUTs? There are currently 8 Spark Streaming jobs constantly running, each 3 with 1 second batch, 5 x 10 s. I believe these are the jobs that publish to ATS. How

Unsubscribe

Unsubscribe

RE: Unsubscribe footer for user@h.a.o messages

+ 1 ( non-binding).. Nice thought,Arpit.. Thanks And RegardsBrahma Reddy Battula Subject: Re: Unsubscribe footer for user@h.a.o messages From: m...@hortonworks.com To: user@hadoop.apache.org Date: Thu, 5 Nov 2015 21:23:41 + +1 (non-binding) On Nov 5, 2015, at 12:50 PM,

Unsubscribe footer for user@h.a.o messages

Apache project mailing lists can add unsubscribe footers to messages. E.g. From spark-user. https://mail-archives.apache.org/mod_mbox/spark-user/201511.mbox/%3C5637830F.3070702%40uib.no%3E If no one objects I will file an INFRA ticket to add the footer to user@h.a.o. Unsubscribe requests are

Re: Unsubscribe footer for user@h.a.o messages

+1 Thank you, Arpit. --Chris Nauroth From: Arpit Agarwal > Reply-To: "user@hadoop.apache.org" > Date: Thursday, November 5, 2015 at 1:50 PM To:

Re: Unsubscribe footer for user@h.a.o messages

+1 (non-binding) On Nov 5, 2015, at 12:50 PM, Arpit Agarwal > wrote: Apache project mailing lists can add unsubscribe footers to messages. E.g. >From spark-user.

RE: YARN timelineserver process taking 600% CPU

Hi Krzysiek, There are currently 8 Spark Streaming jobs constantly running, each 3 with 1 second batch, 5 x 10 s. I believe these are the jobs that publish to ATS. How could I check what precisely is doing what or how to get some logs about it, I don't know... Not sure about the

build hadoop source code errors

HI all, build hadoop source cod have an error after clone hadoop from trunk branch of github.com . a commant is mvn package -Pdist,native,docs,src -DskipTests -Dtar on ubuntu:14.10 ppc64le os errors is below:Failed to execute goal

Re: build hadoop source code errors

it work , thank you ,very happy for submitting path . but I am a student, don’t know how to submit path , could you give me some docs about patch of hadoop project. > On Nov 6, 2015, at 14:03, Chris Nauroth wrote: > > Hello Zheng, > > This looks like the

RE: Unsubscribe footer for user@h.a.o messages

+1, Thanks Arpit -Vinay From: Brahma Reddy Battula [mailto:brahmareddy.batt...@hotmail.com] Sent: Friday, November 06, 2015 8:27 AM To: user@hadoop.apache.org Subject: RE: Unsubscribe footer for user@h.a.o messages + 1 ( non-binding).. Nice thought,Arpit.. Thanks And Regards Brahma Reddy

RE: hadoop not using whole disk for HDFS

For each configured dfs.datanode.data.dir , HDFS thinks its in separate partiotion and counts the capacity separately. So when another dir is added /hdfs/data, HDFS thinks new partition is added, So it increased the capacity 50GB per node. i.e. 100GB for 2 Nodes. Not allowing /home directory

RE: hadoop not using whole disk for HDFS

Hi Bob, I am suspecting Ambari would not be allowing to create a folder directly under /home, might be it will allow /home//hdfs, since directories under /home is expected to be users home dir. Regards, + Naga From: Naganarasimha G R (Naga)

Re: build hadoop source code errors

Hello Zheng, This looks like the FINDBUGS_HOME environment variable couldn't be expanded by Maven, likely because the environment variable is not defined. I have mine set to the base directory of my Findbugs 1.3.9 installation. > echo $FINDBUGS_HOME /Users/chris/findbugs-1.3.9 I expect

RE: hadoop not using whole disk for HDFS

Hi Bob, 1. I wasn’t able to set the config to /home/hdfs/data. I got an error that told me I’m not allowed to set that config to the /home directory. So I made it /hdfs/data. Naga : I am not sure about the HDP Distro but if you make it point to /hdfs/data, still it will be pointing to the

Re: Unsubscribe footer for user@h.a.o messages

Created https://issues.apache.org/jira/browse/INFRA-10725 From: Vinayakumar B > Reply-To: "user@hadoop.apache.org" > Date: Thursday, November 5, 2015

Re: hadoop not using whole disk for HDFS

Is there a maximum amount of disk space that HDFS will use? Is 100GB that max? When we’re supposed to be dealing with “big data” why is the amount of data to be held on any one box such a small number when you’ve got terabytes available? Adaryl "Bob" Wakefield, MBA Principal Mass Street

RE: hadoop not using whole disk for HDFS

Thanks Brahma, dint realize he might have configured both directories and i was assuming bob has configured single new directory "/hdfs/data". So virtually its showing additional space, manually try to add a data dir in /home, for your usecase, and restart datanodes. Not sure about the impacs in

Re: hadoop not using whole disk for HDFS

Please post: - output of df -h from every datanode in your cluster - what dfs.datanode.data.dir is currently set too -- Iain Wright This email message is confidential, intended only for the recipient(s) named above and may contain information that is privileged, exempt from disclosure under

Re: build hadoop source code errors

the doc is very useful for me ,But have some questions , 1 where BUILD.txt should be modify, 2 if modified BUILD.txt, then have a patch file ,how to test this patch? > On Nov 6, 2015, at 14:59, Chris Nauroth wrote: > > I'm glad to hear it helped. > > This

Re: build hadoop source code errors

I'm glad to hear it helped. This page describes the contribution process. https://wiki.apache.org/hadoop/HowToContribute For a documentation-only patch on BUILDING.txt, the process would be simplified, because a few steps like unit tests won't be applicable. --Chris Nauroth From: Zheng Huang

Re: unsubscribe

So, here's a cool thing we can do to these charming people that are too lazy to go and read a bit about a group that they so cheerfully joined: Create a rule in your e-mail client to reply "Why don't you read this: https://hadoop.apache.org/mailing_lists.html; It will be very right thing to do,

Re: unsubscribe

Welcome to human race.  You can bring a horse to water but you can't make it drink it. On Thursday, November 5, 2015 8:49 AM, Daniel Jankovic wrote: So, here's a cool thing we can do to these charming people that are too lazy to go and read a bit about a group

RE: unsubscribe

Unsubcribe From: mark charts [mailto:mcha...@yahoo.com] Sent: Thursday, November 05, 2015 8:54 AM To: user@hadoop.apache.org; wadood.chaudh...@instinet.com Subject: Re: unsubscribe Welcome to human race. You can bring a horse to water but you can't make it drink it. On Thursday, November 5,

Re: Unsubscribe

NO! On Thu, Nov 5, 2015 at 2:33 PM, Marian Swenson wrote: > unsubscribe >

Re: unsubscribe

Ok, this is not a joke... On Thu, Nov 5, 2015 at 3:06 PM Bourre, Marc < marc.bou...@ehealthontario.on.ca> wrote: > Unsubcribe > > > > *From:* mark charts [mailto:mcha...@yahoo.com] > *Sent:* Thursday, November 05, 2015 8:54 AM > *To:* user@hadoop.apache.org; wadood.chaudh...@instinet.com >