[jira] [Created] (HADOOP-7582) mvn eclipse:eclipse doesn't add generated-test-sources to build path for eclipse

mvn eclipse:eclipse doesn't add generated-test-sources to build path for eclipse Key: HADOOP-7582 URL: https://issues.apache.org/jira/browse/HADOOP-7582 Project: Hadoop

[jira] [Created] (HADOOP-7583) mvn -Ptar and -Pbintar are broken

mvn -Ptar and -Pbintar are broken - Key: HADOOP-7583 URL: https://issues.apache.org/jira/browse/HADOOP-7583 Project: Hadoop Common Issue Type: Bug Reporter: Arun C Murthy Priority:

Build failed in Jenkins: Hadoop-Common-trunk #139

See https://builds.apache.org/job/Hadoop-Common-trunk/139/changes Changes: [sharad] MAPREDUCE-2807. Fix AM restart and client redirection. Contributed by Sharad Agarwal. [acmurthy] HADOOP-7560. Change src layout to be heirarchical. Contributed by Alejandro Abdelnur. [acmurthy] HADOOP-7560.

Any related paper on how to resolve hadoop SPOF issue?

Hi guys, We are currently in the process of writing a paper regarding hadoop and we would like to reference any attempt to remove the single point of failure of the Namenode. We have found in various presentations some efforts (like dividing the namespace between more than one namenodes if

Re: Any related paper on how to resolve hadoop SPOF issue?

Hope it helps http://www.springerlink.com/content/h17r882710314147/ Best, Nan On Thu, Aug 25, 2011 at 5:43 PM, George Kousiouris gkous...@mail.ntua.grwrote: Hi guys, We are currently in the process of writing a paper regarding hadoop and we would like to reference any attempt to remove

Re: Any related paper on how to resolve hadoop SPOF issue?

Hi, Community started working on NameNode High availabily. you can refer : https://issues.apache.org/jira/browse/HDFS-1623 regards, Uma - Original Message - From: George Kousiouris gkous...@mail.ntua.gr Date: Thursday, August 25, 2011 3:15 pm Subject: Any related paper on how to

Re: Any related paper on how to resolve hadoop SPOF issue?

Hi, many thanks!! I also found this one, which has some related work also with other efforts, in case it is helpful for someone else: https://ritdml.rit.edu/bitstream/handle/1850/13321/ATalwalkarThesis1-2011.pdf?sequence=1 BR, George On 8/25/2011 12:46 PM, Nan Zhu wrote: Hope it helps

[jira] [Resolved] (HADOOP-7583) mvn -Ptar and -Pbintar are broken

[ https://issues.apache.org/jira/browse/HADOOP-7583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Abdelnur resolved HADOOP-7583. Resolution: Invalid As per Thomas' comment, use '-Pdist' (to create layout only)

Question about invoking an executable from Hadoop mapper

I think this should be a common use case. I'm trying to invoke an executable from my mapper. Because my executable takes steaming input, I used something like the following: String lCmdStr = hadoop dfs -cat file | myExec; Process lChldProc = Runtime.getRuntime().exec(lCmdStr); All executable

[jira] [Reopened] (HADOOP-7583) mvn -Ptar and -Pbintar are broken

[ https://issues.apache.org/jira/browse/HADOOP-7583?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Yang reopened HADOOP-7583: --- Please use -Ptar to activate -Pdist and build tarball mvn -Ptar and -Pbintar are broken

Re: Question about invoking an executable from Hadoop mapper

I think this is a java issue. I don't think that it is launching a shell to run your command. I think it is just splitting on white space and then passing all the args to hadoop. What you want to do is to run sh -e 'hadoop dfs -cat file| myExec' Or with streaming white a small shell script

[jira] [Resolved] (HADOOP-7581) Update asf-mailer.conf for moved trees

[ https://issues.apache.org/jira/browse/HADOOP-7581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arun C Murthy resolved HADOOP-7581. --- Resolution: Fixed Thanks for committing this Ian. Update asf-mailer.conf for moved trees

Build failed in Jenkins: Hadoop-Common-trunk #140

See https://builds.apache.org/job/Hadoop-Common-trunk/140/changes Changes: [mahadev] MAPREDUCE-2877. Add missing Apache license header in some files in MR and also add the rat plugin to the poms. (mahadev) [szetszwo] Setup svn:ignore in hadoop-auth. --

Build failed in Jenkins: Hadoop-Common-trunk #141

See https://builds.apache.org/job/Hadoop-Common-trunk/141/ -- [...truncated 9866 lines...] Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.244 sec Running org.apache.hadoop.ipc.TestRPC Tests run: 8, Failures: 0, Errors: 0, Skipped: 0,

Re: Any related paper on how to resolve hadoop SPOF issue?

Hi George, UC Santa Cruz contributed a ;login: article describing replacing HDFS with Ceph. (I was one of the authors.) One of the key architectural advantages of Ceph over HDFS is that Ceph distributes its metadata service over multiple metadata servers. I hope that helps. --Alex On Aug

RE: Question about invoking an executable from Hadoop mapper

A shell script actually worked great! Thanks so much! Grace -Original Message- From: Robert Evans [mailto:ev...@yahoo-inc.com] Sent: Thursday, August 25, 2011 11:32 AM To: common-dev@hadoop.apache.org Subject: Re: Question about invoking an executable from Hadoop mapper I think this is

Build failed in Jenkins: Hadoop-Common-trunk #142

See https://builds.apache.org/job/Hadoop-Common-trunk/142/changes Changes: [mahadev] HADOOP-7578. Fix test-patch to be able to run on MR patches. (mahadev and tom white) [acmurthy] MAPREDUCE-2879. Fix version for MR-279 to 0.23.0. [acmurthy] MAPREDUCE-2796. Set start times for MR applications

Re: Hadoop 21.1, appends maintenance, roadmap?

The problem is that the 0.20.2xx releases are neither a superset or subset of the 0.21 release. In many ways, the 0.20.2xx.y releases would be better named as 1.x.y. This confused me totally. Is the thinking to make 0.20.2xx.y as 1.x.y or is it 0.23.x which will become 1.x.y ? - milind

[jira] [Resolved] (HADOOP-7163) java.net.SocketTimeoutException: 60000 millis timeout happens a lot

[ https://issues.apache.org/jira/browse/HADOOP-7163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Owen O'Malley resolved HADOOP-7163. --- Resolution: Fixed java.net.SocketTimeoutException: 6 millis timeout happens a lot

Re: Hadoop 21.1, appends maintenance, roadmap?

On Aug 25, 2011, at 1:07 PM, milind.bhandar...@emc.com milind.bhandar...@emc.com wrote: The problem is that the 0.20.2xx releases are neither a superset or subset of the 0.21 release. In many ways, the 0.20.2xx.y releases would be better named as 1.x.y. This confused me totally. Is

Jenkins build is back to normal : Hadoop-Common-trunk #143

See https://builds.apache.org/job/Hadoop-Common-trunk/143/changes

[jira] [Created] (HADOOP-7584) Truncate stack traces coming out of RPC

Truncate stack traces coming out of RPC --- Key: HADOOP-7584 URL: https://issues.apache.org/jira/browse/HADOOP-7584 Project: Hadoop Common Issue Type: Improvement Reporter: Todd Lipcon

[jira] [Reopened] (HADOOP-7559) Broken Link On Web Access Source View

[ https://issues.apache.org/jira/browse/HADOOP-7559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon reopened HADOOP-7559: - Codebase is somewhat migratory this week... reopening Broken Link On Web Access Source View

[VOTE] Should we release 0.20.204.0-rc3?

All, I've fixed the issues that Allen observed in the previous rc for 0.20.204 and rolled the new bundled up in http://people.apache.org/~omalley/hadoop-0.20.204.0-rc3 . Please download the tarball, compile it, and try it out. All of the tests pass, and I've run several 1TB sorts with

[jira] [Created] (HADOOP-7585) hadoop-config.sh should be changed to not rely on java6 behavior for classpath expansion since it breaks jsvc

hadoop-config.sh should be changed to not rely on java6 behavior for classpath expansion since it breaks jsvc - Key: HADOOP-7585 URL:

[jira] [Created] (HADOOP-7586) Hadoop daemon does not clean up pid file upon normal shutdown

Hadoop daemon does not clean up pid file upon normal shutdown - Key: HADOOP-7586 URL: https://issues.apache.org/jira/browse/HADOOP-7586 Project: Hadoop Common Issue Type: