Re: Hadoop source code modification.

2016-11-19 Thread zhangjc
t > <https://github.com/apache/hadoop/blob/trunk/BUILDING.txt> > > > > Regards > Brahma Reddy Battula > > -Original Message- > From: Madhvaraj Shetty [mailto:madresearch2...@gmail.com > <mailto:madresearch2...@gmail.com>] > Sent: 15 November 2016 19

Re: Hadoop source code modification.

2016-11-18 Thread Madhvaraj Shetty
com/apache/hadoop/blob/trunk/BUILDING.txt >> >> >> >> Regards >> Brahma Reddy Battula >> >> -Original Message----- >> From: Madhvaraj Shetty [mailto:madresearch2...@gmail.com] >> Sent: 15 November 2016 19:36 >> To: gene...@hadoop.ap

RE: Hadoop source code modification.

2016-11-15 Thread Mallanagouda Patil
/hadoop/blob/trunk/BUILDING.txt > > > > Regards > Brahma Reddy Battula > > -Original Message- > From: Madhvaraj Shetty [mailto:madresearch2...@gmail.com] > Sent: 15 November 2016 19:36 > To: gene...@hadoop.apache.org > Subject: Hadoop source code modification.

RE: Hadoop source code modification.

2016-11-15 Thread Brahma Reddy Battula
: Madhvaraj Shetty [mailto:madresearch2...@gmail.com] Sent: 15 November 2016 20:27 To: Brahma Reddy Battula Subject: Re: Hadoop source code modification. Thank you so much sir Any links for understanding hadoop code and classes? Any quick way to debug OR any setup like eclipse.. to do these work

RE: Hadoop source code modification.

2016-11-15 Thread Brahma Reddy Battula
raj Shetty [mailto:madresearch2...@gmail.com] Sent: 15 November 2016 19:36 To: gene...@hadoop.apache.org Subject: Hadoop source code modification. Hello, I am working in the area of hadoop, especially i want to improve hadoop security. So i need procedure for modifying hadoop source code. I ha

Re: build hadoop source code errors

2015-11-06 Thread Zheng Huang
up...@gmail.com <mailto:bup...@gmail.com>> > Reply-To: "user@hadoop.apache.org <mailto:user@hadoop.apache.org>" > <user@hadoop.apache.org <mailto:user@hadoop.apache.org>> > Date: Friday, November 6, 2015 at 12:57 AM > To: "user@hadoop.apach

Re: build hadoop source code errors

2015-11-06 Thread Chris Nauroth
doop.apache.org<mailto:user@hadoop.apache.org>" <user@hadoop.apache.org<mailto:user@hadoop.apache.org>> Date: Friday, November 6, 2015 at 12:57 AM To: "user@hadoop.apache.org<mailto:user@hadoop.apache.org>" <user@hadoop.apache.org<mailto:user@hadoop.apache.org>&g

build hadoop source code errors

2015-11-05 Thread Zheng Huang
HI all, build hadoop source cod have an error after clone hadoop from trunk branch of github.com . a commant is mvn package -Pdist,native,docs,src -DskipTests -Dtar on ubuntu:14.10 ppc64le os errors is below:Failed to execute goal

Re: build hadoop source code errors

2015-11-05 Thread Zheng Huang
ail.com>> > Reply-To: "user@hadoop.apache.org <mailto:user@hadoop.apache.org>" > <user@hadoop.apache.org <mailto:user@hadoop.apache.org>> > Date: Thursday, November 5, 2015 at 10:19 PM > To: "user@hadoop.apache.org <mailto:user@hadoop.apache.org>&qu

Re: build hadoop source code errors

2015-11-05 Thread Chris Nauroth
oop.apache.org>" <user@hadoop.apache.org<mailto:user@hadoop.apache.org>> Date: Thursday, November 5, 2015 at 10:19 PM To: "user@hadoop.apache.org<mailto:user@hadoop.apache.org>" <user@hadoop.apache.org<mailto:user@hadoop.apache.org>> Subject: build hadoop s

Re: build hadoop source code errors

2015-11-05 Thread Zheng Huang
e.org>> > Date: Thursday, November 5, 2015 at 11:51 PM > To: "user@hadoop.apache.org <mailto:user@hadoop.apache.org>" > <user@hadoop.apache.org <mailto:user@hadoop.apache.org>> > Subject: Re: build hadoop source code errors > > it work , thank

Re: build hadoop source code errors

2015-11-05 Thread Chris Nauroth
ser@hadoop.apache.org>" <user@hadoop.apache.org<mailto:user@hadoop.apache.org>> Subject: Re: build hadoop source code errors it work , thank you ,very happy for submitting path . but I am a student, don't know how to submit path , could you give me some docs about patch

Hadoop source code in eclipse

2014-10-30 Thread mufc_fan
debug environment. Can anyone tell me how? -- View this message in context: http://hadoop-common.472056.n3.nabble.com/Hadoop-source-code-in-eclipse-tp4054803.html Sent from the Users mailing list archive at Nabble.com.

a question about hadoop source code repo

2014-05-12 Thread Libo Yu
Hi, Under hadoop-mapreduce-project directory, I notice the following two directories: 1hadoop-mapreduce-client/ 2src/ 2 src/ can be expanded to java/org/apache/hadoop/mapreduce My question is what the directory is for. And I wonder why mapreduce code is in hadoop-mapreduce-client.

hadoop source code

2014-03-24 Thread Avinash Kujur
hi, i downloaded the hadoop source code from github. after importing those files in eclipse some of the classes and packages are missing. And i am not able able to get those files online. help me out to get all the files once and some link for what are the files do i need to import eclipse

Re: hadoop source code

2014-03-24 Thread Azuryy Yu
Hi, you'd bettern check out from svn, then build with maven: mvn eclipse:eclipse, which will generate eclipse projects to you. On Mon, Mar 24, 2014 at 3:24 PM, Avinash Kujur avin...@gmail.com wrote: hi, i downloaded the hadoop source code from github. after importing those files in eclipse

Re: regarding hadoop source code

2014-03-11 Thread Avinash Kujur
after executing this command : mvn clean install i am getting this error. Failed tests: TestMetricsSystemImpl.testMultiThreadedPublish:232 expected:0 but was:5 TestNetUtils.testNormalizeHostName:617 null TestFsShellReturnCode.testGetWithInvalidSourcePathShouldNotDisplayNullInConsole:307

Re: regarding hadoop source code

2014-03-11 Thread Jian He
Those are just test failures, I suggest you skip the tests as you earlier did and do mvn clean install. On Tue, Mar 11, 2014 at 5:10 AM, Avinash Kujur avin...@gmail.com wrote: after executing this command : mvn clean install i am getting this error. Failed tests:

Re: regarding hadoop source code

2014-03-10 Thread Avinash Kujur
hi, i downloaded the code from https://github.com/apache/hadoop-common.git . but while executing the command mvn install -DskipTests its giving this error in between: [INFO] --- maven-compiler-plugin:2.5.1:compile (default-compile) @ hadoop-hdfs-httpfs --- [INFO] Compiling 56 source files to

Re: regarding hadoop source code

2014-03-10 Thread Oleg Zhurakousky
You must be using Java 1.5 or below where @Override is not allowed on any method that implements its counterpart from interface. Remember, both 1.5 and 1.6 are EOL, so I would suggest upgrading to 1.7. Oleg On Mon, Mar 10, 2014 at 10:49 AM, Avinash Kujur avin...@gmail.com wrote: hi, i

Re: unable to compile hadoop source code

2014-01-06 Thread Diego Gutierrez
El ene 6, 2014 10:48 PM, nagarjuna kanamarlapudi nagarjuna.kanamarlap...@gmail.com escribió: Hi, I checked out the source code from https://svn.apache.org/repos/asf/hadoop/common/trunk/ I tried to compile the code with mvn. I am compiling this on a mac os X , mavericks. Any help is

RE: unable to compile hadoop source code

2014-01-06 Thread Rohith Sharma K S
2014 09:18 To: user@hadoop.apache.org Subject: unable to compile hadoop source code Hi, I checked out the source code from https://svn.apache.org/repos/asf/hadoop/common/trunk/ I tried to compile the code with mvn. I am compiling this on a mac os X , mavericks. Any help is appreciated

Re: unable to compile hadoop source code

2014-01-06 Thread nagarjuna kanamarlapudi
*To:* user@hadoop.apache.org *Subject:* unable to compile hadoop source code Hi, I checked out the source code from https://svn.apache.org/repos/asf/hadoop/common/trunk/ I tried to compile the code with mvn. I am compiling this on a mac os X , mavericks. Any help is appreciated

Re: Error while running Hadoop Source Code

2013-11-09 Thread Basu,Indrashish
Any updates on this ? Regards, Indra On Thu, 07 Nov 2013 11:28:57 -0500, Basu,Indrashish wrote: Hi Vinod, Please find the below details requested: A) ALL OF THE TASKTRACKER LOG : Same what I have provided in the earlier email. B) THE TASK-LOGS : SYSLOG :

Re: Error while running Hadoop Source Code

2013-11-06 Thread Basu,Indrashish
Hi Vinod, Thanks for your help regarding this. I checked the task logs, this is what it is giving as output. 2013-11-06 06:40:05,541 INFO org.apache.hadoop.mapred.JvmManager: In JvmRunner constructed JVM ID: jvm_201311060636_0001_m_1100862588 2013-11-06 06:40:05,553 INFO

Re: Error while running Hadoop Source Code

2013-11-06 Thread Basu,Indrashish
Can anyone please assist regarding this ? Thanks in advance Regards, Indra On Wed, 06 Nov 2013 09:50:02 -0500, Basu,Indrashish wrote: Hi Vinod, Thanks for your help regarding this. I checked the task logs, this is what it is giving as output. 2013-11-06 06:40:05,541 INFO

Re: Error while running Hadoop Source Code

2013-11-06 Thread Vinod Kumar Vavilapalli
Don't see anything in the logs that you pasted. Can you paste the following in say pastebin? - All of the TaskTracker log - The task-logs. These are syslog, stderr, stdout files for a specific TaskAttempt. - And specific TaskAttempt's TaskAttemtpID that is failing. Thanks, +Vinod On Nov 6,

Re: Error while running Hadoop Source Code

2013-11-05 Thread Basu,Indrashish
Hi, Can anyone kindly assist on this ? Regards, Indrashish On Mon, 04 Nov 2013 10:23:23 -0500, Basu,Indrashish wrote: Hi All, Any update on the below post ? I came across some old post regarding the same issue. It explains the solution as The *nopipe* example needs more documentation.

Re: Error while running Hadoop Source Code

2013-11-05 Thread Vinod Kumar Vavilapalli
It seems like your pipes mapper is exiting before consuming all the input. Did you check the task-logs on the web UI? Thanks, +Vinod On Nov 5, 2013, at 7:25 AM, Basu,Indrashish wrote: Hi, Can anyone kindly assist on this ? Regards, Indrashish On Mon, 04 Nov 2013 10:23:23 -0500,

Re: Error while running Hadoop Source Code

2013-11-04 Thread Basu,Indrashish
Hi All, Any update on the below post ? I came across some old post regarding the same issue. It explains the solution as The *nopipe* example needs more documentation. It assumes that it is run with the InputFormat from src/test/org/apache/*hadoop*/mapred/*pipes*/

Error while running Hadoop Source Code

2013-10-31 Thread Basu,Indrashish
Hi, I am trying to run a sample Hadoop GPU source code (kmeans algorithm) on an ARM processor and getting the below error. Can anyone please throw some light on this ? rmr: cannot remove output: No such file or directory. 13/10/31 13:43:12 WARN mapred.JobClient: No job jar file set. User

HOW TO WORK WITH HADOOP SOURCE CODE

2013-02-10 Thread Dibyendu Karmakar
Hi, I am trying to view HADOOP SOURCE CODE. I am using HADOOP 1.0.3. In HADOOP distribution, only jar files are there. Give me some instruction to view source code... please I have seen contribute to hadoop page ( wiki.apache.org/hadoop/HowToContribute ) where something about git is written. I am

building Hadoop source code in Eclipse

2012-08-23 Thread susnata basak
Hi All, While trying to build hadoop source code in eclipse using maven following the instructions on - http://wiki.apache.org/hadoop/EclipseEnvironment I noticed that the project layout has changed in the latest development version, as such the instruction didn't quite match. I was wondering

Re: building Hadoop source code in Eclipse

2012-08-23 Thread Adam Berry
To: user@hadoop.apache.orgmailto:user@hadoop.apache.org user@hadoop.apache.orgmailto:user@hadoop.apache.org Subject: building Hadoop source code in Eclipse Hi All, While trying to build hadoop source code in eclipse using maven following the instructions on - http://wiki.apache.org/hadoop

Re: building Hadoop source code in Eclipse

2012-08-23 Thread Harsh J
@hadoop.apache.org user@hadoop.apache.org Subject: building Hadoop source code in Eclipse Hi All, While trying to build hadoop source code in eclipse using maven following the instructions on - http://wiki.apache.org/hadoop/EclipseEnvironment I noticed that the project layout has changed

RE: building Hadoop source code in Eclipse

2012-08-23 Thread susnata basak
Hey Harsh, I came across a video on building hadoop source code on cloudera site, but it was using Ant (on an older project layout). If you're able to use m2eclipse, would you like to make a similar video post or document it somewhere. The other issue I ran into - the unit tests weren't

how to read hadoop source code efficiently

2011-12-07 Thread 陈竞
hi, i am reading hadoop-0.23 source code, mainly focusing on hadoop yarn. However i have some problems in reading the source code. There is no Debugging tools for hadoop, so i can't track the code execution flow. Therefore i can't understand the code quickly since there are lots of overwirte,

Re: how to read hadoop source code efficiently

2011-12-07 Thread wang xin
Hi,Jing, you can run ant eclipse-files at command line.And then you can import it to your eclipse. I think you can read the code from JobTracker and TaskTracker .you can find the main() function in these class. 在 2011-12-8,下午1:50, 陈竞 写道: hi, i am reading hadoop-0.23 source code,

Re: how to read hadoop source code efficiently

2011-12-07 Thread 陈竞
my problem is that there are many definitions of one function, i can't get which function it really use even in eclipse , since there are many overwrite, so i want to track it. is there some tools like gdb in java for runing hadoop? 在 2011年12月8日 下午1:59,wang xin wangxin0072...@gmail.com写道:

Re: how to read hadoop source code efficiently

2011-12-07 Thread Harsh J
You can run daemons from within Eclipse in debugging mode -- you only need to launch the right main class (NameNode, DataNode, etc. for example). This is a feature of Eclipse. But distributed programming is best debugged with proper logging, if you can't afford running all the daemons and the

help with hadoop source code

2010-07-11 Thread Rahul.V.
Hi, Am trying to implement a small map reduce framework on another file system. A very elementary one at that. So I am trying to access the Hadoop source code for that. Where do I find it? -- Regards, R.V.

Re: help with hadoop source code

2010-07-11 Thread Ted Yu
to access the Hadoop source code for that. Where do I find it? -- Regards, R.V.

Re: help with hadoop source code

2010-07-11 Thread Rahul.V.
reduce framework on another file system. A very elementary one at that. So I am trying to access the Hadoop source code for that. Where do I find it? -- Regards, R.V. -- Regards, R.V.

How can I debug the hadoop source code within eclipse

2008-08-27 Thread li luo
Hi, All I am deploy hadoop in my Linux computer as a single-node environment.And everything running good.Now I want to follow the running step of hadoop job step by step in Eclipse.please tell me how I can do that? Thanks