svn commit: r571521 - in /lucene/hadoop/trunk: docs/credits.html docs/credits.pdf src/docs/src/documentation/content/xdocs/credits.xml

2007-08-31 Thread acmurthy
Author: acmurthy Date: Fri Aug 31 09:53:34 2007 New Revision: 571521 URL: http://svn.apache.org/viewvc?rev=571521&view=rev Log: Add Arun C Murthy to list of committers. Modified: lucene/hadoop/trunk/docs/credits.html lucene/hadoop/trunk/docs/credits.pdf lucene/hadoop/trunk/src/

svn commit: r573513 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/mapred/JobTracker.java

2007-09-07 Thread acmurthy
Author: acmurthy Date: Fri Sep 7 02:09:00 2007 New Revision: 573513 URL: http://svn.apache.org/viewvc?rev=573513&view=rev Log: HADOOP-1018. Improve documentation w.r.t handling of lost hearbeats between TaskTrackers and JobTracker. Modified: lucene/hadoop/trunk/CHANGES.txt lu

svn commit: r573708 - in /lucene/hadoop/trunk: ./ src/java/org/apache/hadoop/mapred/ src/webapps/job/

2007-09-07 Thread acmurthy
Author: acmurthy Date: Fri Sep 7 14:08:36 2007 New Revision: 573708 URL: http://svn.apache.org/viewvc?rev=573708&view=rev Log: HADOOP-1351. Add "bin/hadoop job [-fail-task|-kill-task]" sub-commands to terminate a particular task-attempt. Contributed by Enis Soztutar. Modifi

svn commit: r574888 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/mapred/TaskStatus.java

2007-09-12 Thread acmurthy
Author: acmurthy Date: Wed Sep 12 04:20:13 2007 New Revision: 574888 URL: http://svn.apache.org/viewvc?rev=574888&view=rev Log: HADOOP-1840. Fix race condition which leads to task's diagnostic messages getting lost. Modified: lucene/hadoop/trunk/CHANGES.txt lucene/hadoop/trunk

svn commit: r575889 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/mapred/JobTracker.java

2007-09-15 Thread acmurthy
Author: acmurthy Date: Sat Sep 15 00:55:27 2007 New Revision: 575889 URL: http://svn.apache.org/viewvc?rev=575889&view=rev Log: HADOOP-1892. Fix a NullPointerException in the JobTracker when trying to fetch a task's diagnostic messages from the JobClient. Modified: lucene/had

svn commit: r583408 - in /lucene/hadoop/trunk: ./ src/java/org/apache/hadoop/mapred/ src/webapps/job/

2007-10-10 Thread acmurthy
Author: acmurthy Date: Wed Oct 10 02:32:49 2007 New Revision: 583408 URL: http://svn.apache.org/viewvc?rev=583408&view=rev Log: HADOOP-1874. Move task-outputs' promotion/discard to a separate thread distinct from the main heartbeat-processing thread. The main upside being that we do

svn commit: r583937 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/mapred/JobTracker.java

2007-10-11 Thread acmurthy
Author: acmurthy Date: Thu Oct 11 12:50:23 2007 New Revision: 583937 URL: http://svn.apache.org/viewvc?rev=583937&view=rev Log: HADOOP-2022. Ensure that status information for successful tasks is correctly recorded at the JobTracker, so that, for example, one may view correct information

svn commit: r583945 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/mapred/TaskInProgress.java

2007-10-11 Thread acmurthy
Author: acmurthy Date: Thu Oct 11 13:27:47 2007 New Revision: 583945 URL: http://svn.apache.org/viewvc?rev=583945&view=rev Log: HADOOP-2031. Correctly maintain the taskid which takes the TIP to completion, failing which the case of lost tasktrackers isn't handled properly i.e. the ma

svn commit: r584187 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/mapred/TaskTracker.java

2007-10-12 Thread acmurthy
Author: acmurthy Date: Fri Oct 12 08:33:10 2007 New Revision: 584187 URL: http://svn.apache.org/viewvc?rev=584187&view=rev Log: HADOOP-2016. Ignore status-updates from FAILED/KILLED tasks at the TaskTracker. This fixes a race-condition which caused the tasks to wrongly remain in the RUN

svn commit: r586003 - in /lucene/hadoop/trunk: ./ src/java/org/apache/hadoop/mapred/pipes/

2007-10-18 Thread acmurthy
Author: acmurthy Date: Thu Oct 18 08:23:11 2007 New Revision: 586003 URL: http://svn.apache.org/viewvc?rev=586003&view=rev Log: HADOOP-2070. Added a flush method to pipes' DownwardProtocol and call that before waiting for the application to finish to ensure all buffered data is

svn commit: r586006 - in /lucene/hadoop/branches/branch-0.15: ./ src/java/org/apache/hadoop/mapred/pipes/

2007-10-18 Thread acmurthy
Author: acmurthy Date: Thu Oct 18 08:31:09 2007 New Revision: 586006 URL: http://svn.apache.org/viewvc?rev=586006&view=rev Log: Merge -r 586002:586003 from trunk to branch-0.15 to fix HADOOP-2070. Modified: lucene/hadoop/branches/branch-0.15/CHANGES.txt lucene/hadoop/branches/br

svn commit: r588168 - in /lucene/hadoop/trunk: CHANGES.txt src/webapps/job/jobdetails.jsp src/webapps/job/jobtasks.jsp

2007-10-25 Thread acmurthy
Author: acmurthy Date: Thu Oct 25 01:57:25 2007 New Revision: 588168 URL: http://svn.apache.org/viewvc?rev=588168&view=rev Log: HADOOP-1839. Link-ify the Pending/Running/Complete/Killed grid in jobdetails.jsp to help quickly narrow down and see categorized TIPs' details via jobtasks.j

svn commit: r588285 - in /lucene/hadoop/trunk: CHANGES.txt bin/hadoop-daemon.sh

2007-10-25 Thread acmurthy
Author: acmurthy Date: Thu Oct 25 10:30:36 2007 New Revision: 588285 URL: http://svn.apache.org/viewvc?rev=588285&view=rev Log: HADOOP-2100. Remove faulty check for existence of $HADOOP_PID_DIR and let 'mkdir -p' to check & create it. Contributed by Michael Bieniosek. Mo

svn commit: r588295 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/mapred/LocalJobRunner.java

2007-10-25 Thread acmurthy
Author: acmurthy Date: Thu Oct 25 10:56:40 2007 New Revision: 588295 URL: http://svn.apache.org/viewvc?rev=588295&view=rev Log: HADOOP-1642. Ensure jobids generated by LocalJobRunner are unique to avoid collissions and hence job-failures. Contributed by Doug Cutting. Modified: lu

svn commit: r588298 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/mapred/JobHistory.java src/webapps/job/jobconf.jsp

2007-10-25 Thread acmurthy
Author: acmurthy Date: Thu Oct 25 11:07:39 2007 New Revision: 588298 URL: http://svn.apache.org/viewvc?rev=588298&view=rev Log: HADOOP-2096. Close open file-descriptors held by streams while localizing job.xml in the JobTracker and while displaying it on the webui in jobconf.jsp. Contrib

svn commit: r588300 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/mapred/JobInProgress.java

2007-10-25 Thread acmurthy
Author: acmurthy Date: Thu Oct 25 11:16:58 2007 New Revision: 588300 URL: http://svn.apache.org/viewvc?rev=588300&view=rev Log: HADOOP-2098. Log start & completion of empty jobs to JobHistory, which also ensures that we close the file-descriptor of the job's history log opene

svn commit: r588600 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/conf/Configuration.java src/java/org/apache/hadoop/io/WritableComparable.java src/java/org/apache/hadoop/mapred/Ma

2007-10-26 Thread acmurthy
Author: acmurthy Date: Fri Oct 26 04:06:13 2007 New Revision: 588600 URL: http://svn.apache.org/viewvc?rev=588600&view=rev Log: HADOOP-2103. Fix minor javadoc bugs introduce by HADOOP-2046. Contributed by Nigel Daley. Modified: lucene/hadoop/trunk/CHANGES.txt lucene/hadoop/trunk

svn commit: r588602 - /lucene/hadoop/trunk/CHANGES.txt

2007-10-26 Thread acmurthy
Author: acmurthy Date: Fri Oct 26 04:10:51 2007 New Revision: 588602 URL: http://svn.apache.org/viewvc?rev=588602&view=rev Log: Moved the change-log for HADOOP-1857 to the 'NEW FEATURES' section from the 'IMPROVEMENTS' section. Modified: lucene/hadoop/trunk/CHANG

svn commit: r588778 - in /lucene/hadoop/trunk: CHANGES.txt src/java/overview.html

2007-10-26 Thread acmurthy
Author: acmurthy Date: Fri Oct 26 14:01:26 2007 New Revision: 588778 URL: http://svn.apache.org/viewvc?rev=588778&view=rev Log: HADOOP-2105. Improve overview.html to clarify supported platforms, software pre-requisites for hadoop, how to install them on various platforms and a better gen

svn commit: r589541 - in /lucene/hadoop/branches/branch-0.15: CHANGES.txt src/examples/org/apache/hadoop/examples/RandomWriter.java src/java/org/apache/hadoop/util/ToolBase.java

2007-10-29 Thread acmurthy
Author: acmurthy Date: Mon Oct 29 01:21:25 2007 New Revision: 589541 URL: http://svn.apache.org/viewvc?rev=589541&view=rev Log: Merge -r 589538:589539 from trunk to branch-0.15 to fix HADOOP-2102. Modified: lucene/hadoop/branches/branch-0.15/CHANGES.txt lucene/hadoop/branches/br

svn commit: r589539 - in /lucene/hadoop/trunk: CHANGES.txt src/examples/org/apache/hadoop/examples/RandomWriter.java src/java/org/apache/hadoop/util/ToolBase.java

2007-10-29 Thread acmurthy
Author: acmurthy Date: Mon Oct 29 01:17:56 2007 New Revision: 589539 URL: http://svn.apache.org/viewvc?rev=589539&view=rev Log: HADOOP-2102. Fix the deprecated ToolBase to pass its Configuration object to the superceding ToolRunner to ensure it picks up the appropriate configuration resou

svn commit: r589548 - /lucene/hadoop/trunk/CHANGES.txt

2007-10-29 Thread acmurthy
Author: acmurthy Date: Mon Oct 29 01:59:15 2007 New Revision: 589548 URL: http://svn.apache.org/viewvc?rev=589548&view=rev Log: Preparing to merge HADOOP-2103 into branch-0.15. Modified: lucene/hadoop/trunk/CHANGES.txt Modified: lucene/hadoop/trunk/CHANGES.txt URL: http://svn.apache

svn commit: r589543 - /lucene/hadoop/trunk/CHANGES.txt

2007-10-29 Thread acmurthy
Author: acmurthy Date: Mon Oct 29 01:36:15 2007 New Revision: 589543 URL: http://svn.apache.org/viewvc?rev=589543&view=rev Log: Preparing to merge HADOOP-2103 and HADOOP-2105 into branch-0.15. Modified: lucene/hadoop/trunk/CHANGES.txt Modified: lucene/hadoop/trunk/CHANGES.txt URL:

svn commit: r589555 - in /lucene/hadoop/branches/branch-0.15: CHANGES.txt src/java/overview.html

2007-10-29 Thread acmurthy
Author: acmurthy Date: Mon Oct 29 02:18:06 2007 New Revision: 589555 URL: http://svn.apache.org/viewvc?rev=589555&view=rev Log: Merge -r 588777:588778 and 589551:589552 from trunk to branch-0.15 to fix HADOOP-2105. Modified: lucene/hadoop/branches/branch-0.15/CHANGES.txt lucene/ha

svn commit: r589552 - /lucene/hadoop/trunk/CHANGES.txt

2007-10-29 Thread acmurthy
Author: acmurthy Date: Mon Oct 29 02:06:05 2007 New Revision: 589552 URL: http://svn.apache.org/viewvc?rev=589552&view=rev Log: Preparing to merge HADOOP-2105 into branch-0.15. Modified: lucene/hadoop/trunk/CHANGES.txt Modified: lucene/hadoop/trunk/CHANGES.txt URL: http://svn.apache

svn commit: r589547 - /lucene/hadoop/trunk/CHANGES.txt

2007-10-29 Thread acmurthy
Author: acmurthy Date: Mon Oct 29 01:56:59 2007 New Revision: 589547 URL: http://svn.apache.org/viewvc?rev=589547&view=rev Log: Reverting revision 589543. Modified: lucene/hadoop/trunk/CHANGES.txt Modified: lucene/hadoop/trunk/CHANGES.txt URL: http://svn.apache.org/viewvc/lucene/ha

svn commit: r589551 - in /lucene/hadoop/branches/branch-0.15: CHANGES.txt src/java/org/apache/hadoop/conf/Configuration.java src/java/org/apache/hadoop/io/WritableComparable.java src/java/org/apache/h

2007-10-29 Thread acmurthy
Author: acmurthy Date: Mon Oct 29 02:02:50 2007 New Revision: 589551 URL: http://svn.apache.org/viewvc?rev=589551&view=rev Log: Merge -r 588599:588600 and 589547:589548 from trunk to branch-0.15 to fix HADOOP-2103. Modified: lucene/hadoop/branches/branch-0.15/CHANGES.txt lucene/ha

svn commit: r589576 - in /lucene/hadoop/trunk: CHANGES.txt build.xml

2007-10-29 Thread acmurthy
Author: acmurthy Date: Mon Oct 29 03:23:31 2007 New Revision: 589576 URL: http://svn.apache.org/viewvc?rev=589576&view=rev Log: HADOOP-2112. Adding back changes to build.xml lost while reverting HADOOP-1622 i.e. http://svn.apache.org/viewvc?view=rev&revision=588771. Modified: lucen

svn commit: r592724 - in /lucene/hadoop/trunk: CHANGES.txt src/contrib/streaming/src/java/org/apache/hadoop/streaming/StreamXmlRecordReader.java src/contrib/streaming/src/test/org/apache/hadoop/stream

2007-11-07 Thread acmurthy
Author: acmurthy Date: Wed Nov 7 04:08:01 2007 New Revision: 592724 URL: http://svn.apache.org/viewvc?rev=592724&view=rev Log: HADOOP-2071. Fix StreamXmlRecordReader to use a BufferedInputStream wrapped over the DFSInputStream since mark/reset aren't supported by DFSInputStream

svn commit: r592857 - in /lucene/hadoop/trunk: ./ src/contrib/streaming/src/java/org/apache/hadoop/streaming/ src/contrib/streaming/src/test/org/apache/hadoop/streaming/

2007-11-07 Thread acmurthy
Author: acmurthy Date: Wed Nov 7 11:12:40 2007 New Revision: 592857 URL: http://svn.apache.org/viewvc?rev=592857&view=rev Log: HADOOP-1952. Improve handling of invalid, user-specified classes while configuring streaming jobs such as combiner, input/output formats etc. Now invalid options

svn commit: r592860 - in /lucene/hadoop/trunk: CHANGES.txt src/java/overview.html

2007-11-07 Thread acmurthy
Author: acmurthy Date: Wed Nov 7 11:26:37 2007 New Revision: 592860 URL: http://svn.apache.org/viewvc?rev=592860&view=rev Log: HADOOP-2134. Remove developer-centric requirements from overview.html and keep it end-user focussed, specifically sections related to subversion and building Ha

svn commit: r593743 - in /lucene/hadoop/trunk: CHANGES.txt src/c++/libhdfs/Makefile

2007-11-09 Thread acmurthy
Author: acmurthy Date: Fri Nov 9 23:07:35 2007 New Revision: 593743 URL: http://svn.apache.org/viewvc?rev=593743&view=rev Log: HADOOP-2169. Fix the DT_SONAME field of libhdfs.so to set it to the correct value of 'libhdfs.so', currently it is set to the absolute path of libhdfs.so

svn commit: r593746 - in /lucene/hadoop/branches/branch-0.15: ./ src/c++/pipes/api/hadoop/ src/c++/pipes/impl/ src/examples/pipes/impl/ src/native/src/org/apache/hadoop/io/compress/lzo/

2007-11-09 Thread acmurthy
Author: acmurthy Date: Fri Nov 9 23:20:22 2007 New Revision: 593746 URL: http://svn.apache.org/viewvc?rev=593746&view=rev Log: Merge -r 591120:591121 from trunk to branch-0.15 to fix HADOOP-2140 Modified: lucene/hadoop/branches/branch-0.15/CHANGES.txt lucene/hadoop/branches/branch-

svn commit: r593747 - in /lucene/hadoop/branches/branch-0.15: CHANGES.txt src/c++/libhdfs/Makefile

2007-11-09 Thread acmurthy
Author: acmurthy Date: Fri Nov 9 23:21:26 2007 New Revision: 593747 URL: http://svn.apache.org/viewvc?rev=593747&view=rev Log: Merge -r 593742:593743 from trunk to branch-0.15 to fix HADOOP-2169 Modified: lucene/hadoop/branches/branch-0.15/CHANGES.txt lucene/hadoop/branches/branch-

svn commit: r593748 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/util/CopyFiles.java

2007-11-09 Thread acmurthy
Author: acmurthy Date: Fri Nov 9 23:51:50 2007 New Revision: 593748 URL: http://svn.apache.org/viewvc?rev=593748&view=rev Log: HADOOP-2174. Removed the unnecessary Reporter.setStatus call from FSCopyFilesMapper.close which led to a NPE since the reporter isn't valid in the clo

svn commit: r593750 - in /lucene/hadoop/branches/branch-0.15: CHANGES.txt src/java/org/apache/hadoop/util/CopyFiles.java

2007-11-09 Thread acmurthy
Author: acmurthy Date: Fri Nov 9 23:55:22 2007 New Revision: 593750 URL: http://svn.apache.org/viewvc?rev=593750&view=rev Log: Merge -r 593747:593748 from trunk to branch-0.15 to fix HADOOP-2174 Modified: lucene/hadoop/branches/branch-0.15/CHANGES.txt lucene/hadoop/branches/branch-

svn commit: r594456 - /lucene/hadoop/branches/branch-0.15/CHANGES.txt

2007-11-13 Thread acmurthy
Author: acmurthy Date: Tue Nov 13 00:33:47 2007 New Revision: 594456 URL: http://svn.apache.org/viewvc?rev=594456&view=rev Log: Removing HADOOP-2140 and HADOOP-2169 from branch-0.15 since they are scheduled for 0.14.4 Modified: lucene/hadoop/branches/branch-0.15/CHANGES.txt Modi

svn commit: r594460 [4/6] - in /lucene/hadoop/trunk: ./ docs/ src/docs/src/documentation/content/xdocs/

2007-11-13 Thread acmurthy
Added: lucene/hadoop/trunk/docs/quickstart.html URL: http://svn.apache.org/viewvc/lucene/hadoop/trunk/docs/quickstart.html?rev=594460&view=auto == --- lucene/hadoop/trunk/docs/quickstart.html (added) +++ lucene/hadoop/trun

svn commit: r594460 [6/6] - in /lucene/hadoop/trunk: ./ docs/ src/docs/src/documentation/content/xdocs/

2007-11-13 Thread acmurthy
Added: lucene/hadoop/trunk/src/docs/src/documentation/content/xdocs/quickstart.xml URL: http://svn.apache.org/viewvc/lucene/hadoop/trunk/src/docs/src/documentation/content/xdocs/quickstart.xml?rev=594460&view=auto == ---

svn commit: r594461 - in /lucene/hadoop/branches/branch-0.15: ./ docs/ src/docs/src/documentation/content/xdocs/

2007-11-13 Thread acmurthy
Author: acmurthy Date: Tue Nov 13 01:03:11 2007 New Revision: 594461 URL: http://svn.apache.org/viewvc?rev=594461&view=rev Log: Merge -r 594459:594460 from trunk to branch-0.15 to fix HADOOP-1917 Added: lucene/hadoop/branches/branch-0.15/docs/cluster_setup.html - copied unchanged

svn commit: r595246 - in /lucene/hadoop/trunk: ./ docs/ src/docs/src/documentation/content/xdocs/

2007-11-15 Thread acmurthy
Author: acmurthy Date: Thu Nov 15 00:58:42 2007 New Revision: 595246 URL: http://svn.apache.org/viewvc?rev=595246&view=rev Log: HADOOP-2205. Regenerate the Hadoop website since some of the changes made by HADOOP-1917 weren't correctly copied over to the trunk/docs directory. Also

svn commit: r595247 - in /lucene/hadoop/branches/branch-0.15: ./ docs/ src/docs/src/documentation/content/xdocs/

2007-11-15 Thread acmurthy
Author: acmurthy Date: Thu Nov 15 01:02:44 2007 New Revision: 595247 URL: http://svn.apache.org/viewvc?rev=595247&view=rev Log: Merge -r 595245:595246 from trunk to branch-0.15 to fix HADOOP-2205. Modified: lucene/hadoop/branches/branch-0.15/CHANGES.txt lucene/hadoop/branches/branch-

svn commit: r597057 - in /lucene/hadoop/trunk: ./ conf/ src/examples/org/apache/hadoop/examples/ src/java/org/apache/hadoop/mapred/ src/test/org/apache/hadoop/mapred/ src/webapps/job/

2007-11-21 Thread acmurthy
Author: acmurthy Date: Wed Nov 21 04:35:27 2007 New Revision: 597057 URL: http://svn.apache.org/viewvc?rev=597057&view=rev Log: HADOOP-1274. Support different number of mappers and reducers per TaskTracker to allow administrators to better configure and utilize heterogenous clus

svn commit: r597109 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/mapred/TaskInProgress.java

2007-11-21 Thread acmurthy
Author: acmurthy Date: Wed Nov 21 07:14:17 2007 New Revision: 597109 URL: http://svn.apache.org/viewvc?rev=597109&view=rev Log: HADOOP-1281. Kill map-tasks when the parent TaskInProgress has been completed by another (possibly speculative) map-task. This ensures that map-slots are

svn commit: r597144 - /lucene/hadoop/trunk/CHANGES.txt

2007-11-21 Thread acmurthy
Author: acmurthy Date: Wed Nov 21 08:55:30 2007 New Revision: 597144 URL: http://svn.apache.org/viewvc?rev=597144&view=rev Log: Added missing attribution of HADOOP-1274 to Amareshwari Sri Ramadasu. Modified: lucene/hadoop/trunk/CHANGES.txt Modified: lucene/hadoop/trunk/CHANGES.txt

svn commit: r597185 - in /lucene/hadoop/trunk: ./ src/contrib/abacus/src/java/org/apache/hadoop/abacus/ src/contrib/streaming/src/java/org/apache/hadoop/streaming/ src/java/org/apache/hadoop/conf/ src

2007-11-21 Thread acmurthy
Author: acmurthy Date: Wed Nov 21 11:16:15 2007 New Revision: 597185 URL: http://svn.apache.org/viewvc?rev=597185&view=rev Log: HADOOP-1843. Removed code from Configuration and JobConf deprecated by HADOOP-785 and a minor fix to Configuration.toString. Specifically the important change is

svn commit: r597172 - in /lucene/hadoop/trunk: CHANGES.txt src/examples/pipes/Makefile.am src/examples/pipes/Makefile.in src/examples/pipes/impl/sort.cc

2007-11-21 Thread acmurthy
Author: acmurthy Date: Wed Nov 21 10:30:56 2007 New Revision: 597172 URL: http://svn.apache.org/viewvc?rev=597172&view=rev Log: HADOOP-2127. Added a pipes sort example to benchmark trivial pipes application versus trivial java application. Contributed by Owen O'Malley. Added: luce

svn commit: r597372 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/mapred/TaskInProgress.java

2007-11-22 Thread acmurthy
Author: acmurthy Date: Thu Nov 22 02:46:37 2007 New Revision: 597372 URL: http://svn.apache.org/viewvc?rev=597372&view=rev Log: Reverting HADOOP-1281 Modified: lucene/hadoop/trunk/CHANGES.txt lucene/hadoop/trunk/src/java/org/apache/hadoop/mapred/TaskInProgress.java Modified: lu

svn commit: r597602 - in /lucene/hadoop/trunk: ./ src/java/org/apache/hadoop/mapred/ src/test/org/apache/hadoop/mapred/jobcontrol/

2007-11-23 Thread acmurthy
Author: acmurthy Date: Fri Nov 23 00:58:29 2007 New Revision: 597602 URL: http://svn.apache.org/viewvc?rev=597602&view=rev Log: HADOOP-2245. Fix LocalJobRunner to generate unique mapids across jobs by incorporating the jobid. Also adds a test-case for JobControl vis-a-vis the LocalJobRu

svn commit: r597626 - in /lucene/hadoop/trunk: CHANGES.txt src/webapps/job/jobtasks.jsp

2007-11-23 Thread acmurthy
Author: acmurthy Date: Fri Nov 23 02:13:27 2007 New Revision: 597626 URL: http://svn.apache.org/viewvc?rev=597626&view=rev Log: HADOOP-2216. Fix jobtasks.jsp to ensure that it first collects the taskids which satisfy the filtering criteria and then use that list to print out only the requ

svn commit: r597620 - /lucene/hadoop/branches/branch-0.15/CHANGES.txt

2007-11-23 Thread acmurthy
Author: acmurthy Date: Fri Nov 23 01:55:25 2007 New Revision: 597620 URL: http://svn.apache.org/viewvc?rev=597620&view=rev Log: Merge -r 597615:597616 from trunk to branch-0.15 to fix HADOOP-2246. Modified: lucene/hadoop/branches/branch-0.15/CHANGES.txt Modified: lucene/hadoop/bran

svn commit: r597616 - /lucene/hadoop/trunk/CHANGES.txt

2007-11-23 Thread acmurthy
Author: acmurthy Date: Fri Nov 23 01:49:34 2007 New Revision: 597616 URL: http://svn.apache.org/viewvc?rev=597616&view=rev Log: HADOOP-2246. Moved the changelog for HADOOP-1851 from the NEW FEATURES section to the INCOMPATIBLE CHANGES section. Modified: lucene/hadoop/trunk/CHANGES

svn commit: r597649 - in /lucene/hadoop/trunk: ./ src/java/org/apache/hadoop/mapred/ src/test/org/apache/hadoop/mapred/jobcontrol/

2007-11-23 Thread acmurthy
Author: acmurthy Date: Fri Nov 23 03:51:38 2007 New Revision: 597649 URL: http://svn.apache.org/viewvc?rev=597649&view=rev Log: Reverting HADOOP-2245 since it can be significantly improved, specifically it copies code into JobControlTestUtils from TestJobControl, and yet doesn't r

svn commit: r605472 - in /lucene/hadoop/branches/branch-0.15: ./ src/java/org/apache/hadoop/filecache/ src/java/org/apache/hadoop/fs/ src/java/org/apache/hadoop/mapred/

2007-12-19 Thread acmurthy
Author: acmurthy Date: Wed Dec 19 00:55:50 2007 New Revision: 605472 URL: http://svn.apache.org/viewvc?rev=605472&view=rev Log: Merge -r 605470:605471 from trunk to branch-0.15 to fix HADOOP-2227. Modified: lucene/hadoop/branches/branch-0.15/CHANGES.txt lucene/hadoop/branches/br

svn commit: r605471 - in /lucene/hadoop/trunk: ./ src/java/org/apache/hadoop/filecache/ src/java/org/apache/hadoop/fs/ src/java/org/apache/hadoop/mapred/

2007-12-19 Thread acmurthy
Author: acmurthy Date: Wed Dec 19 00:54:17 2007 New Revision: 605471 URL: http://svn.apache.org/viewvc?rev=605471&view=rev Log: HADOOP-2227. Use the LocalDirAllocator uniformly for handling all of the temporary storage required for a given task. It also implies

svn commit: r605473 - in /lucene/hadoop/trunk: CHANGES.txt src/examples/pipes/conf/word.xml

2007-12-19 Thread acmurthy
Author: acmurthy Date: Wed Dec 19 01:01:51 2007 New Revision: 605473 URL: http://svn.apache.org/viewvc?rev=605473&view=rev Log: HADOOP-2453. Fix the configuration for wordcount-simple example in Hadoop Pipes which currently produces an XML parsing error. Contributed by Amareshwari Sri Rama

svn commit: r605484 - in /lucene/hadoop/trunk: ./ docs/ src/docs/src/documentation/content/xdocs/

2007-12-19 Thread acmurthy
Author: acmurthy Date: Wed Dec 19 01:38:01 2007 New Revision: 605484 URL: http://svn.apache.org/viewvc?rev=605484&view=rev Log: HADOOP-2215. Fix documentation in cluster_setup.html & mapred_tutorial.html reflect that mapred.tasktracker.tasks.maximum has been superceeded by mapred.tas

svn commit: r605672 [1/3] - in /lucene/hadoop/trunk: CHANGES.txt src/native/config.h.in src/native/configure src/native/configure.ac

2007-12-19 Thread acmurthy
Author: acmurthy Date: Wed Dec 19 11:54:14 2007 New Revision: 605672 URL: http://svn.apache.org/viewvc?rev=605672&view=rev Log: HADOOP-2352. Remove AC_CHECK_LIB for libz and liblzo to ensure that libhadoop.so doesn't have a dependency on them. Modified: lucene/hadoop/trunk/CH

svn commit: r605672 [3/3] - in /lucene/hadoop/trunk: CHANGES.txt src/native/config.h.in src/native/configure src/native/configure.ac

2007-12-19 Thread acmurthy
Modified: lucene/hadoop/trunk/src/native/configure.ac URL: http://svn.apache.org/viewvc/lucene/hadoop/trunk/src/native/configure.ac?rev=605672&r1=605671&r2=605672&view=diff == --- lucene/hadoop/trunk/src/native/configure.a

svn commit: r605830 - in /lucene/hadoop/trunk: CHANGES.txt build.xml

2007-12-20 Thread acmurthy
Author: acmurthy Date: Thu Dec 20 00:22:15 2007 New Revision: 605830 URL: http://svn.apache.org/viewvc?rev=605830&view=rev Log: HADOOP-2457. Added a 'forrest.home' property to the 'docs' target in build.xml. Modified: lucene/hadoop/trunk/CHANGES.txt lucen

svn commit: r605868 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/fs/LocalDirAllocator.java src/test/org/apache/hadoop/fs/TestLocalDirAllocator.java

2007-12-20 Thread acmurthy
Author: acmurthy Date: Thu Dec 20 02:24:54 2007 New Revision: 605868 URL: http://svn.apache.org/viewvc?rev=605868&view=rev Log: HADOOP-2437. Fix the LocalDirAllocator to choose the seed for the round-robin disk selections randomly. This helps in spreading data across multiple partitions

svn commit: r605870 - in /lucene/hadoop/branches/branch-0.15: CHANGES.txt src/java/org/apache/hadoop/fs/LocalDirAllocator.java src/test/org/apache/hadoop/fs/TestLocalDirAllocator.java

2007-12-20 Thread acmurthy
Author: acmurthy Date: Thu Dec 20 02:28:46 2007 New Revision: 605870 URL: http://svn.apache.org/viewvc?rev=605870&view=rev Log: Merge -r 605867:605868 from trunk to branch-0.15 to fix HADOOP-2437. Modified: lucene/hadoop/branches/branch-0.15/CHANGES.txt lucene/hadoop/branches/br

svn commit: r606268 - in /lucene/hadoop/branches/branch-0.15: CHANGES.txt src/java/org/apache/hadoop/mapred/JobInProgress.java src/java/org/apache/hadoop/mapred/ReduceTask.java src/java/org/apache/had

2007-12-21 Thread acmurthy
Author: acmurthy Date: Fri Dec 21 10:57:55 2007 New Revision: 606268 URL: http://svn.apache.org/viewvc?rev=606268&view=rev Log: Merge -r 606266:606267 from trunk to branch-0.15 to fix HADOOP-2247. Modified: lucene/hadoop/branches/branch-0.15/CHANGES.txt lucene/hadoop/branches/br

svn commit: r606267 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/mapred/JobInProgress.java src/java/org/apache/hadoop/mapred/ReduceTask.java src/java/org/apache/hadoop/mapred/Task

2007-12-21 Thread acmurthy
Author: acmurthy Date: Fri Dec 21 10:51:22 2007 New Revision: 606267 URL: http://svn.apache.org/viewvc?rev=606267&view=rev Log: HADOOP-2247. Fine-tune the strategies for killing mappers and reducers due to failures while fetching map-outputs. Now the map-completion times and numbe

svn commit: r606287 - in /lucene/hadoop/branches/branch-0.15: CHANGES.txt src/java/org/apache/hadoop/mapred/JobInProgress.java src/java/org/apache/hadoop/mapred/ReduceTask.java src/java/org/apache/had

2007-12-21 Thread acmurthy
Author: acmurthy Date: Fri Dec 21 11:37:35 2007 New Revision: 606287 URL: http://svn.apache.org/viewvc?rev=606287&view=rev Log: Merge -r 606267:606266 from trunk to branch-0.15 to revert HADOOP-2247. Modified: lucene/hadoop/branches/branch-0.15/CHANGES.txt lucene/hadoop/branches/br

svn commit: r606297 - /lucene/hadoop/trunk/CHANGES.txt

2007-12-21 Thread acmurthy
Author: acmurthy Date: Fri Dec 21 12:26:30 2007 New Revision: 606297 URL: http://svn.apache.org/viewvc?rev=606297&view=rev Log: Scheduling HADOOP-2247 for release 0.16.0. Modified: lucene/hadoop/trunk/CHANGES.txt Modified: lucene/hadoop/trunk/CHANGES.txt URL: http://svn.apache.org/vi

svn commit: r607007 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/mapred/FileInputFormat.java

2007-12-26 Thread acmurthy
Author: acmurthy Date: Wed Dec 26 22:35:55 2007 New Revision: 607007 URL: http://svn.apache.org/viewvc?rev=607007&view=rev Log: HADOOP-2466. Change FileInputFormat.computeSplitSize to a protected non-static method to allow sub-classes to provide alternate implementations. Contributed

svn commit: r608050 - in /lucene/hadoop/trunk: ./ src/java/org/apache/hadoop/fs/ src/java/org/apache/hadoop/mapred/ src/java/org/apache/hadoop/security/ src/java/org/apache/hadoop/util/ src/test/org/a

2008-01-02 Thread acmurthy
Author: acmurthy Date: Wed Jan 2 01:19:11 2008 New Revision: 608050 URL: http://svn.apache.org/viewvc?rev=608050&view=rev Log: HADOOP-2344. Enhance the utility for executing shell commands to read the stdout/stderr streams while waiting for the command to finish (to free up the buffers).

svn commit: r608052 - /lucene/hadoop/trunk/CHANGES.txt

2008-01-02 Thread acmurthy
Author: acmurthy Date: Wed Jan 2 01:26:06 2008 New Revision: 608052 URL: http://svn.apache.org/viewvc?rev=608052&view=rev Log: Added missing attribution of HADOOP-2344 for Amar Kamat. Modified: lucene/hadoop/trunk/CHANGES.txt Modified: lucene/hadoop/trunk/CHANGES.txt URL:

svn commit: r608234 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/util/Shell.java

2008-01-02 Thread acmurthy
Author: acmurthy Date: Wed Jan 2 13:14:06 2008 New Revision: 608234 URL: http://svn.apache.org/viewvc?rev=608234&view=rev Log: HADOOP-2511. Fix a javadoc warning in org.apache.hadoop.util.Shell introduced by HADOOP-2344. Modified: lucene/hadoop/trunk/CHANGES.txt lucene/hadoop/trunk

svn commit: r608973 [2/4] - in /lucene/hadoop/trunk: ./ docs/ docs/skin/ docs/skin/images/ src/docs/src/documentation/content/xdocs/

2008-01-04 Thread acmurthy
Modified: lucene/hadoop/trunk/docs/index.pdf URL: http://svn.apache.org/viewvc/lucene/hadoop/trunk/docs/index.pdf?rev=608973&r1=608972&r2=608973&view=diff == --- lucene/hadoop/trunk/docs/index.pdf (original) +++ lucene/had

svn commit: r609741 - in /lucene/hadoop/trunk: CHANGES.txt conf/hadoop-default.xml docs/hadoop-default.html src/java/org/apache/hadoop/mapred/TaskRunner.java

2008-01-07 Thread acmurthy
Author: acmurthy Date: Mon Jan 7 11:04:38 2008 New Revision: 609741 URL: http://svn.apache.org/viewvc?rev=609741&view=rev Log: Removed support for deprecated mapred.child.heap.size and fixed some indentation issues in TaskRunner. Modified: lucene/hadoop/trunk/CHANGES.txt lucene/ha

svn commit: r610135 [3/3] - in /lucene/hadoop/trunk: ./ docs/ src/docs/src/documentation/content/xdocs/ src/java/org/apache/hadoop/mapred/

2008-01-08 Thread acmurthy
Modified: lucene/hadoop/trunk/src/docs/src/documentation/content/xdocs/mapred_tutorial.xml URL: http://svn.apache.org/viewvc/lucene/hadoop/trunk/src/docs/src/documentation/content/xdocs/mapred_tutorial.xml?rev=610135&r1=610134&r2=610135&view=diff ==

svn commit: r610135 [1/3] - in /lucene/hadoop/trunk: ./ docs/ src/docs/src/documentation/content/xdocs/ src/java/org/apache/hadoop/mapred/

2008-01-08 Thread acmurthy
Author: acmurthy Date: Tue Jan 8 12:32:29 2008 New Revision: 610135 URL: http://svn.apache.org/viewvc?rev=610135&view=rev Log: HADOOP-1660. Add the cwd of the map/reduce task to the java.library.path of the child-jvm to support loading of native libraries distributed via the DistributedC

svn commit: r610523 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/mapred/TaskInProgress.java

2008-01-09 Thread acmurthy
Author: acmurthy Date: Wed Jan 9 11:39:25 2008 New Revision: 610523 URL: http://svn.apache.org/viewvc?rev=610523&view=rev Log: HADOOP-1281. Ensure running tasks of completed map TIPs (e.g. speculative tasks) are killed as soon as the TIP completed. Modified: lucene/hadoop/trunk/CHANGES

svn commit: r610541 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/mapred/jobcontrol/Job.java src/java/org/apache/hadoop/mapred/jobcontrol/JobControl.java src/java/org/apache/hadoop

2008-01-09 Thread acmurthy
Author: acmurthy Date: Wed Jan 9 12:12:45 2008 New Revision: 610541 URL: http://svn.apache.org/viewvc?rev=610541&view=rev Log: HADOOP-2268. Fix org.apache.hadoop.mapred.jobcontrol classes to use the List/Map interfaces rather than concrete ArrayList/HashMap classes internally. Contribute

svn commit: r610902 - in /lucene/hadoop/trunk: ./ src/java/org/apache/hadoop/mapred/

2008-01-10 Thread acmurthy
Author: acmurthy Date: Thu Jan 10 11:52:37 2008 New Revision: 610902 URL: http://svn.apache.org/viewvc?rev=610902&view=rev Log: HADOOP-2487. Added an option to get statuses for all submitted/run jobs. This information can be used to develop tools for analysing jobs. Contributed by Amaresh

svn commit: r610910 [1/3] - in /lucene/hadoop/trunk: ./ conf/ docs/ src/contrib/streaming/src/java/org/apache/hadoop/streaming/ src/docs/src/documentation/content/xdocs/ src/java/org/apache/hadoop/map

2008-01-10 Thread acmurthy
Author: acmurthy Date: Thu Jan 10 12:09:01 2008 New Revision: 610910 URL: http://svn.apache.org/viewvc?rev=610910&view=rev Log: HADOOP-2131. Allow finer-grained control over speculative-execution. Now users can set it for maps and reduces independently. Contributed by Amareshwari Sri Rama

svn commit: r610910 [3/3] - in /lucene/hadoop/trunk: ./ conf/ docs/ src/contrib/streaming/src/java/org/apache/hadoop/streaming/ src/docs/src/documentation/content/xdocs/ src/java/org/apache/hadoop/map

2008-01-10 Thread acmurthy
Modified: lucene/hadoop/trunk/src/java/org/apache/hadoop/mapred/JobConf.java URL: http://svn.apache.org/viewvc/lucene/hadoop/trunk/src/java/org/apache/hadoop/mapred/JobConf.java?rev=610910&r1=610909&r2=610910&view=diff ==

svn commit: r611315 - in /lucene/hadoop/trunk: ./ src/java/org/apache/hadoop/mapred/ src/test/org/apache/hadoop/mapred/ src/test/org/apache/hadoop/test/

2008-01-11 Thread acmurthy
Author: acmurthy Date: Fri Jan 11 14:04:59 2008 New Revision: 611315 URL: http://svn.apache.org/viewvc?rev=611315&view=rev Log: HADOOP-1965. Interleave sort/spill in teh map-task along with calls to the Mapper.map method. This is done by splitting the 'io.sort.mb' buffer into two

svn commit: r611527 - in /lucene/hadoop/trunk: ./ conf/ src/java/org/apache/hadoop/mapred/ src/test/org/apache/hadoop/mapred/

2008-01-12 Thread acmurthy
Author: acmurthy Date: Sat Jan 12 18:49:01 2008 New Revision: 611527 URL: http://svn.apache.org/viewvc?rev=611527&view=rev Log: HADOOP-1876. Persist statuses of completed jobs in HDFS so that the JobClient can query and get information about decommissioned jobs and also across JobTra

svn commit: r611874 - in /lucene/hadoop/trunk: CHANGES.txt src/java/org/apache/hadoop/util/StringUtils.java

2008-01-14 Thread acmurthy
Author: acmurthy Date: Mon Jan 14 10:25:58 2008 New Revision: 611874 URL: http://svn.apache.org/viewvc?rev=611874&view=rev Log: HADOOP-2077. Added version and build information to STARTUP_MSG for all hadoop daemons to aid error-reporting, debugging etc. Modified: lucene/hadoop/t

svn commit: r611887 [3/3] - in /lucene/hadoop/trunk: CHANGES.txt docs/mapred_tutorial.html docs/mapred_tutorial.pdf src/docs/src/documentation/content/xdocs/mapred_tutorial.xml

2008-01-14 Thread acmurthy
Modified: lucene/hadoop/trunk/src/docs/src/documentation/content/xdocs/mapred_tutorial.xml URL: http://svn.apache.org/viewvc/lucene/hadoop/trunk/src/docs/src/documentation/content/xdocs/mapred_tutorial.xml?rev=611887&r1=611886&r2=611887&view=diff ==

svn commit: r611887 [1/3] - in /lucene/hadoop/trunk: CHANGES.txt docs/mapred_tutorial.html docs/mapred_tutorial.pdf src/docs/src/documentation/content/xdocs/mapred_tutorial.xml

2008-01-14 Thread acmurthy
Author: acmurthy Date: Mon Jan 14 10:43:32 2008 New Revision: 611887 URL: http://svn.apache.org/viewvc?rev=611887&view=rev Log: HADOOP-2574. Fixed mapred_tutorial.xml to correct minor errors with the WordCount examples. Modified: lucene/hadoop/trunk/CHANGES.txt lucene/hadoop/trunk/

svn commit: r611880 - /lucene/hadoop/trunk/docs/hadoop-default.html

2008-01-14 Thread acmurthy
Author: acmurthy Date: Mon Jan 14 10:30:34 2008 New Revision: 611880 URL: http://svn.apache.org/viewvc?rev=611880&view=rev Log: HADOOP-1876. Updating hadoop-default.html to reflect changes to hadoop-default.xml. Modified: lucene/hadoop/trunk/docs/hadoop-default.html Modified: lucene/ha

svn commit: r611895 [2/4] - in /lucene/hadoop/branches/branch-0.15: ./ docs/ docs/skin/ docs/skin/images/ src/docs/src/documentation/content/xdocs/

2008-01-14 Thread acmurthy
Modified: lucene/hadoop/branches/branch-0.15/docs/linkmap.pdf URL: http://svn.apache.org/viewvc/lucene/hadoop/branches/branch-0.15/docs/linkmap.pdf?rev=611895&r1=611894&r2=611895&view=diff == --- lucene/hadoop/branches/bra