Author: ddas
Date: Mon Feb 23 08:47:17 2009
New Revision: 746929
URL: http://svn.apache.org/viewvc?rev=746929&view=rev
Log:
HADOOP-5219. Adds a new property io.seqfile.local.dir for use by SequenceFile,
which earlier used mapred.local.dir. Contributed by Sharad Agarwal.
Modified:
hadoop/core/trunk/CHANGES.txt
hadoop/core/trunk/src/core/core-default.xml
hadoop/core/trunk/src/core/org/apache/hadoop/io/SequenceFile.java
Modified: hadoop/core/trunk/CHANGES.txt
URL:
http://svn.apache.org/viewvc/hadoop/core/trunk/CHANGES.txt?rev=746929&r1=746928&r2=746929&view=diff
==============================================================================
--- hadoop/core/trunk/CHANGES.txt (original)
+++ hadoop/core/trunk/CHANGES.txt Mon Feb 23 08:47:17 2009
@@ -212,6 +212,9 @@
and that brings down the log messages in the JobClient to do with
NetworkTopology.add significantly. (Jothi Padmanabhan via ddas)
+ HADOOP-5219. Adds a new property io.seqfile.local.dir for use by
SequenceFile,
+ which earlier used mapred.local.dir. (Sharad Agarwal via ddas)
+
Release 0.20.0 - Unreleased
INCOMPATIBLE CHANGES
Modified: hadoop/core/trunk/src/core/core-default.xml
URL:
http://svn.apache.org/viewvc/hadoop/core/trunk/src/core/core-default.xml?rev=746929&r1=746928&r2=746929&view=diff
==============================================================================
--- hadoop/core/trunk/src/core/core-default.xml (original)
+++ hadoop/core/trunk/src/core/core-default.xml Mon Feb 23 08:47:17 2009
@@ -90,6 +90,16 @@
obtaining serializers and deserializers.</description>
</property>
+<property>
+ <name>io.seqfile.local.dir</name>
+ <value>${hadoop.tmp.dir}/io/local</value>
+ <description>The local directory where sequence file stores intermediate
+ data files during merge. May be a comma-separated list of
+ directories on different devices in order to spread disk i/o.
+ Directories that do not exist are ignored.
+ </description>
+</property>
+
<!-- file system properties -->
<property>
Modified: hadoop/core/trunk/src/core/org/apache/hadoop/io/SequenceFile.java
URL:
http://svn.apache.org/viewvc/hadoop/core/trunk/src/core/org/apache/hadoop/io/SequenceFile.java?rev=746929&r1=746928&r2=746929&view=diff
==============================================================================
--- hadoop/core/trunk/src/core/org/apache/hadoop/io/SequenceFile.java (original)
+++ hadoop/core/trunk/src/core/org/apache/hadoop/io/SequenceFile.java Mon Feb
23 08:47:17 2009
@@ -2870,7 +2870,7 @@
int numSegments = sortedSegmentSizes.size();
int origFactor = factor;
int passNo = 1;
- LocalDirAllocator lDirAlloc = new
LocalDirAllocator("mapred.local.dir");
+ LocalDirAllocator lDirAlloc = new
LocalDirAllocator("io.seqfile.local.dir");
do {
//get the factor for this pass of merge
factor = getPassFactor(passNo, numSegments);