Author: lewismc
Date: Wed Mar 6 22:39:59 2013
New Revision: 1453600
URL: http://svn.apache.org/r1453600
Log:
NUTCH-1540 Add Gora buffered read and write maximum limits to nutch-default.xml
configuration.
Modified:
nutch/branches/2.x/CHANGES.txt
nutch/branches/2.x/conf/nutch-default.xml
Modified: nutch/branches/2.x/CHANGES.txt
URL:
http://svn.apache.org/viewvc/nutch/branches/2.x/CHANGES.txt?rev=1453600&r1=1453599&r2=1453600&view=diff
==============================================================================
--- nutch/branches/2.x/CHANGES.txt (original)
+++ nutch/branches/2.x/CHANGES.txt Wed Mar 6 22:39:59 2013
@@ -2,6 +2,8 @@ Nutch Change Log
Release 2.2 - Current Development
+* NUTCH-1540 Add Gora buffered read and write maximum limits to
nutch-default.xml configuration. (lewismc)
+
* NUTCH-842 AutoGenerate WebPage code (jnioche via lewismc)
* NUTCH-1536 Ant build file has hardcoded conf dir location (zm via lewismc)
Modified: nutch/branches/2.x/conf/nutch-default.xml
URL:
http://svn.apache.org/viewvc/nutch/branches/2.x/conf/nutch-default.xml?rev=1453600&r1=1453599&r2=1453600&view=diff
==============================================================================
--- nutch/branches/2.x/conf/nutch-default.xml (original)
+++ nutch/branches/2.x/conf/nutch-default.xml Wed Mar 6 22:39:59 2013
@@ -1172,18 +1172,18 @@
org.apache.gora.hbase.store.HBaseStore
Gora class for storing data in Apache HBase.
- org.apache.gora.hbase.store.AccumuloStore
+ org.apache.gora.accumulo.store.AccumuloStore
Gora class for storing data in Apache Accumulo.
- org.apache.gora.hbase.store.AvroStore
+ org.apache.gora.avro.store.AvroStore
Gora class for storing data in Apache Avro.
- org.apache.gora.hbase.store.DataFileAvroStore
+ org.apache.gora.avro.store.DataFileAvroStore
Gora class for storing data in Apache Avro. DataFileAvroStore is
a file based store which uses Avro's DataFile{Writer,Reader}'s as a
backend.
This datastore supports mapreduce.
- org.apache.gora.hbase.store.MemStore
+ org.apache.gora.memory.store.MemStore
Gora class for storing data in a Memory based implementation for tests.
</description>
</property>
@@ -1218,4 +1218,21 @@
</description>
</property>
+<property>
+ <name>gora.buffer.read.limit</name>
+ <value>10000</value>
+ <description>The maximum number of buffered Records we wish to
+ read in one batch. @see org.apache.gora.mapreduce.GoraRecordReader
+ </description>
+</property>
+
+<property>
+ <name>gora.buffer.write.limit</name>
+ <value>10000</value>
+ <description>Configures (for the Hadoop record writer) the maximum number of
+ buffered Records we wish to regularly flush to the Gora datastore.
+ @see org.apache.gora.mapreduce.GoraRecordWriter.
+ </description>
+</property>
+
</configuration>
