This is an automated email from the ASF dual-hosted git repository.
lewismc pushed a change to branch 2.x
in repository https://gitbox.apache.org/repos/asf/nutch.git.
from 755799f Merge branch
'sebastian-nagel-NUTCH-2376-http-accept-header-2.x' into 2.x
adds bda0076 NUTCH-2373 HBaseIndexWriter - indexer for hbase
implemented
adds 9541ad8 NUTCH-2373 Multiple SLF4J bindings issue solved,
unnecessary dependencies removed, hbase index mapping file added
adds 42257b3 NUTCH-2373 Extra newline removed
adds 0f023e8 NUTCH-2373 Code formatted using Nutch
eclipse-codeformat.xml
adds 7d6f3c3 NUTCH-2373 getting mapped qualifier name from key issue
solved
adds 3db3699 NUTCH-2373 Boilerplate default column family removed,
considering first column family as default
adds 112202f commit() on close() to write prevent missing the last
batch
adds 0103f4d NUTCH-2373 typo corrected in hbaseindex-mapping.xml
adds 108dab0 Merge remote-tracking branch 'origin/2.x' into 2.x
adds 906c021 Merge remote-tracking branch 'upstream/2.x' into 2.x
adds 0ca33f5 Parameterized logging with Slf4j applied.
adds efde99e log level info->debug inside write to avoid flood logging
adds f72e9e4 Original ivy.xml restored fixing the two spaces tab issue
adds 9fb6bdd indexer-hbase added into Javadoc artifact's packageset in
build.xml
adds f8ffdea Logger inside write() removed to avoid flood logging, log
added into commit(), made HBaseIndexWriter.LOG identifier public.
adds 9dad864 NUTCH-2373 An issue on document counting fixed, default
batch-size increased to 500
new 1216411 Merge pull request #184 from kaidul/2.x
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "adds" were already present in the repository and have only
been added to this reference.
Summary of changes:
build.xml | 3 +
conf/hbaseindex-mapping.xml | 60 +++++++
conf/nutch-default.xml | 38 +++++
src/plugin/build.xml | 2 +
.../{index-anchor => indexer-hbase}/build.xml | 2 +-
src/plugin/{index-more => indexer-hbase}/ivy.xml | 6 +-
.../{index-anchor => indexer-hbase}/plugin.xml | 20 +--
.../nutch/indexwriter/hbase/HBaseConstants.java | 48 ++++++
.../nutch/indexwriter/hbase/HBaseIndexWriter.java | 166 +++++++++++++++++++
.../indexwriter/hbase/HBaseMappingReader.java | 175 +++++++++++++++++++++
.../nutch/indexwriter/hbase}/package-info.java | 5 +-
11 files changed, 509 insertions(+), 16 deletions(-)
create mode 100644 conf/hbaseindex-mapping.xml
copy src/plugin/{index-anchor => indexer-hbase}/build.xml (94%)
copy src/plugin/{index-more => indexer-hbase}/ivy.xml (85%)
copy src/plugin/{index-anchor => indexer-hbase}/plugin.xml (66%)
create mode 100644
src/plugin/indexer-hbase/src/java/org/apache/nutch/indexwriter/hbase/HBaseConstants.java
create mode 100644
src/plugin/indexer-hbase/src/java/org/apache/nutch/indexwriter/hbase/HBaseIndexWriter.java
create mode 100644
src/plugin/indexer-hbase/src/java/org/apache/nutch/indexwriter/hbase/HBaseMappingReader.java
copy src/{java/org/apache/nutch/parse =>
plugin/indexer-hbase/src/java/org/apache/nutch/indexwriter/hbase}/package-info.java
(86%)
--
To stop receiving notification emails like this one, please contact
['"[email protected]" <[email protected]>'].
