[
https://issues.apache.org/jira/browse/HBASE-2602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Purtell updated HBASE-2602:
----------------------------------
Description:
Put together a full web content archive toolchain:
* Pluggable content acquisition
** Heritrix HBase writer simulator, zipf distribution over [32B, 10MB]
** Real Heritrix + Heritrix HBase writer option for running crawls over
live sites
* Periodic MapReduce using Tika for extraction
* Katta for search, or hbasene + Solr when ready (better)
was:
Put together a full web content archive toolchain:
- Pluggable content acquisition
- Heritrix HBase writer simulator, zipf distribution over [32B, 10MB]
- Real Heritrix + Heritrix HBase writer option for running crawls over live
sites
- Periodic MapReduce using Tika for extraction
- Katta for search, or hbasene + Solr when ready (better)
> full system application test scenario: webtable
> -----------------------------------------------
>
> Key: HBASE-2602
> URL: https://issues.apache.org/jira/browse/HBASE-2602
> Project: Hadoop HBase
> Issue Type: Sub-task
> Reporter: Andrew Purtell
>
> Put together a full web content archive toolchain:
> * Pluggable content acquisition
> ** Heritrix HBase writer simulator, zipf distribution over [32B, 10MB]
> ** Real Heritrix + Heritrix HBase writer option for running crawls over
> live sites
> * Periodic MapReduce using Tika for extraction
> * Katta for search, or hbasene + Solr when ready (better)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
