[
https://issues.apache.org/jira/browse/TIKA-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14303783#comment-14303783
]
Tyler Palsulich commented on TIKA-1331:
---------------------------------------
The big chunks of data are the corpus (or corpora) and results. Assuming we
want to browse a website of the results, it'd be nice to have result summaries
for the last N (5? All?) releases and SNAPSHOT.
Current corpora:
{code}
$ du -hs /public/corpora/*
578G /public/corpora/govdocs1/
216G /public/corpora/commoncrawl/
{code}
We haven't tried running tika-batch on either of them yet, right? How big are
the result files? Any input on TIKA-1334? Do we want to tie that to the
frontend of TIKA-1301?
> Find/configure a vm and gather initial corpus
> ---------------------------------------------
>
> Key: TIKA-1331
> URL: https://issues.apache.org/jira/browse/TIKA-1331
> Project: Tika
> Issue Type: Sub-task
> Components: cli, general, server
> Reporter: Tim Allison
> Assignee: Tim Allison
> Attachments: tika-eval-vm-setup.tar.bz2
>
>
> Let's start with govdocs1 for this issue unless there are other easy options.
> Going forward, we'll want and need to add a more diverse set of documents.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
