[ 
https://issues.apache.org/jira/browse/TIKA-1331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14306440#comment-14306440
 ] 

Tim Allison commented on TIKA-1331:
-----------------------------------

Hi Tyler,
  I'm focusing on TIKA-1302 at the moment.  Give tika-server a shot and see 
what you find.  I can't remember where I left iptables w.r.t. that...
  I'm in the process of sloshing around data on the vm at the moment.
  I finally had a chance to write a script to unzip one of [~jnioche]'s slice 
of CommonCrawl, and I'm in the process of re-grabbing the zips for govdocs1 for 
the /data1/archives folder.
 
  On the apparent deadlock issues above, turns out not to be deadlock, just odd 
oom behavior with sqlite's jni.  I found a few areas to improve memory 
consumption on the eval code, and that is helping.

  Have you had a chance to look at the current static report dump over on 
TIKA-1334?  What do you think?

> Find/configure a vm and gather initial corpus
> ---------------------------------------------
>
>                 Key: TIKA-1331
>                 URL: https://issues.apache.org/jira/browse/TIKA-1331
>             Project: Tika
>          Issue Type: Sub-task
>          Components: cli, general, server
>            Reporter: Tim Allison
>            Assignee: Tim Allison
>         Attachments: tika-eval-vm-setup.tar.bz2
>
>
> Let's start with govdocs1 for this issue unless there are other easy options. 
>  Going forward, we'll want and need to add a more diverse set of documents.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to