[
https://issues.apache.org/jira/browse/TIKA-2170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15645320#comment-15645320
]
Tim Kingsbury commented on TIKA-2170:
-------------------------------------
Hey Tim,
The 5 second sleep on my side is definitely not required (that was just an
experiment). It's interesting that you guys time out after 5 seconds of
inactivity. How long you spend parsing a very large file is going to be
hardware dependent. Perhaps your machine is a bit faster than mine? I see it
fail about 20% of the time at random. If I try with a smaller file, things
become stable.
>>We could parameterize the amount of sleep before
>>shutting-down-on-no-stream-activity if that would help.
That sounds like a perfect solution to me. I would bet that if I could bump the
timeout up to 30 seconds, the problem might go away entirely.
-Tim
> Tika 1.13 ForkParser fails intermittently with very large MS Word docx
> ----------------------------------------------------------------------
>
> Key: TIKA-2170
> URL: https://issues.apache.org/jira/browse/TIKA-2170
> Project: Tika
> Issue Type: Bug
> Components: parser
> Affects Versions: 1.13
> Environment: Windows 10
> Reporter: Tim Kingsbury
> Attachments: TikaForkParserExample.java, War and Peace.docx
>
>
> If the ForkParser is run in a for-loop over and over against a single large
> Microsoft Word DOCX file, it fails intermittently. Sometimes it will fail on
> the very first iteration. Sometimes it will run through several iterations
> before failing. Results are inconsistent.
> A small test application is enclosed. For the test, I use a Word docx with
> the full text of "War and Peace". 2.8MB, 1141 pages of text.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
