[jira] [Commented] (TIKA-2849) TikaInputStream copies the input stream locally

[Tim Allison (JIRA)]

    [ 
https://issues.apache.org/jira/browse/TIKA-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16824296#comment-16824296
 ] 

Tim Allison commented on TIKA-2849:
-----------------------------------

default:     
{noformat}
    private int markLimit = 16 * 1024 * 1024
{noformat}

You can configure it programmatically or via TikaConfig...something along these 
lines:
{noformat}
<properties>
    <parsers/>
    <detectors>
        <detector class="org.apache.tika.detect.OverrideDetector"/>
        <detector 
class="org.apache.tika.detect.microsoft.POIFSContainerDetector">
            <params>
                <param name="markLimit" type="int">16777216</param>
            </params>
        </detector>
        <detector class="org.apache.tika.parser.pkg.ZipContainerDetector">
            <params>
                <param name="markLimit" type="int">16777216</param>
            </params>
        </detector>
    </detectors>
</properties>
{noformat}

> TikaInputStream copies the input stream locally
> -----------------------------------------------
>
>                 Key: TIKA-2849
>                 URL: https://issues.apache.org/jira/browse/TIKA-2849
>             Project: Tika
>          Issue Type: Bug
>    Affects Versions: 1.20
>            Reporter: Boris Petrov
>            Assignee: Tim Allison
>            Priority: Major
>             Fix For: 1.21
>
>
> When doing "tika.detect(stream, name)" and the stream is a "TikaInputStream", 
> execution gets to "TikaInputStream#getPath" which does a "Files.copy(in, 
> path, REPLACE_EXISTING);" which is very, very bad. This input stream could 
> be, as in our case, an input stream from a network file which is tens or 
> hundreds of gigabytes large. Copying it locally is a huge waste of resources 
> to say the least. Why does it do that and can I make it not do it? Or is this 
> something that has to be fixed in Tika?



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)