[ 
https://issues.apache.org/jira/browse/TIKA-4198?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17817988#comment-17817988
 ] 

Tim Allison commented on TIKA-4198:
-----------------------------------

On one 130MB file, the processing time went from 320 seconds -> 12 seconds.

> Skip blob fields in geopkg files
> --------------------------------
>
>                 Key: TIKA-4198
>                 URL: https://issues.apache.org/jira/browse/TIKA-4198
>             Project: Tika
>          Issue Type: Improvement
>            Reporter: Tim Allison
>            Priority: Minor
>
> Some geopkg tables store "geom" information in blob fields, starting with 
> magic: 47 50 00...
> By default Tika handles blobs as embedded files. This can cause serious 
> resource waste on geopkg files that contain hundreds of thousands of rows 
> with a geom field.
> We should create a new parser for geopkg that subclasses the sqlite parser 
> and skips blobs from the geom fields by default.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to