[
https://issues.apache.org/jira/browse/LUCENE-5188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13757635#comment-13757635
]
Simon Willnauer commented on LUCENE-5188:
-----------------------------------------
cool stuff adrien!
One thing I wonder is if we should use a specialized DataInput maybe
SkippableDataInput in that class to prevent the static method. That shared byte
array worries me. Aside of this, I wonder if we had this method in DataInput or
however we gonna do this would it be possible to skip an entire decompression
step if we know that the amount of bytes we skip is larger than one or more
decompression blocks. I have to admit I don't exactly know how this works and
if what I propose is possible but that would help me to better understand why
we need to read all the data and decompress if we trash it anyway.
> Make CompressingStoredFieldsFormat more friendly to StoredFieldVisitors
> -----------------------------------------------------------------------
>
> Key: LUCENE-5188
> URL: https://issues.apache.org/jira/browse/LUCENE-5188
> Project: Lucene - Core
> Issue Type: Improvement
> Reporter: Adrien Grand
> Assignee: Adrien Grand
> Priority: Minor
> Attachments: LUCENE-5188.patch
>
>
> The way CompressingStoredFieldsFormat works is that it first decompresses
> data and then consults the StoredFieldVisitor. This is a bit wasteful in case
> documents are big and only the first field of a document is of interest so
> maybe we could decompress and consult the StoredFieldVicitor in a more
> streaming fashion.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
