[
https://issues.apache.org/jira/browse/LUCENE-4658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Michael McCandless updated LUCENE-4658:
---------------------------------------
Attachment: LUCENE-4658.patch
New patch, 1) moving this thing into Codec as (optional)
getExternalDataFormat, and 2) adding basic read-time support. Test
still passes (and I was able to remove the hack commit/waitForMerges
necessary before because read-time support wasn't there)...
Now I'm not sure it really "belongs" on Codec: it's sort of awkward
because it's an indexing chain PLUS codec part (on the write side).
It's also ... heavyweight now because to use it you must make a Codec
and name it (so SPI can find it at read time), so for Solr (eg) to use
this for an ExternalFileField ... seems hardish.
Maybe it should be back on IndexWriterConfig (write side), but then
we'd need something on the read side ... not sure.
> Per-segment tracking of external/side-car data
> ----------------------------------------------
>
> Key: LUCENE-4658
> URL: https://issues.apache.org/jira/browse/LUCENE-4658
> Project: Lucene - Core
> Issue Type: Improvement
> Reporter: Michael McCandless
> Assignee: Michael McCandless
> Attachments: LUCENE-4658.patch, LUCENE-4658.patch
>
>
> Spinoff from David's idea on LUCENE-4258
> (https://issues.apache.org/jira/browse/LUCENE-4258?focusedCommentId=13534352&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13534352
> )
> I made a prototype patch that allows custom per-segment "side-car
> data". It adds an abstract ExternalSegmentData class. The idea is
> the app implements this, and IndexWriter will pass each Document
> through to it, and call on it to do flushing/merging. I added a
> setter to IndexWriterConfig to enable it, but I think this would
> really belong in Codec ...
> I haven't tackled the read-side yet, though this is already usable
> without that (ie, the app can just open its own files, read them,
> etc.).
> The random test case passes.
> I think for example this might make it easier for Solr/ElasticSearch
> to implement things like ExternalFileField.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
