[
https://issues.apache.org/jira/browse/LUCENE-868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Grant Ingersoll updated LUCENE-868:
-----------------------------------
Attachment: LUCENE-868-v3.patch
Added the start of a Position based Mapper. This would allow indexing directly
(almost) into the vector by position. Still needs a little more testing, but
wanted to put it out there for others to see.
> Making Term Vectors more accessible
> -----------------------------------
>
> Key: LUCENE-868
> URL: https://issues.apache.org/jira/browse/LUCENE-868
> Project: Lucene - Java
> Issue Type: New Feature
> Components: Store
> Reporter: Grant Ingersoll
> Assignee: Grant Ingersoll
> Priority: Minor
> Attachments: LUCENE-868-v2.patch, LUCENE-868-v3.patch
>
>
> One of the big issues with term vector usage is that the information is
> loaded into parallel arrays as it is loaded, which are then often times
> manipulated again to use in the application (for instance, they are sorted by
> frequency).
> Adding a callback mechanism that allows the vector loading to be handled by
> the application would make this a lot more efficient.
> I propose to add to IndexReader:
> abstract public void getTermFreqVector(int docNumber, String field,
> TermVectorMapper mapper) throws IOException;
> and a similar one for the all fields version
> Where TermVectorMapper is an interface with a single method:
> void map(String term, int frequency, int offset, int position);
> The TermVectorReader will be modified to just call the TermVectorMapper. The
> existing getTermFreqVectors will be reimplemented to use an implementation of
> TermVectorMapper that creates the parallel arrays. Additionally, some simple
> implementations that automatically sort vectors will also be created.
> This is my first draft of this API and is subject to change. I hope to have
> a patch soon.
> See
> http://www.gossamer-threads.com/lists/lucene/java-user/48003?search_string=get%20the%20total%20term%20frequency;#48003
> for related information.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
