Re: custom segment files

2009-09-18 Thread John Wang
ifferenct codecs for > >> reading/writing the terms dict and doc/freq/prox/payload postings. > >> I'm working now towards getting PforDelta working... > >> > >> However, that change doesn't [yet] do anything for norms, stored > >> fields nor te

Re: custom segment files

2009-09-18 Thread Michael McCandless
stored >> fields nor term vectors. >> >> Can you describe more details about what kinds of customization you're >> looking to do? >> >> Mike >> >> On Thu, Sep 17, 2009 at 10:00 AM, John Wang wrote: >> > Hi guys: >> > >>

Re: custom segment files

2009-09-18 Thread Earwin Burrfoot
> > Can you describe more details about what kinds of customization you're > looking to do? > > Mike > > On Thu, Sep 17, 2009 at 10:00 AM, John Wang wrote: >> Hi guys: >> >>      I am trying to figure how to add the ability to create custom segment

Re: custom segment files

2009-09-17 Thread Jason Rutherglen
gt;> IW.getReader().getSequentialSubReaders (by comparing the before >> and after). >> >> Adjacent segment files could then be maintained without hacking into >> SegmentMerger. >> >> On Thu, Sep 17, 2009 at 7:00 AM, John Wang wrote: >> > Hi guys: >&g

Re: custom segment files

2009-09-17 Thread Marvin Humphrey
On Fri, Sep 18, 2009 at 08:14:24AM +0800, John Wang wrote: > Say you have a type of field with fixed length data per doc, e.g. a 8 bytes. > It might be good to store in a segment: > Heh. You've just described this proof of concept class: http://www.rectangular.com/kinosearch/docs/deve

Re: custom segment files

2009-09-17 Thread John Wang
ger. > > On Thu, Sep 17, 2009 at 7:00 AM, John Wang wrote: > > Hi guys: > > > > I am trying to figure how to add the ability to create custom > segment > > files. Hopefully it is possible to create a plugin framework where one > can > > provide some s

Re: custom segment files

2009-09-17 Thread Jason Rutherglen
thout hacking into SegmentMerger. On Thu, Sep 17, 2009 at 7:00 AM, John Wang wrote: > Hi guys: > > I am trying to figure how to add the ability to create custom segment > files. Hopefully it is possible to create a plugin framework where one can > provide some sort of callback to ad

Re: custom segment files

2009-09-17 Thread John Wang
00 AM, John Wang wrote: > > Hi guys: > > > > I am trying to figure how to add the ability to create custom > segment > > files. Hopefully it is possible to create a plugin framework where one > can > > provide some sort of callback to add to a segment giv

Re: custom segment files

2009-09-17 Thread Michael McCandless
an you describe more details about what kinds of customization you're looking to do? Mike On Thu, Sep 17, 2009 at 10:00 AM, John Wang wrote: > Hi guys: > > I am trying to figure how to add the ability to create custom segment > files. Hopefully it is possible to create

[jira] Created: (LUCENE-1914) allow for custom segment files

2009-09-17 Thread John Wang (JIRA)
allow for custom segment files -- Key: LUCENE-1914 URL: https://issues.apache.org/jira/browse/LUCENE-1914 Project: Lucene - Java Issue Type: Improvement Components: Index Affects Versions: 2.9

custom segment files

2009-09-17 Thread John Wang
Hi guys: I am trying to figure how to add the ability to create custom segment files. Hopefully it is possible to create a plugin framework where one can provide some sort of callback to add to a segment given a doc and provide some sort of merge logic. This is in light of the flexible