Data storage By Lucene

2014-01-21 Thread Yanan Zhu
I use lucene instead of the database without the transaction. Is there a better way to access storage field? How can I compress the stored field? Is this the right way to do it?

BytesRef equals() method

2014-01-21 Thread Yann-Erwan Perio
Hello, I have been working a bit with BytesRef recently, and I wonder whether the content of the equals() method, and more specifically the content of the bytesEquals(BytesRef other) method, is the intended one. Here is my use case. I work with Lucene 4.6.0. During indexing, using a custom tokeni

Re: Issue with FacetFields.addFields() throwing ArrayIndexOutOfBoundsException

2014-01-21 Thread Matthew Petersen
Will do. I need to sanitize the unit test a bit so it might be a few days. On Fri, Jan 17, 2014 at 9:24 PM, Shai Erera wrote: > Can you open an issue and attach the test there? > On Jan 18, 2014 12:41 AM, "Matthew Petersen" wrote: > > > I do have a test that will reproduce. I'm not adding ca

Re: BytesRef equals() method

2014-01-21 Thread Steven Schlansker
On Jan 21, 2014, at 7:32 AM, Yann-Erwan Perio wrote: > Hello, > > I have been working a bit with BytesRef recently, and I wonder whether > the content of the equals() method, and more specifically the content > of the bytesEquals(BytesRef other) method, is the intended one. > > I was made awar

updating docs when using SortedSetDocValuesFacetFields

2014-01-21 Thread Rose, Stuart J
I'm using Lucene 4.4 with SortedSetDocValuesFacetFields and would like to add and/or remove CategoryPaths for certain documents in the index. Basically, as additional sets of docs are added, the CategoryPaths for some of the previously indexed documents need to changed. My current testing with

RE: BytesRef equals() method

2014-01-21 Thread Rose, Stuart J
I agree that comparing the BytesRef lengths in an equals() method seems counter to the purpose of having a BytesRef class. I'd recommend taking a look at the BytesRefHash which maps BytesRef objects to unique ids as it 'may' be more efficient than converting to Strings. Stuart -Original

Re: BytesRef equals() method

2014-01-21 Thread Michael Sokolov
Note the comments in the source: /** Length of used bytes. */ public int length; length is not the same as the size of the internal buffer. It is the number of used bytes, so the length of the "logical" value as you call it. -Mike On 1/21/2014 10:32 AM, Yann-Erwan Perio wrote: Hello,

Re: BytesRef equals() method

2014-01-21 Thread Yann-Erwan Perio
On Tue, Jan 21, 2014 at 7:54 PM, Steven Schlansker wrote: Hi, Firstly, thanks to all of you for your insights. > How can two byte arrays be equal if they have different lengths? > Same way as two Strings with differing lengths can never be equal, two > byte arrays with different lengths will ne