StoredField

2013-03-17 Thread eksdev
is there any way to get ByteRef from a field originally stored as String? I am playing with Sorter to implement StoredDocSorter, analogous to NumericDocValuesSorter. But realised I do not need ByteRef - String conversion just to compare fields (byte order would be as good for sorting)

Re: StoredField

2013-03-17 Thread eksdev
… On Mar 17, 2013, at 1:53 PM, Shai Erera ser...@gmail.com wrote: You can do new BytesRef(d1.get(fieldName)). Shai On Sun, Mar 17, 2013 at 2:43 PM, eksdev eks...@googlemail.com wrote: is there any way to get ByteRef from a field originally stored as String? I am playing with Sorter

Re: StoredField

2013-03-17 Thread eksdev
, 2013 at 3:02 PM, eksdev eks...@googlemail.com wrote: Shai, was that irony or I am missing something big time? I would like to spare BytesRef - String conversion, not to introduce another one back to BytesRef Simply, for sorting, you do not need to do this byte[]-String conversion, byte

Re: StoredField

2013-03-17 Thread eksdev
for it! It also improved compression by 12% (very small, 4k chunk size) On Mar 17, 2013, at 5:26 PM, Adrien Grand jpou...@gmail.com wrote: Hi, On Sun, Mar 17, 2013 at 2:58 PM, eksdev eks...@googlemail.com wrote: sure, there is a way to make anything - byte[] ;) it looks like this byte[]-type

Re: [jira] [Commented] (LUCENE-3918) Port index sorter to trunk APIs

2013-03-06 Thread eksdev
humpf, do we actually need stored fields? What is wrong with having byte[] DV that stores all document fields, e.g. avro or something simpler to serialise all document fields into one byte[]? I am definitely missing something about DV/Stored fields diff, not sure what? On Mar 6, 2013,

Win7 64bit, jvm 7 and MMAP OOM

2013-01-22 Thread eksdev
Just to share some experience if someone hits the same problem. We had huge problems on Win7 64bit, JVM 64bit 1.7.0_07, (a few days old trunk version, 5.0, default codec) solr under tomcat thread queue limited to 20 . NRTCaching and MMAP have the same problems (no updates , just search).

Re: [jira] [Commented] (SOLR-4032) Unable to replicate between nodes ( read past EOF)

2012-11-27 Thread eksdev
thanks Mark! On Nov 27, 2012, at 8:43 PM, Mark Miller (JIRA) j...@apache.org wrote: [ https://issues.apache.org/jira/browse/SOLR-4032?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13504875#comment-13504875 ] Mark Miller commented on

Re: Compressed stored fields and multiGet(sorted luceneId[])?

2012-11-08 Thread eksdev
On Nov 8, 2012, at 11:30 AM, Robert Muir rcm...@gmail.com wrote: Thanks everybody for response, and much more of the same for the great project Why are you retrieving thousands of stored fields? I do not think it is all that rare that people actually do something with information but

Compressed stored fields and multiGet(sorted luceneId[])?

2012-11-07 Thread eksdev
Just a theoretical question, would it make sense to add some sort of StoredDocument[] bulkGet(int[] docId) to fetch multiple stored documents in one go? The reasoning behind is that now with compressed blocks random-access gets more expensive, and in some cases a user needs to fetch more

Re: java.lang.NoSuchMethodError: org.apache.lucene.search.Scorer.freq()

2012-11-02 Thread eksdev
I *think* I did. Will try to build again... On Nov 2, 2012, at 1:12 PM, Simon Willnauer simon.willna...@gmail.com wrote: did you clean your checkout? simon On Fri, Nov 2, 2012 at 1:10 PM, eksdev eks...@googlemail.com wrote: debugQuery=true on on simple TermQuery (/trunk version from

Re: java.lang.NoSuchMethodError: org.apache.lucene.search.Scorer.freq()

2012-11-02 Thread eksdev
clean did it, never use eclipse if you want to know exactly what you did, command line works always sorry for the noise On Nov 2, 2012, at 1:15 PM, eksdev eks...@googlemail.com wrote: I *think* I did. Will try to build again... On Nov 2, 2012, at 1:12 PM, Simon Willnauer simon.willna