solr-cloud documents decouple issue

2013-04-21 Thread qibaoyuan
hello,
  I have plenty of docs and each docs maybe connected to many user-defined 
tags.I have used solr-cloud, and use JOIN to do this kind of job,and recently i 
know solr-cloud does not support distributed search.AND so this is a big 
problem so far.AND the decouple is quite impossible,because docs and 
user-defined tags are so huge,and many search is always searched on these two 
fields.ANY good idea to deal with this problem?

Re: is phrase search possible in solr

2013-04-21 Thread qibaoyuan

Shingling filter may be help.

 I want to do a phrase search in solr without analyzers being applied to it 
 eg - If I search for *DelhiDareDevil* (i.e - with inverted commas)it
 should search the exact text and not apply any analyzers or tokenizers on
 this field
 However if i search for *DelhiDareDevil* it should use tokenizers and
 analyzers and split it to something like this *delhi dare devil*
 
 My schema definition for this is as follows
 
fieldType name=text class=solr.TextField
   positionIncrementGap=100 
 autoGeneratePhraseQueries=false
   analyzer type=index
   tokenizer 
 class=solr.WhitespaceTokenizerFactory /
   filter class=solr.WordDelimiterFilterFactory
   generateWordParts=1 
 generateNumberParts=1 catenateWords=1
   catenateNumbers=1 catenateAll=0 
 splitOnCaseChange=1
 preserveOriginal=1/
   filter class=solr.LowerCaseFilterFactory /
   /analyzer
   analyzer type=query
   tokenizer 
 class=solr.WhitespaceTokenizerFactory /
   filter class=solr.WordDelimiterFilterFactory
   generateWordParts=1 
 generateNumberParts=1 catenateWords=1
   catenateNumbers=1 catenateAll=0 
 splitOnCaseChange=1
 preserveOriginal=1/
   filter class=solr.LowerCaseFilter``Factory /
   /analyzer
   /fieldType
 
field name=cContent type=text indexed=true stored=true
 multiValued=false/
 
 any help would be appreciated
 
 
 
 
 --
 View this message in context: 
 http://lucene.472066.n3.nabble.com/is-phrase-search-possible-in-solr-tp4057312.html
 Sent from the Solr - User mailing list archive at Nabble.com.



solr-cloud performance decrease day by day

2013-04-19 Thread qibaoyuan
Hello,
   i am using sold 4.1.0 and ihave used sold cloud in my product.I have found 
at first everything seems good,the search time is fast and delay is slow,but it 
becomes very slow after days.does any one knows if there maybe some params or 
optimization to use sold cloud?

Re: solr-cloud performance decrease day by day

2013-04-19 Thread qibaoyuan
there are 6 shards and they are in one machine,and the jvm param is very 
big,the physical memory is 16GB,the total #docs is about 150k,the index size of 
each shard is about 1GB.AND there is indexing while searching,I USE auto commit 
 each 10min.and the data comes about 100 per minutes. 


在 2013-4-19,下午3:17,Furkan KAMACI furkankam...@gmail.com 写道:

 Could you give more info about your index size and technical details of
 your machine? Maybe you are indexing more data day by day and your RAM
 capability is not enough anymore?
 
 2013/4/19 qibaoyuan qibaoy...@gmail.com
 
 Hello,
   i am using sold 4.1.0 and ihave used sold cloud in my product.I have
 found at first everything seems good,the search time is fast and delay is
 slow,but it becomes very slow after days.does any one knows if there maybe
 some params or optimization to use sold cloud?



Re: solr-cloud performance decrease day by day

2013-04-19 Thread qibaoyuan
Thanks manu,i will check it.
在 2013-4-19,下午4:26,Manuel Le Normand manuel.lenorm...@gmail.com 写道:

 Can happen for various reasons.
 
 Can you recreate the situation, meaning restarting the servlet or server
 would start with good qTime and decrease from that point? How fast does
 this happen?
 
 Start by monitoring the jvm process, with oracle visualVM for example.
 Monitor for frequent garbage collections or unreasonable memory peacks or
 opening threads.
 Then monitor your system to see if there's an io disk latency or disk usage
 that increases in time, the writing queue to disk exploads, cpu load
 becomes heavier or network usage's exeeds limit.
 
 If you can recreate the decrease and monitor well, one of the above params
 should pop up. Fixing it after defining the problem will be easier.
 
 Good day,
 Manu
 On Apr 19, 2013 10:26 AM, qibaoyuan qibaoy...@gmail.com wrote:



solr-cloud problem about user-specified tags

2013-04-19 Thread qibaoyuan
I have plenty of docs and each docs maybe connected to many user-defined tags.I 
have used sold-cloud, and use join to do this kind of job,and recently i know 
sole-cloud does not support distributed search.AND so this is a big problem so 
far.AND the decomposition is quite impossible,because docs and user-defined 
docs are so huge,and many search is always searched on these two fields.ANY 
good idea to deal with this problem??