Re: Searching and sorting over multiple collections

2012-08-28 Thread Per Steffensen
Per Steffensen skrev: Hi Due to what we have seen in recent tests I got in doubt how Solr search is actually supposed to behave * Searching with "distrib=true&q=*:*&rows=10&collection=x,y,z&sort=timestamp asc" ** Is Solr supposed to return the 10 documents with the lowest timestamp across a

Antwort: Re: refiltering search results

2012-08-28 Thread Johannes . Schwendinger
The main idea is to filter results as much as possible with solr an then check this result again. To do this I have to read some information from some fields of the documents in the result. At the moment I am trying to do this in the process method of a Search Component. But I even dont know

Re: Solr - Index Concurrency - Is it possible to have multiple threads write to same index?

2012-08-28 Thread Lance Norskog
SolrCloud supports this dynamic addition. SolrCloud makes copies of the source documents and every Solr instances does its own indexing. With replication, you only create the indexes once. When storing very large documents, this is worthwhile. The only use cases I have seen for EmbeddedSolrServer

Re: Auto commit exception in Solr 4.0 Beta

2012-08-28 Thread Chris Hostetter
: Perfect. I reindexed the whole index and everything worked fine. The : exception was just a little bit confusing. Dirk: I'm glad you were able to work arround this, but it's definitely suprising to me thta you got this exception, because it doesn't match my understanding of what is supported

Re: AW: AW: auto completion search with solr using NGrams in SOLR

2012-08-28 Thread Kiran Jayakumar
Since you have , during indexing time, it is going split the text on white spaces and then apply edge n-grams. If you remove this & may be replace it with a simpler regex which does basic clean up like removing multiple white spaces etc., then it will not match on the beginning of non-first words.

Re: SOLR 4 Alpha - distributed DIH available?

2012-08-28 Thread Chris Hostetter
: can someone let me know how to configure DIH in a cloud environment, should : it point to one specific server or to the load balancer for distributing dih : on all the servers. : One problem with the load balancer approach is that there is no good way to : tell whether a dih is already running

Re: need help understanding an issue with scoring

2012-08-28 Thread geeky2
Chris, Jack, thank you for the detailed replies and help ;) -- View this message in context: http://lucene.472066.n3.nabble.com/need-help-understanding-an-issue-with-scoring-tp4002897p4003782.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr Score threshold 'reasonably', independent of results returned

2012-08-28 Thread Chris Hostetter
: Not really. The percentage given in other search packages is fairly : bogus. You have to do a global batch analysis of all of the index to : get a true scale for relevance. Exactly... https://wiki.apache.org/solr/FAQ#Why_Aren.27t_Scores_returned_as_a_percentage.3F_How_Do_I_normalize_Scores.3F

Re: What are the available parameters in field tag in schema.xml, and data-config.xml ?

2012-08-28 Thread Chris Hostetter
: Here is the full list: : http://wiki.apache.org/solr/SchemaXml#Common_field_options Just to be clear, that is not the "full" list that might exist for any field type -- that is the list of options that exist for all field types. individual field types might define thier own options (ie: the T

Re: need help understanding an issue with scoring

2012-08-28 Thread Chris Hostetter
: What is your query and "qf"? FYI: these are both inlcuded in the original message (which was also quoted in the reply below) As jack points out, the differnece in score comes from thediffernece in which fields are matched on. Your high scoring example doc matches on *both* the itemNo and

Re: Solr Master/Slave setup issue

2012-08-28 Thread Chris Hostetter
: ${enable.slave:false} : http://localhost:8080/ndxservice/registry/replication ... : In above config, I did the enable/disable of solr/master using : solrcore.properties file, : but I want set up the masterUrl from java code or my app setting.xml. How i

RE: Injest pauses

2012-08-28 Thread Voth, Brad (GE Corporate)
Thanks for the insight on the merge config. That bit makes a bit more sense to me now. Though in digging more it looks like my primary issue is less to do with the merging and more to do with flushes from rambuffer -> disk. I've spent most of the morning digging through the lucene code to dr

Re: More debugging DIH - URLDataSource (solved)

2012-08-28 Thread Carrie Coy
Thank you for these suggestions. The real problem was incorrect syntax for the primary key column in data-config.xml. Once I corrected that, the data loaded fine. wrong: Right: On 08/25/2012 08:52 PM, Lance Norskog wrote: About XPaths: the XPath engine does a limited range of xpat

Re: The way to customize ranking?

2012-08-28 Thread Chris Hostetter
: I'm working on Solr to build a local business search in China. We have a : special requirement from advertiser. When user makes a search, if the : results contain paid advertisements, those ads need to be moved on the top : of results. For different ads, they have detailed rules about which come

Re: Solr Master/Slave setup issue

2012-08-28 Thread Ahmet Arslan
--- On Tue, 8/28/12, bsargurunathan wrote: > From: bsargurunathan > Subject: Re: Solr Master/Slave setup issue > To: solr-user@lucene.apache.org > Date: Tuesday, August 28, 2012, 8:54 PM > Hi iorixxx, > Thanks for the updates, its really helpful for me. But I > want one more > clarification, >

Re: Solr Master/Slave setup issue

2012-08-28 Thread bsargurunathan
Hi iorixxx, Thanks for the updates, its really helpful for me. But I want one more clarification, I am setting up the solrcofig.xml like as follows, ${enable.master:false} commit schema.xml,stopwords.txt

Re: Injest pauses

2012-08-28 Thread Shawn Heisey
On 8/27/2012 2:54 PM, Voth, Brad (GE Corporate) wrote: Hello all, I'm working on implementing a solution in a very high index rate, lower query rate project. We have a very small record size, 2 small strings, 6 longs, 7 ints, and 2 dates, indexing on 8 of those fields. We need to be able to

Re: SOLR 4 BEAT - More Like This

2012-08-28 Thread Shawn Heisey
On 8/28/2012 5:47 AM, Nick Koton wrote: I am having difficulty getting MLT to work with a cloud configuration in SOLR 4 beta. I have reproduced it with the "example" schema and data from the distribution: http://hostname:8983/solr/example/select? q=id:VDBDB1A16&mlt=true&mlt.fl=text,features,name

Re: refiltering search results

2012-08-28 Thread Ahmet Arslan
> Im trying to develop a search component to filter the search > results agein > with current data so that the user only sess results he is > permitted to > see. > > Can someone give me a hint where to start and how to do > this? Is a Search > Component the right place to do this? May you can

Re: Query Time problem on Big Index Solr 3.5

2012-08-28 Thread Jack Krupansky
I did notice that you use a lot of the sint/slong/sdouble field types instead of the default int/long/double which are now the much more efficient trie field types, even in Solr 3.5. I have no idea how much of your lackluster performance is due to sint, et al, but I am sure that is a contributi

RES: Data Import Handler - Could not load driver - com.microsoft.sqlserver.jdbc.SQLServerDriver - SOLR 4 Beta

2012-08-28 Thread Claudio Ranieri
Hi Adam, Try to add the parameter sharedLib="lib" in $SOLR_HOME/solr.xml (). Copy all jars of Solr to $SOLR_HOME/lib (including the sqljdbc4.jar) I already a problem with classloader in solr 4.0 and I solved with this configuration. -Mensagem original- De: awb3667 [mailto:adam.bu...@peo

RE: solr 4 degraded behavior failure

2012-08-28 Thread Chris Hostetter
: Is there a way to make the shards.tolerant=true behavior the default behavior? look at the comments in the example solrconfig.xml about adding "defaults" paramaters to your request handler configuration. -Hoss

RE: Solr 4.0 - Join performance

2012-08-28 Thread Eric Khoury
David, Solr support for this will come in Solr-3304 I suppose?http://wiki.apache.org/solr/SolrAdaptersForLuceneSpatial4Any idea if this is going to make it into Solr 4.0? Thanks,Eric. > Date: Wed, 15 Aug 2012 07:07:21 -0700 > From: dsmi...@mitre.org > To: solr-user@lucene.apache.org > Subject:

Re: refiltering search results

2012-08-28 Thread Alexandre Rafalovitch
I think there was a JOIN example (for version 4) somewhere with the permission restrictions. Or, if you have very broad categories, you can use different search handlers with restriction queries baked in. These might be enough. Otherwise, you have to send the list of IDs back and forth and it coul

Re: Data Import Handler - Could not load driver - com.microsoft.sqlserver.jdbc.SQLServerDriver - SOLR 4 Beta

2012-08-28 Thread awb3667
Correction. That DID work! Thanks everyone. -Adam -- View this message in context: http://lucene.472066.n3.nabble.com/Data-Import-Handler-Could-not-load-driver-com-microsoft-sqlserver-jdbc-SQLServerDriver-SOLR-4-Beta-tp4002902p4003731.html Sent from the Solr - User mailing list archive at Nabbl

Re: Data Import Handler - Could not load driver - com.microsoft.sqlserver.jdbc.SQLServerDriver - SOLR 4 Beta

2012-08-28 Thread awb3667
Thanks for the suggestion. I went ahead and added that line to the solrconfig.xml where the lib directives are. When I do a full import, i am still seeing the sql driver error. Has anyone been able to use DIH with SQL Server in 4.0 yet? If so, did you run into this issue? Thanks. -Adam -- View

RE: Injest pauses

2012-08-28 Thread Voth, Brad (GE Corporate)
I've noticed the following messages in the infostream log around the times the pauses begin... DW 0 [Tue Aug 28 13:25:29 UTC 2012; qtp435584308-969]: WARNING DocumentsWriter has stalled threads; waiting From: Voth, Brad (GE Corporate) Sent: Monday, Aug

refiltering search results

2012-08-28 Thread Johannes . Schwendinger
Hello, Im trying to develop a search component to filter the search results agein with current data so that the user only sess results he is permitted to see. Can someone give me a hint where to start and how to do this? Is a Search Component the right place to do this? Regards Johannes

Re: Solr and Tomcat - problem with unicode characters

2012-08-28 Thread zehoss
I found my mistake. I've forget to set encoding do curl options curl_setopt($ch, CURLOPT_HTTPHEADER, array('Content-Type: application/json; charset=UTF-8', 'Content-Length: '.strlen($data))); So, thank you for attention and have a nice day :) -- View this message in context: http://lucene.472

Re: AW: AW: auto completion search with solr using NGrams in SOLR

2012-08-28 Thread Ahmet Arslan
You need to use quotes in your query : http://localhost:8080/test/suggest/?q="michael f" --- On Tue, 8/28/12, aniljayanti wrote: > From: aniljayanti > Subject: Re: AW: AW: auto completion search with solr using NGrams in SOLR > To: solr-user@lucene.apache.org > Date: Tuesday, August 28, 2012

Re: Solr and Tomcat - problem with unicode characters

2012-08-28 Thread zehoss
I just dump (PHP) json response and show in web browser. Please note that for the same request I have some results on Jetty but no results on Tomcat. That's why I think this is probably problem with Tomcat configuration. When I search for something in catalina.out I get Aug 28, 2012 2:24:43 PM o

Re: Solr Master/Slave setup issue

2012-08-28 Thread Ahmet Arslan
> Can you please share some samples for > that? > I cant see anywhere that solrcore.properties file in my > solr-3.5 package. > Can you please explain somewhat depth? You need to create it by yourself. Create a solrcore.properties file under conf directory. This example talks about using same s

Re: Solr and Tomcat - problem with unicode characters

2012-08-28 Thread François Schiettecatte
What is probably going on is that the response is not being interpreted as UTF-8 but as some other encoding. What are you using to display the response? François On Aug 28, 2012, at 8:08 AM, zehoss wrote: > Hi, > at the beginning I would like to sorry for my english. I hope my message > will

Solr and Tomcat - problem with unicode characters

2012-08-28 Thread zehoss
Hi, at the beginning I would like to sorry for my english. I hope my message will be communicative. I would like to ask you for help with Solr running on Tomcat 6. I have configured Tomcat's Connector like this: But still I have problem with unicode chars. My application sends query string to

SOLR 4 BEAT - More Like This

2012-08-28 Thread Nick Koton
I am having difficulty getting MLT to work with a cloud configuration in SOLR 4 beta. I have reproduced it with the "example" schema and data from the distribution: http://hostname:8983/solr/example/select? q=id:VDBDB1A16&mlt=true&mlt.fl=text,features,name,sku,id,manu,cat,title,desc ription,keywor

Query Time problem on Big Index Solr 3.5

2012-08-28 Thread mpcmarcos
Hello, I have a problem, I'm working with Solr 3.5, with a index that has 8.000.000 of documents (13Gb), each document has a lot of fields, I include the schema at bottom the message for more information. The query time is very high, a simple query has a query time of 300-1.000 ms, and a complex

Re: Solr Master/Slave setup issue

2012-08-28 Thread bsargurunathan
Can you please share some samples for that? I cant see anywhere that solrcore.properties file in my solr-3.5 package. Can you please explain somewhat depth? Thanks, Guru -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Master-Slave-setup-issue-tp4003667p4003675.html S

Re: Solr Master/Slave setup issue

2012-08-28 Thread Ahmet Arslan
> And I added following things in Slave solrconfig.xml, > > class="solr.ReplicationHandler" > >         >           name="masterUrl">http://172.16.17.64:8080/ndxservice/registry/replication/ >           name="pollInterval">00:00:60 >         > > > So, my problem is, I want to avoid the hot code

Re: Problem building Solr4 beta sources

2012-08-28 Thread Antoine LE FLOC'H
Chris, My fault, the DNS changed yesterday at the hosting facility, it could not resolve repo1.maven.org Here is the full log herebelow Thanks anyway lefl@devxml1:~/tools$ cd apache-solr-4.0.0-BETA/ lefl@devxml1:~/tools/apache-solr-4.0.0-BETA$ ant compile Buildfile: /home/lefl/tools/apache-sol

Solr Master/Slave setup issue

2012-08-28 Thread bsargurunathan
Hi Guys, I have a problem with Solr Master/Slave setup. Please clarify me. I added the following things in my Master solrconfig.xml commit startup schema.xml,stopwords.txt And I added following things in Slave solrconfig.xml, http:/

Re: Problem to start solr-4.0.0-BETA with tomcat-6.0.20

2012-08-28 Thread Vadim Kisselmann
Hi Claudio, great to hear that it works. Everyone can edit the wiki, you need only to login. Regards Vadim 2012/8/27 Claudio Ranieri : > I solved the problem. > I added the parameter sharedLib="lib" in $SOLR_HOME/solr.xml ( persistent="true" sharedLib="lib">) and moved all jars into > $TOMCAT_HO

Frequently Updated Index and Caching

2012-08-28 Thread deniz
Hi All, If we are updating out index very frequently on some fields, do we still need to use caching or we can simply disable it? http://wiki.apache.org/solr/SolrCaching#Overview After reading this part I feel like a frequently updated index wont need a cache for performance, as its data will b