Re: Can solr index folder can be moved from one system to another?

2012-03-21 Thread ravicv
Hi Tomás, I can not use Solr replcation in my scenario. My requirement is to gzip the solr index folder and send to dotnet system through webservice. Then in dotnet the same index folder should be unzipped and same folder should be used as an index folder through solrnet . Whether my requirement

Why does parameter "useCompoundFile" not work?

2012-03-21 Thread 梅诚
Dear all, I want to generate compound type index instead of files contain fdt,fdx etc. I follow the suggestion to change the "useCompoundFile" parameter to true (both in indexDefaults and mainIndex) in solrconfig.xml, but when i use post.jar to post example xml file (solr.xml), i find the index i

Re: Multi-valued polyfields - Do they exist in the wild ?

2012-03-21 Thread Mikhail Khludnev
Hello, The most promising approach for doing this is BlockJoinQuery. Here is the great intro http://blog.mikemccandless.com/2012/01/searching-relational-content-with.html. This query and lowlevel indexing support is implemented in Lucene. Some work is in progress for Solr https://issues.apache.org

Re: url-encoded strings from Admin Query String search

2012-03-21 Thread Shawn Heisey
On 3/21/2012 9:04 PM, Shawn Heisey wrote: The admin screen is made for doing a quick query against the default field with the settings defined in the default search handler. To that end, it assumes that all entered characters should be part of the search string, so it encodes them accordingly.

Re: url-encoded strings from Admin Query String search

2012-03-21 Thread Shawn Heisey
On 3/21/2012 5:41 PM, Aaron Couch wrote: select/?q=t_title%3Aweb%26defType%3Dlucene The '&' and '%26' are not equivalent as well as the '=' and '%3D'. I know I could easily just type the queries correctly in the URL, but I'm giving a training where I'd like to show how the queries generated in

Re: Grouping queries

2012-03-21 Thread Jamie Johnson
I need to apologize I believe that in my example I have too grossly over simplified the problem and it's not clear what I am trying to do, so I'll try again. I have a situation where I have a set of access controls say user, super user and ultra user. These controls are not necessarily hierarchic

Unable to get solr server to initialize

2012-03-21 Thread nm
Hello everyone, Iam trying to get Solr installed using apache solr 3.5.0, Java 1.6.0, and Drupal 7. I am able to log in through ssh, navigate to apache-solr-3.5.0/example, and run java -jar start.jar. After that, however, trying to access either localhost:8983/solr/admin or localhost:8983/sol

Re: Grouping queries

2012-03-21 Thread Jamie Johnson
Join looks interesting for this as well, is this currently supported in SolrCloud? On Wed, Mar 21, 2012 at 6:56 PM, Jamie Johnson wrote: > What would you recommend instead, I had thought about block join perhaps I'm > open to suggestions tbough > > > On Wednesday, March 21, 2012, Martijn v Gronin

Re: url-encoded strings from Admin Query String search

2012-03-21 Thread Aaron Couch
Thanks again for the follow-up. You are correct that '%3A' and ':' are equivalent. However if I type anything else, for example if I want to change the query parser to Lucene, the responseHeader returns an empty set. If I type in the /admin screen: t_FIELD_NAME:TEST&defType=lucene I get: selec

Re: Grouping queries

2012-03-21 Thread Jamie Johnson
What would you recommend instead, I had thought about block join perhaps I'm open to suggestions tbough On Wednesday, March 21, 2012, Martijn v Groningen < martijn.v.gronin...@gmail.com> wrote: > I'm not sure if grouping is the right feature to use for your > requirements... Grouping does have an

Re: Solr group witch minimum count in each group

2012-03-21 Thread Martijn v Groningen
Filtering results based on group count isn't supported yet. There is already an issue created for this feature: https://issues.apache.org/jira/browse/SOLR-3152 Martijn On 21 March 2012 11:52, ViruS wrote: > Hi, > > I try to get all duplicated documents in my index. > I have signature field and

Re: Grouping queries

2012-03-21 Thread Martijn v Groningen
I'm not sure if grouping is the right feature to use for your requirements... Grouping does have an impact on performance which you need to take into account. Depending on what grouping features you're going to use (grouped facets, ngroups), grouping performs well on large indices if you use filter

Solr / Tika crashing when attempting to index large files

2012-03-21 Thread vybe3142
While waiting for someohe to help answer my multicore config issue :),... I decided to test SOLR's limits on a single instance/core config. We occasionally need to index large text files (that must not be broken up). This results in an out of memory error. I tried increasing tomcat's heap size to

Grouping queries

2012-03-21 Thread Jamie Johnson
I was wondering how much more intensive grouping queries are in general. I am considering using grouping queries as my primary query because I have the need to store a document as pieces with varying access controls, for instance a portion of a document a user can see but an admin can see the enti

Re: Multi-valued polyfields - Do they exist in the wild ?

2012-03-21 Thread Lance Norskog
(Currency has one value and a dynamic table of currency->conversion. The field type does the conversion calculations on the fly.) To pick particular values, you have to do your own search inside the returned array. On Wed, Mar 21, 2012 at 1:25 PM, wrote: > Hi Yonik: >    Thanks, I am looking a

RE: org.apache.solr.common.SolrException: Internal Server Error

2012-03-21 Thread Welty, Richard
yes. when i have seen these, generally the full trace is good about including the exception that triggered the whole thing, you just need to look down the trace aways to find it. richard -Original Message- From: vybe3142 [mailto:vybe3...@gmail.com] Sent: Wed 3/21/2012 4:58 PM To: solr-

Re: org.apache.solr.common.SolrException: Internal Server Error

2012-03-21 Thread vybe3142
Try to obtain the server trace, That should tell you what specifically the error is -- View this message in context: http://lucene.472066.n3.nabble.com/org-apache-solr-common-SolrException-Internal-Server-Error-tp3842862p3846821.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: copyField question

2012-03-21 Thread ramdev.wudali
Hi Tomás: I think there is simplicity in your solution ;) A document would have Tens of different values. (at the most 20)Š So If were to follow your suggestion of naming a dynamic field with the value as the name of the field and the corresponding Score as the value. How would I go about chan

Re: Multi-valued polyfields - Do they exist in the wild ?

2012-03-21 Thread ramdev.wudali
Hi Yonik: Thanks, I am looking a field (example: Currency) which can have multiple values within a document (I.e. Different currencies and corresponding conversion rates). I would like to store that information as part of one multivalued field. Even better would be a solution that upon queried

Re: copyField question

2012-03-21 Thread Tomás Fernández Löbbe
> However, If the multivalued complex data field is not possible. Is it possible to use copyField directive to copy fields if a certain score is higher than a threshold ? I don't think that's possible out of the box, but you could use custom UpdateRequestProcessor for for that. How many different

copyField question

2012-03-21 Thread ramdev.wudali
Hi: Is it it possible to store a value and a corresponding score in Solr as part of a single Field definition. And Can this field be a multivalued field ? I have several terms that are score. I would like to store them as part of a single field definition rather than having to create two diffe

Re: Can't locate contrib jars (solr 3.5 / solr 4) when indexingt

2012-03-21 Thread vybe3142
My Latest attempt: With the dist and contrib directories as subdirectories of "solrhost". Now, tomcat seems to load the jars (see log below) but I still get the MimeTypeException when I try to index a file http://pastebin.com/VuB4yauP -- View this message in context:

Re: Can't locate contrib jars (solr 3.5 / solr 4) when indexingt

2012-03-21 Thread vybe3142
For the record etc doesn't work either -- View this message in context: http://lucene.472066.n3.nabble.com/Can-t-locate-contrib-jars-solr-3-5-solr-4-when-indexingt-tp3846464p3846472.html Sent from the Solr - User mailing list archive at Nabble.com.

Can't locate contrib jars (solr 3.5 / solr 4) when indexingt

2012-03-21 Thread vybe3142
I've had this issue trying to set up a multi core solr instance. It's obviously something basic I'm overlooking in the jar loading since the basic solr install works. The required classes should be in the jars located in the dist or contrib/*/lib dirs. SEVERE: null:java.lang.RuntimeException: java

Re: org.apache.solr.common.SolrException: Internal Server Error

2012-03-21 Thread Erick Erickson
Please review: http://wiki.apache.org/solr/UsingMailingLists At a minimum we need the full stack trace, solr version, etc. in order to have a clue where to start. Best Erick On Tue, Mar 20, 2012 at 12:12 PM, qingwei201314 <87863...@qq.com> wrote: > I use the solrJ to index a pdf file. >        

Re: querying on shards

2012-03-21 Thread Erick Erickson
I'd _really_ recommend that you do not do this unless and until it's provably necessary. As Shawn says, the load on the shards that return nothing will probably be very low. And this is the kind of thing that one spends endless hours debugging. Somehow, sometime, I flat guarantee you'll be trying t

Bulk insertion in solr

2012-03-21 Thread Suneel
Hello Friends, I am using sql data base and importing data in solr by using DIH. now my data have increase its taking lot of time, i want bulk insert i have tried but not got any article of net. please provide me some example to write the script to bulk insertion from sql to solr. this will be ve

Re: url-encoded strings from Admin Query String search

2012-03-21 Thread fbrisbart
I'm not sure to understand your problem. The 2 urls : .../select/?q=t_FIELD_NAME%3ATEST and .../select/?q=t_FIELD_NAME:TEST are strictly the same. Look in the 'responseHeader', you'll see that query received is t_FIELD_NAME:TEST for both urls. Franck Le mercredi 21 mars 2012 à 12:36 -0500, Aa

Re: url-encoded strings from Admin Query String search

2012-03-21 Thread Aaron Couch
hi Franck; Thank you for your response. I'm not sure you understand my issue however. I have dismax on by default so am able to use query fields. My problem is not in the queries themselves, but when they are input from the '/admin' screen they are url-encoded. If I take your suggestion and type

Re: Disseminate results from different sources

2012-03-21 Thread Tanguy Moal
Hello Franck, I've had the same issue in the past. I addressed that by adding a random value to each document. I use this value in the "bf" parameter, so that the random value alters more or less the documents' score. This results in a natural shuffling of documents which had the same score

Re: Disseminate results from different sources

2012-03-21 Thread Emmanuel Espina
In general the algorithm considers what is more relevant and probably you should check why one kind of result is giving always higher scores than the others. Are you using norms (not setting omitNorms = true). With debugQuery=true you can get a detail of how the score is calculated. That would be

Re: url-encoded strings from Admin Query String search

2012-03-21 Thread fbrisbart
Hi, for your example query 'TEST&qf=t_FIELD_NAME ', you can simply query : t_FIELD_NAME:TEST If you really want to use the 'qf' parameter, it is only available for dismax queries ( http://wiki.apache.org/solr/DisMaxQParserPlugin ). Your query becomes: {!dismax qf=t_FIELD_NAME}TEST Have a look at

Re: SolrCloud replica and leader out of Sync somehow

2012-03-21 Thread Jamie Johnson
Given that in a distributed environment the docids are not guaranteed to be the same across shards should the sorting use the uniqueId field as the tie breaker by default? On Tue, Mar 20, 2012 at 2:10 PM, Yonik Seeley wrote: > On Tue, Mar 20, 2012 at 2:02 PM, Jamie Johnson wrote: >> I'll try to

Re: Staggering Replication start times

2012-03-21 Thread Shalin Shekhar Mangar
What William said was the original motivation to sync all slaves to poll approximately at the same time. On Tue, Mar 20, 2012 at 10:38 PM, William Bell wrote: > For our use case this is a no-no. When the index is updated, we need > all indexes to be updated at the same time. > > We put all index

Rescoring queries

2012-03-21 Thread Benson Margulies
I confess that I did only minimal googling before composing the below. I would like to be able to insert my own code into Solr to rescore query results. To be more specific, I'd like to send Solr a query in which some additional information is attached to the query. After Solr has done the usual q

Re: whethere solr 3.3 index file is compatable with solr 4.0

2012-03-21 Thread Vadim Kisselmann
you have to re-index your data. best regards vadim 2012/3/21 syed kather : > Team > > I have indexed my data with solr 3.3 version , As I need to use > hierarchical facets features from solr 4.0 . > Can I use the existing data with Solr 4.0 version or should need to > re-index the data with new

whethere solr 3.3 index file is compatable with solr 4.0

2012-03-21 Thread syed kather
Team I have indexed my data with solr 3.3 version , As I need to use hierarchical facets features from solr 4.0 . Can I use the existing data with Solr 4.0 version or should need to re-index the data with new version? Thanks and Regards, S SYED ABDUL KATHER

Solr 4.0 replication problem

2012-03-21 Thread Hakan İlter
Hi everyone, We are using very early version of Solr 4.0 and we've some replication problems. Actually we used this build more than one year without any problem but when I made some changes on schema.xml, the following problem started. I've just changed schema.xml with adding multiValued="true" a

Disseminate results from different sources

2012-03-21 Thread fbrisbart
Hi all, I have, in my dataset, documents from different sources (forum, news, reviews, ...) And I'd like to have a mix of them in my search results. The problem is that, depending only on the relevance, the results are often grouped by source (Ex.:50 'forum' docs before the first 'review' doc) S

Re: Can solr index folder can be moved from one system to another?

2012-03-21 Thread Tomás Fernández Löbbe
Yes, you can use replication: http://wiki.apache.org/solr/SolrReplication On Wed, Mar 21, 2012 at 5:07 AM, ravicv wrote: > Hi > I have requirement to index data using solr in server and move the index > folder to all clients through webservice. > > Is it possible to move the index folder? > If s

SolrCloud with Tomcat and external Zookeeper, does it work?

2012-03-21 Thread Vadim Kisselmann
Hello folks, i read the SolrCloud Wiki and Bruno Dumon's blog entry with his "First Exploration of SolrCloud". Examples and a first setup with embedded Jetty and ZK WORKS without problems. I tried to setup my own configuration with Tomcat and an external Zookeeper(my Master-ZK), but it doesn't wo

Best way to index huge data quickly in solr multi core configuration

2012-03-21 Thread ravicv
Hi I am using Oracle Exadata as my DB. I want to index nearly 4 crore rows. I have tried with specifing batchsize as 1. and with out specifing batchsize. But both tests takes nearly same time. Could anyone suggest me best way to index huge data Quickly? Thanks Ravi -- View this message in