Re: Chaining plugins

2013-12-30 Thread elmerfudd
I will make it clear. I want to save the query into a file when a user is changing a parameter in the query, lets say he adds logTofile=1 then the searchHandler will provide the same result as without this parameter, but in the background it will do some logic(ex. save the query to file) . But I

Fetching results with a minimum from each category

2013-12-30 Thread nish
I am using solr 4.4.0. The search is performed on products, each of which has a category field. I want to retrieve top n products. But, if some category has less than m products among the top n, then I want to retrieve more products only for those categories. Eg. I have 4 categories a, b, c, d.

Re: How to use Solr in my project

2013-12-30 Thread Gora Mohanty
On 30 December 2013 11:27, Fatima Issawi issa...@qu.edu.qa wrote: Hi again, We have another program that will be extracting the text, and it will be extracting the top right and bottom left corners of the words. You are right, I do expect to have a lot of data. When would solr start

RE: How to use Solr in my project

2013-12-30 Thread Fatima Issawi
I think we may have up to 100,000 books, but I don't think the site will have a lot of traffic. Thank you for your help. I think it is a little more clear and will try to implement it now. -Original Message- From: Gora Mohanty [mailto:g...@mimirtech.com] Sent: Monday, December 30,

Re: Fetching results with a minimum from each category

2013-12-30 Thread Jilal Oussama
I don't get it, if b and d only have 4 products, how can you fetch one more for them? But any way, if you realy know what you are doing, then I can say that this is quite specific, so you may have to do it in 2 solr queries. also see the Grouping Componant, it may help you get what you want

Re: Fetching results with a minimum from each category

2013-12-30 Thread nish
Oussama Jilal, b and d have 4 products in top 20 results obtained and not overall in the database. Grouping would give me results from all categories, I only want categories corresponding to top 20 results. It can be done in 2 solr queries, but it would make the system slow. Was just wondering

Re: org.apache.solr.handler.dataimport.DataImportHandlerException: Unable to execute query

2013-12-30 Thread PeterKerk
I ran the query in debug mode: http://localhost:8983/solr/tv-wordpress/dataimport?command=full-importdebug=true Here's the output, what can you tell from this? 22432 [qtp33142123-13] INFO org.apache.solr.handler.dataimport.JdbcDataSource û Creating a connection for entity article with URL:

Re: how to debug dataimporthandler

2013-12-30 Thread PeterKerk
Tried your steps, but failed. Could you perhaps have a look at my post here: http://lucene.472066.n3.nabble.com/org-apache-solr-handler-dataimport-DataImportHandlerException-Unable-to-execute-query-td4108227.html -- View this message in context:

Re: org.apache.solr.handler.dataimport.DataImportHandlerException: Unable to execute query

2013-12-30 Thread Shalin Shekhar Mangar
I'm sorry I meant that you should see the XML response returned in debug mode. The debug mode won't log anything extra but it will collect information such as the SQL queries executed per entity and per row. It will also show a stacktrace if there was an error. On Mon, Dec 30, 2013 at 3:58 PM,

Re: org.apache.solr.handler.dataimport.DataImportHandlerException: Unable to execute query

2013-12-30 Thread PeterKerk
This is all I see in the XML response: This XML file does not appear to have any style information associated with it. The document tree is shown below. response script/ lst name=responseHeader int name=status0/int int name=QTime39/int /lst lst name=initArgs lst name=defaults str

Re: How to boost documents ?

2013-12-30 Thread Anca Kopetz
Hi, Thank you for your response. When I try the URL you sent me, I get the following error message : org.apache.solr.search.SyntaxError: Infinite Recursion detected parsing query 'beautiful Christmas tree' Any idea what this means ? Best regards, Anca On 12/16/2013 02:00 PM, Ahmet Arslan

Solr core is asking tomcat username and password

2013-12-30 Thread kumar
Hi, I Created core in solr using tomcat and when i am accessing created core it is asking tomcat authentication details. For example i am using following url. http://localhost:8080/solr/corename/ypcity/suggest?jsons=kumar if i pass this to ajax, it is asking tomcat username and password. How

Re: Solr core is asking tomcat username and password

2013-12-30 Thread Gora Mohanty
On 30 December 2013 18:59, kumar pavan2...@gmail.com wrote: Hi, I Created core in solr using tomcat and when i am accessing created core it is asking tomcat authentication details. Hi, This is off-topic: If you are going to run Solr within Tomcat, please do some basic homework, or ask on a

monitoring solr logs

2013-12-30 Thread adfel70
hi i'm trying to figure out which solr and zookeeper logs i should monitor and collect. All the logs will be written to a file but I want to collect some of them with logstash in order to be able to analyze them efficiently. any inputs on logs of which classes i should collect? thanks. --

RE: monitoring solr logs

2013-12-30 Thread Tim Potter
I'm using logstash4solr (http://logstash4solr.org) for something similar ... I setup my Solr to use Log4J by passing the following on the command-line when starting Solr: -Dlog4j.configuration=file:///$SCRIPT_DIR/log4j.properties Then I use a custom Log4J appender that writes to RabbitMQ:

Solr search videos

2013-12-30 Thread Fkyz
Hi everyone. I am very new at Solr.. i'm only starting, and i dont know if this is possible to do. So let's say that i want to do a video search engine. To do this i was thinking to use nutch for crawl video websites and then create the index files. But then i thought.. How do I know that nutch

RE: monitoring solr logs

2013-12-30 Thread adfel70
Actually I was considering using logstash4solr, but it didn't seem mature enough. does it work fine? any known bugs? are you collecting the logs in the same solr cluster you use for the production systems? if so, what will you do if for some reason solr is down and you would like to analyze the

RE: monitoring solr logs

2013-12-30 Thread Tim Potter
We're (LucidWorks) are actively developing on logstash4solr so if you have issues, let us know. So far, so good for me but I upgraded to logstash 1.3.2 even though the logstash4solr version includes 1.2.2 you can use the newer one. I'm not quite in production with my logstash4solr - rabbit-mq -

RE: monitoring solr logs

2013-12-30 Thread adfel70
And are you using any tool like kibana as a dashboard for the logs? Tim Potter wrote We're (LucidWorks) are actively developing on logstash4solr so if you have issues, let us know. So far, so good for me but I upgraded to logstash 1.3.2 even though the logstash4solr version includes 1.2.2

RE: monitoring solr logs

2013-12-30 Thread Tim Potter
I've just been using the Solr query form so far :P but have plans to try out Kibana too. Let me know how that goes for you and I'll do the same. From: adfel70 adfe...@gmail.com Sent: Monday, December 30, 2013 10:06 AM To: solr-user@lucene.apache.org

side logging requests

2013-12-30 Thread elmerfudd
Hi all, currently there are 2 things I want to accomplish. I want that on demend Every doc (xml) that is sent to be indexed in solr will be copied to a big log file (I want to control when to activate this feature and when to deactivate) same as for queries. Also, I may need to manipulate the

RE: side logging requests

2013-12-30 Thread Tim Potter
You can wire-in a custom UpdateRequestProcessor - http://wiki.apache.org/solr/UpdateRequestProcessor Timothy Potter Sr. Software Engineer, LucidWorks www.lucidworks.com From: elmerfudd na...@012.net.il Sent: Monday, December 30, 2013 10:26 AM To:

Re: adding wild card at the end of the text and search(like sql like search)

2013-12-30 Thread suren
Ahmet, I am using solr 4.3.1. do i still need to apply this patch ? if yes please tell me the steps to follow. In the given link i see lot of patches, not sure which patch for what version of solr also i don't see the patch note how to apply. Thanks, Suren. -- View this message in

Re: Possible memory leak after segment merge? (related to DocValues?)

2013-12-30 Thread Greg Preston
That was it. Setting omitNorms=true on all fields fixed my problem. I left it indexing all weekend, and heap usage still looks great. I'm still not clear why bouncing the solr instance freed up memory, unless the in-memory structure for this norms data is lazily loaded somehow. Anyway, thank

config JoinQParserPlugin

2013-12-30 Thread Ray Cheng
Hi, I have trouble configuring JoinQParserPlugin in Solr. I'm using solr-4.6.0. I put this line (and only this line) to solrconfig.xml following Query Parsers comments of solrconfig.xml (solr-4.6.0):   !-- example of registering a query parser --   !--      queryParser name=myparser

Re: side logging requests

2013-12-30 Thread Erik Hatcher
And a custom SearchComponent for the querying side of things: http://wiki.apache.org/solr/SearchComponent Or, you could put some logging proxy in between your client and Solr? Or put something into the web container you're using that does what you need before requests hit Solr? Several

Re: solr OOM Crash

2013-12-30 Thread Sandra Scott
Hello Sébastien, Can you give some information about your environment so I can make sure we are having the same problem you had? Also, did you find out what caused the GC to go crazy or what caused the increased commit rate? Thanks, Sandra On Thu, Dec 19, 2013 at 12:34 PM, Sébastien Michel

Re: config JoinQParserPlugin

2013-12-30 Thread Yonik Seeley
On Mon, Dec 30, 2013 at 2:43 PM, Ray Cheng rch...@rocketmail.com wrote: Hi, I have trouble configuring JoinQParserPlugin in Solr. I'm using solr-4.6.0. I put this line (and only this line) to solrconfig.xml following Query Parsers comments of solrconfig.xml (solr-4.6.0): !-- example of

Re: config JoinQParserPlugin

2013-12-30 Thread Ray Cheng
 The join parser should already be included by default - no need for configuration. Does it mean the following line I added to solrconfig.xml is not needed and caused Solr start error? queryParser name=join class=org.apache.solr.search.JoinQParserPlugin / Thanks, Ray On Monday, December

Re: config JoinQParserPlugin

2013-12-30 Thread Yonik Seeley
Does it mean the following line I added to solrconfig.xml is not needed and caused Solr start error? Yes. Join is a builtin parser and you should not add any config for it. Most likely that is what is causing your startup error (although it's not entirely clear why it's causing it to fail).

Solr -The connection has timed out

2013-12-30 Thread rakesh
I have Solr server running wit jetty. Some times i am getting connection timed out error from the home page. In the logs no errors are shown also .Please help how to resolve this problem.Attaching the log from the Solr INFO - 2013-12-26 02:51:37.460; org.eclipse.jetty.server.Server;

Re: config JoinQParserPlugin

2013-12-30 Thread Ray Cheng
Earlier I tried join queries using curl 'http://myLinux:8983/solr/abc.edu_up/select?debug=trueq=*:*fq={defType=join from=id to=id fromIndex=abc.edu}subject:financial' curl http://localhost:8983/solr/... with debug=true but didn't get any response. There was nothing on Solr log either. So, I

Re: config JoinQParserPlugin

2013-12-30 Thread Ray Cheng
(Sorry, I clicked a wrong Mac command button and the last email was sent out before I finished editing it..) Earlier I tried join queries using curl 'http://myLinux:8983/solr/abc.edu_up/select?debug=trueq=*:*fq={defType=join from=id to=id fromIndex=abc.edu}subject:financial'  but didn't get any

Re: Chaining plugins

2013-12-30 Thread Chris Hostetter
You don't need to write your own handler. See the previpous comment about implementing a SearchComponent -- you can check for the params in your prepare() method and do whatever side effects you want, then register your custom component and hook it into the component chain of whatever handler

Re: Solr -The connection has timed out

2013-12-30 Thread Furkan KAMACI
Hi Rakesh; Are you sure that you do not see any errors at your log? By the way what is the exact error you see at Solr home page? Thanks; Furkan KAMACI 30 Aralık 2013 Pazartesi tarihinde rakesh rakesh3...@yahoo.com adlı kullanıcı şöyle yazdı: I have Solr server running wit jetty. Some times i

Re: Solr search videos

2013-12-30 Thread Furkan KAMACI
Hi; It is possible to do video search with Solr and Nutch. You shoul start with deciding which infotmation you will use for video search. Alt information, title of page, extracting data with XPath parser are things to think. Start doing something and I can help you. Thanks; Furkan KAMACI 30

RE: monitoring solr logs

2013-12-30 Thread Otis Gospodnetic
Hi, You should look at Logsene: http://sematext.com/logsene (free) It has Kibana + native UI, it's not limited to logs, and if you are monitoring your Solr and/or Zookeeper with SPM you can have your performance metrics graphs and your logs side by side for much more efficient troubleshooting.

Re: REYPLAY_ERR: IOException reading log

2013-12-30 Thread Furkan KAMACI
Hi YouPeng; Could you share you schema fields? Thanks; Furkan KAMACI 27 Aralık 2013 Cuma tarihinde YouPeng Yang yypvsxf19870...@gmail.com adlı kullanıcı şöyle yazdı: Hi users I have build a SolrCloud on tomcat.The cloud contains 22 shards with no replica.Also the the solrcloud is

Re: Grouping results with group.limit return wrong numFound ?

2013-12-30 Thread Furkan KAMACI
Hi; group.limit is: the number of results (documents) to return for each group. Defaults to 1. Did you check the page here: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=32604232 Thanks; Furkan KAMACI 25 Aralık 2013 Çarşamba tarihinde tasmaniski tasmani...@gmail.com adlı

Re: Solr -The connection has timed out

2013-12-30 Thread rakesh
Finally able to get the full log details ERROR - 2013-12-30 15:13:00.811; org.apache.solr.core.SolrCore; [collection1] Solr index directory '/ctgapps/apache-solr-4.6.0/solr-4.6.0/example/solr/collection1/data/index/' is locked. Throwing exception INFO - 2013-12-30 15:13:00.812;