Re: is it possible to remove response header from the JSON fromat?

2011-08-18 Thread Filype Pereira
I reckon you can use omitHeader=true on the URL, hope that it helps On Thu, Aug 18, 2011 at 5:21 PM, nagarjuna nagarjuna.avul...@gmail.comwrote: Thank u very much for ur reply Erik Hatcher... actually i thought to use my solr response in Jquery page. i have one sample url

DataImportHandler using new connection on each query

2011-08-18 Thread Kevin Osborn
I have a data import handler that is importing data in full mode from SQL Server. It has one main entity and three sub-entities. Against a good database, it appears to open 4 connections total. One for the main query and the other 3 subqueries just re-use their connections. This works well

Re: ClassNotFoundException when trying to make spellcheck JaraWinkler working

2011-08-18 Thread Mike Mander
Hello Alexei Martchenko, my search component looks like this: code !-- Spell Check The spell check component can return a list of alternative spelling suggestions. http://wiki.apache.org/solr/SpellCheckComponent -- searchComponent name=spellcheck

Re: Stable Linux Release

2011-08-18 Thread Gora Mohanty
On Thu, Aug 18, 2011 at 10:43 AM, Cupbearer jcr...@inforeverse.com wrote: I've now had several false starts on different versions of Linux.  openSUSE wouldn't load up on my older dell server box because it didn't like my raid controller and I've now been through CentOS 5.5, 5.6 and 6.0. [...]

Re: is it possible to remove response header from the JSON fromat?

2011-08-18 Thread nagarjuna
Thank u very much Filype Pereira it works well but i have an another problem when ever i tried to use the url in my jquery page to get the keywords from the response it is saying tht it is not a pure json format...and i tested that url in REST client and i am not getting formatted JSON

Re: ClassNotFoundException when trying to make spellcheck JaraWinkler working

2011-08-18 Thread Mike Mander
Solution found. The original solr-config.xml jarowinkler definition had some line breaks. If i write the difinition in one line (no tabs, no line breaks) server starts without exception str name=distanceMeasureorg.apache.lucene.search.spell.JaroWinklerDistance/str Thanks for helping me Mike

solr integration with jquery client page?

2011-08-18 Thread nagarjuna
hi every body... i queried following solr query http://localhost:8080/solr/db/select/?q=testversion=2.2start=0rows=10indent=onfl=keywordsomitHeader=true http://localhost:8080/solr/db/select/?q=testversion=2.2start=0rows=10indent=onfl=keywordsomitHeader=true to get the all keywords started

Re: suggester issues

2011-08-18 Thread Kuba Krzemień
What happens if you set spellcheck.maxCollations to more than 1? -- From: Alexei Martchenko ale...@superdownloads.com.br Sent: Wednesday, August 17, 2011 11:01 PM To: solr-user@lucene.apache.org Subject: Re: suggester issues I've been indexing and

Re: Solr Accent Insensitive and sensitive search

2011-08-18 Thread Denis WSRosa
Hi! Thank you for your response! here is my full schema: ?xml version=1.0 encoding=UTF-8 ? !-- Licensed to the Apache Software Foundation (ASF) under one or more contributor license agreements. See the NOTICE file distributed with this work for additional information regarding copyright

Re: Periodic search in date field

2011-08-18 Thread Erick Erickson
Hmmm, doing this with date ranges would be a possibility, although that would be some really ugly filter queries... What would happen if you indexed a separate field that was just the last digit of the year, plus separate fields for year day and month? This assumes that 1, 5 and 10 are the only

Re: Solr Join in 3.3.x

2011-08-18 Thread Michael McCandless
Unfortunately Solr's join impl hasn't been backported to 3.x, as far as I know. You might want to look at ElasticSearch; it has a join implementation already or use Solr 4.0. Mike McCandless http://blog.mikemccandless.com On Wed, Aug 17, 2011 at 7:40 PM, Cameron Hurst wakemaste...@z33k.com

Re: Filtering results based on a set of values for a field

2011-08-18 Thread Erick Erickson
How does this list of authors get selected? The reason I'm asking is I'm wondering if you can define the problem away. In other words, I'm wondering if this is an XY problem (http://people.apache.org/~hossman/#xyproblem). I can't imagine you expect a user to specify up to 2k authors, so there

Re: Loggly support

2011-08-18 Thread Mark Miller
Hey Bill - try the syslog appender: http://logging.apache.org/log4j/1.2/apidocs/org/apache/log4j/net/SyslogAppender.html http://wiki.loggly.com/log4j On Aug 14, 2011, at 10:08 PM, Bill Bell wrote: How do you setup log4j to work with Loggly for SOLR logs? Anyone have this set up? Bill

Re: suggester issues

2011-08-18 Thread O. Klein
The problem lies in the suggester like the spellchecker, tokenizing on whitespace. So while shingles might give you nice suggestions, the behaviour of the Suggester makes it unusable. Besides that, I never succeeded in getting the suggester to show more collations then one. Normal spellchecker on

XSLT Exception

2011-08-18 Thread Christopher Gross
I'm using Solr 3.3, trying to run an XSLT translation on the results of a query. The xsl file worked just fine for Solr 1.4.1, but I'm having trouble with the newer version. The root cause is: javax.xml.transform.TransformerException: Extra illegal tokens: 'contains', '(', '$', 'posted', ',',

Re: Filtering results based on a set of values for a field

2011-08-18 Thread Tomas Zerolo
On Thu, Aug 18, 2011 at 08:36:08AM -0400, Erick Erickson wrote: How does this list of authors get selected? The reason I'm asking is I'm wondering if you can define the problem away. In other words, I'm wondering if this is an XY problem (http://people.apache.org/~hossman/#xyproblem). :-) I

Re: Periodic search in date field

2011-08-18 Thread slaava
Very inspirating, great thanks! Idea with indexing last number of year is very good and covers current requirements. But one day there could be requirement for (as you said) 3-years anniversaries. So I do this: Index: For every required X-year anniversary there will be field year_mod_X with YEAR

Re: Return records based on aggregate functions?

2011-08-18 Thread Erick Erickson
Side comment: Is your content field really a string value in your schema.xml? that's an un-analyzed type and unless you're always searching for *exactly* the full contents of the field, you'll have problems Best Erick On Wed, Aug 17, 2011 at 2:20 PM, Daniel Skiles daniel.ski...@docfinity.com

Re: Return records based on aggregate functions?

2011-08-18 Thread Daniel Skiles
It's actually an analyzed String. I figured that out after the first test run. On Thu, Aug 18, 2011 at 9:00 AM, Erick Erickson erickerick...@gmail.comwrote: Side comment: Is your content field really a string value in your schema.xml? that's an un-analyzed type and unless you're always

Solr Copyfields

2011-08-18 Thread Nicholas Fellows
Hi I have a question regarding CopyFields in Solr As far as i can tell there are several ways to do the same thing 1) create an alias in the SQL Query and Delta Queries 2) specify multiple fields in the db-data-config.xml having different names for the same column 3) use the copyField directive

Solr read timeout

2011-08-18 Thread Tod
I'm using perl to indirectly call the solr ExtractingRequestHandler to stream remote documents into a solr index instance. Every 100 URL's I process I do a commit. I've got about 30K documents to be indexed. I'm using a stock, out of the box version of solr 1.4.1 with the necessary schema

Content recommendation using solr?

2011-08-18 Thread Arcadius Ahouansou
Hello. I'm doing some research regarding the usage of Solr for implementing content recommendation engines. Initially, I was looking at http://wiki.apache.org/solr/MoreLikeThis Then, it turned out that most implementations are based on a combination of Mahout, Solr and Hadoop. Please, are you

Exact Match using Copy Fields

2011-08-18 Thread jyn7
Hi, I am trying to achieve an exact match search on a text field. I am using a copy field and copying it to a string and using that for the search. field name=imprint type=text indexed=true stored=true/ field name=author type=text indexed=true stored=true/ field name=author_exact type=string

Re: Content recommendation using solr?

2011-08-18 Thread Omri Cohen
check out OutBrain

lucene 3 and merge/optimize

2011-08-18 Thread olivier sallou
Hi, after an upgrade to solr/lucene 3, I tried to change the code to remove deprecated functions Though new MergePolicy etc... are not really clear. I have now issues with the merge and optimize functions. I have a command line application (Java/Lucene api) that merge multiple indexes in a

Re: Periodic search in date field

2011-08-18 Thread Gora Mohanty
On Wed, Aug 17, 2011 at 1:07 PM, slaava slaav...@gmail.com wrote: Thanks for quick reply! Yes, this is my backup solution. But I prefer some one-query approach - there could be many results so I want use SolrQuery.start() and SolrQuery.rows() and show persons in table with paging. Was

Re: Exact Match using Copy Fields

2011-08-18 Thread Juan Grande
Hi, are you sure you're using dismax query parser? Make sure you have the parameter defType=dismax in your request. *Juan* On Thu, Aug 18, 2011 at 11:22 AM, jyn7 jyotsna.namb...@gmail.com wrote: Hi, I am trying to achieve an exact match search on a text field. I am using a copy field and

Re: Query does not work when changing param order

2011-08-18 Thread Juan Manuel Alvarez
Sorry it took me so long to answer, but that issue turned into low priority and I resume it today. Adding a filter query for each tag worked great! Thank you! =o) Juan M. On Thu, Jul 7, 2011 at 7:10 PM, Juan Grande juan.gra...@gmail.com wrote: Hi Juan! I think your problem is that in the

Full sentence spellcheck

2011-08-18 Thread Valentin
I'm trying to configure a spellchecker to autocomplete full sentences from my query. I've already been able to get this results: /american israel : - american something - israel something/ But i want : /american israel : - american israel something/ This is my solrconfig.xml :

Re: lucene 3 and merge/optimize

2011-08-18 Thread olivier sallou
answer to myself, to be checked... I used policy.setMaxMergeDocs(10), limiting to small number of filesat least for merge. I gonna test. 2011/8/18 olivier sallou olivier.sal...@gmail.com Hi, after an upgrade to solr/lucene 3, I tried to change the code to remove deprecated functions

When are you planning to release SolrCloud feature with ZooKeeper?

2011-08-18 Thread Way Cool
Hi, guys, When are you planning to release the SolrCloud feature with ZooKeeper currently in trunk? The new admin interface looks great. Great job. Thanks, YH

get update record from database using DIH

2011-08-18 Thread vighnesh
hi everyone let me know about how to get update record from database using solr without executing full-import command. thanks in advance vighnesh -- View this message in context: http://lucene.472066.n3.nabble.com/get-update-record-from-database-using-DIH-tp3264126p3264126.html Sent

RE: Synonym and Whitespaces and optional TokenizerFactory

2011-08-18 Thread Jaeger, Jay - DOT
You could presumably do it with solr.PatternTokenizerFactory with the pattern set to .* as your tokenizer Or, maybe, if Solr allows it, you don't use any tokenizer at all? Or, maybe you could use solr.WhitespaceTokenizerFactory, allowing it to split up the words, along with

DataImportHandler under Tomcat

2011-08-18 Thread Dali
Hello everybody, I'm using solr 1.4.1 under tomcat 6.0.32 and i well configured (data-config.xml, solrconfig.xml and schema.xml) as described in the wiki to index data from mysql database. But when i access dataimport console, i'm getting a screen divided in two parts: -One at the left side

Re: DataImportHandler under Tomcat

2011-08-18 Thread Dali
It's likely to be a problem of version. I turned out to solr 3.3.0 and it works fine :) -- View this message in context: http://lucene.472066.n3.nabble.com/DataImportHandler-under-Tomcat-tp3264142p3264239.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: get update record from database using DIH

2011-08-18 Thread Dali
Hello Take a look at the delta import example : http://wiki.apache.org/solr/DataImportHandler http://wiki.apache.org/solr/DataImportHandler Regards -- View this message in context: http://lucene.472066.n3.nabble.com/get-update-record-from-database-using-DIH-tp3264126p3264393.html Sent from

without usage of full-import command and delta-import command

2011-08-18 Thread vighnesh
is it possible to get the new record from a updataed table using solr without executiing full-import and delta-import commands? when i can make change in solr query i need to get that newly inserted record from a databse.

Re: solr integration with jquery client page?

2011-08-18 Thread Gora Mohanty
On Thu, Aug 18, 2011 at 12:14 PM, nagarjuna nagarjuna.avul...@gmail.com wrote: hi every body...   i queried following solr query http://localhost:8080/solr/db/select/?q=testversion=2.2start=0rows=10indent=onfl=keywordsomitHeader=true

RE: Solr Copyfields

2011-08-18 Thread Jaeger, Jay - DOT
I would suggest #3, unless you have some very unusual performance requirements. It has the advantage of isolating your index environment requirements from the database. -Original Message- From: Nicholas Fellows [mailto:n...@djdownload.com] Sent: Thursday, August 18, 2011 8:40 AM To:

Re: magento-solr integration

2011-08-18 Thread Gora Mohanty
On Wed, Aug 17, 2011 at 8:38 PM, Harsha Vardhan Muthyala muthyala_har...@yahoo.com wrote: Hi, Not sure if this is right forum to ask a question regarding installation. But the admin page on solr screen pointed to this address. We have followed the installation procedure mentioned at

Re: without usage of full-import command and delta-import command

2011-08-18 Thread Gora Mohanty
On Thu, Aug 18, 2011 at 5:42 PM, vighnesh svighnesh...@gmail.com wrote: is it possible to get the new record from a updataed table using solr without executiing full-import and delta-import commands? It is not clear why you are imposing this restriction. when i can make change in solr query i

RE: XSLT Exception

2011-08-18 Thread Jaeger, Jay - DOT
I am not an XSLT expert, but believe that in XSLT, not is a function, rather than an operator. http://www.w3.org/TR/xpath-functions/#func-not So, not(contains)) rather than not contains() should presumably do the trick. -Original Message- From: Christopher Gross

Re: XSLT Exception

2011-08-18 Thread Christopher Gross
Ah, that makes sense. I'm still confused as to why Solr 1.4 would let that go, then. Thanks! -- Chris On Thu, Aug 18, 2011 at 12:39 PM, Jaeger, Jay - DOT jay.jae...@dot.wi.gov wrote: I am not an XSLT expert, but believe that in XSLT, not is a function, rather than an operator.

RE: Full sentence spellcheck

2011-08-18 Thread Dyer, James
If you use spellcheck.q, you also still need to specify q for the queryhandler, otherwise you'll get an NPE. Not sure that's your problem but its one thing to check. James Dyer E-Commerce Systems Ingram Content Group (615) 213-4311 -Original Message- From: Valentin

Re: ClassNotFoundException when trying to make spellcheck JaraWinkler working

2011-08-18 Thread Alexei Martchenko
Good knowledge for everybody, those little mistakes like spaces, typos and lack of commas makes lose so many time. thanks for posting this. 2011/8/18 Mike Mander wicket-m...@gmx.de Solution found. The original solr-config.xml jarowinkler definition had some line breaks. If i write the

Re: Solr Accent Insensitive and sensitive search

2011-08-18 Thread Erick Erickson
Well, we can't tell. Because you haven't identified the field you are working with. So, we need two additional pieces of information: the query you use that works the query you use that doesn't work And attach debugQuery=on to both of them and post the results back please. But looking at the

RE: Stable Linux Release

2011-08-18 Thread Cupbearer
I’m not sure where a better place would be. The problems I seem to be having revolve around having the right prerequisites installed in my Apache and Php installs to get this done. I’m unsure that a Generic Linux forum would know and understand the Solr prerequisites better than the Solr

Re: suggester issues

2011-08-18 Thread oberman_cs
I was trying to deal with the exact same issue, with the exact same results. Is there really no way to feed a phrase into the suggester (spellchecker) without it splitting the input phrase into words? -- View this message in context:

Re: Stable Linux Release

2011-08-18 Thread Markus Jelsma
Gora is right, this is not the right place for Linux or PHP questions for whatever distro. Solr will run happily on ANY Linux box with a bit of RAM, diskspace and CPU time and a Java 5 JVM and a servlet container. So far you haven't asked any Solr specific question or problem description. I

Re: Filtering results based on a set of values for a field

2011-08-18 Thread Erick Erickson
Hmmm, I'm still not getting it... You have one or more lists. These lists change once a month or so. Are you trying to include or exclude the documents in these lists? And do the authors you want to include or exclude change on a per-query basis or would you be all set if you just had a filter

Re: suggester issues

2011-08-18 Thread Alexei Martchenko
It can be done, I did that with shingles, but it's not the way it's meant to be. The main problem with suggester is that we want compound words and we never get them. I try to get internet explorer but when i enter in the second word, internet e the suggester never finds explorer. 2011/8/18

Re: Stable Linux Release

2011-08-18 Thread Gora Mohanty
On Thu, Aug 18, 2011 at 11:48 PM, Cupbearer jcr...@inforeverse.com wrote: I’m not sure where a better place would be.  The problems I seem to be having revolve around having the right prerequisites installed in my Apache and Php installs to get this done.  I’m unsure that a Generic Linux

RE: Stable Linux Release

2011-08-18 Thread Cupbearer
What are the Prerequite libraries required to get Solr to work in Php. Php.net has libxml2 and libcurlx I think (off the top of my head) I have those installed correctly and I can get to my Solr/admin page from a browser just fine and ping and all of those things just fine from within the

Re: Stable Linux Release

2011-08-18 Thread Gora Mohanty
On Fri, Aug 19, 2011 at 12:15 AM, Cupbearer jcr...@inforeverse.com wrote: What are the Prerequite libraries required to get Solr to work in Php.   Php.net has libxml2 and libcurlx I think (off the top of my head)  I have those installed correctly and I can get to my Solr/admin page from a

Re: Stable Linux Release

2011-08-18 Thread Glen Newton
Please take this discussion off list. Thanks, Glen On Thu, Aug 18, 2011 at 3:02 PM, Gora Mohanty g...@mimirtech.com wrote: On Fri, Aug 19, 2011 at 12:15 AM, Cupbearer jcr...@inforeverse.com wrote: What are the Prerequite libraries required to get Solr to work in Php.   Php.net has libxml2 and

Re: hl.useFastVectorHighlighter, fragmentsBuilder and HighlightingParameters

2011-08-18 Thread Alexei Martchenko
Hi Koji thanks for the reply. My fragmentsBuilder is defined directly in config. SOLR 3.3 warns me highlighting is a deprecated form do you think it is in the wrong place? 2011/8/17 Koji Sekiguchi k...@r.email.ne.jp Alexei, From the log, I think Solr couldn't find colored

Re: Synonym and Whitespaces and optional TokenizerFactory

2011-08-18 Thread Erick Erickson
Hmmm, why doesn't the multi word synonym syntax in your synonym.txt handle this case? Or am I missing something totally? Best Erick On Wed, Aug 17, 2011 at 10:02 PM, Will Milspec will.mils...@gmail.com wrote: Hi all, This may be obvious. My question pertains to use of tokenizerFactory

Re: Synonym and Whitespaces and optional TokenizerFactory

2011-08-18 Thread Markus Jelsma
How about escaping white\ space? cheers Hmmm, why doesn't the multi word synonym syntax in your synonym.txt handle this case? Or am I missing something totally? Best Erick On Wed, Aug 17, 2011 at 10:02 PM, Will Milspec will.mils...@gmail.com wrote: Hi all, This may be obvious.

RE: Stable Linux Release

2011-08-18 Thread Cupbearer
Since this doesn’t seem to be something that the community is interested in answering could they at least point me to some sort of documentation somewhere or the appropriate forum to ask this question? Or is everyone just compiling php from source if they have made it this far and decided to

Re: IndexTank technology...

2011-08-18 Thread Cupbearer
btw, i was told by Matt Weber who's the wordpress plugin/solr developer that I've been talking to that this was a solr search that I could maybe use for my WordPress Multisite search functionality. After reading through it all it was missing something that I needed, but according to him it is

Re: Synonym and Whitespaces and optional TokenizerFactory

2011-08-18 Thread Ravi Solr
If you have multi-word synonyms you could use - tokenizerFactory=solr.KeywordTokenizerFactory - in the SynonymFilterFactory filter factory declaration. This assumes that your tokenizer for that field allows for keeping the phrases as a single token (achieved by using solr.KeywordTokenizerFactory

Update field value in the document based on value of another field in the document

2011-08-18 Thread bhawna singh
Hi All, I have a requirement to update a certain field value depending on the field value of another field. To elaborate- I have a field called 'popularity' and a field called 'URL'. I need to assign popularity value depending on the domain (URL) ( I have the popularity and domain mapping in a

Re: Synonym and Whitespaces and optional TokenizerFactory

2011-08-18 Thread Ravi Solr
If you have multi-word synonyms you could use - tokenizerFactory=solr.KeywordTokenizerFactory - in the SynonymFilterFactory filter factory declaration. This assumes that your tokenizer for that field allows for keeping the phrases as a single token (achieved by using solr.KeywordTokenizerFactory

Re: suggester issues

2011-08-18 Thread William Oberman
I tried this: package com.civicscience; import java.util.ArrayList; import java.util.Collection; import java.util.Collections; import org.apache.lucene.analysis.Token; import org.apache.solr.spelling.QueryConverter; /**

RE: Solr spellcheck and multiple collations

2011-08-18 Thread Herman Kiefus
Nice catch, I was sending maxCollations with a capital M. -Original Message- From: Dyer, James [mailto:james.d...@ingrambook.com] Sent: Wednesday, August 17, 2011 6:10 PM To: solr-user@lucene.apache.org Subject: RE: Solr spellcheck and multiple collations I quickly went through what

Re: Update field value in the document based on value of another field in the document

2011-08-18 Thread simon
An UpdateRequestProcessor would do the trick. Look at the (rather minimal) documentation and code example in http://wiki.apache.org/solr/UpdateRequestProcessor -Simon On Thu, Aug 18, 2011 at 4:15 PM, bhawna singh singhbha...@gmail.com wrote: Hi All, I have a requirement to update a certain

overhead of empty, unused fields

2011-08-18 Thread Will Milspec
hi all, What are the cost of unused field types? Our application supports multiple languages. We envision separate Lucene/Solr fields (and field types) per language (conten_en, content_fr, content_zh_CN,etc). We thought of a few optons: a) auto-generating the 'multilingual' portion of the

Re: overhead of empty, unused fields

2011-08-18 Thread Markus Jelsma
No problem. A document without a value for some field simply doesn't have an entry in the inverted index. hi all, What are the cost of unused field types? Our application supports multiple languages. We envision separate Lucene/Solr fields (and field types) per language (conten_en,

RE: Stable Linux Release

2011-08-18 Thread Cupbearer
Just for posterity sake: I was correct in that it had to do with the fsockopen() function in php. However, the issue was in SELinux and not in any of my other configuration. Even when I tried to disable SELinux to test if it was a firewall issue apparently whatever was set in the Boolean’s

Re: get update record from database using DIH

2011-08-18 Thread Alexandre Sompheng
Hi guys, i try the delta import, i got logs saying that it found delta data to update. But it seems that the index is not updated. Amy guess why this happens ? Did i miss something? I'm on solr 3.3 with no patch. Thanks On 18 août 2011, at 18:10, Dali medalibenmans...@gmail.com wrote: Hello

Re: hl.useFastVectorHighlighter, fragmentsBuilder and HighlightingParameters

2011-08-18 Thread Koji Sekiguchi
(11/08/19 4:14), Alexei Martchenko wrote: Hi Koji thanks for the reply. MyfragmentsBuilder is defined directly inconfig. SOLR 3.3 warns me highlighting is a deprecated form do you think it is in the wrong place? Hi Alexei, Yes, it is incorrect. What deprecate is that highlighting tag

Boost documents based on the number of their fields

2011-08-18 Thread SR
Hi there, My documents have a title, a textual description and might have an image, and a video. During the querying process, I search across the textual fields of the documents (title and description). In order to sort the documents that match with my query, I'd like to give a boost to those