Solr Search fails

2011-05-06 Thread deniz
Hi all. have been trying to implement a universal search on a field but somehow it fails... when I make a full import everything is ok I can see the indexed field. But when i make a query like universal:Male it shows no match any ideas? -- View this message in context:

Re: Is it possible to use sub-fields or multivalued fields for boosting?

2011-05-06 Thread deniz
it seems like I will use dismax... I have tried some other ways but dismax seems the best :) -- View this message in context: http://lucene.472066.n3.nabble.com/Is-it-possible-to-use-sub-fields-or-multivalued-fields-for-boosting-tp2901992p2907094.html Sent from the Solr - User mailing list

Re: Solr Search fails

2011-05-06 Thread Grijesh
What is your field type and analysis chain - Thanx: Grijesh www.gettinhahead.co.in -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Search-fails-tp2907093p2907097.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Solr Search fails

2011-05-06 Thread deniz
type is string and i use standard analyzer ( i am not sure what you mean by the word chain ) -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Search-fails-tp2907093p2907104.html Sent from the Solr - User mailing list archive at Nabble.com.

Use Solr / Lucene to search in a Logfile

2011-05-06 Thread Robert Naczinski
Hello, we want to search large log4j logfiles withSolr / Lucene and find any lines with a special argument. ( for examle: with a defined userid ) It should be a solr indput document for each row in the file. The log file is growing continuously and the search index must be refreshed. Has already

How to convert date/timestamp to long in data-config.xml

2011-05-06 Thread Shanmugavel SRD
SOLR : 1.4.1 There are 1,300,000+ documents in the index. Sorting on a date field with timestamp leads to OutOfMemoryError. So, we are looking for a way to copy the timestamp as a long value to a field and sort based on that field. Can any one help me on how to convert the timestamp to a long

Re: Solr Search fails

2011-05-06 Thread Grijesh
If its type is string then you can search for exact text only not for any part of string and also case sensitive - Thanx: Grijesh www.gettinhahead.co.in -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Search-fails-tp2907093p2907148.html Sent from the Solr - User

Re: Solr Search fails

2011-05-06 Thread deniz
well i have already done.. both the exact text and also some word in the whole text... nothing changes... -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Search-fails-tp2907093p2907157.html Sent from the Solr - User mailing list archive at Nabble.com.

How can i use Solr based Search Engine for My University?

2011-05-06 Thread Anurag
I am a student at http://jmi.ac.in/index.htm Jamia Millia Islamia , a central univeristy in India. I want to use my search engine for the benefit of students. The university has course like undergraduate,graduate,phd etc inlcuding Engineering . Earlier one of my teacher suggested developing

Re: How can i use Solr based Search Engine for My University?

2011-05-06 Thread Paul Libbrecht
Have you looked at Nutch? Or any other web-harvester? That seems to be closest. paul Le 6 mai 2011 à 10:01, Anurag a écrit : I am a student at http://jmi.ac.in/index.htm Jamia Millia Islamia , a central univeristy in India. I want to use my search engine for the benefit of students. The

Re: Solr Search fails

2011-05-06 Thread Grijesh
provide your schema for more detail about your problem - Thanx: Grijesh www.gettinhahead.co.in -- View this message in context: http://lucene.472066.n3.nabble.com/Solr-Search-fails-tp2907093p2907192.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: How can i use Solr based Search Engine for My University?

2011-05-06 Thread Grijesh
Use Nutch for your Intranet crawling.For more detail http://www.lucidimagination.com/blog/2009/03/09/nutch-solr/ - Thanx: Grijesh www.gettinhahead.co.in -- View this message in context:

Re: How to convert date/timestamp to long in data-config.xml

2011-05-06 Thread Grijesh
HI, You can convert time stamp to long by writing a custom transformer. But how will it help for OutOfMemory error.Because any sorting will use lucene field cache which will take a lot of memory as you have huge data. If you can then buy more RAM for your server. - Thanx: Grijesh

Re: How can i use Solr based Search Engine for My University?

2011-05-06 Thread Anurag
In my search engine Nutch and Solr have been integrated both. Also i am impplemented autocraling process. Whenever any one puts a http link in a given box and then submit it, the http site address gets automatically crawled and Indexes to solr... On Fri, May 6, 2011 at 2:02 PM, Grijesh [via

RE: Solr: org.apache.solr.common.SolrException: Invalid Date String:

2011-05-06 Thread Ahmet Arslan
--- On Fri, 5/6/11, Rohit ro...@in-rev.com wrote: From: Rohit ro...@in-rev.com Subject: RE: Solr: org.apache.solr.common.SolrException: Invalid Date String: To: solr-user@lucene.apache.org Date: Friday, May 6, 2011, 8:47 AM Hi Craig, Thanks for the response, actually what we need to

uima fieldMappings and solr dynamicField

2011-05-06 Thread Koji Sekiguchi
Hello, I'd like to use dynamicField in feature-field mapping of uima update processor. It doesn't seem to be acceptable currently. Is it a bad idea in terms of use of uima? If it is not so bad, I'd like to try a patch. Background: Because my uima annotator can generate many types of named

Re: Thoughts on Search Analytics?

2011-05-06 Thread findbestopensource
1. Reports based on Location. Group by City / Country 2. Total search performed per hour / week / month 3. Frequently used search keywords 4. Analytics based on search keywords. Regards Aditya www.findbestopensource.com On Fri, May 6, 2011 at 3:55 AM, Otis Gospodnetic otis_gospodne...@yahoo.com

Re: How can i use Solr based Search Engine for My University?

2011-05-06 Thread findbestopensource
Hello Anurag Google is always there to do internet search. You need to support search for your university. My opinion would be don't crawl the sites. You require only Solr and not Nutch. 1. Provide an interface to upload the documents by the university students. The documents could be previous

Re: UIMA analysisEngine path

2011-05-06 Thread Tommaso Teofili
Barry, I understand your need and I agree with you it'd be useful to be able to load AEs also from filesystem, I created SOLR-2501 [1] to track that requirement. Consider that loading AEs from relative paths, as using relative paths in general, is not a good practice since different environments

Re: why query chinese character with bracket become phrase query by default?

2011-05-06 Thread Michael McCandless
On Thu, May 5, 2011 at 10:00 AM, Yonik Seeley yo...@lucidimagination.com wrote: 2011/5/5 Michael McCandless luc...@mikemccandless.com: The very first thing every non-whitespace language Solr app should do is turn  off autoGeneratePhraseQueries! Luckily, this is configurable per FieldType...

How many UpdateHandlers can a Solr config have?

2011-05-06 Thread Julian Heise
Hello everyone, just a very basic question, but I haven't been able to find the answer in the Solr wiki: how many updateHandlers can one Solr config have? Just one? Or many? Thank you very much -Julian

Re: DIH for e-mails

2011-05-06 Thread Erick Erickson
Take a look at Transformers, perhaps a custom Transformer. They're surprisingly easy to add. Essentially, if you write your own it gets a map representing the Solr document. That map contains all of the modifications to the document made by any other Transformers previously defined, and you can

Re: Use Solr / Lucene to search in a Logfile

2011-05-06 Thread Otis Gospodnetic
Hi Robert, Have you considered just using Loggly.com ? Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search :: http://search-lucene.com/ - Original Message From: Robert Naczinski robert.naczin...@googlemail.com To: solr-user@lucene.apache.org

Re: Thoughts on Search Analytics?

2011-05-06 Thread Otis Gospodnetic
Hi Aditya, - Original Message From: findbestopensource findbestopensou...@gmail.com 1. Reports based on Location. Group by City / Country In other words, much like what one gets in Google Analytics? 2. Total search performed per hour / week / month 3. Frequently used search

Re: How can i use Solr based Search Engine for My University?

2011-05-06 Thread Anurag
Thanks Aditya, i appreciate your suggestion.i will implemet your suggestions. Besides these is there any other useful aspect that i may be not taking into account? Thanks a lot.. On Fri, May 6, 2011 at 4:57 PM, findbestopensource [via Lucene] ml-node+2907727-211212-146...@n3.nabble.com

Re: Solr Terms and Date field issues

2011-05-06 Thread Erick Erickson
OK, I'm reaching a little here, but I think it's got a pretty good chance of being the issue you're seeing. Sure hope somebody jumps in and corrects me if I'm wrong (hint hint)... I haven't delved into the actual Trie code, this is just from looking with TermsComponent and Luke. Using Solr 1.4.1

Re: Testing the limits of non-Java Solr

2011-05-06 Thread Erick Erickson
You've hit it right on the head... if you can use the standard analyzers/filters/etc, you're in good shape. You have to process the output (xml, json, whatever) as Otis says, but that's in whatever language your app server uses. But when was the last time you were motivated to write a blog post

Re: UIMA analysisEngine path

2011-05-06 Thread Barry Hathaway
Thanks for creating the case to track the requirement. I really don't agree with your comments about using relative paths though. The only way to specify the AE's making up an aggregate AE is to use a import location ..., leaving you to choose either a absolute, relative, or a URL. All of

Re: UIMA analysisEngine path

2011-05-06 Thread Tommaso Teofili
Hello Barry, 2011/5/6 Barry Hathaway bhath...@nycap.rr.com Thanks for creating the case to track the requirement. I really don't agree with your comments about using relative paths though. The only way to specify the AE's making up an aggregate AE is to use a import location ..., leaving

Michigan Information Retrieval Enthusiasts Group Quarterly Meetup - May 19th 2011

2011-05-06 Thread Provalov, Ivan
Our next IR Meetup is at Cengage Learning on May 19, 2011. Please RSVP here: http://www.meetup.com/Michigan-Information-Retrieval-Enthusiasts-Group/events/17567795/ Presentations: 1. Bayesian Language Model This talk presents a Bayesian language model, originally described by (Teh 2006), which

RE: Solr: org.apache.solr.common.SolrException: Invalid Date String:

2011-05-06 Thread Rohit
Thanks Ahmet, let me give this a shot. Regards, Rohit -Original Message- From: Ahmet Arslan [mailto:iori...@yahoo.com] Sent: 06 May 2011 15:39 To: solr-user@lucene.apache.org Subject: RE: Solr: org.apache.solr.common.SolrException: Invalid Date String: --- On Fri, 5/6/11, Rohit

Replication question

2011-05-06 Thread kenf_nc
I have Replication set up with str name=pollInterval00:00:60/str I assumed that meant it would poll the master for updates once a minute. But my logs make it look like it is trying to sync up almost constantly. Below is an example of my log from just 1 minute in time. Am I reading this wrong?

How to pass resultset to stored procedure ? DataImportHandler

2011-05-06 Thread binoybt
Hi I am new to Solr. I wrote a stored procedure in Oracle. I tried calling from solr. But the procedure is not getting executed as it expects a resultset as out param. CREATE OR REPLACE PROCEDURE GETSEARCHQUERY(p_cursor in out sys_refcursor) AS BEGIN OPEN p_cursor FOR select * from X

Re: Programmatic restructuring of a Solr cloud

2011-05-06 Thread Sergey Sazonov
Hello Jan, Thank you very much for the answer. Unfortunately, we don't use Amazon, and I doubt we will be able to persuade the customer to switch to it. Moreover, the amount of data will not allow us to store everything on a single master. However, having considered your design I am starting

RE: Solr Terms and Date field issues

2011-05-06 Thread Viswa S
Thanks Erick Ahmet, that helps. Date: Fri, 6 May 2011 09:25:11 -0400 Subject: Re: Solr Terms and Date field issues From: erickerick...@gmail.com To: solr-user@lucene.apache.org OK, I'm reaching a little here, but I think it's got a pretty good chance of being the issue you're seeing.

Re: Use Solr / Lucene to search in a Logfile

2011-05-06 Thread Robert Naczinski
Hi, thanks for the reply. I did not know that. Is there still a way to use Solr or Lucene? Or Apache Nutch would be not be bad. Could I maybe write a customized DIH? Greetings, Robert 2011/5/6 Otis Gospodnetic otis_gospodne...@yahoo.com: Loggly.com

Re: Field names with a period (.)

2011-05-06 Thread Chris Hostetter
: I remember the same, except I think I've seen the recommendation that you : make all the letters lower-case. As I remember, there are some interesting : edge cases that you might run into later with upper case. i can't think of *any* reason why upper case character names i na field would

Re: Field names with a period (.)

2011-05-06 Thread Gora Mohanty
On Sat, May 7, 2011 at 1:29 AM, Chris Hostetter hossman_luc...@fucit.org wrote: : I remember the same, except I think I've seen the recommendation that you : make all the letters lower-case. As I remember, there are some interesting : edge cases that you might run into later with upper case.

custom types file for WordDelimeterFilterFactory

2011-05-06 Thread Jerry Mindek
Hi there, I would like to experiment with the custom types file introduced in solr-2059. I have copied the wdftypes.txt file from SVN and put it in my solrhome/solr/conf directory. However, it doesn't appear to me that the WordDelimeterFilterFactory is using it. Have I put it in the

Replication Clarification Please

2011-05-06 Thread Ravi Solr
Hello,     Pardon me if this has been already answered somewhere and I apologize for a lengthy post. I was wondering if anybody could help me understand Replication internals a bit more. We have a single master-slave setup (solr 1.4.1) with the configurations as shown below. Our environment is

RE: Solr: org.apache.solr.common.SolrException: Invalid Date String:

2011-05-06 Thread Chris Hostetter
: Thanks for the response, actually what we need to achive is see group by : results based on dates like, : : 2011-01-01 23 : 2011-01-02 14 : 2011-01-03 40 : 2011-01-04 10 : : Now the records in my table run into millions, grouping the result based on : UTC date would not produce the right

*:* query with dismax

2011-05-06 Thread Jason Chaffee
I am using dismax and trying to use q=*:* to return all indexed documents. However, it is always returning 0 found. If I used the default select (not dismax) handler and try q=*:* then it returns all documents. There is nothing in the logs to indicate why this happening. Does anyone

Re: *:* query with dismax

2011-05-06 Thread Mark Mandel
This is exactly what should be happening, as the dismax parser doesn't understand regular query syntax (and for good reason too). This tripped me up as well when I first started using dismax. Solution for me was to comfigure the handler to use *:* when the query is empty, so that you can still

RE: *:* query with dismax

2011-05-06 Thread Jason Chaffee
Can you shed some light on what you did to configure it to handle *:*? I have the same issue that I need it to work for faceting, but I do need the dismax abilities as well. -Original Message- From: Mark Mandel [mailto:mark.man...@gmail.com] Sent: Friday, May 06, 2011 4:30 PM To:

edismax available in solr 3.1?

2011-05-06 Thread cyang2010
Hi, is edixmax available in solr 3.1? I don't see any documentation about it. if it is, does it support the prefix and fuzzy query? Thanks, cy -- View this message in context: http://lucene.472066.n3.nabble.com/edismax-available-in-solr-3-1-tp2910613p2910613.html Sent from the Solr - User

Re: *:* query with dismax

2011-05-06 Thread Rob Casson
it does seem a little weird, but q.alt will get what you want: http://wiki.apache.org/solr/DisMaxQParserPlugin#q.alt hth, rc On Fri, May 6, 2011 at 7:41 PM, Jason Chaffee jchaf...@ebates.com wrote: Can you shed some light on what you did to configure it to handle *:*? I have the same

Why special character is handled differently by standard/lucene query parser?

2011-05-06 Thread cyang2010
Hi, When user entered text contains special character, can this being taken care by the tokenizer/filter configured at the field? In application code, Do i need to parse the user input string and add the escape in front of those special character? If so, will those special characters differ

Re: Why special character is handled differently by standard/lucene query parser?

2011-05-06 Thread Yonik Seeley
On Fri, May 6, 2011 at 10:35 PM, cyang2010 ysxsu...@hotmail.com wrote: When user entered text contains special character, can this being taken care by the tokenizer/filter configured at the field? In application code, Do i need to parse the user input string and add the escape in front of

Re: Why special character is handled differently by standard/lucene query parser?

2011-05-06 Thread cyang2010
I know about dismax. But with that, i can't perform prefix and fuzzy query. can edismax handle prefix and fuzzy query? My application logic just pass the user entered text to solr server to perform term query, phrase query, prefix and fuzzy query. And i don't want to escape the special