Re: Field Collapsing on 1.4.1

2011-02-20 Thread Otis Gospodnetic
Hi Mark,

I don't think there's anything for 1.4.1.  There are SOLR-236 and SOLR-1682 (in 
trunk).  Neither one works for distributed search.  SOLR-2066 has a patch for 
field collapsing / results grouping in distributed search, but it doesn't seem 
to work well.

Otis

Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecosystem search :: http://search-lucene.com/



- Original Message 
 From: Mark static.void@gmail.com
 To: solr-user@lucene.apache.org
 Sent: Sat, February 19, 2011 9:49:19 AM
 Subject: Field Collapsing on 1.4.1
 
 Is there a seamless field collapsing patch for 1.4.1?
 
 I see it has been  merged into trunk but I tried downloading it to give it a 
whirl but it appears  that many things have changed and our application would 
need some considerable  work to get it up an running.
 
 Thanks
 


Re: Problems with ant test : No tests found

2011-02-20 Thread Otis Gospodnetic
Jurgen,

 svn co https://svn.apache.org/repos/asf/lucene/dev/trunk solr_svn
 
 According to the book I am reading I should be able to run the  tests
 succesfully, so I did a
 
 /var/solr_svn# ant test 

Between the above 2 commands you need to:

/var/solr_svn# cd solr

Otis

Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecosystem search :: http://search-lucene.com/



- Original Message 
 From: Jurgen blur...@gmail.com
 To: solr-user@lucene.apache.org
 Sent: Sat, February 19, 2011 9:26:34 AM
 Subject: Problems with ant test : No tests found
 
 Hi List!
 
 I was wondering, after downloading the subversion source  with
 
 svn co https://svn.apache.org/repos/asf/lucene/dev/trunk solr_svn
 
 According to the book I am reading I should be able to run the  tests
 succesfully, so I did a
 
 /var/solr_svn# ant test
 
 And it  seems that junit-parallel gives _only_ errors, not because tests it
 self fail  but tests aren't found.
 What did I do wrong?
 
 junit-parallel:
  [junit] Testsuite: org.apache.lucene.TestDemo
 [junit]  Testcase: warning(junit.framework.TestSuite$1):FAILED
  [junit] No tests found in org.apache.lucene.TestDemo
  [junit] junit.framework.AssertionFailedError: No tests found  in
 org.apache.lucene.TestDemo
 
 
 [junit] Tests run: 1,  Failures: 1, Errors: 0, Time elapsed: 0,475 sec
 
 [junit]  TEST org.apache.lucene.TestDemo FAILED
 [junit] Testsuite:  org.apache.lucene.TestSearchForDuplicates
 [junit] Testcase:  warning(junit.framework.TestSuite$1):FAILED
  [junit] No tests found in org.apache.lucene.TestSearchForDuplicates
  [junit] junit.framework.AssertionFailedError: No tests found  in
 org.apache.lucene.TestSearchForDuplicates
 
 
 [junit]  Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0,012 sec
 
  [junit] TEST org.apache.lucene.TestSearchForDuplicates FAILED
  [junit] Testsuite: org.apache.lucene.document.TestDocument
  [junit] Testcase: warning(junit.framework.TestSuite$1): FAILED
 [junit] No tests found in  org.apache.lucene.document.TestDocument
 [junit]  junit.framework.AssertionFailedError: No tests found  in
 org.apache.lucene.document.TestDocument
 
 
 [junit]  Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0,008 sec
 
  [junit] TEST org.apache.lucene.document.TestDocument FAILED
  [junit] Testsuite: org.apache.lucene.index.TestByteSlices
  [junit] Testcase: warning(junit.framework.TestSuite$1): FAILED
 [junit] No tests found in  org.apache.lucene.index.TestByteSlices
 [junit]  junit.framework.AssertionFailedError: No tests found  in
 org.apache.lucene.index.TestByteSlices
 
 
 [junit]  Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0,008 sec
 
  [junit] TEST org.apache.lucene.index.TestByteSlices FAILED
  [junit] Testsuite: org.apache.lucene.index.TestDeletionPolicy
  [junit] Testcase: warning(junit.framework.TestSuite$1): FAILED
 [junit] No tests found in  org.apache.lucene.index.TestDeletionPolicy
 [junit]  junit.framework.AssertionFailedError: No tests found  in
 org.apache.lucene.index.TestDeletionPolicy
 
 
  [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0,01  sec
 
 [junit] TEST org.apache.lucene.index.TestDeletionPolicy  FAILED
 [junit] Testsuite:  org.apache.lucene.index.TestDoc
 [junit] Testcase:  warning(junit.framework.TestSuite$1):FAILED
  [junit] No tests found in org.apache.lucene.index.TestDoc
  [junit] junit.framework.AssertionFailedError: No tests found  in
 org.apache.lucene.index.TestDoc
 
 
 [junit] Tests  run: 1, Failures: 1, Errors: 0, Time elapsed: 0,007 sec
 
  [junit] TEST org.apache.lucene.index.TestDoc FAILED
 [junit]  Testsuite: org.apache.lucene.index.TestIndexWriterDelete
  [junit] Testcase: warning(junit.framework.TestSuite$1): FAILED
 [junit] No tests found in  org.apache.lucene.index.TestIndexWriterDelete
 [junit]  junit.framework.AssertionFailedError: No tests found  in
 org.apache.lucene.index.TestIndexWriterDelete
 
 
  [junit] Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0,007  sec
 
 [junit] TEST  org.apache.lucene.index.TestIndexWriterDelete FAILED
 [junit]  Testsuite: org.apache.lucene.index.TestMultiFields
 [junit]  Testcase: warning(junit.framework.TestSuite$1):FAILED
  [junit] No tests found in  org.apache.lucene.index.TestMultiFields
 [junit]  junit.framework.AssertionFailedError: No tests found  in
 org.apache.lucene.index.TestMultiFields
 
 
 [junit]  Tests run: 1, Failures: 1, Errors: 0, Time elapsed: 0,008 sec
 
  [junit] TEST org.apache.lucene.index.TestMultiFields FAILED
  [junit] Testsuite: org.apache.lucene.index.TestNoMergeScheduler
  [junit] Testcase: warning(junit.framework.TestSuite$1): FAILED
 [junit] No tests found in  org.apache.lucene.index.TestNoMergeScheduler
 [junit]  junit.framework.AssertionFailedError: No 

Re: Remove part of keywords from existing index and merging new index

2011-02-20 Thread Otis Gospodnetic
Ryan,

It's not possible out of the box, no.  If your docs with abc* keywords have all 
fields stored, you could get them from the index, modify them in memory to 
remove abc*, and send them back to Solr for indexing.  It's still reindexing, 
but only of those particular documents and without having to go to the original 
document source.  But it does require all fields to be stored, so you can get 
and modify their values in your custom app.

Otis

Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecosystem search :: http://search-lucene.com/



- Original Message 
 From: Ryan Chan ryanchan...@gmail.com
 To: solr-user@lucene.apache.org
 Sent: Sat, February 19, 2011 12:06:52 AM
 Subject: Remove part of keywords from existing index and merging new index
 
 Hello,
 
 I am not sure if it is possible.
 
 1. I have a document of  100MB, I want to remove keywords started with
 a specific pattern, e.g. abc*,  so all keywords started with abc* in
 the index will be removed, and I don't  need to reindex the document
 again.
 
 2. I have another document of  100KB, I want to append the new document
 to an existing one, without the new  to reindex the existing document
 again.
 
 
 I believe (2) is possible,  but not sure about (1).
 
 Thanks.
 


Re: adding a TimerTask

2011-02-20 Thread Otis Gospodnetic
Tri,

What you are you trying to accomplish?

Otis
---
Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecosystem search :: http://search-lucene.com/



- Original Message 
 From: Tri Nguyen tringuye...@yahoo.com
 To: solr user solr-user@lucene.apache.org
 Sent: Fri, February 18, 2011 9:02:44 PM
 Subject: adding a TimerTask
 
 Hi,
 
 How can I add a TimerTask to Solr?
 
 Tri


Re: XML Stripping from DIH

2011-02-20 Thread Otis Gospodnetic
Ron,

http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters#solr.HTMLStripCharFilterFactory


Otis

Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecosystem search :: http://search-lucene.com/



- Original Message 
 From: Olson, Ron rol...@lbpc.com
 To: solr-user@lucene.apache.org solr-user@lucene.apache.org
 Sent: Fri, February 18, 2011 4:05:15 PM
 Subject: XML Stripping from DIH
 
 Hi all-
 
 I have some XML in a database that I am trying to index and  store; I am 
interested in the various pieces of text, but none of the tags. I've  been 
trying to figure out a way to strip all the tags out, but haven't found  
anything within Solr to do so; the XML parser seems to want XPath to get the  
various element values, when all I want is to turn the whole thing into one 
blob  
of text, regardless of whether it makes any contextual sense.
 
 Is there  something in Solr to do this, or is it something I'd have to write 
myself (which  I'm willing to do if necessary)?
 
 Thanks for any  info,
 
 Ron
 
 DISCLAIMER: This electronic message, including any  attachments, files or 
documents, is intended only for the addressee and may  contain CONFIDENTIAL, 
PROPRIETARY or LEGALLY PRIVILEGED information.  If  you are not the intended 
recipient, you are hereby notified that any use,  disclosure, copying or 
distribution of this message or any of the information  included in or with it 
is  unauthorized and strictly prohibited.  If  you have received this message 
in 
error, please notify the sender immediately by  reply e-mail and permanently 
delete and destroy this message and its  attachments, along with any copies 
thereof. This message does not create any  contractual obligation on behalf of 
the sender or Law Bulletin Publishing  Company.
 Thank you.
 


Re: Understanding multi-field queries with q and fq

2011-02-20 Thread Otis Gospodnetic
Hi mrw,

It sounds like you (e)dismax is what you should look into.  You didn't mention 
it/them, so I'm assuming you're not aware of them.

See: http://search-lucene.com/?q=dismax+OR+edismaxfc_project=Solr

Otis

Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecosystem search :: http://search-lucene.com/



- Original Message 
 From: mrw mikerobertsw...@gmail.com
 To: solr-user@lucene.apache.org
 Sent: Fri, February 18, 2011 1:56:24 PM
 Subject: Understanding multi-field queries with q and fq
 
 
 
 After searching this list, Google, and looking through the Pugh book, I  am a
 little confused about the right way to structure a query.
 
 The  Packt book uses the example of the MusicBrainz DB full of song metadata. 
 What if they also had the song lyrics in English and German as files  on
 disk, and wanted to index them along with the metadata, so that  each
 document would basically have song title, artist, publisher, date,  ...,
 All_Metadata (copy field of all metadata fields), Text_English,  and
 Text_German fields?  
 
 There can only be one default field,  correct?  So if we want to search for
 all songs containing (zeppelin AND  (dog OR merle)) do we 
 
 repeat the entire query text for all three major  fields in the 'q' clause
 (assuming we don't want to use the  cache):
 
 q=(+All_Metadata:zeppelin AND (dog OR  merle)+Text_English:zeppelin AND (dog
 OR merle)+Text_German:(zeppelin AND  (dog OR merle))
 
 or repeat the entire query text for all three major  fields in the 'fq'
 clause (assuming we want to use the  cache):
 
 q=*:*fq=(+All_Metadata:zeppelin AND (dog OR  merle)+Text_English:zeppelin
 AND (dog OR merle)+Text_German:zeppelin AND (dog  OR merle))
 
 ?
 
 Thanks!
 
 
 -- 
 View this message in  context: 
http://lucene.472066.n3.nabble.com/Understanding-multi-field-queries-with-q-and-fq-tp2528866p2528866.html

 Sent  from the Solr - User mailing list archive at Nabble.com.
 


Re: string field_type query

2011-02-20 Thread Otis Gospodnetic
Isha,

Could be a case sensitivity thing.  Try crime if that's what's that field 
(you 
can look manually when you run *:* or with Luke.

Otis

Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecosystem search :: http://search-lucene.com/



- Original Message 
 From: Isha Garg isha.g...@orkash.com
 To: solr-user@lucene.apache.org
 Sent: Fri, February 18, 2011 7:31:38 AM
 Subject: string field_type query
 
 i had declare a field_name=category ,field_type=string
 now i am querying  category:Crime but it did nt show any results .But when i 
query for *:* it shows  values related to this category
 can anyone tell me the problem?
 


Re: SolrCloud new....

2011-02-20 Thread Otis Gospodnetic
Hi Stijn,

Thank you for sharing this.
Would it at all be possible for you to update the parts of SolrCloud page that 
are incorrect and that you figured out or add anything new that's not on that 
page yet?

Thanks!

Otis

Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecosystem search :: http://search-lucene.com/



- Original Message 
 From: Stijn Vanhoorelbeke stijn.vanhoorelb...@gmail.com
 To: solr-user@lucene.apache.org
 Sent: Fri, February 18, 2011 6:42:10 AM
 Subject: Re: SolrCloud new
 
 
 Hi,
 
 I'm busy doing the exact same thing.
 I figured things out -  all  by myself - the wiki page is a nice 'fist view',
 but doesn't goes  in dept...
 
 Lets go ahead:
 1)Should i copy the libraries from cloud to  trunk???
 2)should i keep the cloud module in every system???
 
 A: Yes,  you should.
 You should get yourself the latest dev trunk and compile  it.
 
 The steps I followed:
 + grap latest trunk  build solr
 +  backup all solr config files
 + in dir tomcat6/webapps/ remove the dir  'solr'
 + copy the new solr.war ( which you build in first step ) to  tomcat6/webapps
 + On your Solr_home/conf dir solrconfig.xml need to be  replaced by a new one
 ( you take from example dir of your build) -- some  other config files ( like
 schema.xml ) you may keep using the old ones.
 +  Adapt the new files to represent the old configuration
 + restart tomcat and  it will install new version of solr
 
 It seems the index isn't compatible -  so you need to flush your whole index
 and re-index all data.
 And finally  you have your solr system back with zookeeper integrated in
 /admin zone  :)
 
 
 3) I am not using any cores in the solr. It is a single solr in  every
 system.can solrcloud support it??
 
 A: Actually you are using one  cor - so gives no problem.
 But be sure to check you have solr.xml file in  your solr_home dir.
 This file just mentions all cores - in your case just one  core;
 ( you can find examples of layout of this file easily on
 http://wiki.apache.org/solr/CoreAdmin )
 
 4) the example is given in  jetty.Is it the same way to make it in tomcat???
 
 A: Right now - it is the  same way.
 You have to edit your /etc/init.d/tomcat6 startup script. In the  start)
 section you can specify all the JAVA_OPTS ( the ones the solrcloud  wiki
 mentions).
 
 Be sure to set following one:
 export  JAVA_OPTS=$JAVA_OPTS -DhostPort=8080 ( if tomcat runs on port  8080
 )
 
 At first I didn't --  my zookeeper pointed to standard  8983 port, which
 gave errors.
 
 
 In the above I gave you a quick peak  how to get the SolrCloud feature.
 In above the Zookeeper is embedded in one  of your solr machines. If you
 don't want this you may place zookeeper on a  different machine ( like I'm
 doing right now).
 
 If you need more help -  you can contact me.
 Stijn Vanhoorelbeke,
 
 
 -- 
 View this message  in context: 
http://lucene.472066.n3.nabble.com/SolrCloud-new-tp1528872p2526080.html
 Sent  from the Solr - User mailing list archive at Nabble.com.
 


Re: fine tuning the solr search

2011-02-20 Thread Otis Gospodnetic
Hi,

In short, the bigger the overlap of query and document, the higher the 
document's relevance to the query.  This is an oversimplification, of course, 
but that's the general idea (and it doesn't match what you listed below).

Otis

Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
Lucene ecosystem search :: http://search-lucene.com/



- Original Message 
 From: Churchill Nanje Mambe mambena...@afrovisiongroup.com
 To: solr-user@lucene.apache.org
 Sent: Thu, February 17, 2011 6:50:08 AM
 Subject: fine tuning the solr search
 
 Hi
  I would love to know how to do this with solr
  say a user inputs  Account manager files,
  I wish that solr puts priority on the documents it  finds as follows
  1) documents containing account manager files gets a  greater score
  2) then documents with account manager come next
  3) then  documents with account can come
  before the other words are used to get  documents in the search
 
 right now I think it works different as it finds  documents with
 accounts and puts them like in first position or documents  with word
 manager in second position or so
 
 thanks
 -- 
 Mambe  Churchill Nanje
 237 33011349,
 AfroVisioN Founder, President,CEO
 http://www.afrovisiongroup.com | http://mambenanje.blogspot.com
 skypeID:  mambenanje
 www.twitter.com/mambenanje
 


How to get a field that starts with a minus?

2011-02-20 Thread Paul Tomblin
I have a field in my database, id, which is the unique key.  The id
is generated as an MD5 hash of some of the other data in the record,
and unfortunately the way I converted it to hex meant that sometimes I
get a negative value.  I'm having a real hard time figuring out the
right combination of quotes and escapes so I can actually query these
things using SolrJ.  On the Solr web interface, I can just do put in
id:-3f66fdfb1ef5f8719f65a7403e93cc9d
which results in a url like:
http://localhost:8080/solrChunk/nutch/select/?q=id:%22-3f66fdfb1ef5f8719f65a7403e93cc9d%22version=2.2start=0rows=10indent=on
but when I try that using SolrJ

SolrQuery query = new SolrQuery();
query.setQuery(key + : + value);
query.setRows(NUM_AT_A_TIME);

int start = 0;
while (true)
{
query.setStart(start);
QueryResponse resp = solrChunkServer.query(query);
SolrDocumentList docs = resp.getResults();
LOG.debug(got  + docs.getNumFound() +  documents
(or  + docs.size() +  if you prefer));
if (docs.size() == 0)
break;

for (SolrDocument doc : docs)
{
retCode.add(doc);
}
if (docs.size()  NUM_AT_A_TIME)
break;

start += NUM_AT_A_TIME;
}

I call that using key = id and value =
-3f66fdfb1ef5f8719f65a7403e93cc9d and I get an exception.  If I
change value to \-3f66fdfb1ef5f8719f65a7403e93cc9d\, I get no
results.  If I change value to \-3f66fdfb1ef5f8719f65a7403e93cc9d, I
get no results.  If I change value to
\\-3f66fdfb1ef5f8719f65a7403e93cc9d\, I get no results.

If I had hair, I'd be tearing it out right now.

-- 
http://www.linkedin.com/in/paultomblin
http://careers.stackoverflow.com/ptomblin


Re: How to get a field that starts with a minus?

2011-02-20 Thread Ahmet Arslan

What is the field type of if field? Is it string?

What happens when you do :

q={!raw f=id}-3f66fdfb1ef5f8719f65a7403e93cc9d

query.setQuery({!raw f=id}-3f66fdfb1ef5f8719f65a7403e93cc9d);



--- On Sun, 2/20/11, Paul Tomblin ptomb...@xcski.com wrote:

 From: Paul Tomblin ptomb...@xcski.com
 Subject: How to get a field that starts with a minus?
 To: solr-user@lucene.apache.org
 Date: Sunday, February 20, 2011, 5:15 PM
 I have a field in my database, id,
 which is the unique key.  The id
 is generated as an MD5 hash of some of the other data in
 the record,
 and unfortunately the way I converted it to hex meant that
 sometimes I
 get a negative value.  I'm having a real hard time
 figuring out the
 right combination of quotes and escapes so I can actually
 query these
 things using SolrJ.  On the Solr web interface, I can
 just do put in
 id:-3f66fdfb1ef5f8719f65a7403e93cc9d
 which results in a url like:
 http://localhost:8080/solrChunk/nutch/select/?q=id:%22-3f66fdfb1ef5f8719f65a7403e93cc9d%22version=2.2start=0rows=10indent=on
 but when I try that using SolrJ
 
         SolrQuery query = new
 SolrQuery();
         query.setQuery(key + : +
 value);
         query.setRows(NUM_AT_A_TIME);
 
             int start = 0;
             while (true)
             {
                
 query.setStart(start);
                
 QueryResponse resp = solrChunkServer.query(query);
                
 SolrDocumentList docs = resp.getResults();
                
 LOG.debug(got  + docs.getNumFound() +  documents
 (or  + docs.size() +  if you prefer));
                 if
 (docs.size() == 0)
                
     break;
 
                 for
 (SolrDocument doc : docs)
                 {
                
     retCode.add(doc);
                 }
                 if
 (docs.size()  NUM_AT_A_TIME)
                
     break;
 
                
 start += NUM_AT_A_TIME;
             }
 
 I call that using key = id and value =
 -3f66fdfb1ef5f8719f65a7403e93cc9d and I get an
 exception.  If I
 change value to \-3f66fdfb1ef5f8719f65a7403e93cc9d\, I
 get no
 results.  If I change value to
 \-3f66fdfb1ef5f8719f65a7403e93cc9d, I
 get no results.  If I change value to
 \\-3f66fdfb1ef5f8719f65a7403e93cc9d\, I get no
 results.
 
 If I had hair, I'd be tearing it out right now.
 
 -- 
 http://www.linkedin.com/in/paultomblin
 http://careers.stackoverflow.com/ptomblin
 





Re: How to get a field that starts with a minus?

2011-02-20 Thread Paul Tomblin
Yes, it's string:
   fieldType name=string class=solr.StrField
sortMissingLast=true omitNorms=true/
field name=id type=string stored=true indexed=true/

Is there a better field definition I should be using?

On Sun, Feb 20, 2011 at 10:37 AM, Ahmet Arslan iori...@yahoo.com wrote:

 What is the field type of if field? Is it string?

 What happens when you do :

 q={!raw f=id}-3f66fdfb1ef5f8719f65a7403e93cc9d

 query.setQuery({!raw f=id}-3f66fdfb1ef5f8719f65a7403e93cc9d);



 --- On Sun, 2/20/11, Paul Tomblin ptomb...@xcski.com wrote:

 From: Paul Tomblin ptomb...@xcski.com
 Subject: How to get a field that starts with a minus?
 To: solr-user@lucene.apache.org
 Date: Sunday, February 20, 2011, 5:15 PM
 I have a field in my database, id,
 which is the unique key.  The id
 is generated as an MD5 hash of some of the other data in
 the record,
 and unfortunately the way I converted it to hex meant that
 sometimes I
 get a negative value.  I'm having a real hard time
 figuring out the
 right combination of quotes and escapes so I can actually
 query these
 things using SolrJ.  On the Solr web interface, I can
 just do put in
 id:-3f66fdfb1ef5f8719f65a7403e93cc9d
 which results in a url like:
 http://localhost:8080/solrChunk/nutch/select/?q=id:%22-3f66fdfb1ef5f8719f65a7403e93cc9d%22version=2.2start=0rows=10indent=on
 but when I try that using SolrJ

         SolrQuery query = new
 SolrQuery();
         query.setQuery(key + : +
 value);
         query.setRows(NUM_AT_A_TIME);

             int start = 0;
             while (true)
             {

 query.setStart(start);

 QueryResponse resp = solrChunkServer.query(query);

 SolrDocumentList docs = resp.getResults();

 LOG.debug(got  + docs.getNumFound() +  documents
 (or  + docs.size() +  if you prefer));
                 if
 (docs.size() == 0)

     break;

                 for
 (SolrDocument doc : docs)
                 {

     retCode.add(doc);
                 }
                 if
 (docs.size()  NUM_AT_A_TIME)

     break;


 start += NUM_AT_A_TIME;
             }

 I call that using key = id and value =
 -3f66fdfb1ef5f8719f65a7403e93cc9d and I get an
 exception.  If I
 change value to \-3f66fdfb1ef5f8719f65a7403e93cc9d\, I
 get no
 results.  If I change value to
 \-3f66fdfb1ef5f8719f65a7403e93cc9d, I
 get no results.  If I change value to
 \\-3f66fdfb1ef5f8719f65a7403e93cc9d\, I get no
 results.

 If I had hair, I'd be tearing it out right now.

 --
 http://www.linkedin.com/in/paultomblin
 http://careers.stackoverflow.com/ptomblin








-- 
http://www.linkedin.com/in/paultomblin
http://careers.stackoverflow.com/ptomblin


Synonyms.txt

2011-02-20 Thread Marc Kalberer

Hello,
Is there any free Synonyms.txt available on internet ?  Wasn't able to 
find any.  Specially interested by the french version.

++
Marc
--
*Programmers.ch*
Développement WEB
Solutions libres et Opensources
Tel: ++41 76 44 888 72
Site: http://www.programmers.ch


Re: How to get a field that starts with a minus?

2011-02-20 Thread Ahmet Arslan

--- On Sun, 2/20/11, Paul Tomblin ptomb...@xcski.com wrote:

 From: Paul Tomblin ptomb...@xcski.com
 Subject: Re: How to get a field that starts with a minus?
 To: solr-user@lucene.apache.org
 Date: Sunday, February 20, 2011, 5:53 PM
 Yes, it's string:
        fieldType name=string
 class=solr.StrField
            
 sortMissingLast=true omitNorms=true/
         field name=id
 type=string stored=true indexed=true/


No, string is OK. In this case it is better to use raw or field query parser. 

SolrQuery.setQuery({!raw f=id}-3f66fdfb1ef5f8719f65a7403e93cc9d);






Re: How to get a field that starts with a minus?

2011-02-20 Thread Paul Tomblin
On Sun, Feb 20, 2011 at 10:15 AM, Paul Tomblin ptomb...@xcski.com wrote:
 I have a field in my database, id, which is the unique key.  The id
 is generated as an MD5 hash of some of the other data in the record,
 and unfortunately the way I converted it to hex meant that sometimes I
 get a negative value.  I'm having a real hard time figuring out the

It turns out that the problem isn't the minus sign, the problem is
that I keep expecting Solr to act like a relational database.  In a
relational database, if you do inserts, your queries will find those
records even if you haven't committed them.  It's only *other*
database connections that won't find the records until you commit.
But evidently in Solr, even the original connection/thread that
inserted the records doesn't see them in a query until you commit them
- I assume that's because a web connection is stateless.  I added a
commit before my query, and now I can find them.

-- 
http://www.linkedin.com/in/paultomblin
http://careers.stackoverflow.com/ptomblin


Re: Synonyms.txt

2011-02-20 Thread lee carroll
Hi Marc,
I don't want to sound to prissy and also assume to much about your
application but a generic synonym file could do more harm than good. Lots of
applications have specific vocabularies and a specific synonym list is what
is needed. Remember synonyms increase recall but reduce precision. The
better matched your synonym list is to your users and their searches the
better this ratio between recall and precision will be.

Without knowing your app or motivation I'd say don't go for a generic list
but maybe its right for your circumstances.

see this thread here

http://lucene.472066.n3.nabble.com/French-synonyms-amp-Online-synonyms-td488829.html

On 20 February 2011 15:58, Marc Kalberer i...@programmers.ch wrote:

 Hello,
 Is there any free Synonyms.txt available on internet ?  Wasn't able to find
 any.  Specially interested by the french version.
 ++
 Marc
 --
 *Programmers.ch*
 Développement WEB
 Solutions libres et Opensources
 Tel: ++41 76 44 888 72
 Site: http://www.programmers.ch



Re: How to get a field that starts with a minus?

2011-02-20 Thread Ahmet Arslan
 He could also just escape it or am i
 missing something?

Yes, he can also just escape minus sign using back slash.


  


Re: How to get a field that starts with a minus?

2011-02-20 Thread Paul Tomblin
As I said in my original post, I'd already tried various methods of escaping:
:call that using key = id and value =
:-3f66fdfb1ef5f8719f65a7403e93cc9d and I get an exception.  If I
:change value to \-3f66fdfb1ef5f8719f65a7403e93cc9d\, I get no
:results.  If I change value to \-3f66fdfb1ef5f8719f65a7403e93cc9d, I
:get no results.  If I change value to
:\\-3f66fdfb1ef5f8719f65a7403e93cc9d\, I get no results.

But it turned out that the values I was querying for had been added
but not committed.

On Sun, Feb 20, 2011 at 11:17 AM, Markus Jelsma
markus.jel...@openindex.io wrote:
 He could also just escape it or am i missing something?

 --- On Sun, 2/20/11, Paul Tomblin ptomb...@xcski.com wrote:
  From: Paul Tomblin ptomb...@xcski.com
  Subject: Re: How to get a field that starts with a minus?
  To: solr-user@lucene.apache.org
  Date: Sunday, February 20, 2011, 5:53 PM
  Yes, it's string:
         fieldType name=string
  class=solr.StrField
 
  sortMissingLast=true omitNorms=true/
          field name=id
  type=string stored=true indexed=true/

 No, string is OK. In this case it is better to use raw or field query
 parser.

 SolrQuery.setQuery({!raw f=id}-3f66fdfb1ef5f8719f65a7403e93cc9d);




-- 
http://www.linkedin.com/in/paultomblin
http://careers.stackoverflow.com/ptomblin


Re: Synonyms.txt

2011-02-20 Thread Marc Kalberer
Thanks Lee !
Your are right,  I'm new to solr, and I didn't think about that point. 
But in my case, target is newspaper articles, so it's more generic
contents that specialized contents and I suppose that a generic synonym
dictionnary should fit my needs. Thanks for the link !
Marc

Programmers.ch
Solutions libres et Opensources
Tel: ++41 76 44 888 72
Site: http://www.programmers.ch


Le 20. 02. 11 17:27, lee carroll a écrit :
 Hi Marc,
 I don't want to sound to prissy and also assume to much about your
 application but a generic synonym file could do more harm than good. Lots of
 applications have specific vocabularies and a specific synonym list is what
 is needed. Remember synonyms increase recall but reduce precision. The
 better matched your synonym list is to your users and their searches the
 better this ratio between recall and precision will be.

 Without knowing your app or motivation I'd say don't go for a generic list
 but maybe its right for your circumstances.

 see this thread here

 http://lucene.472066.n3.nabble.com/French-synonyms-amp-Online-synonyms-td488829.html

 On 20 February 2011 15:58, Marc Kalberer i...@programmers.ch wrote:

 Hello,
 Is there any free Synonyms.txt available on internet ?  Wasn't able to find
 any.  Specially interested by the french version.
 ++
 Marc
 --
 *Programmers.ch*
 Développement WEB
 Solutions libres et Opensources
 Tel: ++41 76 44 888 72
 Site: http://www.programmers.ch



Re: SolrCloud new....

2011-02-20 Thread Stijn Vanhoorelbeke

Hi,

Can I edit the SolrCloud page?
I never thought about it - but since it's a wiki -- everyone can edit,
right?

For the moment I'll not write stuff onto it - but if you need some help, I
can share you some of my ( little, but some ) experience.

2011/2/20 Otis Gospodnetic-2 [via Lucene] 
ml-node+2538747-751169843-301...@n3.nabble.com

 Hi Stijn,

 Thank you for sharing this.
 Would it at all be possible for you to update the parts of SolrCloud page
 that
 are incorrect and that you figured out or add anything new that's not on
 that
 page yet?

 Thanks!

 Otis
 
 Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch
 Lucene ecosystem search :: http://search-lucene.com/



 - Original Message 

  From: Stijn Vanhoorelbeke [hidden 
  email]http://user/SendEmail.jtp?type=nodenode=2538747i=0

  To: [hidden email]http://user/SendEmail.jtp?type=nodenode=2538747i=1
  Sent: Fri, February 18, 2011 6:42:10 AM
  Subject: Re: SolrCloud new
 
 
  Hi,
 
  I'm busy doing the exact same thing.
  I figured things out -  all  by myself - the wiki page is a nice 'fist
 view',
  but doesn't goes  in dept...
 
  Lets go ahead:
  1)Should i copy the libraries from cloud to  trunk???
  2)should i keep the cloud module in every system???
 
  A: Yes,  you should.
  You should get yourself the latest dev trunk and compile  it.
 
  The steps I followed:
  + grap latest trunk  build solr
  +  backup all solr config files
  + in dir tomcat6/webapps/ remove the dir  'solr'
  + copy the new solr.war ( which you build in first step ) to
  tomcat6/webapps
  + On your Solr_home/conf dir solrconfig.xml need to be  replaced by a new
 one
  ( you take from example dir of your build) -- some  other config files (
 like
  schema.xml ) you may keep using the old ones.
  +  Adapt the new files to represent the old configuration
  + restart tomcat and  it will install new version of solr
 
  It seems the index isn't compatible -  so you need to flush your whole
 index
  and re-index all data.
  And finally  you have your solr system back with zookeeper integrated in
  /admin zone  :)
 
 
  3) I am not using any cores in the solr. It is a single solr in  every
  system.can solrcloud support it??
 
  A: Actually you are using one  cor - so gives no problem.
  But be sure to check you have solr.xml file in  your solr_home dir.
  This file just mentions all cores - in your case just one  core;
  ( you can find examples of layout of this file easily on
  http://wiki.apache.org/solr/CoreAdmin )
 
  4) the example is given in  jetty.Is it the same way to make it in
 tomcat???
 
  A: Right now - it is the  same way.
  You have to edit your /etc/init.d/tomcat6 startup script. In the  start)
  section you can specify all the JAVA_OPTS ( the ones the solrcloud  wiki
  mentions).
 
  Be sure to set following one:
  export  JAVA_OPTS=$JAVA_OPTS -DhostPort=8080 ( if tomcat runs on port
  8080
  )
 
  At first I didn't --  my zookeeper pointed to standard  8983 port, which

  gave errors.
 
 
  In the above I gave you a quick peak  how to get the SolrCloud feature.
  In above the Zookeeper is embedded in one  of your solr machines. If you
  don't want this you may place zookeeper on a  different machine ( like
 I'm
  doing right now).
 
  If you need more help -  you can contact me.
  Stijn Vanhoorelbeke,
 
 
  --
  View this message  in context:
 http://lucene.472066.n3.nabble.com/SolrCloud-new-tp1528872p2526080.htmlhttp://lucene.472066.n3.nabble.com/SolrCloud-new-tp1528872p2526080.html?by-user=t
  Sent  from the Solr - User mailing list archive at Nabble.com.
 


 --
  If you reply to this email, your message will be added to the discussion
 below:
 http://lucene.472066.n3.nabble.com/SolrCloud-new-tp1528872p2538747.html
  To unsubscribe from SolrCloud new, click 
 herehttp://lucene.472066.n3.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_codenode=1528872code=c3Rpam4udmFuaG9vcmVsYmVrZUBnbWFpbC5jb218MTUyODg3MnwxNjg2NDg1MjQ0.



-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/SolrCloud-new-tp1528872p2540432.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: Solr 4.0 trunk in production

2011-02-20 Thread Ryan McKinley
Not crazy -- but be aware of a few *key* caviates.

1. Do good testing on a stable snapshot.
2. Don't get surprised if you have to rebuild the index from scratch
to upgrade in the future.  The official releases will upgrade smoothly
-- but within dev builds, anything may happen.



On Sat, Feb 19, 2011 at 9:50 AM, Mark static.void@gmail.com wrote:
 Would I be crazy even to consider putting this in production? Thanks



Re: Solr 4.0 trunk in production

2011-02-20 Thread Mark

Thanks for the adivce.

Where can I find stable snapshots, I only know of checking out from head?

On 2/20/11 11:56 AM, Ryan McKinley wrote:

Not crazy -- but be aware of a few *key* caviates.

1. Do good testing on a stable snapshot.
2. Don't get surprised if you have to rebuild the index from scratch
to upgrade in the future.  The official releases will upgrade smoothly
-- but within dev builds, anything may happen.



On Sat, Feb 19, 2011 at 9:50 AM, Markstatic.void@gmail.com  wrote:

Would I be crazy even to consider putting this in production? Thanks



Re: DIH threads

2011-02-20 Thread Lance Norskog
It does not substitute values correctly in many cases. It seems to
work at a top level, but not in sub-levels.

On Fri, Feb 18, 2011 at 5:41 PM, Bill Bell billnb...@gmail.com wrote:
 I used it on 4,0 and it did not help us. We were bound on SQL io

 Bill Bell
 Sent from mobile


 On Feb 18, 2011, at 4:47 PM, Mark static.void@gmail.com wrote:

 Has anyone applied the DIH threads patch on 1.4.1 
 (https://issues.apache.org/jira/browse/SOLR-1352)?

 Does anyone know if this works and/or does it improve performance?

 Thanks






-- 
Lance Norskog
goks...@gmail.com


Re: Query performance very slow even after autowarming

2011-02-20 Thread linkedLetter

Johnny:

Are you still looking for help?


Wease

-
NOT always nice. When are we getting better releases?
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Query-performance-very-slow-even-after-autowarming-tp2010384p2542789.html
Sent from the Solr - User mailing list archive at Nabble.com.


change in field_type

2011-02-20 Thread Isha Garg

Hii,

  I want to confirm that if a change the type of a field from 
sting to text in schema.xml then whether i have rebuild the index or 
will it works fine with previous index.






Re: change in field_type

2011-02-20 Thread Sachin

 Rebuild - the tokenizers/analyzers for string type would be different for 
string and text type.

 


 

 

-Original Message-
From: Isha Garg isha.g...@orkash.com
To: solr-user solr-user@lucene.apache.org
Sent: Mon, Feb 21, 2011 10:51 am
Subject: change in field_type


Hii,



   I want to confirm that if a change the type of a field from 

sting to text in schema.xml then whether i have rebuild the index or 

will it works fine with previous index.