Re: Does solr use Java hotspot client?

2006-04-03 Thread Bill Au
Solr is just a webapp that runs inside an appserver. So it is up to the user to tune the JVM for the appserver. Besides, client vs server mode, one can also tune the heap size and garbage collection, as well as many many other options of the JVM:

Re: Solr is indexing XML only?

2006-04-26 Thread Bill Au
With Solr you can index anything Lucene can index since Solr uses Lucene under the cover. The input to Solr is in XML format. You will need to process that data you want to index (ie exclude certain files and remove HTML tags) and put them into Solr's input format. Bill On 4/26/06, David

Re: Java heap space

2006-05-05 Thread Bill Au
There seems to be a fair number of folks using the jetty with the example app as oppose to using Solr with their own appserver. So I think it is best to use a stable version of Jetty instead of the beta. If no one objects, I can go ahead and take care of this. Bill On 5/4/06, Yonik Seeley

Re: Java heap space

2006-05-09 Thread Bill Au
FYI, I have just committed the a On 5/8/06, Bill Au [EMAIL PROTECTED] wrote: I was able to produce an OutOfMemoryError using Yonik's python script with Jetty 6. I was not able to do so with Jetty 5.1.11RC0, the latest stable version. So that's the version of Jetty with which I will downgrade

Re: Java heap space

2006-05-09 Thread Bill Au
Sorry, hit the wrong key before... FYI, I have just committed all the changes related to the Jetty downgrade into SVN. Let me know if you notice anything problems. Bill On 5/9/06, Bill Au [EMAIL PROTECTED] wrote: FYI, I have just committed the a On 5/8/06, Bill Au [EMAIL PROTECTED] wrote

Re: solrconfig environment variable

2006-05-24 Thread Bill Au
The admin page has a link, LOGGING, that will let you set the logging level on the fly: http://localhost:8983/solr/admin/logging.jsp Bill On 5/24/06, Chris Hostetter [EMAIL PROTECTED] wrote: : Talking about configuration and system properties: is it possible to set : the log level of Solr's

Re: Wildcard Query

2006-06-20 Thread Bill Au
If it is just a matter of matching lower case to upper case and upper case to lower case, one can simply use the LowercaseFilter. Bill On 6/20/06, Erik Hatcher [EMAIL PROTECTED] wrote: On Jun 20, 2006, at 6:07 AM, Pace Davis wrote: Ok, before I go start writing a new request handlerlet

Re: Distribution and Tomcat

2006-06-26 Thread Bill Au
I added what I considered a first draft into the solrconfig.xml wiki. Bill On 6/23/06, Chris Hostetter [EMAIL PROTECTED] wrote: : You can put a load balancer in front of the pool of slave servers for that. Solr does have some features designed to make Load Balancing easy * healthcheck

Re: When to commit?

2006-06-29 Thread Bill Au
Also keep in mind that changes and additions to the index is not visible by the clients until a commit has occured. Bill On 6/28/06, Erik Hatcher [EMAIL PROTECTED] wrote: On Jun 28, 2006, at 3:43 PM, UpAndGone wrote: Another question: Since a commit is expensive, it shouldn't be send after

Re: I think i got right...

2006-10-03 Thread Bill Au
solar.war should be copied into the webapps directory, not lib. Bill On 10/3/06, Panayiotis Papadopoulos [EMAIL PROTECTED] wrote: Hi there again, sorry for bugging you once more... So i executed the bandled example and know i did the following in Tomcat once again: * Tomcat is set correctly

Re: replication test problems

2006-10-31 Thread Bill Au
It looks like find running under zsh is the problem. In this case it does like the wildcard (*). I don't really know zsh so I will have to spend some time to investigate. Bill On 10/30/06, Yu-Hui Jin [EMAIL PROTECTED] wrote: Hi, Hoss, Thanks for the reply! For #2, I think I just need to

Re: Multiple indexes...

2006-12-22 Thread Bill Au
While it may be easier from a management perspective, there are also disadvantages with runnning multiple indices within a single appserver port: - they are sharing the memory of a single JVM so the size of the cache has to be smaller then running a singler instance per appserver instance - a

Re: Analyzers and Tokenizers?

2007-02-07 Thread Bill Au
FYI, I have added that link into the Wiki. Bill On 2/6/07, rubdabadub [EMAIL PROTECTED] wrote: Thanks Thorsten! On 2/6/07, Thorsten Scherler [EMAIL PROTECTED] wrote: On Tue, 2007-02-06 at 17:27 +0100, rubdabadub wrote: Hi: Are there more filters/tokenizers then the ones mentioned

Re: Question re snapinstaller

2007-02-13 Thread Bill Au
Solr snapshots are created using hard links. The file is not deleted as long as there is 1 or more link to it. Bill On 2/13/07, Mike Klaas [EMAIL PROTECTED] wrote: On 2/13/07, Ken Krugler [EMAIL PROTECTED] wrote: A Lucene's IndexReader opens all index files it needs when it is

Re: Incremental replication...

2007-02-13 Thread Bill Au
FYI, additional information on replication is available in the Solr TWiki: http://wiki.apache.org/solr/CollectionDistribution Bill On 2/13/07, Bertrand Delacretaz [EMAIL PROTECTED] wrote: On 2/13/07, escher2k [EMAIL PROTECTED] wrote: ...Atleast from looking at the snapshooter script, it

Re: JVM random crashes

2007-03-05 Thread Bill Au
Seems like this maybe a JVM bug: http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=6500147 http://forum.java.sun.com/thread.jspa?threadID=659990messageID=3876052 Have you tried using a different garbage collector? Bill On 3/3/07, Jed Reynolds [EMAIL PROTECTED] wrote: Yonik Seeley wrote:

Re: logging off

2007-03-05 Thread Bill Au
FYI, the admin page has a link, [LOGGING], that can be use to change Solr's logging on the fly. Bill On 3/4/07, Chris Hostetter [EMAIL PROTECTED] wrote: : Hi Brian, all you have to do is create a logging.properties file and : call this before starting up solr: : :

Re: Controlling read/write access for replicated indexes

2007-04-09 Thread Bill Au
Solr's web.xml has a servlet-mapping which maps url-pattern /update/* to the SolrUpdateServlet. You can set up a security-constraint on that to protect against inadvertent updates. Bill On 3/28/07, Jeff Rodenburg [EMAIL PROTECTED] wrote: I'm curious what mechanisms everyone is using to

Re: Solr logo poll

2007-04-09 Thread Bill Au
A Bill On 4/9/07, Michael Kimsal [EMAIL PROTECTED] wrote: My wife votes for A. :) On 4/9/07, Nitin Borwankar [EMAIL PROTECTED] wrote: B Yonik Seeley wrote: Quick poll... Solr 2.1 release planning is underway, and a new logo may be a part of that. What form of logo do you prefer,

Re: Solr Scripts.conf Parsing Error

2007-04-11 Thread Bill Au
What does your directory structure looks like? Have you tried running rsyncd-enable with bash -x to see how/what $user is set? Bill On 4/9/07, realw5 [EMAIL PROTECTED] wrote: Hello, I'm having troubles getting replication to work using the supplied solr scripts. I've been doing alot of

Re: Solr Scripts.conf Parsing Error

2007-04-12 Thread Bill Au
++ whoami ]][ root != solr + sudo -u $'solr\r' ./solr/bin/rsyncd-enable -V !udo: no passwd entry for solr + exit 1 ++ echo -ne '\033]0;[EMAIL PROTECTED]:/usr/local/apache-tomcat\007' Dan Bill Au wrote: What does your directory structure looks like? Have you tried running rsyncd-enable with bash

Re: Solr Scripts.conf Parsing Error

2007-04-14 Thread Bill Au
Or simply create a new copy of the file using vi locally on the system where you are running solr. Don't cut and paste since you may include the non-printing characters that way too. Simply type in the content of the file. Bill On 4/14/07, Venkatesh Seetharam [EMAIL PROTECTED] wrote: you

Re: Snapshooting or replicating recently indexed data

2007-04-23 Thread Bill Au
Here's the Solr Wiki on collection distribution: http://wiki.apache.org/solr/CollectionDistribution It describes the incremental nature of the distribution: A collection is a directory of many files. Collections are distributed to the slaves as snapshots of these files. Each snapshot is made

Re: snapshooter on OS X

2007-04-23 Thread Bill Au
You can also run the script with the -V option. It shows debugging info but not as much as bash -x. I tried snapshooter on OS X 10.4.9. I did get the cp: illegal option -- l error. But that's the only error I got. Bill On 4/23/07, Bertrand Delacretaz [EMAIL PROTECTED] wrote: On 4/23/07,

Re: wrong path in snappuller

2007-04-25 Thread Bill Au
What OS are you running on? The solr on the rsync command line is just a label which is defined in rsyncd.conf on the master. rsyncd.conf is created on the fly by the script rsyncd-start: cat EOF ${solr_root}/conf/rsyncd.conf rsyncd.conf file uid = $(whoami) gid = $(whoami) use

Re: resin faile to start with solr.

2007-04-27 Thread Bill Au
version before 3.0.19). Even though you're using a later version of Resin, I've had lots of issues with their XML parsing. -- Ken 2007/4/26, Bill Au [EMAIL PROTECTED]: Have you tried resin 3.0.x? 3.1 is a development branch so it is less stable as 3.0. Bill On 4/19/07, James liu

Re: Collection Distirbution in windows

2007-05-02 Thread Bill Au
The collection distribution scripts relies on hard links and rsync. It seems that both maybe avaialble on Windows hard links: http://www.microsoft.com/resources/documentation/windows/xp/all/proddocs/en-us/fsutil_hardlink.mspx?mfr=true rsync: http://samba.anu.edu.au/rsync/download.html I say

Re: Index corruptions?

2007-05-03 Thread Bill Au
In additional to snapshot, you can also make backup copies of your Solr index using the backup script. Backup are created the same way as snapshots using hard links. Each one is a viable full index. Bill On 5/3/07, Charlie Jackson [EMAIL PROTECTED] wrote: I have a couple of questions

Re: snapshooter no go

2007-06-27 Thread Bill Au
I would also check ls -ld /foo/jetty-6.1.3 too. Bill On 6/27/07, Chris Hostetter [EMAIL PROTECTED] wrote: : Here is a puzzling one. I can't get Solr to invoke snaphooter properly. : Solr claims my snapshooter is not where I said it is: : : SEVERE: java.io.IOException: Cannot run program

Re: distribution scripts on Solaris

2007-07-09 Thread Bill Au
is: rsyncEndSec=`perl -e print time;` -Original Message- From: Bill Au [mailto:[EMAIL PROTECTED] Sent: Monday, July 09, 2007 8:40 AM To: solr-user@lucene.apache.org Subject: distribution scripts on Solaris I am working on bug SOLR-282: https://issues.apache.org/jira/browse/SOLR-282 and noticed

Re: snappuller copying to wrong directory?

2007-07-12 Thread Bill Au
That change doesn't have anything to do with where snappuller place the snapshots. Is the environment variable data_dir set up correctly in conf/scripts.conf? That's where snappuller puts the snapshots. Bill On 7/12/07, Kevin Lewandowski [EMAIL PROTECTED] wrote: I've been running solr

Re: Replication script file issues..

2007-07-18 Thread Bill Au
You should specify snapshooter by its full path, as in: str name=exe/opt/solr/bin/snapshooter/str Bill On 7/18/07, Matthew Runo [EMAIL PROTECTED] wrote: I'm sorry about this guys, but I'm having the strangest path errors with replication.. SEVERE: java.io.IOException: Cannot run program

Re: Replication script file issues..

2007-07-20 Thread Bill Au
FYI, in additional to the -v option, the latest version of all the scripts have a -V option which is equivalent to set -x. Bill On 7/20/07, Matthew Runo [EMAIL PROTECTED] wrote: Just an FYI.. it seems that the generated scripts.conf file had DOS format newlines. Once I did :set

Re: solr doesn't find exe in postCommit event

2007-08-14 Thread Bill Au
The element str name=dir specifies the working directory for the call to Runtime.exec(). You still need to set up your PATH if you don't use an absolute path for the exe element. As Chris has pointed out, the best thing to do is to use an absolute path. Bill On 8/14/07, Chris Hostetter [EMAIL

Solr Tomcat Wiki

2007-08-14 Thread Bill Au
I just noticed that the Solr Tomcat step-by-step instruction ( http://wiki.apache.org/solr/SolrTomcat) is now out-dated due to the face that tomcat the zip file for 5.0.20 had been move from the public mirrors to the archive site. We can either update the Wiki to use 5.0.23 (and then update it

Re: synchronizing slave indexes in distributing collections

2007-08-17 Thread Bill Au
If snapinstaller fails to install the lastest snapshot, then chances are that it would be able to install any earlier snapshots as well. All it does is some very simple filesystem operations and then invoke the Solr server to do a commit. I agree with Chris that the best thing to do is to take

Re: Replication broken.. no helpful errors?

2007-08-31 Thread Bill Au
latest snapshot /opt/solr/data/temp-snapshot.20070816120113 already installed It looks like you have a directory named temp-snapshot.20070816120113 in your data directory. You should remove it. One of the other script might have left that behind somehow. I will update the snapinstaller

Re: Distribution Information?

2007-08-31 Thread Bill Au
Are there any error message in your appserver log files? Bill On 8/31/07, Matthew Runo [EMAIL PROTECTED] wrote: Hello! /solr/admin/distributiondump.jsp This server is set up as a master server, and other servers use the replication scripts to pull updates from it every few minutes. My

Re: Replication broken.. no helpful errors?

2007-09-06 Thread Bill Au
++ On Aug 31, 2007, at 6:11 PM, Bill Au wrote: latest snapshot /opt/solr/data/temp-snapshot.20070816120113 already installed It looks like you have a directory named temp-snapshot.20070816120113 in your data directory. You should

Re: Distribution Information?

2007-09-06 Thread Bill Au
] | 702-943-7833 ++ On Aug 31, 2007, at 6:12 PM, Bill Au wrote: Are there any error message in your appserver log files? Bill On 8/31/07, Matthew Runo [EMAIL PROTECTED] wrote: Hello! /solr/admin/distributiondump.jsp

Re: Replication broken.. no helpful errors?

2007-09-07 Thread Bill Au
As I had pointed out in my first reply to this thread, you had a directory named temp-snapshot.20070816120113 in your data directory on the slave. Snapinstaller was mistakenly treating that as the lastest snapshot and was installing that every time it was called. Snapinstaller didn't trigger a

Re: Distribution Information?

2007-09-07 Thread Bill Au
++ On Sep 6, 2007, at 6:09 AM, Bill Au wrote: That is very strange. Even if there is something wrong with the config or code, the static HTML contained in distributiondump.jsp should show up. Are you using the latest version of the JSP? There has been a recent fix: http

Re: Distribution Information?

2007-09-07 Thread Bill Au
. ++ | Matthew Runo | Zappos Development | [EMAIL PROTECTED] | 702-943-7833 ++ On Sep 7, 2007, at 7:43 AM, Bill Au wrote: I that case, definitely take a look at SOLR-333: http://issues.apache.org/jira/browse/SOLR-333

Re: Distribution Information?

2007-09-10 Thread Bill Au
++ On Sep 7, 2007, at 2:21 PM, Bill Au wrote: I just double checked distribution.jsp. The directory where it looks for status files is hard coded to logs/clients. So for now master_status_dir in your solr/conf/scripts.conf has to be set to that so the scripts will put

Re: Authentication

2007-09-14 Thread Bill Au
Add/Update, Commit/Optimize, Delete, and Delete by query, in Solr are done using the url /update. So should be able to protect that url at the container level outside of Solr. If you want you can protect the query url /select or the admin pages too. Container level authentication is transparent

Re: Authentication

2007-09-14 Thread Bill Au
I meant outside of the Solr code. You are right that it is still in the Solr war file since you will need to put the authentication configuration into web.xml. Bill On 9/14/07, jenix [EMAIL PROTECTED] wrote: When you say outside of Solr do you mean outside of solr.war? We finally got

Re: Solr Index - no segments* file found in org.apache.lucene.store.FSDirectory

2007-09-19 Thread Bill Au
What files are there in your /data/pub/index directory? Bill On 9/19/07, Venkatraman S [EMAIL PROTECTED] wrote: Hi , Product : Solr (Embedded)Version : 1.2 Problem Description : While trying to add and search over the index, we are stumbling on this error again and again. Do note

Re: rsync start and enable for multiple solr instances within one tomcat

2007-09-20 Thread Bill Au
The solr that you are referring to in your third question in the name of the rsync area which is map to the solr data directory. This is defined in the rsyncd configuration file which is generated on the fly as Chris has pointed out. Take a look at rsyncd-start. snappuller rsync the index from

Re: a bug in commit script?

2007-09-20 Thread Bill Au
That would be my bad. I noticed the problem while fixing SOLR-282 which is not related. I fixed both problems in stead of opening a different bug for the response format issue. I will update the change log. Bill On 9/20/07, Chris Hostetter [EMAIL PROTECTED] wrote: : : It seems there's a

Re: Triggering snapshooter through web admin interface

2007-09-21 Thread Bill Au
Lance, do start a new thread if you run into this problem again and please include as much info as possible. Once a snapshot has been taken, the files it contains should not change so I am not sure why tar was telling you a file had changed while it was being copied. Bill On 9/19/07, Chris

Re: rsync start and enable for multiple solr instances within one tomcat

2007-09-21 Thread Bill Au
You are welcome. Bill On 9/21/07, Yu-Hui Jin [EMAIL PROTECTED] wrote: Bill, Thanks for the explanation. That helps my understanding on rsync and the replication in general. regards, -Hui On 9/20/07, Bill Au [EMAIL PROTECTED] wrote: The solr that you are referring to in your third

Re: a bug in commit script?

2007-09-21 Thread Bill Au
to this. regards, -Hui On 9/20/07, Bill Au [EMAIL PROTECTED] wrote: That would be my bad. I noticed the problem while fixing SOLR-282 which is not related. I fixed both problems in stead of opening a different bug for the response format issue. I will update the change log

Re: CollectionDistribution - Changes reflected immediately on master, but only after tomcat restart on slave

2007-10-29 Thread Bill Au
Snapinstaller uses commit to notify Solr to open a new Searcher. Is there anything in the commit log which shows why the commit failed? Bill On 10/29/07, Karen Loughran [EMAIL PROTECTED] wrote: Thanks Yonik and Otis, I noticed from the log (snapinstaller.log) the following when the slave

Re: Problems with SOLR Collection Distribution

2007-12-14 Thread Bill Au
Try setting data_dir to \opt\solr\data. I noticed that in the error message it shows \ in the path to snapshooter (ie \opt\solr\bin\snapshooter) but / in the path to the data directory (ie /opt/solr/data). Bill On Dec 13, 2007 7:46 AM, Dilip.TS [EMAIL PROTECTED] wrote: Hi, When i changed the

Re: Solr replication

2007-12-14 Thread Bill Au
On Dec 14, 2007 7:00 AM, Dilip.TS [EMAIL PROTECTED] wrote: Hi, I have the following requirement for SOLR Collection Distribution using Embedded Solr with the Jetty server: I have different data folders for multiple instances of SOLR within the Same application. Im using the same SOLR_HOME

Re: Solr replication

2008-01-16 Thread Bill Au
/SolrCollectionDistributionScripts So you can invoke the scripts for each instance by setting the data directory on the command line. Regards, Dilip -Original Message- From: Bill Au [mailto:[EMAIL PROTECTED] Sent: Monday, January 14, 2008 9:40 PM To: [EMAIL PROTECTED] Subject: Re: Solr

Re: collectionDistribution question

2008-02-13 Thread Bill Au
Your first and second conclusions are right, but not the third one. Solr does not distribute the queries from clients to the slaves. You need to do that yourself (for example, use a load balancer in front of your pool of Solr slaves). I think that when Solr is optimizing the index all update

Re: /solr/admin not found

2008-02-28 Thread Bill Au
The problem was with the default configuration of jetty which expands the webapps in /tmp and some UNIX boxes are configured to purge old files from /tmp. A simple fix is to create a $(jetty.chom)/work directory for jetty to use. See bug SOLR-118 for details:

Re: what's up with: java -Ddata=args -jar post.jar optimize/

2008-03-20 Thread Bill Au
What messages do you see in your log file? Bill On Wed, Mar 19, 2008 at 3:15 PM, [EMAIL PROTECTED] wrote: Hi, I'm a new Solr user. I figured my way around Solr just fine (I think) ... I can index and search ets. And so far I have indexed over 300k documents. What I can't figure out

Re: Master / slave setup with multicore

2008-05-02 Thread Bill Au
snapinstall calls commit to trigger Solr to use the new index. Do you see the commit request in your Solr log? Anything in the snapinstaller log? Bill On Thu, May 1, 2008 at 8:35 PM, James Brady [EMAIL PROTECTED] wrote: Hi Ryan, thanks for that! I have one outstanding question: when I take

Re: Welcome, Koji

2008-05-07 Thread Bill Au
Welcome abroad, Koji. Bill On Tue, May 6, 2008 at 6:56 PM, Koji Sekiguchi [EMAIL PROTECTED] wrote: Hi Erik and everyone! I'm looking forward to working with you. :) Cheers, Koji Erik Hatcher wrote: A warm welcome to our newest Solr committer, Koji Sekiguchi! He's been providing

Re: Solr Collection Distribution on AIX

2008-05-30 Thread Bill Au
I know people have made changes to the scripts in order for them to work correctly on the UNIX variant that they are running on. Has anyone done this for AIX? Bill On Fri, May 30, 2008 at 10:38 AM, tglawles [EMAIL PROTECTED] wrote: I've found that the scripts provided with Solr do not run on

Re: Rsyncd start and stop for multiple instances

2008-06-13 Thread Bill Au
The rsyncd-start scripts gets the data_dir path from the command line and create a rsyncd.conf on the fly exporting the path as the rsync module named solr. The salves need the data_dir path on the master to look for the latest snapshot. But the rsync command used by the slaves relies on the

Re: Solr Master Slave Architecture over NFS

2008-06-30 Thread Bill Au
Isn't using Lucene over NFS *not* recommended? Bill On Mon, Jun 30, 2008 at 4:27 AM, Nico Heid [EMAIL PROTECTED] wrote: Hey, I'm looking for some feedback on the following setup. Due to the architects decision I will be working with NFS not Solr's own distribution scripts. A few Solr

Re: Rsyncd start and stop for multiple instances

2008-07-01 Thread Bill Au
You can either use a dedicated rsync port for each instance or hack the existing scripts to support multiple rsync modules. Both ways should work. Bill On Tue, Jul 1, 2008 at 3:49 AM, Jacob Singh [EMAIL PROTECTED] wrote: Hi Bill and Others: Bill Au wrote: The rsyncd-start scripts gets

Re: matser /slave issue on solr

2008-09-04 Thread Bill Au
On your slave, solr_hostname should be localhost and master_host should be the hostname of your master server Check out the following Wiki for a full description of the variables in scripts.conf: http://wiki.apache.org/solr/SolrCollectionDistributionScripts Bill On Thu, Sep 4, 2008 at 4:46

Re: matser /slave issue on solr

2008-09-05 Thread Bill Au
Try running snappuller with the -V option to show debug output. Here's the closest thing to a step by step doc: http://wiki.apache.org/solr/SolrCollectionDistributionOperationsOutline Please note the first bullet under slave Solr server that the user id under which the scripts run must be able

Re: scripts.conf

2008-09-17 Thread Bill Au
All the scripts dot in (.) the utility script scripts-util, which in turn dots in scripts.conf. Why are you running several instances, multiple ports, multiple webapps, or multiple cores? http://wiki.apache.org/solr/MultipleIndexes Bill On Wed, Sep 17, 2008 at 8:50 AM, sunnyfr [EMAIL

Re: help rsyncd-enable

2008-09-17 Thread Bill Au
try the command line in stead: /solr/user/bin/rsyncd-enable The scripts do not like to be bashed. Bill On Wed, Sep 17, 2008 at 9:24 AM, sunnyfr [EMAIL PROTECTED] wrote: [EMAIL PROTECTED]:/solr/user/bin# bash rsyncd-enable rsyncd-enable: line 21: cd: rsyncd-enable/..: Not a directory

Re: scripts.conf

2008-09-17 Thread Bill Au
, which in turn dots in scripts.conf. Bill Au wrote: All the scripts dot in (.) the utility script scripts-util, which in turn dots in scripts.conf. Why are you running several instances, multiple ports, multiple webapps, or multiple cores? http://wiki.apache.org/solr

Re: snappuller / rsync

2008-09-17 Thread Bill Au
You only need to run the rsync daemon on the master. Bill On Wed, Sep 17, 2008 at 10:54 AM, sunnyfr [EMAIL PROTECTED] wrote: Hi Raghu, Thanks it's clear now; Kashyap, Raghu wrote: Hi, Rsyncd is the rsync(http://samba.anu.edu.au/rsync/) daemon. You need to make sure that

Re: snappuller / rsync

2008-09-22 Thread Bill Au
Try running snapshooter with the -V option. That will show debugging info. Bill On Mon, Sep 22, 2008 at 6:49 AM, sunnyfr [EMAIL PROTECTED] wrote: Yes but even if I run it I've no snapshot created, I don't get how I can fixe it. Bill Au wrote: You only need to run the rsync daemon

Re: snappuller / rsync

2008-09-22 Thread Bill Au
Au wrote: Try running snapshooter with the -V option. That will show debugging info. Bill On Mon, Sep 22, 2008 at 6:49 AM, sunnyfr [EMAIL PROTECTED] wrote: Yes but even if I run it I've no snapshot created, I don't get how I can fixe it. Bill Au wrote: You

Re: Memory error - snapshooter help

2008-09-25 Thread Bill Au
The OS is checking that there is enough memory... add swap space: http://www.nabble.com/Not-enough-space-to11423199.html#a11432978 On Thu, Sep 25, 2008 at 4:20 AM, sunnyfr [EMAIL PROTECTED] wrote: Hi, Any idea ? Sep 25 06:50:41 solr-test jsvc.exec[23286]: Sep 25, 2008 6:50:41 AM

Re: snappuller not getting snapshoot?

2008-09-29 Thread Bill Au
Yes, the status file is desiged to go into a logs directory, and not the snapshots directory. Bill 2008/9/29 Jarek Zgoda [EMAIL PROTECTED] I think I found the offending one by running snappuller -V: ++ ssh -o StrictHostKeyChecking=no e02 'ls /home/jzgoda/solr-master-data|grep

Re: Replication on solr

2008-10-01 Thread Bill Au
If you use cron, you should use the new -c option of snapshooter which only takes a snapshot where there have been changes. My personal preference is to use postCommit and postOptimize event listeners. Bill On Wed, Oct 1, 2008 at 4:28 AM, sunnyfr [EMAIL PROTECTED] wrote: Hi guys, Do you

Re: Transitioning from Solr 1.2 to Solr 1.3

2008-10-01 Thread Bill Au
Backup or snapshot taken by hard links are save to copy since once Lucene creates an index file, it will not be modified. From the 1.3.0 release notes: The Porter snowball based stemmers in Lucene were updated (LUCENE-1142), and are not guaranteed to be backward compatible at the index level

Re: Error for creating Index folder?

2008-10-02 Thread Bill Au
You probably have a permission problem. Check to make sure that the user id running Solr has write permission in the directory /data/solr/video/data. Bill On Thu, Oct 2, 2008 at 8:11 AM, sunnyfr [EMAIL PROTECTED] wrote: Oct 2 14:09:30 solr-test jsvc.exec[12890]: Oct 2, 2008 2:09:30 PM

Re: Replication on solr

2008-10-02 Thread Bill Au
, Bill Au wrote: If you use cron, you should use the new -c option of snapshooter which only takes a snapshot where there have been changes. My personal preference is to use postCommit and postOptimize event listeners. Bill On Wed, Oct 1, 2008 at 4:28 AM, sunnyfr [EMAIL

Re: solr servers synchronisation

2008-10-02 Thread Bill Au
Have you seen these two Wiki pages: http://wiki.apache.org/solr/CollectionDistribution http://wiki.apache.org/solr/SolrCollectionDistributionOperationsOutline Solr comes with tools to let you sync the index directory. Bill On Thu, Oct 2, 2008 at 3:52 AM, dudes dudes [EMAIL PROTECTED] wrote:

Re: Snapshooter shooting after commit or optimize

2010-04-12 Thread Bill Au
The lines you have encloses are commented out by the !-- and -- Bill On Mon, Apr 12, 2010 at 1:32 PM, william pink will.p...@gmail.com wrote: Hi, I am running Solr 1.2 ( I will be updating in due course) I am having a few issues with doing the snapshots after a postCommit or postOptimize

Re: Jetty, Tomcat or JBoss?

2010-04-20 Thread Bill Au
Solr only uses Servlet and JSP. Bill On Sat, Apr 17, 2010 at 9:11 AM, Abdelhamid ABID aeh.a...@gmail.com wrote: Solr does use JEE WEB components On 4/17/10, Lukáš Vlček lukas.vl...@gmail.com wrote: Hi, may be you should be aware that JBoss AS is using Tomcat for web container

Re: Jetty, Tomcat or JBoss?

2010-04-20 Thread Bill Au
I never said they weren't. Bill On Tue, Apr 20, 2010 at 5:54 PM, Abdelhamid ABID aeh.a...@gmail.com wrote: Which are JEE Web components, aren't they? On 4/20/10, Bill Au bill.w...@gmail.com wrote: Solr only uses Servlet and JSP. Bill On Sat, Apr 17, 2010 at 9:11 AM

Re: Storing different entities in Solr

2010-05-28 Thread Bill Au
You can keep different type of documents in the same index. If each document has a type field. You can restrict your searches to specific type(s) of document by using a filter query, which is very fast and efficient. Bill On Fri, May 28, 2010 at 12:28 PM, Nagelberg, Kallin

Re: Storing different entities in Solr

2010-05-30 Thread Bill Au
please give me a link or someting where I can get more info on this? Thanks, Moazzam On Fri, May 28, 2010 at 11:50 AM, Bill Au bill.w...@gmail.com wrote: You can keep different type of documents in the same index. If each document has a type field. You can restrict your searches

Re: Can query boosting be used with a custom request handlers?

2010-06-10 Thread Bill Au
You can use the defType param ni the boost local params to use a different handler. Here is an example for using dismax: {!boost b=log(popularity) defType=dismax}foo I do this with a custom handler that I have implemented fro my app. Bill On Wed, Jun 9, 2010 at 11:37 PM, Andy

Re: Solr jam after all my jvm thread pool hang in blocked state

2010-08-23 Thread Bill Au
It would be helpful it you can attached a threads dump. BIll On Mon, Aug 23, 2010 at 6:00 PM, AlexxelA alexandre.boudrea...@canoe.cawrote: I, I'm running solr 1.3 in production for now 1 year and i never had any problem with it since 2 weeks. It happen 6-7 times a day, all of my thread

Re: Solr Hangs up after couple of hours

2010-08-23 Thread Bill Au
It would be very useful if you can take a threads dump while Solr is hanging. That will give indication where/why Solr is hanging. Bill On Mon, Aug 23, 2010 at 9:32 PM, Manepalli, Kalyan kalyan.manepa...@orbitz.com wrote: Hi all, I am facing a peculiar problem with Solr querying.

Re: JVM GC is very frequent.

2010-08-28 Thread Bill Au
Besides frequency, you should also look at duration of GC events. You may want to try the concurrent garbage collector if you see many long full gc. Bill 2010/8/25 Chengyang atreey...@163.com We have about 500million documents are indexed.The index size is aobut 10G. Running on a 32bit box.

two facet.prefix on one facet field in a single query

2009-10-12 Thread Bill Au
Is it possible to have two different facet.prefix on the same facet field in a single query. I wan to get facet counts for two prefix, xx and yy. I tried using two facet.prefix (ie facet.prefix=xxfacet.prefix=yy) but the second one seems to have no effect. Bill

doing searches from within an UpdateRequestProcessor

2009-10-12 Thread Bill Au
Is it possible to do searches from within an UpdateRequestProcessor? The documents in my index reference each other. When a document is deleted, I would like to update all documents containing a reference to the deleted document. My initial idea is to use a custom UpdateRequestProcessor. Is

Re: two facet.prefix on one facet field in a single query

2009-10-12 Thread Bill Au
It looks like there is a JIRA covering this: https://issues.apache.org/jira/browse/SOLR-1387 On Mon, Oct 12, 2009 at 11:00 AM, Bill Au bill.w...@gmail.com wrote: Is it possible to have two different facet.prefix on the same facet field in a single query. I wan to get facet counts for two

Re: doing searches from within an UpdateRequestProcessor

2009-10-13 Thread Bill Au
:20 AM, Bill Au bill.w...@gmail.com wrote: Is it possible to do searches from within an UpdateRequestProcessor? The documents in my index reference each other. When a document is deleted, I would like to update all documents containing a reference to the deleted document. My initial idea

question about text field and WordDelimiterFilter in example schema.xml

2009-10-20 Thread Bill Au
I have a question regarding the use of the WordDelimiterFilter in the text field in the example schema.xml. The parameters are set differently for the indexing and querying. Namely, catenateWords and catenateNumbers are set differently. Shouldn't the same analysis be done at both index and

Question on ShingleFilter

2009-10-21 Thread Bill Au
I am having problem with using the ShingleFIlter. My test document is the quick brown fox jumps over the lazy dog. My query is my quick brown. Since both have the term quick brown at term position 2, the query should match the test document, right? But my query is not returning anything. I

Re: question about text field and WordDelimiterFilter in example schema.xml

2009-10-27 Thread Bill Au
, 2009 at 8:09 PM, Yonik Seeley yo...@lucidimagination.comwrote: On Tue, Oct 20, 2009 at 6:37 PM, Bill Au bill.w...@gmail.com wrote: I have a question regarding the use of the WordDelimiterFilter in the text field in the example schema.xml. The parameters are set differently

Re: TermsComponent results don't change after documents removed from index

2009-11-03 Thread Bill Au
Thanks for pointing that out. The TermsComponent prefix query is running much faster than the facet prefix query. I guess there is yet another reason to optimize the index. Bill On Tue, Nov 3, 2009 at 5:09 PM, Koji Sekiguchi k...@r.email.ne.jp wrote: Bill Au wrote: Should the results

Re: How to instruct MoreLikeThisHandler to sort results

2009-12-03 Thread Bill Au
I had open a Jira and submitted a patch for this: https://issues.apache.org/jira/browse/SOLR-1545 Bill On Thu, Dec 3, 2009 at 7:47 AM, Sascha Szott sz...@zib.de wrote: Hi Folks, is there any way to instruct MoreLikeThisHandler to sort results? I was wondering that MLTHandler recognizes

Re: Payloads with Phrase queries

2009-12-15 Thread Bill Au
Lucene 2.9.1 comes with a PayloadTermQuery: http://lucene.apache.org/java/2_9_1/api/all/org/apache/lucene/search/payloads/PayloadTermQuery.html I have been using that to use the payload as part of the score without any problem. Bill On Tue, Dec 15, 2009 at 6:31 AM, Raghuveer Kancherla

Re: Snapshot / Distribution Process

2010-03-11 Thread Bill Au
Have you started rsyncd on the master? Make sure that it is enabled before you start: http://wiki.apache.org/solr/SolrCollectionDistributionOperationsOutline You can also tried running snappuller with the -V option to et more debugging info. Bill On Wed, Mar 10, 2010 at 4:09 PM, Lars R.

  1   2   3   >