Re: How to know if a field is null?

2008-08-25 Thread Erik Hatcher
Lance - where do you see a negative query not working with Solr?
Should work fine as long as the field name is valid.


Erik


On Aug 23, 2008, at 5:50 PM, Lance Norskog wrote:

And, a negative query does not work, so if this is the only clause,  
you have

to say:

*:* AND -field[* TO *]

Where *:* is a special code for all documents.

It's like learning a language: there is the normal grammar, there  
are the

unusual cases, and then there are the bizarre slang expressions.

-Original Message-
From: Erik Hatcher [mailto:[EMAIL PROTECTED]
Sent: Saturday, August 23, 2008 12:16 PM
To: solr-user@lucene.apache.org
Subject: Re: How to know if a field is null?


On Aug 22, 2008, at 3:31 PM, Alexander Ramos Jardim wrote:
I'd like to know if there's a way to query for not having a field  
set.

Something like saying I want all the docs that have field A empty.

Is that possible?


Sure is

   -field:[* TO *]

that'll match all documents that do NOT have terms in field

Erik






Re: Multicore and snapshooter / snappuller

2008-08-25 Thread Norberto Meijome
On Fri, 22 Aug 2008 12:21:53 -0700
Lance Norskog [EMAIL PROTECTED] wrote:

  Apparently the ZFS (Silicon Graphics
 originally) is great for really huge files. 

hi Lance,
You may be  confusing Sun's ZFS with SGI's XFS. The OP referred, i think, to 
ZFS.

B

_
{Beto|Norberto|Numard} Meijome

The greatest dangers to liberty lurk in insidious encroachment by men of zeal, 
well-meaning but without understanding.
   Justice Louis D. Brandeis

I speak for myself, not my employer. Contents may be hot. Slippery when wet. 
Reading disclaimers makes you go blind. Writing them is worse. You have been 
Warned.


Re: How to know if a field is null?

2008-08-25 Thread Yonik Seeley
On Mon, Aug 25, 2008 at 5:33 AM, Erik Hatcher
[EMAIL PROTECTED] wrote:
 Lance - where do you see a negative query not working with Solr?   Should
 work fine as long as the field name is valid.

Actually, we only ever fixed it for top-level queries in Solr... so if
it's nested you currently need the *:* trick.

-Yonik


Re: Multicore and snapshooter / snappuller

2008-08-25 Thread Jon Baer
Yeah I think the snapshot techniques that ZFS provides would be very  
nice for handling indexes, although remains to be seen as I have not  
seen too much info pertaining to it.


Im hoping to have a chance to put Solr on OpenSolaris soon and will  
see what works / what doesn't.  (BTW this combo can be tried out for  
free w/ VirtualBox and OpenSolaris .iso if anyone is interested).


- Jon

On Aug 25, 2008, at 7:37 AM, Norberto Meijome wrote:


On Fri, 22 Aug 2008 12:21:53 -0700
Lance Norskog [EMAIL PROTECTED] wrote:


Apparently the ZFS (Silicon Graphics
originally) is great for really huge files.


hi Lance,
You may be  confusing Sun's ZFS with SGI's XFS. The OP referred, i  
think, to ZFS.


B

_
{Beto|Norberto|Numard} Meijome

The greatest dangers to liberty lurk in insidious encroachment by  
men of zeal, well-meaning but without understanding.

  Justice Louis D. Brandeis

I speak for myself, not my employer. Contents may be hot. Slippery  
when wet. Reading disclaimers makes you go blind. Writing them is  
worse. You have been Warned.




dataimporthandler and mysql connector jar

2008-08-25 Thread Walter Ferrara
Launching a multicore solr with dataimporthandler using a mysql driver,
(driver=com.mysql.jdbc.Driver) works fine if the mysql connector jar
(mysql-connector-java-5.0.7-bin.jar) is in the classpath, either jdk
classpath or inside the solr.war lib dir.
While putting the mysql-connector-java-5.0.7-bin.jar in core0/lib
directory, or in the multicore shared lib dir (specified in sharedLib
attribute in solr.xml) result in exception, even if the jar is correctly
loaded by the classloader:

25-ago-2008 16.36.05 org.apache.solr.core.SolrResourceLoader
createClassLoader
INFO: Adding
'file:/E:/Temp/apache-solr-2008-08-25_08-06-39/example/solr/lib/mysql-connector-java-5.0.7-bin.jar'
to Solr classloader
[..]
GRAVE: Exception while loading DataImporter
org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to
initialize DataSource: null Processing Document #
at
org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:306)
at
org.apache.solr.handler.dataimport.DataImporter.addDataSource(DataImporter.java:273)
at
org.apache.solr.handler.dataimport.DataImporter.initEntity(DataImporter.java:228)
at
org.apache.solr.handler.dataimport.DataImporter.init(DataImporter.java:98)
at
org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportHandler.java:106)
at
org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:311)
at org.apache.solr.core.SolrCore.init(SolrCore.java:475)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:323)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:216)
at
org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:104)
at
org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:69)
at org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:99)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)
at
org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:594)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:139)
at
org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1218)
at
org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:500)
at
org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:448)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)
at
org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:147)
at
org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:161)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)
at
org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:147)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)
at
org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:117)
at org.mortbay.jetty.Server.doStart(Server.java:210)
at
org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)
at org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:929)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.mortbay.start.Main.invokeMain(Main.java:183)
at org.mortbay.start.Main.start(Main.java:497)
at org.mortbay.start.Main.main(Main.java:115)
Caused by:
org.apache.solr.handler.dataimport.DataImportHandlerException: driver
could not be loaded Processing Document #
at
org.apache.solr.handler.dataimport.JdbcDataSource.createConnectionFactory(JdbcDataSource.java:110)
at
org.apache.solr.handler.dataimport.JdbcDataSource.init(JdbcDataSource.java:63)
at
org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:303)
... 34 more

Shouldn't it works when the jar is (only) in the core lib dir?
tested on windows machine, with java 1.6 and today hudson nightly build
of solr.

Walter




sporadic warnings / errors when using a DataImportHandler based solr instance

2008-08-25 Thread Jeremy Hinegardner
Hi all,

I have a system using DataImportHandler, and it is performing great, but we're
getting a couple of sporadic warnings / errors that I'd like to be able to
address.

The version of solr we are using is a nightly snapshot from 2008-08-02.

1) INFO: PERFORMANCE WARNING: Overlapping onDeckSearchers=2

   I doubt this is DataImportMapper related, but it might be related to how we
   do updates / commits.  Can anyone describe the situation that makes this
   performance warning happen?

2) SEVERE: org.apache.solr.common.SolrException: Error opening new searcher.
   exceeded limit of maxWarmingSearchers=4, try again later. 

   My instinct says that this one is related to the first one but i'm not sure. 
 

3) WARNING: Could not getStatistics on info bean 
org.apache.solr.search.SolrIndexSearcher
  org.apache.lucene.store.AlreadyClosedException: this IndexReader is closed

  Does this indicate there is a race condition between the info beans and the
  closing of searchers?

enjoy,

-jeremy

-- 

 Jeremy Hinegardner  [EMAIL PROTECTED] 



Re: Solr Logo thought

2008-08-25 Thread Otis Gospodnetic
Hoss, I like the LogoContest page, but I have a feeling it will not result in 
more logo candidates getting submitted because the only people who know about 
it are solr-user/dev subscribers, and people here are typically not designers.

Perhaps solr-user/dev subscribers have pointed their designer friends and 
colleagues to the LogoContest page?

Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch



- Original Message 
 From: Chris Hostetter [EMAIL PROTECTED]
 To: solr-user@lucene.apache.org
 Sent: Friday, August 22, 2008 6:55:00 PM
 Subject: Re: Solr Logo thought
 
 
 : I think Shalin's poll is the contest. :)
 
 A public poll is a voting mechanism, it can be part ofa contest ... a 
 contest involves rules (which in our case have to do with attaching to 
 Jira and granting liscence, also probably some size requirements) and a 
 specific, anounced in advance, window of time in which entires are 
 accepted (a public poll for voting should also involve a specific, 
 anounced in advance, window of time to participate.)
 
 People who want to help spell out a little bette exactly how/when the 
 contest should run should help hack up the wiki page...
 
 http://wiki.apache.org/solr/LogoContest
 
 -Hoss



Re: Solr Logo thought

2008-08-25 Thread Mark Miller
I don't think Hoss wants to be involved in the logo contest beyond the 
guidance he gave ;)


What is there now is really a template I stole from other logo contests. 
It hasn't really been blessed or finished. For instance, the contest end 
date should be decided upon. No committer has even really endorsed 
running the contest - not a big deal, but I think it means things are 
not yet official. Agreeing that the current rules are fine and deciding 
on an end date would seem to remedy that.


As far as getting other interest beyond the developers, once the contest 
is blessed, I'd be happy to try and spread the word. I don't predict it 
will do much good though. However, I think we already have some quality 
logos and this is really just a chance for late comers to get into the 
game - so I am personally not so worried about getting other designers 
(I would like for it to happen though).


If people see clear concrete steps ahead that I can help with, just let 
me know.


- Mark


Otis Gospodnetic wrote:

Hoss, I like the LogoContest page, but I have a feeling it will not result in 
more logo candidates getting submitted because the only people who know about 
it are solr-user/dev subscribers, and people here are typically not designers.

Perhaps solr-user/dev subscribers have pointed their designer friends and 
colleagues to the LogoContest page?

Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch



- Original Message 
  

From: Chris Hostetter [EMAIL PROTECTED]
To: solr-user@lucene.apache.org
Sent: Friday, August 22, 2008 6:55:00 PM
Subject: Re: Solr Logo thought


: I think Shalin's poll is the contest. :)

A public poll is a voting mechanism, it can be part ofa contest ... a 
contest involves rules (which in our case have to do with attaching to 
Jira and granting liscence, also probably some size requirements) and a 
specific, anounced in advance, window of time in which entires are 
accepted (a public poll for voting should also involve a specific, 
anounced in advance, window of time to participate.)


People who want to help spell out a little bette exactly how/when the 
contest should run should help hack up the wiki page...


http://wiki.apache.org/solr/LogoContest

-Hoss



  




RE: Less aggressive stemmer?

2008-08-25 Thread Wagner,Harry
Otis,
I'd be happy to. Where do you think the best place to put this is -
under 'hacking Solr' or with the other stemming text?

-Original Message-
From: Otis Gospodnetic [mailto:[EMAIL PROTECTED] 
Sent: Friday, August 22, 2008 12:24 PM
To: solr-user@lucene.apache.org
Subject: Re: Less aggressive stemmer?

It won't be integrated in Solr 1.3, I believe, because of KStem's
license.  But we should document what the Factory for it can look like,
perhaps by posting it on the Wiki.  Harry, if you have the code handy,
feel free to post it on the Solr Wiki somewhere.

Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch



- Original Message 
 From: Wagner,Harry [EMAIL PROTECTED]
 To: solr-user@lucene.apache.org
 Sent: Friday, August 22, 2008 8:40:18 AM
 Subject: RE: Less aggressive stemmer?
 
 We use KStem also and are very happy with it.  I think it has been
 integrated into Solr and will be included in 1.3 (someone please
correct
 me if this is not the case). You should be able to get it from the
 nightly builds now. 
 
 Cheers!
 harry
 
 -Original Message-
 From: Kevin Osborn [mailto:[EMAIL PROTECTED] 
 Sent: Thursday, August 21, 2008 5:30 PM
 To: solr-user@lucene.apache.org
 Subject: Re: Less aggressive stemmer?
 
 We had similar problems and then switched to KStem and have been
pretty
 happy with the results.
 
 http://ciir.cs.umass.edu/cgi-bin/downloads/downloads.cgi
 
 
 
 - Original Message 
 From: Jason Rennie 
 To: solr-user@lucene.apache.org
 Sent: Thursday, August 21, 2008 2:23:36 PM
 Subject: Less aggressive stemmer?
 
 Is there an option to perform less aggressive stemming in solr?  We're
 using
 the Porter stemmer.  I see that there is an option for Snowball, but
my
 understanding is that Snowball is a refinement of Porter rather than
 something radically different.  I think we'd be best off with
something
 very
 basic, possibly as simple as removing plural endings.  Our index is
over
 product descriptions, so it's important that we stem normal variations
 in
 nouns, but adverbs, verbs and possibly adjective variations are not so
 important and sometimes cause problems for us.
 
 Jason





hebrew stemmer

2008-08-25 Thread michael ravits
I am really curious whether anyone is working/worked on something like this?
Also I would like to hear ideas for a direction to begin working on.

Michael


  


Re: solr nightly (1.3ish) and jboss 4.2.2 class cast exception

2008-08-25 Thread Christopher Liebman
I believe this is the issue  http://issues.apache.org/jira/browse/SOLR-495 
   and blocks the sample from working out of the box in jboss 4.2.2


  -- Chris

On Aug 22, 2008, at 2:49 PM, Christopher Liebman wrote:

  Is anyone using the nightly (1.3ish) build in jboss 4.2.2?  I just  
attempted to use the example in jboss 4.2.2 and it fails with a  
class cast exception.  Has anyone seen this before? Happens on both  
mac and linux platforms.


   -- Chris

Mac java:

10-1-3-116:~ liebman$ java -version
java version 1.5.0_13
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_13- 
b05-237)

Java HotSpot(TM) Client VM (build 1.5.0_13-119, mixed mode, sharing)


Linux java:

[EMAIL PROTECTED] pmsearch]$ java -version
java version 1.5.0_15
Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_15-b04)
Java HotSpot(TM) Server VM (build 1.5.0_15-b04, mixed mode)


14:40:38,560 ERROR [STDERR] Aug 22, 2008 2:40:38 PM  
org.apache.solr.common.SolrException log
SEVERE: java.lang.ClassCastException:  
com.ctc.wstx.stax.WstxInputFactory
	at  
javax.xml.stream.XMLInputFactory.newInstance(XMLInputFactory.java:136)
	at  
org 
.apache 
.solr 
.handler.XmlUpdateRequestHandler.init(XmlUpdateRequestHandler.java:86)
	at org.apache.solr.core.RequestHandlers$1.init(RequestHandlers.java: 
162)
	at org.apache.solr.core.RequestHandlers$1.init(RequestHandlers.java: 
161)
	at  
org 
.apache 
.solr 
.util.plugin.AbstractPluginLoader.load(AbstractPluginLoader.java:175)
	at  
org 
.apache 
.solr 
.core.RequestHandlers.initHandlersFromConfig(RequestHandlers.java:169)

at org.apache.solr.core.SolrCore.init(SolrCore.java:439)
	at org.apache.solr.core.CoreContainer 
$Initializer.initialize(CoreContainer.java:112)
	at  
org 
.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java: 
69)
	at  
org 
.apache 
.catalina 
.core.ApplicationFilterConfig.getFilter(ApplicationFilterConfig.java: 
275)
	at  
org 
.apache 
.catalina 
.core 
.ApplicationFilterConfig.setFilterDef(ApplicationFilterConfig.java: 
397)
	at  
org 
.apache 
.catalina 
.core.ApplicationFilterConfig.init(ApplicationFilterConfig.java:108)
	at  
org 
.apache 
.catalina.core.StandardContext.filterStart(StandardContext.java:3722)
	at  
org.apache.catalina.core.StandardContext.start(StandardContext.java: 
4367)
	at  
org 
.apache 
.catalina.core.ContainerBase.addChildInternal(ContainerBase.java:790)
	at  
org.apache.catalina.core.ContainerBase.addChild(ContainerBase.java: 
770)
	at org.apache.catalina.core.StandardHost.addChild(StandardHost.java: 
553)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at  
sun 
.reflect 
.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at  
sun 
.reflect 
.DelegatingMethodAccessorImpl 
.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:585)
	at  
org 
.apache 
.tomcat.util.modeler.BaseModelMBean.invoke(BaseModelMBean.java:296)
	at  
org.jboss.mx.server.RawDynamicInvoker.invoke(RawDynamicInvoker.java: 
164)
	at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java: 
659)
	at  
org.apache.catalina.core.StandardContext.init(StandardContext.java: 
5312)

at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at  
sun 
.reflect 
.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
	at  
sun 
.reflect 
.DelegatingMethodAccessorImpl 
.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:585)
	at  
org 
.apache 
.tomcat.util.modeler.BaseModelMBean.invoke(BaseModelMBean.java:296)
	at  
org.jboss.mx.server.RawDynamicInvoker.invoke(RawDynamicInvoker.java: 
164)
	at org.jboss.mx.server.MBeanServerImpl.invoke(MBeanServerImpl.java: 
659)
	at  
org 
.jboss 
.web 
.tomcat 
.service.TomcatDeployer.performDeployInternal(TomcatDeployer.java:301)
	at  
org 
.jboss 
.web.tomcat.service.TomcatDeployer.performDeploy(TomcatDeployer.java: 
104)
	at org.jboss.web.AbstractWebDeployer.start(AbstractWebDeployer.java: 
375)

at org.jboss.web.WebModule.startModule(WebModule.java:83)
at org.jboss.web.WebModule.startService(WebModule.java:61)
	at  
org 
.jboss 
.system 
.ServiceMBeanSupport.jbossInternalStart(ServiceMBeanSupport.java:289)
	at  
org 
.jboss 
.system 
.ServiceMBeanSupport.jbossInternalLifecycle(ServiceMBeanSupport.java: 
245)

at sun.reflect.GeneratedMethodAccessor5.invoke(Unknown Source)
	at  
sun 
.reflect 
.DelegatingMethodAccessorImpl 
.invoke(DelegatingMethodAccessorImpl.java:25)

at java.lang.reflect.Method.invoke(Method.java:585)
	at  
org 
.jboss 
.mx.interceptor.ReflectedDispatcher.invoke(ReflectedDispatcher.java: 
155)

at org.jboss.mx.server.Invocation.dispatch(Invocation.java:94)
at org.jboss.mx.server.Invocation.invoke(Invocation.java:86)
	at  
org 
.jboss 
.mx.server.AbstractMBeanInvoker.invoke(AbstractMBeanInvoker.java:264)
	at 

RE: How to know if a field is null?

2008-08-25 Thread Lance Norskog
Has this been fixed in solr 1.3?

-Original Message-
From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Yonik Seeley
Sent: Monday, August 25, 2008 5:44 AM
To: solr-user@lucene.apache.org
Subject: Re: How to know if a field is null?

On Mon, Aug 25, 2008 at 5:33 AM, Erik Hatcher [EMAIL PROTECTED]
wrote:
 Lance - where do you see a negative query not working with Solr?   Should
 work fine as long as the field name is valid.

Actually, we only ever fixed it for top-level queries in Solr... so if it's
nested you currently need the *:* trick.

-Yonik



Re: Less aggressive stemmer?

2008-08-25 Thread Otis Gospodnetic
I'd create a new page and link it from, perhaps, the page about stemming if 
there is one or from the page about analyzers/tokens/filters.

 
Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch



- Original Message 
 From: Wagner,Harry [EMAIL PROTECTED]
 To: solr-user@lucene.apache.org
 Sent: Monday, August 25, 2008 1:57:38 PM
 Subject: RE: Less aggressive stemmer?
 
 Otis,
 I'd be happy to. Where do you think the best place to put this is -
 under 'hacking Solr' or with the other stemming text?
 
 -Original Message-
 From: Otis Gospodnetic [mailto:[EMAIL PROTECTED] 
 Sent: Friday, August 22, 2008 12:24 PM
 To: solr-user@lucene.apache.org
 Subject: Re: Less aggressive stemmer?
 
 It won't be integrated in Solr 1.3, I believe, because of KStem's
 license.  But we should document what the Factory for it can look like,
 perhaps by posting it on the Wiki.  Harry, if you have the code handy,
 feel free to post it on the Solr Wiki somewhere.
 
 Otis
 --
 Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
 
 
 
 - Original Message 
  From: Wagner,Harry 
  To: solr-user@lucene.apache.org
  Sent: Friday, August 22, 2008 8:40:18 AM
  Subject: RE: Less aggressive stemmer?
  
  We use KStem also and are very happy with it.  I think it has been
  integrated into Solr and will be included in 1.3 (someone please
 correct
  me if this is not the case). You should be able to get it from the
  nightly builds now. 
  
  Cheers!
  harry
  
  -Original Message-
  From: Kevin Osborn [mailto:[EMAIL PROTECTED] 
  Sent: Thursday, August 21, 2008 5:30 PM
  To: solr-user@lucene.apache.org
  Subject: Re: Less aggressive stemmer?
  
  We had similar problems and then switched to KStem and have been
 pretty
  happy with the results.
  
  http://ciir.cs.umass.edu/cgi-bin/downloads/downloads.cgi
  
  
  
  - Original Message 
  From: Jason Rennie 
  To: solr-user@lucene.apache.org
  Sent: Thursday, August 21, 2008 2:23:36 PM
  Subject: Less aggressive stemmer?
  
  Is there an option to perform less aggressive stemming in solr?  We're
  using
  the Porter stemmer.  I see that there is an option for Snowball, but
 my
  understanding is that Snowball is a refinement of Porter rather than
  something radically different.  I think we'd be best off with
 something
  very
  basic, possibly as simple as removing plural endings.  Our index is
 over
  product descriptions, so it's important that we stem normal variations
  in
  nouns, but adverbs, verbs and possibly adjective variations are not so
  important and sometimes cause problems for us.
  
  Jason



SpellCheckComponent bug?

2008-08-25 Thread Matthew Runo

Hello folks!

I seem to be seeing a bug in the SpellCheckComponent..

Search term: Quicksilver... I get two suggestions...

lst name=suggestion
int name=frequency2/int
str name=wordQuicksilver/str
/lst

lst name=suggestion
int name=frequency220/int
str name=wordQuiksilver/str
/lst

...and it's not correctly spelled...

bool name=correctlySpelledfalse/bool

...but the collation is of the first term - not the one with the  
highest frequency?


str name=collationQuicksilver/str

This seems to be anti-what-the-docs-say collation should do. Other,  
more popular terms (shoez, runnning, etc) all seem to collate  
properly. I'm hitting Solr via SolrJ and not really doing anything too  
fancy - using SVN head at the moment. Just wondered if anyone had any  
ideas. There are no synonyms in this system, so I don't think that  
could be it. I've rebuilt the search index.


Thanks for your time!

Matthew Runo
Software Engineer, Zappos.com
[EMAIL PROTECTED] - 702-943-7833



Using score in FunctionQuery

2008-08-25 Thread Yoav Caspi
Hi,



Is it possible to use Lucene similarity score in a FunctionQuery (in dismax
boost function, for example) as part of a function?

I would like to use a more complex boosting function, which uses more than
simple boosting addition (for example a*score+b).



Thanks


Re: dataimporthandler and mysql connector jar

2008-08-25 Thread Norberto Meijome
On Mon, 25 Aug 2008 17:11:47 +0200
Walter Ferrara [EMAIL PROTECTED] wrote:

 Launching a multicore solr with dataimporthandler using a mysql driver,
 (driver=com.mysql.jdbc.Driver) works fine if the mysql connector jar
 (mysql-connector-java-5.0.7-bin.jar) is in the classpath, either jdk
 classpath or inside the solr.war lib dir.
 While putting the mysql-connector-java-5.0.7-bin.jar in core0/lib
 directory, or in the multicore shared lib dir (specified in sharedLib
 attribute in solr.xml) result in exception, even if the jar is correctly
 loaded by the classloader:


Hi Walter,
As at nightly build of August 19th, the DIH failing to connect to the data
source on SOLR's startup does *not* kill SOLR anymore. I haven't tested
yesterday's ...it could be a regression bug, but i doubt it - the error used to
be different to yours  (about connectivity, not failure in document).

for what is worth,i only have 1 copy of the jdbc jar (MS SQL in my case), in
the SOLR's lib directory, used by several cores's own DIH. You can check if
it's picked up by SOLR's classpath in the Java Info page under admin/

You may also want to try with a valid but empty document definition in
data-config.xml to rule out syntax issues.

B
_
{Beto|Norberto|Numard} Meijome

Any society that would give up a little liberty to gain a little security will
deserve neither and lose both. Benjamin Franklin

I speak for myself, not my employer. Contents may be hot. Slippery when wet.
Reading disclaimers makes you go blind. Writing them is worse. You have been
Warned.


Re: dataimporthandler and mysql connector jar

2008-08-25 Thread Noble Paul നോബിള്‍ नोब्ळ्
Which build of Solr are you using. The feature of loading libraries
from ${solr.home}/lib is added recently. I guess it must work with the
latest trunk. if it doesn't please let us know
--Noble

On Mon, Aug 25, 2008 at 8:41 PM, Walter Ferrara [EMAIL PROTECTED] wrote:
 Launching a multicore solr with dataimporthandler using a mysql driver,
 (driver=com.mysql.jdbc.Driver) works fine if the mysql connector jar
 (mysql-connector-java-5.0.7-bin.jar) is in the classpath, either jdk
 classpath or inside the solr.war lib dir.
 While putting the mysql-connector-java-5.0.7-bin.jar in core0/lib
 directory, or in the multicore shared lib dir (specified in sharedLib
 attribute in solr.xml) result in exception, even if the jar is correctly
 loaded by the classloader:

 25-ago-2008 16.36.05 org.apache.solr.core.SolrResourceLoader
 createClassLoader
 INFO: Adding
 'file:/E:/Temp/apache-solr-2008-08-25_08-06-39/example/solr/lib/mysql-connector-java-5.0.7-bin.jar'
 to Solr classloader
 [..]
 GRAVE: Exception while loading DataImporter
 org.apache.solr.handler.dataimport.DataImportHandlerException: Failed to
 initialize DataSource: null Processing Document #
at
 org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:306)
at
 org.apache.solr.handler.dataimport.DataImporter.addDataSource(DataImporter.java:273)
at
 org.apache.solr.handler.dataimport.DataImporter.initEntity(DataImporter.java:228)
at
 org.apache.solr.handler.dataimport.DataImporter.init(DataImporter.java:98)
at
 org.apache.solr.handler.dataimport.DataImportHandler.inform(DataImportHandler.java:106)
at
 org.apache.solr.core.SolrResourceLoader.inform(SolrResourceLoader.java:311)
at org.apache.solr.core.SolrCore.init(SolrCore.java:475)
at org.apache.solr.core.CoreContainer.create(CoreContainer.java:323)
at org.apache.solr.core.CoreContainer.load(CoreContainer.java:216)
at
 org.apache.solr.core.CoreContainer$Initializer.initialize(CoreContainer.java:104)
at
 org.apache.solr.servlet.SolrDispatchFilter.init(SolrDispatchFilter.java:69)
at org.mortbay.jetty.servlet.FilterHolder.doStart(FilterHolder.java:99)
at
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)
at
 org.mortbay.jetty.servlet.ServletHandler.initialize(ServletHandler.java:594)
at org.mortbay.jetty.servlet.Context.startContext(Context.java:139)
at
 org.mortbay.jetty.webapp.WebAppContext.startContext(WebAppContext.java:1218)
at
 org.mortbay.jetty.handler.ContextHandler.doStart(ContextHandler.java:500)
at
 org.mortbay.jetty.webapp.WebAppContext.doStart(WebAppContext.java:448)
at
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)
at
 org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:147)
at
 org.mortbay.jetty.handler.ContextHandlerCollection.doStart(ContextHandlerCollection.java:161)
at
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)
at
 org.mortbay.jetty.handler.HandlerCollection.doStart(HandlerCollection.java:147)
at
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)
at
 org.mortbay.jetty.handler.HandlerWrapper.doStart(HandlerWrapper.java:117)
at org.mortbay.jetty.Server.doStart(Server.java:210)
at
 org.mortbay.component.AbstractLifeCycle.start(AbstractLifeCycle.java:40)
at org.mortbay.xml.XmlConfiguration.main(XmlConfiguration.java:929)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
at java.lang.reflect.Method.invoke(Unknown Source)
at org.mortbay.start.Main.invokeMain(Main.java:183)
at org.mortbay.start.Main.start(Main.java:497)
at org.mortbay.start.Main.main(Main.java:115)
 Caused by:
 org.apache.solr.handler.dataimport.DataImportHandlerException: driver
 could not be loaded Processing Document #
at
 org.apache.solr.handler.dataimport.JdbcDataSource.createConnectionFactory(JdbcDataSource.java:110)
at
 org.apache.solr.handler.dataimport.JdbcDataSource.init(JdbcDataSource.java:63)
at
 org.apache.solr.handler.dataimport.DataImporter.getDataSourceInstance(DataImporter.java:303)
... 34 more

 Shouldn't it works when the jar is (only) in the core lib dir?
 tested on windows machine, with java 1.6 and today hudson nightly build
 of solr.

 Walter






-- 
--Noble Paul