RE: Solr 1.4 Enterprise Search Server book examples

2010-05-22 Thread Dennis Gearon
127-300meg? Wow!

That's a lot of examples.

Did you type that all by hand ;-)
Dennis Gearon

Signature Warning

EARTH has a Right To Life,
  otherwise we all die.

Read 'Hot, Flat, and Crowded'
Laugh at http://www.yert.com/film.php


--- On Fri, 5/21/10, David Smiley (@MITRE.org) dsmi...@mitre.org wrote:

 From: David Smiley (@MITRE.org) dsmi...@mitre.org
 Subject: RE: Solr 1.4 Enterprise Search Server book examples
 To: solr-user@lucene.apache.org
 Date: Friday, May 21, 2010, 9:29 PM
 
 Hello Rob, 
 Thank you for buying the book.  I'm the lead
 author.  There is a README.txt
 file in the root of the zip which includes a rather full
 invocation of java
 to kick off Solr that is to be used for the example
 data.  The options as
 part of the invocation should elucidate what's going
 on.  The layout of
 where Solr's home is in relation to where Jetty is does not
 coincide with a
 standard Solr distribution's example directory.  In
 hind-site, I should
 have made it the same so as not to confuse people. 
 Sorry.
 
 And I have no idea why the download got corrupted on
 Packt's server.  I made
 a smaller distribution for them (~127MB vs 300-something)
 and put the data
 files on MusicBrainz' servers which are downloaded as part
 of the setup
 script you should run.
 
 ~ David Smiley
 
 -
  Author: https://www.packtpub.com/solr-1-4-enterprise-search-server/book
 -- 
 View this message in context: 
 http://lucene.472066.n3.nabble.com/Solr-1-4-Enterprise-Search-Server-book-examples-tp756119p835927.html
 Sent from the Solr - User mailing list archive at
 Nabble.com.



Re: TikaEntityProcessor on Solr 1.4?

2010-05-22 Thread Noble Paul നോബിള്‍ नोब्ळ्
just copy the dih-extras jar file from the nightly should be fine

On Sat, May 22, 2010 at 3:12 AM, Sixten Otto six...@sfko.com wrote:
 On Fri, May 21, 2010 at 5:30 PM, Chris Harris rygu...@gmail.com wrote:
 Actually, rather than cherry-pick just the changes from SOLR-1358 and
 SOLR-1583 what I did was to merge in all DataImportHandler-related
 changes from between the 1.4 release up through Solr trunk r890679
 (inclusive). I'm not sure if that's what would work best for you, but
 it's one option.

 I'd rather, of course, not to have to build my own. But if I'm going
 to dabble in the source at all, it's just a slippery slope from the
 former to the latter. :-)  (My main hesitation in doing so would be
 that I'm new enough to the code that I have no idea what core changes
 the trunk's DIH might also depend on. And my Java's pretty rusty.)

 How did you arrive at your patch? Just grafting the entire
 trunk/solr/contrib/dataimporthandler onto 1.4's code? Or did you go
 through Jira/SVN looking for applicable changesets?

 I'll be very interested to hear how your testing goes!

 Sixten




-- 
-
Noble Paul | Systems Architect| AOL | http://aol.com


Re: sort by function

2010-05-22 Thread MitchK

The score isn't computed when you try to access it. Furthermore your
functionQuery needs to become part of the score.

So what can you do???

The keyword is boosting.

Do:  {!func}product(0.88,rank)^x
Where x is a boosting factor based on your experiences.

Keep in mind that the result of your product-function-query will be added to
the score.
That means if the result is i.e. 12, and the normal score would be 5,6,
than the final score for the document is 17,6. If your ranking-value or your
x-value is too large, this would lead to unexpected results.

Hope this helps.
- Mitch
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/sort-by-function-tp814380p836471.html
Sent from the Solr - User mailing list archive at Nabble.com.


Highlighting mutlivalued fields

2010-05-22 Thread Darren Govoni
Hi,
  I'm see something odd, but maybe I'm doing something wrong.
I declared a highlight field 'text_t' that is a multivalued stored
indexed text field.
It seems when there are two values, only the last one is used for
highlighting. Missing
a lot of pertinent highlights from the other values.

Is this correct behavior?

thanks,
Darren


Re: SolrJ/EmbeddedSolrServer

2010-05-22 Thread Ryan McKinley
Check:
http://wiki.apache.org/solr/CoreAdmin

Unless I'm missing something, I think you should be able to sort what you need


On Fri, May 21, 2010 at 7:55 PM, Ken Krugler
kkrugler_li...@transpac.com wrote:
 I've got a situation where my data directory (a) needs to live elsewhere
 besides inside of Solr home, (b) moves to a different location when updating
 indexes, and (c) setting up a symlink from solr_home/data isn't a great
 option.

 So what's the best approach to making this work with SolrJ? The low-level
 solution seems to be

 - create my own SolrCore instance, where I specify the data directory
 - use that to update the CoreContainer
 - create a new EmbeddedSolrServer

 But recreating the EmbeddedSolrServer with each index update feels wrong,
 and I'd like to avoid mucking around with low-level SolrCore instantiation.

 Any other approaches?

 Thanks,

 -- Ken

 
 Ken Krugler
 +1 530-210-6378
 http://bixolabs.com
 e l a s t i c   w e b   m i n i n g







Combining index and file spellcheck dictionaries

2010-05-22 Thread O. Klein

Is it possible to combine index and file spellcheck dictionaries?

-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/Combining-index-and-file-spellcheck-dictionaries-tp836773p836773.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: DIH post import event listener for errors

2010-05-22 Thread Blargy

Awesome thanks
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/DIH-post-import-event-listener-for-errors-tp834645p836955.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: DIH post import event listener for errors

2010-05-22 Thread Blargy

Smiley, I dont follow. Can you explain how one could do this?

I'm guessing Log4J would parse the logs looking for a ROLLBACK and then it
would send out a notification? Sorry but i'm not really familiar with Log4J

BTW, loved your book. Have you've thought about putting out another more
advanced book possibly covering subjects as, custom request handlers,
plugins etc?

Thanks
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/DIH-post-import-event-listener-for-errors-tp834645p836974.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: DIH post import event listener for errors

2010-05-22 Thread Blargy

Ok... just read up on Log4J email notification. Sounds like it would be a
good idea however can you have separate SMTPAppenders based on which
exception is thrown and/or by searching for a particular string?

ie, if log level = SEVERE and contains rollback then use SMTPAppender foo.

Thanks
 
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/DIH-post-import-event-listener-for-errors-tp834645p837015.html
Sent from the Solr - User mailing list archive at Nabble.com.


Cartesian tiers with DataImportHandler

2010-05-22 Thread Ilya Sterin
I'm using solr 1.4 and need to utilize a geospatial extension (spatial
solr).  In order to do that, the indexed document must have cartesian
tier information appended.  These are not specific to spatial solr, as
solr and lucene local require the same I believe.

I'm currently using DataImportHandler to index database contained in a
SQL database.  The lat/lng radians coordinates are contained in there
as well.  I'd like to know if there is a way for me to dynamically
generate that information with my current setup.  All
examples/information I've seen generate these fields through the API
vs. declaratively.

Wondering if there is some way to dynamically generate fields during
the import process and/or some other declarative configuration.

Thanks in advance.

Ilya Sterin


Re: Cartesian tiers with DataImportHandler

2010-05-22 Thread Ilya Sterin
Actually, it's working now.  I needed to add a dynamic field to the config...

dynamicField name=_tier_* type=string indexed=true stored=true/

I guess importer plugin does automatically add tier fields, but they
needed to be configured as dynamic fields.


Ilya

On Sat, May 22, 2010 at 6:05 PM, Ilya Sterin ster...@gmail.com wrote:
 I'm using solr 1.4 and need to utilize a geospatial extension (spatial
 solr).  In order to do that, the indexed document must have cartesian
 tier information appended.  These are not specific to spatial solr, as
 solr and lucene local require the same I believe.

 I'm currently using DataImportHandler to index database contained in a
 SQL database.  The lat/lng radians coordinates are contained in there
 as well.  I'd like to know if there is a way for me to dynamically
 generate that information with my current setup.  All
 examples/information I've seen generate these fields through the API
 vs. declaratively.

 Wondering if there is some way to dynamically generate fields during
 the import process and/or some other declarative configuration.

 Thanks in advance.

 Ilya Sterin



Re: StackOverflowError during Delta-Import

2010-05-22 Thread Blargy

Narrowed down the issues to this block in in DocBuilder.java in the
collectDelta method. Any ideas?

 SetMapString, Object deletedSet = new HashSetMapString, Object();
SetMapString, Object deltaRemoveSet = new HashSetMapString,
Object();
while (true) {
  MapString, Object row = entityProcessor.nextDeletedRowKey();

  if (row == null)
break;
  
  //Check to see if this delete is in the current delta set
  for (MapString, Object modifiedRow : deltaSet) {
if (modifiedRow.get(entity.getPk()).equals(row.get(entity.getPk(
{
  deltaRemoveSet.add(modifiedRow);
}
  }

  deletedSet.add(row);
  importStatistics.rowsCount.incrementAndGet();
  // check for abort
  if (stop.get())
return new HashSet();
}
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/StackOverflowError-during-Delta-Import-tp811053p837444.html
Sent from the Solr - User mailing list archive at Nabble.com.


Re: StackOverflowError during Delta-Import

2010-05-22 Thread Blargy

Forgot to mention, the entity that is causing this is the root entity
-- 
View this message in context: 
http://lucene.472066.n3.nabble.com/StackOverflowError-during-Delta-Import-tp811053p837451.html
Sent from the Solr - User mailing list archive at Nabble.com.