Re: DataImportHandler

2011-05-30 Thread Jeffrey Chang
I faced the same problem before, but that's because some parent classloader has 
loaded the DataImport class instead of using the SolrResourceLoader's delegated 
classloader.

How are you starting your Solr? Via Eclipse? If you try starting Solr using 
cmdline, will you encounter the same issue?



On May 30, 2011, at 9:28 PM, adpablos adpab...@molinodeideas.es wrote:

 Hi,
 
 i've tryed to install DataImportHandler but i've some problems when run up
 solr.
 
 
 GRAVE: org.apache.solr.common.SolrException: Error Instantiating Request
 Handler, 
 org.apache.solr.handler.dataimport.DataImportHandler is not a
 org.apache.solr.request.SolrRequestHandler
 
 This is the log.
 
 I've 
 
  requestHandler name=/dataimport
 class=org.apache.solr.handler.dataimport.DataImportHandler
lst name=defaults
str name=configdb-data-config.xml/str
/lst
  /requestHandler
 
 in my solrconfig.xml
 
 i'm working ina  java project and in my eclipse project, i can write
 something like this: SolrRequestHandler srh = new DataImportHandler(); with
 out problem. 
 
 Sorry about my english and thank you in advance.
 
 --
 View this message in context: 
 http://lucene.472066.n3.nabble.com/DataImportHandler-tp3001957p3001957.html
 Sent from the Solr - User mailing list archive at Nabble.com.


Re: highlighting in multiValued field

2011-05-28 Thread Jeffrey Chang
Hi All,

I'll share my own workaround for my own issue.

I simply created a new multiValued field that concatenantes the multiValued
fields for index. During search, I will then have both fields in the same
array position.

Thanks,
Jeff

On Fri, May 27, 2011 at 10:24 PM, Jeffrey Chang jclal...@gmail.com wrote:

 Hi Bob,

 Hmm... I don't think this approach will scale with bigger and more
 documents :(

 Thanks for your help though; I think I should take a look at customizing
 highlight component to achieve this...

 Thanks,
 Jeff



 On May 27, 2011, at 12:24 PM, Bob Sandiford bob.sandif...@sirsidynix.com
 wrote:

  The only thing I can think of is to post-process your snippets.  I.E.
 pull the highlighting tags out of the strings, look for the match in your
 result description field looking for a match, and if you find one, replace
 that description with the original highlight text (i.e. with the highlight
 tags still in place).
 
  Bob Sandiford | Lead Software Engineer | SirsiDynix
  P: 800.288.8020 X6943 | bob.sandif...@sirsidynix.com
  www.sirsidynix.com
  Join the conversation - you may even get an iPad or Nook out of it!
 
  Like us on Facebook!
 
  Follow us on Twitter!
 
 
 
  -Original Message-
  From: Jeffrey Chang [mailto:jclal...@gmail.com]
  Sent: Friday, May 27, 2011 12:16 AM
  To: solr-user@lucene.apache.org
  Subject: Re: highlighting in multiValued field
 
  Hi Bob,
 
  I have no idea how I missed that! Thanks for pointing me to use
  hl.snippets
  - that did the magic!
 
  Please allow me squeeze one more question along the same line.
 
  Since I'm now able to display multiple snippets - what I'm trying to
  achieve
  is, determine which highlighted snippet maps back to what position in
  the
  original document.
 
  e.g. If I search for Tel, with highlighting and hl.snippets=2 it'll
  return
  me:
  doc
  ...
  arr name=descID
   str1/str
   str2/str
   str3/str
  /arr
  arr name=description
   strTel to talent 1/str
   strTel to talent 2/str
   strTel to talent 3/str
  /arr
  ...
  /doc
  lst name=highlighting
   lst name=1
   arr name=description
 stremTel/em to talent 1/str
 stremTel/em to talent 2/str
   /arr
  /lst
  ...
 
  Is there a way for me to figure out which highlighted snippet belongs
  to
  which descID so I can display also display the non-highlighted rows for
  my
  search results.
 
  Or is this not the way how highlighting is designed and to be used?
 
  Thanks so much,
  Jeff
  [snip]
 



Re: parentDeltaQuery

2011-05-28 Thread Jeffrey Chang
I'm also working on Delta queries; here's what I found.

Hopefully it's useful for you too:
http://wiki.apache.org/solr/DataImportHandler#Using_delta-import_command

On Tue, May 24, 2011 at 6:42 PM, Romi romijain3...@gmail.com wrote:

 Hi, i am new to solr and i m trying some examples to fetch data from MySql
 to
 solr server.I want to know what is parentDeltaQuery, when should it b used,
 what is its advantage. please refer me some good example.

 -
 Romi
 --
 View this message in context:
 http://lucene.472066.n3.nabble.com/parentDeltaQuery-tp2979110p2979110.html
 Sent from the Solr - User mailing list archive at Nabble.com.



Re: highlighting in multiValued field

2011-05-27 Thread Jeffrey Chang
Hi Bob,

Hmm... I don't think this approach will scale with bigger and more documents :(

Thanks for your help though; I think I should take a look at customizing 
highlight component to achieve this...

Thanks,
Jeff



On May 27, 2011, at 12:24 PM, Bob Sandiford bob.sandif...@sirsidynix.com 
wrote:

 The only thing I can think of is to post-process your snippets.  I.E. pull 
 the highlighting tags out of the strings, look for the match in your result 
 description field looking for a match, and if you find one, replace that 
 description with the original highlight text (i.e. with the highlight tags 
 still in place).
 
 Bob Sandiford | Lead Software Engineer | SirsiDynix
 P: 800.288.8020 X6943 | bob.sandif...@sirsidynix.com
 www.sirsidynix.com 
 Join the conversation - you may even get an iPad or Nook out of it!
 
 Like us on Facebook!
 
 Follow us on Twitter!
 
 
 
 -Original Message-
 From: Jeffrey Chang [mailto:jclal...@gmail.com]
 Sent: Friday, May 27, 2011 12:16 AM
 To: solr-user@lucene.apache.org
 Subject: Re: highlighting in multiValued field
 
 Hi Bob,
 
 I have no idea how I missed that! Thanks for pointing me to use
 hl.snippets
 - that did the magic!
 
 Please allow me squeeze one more question along the same line.
 
 Since I'm now able to display multiple snippets - what I'm trying to
 achieve
 is, determine which highlighted snippet maps back to what position in
 the
 original document.
 
 e.g. If I search for Tel, with highlighting and hl.snippets=2 it'll
 return
 me:
 doc
 ...
 arr name=descID
  str1/str
  str2/str
  str3/str
 /arr
 arr name=description
  strTel to talent 1/str
  strTel to talent 2/str
  strTel to talent 3/str
 /arr
 ...
 /doc
 lst name=highlighting
  lst name=1
  arr name=description
stremTel/em to talent 1/str
stremTel/em to talent 2/str
  /arr
 /lst
 ...
 
 Is there a way for me to figure out which highlighted snippet belongs
 to
 which descID so I can display also display the non-highlighted rows for
 my
 search results.
 
 Or is this not the way how highlighting is designed and to be used?
 
 Thanks so much,
 Jeff
 [snip]
 


highlighting in multiValued field

2011-05-26 Thread Jeffrey Chang
Hi All,

I am having a problem with search highlighting for multiValued fields and am
wondering if someone can point me in the right direction.

I have in my schema a multiValued field as such:
 field name=description type=text stored=true indexed=true
multiValued=true/

When I search for term Tel, it returns me the correct doc:
doc
...
arr name=description
  strTel to talent 1/str
  strTel to talent 2/str
  /arr
...
/doc

When I enable highlighting, it returns me the following highlight with only
one vector returned:
...
lst name=highlighting
  lst name=1
  arr name=description
stremTel/em to talent 1/str
  /arr
  /lst
/lst
What I'm expecting is actually both vectors to be returned as such:
lst name=highlighting
  lst name=1
  arr name=description
stremTel/em to talent 1/str
stremTel/em to talent 2/str
  /arr
  /lst
/lst
Am I doing something wrong in my config or query (I'm using default)? Any
help is appreciated.

Thanks,
Jeff


Re: Solr architecture diagram

2011-04-07 Thread Jeffrey Chang
This is awesome; thank you!

On Thu, Apr 7, 2011 at 6:09 PM, Jan Høydahl jan@cominvent.com wrote:

 Hi,

 Glad you liked it. You'd like to model the inner architecture of SolrJ as
 well, do you? Perhaps that should be a separate diagram.

 --
 Jan Høydahl, search solution architect
 Cominvent AS - www.cominvent.com

  On 6. apr. 2011, at 12.06, Stevo Slavić wrote:

  Nice, thank you!
 
  Wish there was something similar or extra to this one depicting where
  do SolrJ's CommonsHttpSolrServer and EmbeddedSolrServer fit in.
 
  Regards,
  Stevo.
 
  On Wed, Apr 6, 2011 at 11:44 AM, Jan Høydahl jan@cominvent.com
 wrote:
  Hi,
 
  At Cominvent we've often had the need to visualize the internal
 architecture of Apache Solr in order to explain both the relationships of
 the components as well as the flow of data and queries. The result is a
 conceptual architecture diagram, clearly showing how Solr relates to the
 app-server, how cores relate to a Solr instance, how documents enter through
 an UpdateRequestHandler, through an UpdateChain and Analysis and into the
 Lucene index etc.
 
  The drawing is created using Google draw, and the original is shared on
 Google Docs. We have licensed the diagram under the permissive Creative
 Commons CC-by license which lets you use, modify and re-distribute the
 diagram, even commercially, as long as you attribute us with a link.
 
  Check it out at http://ow.ly/4sOTm
  We'd love your comments
 
  --
  Jan Høydahl, search solution architect
  Cominvent AS - www.cominvent.com
 
 




Re: Solr without Server / Search solutions with Solr on DVD (examples?)

2011-04-07 Thread Jeffrey Chang
Even if you can ship your DVD with a jetty server, you'll still need JAVA
installed on the customer machine...

On Thu, Apr 7, 2011 at 10:18 PM, Ezequiel Calderara ezech...@gmail.comwrote:

 Can't you just run a jetty server on the background?

 But probably some antivirus or antispyware could take that as an tojan or
 something like that.

 How many little main memory is? 1gb? less?

 I don't think that you are going to have problems above 1gb. The index will
 be static, no changes, no optimizations...

 That's my thought

 On Thu, Apr 7, 2011 at 11:12 AM, karsten-s...@gmx.de wrote:

  Hi folks,
 
  we want to migrate our search-portal to Solr.
  But some of our customers search in our informations offline with a
  DVD-Version.
  So we want to estimate the complexity of a Solr DVD-Version.
  This means to trim Solr to work on small computers with the opposite of
  heavy loads. So no server-optimizations, no Cache, less facet terms in
  memory...
 
  My question:
  Does anyone know examples of solutions with Solr starting from DVD?
 
  Is there a tutorial for “configure a slow Solr for Computer with little
  main memory”?
 
  Any best practice tips from yourself?
 
 
  Best regards
   Karsten
 



 --
 __
 Ezequiel.

 Http://www.ironicnet.com http://www.ironicnet.com/



admin/index.jsp double submit on IE

2011-04-02 Thread Jeffrey Chang
Hi,

I noticed /admin/index.jsp could issue a double submit on IE causing Jetty
to error out.

Fixed by modifying index.jsp's javascript submit to return false.

... queryForm.submit(); return false; ...

Not sure if I should log a defect for this or not.

- Jeff


Re: FW: DIH relating multiple DataSources

2011-03-28 Thread Jeffrey Chang
I'll reply the solution to this thread on my own (with a different email
address).

Did some debugging on 1.4.1 source code, my issue is in the data-config.xml
file, the field column name when stored in Map object uses the DBs column
casing (e.g. ID -- id):

entity name=parentEntity ...
field column=ID name=XXX /
...
   entity childEntity ... query=select * from jctest where
ID='${parentEntity.ID}'
...

The config above does not work because the parentEntity.ID, the ID token
when compared in the Map object is stored as 'id'. If I change
parentEntity.ID to parentEntity.id (lower case id) then it works.

Perhaps the class *VariableResolverImpl *should consider a case insensitive
Map get?
Thanks,
Jeff
On Mon, Mar 28, 2011 at 3:18 PM, jeffrey_ch...@trend.com.tw wrote:



 -Original Message-
 From: Jeffrey Chang (IS-TW)
 Sent: Saturday, March 26, 2011 9:00 PM
 To: solr-user@lucene.apache.org
 Subject: DIH relating multiple DataSources

 Hi All,

 I'm a newbie to SOLR and is hoping to get some help.

 I was able to get DIH to work with one datasource. What I'm trying to
 achieve is using two datasources to build my document. Below is my
 data-config:

 dataConfig
 dataSource name=localDB driver=com.mysql.jdbc.Driver
 url=jdbc:mysql://localhost:3306/ebook user=ebook password=masked
 batchSize=1 /
 dataSource name=remoteDB driver=com.mysql.jdbc.Driver
 url=jdbc:mysql://tw-stntlab1:3306/test user=root password=masked
 batchSize=1 /
document name=epub
entity dataSource=localDB rootEntity=true name=epub
 pk=ID query=select * from epub
field column=ID name=id /
field column=Name name=url /
field column=Author name=content /
entity dataSource=remoteDB name=test
 query=select TESTCOLUMN from jctest where ID='${epub.ID}'
field column=TESTCOLUMN name=title /
/entity
/entity
/document
 /dataConfig

 If the above possible? I can't seem to get my title field above populated
 from a second datasource but the fields identified in my rootEntity using
 the first datasource works perfectly fine.

 Thanks,
 Jeff
 TREND MICRO EMAIL NOTICE
 The information contained in this email and any attachments is confidential
 and may be subject to copyright or other intellectual property protection.
 If you are not the intended recipient, you are not authorized to use or
 disclose this information, and we request that you notify us by reply mail
 or telephone and delete the original message from your mail system.




Re: Cant retrieve data

2011-03-28 Thread Jeffrey Chang
I'm also new but I was able to get DIH working.

From your response your have:
...
Indexing completed. Added/Updated: 0 documents. Deleted 0 documents.
...
str name=Total Documents Processed0/str

I believe your fetch (db source and query) is correct based on the response
but perhaps your mapping isn't. I would check required fields on your
schema.xml and see if they are properly mapped. Also are you getting any
exceptions?
- Jeff


On Mon, Mar 28, 2011 at 8:12 PM, Upayavira u...@odoko.co.uk wrote:

 What query are you doing?

 Try q=*:*

 Also, what does /solr/admin/stats.jsp report for number of docs?

 Upayavira

 On Mon, 28 Mar 2011 04:28 -0700, Merlin Morgenstern
 merli...@fastmail.fm wrote:
  Hi there,
 
  I am new to solr and have just installed it on a suse box with mysql
  backend.
 
  Install and MySQL connector seem to be running. I can see the solr admin
  interface.
  Now I tried to index a table with about 0.5 Mio rows. That seemed to
  work as well. However, I do get 0 results doing a querie on it.
  Something seemes to be wrong. I also did a commit of the full import.
 
  Here is the response from import.
 
  response
  -
  lst name=responseHeader
  int name=status0/int
  int name=QTime3/int
  /lst
  -
  lst name=initArgs
  -
  lst name=defaults
  str name=configdata-config.xml/str
  /lst
  /lst
  str name=commandfull-import/str
  str name=statusidle/str
  str name=importResponse/
  -
  lst name=statusMessages
  str name=Total Requests made to DataSource1/str
  str name=Total Rows Fetched404575/str
  str name=Total Documents Skipped0/str
  str name=Full Dump Started2011-03-28 12:47:36/str
  -
  str name=
  Indexing completed. Added/Updated: 0 documents. Deleted 0 documents.
  /str
  str name=Committed2011-03-28 12:47:42/str
  str name=Optimized2011-03-28 12:47:42/str
  str name=Total Documents Processed0/str
  str name=Time taken 0:0:6.141/str
  /lst
  -
  str name=WARNING
  This response format is experimental.  It is likely to change in the
  future.
  /str
  /response
 
  Data-config.xml looks like this:
 
  dataConfig
  dataSource type=JdbcDataSource
 driver=com.mysql.jdbc.Driver
 url=jdbc:mysql://192.168.0.109/test
 user=solr
 password=bOgKk0Kg/
  document name=content
  entity name=node query=select phrase, country from
  search_site
  field column=ID name=id /
  field column=phrase name=phrase /
  field column=country name=country /
  /entity
  /document
  /dataConfig
 
  Thank you for any hint to get this running.
 
  --
  http://www.fastmail.fm - Email service worth paying for. Try it for free
 
 ---
 Enterprise Search Consultant at Sourcesense UK,
 Making Sense of Open Source