Issues with coordinates in Solr during updating of fields

2016-05-24 Thread Zheng Lin Edwin Yeo
Hi, I have an implementation of storing the coordinates in Solr during indexing. During indexing, I will only store the value in the field name ="gps". For the field name = "gps_0_coordinate" and "gps_1_coordinate", the value will be auto filled and indexed from the "gps" field. But

Re: ngroup for MLT results

2016-05-24 Thread Zheng Lin Edwin Yeo
Anyone has any information on this? Regards, Edwin On 21 May 2016 at 14:50, Zheng Lin Edwin Yeo wrote: > Hi, > > Would like to check, is there a way to do ngrouping for MLT queries? > I tried the following query with the MoreLikeThisHandler, but I could not > get any

Re: debugging solr query

2016-05-24 Thread Erick Erickson
Try adding debug=timing, that'll give you an idea of what component is taking all the time. >From there, it's "more art than science". But you haven't given us much to go on. What is the query? Are you grouping? Faceting on high-cardinality fields? Returning 10,000 rows? Best, Erick On Tue, May

Re: debugging solr query

2016-05-24 Thread Ahmet Arslan
Hi, Is it QueryComponent taking time? Ot other components? Also make sure there is plenty of RAM for OS cache. Ahmet On Wednesday, May 25, 2016 1:47 AM, Jay Potharaju wrote: Hi, I am trying to debug solr performance problems on an old version of solr, 4.3.1. The

debugging solr query

2016-05-24 Thread Jay Potharaju
Hi, I am trying to debug solr performance problems on an old version of solr, 4.3.1. The queries are taking really long -in the range of 2-5 seconds!!. Running filter query with only one condition also takes about a second. There is memory available on the box for solr to use. I have been looking

Re: Is it possible to pass parameters through solrconfig.xml ?

2016-05-24 Thread Chris Hostetter
your question confuses me - pass "through" from where? when search components are defined in solrconfig.xml, they can be declared with any init params you want which will be passed to the init() method. Both the sample_techproducts_configs and data_driven_schema_configs that come with

Re: Adding information to Solr response in custom filter query code?

2016-05-24 Thread Chris Hostetter
: Is there any way a custom search component can access data created in custom : post filter query so that the data can be added to the response? Yes - this is exactly what the example i mentioned in my previous message do -- as i said before... >> Take a look at the CollapseQParser (which is

Re: [Solr 6] Migration from Solr 4.10.2

2016-05-24 Thread Alessandro Benedetti
Mikhail, you have been really helpful! On Tue, May 24, 2016 at 9:38 PM, Mikhail Khludnev < mkhlud...@griddynamics.com> wrote: > Alessandro, > > I checked with Solr 6.0 distro on techproducts. > Faceting on cat with uif hits fieldValueCache > >

Re: [Solr 6] Migration from Solr 4.10.2

2016-05-24 Thread Mikhail Khludnev
Alessandro, I checked with Solr 6.0 distro on techproducts. Faceting on cat with uif hits fieldValueCache http://localhost:8983/solr/techproducts/select?facet.field=cat=uif=on=on=*:*=json fieldValueCache - class:org.apache.solr.search.FastLRUCache - description:Concurrent LRU

Re: Solr mysql Json import

2016-05-24 Thread vsriram30
Looks like it is available through http post request as given in https://lucidworks.com/blog/2014/08/12/indexing-custom-json-data/ Hence I assume corresponding json data import from mysql should also be available. Can someone point me to related docs? Thanks, Sriram -- View this message in

Re: [Solr 6] Migration from Solr 4.10.2

2016-05-24 Thread Alessandro Benedetti
Update , it seems clear I incurred in the bad https://issues.apache.org/jira/browse/SOLR-8096 : Just adding some additional information as I just incurred on the issue with Solr 6.0 : Static index, around 50 *10^6 docs, 20 fields to facet, 1 of them with high cardinality on top of grouping.

Is it possible to pass parameters through solrconfig.xml ?

2016-05-24 Thread vitaly bulgakov
I need to pass a parameter to one of my searchComponent class from solrconfog.xml file. Please advice me how to do it if it is possible. -- View this message in context: http://lucene.472066.n3.nabble.com/Is-it-possible-to-pass-parameters-through-solrconfig-xml-tp4278852.html Sent from the

Re: Auto Suggestion in solr

2016-05-24 Thread Erick Erickson
Well, theoretically you could back-port the suggester stuff, but I'd guess it would be very, very difficult. It'd be far easier to upgrade to, say, 4.10. But there's a different problem there. Until, I think 5.1, the suggester would rebuild itself on startup, and that could take a very long time.

Re: dynamicfields, copyfields, and multivalues

2016-05-24 Thread John Blythe
never mind, the issue ended up being that i had the copyField for that uom field in two places and hadn't realized it, doh! -- *John Blythe* Product Manager & Lead Developer 251.605.3071 | j...@curvolabs.com www.curvolabs.com 58 Adams Ave Evansville, IN 47713 On Tue, May 24, 2016 at 9:05 AM,

Re: Import html data in mysql and map schemas using onlySolrCELL+TIKA+DIH [scottchu]

2016-05-24 Thread Tom Evans
On Tue, May 24, 2016 at 3:06 PM, Scott Chu wrote: > p.s. There're really many many extensive, worthy stuffs in Solr. If the > project team can provide some "dictionary" of them, It would be a "Santa > Claus" > for we solr users. Ha! Just a X'mas wish! Sigh! I know it's

Re: Import html data in mysql and map schemas using onlySolrCELL+TIKA+DIH [scottchu]

2016-05-24 Thread Scott Chu
Justa let everybody know. I use DIH+template (without TIKA and Solr Cell, I really don't understand that part in reference guide) to achieve what I want. But still need to test more various form of HTML source. Scott Chu,scott@udngroup.com 2016/5/24 (週二) p.s. There're really many many

dynamicfields, copyfields, and multivalues

2016-05-24 Thread John Blythe
hi all, i'm going mad over something that seems incredibly simple. in an attempt to maintain some order to my growing data, i've begun to employ dynamicFields. basic stuff here, just using *_s, *_d, etc. for my strings, doubles, and other common datatypes. i have these stored but not indexed.

Re: Atomic updates and "stored"

2016-05-24 Thread Mark Robinson
Thanks Eric! Best, Mark On Mon, May 23, 2016 at 1:35 PM, Erick Erickson wrote: > Yes, currently when using Atomic updates _all_ fields > have to be stored, except the _destinations_ of copyField > directives. > > Yes, it will make your index bigger. The affects on

[Solr 6] Legacy faceting Term Enum method VS DocValues

2016-05-24 Thread Alessandro Benedetti
Hi guys, It has been a while I was thinking about this and yesterday I took a look into the code : I was wondering if the termEnum approach is still a valid alternative to docValues when we have low cardinality fields. The reason I am asking this is because yesterday I run into this piece of

Caused by: java.sql.SQLException: Unknown character set index for field '224' received from server. when do DIH [scottchu]

2016-05-24 Thread scott.chu
I test a table with ony 2 records. This table's properties are: MyISAM, utf8 character set, utf8_general_ci collation. the conents are html source with Chinese characters. I doesn't specify any schema.xml but only setup db-data-config.xml as follows:

Re: trying DIH but get 'Sorry, no dataimport-handler defined!'

2016-05-24 Thread scott.chu
I happen to find the problem. The problem seems to come from the html file that shows DIH function page. I use Maxthon browser, it has a function that can switch between IE mode and non-IE mode (actually the Webkit engine). I happen to switch back to non-IE mode and the error message is gone

Re(2): Import html data in mysql and map schemas using onlySolrCELL+TIKA+DIH [scottchu]

2016-05-24 Thread scott.chu
I read that but can't quite understand the steps! That's why I ask help here. scott.chu,scott@udngroup.com 2016/5/24 (週二) - Original Message - From: Markus Jelsma To: solr-user ; solr-user CC: Date: 2016/5/24 (週二) 17:52 Subject: RE: Import html data in mysql and map schemas using

RE: Import html data in mysql and map schemas using only SolrCELL+TIKA+DIH [scottchu]

2016-05-24 Thread Markus Jelsma
Hello - did you find this manual page? It explains how HTML can be uploaded. https://cwiki.apache.org/confluence/display/solr/Uploading+Data+with+Solr+Cell+using+Apache+Tika Markus -Original message- > From:scott.chu > Sent: Tuesday 24th May 2016 7:48 > To:

Re: More Like This on not new documents

2016-05-24 Thread Vincenzo D'Amore
Thanks Nick, I don't plan to index the document, the document is a kind of disposable object. And it is based on the user query. I have seen that page, I didn't get how pass the document (my disposable object) via stream.body parameter. Googling I found this

Re: Auto Suggestion in solr

2016-05-24 Thread Mugeesh Husain
thank Erick for reply, actually I am using solr 4.4, solr.SuggestComponent class is not available in solr 4.4, Can I implement this into my solr 4.4 lib and how ? if possible share any article before how people used suggestion in 4.4. Thanks Mugeesh -- View this message in context:

Re: trying DIH but get 'Sorry, no dataimport-handler defined!'

2016-05-24 Thread kostali hassan
if you have in this path server/solr/configsets/testdih/conf you shoud right this in your line commande: 'bin\solr>solr create -c your_core -d testdih -p 8983 to create a core with an exemple config testdih. 2016-05-24 9:35 GMT+01:00 scott.chu : > > I do following

Re: trying DIH but get 'Sorry, no dataimport-handler defined!'

2016-05-24 Thread scott.chu
I try run the example by issuing "bin\solr create_core -c exampledih -d example\example-DIH\solr\db\conf". It also shows same error. Do I issue wrong command? scott.chu,scott@udngroup.com 2016/5/24 (週二) - Original Message - From: scott(自己) To: solr-user CC: Date: 2016/5/24 (週二)

How to set id in DIHConfiguration?

2016-05-24 Thread Andreas Meyer
Hello! I try to import email from am IMAP maildir and see the following in the log: 2016-05-24 08:46:11.655 INFO (qtp428746855-14) [ x:ccc] o.a.s.h.d.DataImporter Loading DIH Configuration: mail-data-config.xml 2016-05-24 08:46:11.685 INFO (qtp428746855-14) [ x:ccc]

trying DIH but get 'Sorry, no dataimport-handler defined!'

2016-05-24 Thread scott.chu
I do following things: * I create folder : D:\solr-6.0.0\myconfigsets\testdih. * Copy D:\portable_sw\solr-6.0.0\example\example-DIH\solr\db\conf to D:\solr-6.0.0\myconfigsets\testdih. * Go into D:\solr-6.0.0\myconfigsets\testdih\conf and edit db-data-config.xml as follows (I am pretty sure

Re: Indexing a (File attached to a document)

2016-05-24 Thread Solr User
Hi I am using MapReduceIndexer Tool to index data from hdfs , using morphlines as ETL tool. Specifying data path as xpath's in morphline file. sorry for delay -- View this message in context: http://lucene.472066.n3.nabble.com/Indexing-a-File-attached-to-a-document-tp4276334p4278730.html

spellcheck on vietnamese (vi)

2016-05-24 Thread Nuhaa All Bakry
hello all, The site i’m working on has to support Vietnamese and Thai languages. The user should be able to search in a language and Solr should be able to detect misspelling and suggest some corrections. The search works as expected but the spellcheck doesnt. Currently I’m looking to