Re: Question about Luke

Hello, > Is it different from checkIndex -exorcise option? > (As far as I recently leaned, checkIndex -exorcise will delete unreadable > indices. ) If you mean desktop app Luke, "Repair" is just a wrapper of CheckIndex.exorciseIndex(). There is no difference between doing "Repair" from Luke GUI

Re: Could not find lemmatization model

Hi, maybe this one? http://opennlp.sourceforge.net/models-1.5/ 2019年6月18日(火) 17:13 Vidit Mathur : > > Sir/ma'am > I was trying to integrate OpenNLP with solr for lemmatizating the search > text but I could find the lemmatization model on opennle.sourceforge.net . > Could you please help me with

[ANNOUNCE] Luke 8.0.0 released

Hi, Luke 8.0.0 is out. Zip archive can be downloaded from here: https://github.com/DmitryKey/luke/releases/tag/luke-swing-8.0.0 In this release, - Lucene version was upgraded to 8.0.0. - Added 'exact hits count' checkbox to the Search tab to return the accurate total hit count. - Supported

[ANNOUNCE] Luke 7.7.0 released

Hi, Luke 7.7.0 is out. Zip archive can be downloaded at here: https://github.com/DmitryKey/luke/releases/tag/luke-swing-7.7.0 In this release, - Lucene version was upgraded to 7.7.0. - Some trivial UI bugs were fixed. Regards, Tomoko

[ANNOUNCE] Luke 7.6.0 released

Hi Luke users, Luke 7.6.0 was just released. Zip archive can be downloaded from here: https://github.com/DmitryKey/luke/releases/tag/luke-swing-7.6.0 This release includes important bug fixes and improvements. Please consider upgrading if you use Swing Luke 7.5.0. Major changes:

[ANNOUNCE] Luke 7.5.0 released

Hi, Luke 7.5.0 was just released. For this release, we have two editions of Luke. (Sorry for the confusion.) * Luke 7.5.0 - Swing edition Swing edition can be downloaded from here: https://github.com/DmitryKey/luke/releases/tag/luke-swing-7.5.0 This version of Luke works with JDK 8/9/10/11. Use

Re: Docvalue v.s. invert index

> > > > > > -- > Sent from: http://lucene.472066.n3.nabble.com/Solr-User-f472068.html > -- Tomoko Uchida

Re: Question regarding searching Chinese characters

rogram > > Thanks! > Amanda > > > -- > Dr. Amanda Shuman > Post-doc researcher, University of Freiburg, The Maoist Legacy Project > <http://www.maoistlegacy.uni-freiburg.de/> > PhD, University of California, Santa Cruz > http://www.amandashum

Re: Question regarding searching Chinese characters

izer. > > > > I’ve never built a charfilter, but it seems like this would be a good > first project for someone who wants to contribute. > > > > wunder > > Walter Underwood > > wun...@wunderwood.org > > http://observer.wunderwood.org/ (my blog) > >

Re: Question regarding searching Chinese characters

>>> > >>>>>>> Otherwise, I think your answer would be somewhere around using > >> ICU4J, > >>>>>>> IBM's library for dealing with Unicode: > >> http://site.icu-project.org/ > >>>>>>> (mentioned on the same page above) > >>>>>>> Specifically, transformations: > >>>>>>> http://userguide.icu-project.org/transforms/general > >>>>>>> > >>>>>>> With that, maybe you map both alphabets into latin. I did that once > >>>>>>> for Thai for a demo: > >>>>>>> https://github.com/arafalov/solr-thai-test/blob/master/ > >>>>>>> collection1/conf/schema.xml#L34 > >>>>>>> > >>>>>>> The challenge is to figure out all the magic rules for that. You'd > >>>>>>> have to dig through the ICU documentation and other web pages. I > >>> found > >>>>>>> this one for example: > >>>>>>> http://avajava.com/tutorials/lessons/what-are-the-system- > >>>>>>> transliterators-available-with-icu4j.html;jsessionid= > >>>>>>> BEAB0AF05A588B97B8A2393054D908C0 > >>>>>>> > >>>>>>> There is also 12 part series on Solr and Asian text processing, > >>> though > >>>>>>> it is a bit old now: http://discovery-grindstone.blogspot.com/ > >>>>>>> > >>>>>>> Hope one of these things help. > >>>>>>> > >>>>>>> Regards, > >>>>>>> Alex. > >>>>>>> > >>>>>>> > >>>>>>> On 20 July 2018 at 03:54, Amanda Shuman > >>>>>> wrote: > >>>>>>>> Hi all, > >>>>>>>> > >>>>>>>> We have a problem. Some of our historical documents have mixed > >>>>>> together > >>>>>>>> simplified and Chinese characters. There seems to be no problem > >>> when > >>>>>>>> searching either traditional or simplified separately - that is, > >>> if a > >>>>>>>> particular string/phrase is all in traditional or simplified, it > >>>>>> finds > >>>>>>> it - > >>>>>>>> but it does not find the string/phrase if the two different > >>>>>> characters > >>>>>>> (one > >>>>>>>> traditional, one simplified) are mixed together in the SAME > >>>>>>> string/phrase. > >>>>>>>> > >>>>>>>> Has anyone ever handled this problem before? I know some > >> libraries > >>>>>> seem > >>>>>>> to > >>>>>>>> have implemented something that seems to be able to handle this, > >>> but > >>>>>> I'm > >>>>>>>> not sure how they did so! > >>>>>>>> > >>>>>>>> Amanda > >>>>>>>> -- > >>>>>>>> Dr. Amanda Shuman > >>>>>>>> Post-doc researcher, University of Freiburg, The Maoist Legacy > >>>>>> Project > >>>>>>>> <http://www.maoistlegacy.uni-freiburg.de/> > >>>>>>>> PhD, University of California, Santa Cruz > >>>>>>>> http://www.amandashuman.net/ > >>>>>>>> http://www.prchistoryresources.org/ > >>>>>>>> Office: +49 (0) 761 203 4925 > >>>>>>> > >>>>>> > >>>>> > >>>>> > >>>> > >>> > >> > > -- Tomoko Uchida

Re: Question regarding searching Chinese characters

sessionid= > >>> > BEAB0AF05A588B97B8A2393054D908C0 > >>> > > >>> > There is also 12 part series on Solr and Asian text processing, > though > >>> > it is a bit old now: http://discovery-grindstone.blogspot.com/ > >>> > > >>> > Hope one of these things help. > >>> > > >>> > Regards, > >>> >Alex. > >>> > > >>> > > >>> > On 20 July 2018 at 03:54, Amanda Shuman > >>> wrote: > >>> > > Hi all, > >>> > > > >>> > > We have a problem. Some of our historical documents have mixed > >>> together > >>> > > simplified and Chinese characters. There seems to be no problem > when > >>> > > searching either traditional or simplified separately - that is, > if a > >>> > > particular string/phrase is all in traditional or simplified, it > >>> finds > >>> > it - > >>> > > but it does not find the string/phrase if the two different > >>> characters > >>> > (one > >>> > > traditional, one simplified) are mixed together in the SAME > >>> > string/phrase. > >>> > > > >>> > > Has anyone ever handled this problem before? I know some libraries > >>> seem > >>> > to > >>> > > have implemented something that seems to be able to handle this, > but > >>> I'm > >>> > > not sure how they did so! > >>> > > > >>> > > Amanda > >>> > > -- > >>> > > Dr. Amanda Shuman > >>> > > Post-doc researcher, University of Freiburg, The Maoist Legacy > >>> Project > >>> > > <http://www.maoistlegacy.uni-freiburg.de/> > >>> > > PhD, University of California, Santa Cruz > >>> > > http://www.amandashuman.net/ > >>> > > http://www.prchistoryresources.org/ > >>> > > Office: +49 (0) 761 203 4925 > >>> > > >>> > >> > >> > > > -- Tomoko Uchida

[ANNOUNCE] Luke 7.4.0 released

Download the release zip from here: https://github.com/DmitryKey/luke/releases/tag/luke-7.4.0 This update is for upgrading Lucene 7.4.0. Note: If you use OpenJDK you need to install OpenJFX separately to run JavaFX. Oracle HotSpot JVM includes JavaFX runtime. Best, Tomoko Uchida

[ANNOUNCE] Luke 7.3.1 released

nJFX separately to run JavaFX. Oracle HotSpot JVM includes JavaFX runtime. -- Tomoko Uchida

[ANNOUNCE] Luke 7.2.0 released

plan to switch current (Thinlet) Luke to the JavaFX version in a future release. Please try it and feedback is welcome! Note: If you use OpenJDK you need to install OpenJFX separately to run JavaFX. Oracle HotSpot JVM includes JavaFX runtime. -- Tomoko Uchida

[ANNOUNCE] Luke 7.1.0 released

Download the release zip here: https://github.com/DmitryKey/luke/releases/tag/luke-7.1.0 Upgrade to Lucene 7.1.0. and, other changes in this release: <https://github.com/DmitryKey/luke/blob/master/CHANGES.txt> -- Tomoko Uchida

[ANNOUNCEMENT] Luke 6.5.0 released

o respective contributors! -- Tomoko Uchida

[ANNOUNCEMENT] Luke 6.3.0 released

Download the release zip here: https://github.com/DmitryKey/luke/releases/tag/luke-6.3.0 Upgrade to Lucene 6.3.0. #74 and, other changes in this release: Enjoy!

[ANNOUNCEMENT] Luke 6.2.1 released

Download the release zip here: https://github.com/DmitryKey/luke/releases/tag/luke-6.2.1 Upgrade to Lucene 6.2.1. #67 Enjoy!

Re: EdgeNGramFilterFactory for Chinese characters

dexing and querying. > > Will try to see if there is anyway to managed it by only a single field? > > Regards. > Edwin > > > On 25 October 2015 at 22:59, Tomoko Uchida <tomoko.uchida.1...@gmail.com> > wrote: > > > Hi, Edwin, > > > > > This means it is

Re: EdgeNGramFilterFactory for Chinese characters

ans it is better to have 2 separate fields for English and Chinese > words? > Not quite sure what you mean by that. > > Regards, > Edwin > > > > On 25 October 2015 at 11:42, Tomoko Uchida <tomoko.uchida.1...@gmail.com> > wrote: > > > > I have rich-text doc

Re: EdgeNGramFilterFactory for Chinese characters

> I have rich-text documents that are in both English and Chinese, and > currently I have EdgeNGramFilterFactory enabled during indexing, as I need > it for partial matching for English words. But this means it will also > break up each of the Chinese characters into different tokens.

Re: Unable to delete document from solr

Hi, Sorry if I miss the point... Is your delete query surely okay? When you search with the delete query, how many docs are returned. For example : http://SOLRSERVER:SOLRPORT/solr/collection_name/search?q=Name:".$Name.; AND Version:".$version." If that helps, Solr returns normal response even

Re: Solr 4.7.2 Vs 5.3.0 Docs different for same query

pdate the zookeeper ensemble with > new > > configs via 'upconfig' and 'linkconfig' commands do we have to "reload" > the > > collections on all the nodes to see the updated config ?? Is there a > single > > call which can update all nodes connected to the ensemble ?? I just we

Re: Class Loader issues

Hi, Do you have (execute) permission for /dev/solr-5.3.1/contrib/clustering/lib ? I've seen same warning when I have not access permission to the library dir. Regards, Tomoko 2015-10-02 1:23 GMT+09:00 Firas Khasawneh : > Hi all, > > I am trying to load Jackson json

Re: Solr 4.7.2 Vs 5.3.0 Docs different for same query

Are you sure that you've indexed same data to Solr 4.7.2 and 5.3.0 ? If so, I suspect that you have multiple shards and request to one shard. (In that case, you might get partial results) Can you share HTTP request url and the schema and default search field ? 2015-10-02 6:09 GMT+09:00 Ravi

Re: Is docValues required in Solr 5.x for distributed result grouping?

Hi, > Of course the Doc Values data structure can be used by anything who wants > to retrieve the column base view of documents per field, but is anywhere > documented all the ways it's used in Solr ? According to the Solr guide about docvalues, it is used in faceting, sorting, and grouping.

Re: Raw lucene query for a given solr query

Hi, You can get raw query (and other debug information) with debug=true paramter. Regards, Tomoko 2015-06-16 8:10 GMT+09:00 KNitin nitin.t...@gmail.com: Hi, We have a few custom solrcloud components that act as value sources inside solrcloud for boosting items in the index. I want to get

Re: DOcValues

Hi, According to line 430 in SImpleFacet.java (Solr 5.0.0), facet method is forced to fc when we set docValues=true. https://github.com/apache/lucene-solr/blob/lucene_solr_5_0_0/solr/core/src/java/org/apache/solr/request/SimpleFacets.java#L430 So we need not set facet.method to use doc values.

Re: DOcValues

Dear Shawn, Thank you for the detailed explanation! Many users would need such guidelines about memory consumption (and performance trade-offs) for facets. Thanks, Tomoko 2015-04-03 22:26 GMT+09:00 Shawn Heisey apa...@elyograg.org: On 4/3/2015 6:53 AM, Tomoko Uchida wrote: According to line

Re: How to start solr in solr cloud mode using external zookeeper ?

Hi, Did you check SolrCloud section in Ref Guides? You can download PDFs from here. http://archive.apache.org/dist/lucene/solr/ref-guide/ Or this. (It's already marked out of date, but still provides basic, helpful information.) https://wiki.apache.org/solr/SolrCloud Regards, Tomoko

Re: [ANNOUNCE] Luke 4.10.3 released

PM, Tomoko Uchida tomoko.uchida.1...@gmail.com wrote: Sorry, I'm afraid I have not encountered such errors when launch. Seems something wrong around Pivot's, but I have no idea about it. Would you tell me java version you're using ? Tomoko 2015-02-26 21:15 GMT+09:00 Dmitry Kan

Re: [ANNOUNCE] Luke 4.10.3 released

(Version.java:156) at org.apache.pivot.wtk.ApplicationContext.clinit(ApplicationContext.java:1704) ... 1 more On Thu, Feb 26, 2015 at 1:48 PM, Tomoko Uchida tomoko.uchida.1...@gmail.com wrote: Thank you for checking out it! Sorry, I've forgot to note important

Re: [ANNOUNCE] Luke 4.10.3 released

/lib-ivy does not exist. On Thu, Feb 26, 2015 at 2:27 AM, Tomoko Uchida tomoko.uchida.1...@gmail.com wrote: Thanks! Would you announce at LUCENE-2562 to me and all watchers interested in this issue, when the branch is ready? :) As you know, current pivots's version (that supports

Re: [ANNOUNCE] Luke 4.10.3 released

Dmitry Kan solrexp...@gmail.com: Ok, sure. The plan is to make the pivot branch in the current github repo and update its structure accordingly. Once it is there, I'll let you know. Thank you, Dmitry On Tue, Feb 24, 2015 at 5:26 PM, Tomoko Uchida tomoko.uchida.1...@gmail.com wrote: Hi

Re: [ANNOUNCE] Luke 4.10.3 released

, but at least we will have the common plate. :) Thanks, Dmitry On Tue, Feb 24, 2015 at 4:02 PM, Tomoko Uchida tomoko.uchida.1...@gmail.com wrote: Hi, I'm an user / fan of Luke, so deeply appreciate your work. I've carefully read the readme, noticed the (one of) project's goal

Re: [ANNOUNCE] Luke 4.10.3 released

Hi, I'm an user / fan of Luke, so deeply appreciate your work. I've carefully read the readme, noticed the (one of) project's goal: To port the thinlet UI to an ASL compliant license framework so that it can be contributed back to Apache Lucene. Current work is done with GWT 2.5.1. There has

Re: SolrJ Facetting: changing sort order

FYI, this Jira ticket might be related to your question... you can check the patch. https://issues.apache.org/jira/browse/SOLR-1672 2015-02-04 11:41 GMT+09:00 Tomoko Uchida tomoko.uchida.1...@gmail.com: Hi, I have been trying to find out a way to get the facet results in ascending order

Re: SolrJ Facetting: changing sort order

Hi, I have been trying to find out a way to get the facet results in ascending order of counts. I could not look up online to find a way to do this. In short answer, Solr only supports facet results sorting by descending order of counts, or lexicographical order of terms. See the description

Re: Building Solr 5 from svn sources

Yes, trunk is now for 6.0. branch_5x is for 5.1. 5.0 release branch is lucene_solr_5_0 http://mail-archives.apache.org/mod_mbox/lucene-dev/201501.mbox/%3CCAKiERN4-qbj7BF%3DJgui4xUFKujwuP%2BodkZPesVT51xnXG1om_w%40mail.gmail.com%3E 2015-01-29 19:29 GMT+09:00 Clemens Wyss DEV clemens...@mysign.ch:

Re: Solr source problem

Hi, The error message impossible to resolve dependencies suggests dependency problems. seems to be problems at ant ivy-bootstrap (step 6) Try step 6 again and check logs... Regards, Tomoko 2015-01-29 18:14 GMT+09:00 L� T�ng Anh letunganh28121...@gmail.com: Hi, I want to add solr source to

Re: Index data of XML file

Hi, Do you need to crawl XML files by MCF? I would index XML files by DIH's XMLEntityProcessor. http://wiki.apache.org/solr/DataImportHandler Or, I would parse XMLs and post to Solr on my own. Java(with SolrJ) or any scripting language is convenient. Sorry for if it's not helpful. Regards,

Re: MultiPhraseQuery:Rewrite to BooleanQuery

Hi, Strictly speaking, MultiPhraseQuery and BooleanQuery wrapping PhraseQuerys are not equal. For each query, Query.rewrite() returns different object. (with Lucene 4.10.3) q1.rewrite(reader).toString() returns: body:blueberry chocolate (pie tart), where q1 is your first multi phrase query.

Re: Solr Users Mailing lists in languages other than English?

Hi, There's no mailing lists in Japan as far as I know. A Google group seems to be not used any more. (Other than mailing lists, there are user meetups in Tokyo.) Thanks, Tomoko 2015-01-19 21:39 GMT+09:00 Alexandre Rafalovitch arafa...@gmail.com: Hi, Are there any non-English mailing lists

Re: Solr example for Solr 4.10.2 gives warning about Multiple request handlers with same name

This warning has been fixed in svn branches. (not yet released) https://issues.apache.org/jira/browse/SOLR-6499 You can simply ignore this warning, or comment out the corresponding RequestHandler definition from solrconfig.xml (implicit handler will work.) Regards, Tomoko 2015-01-17 5:27

Re: How to do fuzzy search on phrases

Iam using solr 4.7 and solr php client. Back to original question, I've missed it. ComplexPhraseQueryParser is not available in Solr 4.7, so sorry for misleading information. Regards, Tomoko 2015-01-14 23:44 GMT+09:00 Tomoko Uchida tomoko.uchida.1...@gmail.com: Hi Adrien, No, you cannot

Re: How to do fuzzy search on phrases

Client -Message d'origine- De : Tomoko Uchida [mailto:tomoko.uchida.1...@gmail.com] Envoyé : mercredi 14 janvier 2015 14:31 À : solr-user@lucene.apache.org Objet : Re: How to do fuzzy search on phrases Hi, I suspect you are likely to misunderstand fuzzy search. You should append ~N

Re: How to do fuzzy search on phrases

Hi, I suspect you are likely to misunderstand fuzzy search. You should append ~N to end of each query term, not whole query string / phrase. (You can debug your query and get useful information by specifying debugQuery=true parameter, try it if you have not.) At first glance, I guess Complex

Re: Multi Language Suggester Solr Issue

It's interesting results... I'm not a Unicode specialist, but Japanese query cannot match Arabic documents if both of them correctly encoded. I cannot recommend such use case, single field for all languages, but maybe you should check indexed (analyzed) tokens for inspection, not stored data. Are

Re: set keepword file to be used based on a field value

Hi Leo, Yes, my image is similar to yours. If the value ends with _CAT1 == use as keepword file keepwords1.txt and so on? But my second option is not about configurations, but customizing Solr. Utilizing customizability of Lucene/Solr, you can write your own TokenFilter class. Maybe your

Re: IOException occured when talking to solr server

Hi, org.apache.solr.client.solrj.SolrServerException: Server refused connection at: http://localhost/solr Clearly it is server side problem, so client SolrJ logs are not helpful. You should check Tomcat and Solr error logs and look for cause of the load. Best, Tomoko 2014-12-22 21:27

Re: set keepword file to be used based on a field value

Hi, I cannot fully understand your point, but you would like to apply KeepwordFilter to title field and switch keepword files based on categoryId field value ? I think that is essntially difficult because an Analyzer (including Filters) cannot take into account another field values except for

Re: set keepword file to be used based on a field value

it makes indexing/querying process slightly complicated. 2014-12-22 10:58 GMT+09:00 Tomoko Uchida tomoko.uchida.1...@gmail.com: Hi, I cannot fully understand your point, but you would like to apply KeepwordFilter to title field and switch keepword files based on categoryId field value ? I

Re: problem with tutorial

Hi, At first, you should check solr.log file in your Solr running directory (maybe JVMs stacktraces in it.) You might able to find clues from logs. If you cannot solve the problem, post to mailing list again with your exact command (options too), and stacktrace log. Thanks, Tomoko 2014-12-16

Re: Nested Facet Solr

Hi, This issue might be related to your question. https://issues.apache.org/jira/browse/SOLR-4212 https://issues.apache.org/jira/browse/SOLR-6353 So short answer, currently it's not possible. I cannot come up with good solution with Solr, but you may be able to summing up facet counts returned

Re: Solr join not working for multiple collection in slorCloud env

Hi, It's just FYI, Join query is (currently) not supported at distributed environment. It would be same at SolrCloud mode (I have not tried.) Please see Limitations notation this page, if you have not. https://wiki.apache.org/solr/Join Thanks, Tomoko 2014-12-16 9:04 GMT+09:00 ArnabK

Re: Join in SOLR

Thank you for config information. Three tables have relation (by foreign key) ? You might want to have one nested entity tag in document rather than 3 entity one in document. By using nested entity tag, you may able to merge tables *before* importing them to Solr. All works done by SQL. You have

Re: Highlighting integer field

, 2014 at 3:08 PM, Tomoko Uchida tomoko.uchida.1...@gmail.com wrote: Hi Pawel, Essentially, highlighting is a feature to show fragments of documents that matche user queries. With that, he/she can find occurrence of their query in long documents and can understand

Re: Join in SOLR

I cannot find out your table structure and Solr schema, but if your requirement is too complex to handle by DIH, you could handle it by rich database functionality. I think creating a database view is good choice... (Of course, other experts may have ideas using DIH?) 2014-12-12 20:43

Re: Highlighting integer field

))) { return; } There is still information about LUCENE-3080 in comments (and this JIRA issue is still open) but some other issue seems to be resolved: SOLR-2497 which says it is blocked by LUCENE-3080. On Fri, Dec 12, 2014 at 12:51 PM, Tomoko Uchida tomoko.uchida.1...@gmail.com wrote: Hi

Re: Highlighting integer field

Hi Pawel, Essentially, highlighting is a feature to show fragments of documents that matche user queries. With that, he/she can find occurrence of their query in long documents and can understand their results well. For tint or tlong fields (or other non-text field types), fragments usually have

Re: Join in SOLR

Hi, I cannot guess what is 'entities' in your context, but do you want some kind of join functionality like RDBs on Solr? Basically, Solr is not relational. So at first, you should consider denormalize your RDB tables to one table/view (or issue SQL JOIN query in DIH) to import data to Solr. If