[jira] [Commented] (LUCENE-9581) Clarify discardCompoundToken behavior in the JapaneseTokenizer

2020-10-23 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17219808#comment-17219808 ] Kazuaki Hiraga commented on LUCENE-9581: Thank you for your input, [~jimczi].  My patch was just

[jira] [Commented] (LUCENE-9581) Clarify discardCompoundToken behavior in the JapaneseTokenizer

2020-10-20 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17218057#comment-17218057 ] Kazuaki Hiraga commented on LUCENE-9581: Hello [~jimczi] and [~johtani] san,   Please find

[jira] [Updated] (LUCENE-9581) Clarify discardCompoundToken behavior in the JapaneseTokenizer

2020-10-20 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9581?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Hiraga updated LUCENE-9581: --- Attachment: LUCENE-9581.patch > Clarify discardCompoundToken behavior in the

[jira] [Commented] (LUCENE-9390) Kuromoji tokenizer discards tokens if they start with a punctuation character

2020-06-17 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9390?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138948#comment-17138948 ] Kazuaki Hiraga commented on LUCENE-9390: Hello, I might have just remembered why [~cm] and I

[jira] [Commented] (LUCENE-9123) JapaneseTokenizer with search mode doesn't work with SynonymGraphFilter

2020-01-26 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024058#comment-17024058 ] Kazuaki Hiraga commented on LUCENE-9123: [~romseygeek] Thank you for your comments. I think we

[jira] [Updated] (LUCENE-9123) JapaneseTokenizer with search mode doesn't work with SynonymGraphFilter

2020-01-21 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Hiraga updated LUCENE-9123: --- Attachment: LUCENE-9123.patch > JapaneseTokenizer with search mode doesn't work with

[jira] [Updated] (LUCENE-9123) JapaneseTokenizer with search mode doesn't work with SynonymGraphFilter

2020-01-21 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Hiraga updated LUCENE-9123: --- Attachment: (was: LUCENE-9123.patch) > JapaneseTokenizer with search mode doesn't work

[jira] [Commented] (LUCENE-9123) JapaneseTokenizer with search mode doesn't work with SynonymGraphFilter

2020-01-21 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020345#comment-17020345 ] Kazuaki Hiraga commented on LUCENE-9123: [~cm] Thank you for your comment! {quote} Longer term

[jira] [Updated] (LUCENE-9123) JapaneseTokenizer with search mode doesn't work with SynonymGraphFilter

2020-01-21 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Hiraga updated LUCENE-9123: --- Attachment: LUCENE-9123.patch > JapaneseTokenizer with search mode doesn't work with

[jira] [Updated] (LUCENE-9123) JapaneseTokenizer with search mode doesn't work with SynonymGraphFilter

2020-01-21 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Hiraga updated LUCENE-9123: --- Attachment: LUCENE-9123_8x.patch > JapaneseTokenizer with search mode doesn't work with

[jira] [Updated] (LUCENE-9123) JapaneseTokenizer with search mode doesn't work with SynonymGraphFilter

2020-01-21 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Hiraga updated LUCENE-9123: --- Attachment: (was: LUCENE-9123_revised.patch) > JapaneseTokenizer with search mode

[jira] [Updated] (LUCENE-9123) JapaneseTokenizer with search mode doesn't work with SynonymGraphFilter

2020-01-21 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Hiraga updated LUCENE-9123: --- Attachment: (was: LUCENE-9123.patch) > JapaneseTokenizer with search mode doesn't work

[jira] [Commented] (LUCENE-9123) JapaneseTokenizer with search mode doesn't work with SynonymGraphFilter

2020-01-18 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17018748#comment-17018748 ] Kazuaki Hiraga commented on LUCENE-9123: {quote} Also we need to add some tests to

[jira] [Commented] (LUCENE-9123) JapaneseTokenizer with search mode doesn't work with SynonymGraphFilter

2020-01-17 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17018470#comment-17018470 ] Kazuaki Hiraga commented on LUCENE-9123: {quote} I thought the change in the behavior has very

[jira] [Comment Edited] (LUCENE-9123) JapaneseTokenizer with search mode doesn't work with SynonymGraphFilter

2020-01-17 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17018159#comment-17018159 ] Kazuaki Hiraga edited comment on LUCENE-9123 at 1/17/20 5:56 PM: -

[jira] [Commented] (LUCENE-9123) JapaneseTokenizer with search mode doesn't work with SynonymGraphFilter

2020-01-17 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17018207#comment-17018207 ] Kazuaki Hiraga commented on LUCENE-9123: [~tomoko], Hm.. it sounds tricky and difficulty to draw

[jira] [Commented] (LUCENE-9123) JapaneseTokenizer with search mode doesn't work with SynonymGraphFilter

2020-01-17 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17018159#comment-17018159 ] Kazuaki Hiraga commented on LUCENE-9123: {quote} This solution would fix Kuromoji to create a

[jira] [Commented] (LUCENE-9123) JapaneseTokenizer with search mode doesn't work with SynonymGraphFilter

2020-01-14 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17015612#comment-17015612 ] Kazuaki Hiraga commented on LUCENE-9123: Hello [~tomoko], Please find an attached file that is

[jira] [Updated] (LUCENE-9123) JapaneseTokenizer with search mode doesn't work with SynonymGraphFilter

2020-01-14 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Hiraga updated LUCENE-9123: --- Attachment: LUCENE-9123_revised.patch > JapaneseTokenizer with search mode doesn't work

[jira] [Commented] (LUCENE-9123) JapaneseTokenizer with search mode doesn't work with SynonymGraphFilter

2020-01-13 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014456#comment-17014456 ] Kazuaki Hiraga commented on LUCENE-9123: [~tomoko] Thank you for your reply! You may be right

[jira] [Comment Edited] (LUCENE-9123) JapaneseTokenizer with search mode doesn't work with SynonymGraphFilter

2020-01-08 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011480#comment-17011480 ] Kazuaki Hiraga edited comment on LUCENE-9123 at 1/9/20 6:47 AM: If we

[jira] [Commented] (LUCENE-9123) JapaneseTokenizer with search mode doesn't work with SynonymGraphFilter

2020-01-08 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17011480#comment-17011480 ] Kazuaki Hiraga commented on LUCENE-9123: If we can remove `composed token` from output, it

[jira] [Updated] (LUCENE-9123) JapaneseTokenizer with search mode doesn't work with SynonymGraphFilter

2020-01-08 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kazuaki Hiraga updated LUCENE-9123: --- Attachment: LUCENE-9123.patch > JapaneseTokenizer with search mode doesn't work with

[jira] [Created] (LUCENE-9123) JapaneseTokenizer with search mode doesn't work with SynonymGraphFilter

2020-01-08 Thread Kazuaki Hiraga (Jira)
Kazuaki Hiraga created LUCENE-9123: -- Summary: JapaneseTokenizer with search mode doesn't work with SynonymGraphFilter Key: LUCENE-9123 URL: https://issues.apache.org/jira/browse/LUCENE-9123 Project:

[jira] [Commented] (LUCENE-9100) JapaneseTokenizer produces inconsistent tokens

2019-12-19 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000568#comment-17000568 ] Kazuaki Hiraga commented on LUCENE-9100: [~elbek@gmail.com] OK. Now I understood why I was

[jira] [Commented] (LUCENE-9100) JapaneseTokenizer produces inconsistent tokens

2019-12-18 Thread Kazuaki Hiraga (Jira)
[ https://issues.apache.org/jira/browse/LUCENE-9100?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999688#comment-16999688 ] Kazuaki Hiraga commented on LUCENE-9100: {quote}not we use our own dictionary and connection