[jira] [Commented] (LUCENE-8450) Enable TokenFilters to assign offsets when splitting tokens

2018-08-20 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16586454#comment-16586454 ] Robert Muir commented on LUCENE-8450: - Look at worddelimiterfilter, it wants to use

[jira] [Commented] (LUCENE-8450) Enable TokenFilters to assign offsets when splitting tokens

2018-08-19 Thread Mike Sokolov (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16585134#comment-16585134 ] Mike Sokolov commented on LUCENE-8450: -- I was trying to think about how to make pro

[jira] [Commented] (LUCENE-8450) Enable TokenFilters to assign offsets when splitting tokens

2018-08-11 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577137#comment-16577137 ] Uwe Schindler commented on LUCENE-8450: --- bq. I'm hoping we can avoid situations wh

[jira] [Commented] (LUCENE-8450) Enable TokenFilters to assign offsets when splitting tokens

2018-08-10 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16577055#comment-16577055 ] Robert Muir commented on LUCENE-8450: - {quote} Actually that the real solution for t

[jira] [Commented] (LUCENE-8450) Enable TokenFilters to assign offsets when splitting tokens

2018-08-10 Thread Mike Sokolov (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16576828#comment-16576828 ] Mike Sokolov commented on LUCENE-8450: -- {quote}The fact of life here is, it seems y

[jira] [Commented] (LUCENE-8450) Enable TokenFilters to assign offsets when splitting tokens

2018-08-10 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16576805#comment-16576805 ] Robert Muir commented on LUCENE-8450: - {quotdine} I'm also reluctant to place WDF ea

[jira] [Commented] (LUCENE-8450) Enable TokenFilters to assign offsets when splitting tokens

2018-08-10 Thread Mike Sokolov (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16576798#comment-16576798 ] Mike Sokolov commented on LUCENE-8450: -- about Tokenizer/decompounder as a paired th

[jira] [Commented] (LUCENE-8450) Enable TokenFilters to assign offsets when splitting tokens

2018-08-10 Thread Uwe Schindler (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16576676#comment-16576676 ] Uwe Schindler commented on LUCENE-8450: --- bq. Separately I don't like the correctOf

[jira] [Commented] (LUCENE-8450) Enable TokenFilters to assign offsets when splitting tokens

2018-08-10 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16576633#comment-16576633 ] Robert Muir commented on LUCENE-8450: - {quote} To get the benefit, it's only really

[jira] [Commented] (LUCENE-8450) Enable TokenFilters to assign offsets when splitting tokens

2018-08-10 Thread Michael McCandless (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16576353#comment-16576353 ] Michael McCandless commented on LUCENE-8450: {quote}Separately I don't like

[jira] [Commented] (LUCENE-8450) Enable TokenFilters to assign offsets when splitting tokens

2018-08-09 Thread Mike Sokolov (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16574854#comment-16574854 ] Mike Sokolov commented on LUCENE-8450: -- This approach does not impose any requireme

[jira] [Commented] (LUCENE-8450) Enable TokenFilters to assign offsets when splitting tokens

2018-08-09 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16574825#comment-16574825 ] Robert Muir commented on LUCENE-8450: - I feel pretty strongly that we shouldn't go t

[jira] [Commented] (LUCENE-8450) Enable TokenFilters to assign offsets when splitting tokens

2018-08-09 Thread Mike Sokolov (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16574713#comment-16574713 ] Mike Sokolov commented on LUCENE-8450: -- {quote}I am sorry that some tokenfilters th

[jira] [Commented] (LUCENE-8450) Enable TokenFilters to assign offsets when splitting tokens

2018-08-09 Thread Robert Muir (JIRA)
[ https://issues.apache.org/jira/browse/LUCENE-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16574493#comment-16574493 ] Robert Muir commented on LUCENE-8450: - As mentioned on the mailing list, I don't thi