[jira] [Commented] (SOLR-5800) Admin UI - Analysis form doesn't render results correctly when a CharFilter is used.
[ https://issues.apache.org/jira/browse/SOLR-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13937968#comment-13937968 ] ASF subversion and git services commented on SOLR-5800: --- Commit 1578444 from [~steffkes] in branch 'dev/branches/lucene_solr_4_7' [ https://svn.apache.org/r1578444 ] SOLR-5800: Admin UI - Analysis form doesn't render results correctly when a CharFilter is used (merge r1576652) Admin UI - Analysis form doesn't render results correctly when a CharFilter is used. Key: SOLR-5800 URL: https://issues.apache.org/jira/browse/SOLR-5800 Project: Solr Issue Type: Bug Components: web gui Affects Versions: 4.7 Reporter: Timothy Potter Assignee: Stefan Matheis (steffkes) Priority: Minor Fix For: 4.8, 5.0, 4.7.1 Attachments: SOLR-5800-sample.json, SOLR-5800.patch I have an example in Solr In Action that uses the PatternReplaceCharFilterFactory and now it doesn't work in 4.7.0. Specifically, the fieldType is: fieldType name=text_microblog class=solr.TextField positionIncrementGap=100 analyzer charFilter class=solr.PatternReplaceCharFilterFactory pattern=([a-zA-Z])\1+ replacement=$1$1/ tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.WordDelimiterFilterFactory generateWordParts=1 splitOnCaseChange=0 splitOnNumerics=0 stemEnglishPossessive=1 preserveOriginal=0 catenateWords=1 generateNumberParts=1 catenateNumbers=0 catenateAll=0 types=wdfftypes.txt/ filter class=solr.StopFilterFactory ignoreCase=true words=lang/stopwords_en.txt / filter class=solr.LowerCaseFilterFactory/ filter class=solr.ASCIIFoldingFilterFactory/ filter class=solr.KStemFilterFactory/ /analyzer /fieldType The PatternReplaceCharFilterFactory (PRCF) is used to collapse repeated letters in a term down to a max of 2, such as #yu would be #yumm When I run some text through this analyzer using the Analysis form, the output is as if the resulting text is unavailable to the tokenizer. In other words, the only results being displayed in the output on the form is for the PRCF This example stopped working in 4.7.0 and I've verified it worked correctly in 4.6.1. Initially, I thought this might be an issue with the actual analysis, but the analyzer actually works when indexing / querying. Then, looking at the JSON response in the Developer console with Chrome, I see the JSON that comes back includes output for all the components in my chain (see below) ... so looks like a UI rendering issue to me? {responseHeader:{status:0,QTime:24},analysis:{field_types:{text_microblog:{index:[org.apache.lucene.analysis.pattern.PatternReplaceCharFilter,#Yumm :) Drinking a latte at Caffe Grecco in SF's historic North Beach... Learning text analysis with #SolrInAction by @ManningBooks on my i-Pad foo5,org.apache.lucene.analysis.core.WhitespaceTokenizer,[{text:#Yumm,raw_bytes:[23 59 75 6d 6d],start:0,end:6,position:1,positionHistory:[1],type:word},{text::),raw_bytes:[3a 29],start:7,end:9,position:2,positionHistory:[2],type:word},{text:Drinking,raw_bytes:[44 72 69 6e 6b 69 6e 67],start:10,end:18,position:3,positionHistory:[3],type:word},{text:a,raw_bytes:[61],start:19,end:20,position:4,positionHistory:[4],type:word},{text:latte,raw_bytes:[6c ... the JSON returned to the browser has evidence that the full analysis chain was applied, so this seems to just be a rendering issue. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5800) Admin UI - Analysis form doesn't render results correctly when a CharFilter is used.
[ https://issues.apache.org/jira/browse/SOLR-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13938437#comment-13938437 ] ASF subversion and git services commented on SOLR-5800: --- Commit 1578617 from [~steffkes] in branch 'dev/branches/lucene_solr_4_7' [ https://svn.apache.org/r1578617 ] SOLR-5800, SOLR-5870: fix changes entry on lucene_solr_4_7 Admin UI - Analysis form doesn't render results correctly when a CharFilter is used. Key: SOLR-5800 URL: https://issues.apache.org/jira/browse/SOLR-5800 Project: Solr Issue Type: Bug Components: web gui Affects Versions: 4.7 Reporter: Timothy Potter Assignee: Stefan Matheis (steffkes) Priority: Minor Fix For: 4.8, 5.0, 4.7.1 Attachments: SOLR-5800-sample.json, SOLR-5800.patch I have an example in Solr In Action that uses the PatternReplaceCharFilterFactory and now it doesn't work in 4.7.0. Specifically, the fieldType is: fieldType name=text_microblog class=solr.TextField positionIncrementGap=100 analyzer charFilter class=solr.PatternReplaceCharFilterFactory pattern=([a-zA-Z])\1+ replacement=$1$1/ tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.WordDelimiterFilterFactory generateWordParts=1 splitOnCaseChange=0 splitOnNumerics=0 stemEnglishPossessive=1 preserveOriginal=0 catenateWords=1 generateNumberParts=1 catenateNumbers=0 catenateAll=0 types=wdfftypes.txt/ filter class=solr.StopFilterFactory ignoreCase=true words=lang/stopwords_en.txt / filter class=solr.LowerCaseFilterFactory/ filter class=solr.ASCIIFoldingFilterFactory/ filter class=solr.KStemFilterFactory/ /analyzer /fieldType The PatternReplaceCharFilterFactory (PRCF) is used to collapse repeated letters in a term down to a max of 2, such as #yu would be #yumm When I run some text through this analyzer using the Analysis form, the output is as if the resulting text is unavailable to the tokenizer. In other words, the only results being displayed in the output on the form is for the PRCF This example stopped working in 4.7.0 and I've verified it worked correctly in 4.6.1. Initially, I thought this might be an issue with the actual analysis, but the analyzer actually works when indexing / querying. Then, looking at the JSON response in the Developer console with Chrome, I see the JSON that comes back includes output for all the components in my chain (see below) ... so looks like a UI rendering issue to me? {responseHeader:{status:0,QTime:24},analysis:{field_types:{text_microblog:{index:[org.apache.lucene.analysis.pattern.PatternReplaceCharFilter,#Yumm :) Drinking a latte at Caffe Grecco in SF's historic North Beach... Learning text analysis with #SolrInAction by @ManningBooks on my i-Pad foo5,org.apache.lucene.analysis.core.WhitespaceTokenizer,[{text:#Yumm,raw_bytes:[23 59 75 6d 6d],start:0,end:6,position:1,positionHistory:[1],type:word},{text::),raw_bytes:[3a 29],start:7,end:9,position:2,positionHistory:[2],type:word},{text:Drinking,raw_bytes:[44 72 69 6e 6b 69 6e 67],start:10,end:18,position:3,positionHistory:[3],type:word},{text:a,raw_bytes:[61],start:19,end:20,position:4,positionHistory:[4],type:word},{text:latte,raw_bytes:[6c ... the JSON returned to the browser has evidence that the full analysis chain was applied, so this seems to just be a rendering issue. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5800) Admin UI - Analysis form doesn't render results correctly when a CharFilter is used.
[ https://issues.apache.org/jira/browse/SOLR-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13931555#comment-13931555 ] ASF subversion and git services commented on SOLR-5800: --- Commit 1576652 from [~steffkes] in branch 'dev/trunk' [ https://svn.apache.org/r1576652 ] SOLR-5800: Admin UI - Analysis form doesn't render results correctly when a CharFilter is used Admin UI - Analysis form doesn't render results correctly when a CharFilter is used. Key: SOLR-5800 URL: https://issues.apache.org/jira/browse/SOLR-5800 Project: Solr Issue Type: Bug Components: web gui Affects Versions: 4.7 Reporter: Timothy Potter Assignee: Stefan Matheis (steffkes) Priority: Minor Fix For: 4.8, 5.0 Attachments: SOLR-5800-sample.json, SOLR-5800.patch I have an example in Solr In Action that uses the PatternReplaceCharFilterFactory and now it doesn't work in 4.7.0. Specifically, the fieldType is: fieldType name=text_microblog class=solr.TextField positionIncrementGap=100 analyzer charFilter class=solr.PatternReplaceCharFilterFactory pattern=([a-zA-Z])\1+ replacement=$1$1/ tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.WordDelimiterFilterFactory generateWordParts=1 splitOnCaseChange=0 splitOnNumerics=0 stemEnglishPossessive=1 preserveOriginal=0 catenateWords=1 generateNumberParts=1 catenateNumbers=0 catenateAll=0 types=wdfftypes.txt/ filter class=solr.StopFilterFactory ignoreCase=true words=lang/stopwords_en.txt / filter class=solr.LowerCaseFilterFactory/ filter class=solr.ASCIIFoldingFilterFactory/ filter class=solr.KStemFilterFactory/ /analyzer /fieldType The PatternReplaceCharFilterFactory (PRCF) is used to collapse repeated letters in a term down to a max of 2, such as #yu would be #yumm When I run some text through this analyzer using the Analysis form, the output is as if the resulting text is unavailable to the tokenizer. In other words, the only results being displayed in the output on the form is for the PRCF This example stopped working in 4.7.0 and I've verified it worked correctly in 4.6.1. Initially, I thought this might be an issue with the actual analysis, but the analyzer actually works when indexing / querying. Then, looking at the JSON response in the Developer console with Chrome, I see the JSON that comes back includes output for all the components in my chain (see below) ... so looks like a UI rendering issue to me? {responseHeader:{status:0,QTime:24},analysis:{field_types:{text_microblog:{index:[org.apache.lucene.analysis.pattern.PatternReplaceCharFilter,#Yumm :) Drinking a latte at Caffe Grecco in SF's historic North Beach... Learning text analysis with #SolrInAction by @ManningBooks on my i-Pad foo5,org.apache.lucene.analysis.core.WhitespaceTokenizer,[{text:#Yumm,raw_bytes:[23 59 75 6d 6d],start:0,end:6,position:1,positionHistory:[1],type:word},{text::),raw_bytes:[3a 29],start:7,end:9,position:2,positionHistory:[2],type:word},{text:Drinking,raw_bytes:[44 72 69 6e 6b 69 6e 67],start:10,end:18,position:3,positionHistory:[3],type:word},{text:a,raw_bytes:[61],start:19,end:20,position:4,positionHistory:[4],type:word},{text:latte,raw_bytes:[6c ... the JSON returned to the browser has evidence that the full analysis chain was applied, so this seems to just be a rendering issue. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5800) Admin UI - Analysis form doesn't render results correctly when a CharFilter is used.
[ https://issues.apache.org/jira/browse/SOLR-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13931575#comment-13931575 ] ASF subversion and git services commented on SOLR-5800: --- Commit 1576671 from [~steffkes] in branch 'dev/branches/branch_4x' [ https://svn.apache.org/r1576671 ] SOLR-5800: Admin UI - Analysis form doesn't render results correctly when a CharFilter is used (merge r1576652) Admin UI - Analysis form doesn't render results correctly when a CharFilter is used. Key: SOLR-5800 URL: https://issues.apache.org/jira/browse/SOLR-5800 Project: Solr Issue Type: Bug Components: web gui Affects Versions: 4.7 Reporter: Timothy Potter Assignee: Stefan Matheis (steffkes) Priority: Minor Fix For: 4.8, 5.0 Attachments: SOLR-5800-sample.json, SOLR-5800.patch I have an example in Solr In Action that uses the PatternReplaceCharFilterFactory and now it doesn't work in 4.7.0. Specifically, the fieldType is: fieldType name=text_microblog class=solr.TextField positionIncrementGap=100 analyzer charFilter class=solr.PatternReplaceCharFilterFactory pattern=([a-zA-Z])\1+ replacement=$1$1/ tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.WordDelimiterFilterFactory generateWordParts=1 splitOnCaseChange=0 splitOnNumerics=0 stemEnglishPossessive=1 preserveOriginal=0 catenateWords=1 generateNumberParts=1 catenateNumbers=0 catenateAll=0 types=wdfftypes.txt/ filter class=solr.StopFilterFactory ignoreCase=true words=lang/stopwords_en.txt / filter class=solr.LowerCaseFilterFactory/ filter class=solr.ASCIIFoldingFilterFactory/ filter class=solr.KStemFilterFactory/ /analyzer /fieldType The PatternReplaceCharFilterFactory (PRCF) is used to collapse repeated letters in a term down to a max of 2, such as #yu would be #yumm When I run some text through this analyzer using the Analysis form, the output is as if the resulting text is unavailable to the tokenizer. In other words, the only results being displayed in the output on the form is for the PRCF This example stopped working in 4.7.0 and I've verified it worked correctly in 4.6.1. Initially, I thought this might be an issue with the actual analysis, but the analyzer actually works when indexing / querying. Then, looking at the JSON response in the Developer console with Chrome, I see the JSON that comes back includes output for all the components in my chain (see below) ... so looks like a UI rendering issue to me? {responseHeader:{status:0,QTime:24},analysis:{field_types:{text_microblog:{index:[org.apache.lucene.analysis.pattern.PatternReplaceCharFilter,#Yumm :) Drinking a latte at Caffe Grecco in SF's historic North Beach... Learning text analysis with #SolrInAction by @ManningBooks on my i-Pad foo5,org.apache.lucene.analysis.core.WhitespaceTokenizer,[{text:#Yumm,raw_bytes:[23 59 75 6d 6d],start:0,end:6,position:1,positionHistory:[1],type:word},{text::),raw_bytes:[3a 29],start:7,end:9,position:2,positionHistory:[2],type:word},{text:Drinking,raw_bytes:[44 72 69 6e 6b 69 6e 67],start:10,end:18,position:3,positionHistory:[3],type:word},{text:a,raw_bytes:[61],start:19,end:20,position:4,positionHistory:[4],type:word},{text:latte,raw_bytes:[6c ... the JSON returned to the browser has evidence that the full analysis chain was applied, so this seems to just be a rendering issue. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5800) Admin UI - Analysis form doesn't render results correctly when a CharFilter is used.
[ https://issues.apache.org/jira/browse/SOLR-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13931586#comment-13931586 ] Stefan Matheis (steffkes) commented on SOLR-5800: - Hey Doug, that depends a bit - 'the next available release' i'd say, might be 4.7.1 if it's needed otherwise it would be 4.8 Admin UI - Analysis form doesn't render results correctly when a CharFilter is used. Key: SOLR-5800 URL: https://issues.apache.org/jira/browse/SOLR-5800 Project: Solr Issue Type: Bug Components: web gui Affects Versions: 4.7 Reporter: Timothy Potter Assignee: Stefan Matheis (steffkes) Priority: Minor Fix For: 4.8, 5.0 Attachments: SOLR-5800-sample.json, SOLR-5800.patch I have an example in Solr In Action that uses the PatternReplaceCharFilterFactory and now it doesn't work in 4.7.0. Specifically, the fieldType is: fieldType name=text_microblog class=solr.TextField positionIncrementGap=100 analyzer charFilter class=solr.PatternReplaceCharFilterFactory pattern=([a-zA-Z])\1+ replacement=$1$1/ tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.WordDelimiterFilterFactory generateWordParts=1 splitOnCaseChange=0 splitOnNumerics=0 stemEnglishPossessive=1 preserveOriginal=0 catenateWords=1 generateNumberParts=1 catenateNumbers=0 catenateAll=0 types=wdfftypes.txt/ filter class=solr.StopFilterFactory ignoreCase=true words=lang/stopwords_en.txt / filter class=solr.LowerCaseFilterFactory/ filter class=solr.ASCIIFoldingFilterFactory/ filter class=solr.KStemFilterFactory/ /analyzer /fieldType The PatternReplaceCharFilterFactory (PRCF) is used to collapse repeated letters in a term down to a max of 2, such as #yu would be #yumm When I run some text through this analyzer using the Analysis form, the output is as if the resulting text is unavailable to the tokenizer. In other words, the only results being displayed in the output on the form is for the PRCF This example stopped working in 4.7.0 and I've verified it worked correctly in 4.6.1. Initially, I thought this might be an issue with the actual analysis, but the analyzer actually works when indexing / querying. Then, looking at the JSON response in the Developer console with Chrome, I see the JSON that comes back includes output for all the components in my chain (see below) ... so looks like a UI rendering issue to me? {responseHeader:{status:0,QTime:24},analysis:{field_types:{text_microblog:{index:[org.apache.lucene.analysis.pattern.PatternReplaceCharFilter,#Yumm :) Drinking a latte at Caffe Grecco in SF's historic North Beach... Learning text analysis with #SolrInAction by @ManningBooks on my i-Pad foo5,org.apache.lucene.analysis.core.WhitespaceTokenizer,[{text:#Yumm,raw_bytes:[23 59 75 6d 6d],start:0,end:6,position:1,positionHistory:[1],type:word},{text::),raw_bytes:[3a 29],start:7,end:9,position:2,positionHistory:[2],type:word},{text:Drinking,raw_bytes:[44 72 69 6e 6b 69 6e 67],start:10,end:18,position:3,positionHistory:[3],type:word},{text:a,raw_bytes:[61],start:19,end:20,position:4,positionHistory:[4],type:word},{text:latte,raw_bytes:[6c ... the JSON returned to the browser has evidence that the full analysis chain was applied, so this seems to just be a rendering issue. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5800) Admin UI - Analysis form doesn't render results correctly when a CharFilter is used.
[ https://issues.apache.org/jira/browse/SOLR-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13931319#comment-13931319 ] Doug Turnbull commented on SOLR-5800: - Thanks for the patch Stefan. Will this be released in a Solr 4.7.1? This is a fairly major issue for folks that depend on the analysis UI. Admin UI - Analysis form doesn't render results correctly when a CharFilter is used. Key: SOLR-5800 URL: https://issues.apache.org/jira/browse/SOLR-5800 Project: Solr Issue Type: Bug Components: web gui Affects Versions: 4.7 Reporter: Timothy Potter Assignee: Stefan Matheis (steffkes) Priority: Minor Fix For: 4.8, 5.0 Attachments: SOLR-5800-sample.json, SOLR-5800.patch I have an example in Solr In Action that uses the PatternReplaceCharFilterFactory and now it doesn't work in 4.7.0. Specifically, the fieldType is: fieldType name=text_microblog class=solr.TextField positionIncrementGap=100 analyzer charFilter class=solr.PatternReplaceCharFilterFactory pattern=([a-zA-Z])\1+ replacement=$1$1/ tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.WordDelimiterFilterFactory generateWordParts=1 splitOnCaseChange=0 splitOnNumerics=0 stemEnglishPossessive=1 preserveOriginal=0 catenateWords=1 generateNumberParts=1 catenateNumbers=0 catenateAll=0 types=wdfftypes.txt/ filter class=solr.StopFilterFactory ignoreCase=true words=lang/stopwords_en.txt / filter class=solr.LowerCaseFilterFactory/ filter class=solr.ASCIIFoldingFilterFactory/ filter class=solr.KStemFilterFactory/ /analyzer /fieldType The PatternReplaceCharFilterFactory (PRCF) is used to collapse repeated letters in a term down to a max of 2, such as #yu would be #yumm When I run some text through this analyzer using the Analysis form, the output is as if the resulting text is unavailable to the tokenizer. In other words, the only results being displayed in the output on the form is for the PRCF This example stopped working in 4.7.0 and I've verified it worked correctly in 4.6.1. Initially, I thought this might be an issue with the actual analysis, but the analyzer actually works when indexing / querying. Then, looking at the JSON response in the Developer console with Chrome, I see the JSON that comes back includes output for all the components in my chain (see below) ... so looks like a UI rendering issue to me? {responseHeader:{status:0,QTime:24},analysis:{field_types:{text_microblog:{index:[org.apache.lucene.analysis.pattern.PatternReplaceCharFilter,#Yumm :) Drinking a latte at Caffe Grecco in SF's historic North Beach... Learning text analysis with #SolrInAction by @ManningBooks on my i-Pad foo5,org.apache.lucene.analysis.core.WhitespaceTokenizer,[{text:#Yumm,raw_bytes:[23 59 75 6d 6d],start:0,end:6,position:1,positionHistory:[1],type:word},{text::),raw_bytes:[3a 29],start:7,end:9,position:2,positionHistory:[2],type:word},{text:Drinking,raw_bytes:[44 72 69 6e 6b 69 6e 67],start:10,end:18,position:3,positionHistory:[3],type:word},{text:a,raw_bytes:[61],start:19,end:20,position:4,positionHistory:[4],type:word},{text:latte,raw_bytes:[6c ... the JSON returned to the browser has evidence that the full analysis chain was applied, so this seems to just be a rendering issue. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5800) Admin UI - Analysis form doesn't render results correctly when a CharFilter is used.
[ https://issues.apache.org/jira/browse/SOLR-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13925890#comment-13925890 ] Stefan Matheis (steffkes) commented on SOLR-5800: - [~tim.potter] did you have a chance? otherwise i would commit that one tomorrow Admin UI - Analysis form doesn't render results correctly when a CharFilter is used. Key: SOLR-5800 URL: https://issues.apache.org/jira/browse/SOLR-5800 Project: Solr Issue Type: Bug Components: web gui Affects Versions: 4.7 Reporter: Timothy Potter Assignee: Stefan Matheis (steffkes) Priority: Minor Fix For: 4.8, 5.0 Attachments: SOLR-5800-sample.json, SOLR-5800.patch I have an example in Solr In Action that uses the PatternReplaceCharFilterFactory and now it doesn't work in 4.7.0. Specifically, the fieldType is: fieldType name=text_microblog class=solr.TextField positionIncrementGap=100 analyzer charFilter class=solr.PatternReplaceCharFilterFactory pattern=([a-zA-Z])\1+ replacement=$1$1/ tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.WordDelimiterFilterFactory generateWordParts=1 splitOnCaseChange=0 splitOnNumerics=0 stemEnglishPossessive=1 preserveOriginal=0 catenateWords=1 generateNumberParts=1 catenateNumbers=0 catenateAll=0 types=wdfftypes.txt/ filter class=solr.StopFilterFactory ignoreCase=true words=lang/stopwords_en.txt / filter class=solr.LowerCaseFilterFactory/ filter class=solr.ASCIIFoldingFilterFactory/ filter class=solr.KStemFilterFactory/ /analyzer /fieldType The PatternReplaceCharFilterFactory (PRCF) is used to collapse repeated letters in a term down to a max of 2, such as #yu would be #yumm When I run some text through this analyzer using the Analysis form, the output is as if the resulting text is unavailable to the tokenizer. In other words, the only results being displayed in the output on the form is for the PRCF This example stopped working in 4.7.0 and I've verified it worked correctly in 4.6.1. Initially, I thought this might be an issue with the actual analysis, but the analyzer actually works when indexing / querying. Then, looking at the JSON response in the Developer console with Chrome, I see the JSON that comes back includes output for all the components in my chain (see below) ... so looks like a UI rendering issue to me? {responseHeader:{status:0,QTime:24},analysis:{field_types:{text_microblog:{index:[org.apache.lucene.analysis.pattern.PatternReplaceCharFilter,#Yumm :) Drinking a latte at Caffe Grecco in SF's historic North Beach... Learning text analysis with #SolrInAction by @ManningBooks on my i-Pad foo5,org.apache.lucene.analysis.core.WhitespaceTokenizer,[{text:#Yumm,raw_bytes:[23 59 75 6d 6d],start:0,end:6,position:1,positionHistory:[1],type:word},{text::),raw_bytes:[3a 29],start:7,end:9,position:2,positionHistory:[2],type:word},{text:Drinking,raw_bytes:[44 72 69 6e 6b 69 6e 67],start:10,end:18,position:3,positionHistory:[3],type:word},{text:a,raw_bytes:[61],start:19,end:20,position:4,positionHistory:[4],type:word},{text:latte,raw_bytes:[6c ... the JSON returned to the browser has evidence that the full analysis chain was applied, so this seems to just be a rendering issue. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org
[jira] [Commented] (SOLR-5800) Admin UI - Analysis form doesn't render results correctly when a CharFilter is used.
[ https://issues.apache.org/jira/browse/SOLR-5800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13917795#comment-13917795 ] Hossein Taghi-Zadeh commented on SOLR-5800: --- [~steffkes], It works for me. Thanks. Admin UI - Analysis form doesn't render results correctly when a CharFilter is used. Key: SOLR-5800 URL: https://issues.apache.org/jira/browse/SOLR-5800 Project: Solr Issue Type: Bug Components: web gui Affects Versions: 4.7 Reporter: Timothy Potter Assignee: Stefan Matheis (steffkes) Priority: Minor Fix For: 4.8, 5.0 Attachments: SOLR-5800-sample.json, SOLR-5800.patch I have an example in Solr In Action that uses the PatternReplaceCharFilterFactory and now it doesn't work in 4.7.0. Specifically, the fieldType is: fieldType name=text_microblog class=solr.TextField positionIncrementGap=100 analyzer charFilter class=solr.PatternReplaceCharFilterFactory pattern=([a-zA-Z])\1+ replacement=$1$1/ tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.WordDelimiterFilterFactory generateWordParts=1 splitOnCaseChange=0 splitOnNumerics=0 stemEnglishPossessive=1 preserveOriginal=0 catenateWords=1 generateNumberParts=1 catenateNumbers=0 catenateAll=0 types=wdfftypes.txt/ filter class=solr.StopFilterFactory ignoreCase=true words=lang/stopwords_en.txt / filter class=solr.LowerCaseFilterFactory/ filter class=solr.ASCIIFoldingFilterFactory/ filter class=solr.KStemFilterFactory/ /analyzer /fieldType The PatternReplaceCharFilterFactory (PRCF) is used to collapse repeated letters in a term down to a max of 2, such as #yu would be #yumm When I run some text through this analyzer using the Analysis form, the output is as if the resulting text is unavailable to the tokenizer. In other words, the only results being displayed in the output on the form is for the PRCF This example stopped working in 4.7.0 and I've verified it worked correctly in 4.6.1. Initially, I thought this might be an issue with the actual analysis, but the analyzer actually works when indexing / querying. Then, looking at the JSON response in the Developer console with Chrome, I see the JSON that comes back includes output for all the components in my chain (see below) ... so looks like a UI rendering issue to me? {responseHeader:{status:0,QTime:24},analysis:{field_types:{text_microblog:{index:[org.apache.lucene.analysis.pattern.PatternReplaceCharFilter,#Yumm :) Drinking a latte at Caffe Grecco in SF's historic North Beach... Learning text analysis with #SolrInAction by @ManningBooks on my i-Pad foo5,org.apache.lucene.analysis.core.WhitespaceTokenizer,[{text:#Yumm,raw_bytes:[23 59 75 6d 6d],start:0,end:6,position:1,positionHistory:[1],type:word},{text::),raw_bytes:[3a 29],start:7,end:9,position:2,positionHistory:[2],type:word},{text:Drinking,raw_bytes:[44 72 69 6e 6b 69 6e 67],start:10,end:18,position:3,positionHistory:[3],type:word},{text:a,raw_bytes:[61],start:19,end:20,position:4,positionHistory:[4],type:word},{text:latte,raw_bytes:[6c ... the JSON returned to the browser has evidence that the full analysis chain was applied, so this seems to just be a rendering issue. -- This message was sent by Atlassian JIRA (v6.2#6252) - To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org