[
https://issues.apache.org/jira/browse/ORC-980?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Dongjoon Hyun resolved ORC-980.
-------------------------------
Fix Version/s: 1.8.0
1.7.0
Resolution: Fixed
This is resolved via https://github.com/apache/orc/pull/893
> Filter processing ignores the schema case-sensitivity flag
> ----------------------------------------------------------
>
> Key: ORC-980
> URL: https://issues.apache.org/jira/browse/ORC-980
> Project: ORC
> Issue Type: Bug
> Components: Java
> Affects Versions: 1.7.0, 1.8.0
> Reporter: Pavan Lanka
> Assignee: Pavan Lanka
> Priority: Blocker
> Fix For: 1.7.0, 1.8.0
>
>
> The current SArg to Filter Conversion ignores the case-sensitivity setting
> during read and always perform case-sensitive search of fields even when
> asked to perform case-insensitive match using
> {quote}options()
> .searchArgument(sarg{color:#cc7832}, new {color}String[]
> {{color:#6a8759}"RIDX"{color}})
> .allowSARGToFilter({color:#cc7832}true{color})
> .isSchemaEvolutionCaseAware({color:#cc7832}false{color}){quote}
> leading to the following exceptions that the field is not found in the schema
> {quote}java.lang.IllegalArgumentException: Field RIDX not found in
> struct<f1:bigint,f2:decimal(20,6),f3:bigint,f4:string,ridx:bigint>
> at org.apache.orc.impl.ParserUtils.findColumn(ParserUtils.java:399)
> at org.apache.orc.impl.ParserUtils.findColumn(ParserUtils.java:337)
> at org.apache.orc.impl.ParserUtils.findSubtype(ParserUtils.java:285)
> at org.apache.orc.TypeDescription.findSubtype(TypeDescription.java:820)
> at org.apache.orc.TypeDescription.findSubtype(TypeDescription.java:814)
> at
> org.apache.orc.impl.filter.leaf.LeafFilterFactory.createLeafVectorFilter(LeafFilterFactory.java:230)
> at
> org.apache.orc.impl.filter.FilterFactory.createSArgFilter(FilterFactory.java:123)
> at
> org.apache.orc.impl.filter.FilterFactory.createBatchFilter(FilterFactory.java:63)
> at org.apache.orc.impl.RecordReaderImpl.<init>(RecordReaderImpl.java:284)
> {quote}
> SArg to Filter conversion should respect the case-sensitivity option as
> supplied by the reader.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
