[
https://issues.apache.org/jira/browse/ORC-1146?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
William Hyun closed ORC-1146.
-----------------------------
> Float category missing check if the statistic sum is a finite value
> -------------------------------------------------------------------
>
> Key: ORC-1146
> URL: https://issues.apache.org/jira/browse/ORC-1146
> Project: ORC
> Issue Type: Bug
> Components: Java
> Affects Versions: 1.7.3
> Reporter: Yiqun Zhang
> Assignee: Yiqun Zhang
> Priority: Major
> Fix For: 1.7.4, 1.6.14
>
>
> [https://github.com/apache/orc/blob/70c504cbd759342476d2fb2c9cc75a5025cb7c11/java/core/src/java/org/apache/orc/impl/RecordReaderImpl.java#L696-L703]
> {code:java}
> } else if (category == TypeDescription.Category.DOUBLE) {
> DoubleColumnStatistics dstas = (DoubleColumnStatistics) cs;
> if (!Double.isFinite(dstas.getSum())) {
> LOG.debug("Not using predication pushdown on {} because stats contain
> NaN values",
> predicate.getColumnName());
> return dstas.hasNull() ? TruthValue.YES_NO_NULL : TruthValue.YES_NO;
> }
> }
> {code}
> Currently only the Double category is checked. the Float category is also
> only pushed down if the statistics sum to a finite value.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)
