[jira] [Created] (ORC-1146) Float category does not check if the statistic sum is a finite value

[Yiqun Zhang (Jira)]

Yiqun Zhang created ORC-1146:
--------------------------------

             Summary: Float category does not check if the statistic sum is a 
finite value
                 Key: ORC-1146
                 URL: https://issues.apache.org/jira/browse/ORC-1146
             Project: ORC
          Issue Type: Bug
          Components: Java
    Affects Versions: 1.7.3
            Reporter: Yiqun Zhang


[https://github.com/apache/orc/blob/70c504cbd759342476d2fb2c9cc75a5025cb7c11/java/core/src/java/org/apache/orc/impl/RecordReaderImpl.java#L696-L703]
{code:java}
} else if (category == TypeDescription.Category.DOUBLE) { 
   DoubleColumnStatistics dstas = (DoubleColumnStatistics) cs; 
   if (!Double.isFinite(dstas.getSum())) { 
     LOG.debug("Not using predication pushdown on {} because stats contain NaN 
values", 
             predicate.getColumnName()); 
     return dstas.hasNull() ? TruthValue.YES_NO_NULL : TruthValue.YES_NO; 
   } 
 } 
{code}
Currently only the Double category is checked. the Float category is also only 
pushed down if the statistics sum to a finite value.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)