[
https://issues.apache.org/jira/browse/DRILL-6353?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16506822#comment-16506822
]
ASF GitHub Bot commented on DRILL-6353:
---------------------------------------
vrozov commented on a change in pull request #1259: DRILL-6353: Upgrade Parquet
MR dependencies
URL: https://github.com/apache/drill/pull/1259#discussion_r194214952
##########
File path:
exec/java-exec/src/test/java/org/apache/drill/exec/store/parquet/TestParquetMetadataCache.java
##########
@@ -737,6 +738,7 @@ public void testBooleanPartitionPruning() throws Exception
{
}
}
+ @Ignore
Review comment:
I attached the output of
`org.apache.parquet.format.converter.ParquetMetadataConverter` in the debug
mode to [DRILL-6353](https://issues.apache.org/jira/browse/DRILL-6353). As you
can see there is no statistics available for the `col_intrvl_day`:
```
{
"encodingStats" : null,
"dictionaryPageOffset" : 0,
"valueCount" : 6,
"totalSize" : 92,
"totalUncompressedSize" : 91,
"statistics" : {
"max" : null,
"min" : null,
"maxBytes" : null,
"minBytes" : null,
"empty" : true,
"numNulls" : -1,
"numNullsSet" : false
},
"firstDataPageOffset" : 532,
"type" : "FIXED_LEN_BYTE_ARRAY",
"path" : [ "col_intrvl_day" ],
"primitiveType" : {
"name" : "col_intrvl_day",
"repetition" : "OPTIONAL",
"originalType" : "INTERVAL",
"id" : null,
"primitive" : true,
"primitiveTypeName" : "FIXED_LEN_BYTE_ARRAY",
"decimalMetadata" : null,
"typeLength" : 12
},
"codec" : "SNAPPY",
"encodings" : [ "RLE", "BIT_PACKED", "PLAIN" ],
"startingPos" : 532
}
```
This is result of parquet fix for "Deprecate type-defined sort ordering for
INTERVAL
type"([PARQUET-1064](https://issues.apache.org/jira/browse/PARQUET-1064))
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
> Upgrade Parquet MR dependencies
> -------------------------------
>
> Key: DRILL-6353
> URL: https://issues.apache.org/jira/browse/DRILL-6353
> Project: Apache Drill
> Issue Type: Task
> Reporter: Vlad Rozov
> Assignee: Vlad Rozov
> Priority: Major
> Fix For: 1.14.0
>
> Attachments: alltypes_optional.json
>
>
> Upgrade from a custom build {{1.8.1-drill-r0}} to Apache release {{1.10.0}}.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
