[
https://issues.apache.org/jira/browse/DRILL-2220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14326395#comment-14326395
]
Ramana Inukonda Nagaraj commented on DRILL-2220:
------------------------------------------------
After a little more investigation looks like its the decimal columns are
failing with this issue
output of parquet-tools meta
DECIMAL9_col: OPTIONAL FIXED_LEN_BYTE_ARRAY O:DECIMAL R:0 D:1
DECIMAL28SPARSE_col: OPTIONAL FIXED_LEN_BYTE_ARRAY O:DECIMAL R:0 D:1
DECIMAL38SPARSE_col: OPTIONAL FIXED_LEN_BYTE_ARRAY O:DECIMAL R:0 D:1
These columns fail with this error as they are stored as FIXED_LEN_BYTE_ARRAY
in parquet. Might need to bump up priority since this means one of our
important datatypes decimal is unreadable by the complex reader.
> Complex reader unable to read FIXED_LEN_BYTE_ARRAY types in parquet file
> ------------------------------------------------------------------------
>
> Key: DRILL-2220
> URL: https://issues.apache.org/jira/browse/DRILL-2220
> Project: Apache Drill
> Issue Type: Bug
> Components: Storage - Parquet
> Reporter: Ramana Inukonda Nagaraj
> Assignee: Steven Phillips
> Attachments: parquetAllScalarTypes.q, parquet_all_types.parquet
>
>
> File created using Create table as having all types.
> File can be read fine using normal scalar parquet reader.
> Switching to the complex reader results in
> Query failed: RemoteRpcException: Failure while running fragment.,
> Unsupported type: FIXED_LEN_BYTE_ARRAY [ bb9b5e4d-185c-40f9-998d-c32740273bf7
> on 10.10.30.167:31010 ]
> [ bb9b5e4d-185c-40f9-998d-c32740273bf7 on 10.10.30.167:31010 ]
> Attached are the source parquet files and the query file.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
