[
https://issues.apache.org/jira/browse/SPARK-2446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14074942#comment-14074942
]
Michael Armbrust commented on SPARK-2446:
-----------------------------------------
Hi [~chutium], Thanks for reporting this. Compatibility with impala is
definitely something that I would like to support. I'm thinking it might be
better to do this as a configuration option instead of as a new argument to
parquetFile. Mostly because making the function signatures more complex is
going to add binary compatibility burdens down the road (we can't use default
parameters for public APIs). What do you think? Feel free to create a JIRA
for that if this works.
> Add BinaryType support to Parquet I/O.
> --------------------------------------
>
> Key: SPARK-2446
> URL: https://issues.apache.org/jira/browse/SPARK-2446
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: Takuya Ueshin
> Assignee: Takuya Ueshin
> Fix For: 1.1.0
>
>
> To support {{BinaryType}}, the following changes are needed:
> - Make {{StringType}} use {{OriginalType.UTF8}}
> - Add {{BinaryType}} using {{PrimitiveTypeName.BINARY}} without
> {{OriginalType}}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
