[
https://issues.apache.org/jira/browse/ARROW-785?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15967700#comment-15967700
]
Phillip Cloud commented on ARROW-785:
-------------------------------------
I'm not sure if there's still a possible issue here. When using drill, if I
cast the {{WORD}} column to {{varchar}} then the data look fine. When left as
{{binary}} the values are unintelligible:
{code}
0: jdbc:drill:zk=local> select `YEAR`, cast(`WORD` as varchar) as `WORD` from
dfs.`/home/phillip/code/cpp/arrow/python/arrow_parquet.parquet`;
+-------+---------+
| YEAR | WORD |
+-------+---------+
| 2017 | Word 1 |
| 2018 | Word 2 |
+-------+---------+
{code}
> possible issue on writing parquet via pyarrow, subsequently read in Hive
> ------------------------------------------------------------------------
>
> Key: ARROW-785
> URL: https://issues.apache.org/jira/browse/ARROW-785
> Project: Apache Arrow
> Issue Type: Bug
> Reporter: Jeff Reback
> Priority: Minor
> Fix For: 0.3.0
>
>
> details here:
> http://stackoverflow.com/questions/43268872/parquet-creation-conversion-from-pandas-dataframe-to-pyarrow-table-not-working-f
> This round trips in pandas->parquet->pandas just fine on released pandas
> (0.19.2) and pyarrow (0.2).
> OP stats that it is not readable in Hive however.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
