[jira] [Commented] (SPARK-27442) ParquetFileFormat fails to read column named with invalid characters

2022-01-17 Thread Pietro Cerutti (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17477632#comment-17477632 ] Pietro Cerutti commented on SPARK-27442: Using the Apache Arrow C++ API, see ht

[jira] [Commented] (SPARK-27442) ParquetFileFormat fails to read column named with invalid characters

2022-01-17 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17477493#comment-17477493 ] Hyukjin Kwon commented on SPARK-27442: -- I commented in the PR, see https://github.

[jira] [Commented] (SPARK-27442) ParquetFileFormat fails to read column named with invalid characters

2022-01-17 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17477122#comment-17477122 ] Apache Spark commented on SPARK-27442: -- User 'AngersZh' has created a pull requ

[jira] [Commented] (SPARK-27442) ParquetFileFormat fails to read column named with invalid characters

2022-01-17 Thread angerszhu (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17477089#comment-17477089 ] angerszhu commented on SPARK-27442: --- Yea, will try to fix this. > ParquetFileFormat f

[jira] [Commented] (SPARK-27442) ParquetFileFormat fails to read column named with invalid characters

2022-01-13 Thread Wenchen Fan (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17475894#comment-17475894 ] Wenchen Fan commented on SPARK-27442: - I think we should fix this. It's OK for Spark

[jira] [Commented] (SPARK-27442) ParquetFileFormat fails to read column named with invalid characters

2021-10-21 Thread Pietro Cerutti (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17432407#comment-17432407 ] Pietro Cerutti commented on SPARK-27442: +1 - we're hitting the same wall and we

[jira] [Commented] (SPARK-27442) ParquetFileFormat fails to read column named with invalid characters

2021-08-17 Thread Dror Speiser (Jira)
[ https://issues.apache.org/jira/browse/SPARK-27442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17400478#comment-17400478 ] Dror Speiser commented on SPARK-27442: -- Hey, I'm going over the parquet format spec

[jira] [Commented] (SPARK-27442) ParquetFileFormat fails to read column named with invalid characters

2019-07-24 Thread angerszhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892366#comment-16892366 ] angerszhu commented on SPARK-27442: --- auto writing data, change format to orc. orc can

[jira] [Commented] (SPARK-27442) ParquetFileFormat fails to read column named with invalid characters

2019-07-24 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892358#comment-16892358 ] Hyukjin Kwon commented on SPARK-27442: -- simply rename it before writing out. > Par

[jira] [Commented] (SPARK-27442) ParquetFileFormat fails to read column named with invalid characters

2019-07-24 Thread angerszhu (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16892348#comment-16892348 ] angerszhu commented on SPARK-27442: --- Meet same problem， can't write parquet file with

[jira] [Commented] (SPARK-27442) ParquetFileFormat fails to read column named with invalid characters

2019-04-19 Thread JIRA
[ https://issues.apache.org/jira/browse/SPARK-27442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16821901#comment-16821901 ] Jan Vršovský commented on SPARK-27442: -- [~hyukjin.kwon] Sorry, I forgot about this.

[jira] [Commented] (SPARK-27442) ParquetFileFormat fails to read column named with invalid characters

2019-04-11 Thread Hyukjin Kwon (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-27442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16815706#comment-16815706 ] Hyukjin Kwon commented on SPARK-27442: -- Why does Spark has to be able to read it? I