[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-19 Thread Matthias Rosenthaler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17287040#comment-17287040 ] Matthias Rosenthaler commented on ARROW-11629: -- [~GPSnoopy], seems it makes

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-18 Thread Tanguy Fautre (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286483#comment-17286483 ] Tanguy Fautre commented on ARROW-11629: --- [~matthros] You can chain those calls, si

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-17 Thread Matthias Rosenthaler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286314#comment-17286314 ] Matthias Rosenthaler commented on ARROW-11629: -- I disabled it for all colum

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-17 Thread Matthias Rosenthaler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286312#comment-17286312 ] Matthias Rosenthaler commented on ARROW-11629: -- [~GPSnoopy], it seems there

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-17 Thread Matthias Rosenthaler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286306#comment-17286306 ] Matthias Rosenthaler commented on ARROW-11629: -- strange thing, switching it

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-17 Thread Tanguy Fautre (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17286038#comment-17286038 ] Tanguy Fautre commented on ARROW-11629: --- Wild speculations / hypothesis on my part

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-17 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285943#comment-17285943 ] Antoine Pitrou commented on ARROW-11629: It may mean that there's a bug in Parqu

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-17 Thread Matthias Rosenthaler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285942#comment-17285942 ] Matthias Rosenthaler commented on ARROW-11629: -- It also solves the problem

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-17 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285940#comment-17285940 ] Antoine Pitrou commented on ARROW-11629: I may be mistaken, but it seems Drill i

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-17 Thread Tanguy Fautre (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285936#comment-17285936 ] Tanguy Fautre commented on ARROW-11629: --- ParquetSharp is just a wrapper around Arr

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-17 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285926#comment-17285926 ] Joris Van den Bossche commented on ARROW-11629: --- No idea if/how the featur

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-17 Thread Matthias Rosenthaler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285910#comment-17285910 ] Matthias Rosenthaler commented on ARROW-11629: -- [~jorisvandenbossche]: fasc

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-17 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285894#comment-17285894 ] Joris Van den Bossche commented on ARROW-11629: --- They mention that it migh

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-17 Thread Matthias Rosenthaler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285888#comment-17285888 ] Matthias Rosenthaler commented on ARROW-11629: -- there is a promising commen

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-17 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285886#comment-17285886 ] Antoine Pitrou commented on ARROW-11629: Ok, then let's hope Drill developers ta

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-17 Thread Matthias Rosenthaler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285885#comment-17285885 ] Matthias Rosenthaler commented on ARROW-11629: -- Yes they are different. And

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-17 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285882#comment-17285882 ] Antoine Pitrou commented on ARROW-11629: Wait... Parquet.NET and ParquetSharp ar

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-17 Thread Matthias Rosenthaler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285879#comment-17285879 ] Matthias Rosenthaler commented on ARROW-11629: -- https://github.com/G-Resear

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-17 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285877#comment-17285877 ] Antoine Pitrou commented on ARROW-11629: Can you give the link to the ParquetSha

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-17 Thread Matthias Rosenthaler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285874#comment-17285874 ] Matthias Rosenthaler commented on ARROW-11629: -- [~apitrou], created a ticke

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-17 Thread Antoine Pitrou (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285857#comment-17285857 ] Antoine Pitrou commented on ARROW-11629: [~matthros] I don't think we'll be able

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-16 Thread Matthias Rosenthaler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285660#comment-17285660 ] Matthias Rosenthaler commented on ARROW-11629: -- [~emkornfield] # correct,

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-16 Thread Micah Kornfield (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285626#comment-17285626 ] Micah Kornfield commented on ARROW-11629: - [~matthros] sorry I don't have easy a

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-16 Thread Micah Kornfield (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285350#comment-17285350 ] Micah Kornfield commented on ARROW-11629: - There are two differences with fast p

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-16 Thread Matthias Rosenthaler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17285123#comment-17285123 ] Matthias Rosenthaler commented on ARROW-11629: -- # I tried it with pyarrow 0

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-15 Thread Micah Kornfield (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284890#comment-17284890 ] Micah Kornfield commented on ARROW-11629: - I've uploaded the output of the code

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-15 Thread Micah Kornfield (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284886#comment-17284886 ] Micah Kornfield commented on ARROW-11629: - So I think there might be two issues:

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-15 Thread Micah Kornfield (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284885#comment-17284885 ] Micah Kornfield commented on ARROW-11629: - Would you mind sharing how the parque

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-15 Thread Micah Kornfield (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284877#comment-17284877 ] Micah Kornfield commented on ARROW-11629: - to answer my own question, at least t

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-15 Thread Micah Kornfield (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284875#comment-17284875 ] Micah Kornfield commented on ARROW-11629: - Also, from the comment it sounds like

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-15 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284765#comment-17284765 ] Joris Van den Bossche commented on ARROW-11629: --- Thanks for the details! W

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-15 Thread Matthias Rosenthaler (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284762#comment-17284762 ] Matthias Rosenthaler commented on ARROW-11629: -- [~jorisvandenbossche], In a

[jira] [Commented] (ARROW-11629) [C++] Writing float32 values makes parquet files not readable for some tools

2021-02-15 Thread Joris Van den Bossche (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17284756#comment-17284756 ] Joris Van den Bossche commented on ARROW-11629: --- The Parquet format suppor