[jira] [Commented] (ARROW-3933) [Python] Segfault reading Parquet files from GNOMAD

2019-09-06 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924566#comment-16924566 ] Wes McKinney commented on ARROW-3933: - As step one, I have it returning a reasonable error message

[jira] [Commented] (ARROW-3933) [Python] Segfault reading Parquet files from GNOMAD

2019-09-06 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924555#comment-16924555 ] Wes McKinney commented on ARROW-3933: - I attached the offending file for convenience > [Python]

[jira] [Commented] (ARROW-3933) [Python] Segfault reading Parquet files from GNOMAD

2019-09-06 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16924554#comment-16924554 ] Wes McKinney commented on ARROW-3933: - This is core dumping. I'm going to take a look and see if I

[jira] [Commented] (ARROW-3933) [Python] Segfault reading Parquet files from GNOMAD

2019-08-21 Thread Wes McKinney (Jira)
[ https://issues.apache.org/jira/browse/ARROW-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912773#comment-16912773 ] Wes McKinney commented on ARROW-3933: - Added to 0.15.0 milestone so I can take a quick look to assess

[jira] [Commented] (ARROW-3933) [Python] Segfault reading Parquet files from GNOMAD

2018-12-04 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709548#comment-16709548 ] Wes McKinney commented on ARROW-3933: - Either [~xhochy] or I can take a closer look. This code path

[jira] [Commented] (ARROW-3933) [Python] Segfault reading Parquet files from GNOMAD

2018-12-04 Thread Francois Saint-Jacques (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709537#comment-16709537 ] Francois Saint-Jacques commented on ARROW-3933: --- Offending line

[jira] [Commented] (ARROW-3933) [Python] Segfault reading Parquet files from GNOMAD

2018-12-04 Thread David Konerding (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709364#comment-16709364 ] David Konerding commented on ARROW-3933: I noticed that the latest release of gnomad no longer

[jira] [Commented] (ARROW-3933) [Python] Segfault reading Parquet files from GNOMAD

2018-12-04 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709349#comment-16709349 ] Wes McKinney commented on ARROW-3933: - Try using parquet-tools in the Java library

[jira] [Commented] (ARROW-3933) [Python] Segfault reading Parquet files from GNOMAD

2018-12-04 Thread T Poterba (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709343#comment-16709343 ] T Poterba commented on ARROW-3933: -- I'll note that this file has a pretty huge schema, in case that

[jira] [Commented] (ARROW-3933) [Python] Segfault reading Parquet files from GNOMAD

2018-12-04 Thread David Konerding (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709222#comment-16709222 ] David Konerding commented on ARROW-3933: Is there a file validator for parquet?  Or something in

[jira] [Commented] (ARROW-3933) [Python] Segfault reading Parquet files from GNOMAD

2018-12-04 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708875#comment-16708875 ] Wes McKinney commented on ARROW-3933: - It's hard to say until someone has a chance to look at it.

[jira] [Commented] (ARROW-3933) [Python] Segfault reading Parquet files from GNOMAD

2018-12-04 Thread David Konerding (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-3933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708821#comment-16708821 ] David Konerding commented on ARROW-3933: Do you have suggestions for a workaround?  In