[jira] [Updated] (ARROW-2369) Large (>~20 GB) files written to Parquet via PyArrow are corrupted

2018-03-31 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-2369: Fix Version/s: (was: 0.9.0) 0.10.0 > Large (>~20 GB) files written to

[jira] [Commented] (ARROW-2369) Large (>~20 GB) files written to Parquet via PyArrow are corrupted

2018-03-31 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421510#comment-16421510 ] Wes McKinney commented on ARROW-2369: - Sounds like there's a {{uint32_t}} overflow somewhere, which is

[jira] [Commented] (ARROW-2373) [Rust] Investigate alternate ways to achieve byte-aligned memory

2018-03-31 Thread Andy Grove (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421484#comment-16421484 ] Andy Grove commented on ARROW-2373: --- I just got this suggestion on the Rust forum:   "Just make a type

[jira] [Commented] (ARROW-2373) [Rust] Investigate alternate ways to achieve byte-aligned memory

2018-03-31 Thread Andy Grove (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421445#comment-16421445 ] Andy Grove commented on ARROW-2373: --- I guess using nightly isn't so bad for now. It sounds like alloc

[jira] [Commented] (ARROW-1325) [R] Bootstrap R bindings subproject

2018-03-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421460#comment-16421460 ] ASF GitHub Bot commented on ARROW-1325: --- wesm commented on a change in pull request #1815:

[jira] [Commented] (ARROW-1325) [R] Bootstrap R bindings subproject

2018-03-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421459#comment-16421459 ] ASF GitHub Bot commented on ARROW-1325: --- wesm commented on a change in pull request #1815:

[jira] [Commented] (ARROW-1325) [R] Bootstrap R bindings subproject

2018-03-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421464#comment-16421464 ] ASF GitHub Bot commented on ARROW-1325: --- wesm commented on a change in pull request #1815:

[jira] [Commented] (ARROW-1325) [R] Bootstrap R bindings subproject

2018-03-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421463#comment-16421463 ] ASF GitHub Bot commented on ARROW-1325: --- wesm commented on a change in pull request #1815:

[jira] [Updated] (ARROW-1325) [R] Bootstrap R bindings subproject

2018-03-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-1325: -- Labels: pull-request-available (was: ) > [R] Bootstrap R bindings subproject >

[jira] [Updated] (ARROW-1325) [R] Bootstrap R bindings subproject

2018-03-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated ARROW-1325: -- Labels: pull-request-available (was: ) > [R] Bootstrap R bindings subproject >

[jira] [Commented] (ARROW-1325) [R] Bootstrap R bindings subproject

2018-03-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421462#comment-16421462 ] ASF GitHub Bot commented on ARROW-1325: --- wesm commented on a change in pull request #1815:

[jira] [Updated] (ARROW-2373) [Rust] Investigate alternate ways to achieve byte-aligned memory

2018-03-31 Thread Andy Grove (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove updated ARROW-2373: -- Description: The current Rust implementation of Buffer relies on libc and unsafe code to allocate

[jira] [Created] (ARROW-2373) [Rust] Investigate alternate ways to acheive byte-aligned memory

2018-03-31 Thread Andy Grove (JIRA)
Andy Grove created ARROW-2373: - Summary: [Rust] Investigate alternate ways to acheive byte-aligned memory Key: ARROW-2373 URL: https://issues.apache.org/jira/browse/ARROW-2373 Project: Apache Arrow

[GitHub] wesm commented on issue #25: Fix OSX RPATHs for Boost

2018-03-31 Thread GitBox
wesm commented on issue #25: Fix OSX RPATHs for Boost URL: https://github.com/apache/arrow-dist/pull/25#issuecomment-377731322 Is this ready to go? This is an automated message from the Apache Git Service. To respond to the

[jira] [Updated] (ARROW-2373) [Rust] Investigate alternate ways to achieve byte-aligned memory

2018-03-31 Thread Andy Grove (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove updated ARROW-2373: -- Description: The current Rust implementation of Buffer relies on libc and unsafe code to allocate

[jira] [Updated] (ARROW-2373) [Rust] Investigate alternate ways to achieve byte-aligned memory

2018-03-31 Thread Andy Grove (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andy Grove updated ARROW-2373: -- Summary: [Rust] Investigate alternate ways to achieve byte-aligned memory (was: [Rust] Investigate

[jira] [Commented] (ARROW-2373) [Rust] Investigate alternate ways to achieve byte-aligned memory

2018-03-31 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421425#comment-16421425 ] Krisztian Szucs commented on ARROW-2373: We might use https://github.com/contain-rs/raw-vec or

[jira] [Commented] (ARROW-2369) Large (>~20 GB) files written to Parquet via PyArrow are corrupted

2018-03-31 Thread Babak Alipour (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421506#comment-16421506 ] Babak Alipour commented on ARROW-2369: -- I've got the same issue on Win 10, Arrow v0.9.0. The file was

[jira] [Comment Edited] (ARROW-2373) [Rust] Investigate alternate ways to achieve byte-aligned memory

2018-03-31 Thread Krisztian Szucs (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421425#comment-16421425 ] Krisztian Szucs edited comment on ARROW-2373 at 3/31/18 6:30 PM: - We might

[jira] [Updated] (ARROW-1325) [R] Bootstrap R bindings subproject

2018-03-31 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney updated ARROW-1325: Summary: [R] Bootstrap R bindings subproject (was: R language bindings for Arrow) > [R] Bootstrap

[jira] [Assigned] (ARROW-1325) [R] Bootstrap R bindings subproject

2018-03-31 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-1325: --- Assignee: Romain François > [R] Bootstrap R bindings subproject >

[jira] [Commented] (ARROW-1325) [R] Bootstrap R bindings subproject

2018-03-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421461#comment-16421461 ] ASF GitHub Bot commented on ARROW-1325: --- wesm commented on a change in pull request #1815:

[jira] [Commented] (ARROW-1325) [R] Bootstrap R bindings subproject

2018-03-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421465#comment-16421465 ] ASF GitHub Bot commented on ARROW-1325: --- wesm commented on issue #1815: ARROW-1325: [R]

[jira] [Commented] (ARROW-2189) [C++] Seg. fault on make_shared

2018-03-31 Thread Rares Vernica (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421483#comment-16421483 ] Rares Vernica commented on ARROW-2189: -- [~kou] could this issue be caused by the differences in the

[jira] [Commented] (ARROW-2189) [C++] Seg. fault on make_shared

2018-03-31 Thread Rares Vernica (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2189?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421531#comment-16421531 ] Rares Vernica commented on ARROW-2189: -- I did some tests and it does not look like these differences

[jira] [Created] (ARROW-2374) [Rust] Add support for array of List

2018-03-31 Thread Andy Grove (JIRA)
Andy Grove created ARROW-2374: - Summary: [Rust] Add support for array of List Key: ARROW-2374 URL: https://issues.apache.org/jira/browse/ARROW-2374 Project: Apache Arrow Issue Type: New Feature

[jira] [Commented] (ARROW-2360) Add set_chunksize for RecordBatchReader in arrow/record_batch.h

2018-03-31 Thread Xianjin YE (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2360?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421203#comment-16421203 ] Xianjin YE commented on ARROW-2360: --- Then what do you think of {{ChunkableRecordBatchReader}}?

[jira] [Commented] (ARROW-2361) [Rust] Start native Rust Implementation

2018-03-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421339#comment-16421339 ] ASF GitHub Bot commented on ARROW-2361: --- fsaintjacques commented on a change in pull request #1804:

[jira] [Commented] (ARROW-2361) [Rust] Start native Rust Implementation

2018-03-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421355#comment-16421355 ] ASF GitHub Bot commented on ARROW-2361: --- andygrove commented on issue #1804: ARROW-2361: [Rust]

[jira] [Commented] (ARROW-2361) [Rust] Start native Rust Implementation

2018-03-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421385#comment-16421385 ] ASF GitHub Bot commented on ARROW-2361: --- andygrove commented on issue #1804: ARROW-2361: [Rust]

[jira] [Resolved] (ARROW-2361) [Rust] Start native Rust Implementation

2018-03-31 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney resolved ARROW-2361. - Resolution: Fixed Fix Version/s: 0.10.0 Issue resolved by pull request 1804

[jira] [Commented] (ARROW-2361) [Rust] Start native Rust Implementation

2018-03-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16421415#comment-16421415 ] ASF GitHub Bot commented on ARROW-2361: --- wesm closed pull request #1804: ARROW-2361: [Rust] Starting

[jira] [Assigned] (ARROW-2361) [Rust] Start native Rust Implementation

2018-03-31 Thread Wes McKinney (JIRA)
[ https://issues.apache.org/jira/browse/ARROW-2361?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wes McKinney reassigned ARROW-2361: --- Assignee: Andy Grove > [Rust] Start native Rust Implementation >