[jira] [Resolved] (ARROW-15657) Upgrade Apache ORC to 1.7.3

2022-02-13 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved ARROW-15657. -- Fix Version/s: 8.0.0 Resolution: Fixed Issue resolved by pull request 12397 [https://github.com

[jira] [Commented] (ARROW-15486) [Relase][Java] Verify staged maven artifacts

2022-01-28 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17484036#comment-17484036 ] Chao Sun commented on ARROW-15486: -- [~kou] after you the RC on nexus is closed, the art

[jira] [Comment Edited] (ARROW-15144) [Java] Unable to read IPC file in master

2021-12-18 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17461938#comment-17461938 ] Chao Sun edited comment on ARROW-15144 at 12/18/21, 5:06 PM: -

[jira] [Commented] (ARROW-15144) [Java] Unable to read IPC file in master

2021-12-18 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17461938#comment-17461938 ] Chao Sun commented on ARROW-15144: -- Thanks for the report [~jorgecarleitao]! The Java

[jira] [Resolved] (ARROW-14718) [Java] loadValidityBuffer should avoid allocating memory when input is not null and there are only null or non-null values

2021-12-14 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved ARROW-14718. -- Fix Version/s: 7.0.0 Resolution: Fixed Issue resolved by pull request 11709 [https://github.com

[jira] [Assigned] (ARROW-14718) [Java] loadValidityBuffer should avoid allocating memory when input is not null and there are only null or non-null values

2021-11-15 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned ARROW-14718: Assignee: Chao Sun > [Java] loadValidityBuffer should avoid allocating memory when input is not

[jira] [Created] (ARROW-14718) [Java] loadValidityBuffer should avoid allocating memory when input is not null and there are only null or non-null values

2021-11-15 Thread Chao Sun (Jira)
Chao Sun created ARROW-14718: Summary: [Java] loadValidityBuffer should avoid allocating memory when input is not null and there are only null or non-null values Key: ARROW-14718 URL: https://issues.apache.org/jira/br

[jira] [Closed] (ARROW-14666) Publish Maven artifacts for arrow-c-data

2021-11-12 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun closed ARROW-14666. Resolution: Duplicate > Publish Maven artifacts for arrow-c-data > ---

[jira] [Assigned] (ARROW-14666) Publish Maven artifacts for arrow-c-data

2021-11-10 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14666?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun reassigned ARROW-14666: Assignee: Chao Sun > Publish Maven artifacts for arrow-c-data > -

[jira] [Created] (ARROW-14666) Publish Maven artifacts for arrow-c-data

2021-11-10 Thread Chao Sun (Jira)
Chao Sun created ARROW-14666: Summary: Publish Maven artifacts for arrow-c-data Key: ARROW-14666 URL: https://issues.apache.org/jira/browse/ARROW-14666 Project: Apache Arrow Issue Type: Bug

[jira] [Updated] (ARROW-13941) [C++] Parquet writes incorrect file_offset

2021-09-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated ARROW-13941: - Description: Currently the Parquet writer sets {{file_offset}} in the following way (from {{metadata.cc

[jira] [Updated] (ARROW-13941) [C++] Parquet writes incorrect file_offset

2021-09-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated ARROW-13941: - Description: Currently the Parquet writer set {{file_offset}} in the following way: {code:cpp} if (d

[jira] [Updated] (ARROW-13941) [C++] Parquet writes incorrect file_offset

2021-09-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated ARROW-13941: - Description: Currently the Parquet writer set {{file_offset}} in the following way: {code:cpp} if (d

[jira] [Updated] (ARROW-13941) [C++] Parquet writes incorrect file_offset

2021-09-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated ARROW-13941: - Description: Currently the Parquet writer sets {{file_offset}} in the following way: {code:cpp} if (

[jira] [Created] (ARROW-13941) [C++] Parquet writes incorrect file_offset

2021-09-08 Thread Chao Sun (Jira)
Chao Sun created ARROW-13941: Summary: [C++] Parquet writes incorrect file_offset Key: ARROW-13941 URL: https://issues.apache.org/jira/browse/ARROW-13941 Project: Apache Arrow Issue Type: Bug

[jira] [Commented] (ARROW-13506) Upgrade ORC to 1.6.9

2021-07-30 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17390688#comment-17390688 ] Chao Sun commented on ARROW-13506: -- Can you add [~dongjoon] to the Arrow contributor li

[jira] [Resolved] (ARROW-13506) Upgrade ORC to 1.6.9

2021-07-30 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved ARROW-13506. -- Fix Version/s: 6.0.0 Resolution: Fixed Issue resolved by pull request 10838 [https://github.com

[jira] [Commented] (ARROW-10297) [Rust] Parameter for parquet-read to output data in json format

2021-01-31 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17275969#comment-17275969 ] Chao Sun commented on ARROW-10297: -- [~andygrove] could you add [~manojkarthick] as Arro

[jira] [Resolved] (ARROW-10297) [Rust] Parameter for parquet-read to output data in json format

2021-01-31 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved ARROW-10297. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 9306 [https://github.com/

[jira] [Commented] (ARROW-11183) [Rust] [Parquet] LogicalType::TIMESTAMP_NANOS missing

2021-01-08 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11183?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261492#comment-17261492 ] Chao Sun commented on ARROW-11183: -- I don't see TIMESTAMP_NANOS in the latest Parquet f

[jira] [Updated] (ARROW-11072) Support int32 and int64 physical types

2020-12-30 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated ARROW-11072: - Component/s: Rust > Support int32 and int64 physical types > -- > >

[jira] [Commented] (ARROW-11016) [Rust] Parquet ArrayReader should allow reading a subset of row groups

2020-12-28 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255765#comment-17255765 ] Chao Sun commented on ARROW-11016: -- Sorry for the late reply. Yes I think it should be

[jira] [Comment Edited] (ARROW-11016) [Rust] Parquet ArrayReader should allow reading a subset of row groups

2020-12-28 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17255765#comment-17255765 ] Chao Sun edited comment on ARROW-11016 at 12/29/20, 1:44 AM: -

[jira] [Commented] (ARROW-10002) [Rust] Trait-specialization requires nightly

2020-09-30 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17204937#comment-17204937 ] Chao Sun commented on ARROW-10002: -- +1. It will be awesome if we can remove specializat

[jira] [Updated] (ARROW-9790) [Rust] [Parquet] ParquetFileArrowReader fails to decode all pages if batches fall exactly on row group boundaries

2020-08-19 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun updated ARROW-9790: Component/s: Rust > [Rust] [Parquet] ParquetFileArrowReader fails to decode all pages if batches > fall ex

[jira] [Resolved] (ARROW-9790) [Rust] [Parquet] ParquetFileArrowReader fails to decode all pages if batches fall exactly on row group boundaries

2020-08-19 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9790?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved ARROW-9790. - Fix Version/s: 2.0.0 Resolution: Fixed Issue resolved by pull request 8007 [https://github.com/apa

[jira] [Commented] (ARROW-9735) [Rust] [Parquet] Corrupt footer error on files produced by AvroParquetWriter

2020-08-14 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177984#comment-17177984 ] Chao Sun commented on ARROW-9735: - hmm [~sergiimk], I can't reproduce the issue when usin

[jira] [Commented] (ARROW-9735) [Rust] [Parquet] Corrupt footer error on files produced by AvroParquetWriter

2020-08-13 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17177413#comment-17177413 ] Chao Sun commented on ARROW-9735: - Thanks [~sergiimk] - let me try to reproduce the issue

[jira] [Resolved] (ARROW-9461) [Rust] Reading Date32 and Date64 errors - they are incorrectly converted to RecordBatch

2020-07-18 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved ARROW-9461. - Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 7751 [https://github.com/apa

[jira] [Resolved] (ARROW-9503) [Rust] Comparison sliced arrays is wrong

2020-07-16 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved ARROW-9503. - Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 7788 [https://github.com/apa

[jira] [Commented] (ARROW-9503) Comparison sliced arrays is wrong

2020-07-16 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159148#comment-17159148 ] Chao Sun commented on ARROW-9503: - cc [~paddyhoran], [~nevi_me] > Comparison sliced arra

[jira] [Commented] (ARROW-9503) Comparison sliced arrays is wrong

2020-07-16 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17159145#comment-17159145 ] Chao Sun commented on ARROW-9503: - I think its because [{{comparison.rs}}|https://github

[jira] [Commented] (ARROW-9452) [Rust] [DateFusion] Improve performance of parquet scan

2020-07-13 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17157060#comment-17157060 ] Chao Sun commented on ARROW-9452: - Interesting. I saw that some perf comparison has been

[jira] [Resolved] (ARROW-8559) [Rust] Consolidate Record Batch reader traits in main arrow crate

2020-07-12 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved ARROW-8559. - Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 7666 [https://github.com/apa

[jira] [Closed] (ARROW-9386) [Rust] RecordBatch.schema() should not return &Arc

2020-07-12 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun closed ARROW-9386. --- Resolution: Duplicate > [Rust] RecordBatch.schema() should not return &Arc >

[jira] [Commented] (ARROW-9386) [Rust] RecordBatch.schema() should not return &Arc

2020-07-12 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17156371#comment-17156371 ] Chao Sun commented on ARROW-9386: - This will be resolved as part of ARROW-8559. > [Rust]

[jira] [Resolved] (ARROW-9280) [Rust] Write statistics to Parquet files

2020-07-02 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved ARROW-9280. - Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 7622 [https://github.com/apa

[jira] [Resolved] (ARROW-9290) [Rust] [Parquet] Add features to allow opting out of dependencies

2020-07-02 Thread Chao Sun (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9290?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved ARROW-9290. - Fix Version/s: 1.0.0 Resolution: Fixed Issue resolved by pull request 7610 [https://github.com/apa