[jira] [Closed] (ARROW-17752) Support JNI-based parquet write to write datasets into files

2022-09-16 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17752?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang closed ARROW-17752. Resolution: Duplicate Duplicates ARROW-11776. I am assigning that issue to you. > Support

[jira] [Assigned] (ARROW-11776) [Java][Dataset] Support writing to files within dataset scanner via JNI

2022-09-16 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang reassigned ARROW-11776: Assignee: Ke Jia (was: Hongze Zhang) > [Java][Dataset] Support writing to files within

[jira] [Closed] (ARROW-17657) [C++] C data interface: Add field for byte length of buffers in ArrowArray

2022-09-13 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang closed ARROW-17657. Assignee: Hongze Zhang Resolution: Won't Fix Closed and opened

[jira] [Created] (ARROW-17720) [Java] C data interface: Add API to compute imported buffer size

2022-09-13 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-17720: Summary: [Java] C data interface: Add API to compute imported buffer size Key: ARROW-17720 URL: https://issues.apache.org/jira/browse/ARROW-17720 Project: Apache

[jira] [Comment Edited] (ARROW-17657) [C++] C data interface: Add field for byte length of buffers in ArrowArray

2022-09-13 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17603856#comment-17603856 ] Hongze Zhang edited comment on ARROW-17657 at 9/14/22 3:02 AM: --- {quote}

[jira] [Commented] (ARROW-17657) [C++] C data interface: Add field for byte length of buffers in ArrowArray

2022-09-13 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17657?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17603856#comment-17603856 ] Hongze Zhang commented on ARROW-17657: -- {quote} The C data interface is a stable binary interface,

[jira] [Updated] (ARROW-14034) [Java] Unexpected Allocator states created after allocating buffer whose AllocationManager has different size from the requested size

2022-09-09 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-14034: - Fix Version/s: 8.0.2 > [Java] Unexpected Allocator states created after allocating buffer whose

[jira] [Updated] (ARROW-14034) [Java] Unexpected Allocator states created after allocating buffer whose AllocationManager has different size from the requested size

2022-09-09 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-14034: - Fix Version/s: 10.0.0 (was: 8.0.2) > [Java] Unexpected Allocator states

[jira] [Created] (ARROW-17657) [C++] C data interface: Add field for byte length of buffers in ArrowArray

2022-09-09 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-17657: Summary: [C++] C data interface: Add field for byte length of buffers in ArrowArray Key: ARROW-17657 URL: https://issues.apache.org/jira/browse/ARROW-17657 Project:

[jira] [Updated] (ARROW-17159) [C++][JAVA] Dataset: Support reading from fixed offset of a file for Parquet format

2022-07-22 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17159?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-17159: - Description: This adds property start_offset_ and length_ to FileSource and should be

[jira] [Closed] (ARROW-17161) [C++][Java] Dataset: Support reading from fixed offset of a file for Parquet format

2022-07-21 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang closed ARROW-17161. Resolution: Duplicate > [C++][Java] Dataset: Support reading from fixed offset of a file for

[jira] [Commented] (ARROW-17161) [C++][Java] Dataset: Support reading from fixed offset of a file for Parquet format

2022-07-21 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17161?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17569317#comment-17569317 ] Hongze Zhang commented on ARROW-17161: -- duplicates ARROW-17159 > [C++][Java] Dataset: Support

[jira] [Assigned] (ARROW-17161) [C++][Java] Dataset: Support reading from fixed offset of a file for Parquet format

2022-07-21 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang reassigned ARROW-17161: Assignee: Hongze Zhang > [C++][Java] Dataset: Support reading from fixed offset of a

[jira] [Created] (ARROW-17161) [C++][Java] Dataset: Support reading from fixed offset of a file for Parquet format

2022-07-21 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-17161: Summary: [C++][Java] Dataset: Support reading from fixed offset of a file for Parquet format Key: ARROW-17161 URL: https://issues.apache.org/jira/browse/ARROW-17161

[jira] [Comment Edited] (ARROW-16754) [Java] StructVector's child vectors get unexpectedly reordered after adding vectors with duplicated fields

2022-06-06 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17550578#comment-17550578 ] Hongze Zhang edited comment on ARROW-16754 at 6/6/22 11:24 PM: --- To me the

[jira] [Commented] (ARROW-16754) [Java] StructVector's child vectors get unexpectedly reordered after adding vectors with duplicated fields

2022-06-06 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17550578#comment-17550578 ] Hongze Zhang commented on ARROW-16754: -- To me the issue was found when CONFLICT_APPEND is used. I

[jira] [Created] (ARROW-16754) [Java] StructVector's child vectors get unexpectedly reordered after adding vectors with duplicated fields

2022-06-06 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-16754: Summary: [Java] StructVector's child vectors get unexpectedly reordered after adding vectors with duplicated fields Key: ARROW-16754 URL:

[jira] [Created] (ARROW-16691) [Java][C++] Reorganize JNI code from several modules

2022-05-31 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-16691: Summary: [Java][C++] Reorganize JNI code from several modules Key: ARROW-16691 URL: https://issues.apache.org/jira/browse/ARROW-16691 Project: Apache Arrow

[jira] [Updated] (ARROW-16676) [C++] ReservationListenableMemoryPool::Impl::bytes_allocated() should return its own number of bytes rather than the underlying pool's

2022-05-29 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-16676: - Fix Version/s: 9.0.0 > [C++] ReservationListenableMemoryPool::Impl::bytes_allocated() should

[jira] [Updated] (ARROW-16673) [Java] C data interface: Allow ownership transferring for imported buffer

2022-05-29 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-16673: - Fix Version/s: 9.0.0 > [Java] C data interface: Allow ownership transferring for imported

[jira] [Assigned] (ARROW-16672) [Java] Allow duplicated field names in Java C data interface

2022-05-29 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang reassigned ARROW-16672: Assignee: Hongze Zhang > [Java] Allow duplicated field names in Java C data interface >

[jira] [Updated] (ARROW-16674) [Java] C data interface: Reading as nioBuffer from imported buffer causes error

2022-05-29 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-16674: - Fix Version/s: 9.0.0 > [Java] C data interface: Reading as nioBuffer from imported buffer

[jira] [Updated] (ARROW-16675) [C++] Wrong Tell() result from BufferedOutputStream in an edge case

2022-05-29 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-16675: - Fix Version/s: 9.0.0 > [C++] Wrong Tell() result from BufferedOutputStream in an edge case >

[jira] [Assigned] (ARROW-16674) [Java] C data interface: Reading as nioBuffer from imported buffer causes error

2022-05-29 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang reassigned ARROW-16674: Assignee: Hongze Zhang > [Java] C data interface: Reading as nioBuffer from imported

[jira] [Assigned] (ARROW-16673) [Java] C data interface: Allow ownership transferring for imported buffer

2022-05-29 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang reassigned ARROW-16673: Assignee: Hongze Zhang > [Java] C data interface: Allow ownership transferring for

[jira] [Assigned] (ARROW-16676) [C++] ReservationListenableMemoryPool::Impl::bytes_allocated() should return its own number of bytes rather than the underlying pool's

2022-05-29 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang reassigned ARROW-16676: Assignee: Hongze Zhang > [C++] ReservationListenableMemoryPool::Impl::bytes_allocated()

[jira] [Assigned] (ARROW-16675) [C++] Wrong Tell() result from BufferedOutputStream in an edge case

2022-05-29 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang reassigned ARROW-16675: Assignee: Hongze Zhang > [C++] Wrong Tell() result from BufferedOutputStream in an edge

[jira] [Updated] (ARROW-16676) [C++] ReservationListenableMemoryPool::Impl::bytes_allocated() should return its own number of bytes rather than the underlying pool's

2022-05-27 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-16676: - Issue Type: Improvement (was: Bug) > [C++]

[jira] [Updated] (ARROW-16676) [C++] ReservationListenableMemoryPool::Impl::bytes_allocated() should return its own number of bytes rather than the underlying pool's

2022-05-27 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-16676: - Summary: [C++] ReservationListenableMemoryPool::Impl::bytes_allocated() should return its own

[jira] [Created] (ARROW-16676) [C++] Wrong result of ReservationListenableMemoryPool::Impl::bytes_allocated()

2022-05-27 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-16676: Summary: [C++] Wrong result of ReservationListenableMemoryPool::Impl::bytes_allocated() Key: ARROW-16676 URL: https://issues.apache.org/jira/browse/ARROW-16676

[jira] [Created] (ARROW-16675) [C++] Wrong Tell() result from BufferedOutputStream in an edge case

2022-05-26 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-16675: Summary: [C++] Wrong Tell() result from BufferedOutputStream in an edge case Key: ARROW-16675 URL: https://issues.apache.org/jira/browse/ARROW-16675 Project: Apache

[jira] [Updated] (ARROW-16674) [Java] C data interface: Reading as nioBuffer from imported buffer causes error

2022-05-26 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-16674: - Issue Type: Bug (was: Improvement) > [Java] C data interface: Reading as nioBuffer from

[jira] [Updated] (ARROW-16674) [Java] C data interface: Reading as nioBuffer from imported buffer causes error

2022-05-26 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-16674: - Description: Get following exception when reading nio buffer derived from the imported buffer:

[jira] [Updated] (ARROW-16674) [Java] C data interface: Reading as nioBuffer from imported buffer causes error

2022-05-26 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-16674: - Summary: [Java] C data interface: Reading as nioBuffer from imported buffer causes error (was:

[jira] [Created] (ARROW-16674) [Java] C data interface: Calling #readableBytes on imported buffer causes error

2022-05-26 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-16674: Summary: [Java] C data interface: Calling #readableBytes on imported buffer causes error Key: ARROW-16674 URL: https://issues.apache.org/jira/browse/ARROW-16674

[jira] [Created] (ARROW-16673) [Java] C data interface: Allow ownership transferring for imported buffer

2022-05-26 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-16673: Summary: [Java] C data interface: Allow ownership transferring for imported buffer Key: ARROW-16673 URL: https://issues.apache.org/jira/browse/ARROW-16673 Project:

[jira] [Created] (ARROW-16672) [Java] Allow duplicated field names in Java C data interface

2022-05-26 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-16672: Summary: [Java] Allow duplicated field names in Java C data interface Key: ARROW-16672 URL: https://issues.apache.org/jira/browse/ARROW-16672 Project: Apache Arrow

[jira] [Updated] (ARROW-14923) [Java] AllocationListener should be called during ownership transferring

2022-04-27 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-14923: - Fix Version/s: 9.0.0 > [Java] AllocationListener should be called during ownership transferring

[jira] [Assigned] (ARROW-16329) [Java][C++] Keep more context when marshalling errors through JNI

2022-04-26 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang reassigned ARROW-16329: Assignee: Hongze Zhang > [Java][C++] Keep more context when marshalling errors through

[jira] [Assigned] (ARROW-15745) [Java] Remove ScanTask from the Dataset bindings

2022-04-25 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang reassigned ARROW-15745: Assignee: Hongze Zhang > [Java] Remove ScanTask from the Dataset bindings >

[jira] [Commented] (ARROW-7272) [C++][Java][Dataset] JNI bridge between RecordBatch and VectorSchemaRoot

2022-04-25 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17527370#comment-17527370 ] Hongze Zhang commented on ARROW-7272: - Let's limit the scope of changes into dataset module since we

[jira] (ARROW-7272) [C++][Java][Dataset] JNI bridge between RecordBatch and VectorSchemaRoot

2022-04-25 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7272 ] Hongze Zhang deleted comment on ARROW-7272: - was (Author: zhztheplayer): -Hi guys, would you suggest to just use the existing *org.apache.arrow.vector.ipc.ArrowReader*? We already have a

[jira] [Updated] (ARROW-7272) [C++][Java][Dataset] JNI bridge between RecordBatch and VectorSchemaRoot

2022-04-25 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-7272: Summary: [C++][Java][Dataset] JNI bridge between RecordBatch and VectorSchemaRoot (was:

[jira] [Created] (ARROW-14923) [Java] AllocationListener should be called during ownership transferring

2021-11-30 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-14923: Summary: [Java] AllocationListener should be called during ownership transferring Key: ARROW-14923 URL: https://issues.apache.org/jira/browse/ARROW-14923 Project:

[jira] [Created] (ARROW-14921) [Java] Move base memory component tests from memory-netty to memory-core

2021-11-29 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-14921: Summary: [Java] Move base memory component tests from memory-netty to memory-core Key: ARROW-14921 URL: https://issues.apache.org/jira/browse/ARROW-14921 Project:

[jira] [Created] (ARROW-14466) [Java] Introduce memory leak detector/handler utility to hook on unused unreleased buffers

2021-10-26 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-14466: Summary: [Java] Introduce memory leak detector/handler utility to hook on unused unreleased buffers Key: ARROW-14466 URL: https://issues.apache.org/jira/browse/ARROW-14466

[jira] [Comment Edited] (ARROW-14328) Request for enhancements to BufferAllocator.close()

2021-10-15 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17429107#comment-17429107 ] Hongze Zhang edited comment on ARROW-14328 at 10/15/21, 1:42 PM: - A

[jira] [Commented] (ARROW-14328) Request for enhancements to BufferAllocator.close()

2021-10-14 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17429107#comment-17429107 ] Hongze Zhang commented on ARROW-14328: -- A cleanup can be done at least by caching the allocated

[jira] [Assigned] (ARROW-12480) [Java][Dataset] FileSystemDataset: Support reading from a directory

2021-10-01 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang reassigned ARROW-12480: Assignee: Hongze Zhang > [Java][Dataset] FileSystemDataset: Support reading from a

[jira] [Updated] (ARROW-7272) [C++][Java] JNI bridge between RecordBatch and VectorSchemaRoot

2021-10-01 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-7272: Fix Version/s: 6.0.0 > [C++][Java] JNI bridge between RecordBatch and VectorSchemaRoot >

[jira] [Assigned] (ARROW-7272) [C++][Java] JNI bridge between RecordBatch and VectorSchemaRoot

2021-10-01 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang reassigned ARROW-7272: --- Assignee: Hongze Zhang > [C++][Java] JNI bridge between RecordBatch and VectorSchemaRoot >

[jira] [Assigned] (ARROW-11776) [Java][Dataset] Support writing to files within dataset scanner via JNI

2021-10-01 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang reassigned ARROW-11776: Assignee: Hongze Zhang > [Java][Dataset] Support writing to files within dataset scanner

[jira] [Updated] (ARROW-11776) [Java][Dataset] Support writing to files within dataset scanner via JNI

2021-10-01 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-11776: - Fix Version/s: (was: 7.0.0) 6.0.0 > [Java][Dataset] Support writing to

[jira] [Updated] (ARROW-12607) [Doc][Java] Doc section for Dataset Java bindings

2021-10-01 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-12607: - Fix Version/s: (was: 7.0.0) 6.0.0 > [Doc][Java] Doc section for Dataset

[jira] [Assigned] (ARROW-12607) [Doc][Java] Doc section for Dataset Java bindings

2021-10-01 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang reassigned ARROW-12607: Assignee: Hongze Zhang > [Doc][Java] Doc section for Dataset Java bindings >

[jira] [Updated] (ARROW-13257) [Java][Dataset] Allow passing empty columns for projection

2021-10-01 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-13257: - Fix Version/s: (was: 7.0.0) 6.0.0 > [Java][Dataset] Allow passing empty

[jira] [Created] (ARROW-14034) [Java] Unexpected Allocator states created after allocating buffer whose AllocationManager has different size from the requested size

2021-09-18 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-14034: Summary: [Java] Unexpected Allocator states created after allocating buffer whose AllocationManager has different size from the requested size Key: ARROW-14034 URL:

[jira] [Created] (ARROW-13569) [Java][Dataset] Enable CSV file format

2021-08-05 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-13569: Summary: [Java][Dataset] Enable CSV file format Key: ARROW-13569 URL: https://issues.apache.org/jira/browse/ARROW-13569 Project: Apache Arrow Issue Type:

[jira] [Updated] (ARROW-11776) [Java][Dataset] Support writing to files within dataset scanner via JNI

2021-07-21 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-11776: - Fix Version/s: 6.0.0 > [Java][Dataset] Support writing to files within dataset scanner via JNI

[jira] [Updated] (ARROW-12480) [Java][Dataset] FileSystemDataset: Support reading from a directory

2021-07-21 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-12480: - Fix Version/s: 6.0.0 > [Java][Dataset] FileSystemDataset: Support reading from a directory >

[jira] [Updated] (ARROW-13257) [Java][Dataset] Allow passing empty columns for projection

2021-07-21 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-13257: - Fix Version/s: 6.0.0 > [Java][Dataset] Allow passing empty columns for projection >

[jira] [Updated] (ARROW-12607) [Website] Doc section for Dataset Java bindings

2021-07-21 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-12607: - Fix Version/s: 6.0.0 > [Website] Doc section for Dataset Java bindings >

[jira] [Created] (ARROW-13257) [Java][Dataset] Allow passing empty columns for projection

2021-07-05 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-13257: Summary: [Java][Dataset] Allow passing empty columns for projection Key: ARROW-13257 URL: https://issues.apache.org/jira/browse/ARROW-13257 Project: Apache Arrow

[jira] [Updated] (ARROW-13166) [Java] Java Dataset API ScanOptions expansion

2021-06-29 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-13166: - Summary: [Java] Java Dataset API ScanOptions expansion (was: Java Dataset API ScanOptions

[jira] [Commented] (ARROW-13166) Java Dataset API ScanOptions expansion

2021-06-29 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17371433#comment-17371433 ] Hongze Zhang commented on ARROW-13166: -- Thanks Sebastiaan! As long as the option is defined in C++

[jira] [Commented] (ARROW-6720) [JAVA][C++]Support Parquet Read and Write in Java

2021-06-04 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-6720?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17357165#comment-17357165 ] Hongze Zhang commented on ARROW-6720: - Added issue links for Java Dataset read API and write API. >

[jira] [Created] (ARROW-12965) [Java][C++] Java implementation of Arrow C data interface

2021-06-04 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-12965: Summary: [Java][C++] Java implementation of Arrow C data interface Key: ARROW-12965 URL: https://issues.apache.org/jira/browse/ARROW-12965 Project: Apache Arrow

[jira] [Created] (ARROW-12905) [Java] Adapt to Java 9/9+ automatic module system

2021-05-29 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-12905: Summary: [Java] Adapt to Java 9/9+ automatic module system Key: ARROW-12905 URL: https://issues.apache.org/jira/browse/ARROW-12905 Project: Apache Arrow

[jira] [Comment Edited] (ARROW-7272) [C++][Java] JNI bridge between RecordBatch and VectorSchemaRoot

2021-05-21 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16993151#comment-16993151 ] Hongze Zhang edited comment on ARROW-7272 at 5/22/21, 4:46 AM: --- -Hi guys,

[jira] [Created] (ARROW-12607) [Website] Doc section for Dataset Java bindings

2021-04-30 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-12607: Summary: [Website] Doc section for Dataset Java bindings Key: ARROW-12607 URL: https://issues.apache.org/jira/browse/ARROW-12607 Project: Apache Arrow Issue

[jira] [Updated] (ARROW-11776) [Java][Dataset] Support writing to files within dataset scanner via JNI

2021-04-20 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11776?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-11776: - Summary: [Java][Dataset] Support writing to files within dataset scanner via JNI (was:

[jira] [Updated] (ARROW-9646) [C++][Dataset] Add support for writing parquet datasets

2021-04-20 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-9646: Summary: [C++][Dataset] Add support for writing parquet datasets (was: [C++][Dataset] Support

[jira] [Updated] (ARROW-9646) [C++][Dataset] Support writing to files within dataset scanner via JNI

2021-04-20 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-9646: Summary: [C++][Dataset] Support writing to files within dataset scanner via JNI (was:

[jira] [Created] (ARROW-12481) [Java][Dataset] FileSystemDataset: Support reading dictionary arrays

2021-04-20 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-12481: Summary: [Java][Dataset] FileSystemDataset: Support reading dictionary arrays Key: ARROW-12481 URL: https://issues.apache.org/jira/browse/ARROW-12481 Project: Apache

[jira] [Created] (ARROW-12480) [Java][Dataset] FileSystemDataset: Support reading from a directory

2021-04-20 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-12480: Summary: [Java][Dataset] FileSystemDataset: Support reading from a directory Key: ARROW-12480 URL: https://issues.apache.org/jira/browse/ARROW-12480 Project: Apache

[jira] [Closed] (ARROW-11143) [C++] Support status return for method MemoryPool::Free

2021-02-25 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang closed ARROW-11143. Resolution: Won't Fix I'm closing this. Thanks Antoine and Wes. > [C++] Support status return

[jira] [Created] (ARROW-11776) [Java][Dataset] Writing support for Dataset API

2021-02-24 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-11776: Summary: [Java][Dataset] Writing support for Dataset API Key: ARROW-11776 URL: https://issues.apache.org/jira/browse/ARROW-11776 Project: Apache Arrow Issue

[jira] [Created] (ARROW-11143) [C++] Support status return for method MemoryPool::Free

2021-01-06 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-11143: Summary: [C++] Support status return for method MemoryPool::Free Key: ARROW-11143 URL: https://issues.apache.org/jira/browse/ARROW-11143 Project: Apache Arrow

[jira] [Updated] (ARROW-7808) [Java][Dataset] Implement Datasets Java API

2020-11-04 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-7808: Fix Version/s: 3.0.0 I've temporarily marked this with target release 3.0.0 as most of the codes

[jira] [Updated] (ARROW-9737) [C++][Gandiva] Add bitwise_xor() for integers

2020-08-14 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-9737: Summary: [C++][Gandiva] Add bitwise_xor() for integers (was: [C++][Gandiva] Add bitwise_or() for

[jira] [Created] (ARROW-9737) [C++][Gandiva] Add bitwise_or() for integers

2020-08-14 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-9737: --- Summary: [C++][Gandiva] Add bitwise_or() for integers Key: ARROW-9737 URL: https://issues.apache.org/jira/browse/ARROW-9737 Project: Apache Arrow Issue Type:

[jira] [Updated] (ARROW-9475) Clean up usages of BaseAllocator, use BufferAllocator instead

2020-07-15 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-9475: Component/s: Java > Clean up usages of BaseAllocator, use BufferAllocator instead >

[jira] [Updated] (ARROW-9475) [Java] Clean up usages of BaseAllocator, use BufferAllocator instead

2020-07-15 Thread Hongze Zhang (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongze Zhang updated ARROW-9475: Summary: [Java] Clean up usages of BaseAllocator, use BufferAllocator instead (was: Clean up

[jira] [Created] (ARROW-9475) Clean up usages of BaseAllocator, use BufferAllocator instead

2020-07-15 Thread Hongze Zhang (Jira)
Hongze Zhang created ARROW-9475: --- Summary: Clean up usages of BaseAllocator, use BufferAllocator instead Key: ARROW-9475 URL: https://issues.apache.org/jira/browse/ARROW-9475 Project: Apache Arrow