[jira] [Resolved] (ARROW-15501) [Java] Support validating decimal vectors

2022-02-18 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan resolved ARROW-15501. -- Fix Version/s: 8.0.0 Resolution: Fixed Issue resolved by pull request 12294

[jira] [Resolved] (ARROW-15502) [Java] Detect exceptional footer size in Arrow file reader

2022-02-18 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan resolved ARROW-15502. -- Fix Version/s: 8.0.0 Resolution: Fixed Issue resolved by pull request 12296

[jira] [Created] (ARROW-15562) [Java] FuzzIpcStream: Uncaught exception in java.base/java.nio.Bits.reserveMemory

2022-02-03 Thread Liya Fan (Jira)
Liya Fan created ARROW-15562: Summary: [Java] FuzzIpcStream: Uncaught exception in java.base/java.nio.Bits.reserveMemory Key: ARROW-15562 URL: https://issues.apache.org/jira/browse/ARROW-15562 Project:

[jira] [Created] (ARROW-15561) [Java] FuzzIpcStream: Uncaught exception in org.apache.arrow.memory.BaseAllocator.buffer

2022-02-03 Thread Liya Fan (Jira)
Liya Fan created ARROW-15561: Summary: [Java] FuzzIpcStream: Uncaught exception in org.apache.arrow.memory.BaseAllocator.buffer Key: ARROW-15561 URL: https://issues.apache.org/jira/browse/ARROW-15561

[jira] [Created] (ARROW-15560) [Java] FuzzIpcStream: Uncaught exception in java.base/java.nio.Buffer.createCapacityException

2022-02-03 Thread Liya Fan (Jira)
Liya Fan created ARROW-15560: Summary: [Java] FuzzIpcStream: Uncaught exception in java.base/java.nio.Buffer.createCapacityException Key: ARROW-15560 URL: https://issues.apache.org/jira/browse/ARROW-15560

[jira] [Created] (ARROW-15559) [Java] FuzzIpcFile: Uncaught exception in org.apache.arrow.vector.types.pojo.Schema.convertSchema

2022-02-03 Thread Liya Fan (Jira)
Liya Fan created ARROW-15559: Summary: [Java] FuzzIpcFile: Uncaught exception in org.apache.arrow.vector.types.pojo.Schema.convertSchema Key: ARROW-15559 URL: https://issues.apache.org/jira/browse/ARROW-15559

[jira] [Created] (ARROW-15558) [Java] FuzzIpcFile: Uncaught exception in java.base/java.nio.Buffer.checkIndex

2022-02-03 Thread Liya Fan (Jira)
Liya Fan created ARROW-15558: Summary: [Java] FuzzIpcFile: Uncaught exception in java.base/java.nio.Buffer.checkIndex Key: ARROW-15558 URL: https://issues.apache.org/jira/browse/ARROW-15558 Project:

[jira] [Created] (ARROW-15557) [Java] FuzzIpcFile: Uncaught exception in java.base/java.nio.HeapByteBuffer.

2022-02-03 Thread Liya Fan (Jira)
Liya Fan created ARROW-15557: Summary: [Java] FuzzIpcFile: Uncaught exception in java.base/java.nio.HeapByteBuffer. Key: ARROW-15557 URL: https://issues.apache.org/jira/browse/ARROW-15557 Project: Apache

[jira] [Created] (ARROW-15502) [Java] Detect exceptional footer size in Arrow file reader

2022-01-29 Thread Liya Fan (Jira)
Liya Fan created ARROW-15502: Summary: [Java] Detect exceptional footer size in Arrow file reader Key: ARROW-15502 URL: https://issues.apache.org/jira/browse/ARROW-15502 Project: Apache Arrow

[jira] [Created] (ARROW-15501) [Java] Support validating decimal vectors

2022-01-29 Thread Liya Fan (Jira)
Liya Fan created ARROW-15501: Summary: [Java] Support validating decimal vectors Key: ARROW-15501 URL: https://issues.apache.org/jira/browse/ARROW-15501 Project: Apache Arrow Issue Type: New

[jira] [Resolved] (ARROW-15414) RangeEqualsVisitor does not work for BitVector

2022-01-24 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan resolved ARROW-15414. -- Fix Version/s: 7.0.0 Resolution: Fixed Issue resolved by pull request 12229

[jira] [Comment Edited] (ARROW-5926) [Java] Test fuzzer inputs

2022-01-24 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479877#comment-17479877 ] Liya Fan edited comment on ARROW-5926 at 1/24/22, 1:13 PM: --- A PR is submitted

[jira] [Commented] (ARROW-5926) [Java] Test fuzzer inputs

2022-01-20 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17479877#comment-17479877 ] Liya Fan commented on ARROW-5926: - A PR is submitted to oss-fuzz

[jira] [Comment Edited] (ARROW-15259) [Java] [Benchmarking] Large stdout when running benchmarks

2022-01-14 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476112#comment-17476112 ] Liya Fan edited comment on ARROW-15259 at 1/14/22, 12:40 PM: - Sorry

[jira] [Commented] (ARROW-15259) [Java] [Benchmarking] Large stdout when running benchmarks

2022-01-14 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17476112#comment-17476112 ] Liya Fan commented on ARROW-15259: -- Sorry [~el...@ursacomputing.com] I am having some problems running

[jira] [Commented] (ARROW-15259) [Java] [Benchmarking] Large stdout when running benchmarks

2022-01-06 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17470293#comment-17470293 ] Liya Fan commented on ARROW-15259: -- [~el...@ursacomputing.com] Sorry, I do not understand how the large

[jira] [Resolved] (ARROW-15058) [Java] Remove log4j2 dependency in performance module

2021-12-21 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan resolved ARROW-15058. -- Fix Version/s: 6.0.1 Resolution: Fixed Issue resolved by pull request 11986

[jira] [Updated] (ARROW-15058) [Java] Remove log4j2 dependency in performance module

2021-12-19 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan updated ARROW-15058: - Summary: [Java] Remove log4j2 dependency in performance module (was: [Java] Update log4j2 version to

[jira] [Commented] (ARROW-15058) [Java] Update log4j2 version to 2.15.0 in performance module

2021-12-19 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17462354#comment-17462354 ] Liya Fan commented on ARROW-15058: -- [~dsusanibara] Thanks for the good point. PR updated, please check.

[jira] [Updated] (ARROW-15058) [Java] Update log4j2 version to 2.15.0 in performance module

2021-12-17 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan updated ARROW-15058: - Priority: Critical (was: Major) > [Java] Update log4j2 version to 2.15.0 in performance module >

[jira] [Commented] (ARROW-15058) [Java] Update log4j2 version to 2.15.0 in performance module

2021-12-17 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17461383#comment-17461383 ] Liya Fan commented on ARROW-15058: -- [~ana4] Thanks for reporting the problem. It should be fixed ASAP.

[jira] [Assigned] (ARROW-15058) [Java] Update log4j2 version to 2.15.0 in performance module

2021-12-17 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15058?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan reassigned ARROW-15058: Assignee: Liya Fan > [Java] Update log4j2 version to 2.15.0 in performance module >

[jira] [Resolved] (ARROW-13811) [Java] Provide a general out-of-place sorter

2021-12-03 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan resolved ARROW-13811. -- Fix Version/s: 7.0.0 Resolution: Fixed Issue resolved by pull request 11035

[jira] [Created] (ARROW-14696) [Java] Reset vectors before populating JDBC data when reusing vector schema root

2021-11-12 Thread Liya Fan (Jira)
Liya Fan created ARROW-14696: Summary: [Java] Reset vectors before populating JDBC data when reusing vector schema root Key: ARROW-14696 URL: https://issues.apache.org/jira/browse/ARROW-14696 Project:

[jira] [Resolved] (ARROW-13981) [Java] VectorSchemaRootAppender doesn't work for BitVector

2021-10-23 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan resolved ARROW-13981. -- Fix Version/s: 6.0.0 Resolution: Fixed Issue resolved by pull request 11317

[jira] [Assigned] (ARROW-13981) [Java] VectorSchemaRootAppender doesn't work for BitVector

2021-10-05 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan reassigned ARROW-13981: Assignee: Liya Fan > [Java] VectorSchemaRootAppender doesn't work for BitVector >

[jira] [Commented] (ARROW-13981) [Java] VectorSchemaRootAppender doesn't work for BitVector

2021-10-05 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17424398#comment-17424398 ] Liya Fan commented on ARROW-13981: -- [~tzhang] I have provided a patch for the BitVector. Please check.

[jira] [Commented] (ARROW-13981) [Java] VectorSchemaRootAppender doesn't work for BitVector

2021-09-25 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17420106#comment-17420106 ] Liya Fan commented on ARROW-13981: -- [~tzhang] Thanks for the additional information. I will conduct

[jira] [Commented] (ARROW-13981) [Java] VectorSchemaRootAppender doesn't work for BitVector

2021-09-24 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17419828#comment-17419828 ] Liya Fan commented on ARROW-13981: -- [~tzhang] Thanks for reporting the problem. It is a bug that needs

[jira] [Resolved] (ARROW-13872) [Java] ExtensionTypeVector does not work with RangeEqualsVisitor

2021-09-08 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan resolved ARROW-13872. -- Fix Version/s: 6.0.0 Resolution: Fixed Issue resolved by pull request 11073

[jira] [Updated] (ARROW-13811) [Java] Provide a general out-of-place sorter

2021-08-31 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan updated ARROW-13811: - Description: The sorter should work for any type of vectors, with a time complexity of O(n*log( n )).

[jira] [Created] (ARROW-13811) [Java] Provide a general out-of-place sorter

2021-08-31 Thread Liya Fan (Jira)
Liya Fan created ARROW-13811: Summary: [Java] Provide a general out-of-place sorter Key: ARROW-13811 URL: https://issues.apache.org/jira/browse/ARROW-13811 Project: Apache Arrow Issue Type: New

[jira] [Created] (ARROW-13792) [Java] The toString representation is incorrect for unsigned integer vectors

2021-08-30 Thread Liya Fan (Jira)
Liya Fan created ARROW-13792: Summary: [Java] The toString representation is incorrect for unsigned integer vectors Key: ARROW-13792 URL: https://issues.apache.org/jira/browse/ARROW-13792 Project: Apache

[jira] [Resolved] (ARROW-13645) [Java] Allow NullVectors to have distinct field names

2021-08-25 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan resolved ARROW-13645. -- Resolution: Fixed Issue resolved by pull request 10949 [https://github.com/apache/arrow/pull/10949]

[jira] [Created] (ARROW-13733) [Java] Allow JDBC adapters to reuse vector schema roots

2021-08-24 Thread Liya Fan (Jira)
Liya Fan created ARROW-13733: Summary: [Java] Allow JDBC adapters to reuse vector schema roots Key: ARROW-13733 URL: https://issues.apache.org/jira/browse/ARROW-13733 Project: Apache Arrow Issue

[jira] [Updated] (ARROW-13645) [Java] Allow NullVectors to have distinct field names

2021-08-19 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan updated ARROW-13645: - Description: As discussed in the ML

[jira] [Resolved] (ARROW-13481) [JAVA][VECTOR]: stream write/read when writing batches of different row count

2021-08-18 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan resolved ARROW-13481. -- Resolution: Not A Problem > [JAVA][VECTOR]: stream write/read when writing batches of different row

[jira] [Comment Edited] (ARROW-13481) [JAVA][VECTOR]: stream write/read when writing batches of different row count

2021-08-18 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401424#comment-17401424 ] Liya Fan edited comment on ARROW-13481 at 8/19/21, 2:02 AM: As indicated by

[jira] [Commented] (ARROW-13481) [JAVA][VECTOR]: stream write/read when writing batches of different row count

2021-08-18 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17401424#comment-17401424 ] Liya Fan commented on ARROW-13481: -- As indicated by @awalga, the row count of the batch must be set

[jira] [Updated] (ARROW-13645) [Java] Allow NullVectors to have distinct field names

2021-08-17 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan updated ARROW-13645: - Description: As discussed in the ML

[jira] [Created] (ARROW-13645) [Java] Allow NullVectors to have distinct field names

2021-08-17 Thread Liya Fan (Jira)
Liya Fan created ARROW-13645: Summary: [Java] Allow NullVectors to have distinct field names Key: ARROW-13645 URL: https://issues.apache.org/jira/browse/ARROW-13645 Project: Apache Arrow Issue

[jira] [Created] (ARROW-13604) [Java] Remove deprecation annotations for APIs representing unsupported operations

2021-08-11 Thread Liya Fan (Jira)
Liya Fan created ARROW-13604: Summary: [Java] Remove deprecation annotations for APIs representing unsupported operations Key: ARROW-13604 URL: https://issues.apache.org/jira/browse/ARROW-13604 Project:

[jira] [Created] (ARROW-13544) [Java] Remove APIs that have been deprecated for long

2021-08-04 Thread Liya Fan (Jira)
Liya Fan created ARROW-13544: Summary: [Java] Remove APIs that have been deprecated for long Key: ARROW-13544 URL: https://issues.apache.org/jira/browse/ARROW-13544 Project: Apache Arrow Issue

[jira] [Commented] (ARROW-13481) [JAVA][VECTOR]: stream write/read when writing batches of different row count

2021-07-30 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17390437#comment-17390437 ] Liya Fan commented on ARROW-13481: -- [~awalga] Do you want to provide a patch? > [JAVA][VECTOR]: stream

[jira] [Created] (ARROW-13443) [C++] Fix the incorrect mapping from flatbuf::MetadataVersion to arrow::ipc::MetadataVersion

2021-07-26 Thread Liya Fan (Jira)
Liya Fan created ARROW-13443: Summary: [C++] Fix the incorrect mapping from flatbuf::MetadataVersion to arrow::ipc::MetadataVersion Key: ARROW-13443 URL: https://issues.apache.org/jira/browse/ARROW-13443

[jira] [Resolved] (ARROW-13306) [Java][JDBC] use ResultSetMetaData.getColumnLabel instead of ResultSetMetaData.getColumnName

2021-07-19 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan resolved ARROW-13306. -- Fix Version/s: 5.0.0 Resolution: Fixed Issue resolved by pull request 10700

[jira] [Commented] (ARROW-5926) [Java] Test fuzzer inputs

2021-07-07 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17376290#comment-17376290 ] Liya Fan commented on ARROW-5926: - [~emkornfield] Sounds reasonable. > [Java] Test fuzzer inputs >

[jira] [Resolved] (ARROW-13194) [Java][Document] Create prose document about Java algorithms

2021-07-04 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan resolved ARROW-13194. -- Fix Version/s: 5.0.0 Resolution: Fixed Issue resolved by pull request 10617

[jira] [Resolved] (ARROW-13147) [Java] Respect the rounding policy when allocating vector buffers

2021-07-04 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan resolved ARROW-13147. -- Fix Version/s: 5.0.0 Resolution: Fixed Issue resolved by pull request 10576

[jira] [Commented] (ARROW-5926) [Java] Test fuzzer inputs

2021-07-01 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17373159#comment-17373159 ] Liya Fan commented on ARROW-5926: - As the validation feature is available now, I will check our current

[jira] [Assigned] (ARROW-5926) [Java] Test fuzzer inputs

2021-07-01 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-5926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan reassigned ARROW-5926: --- Assignee: Liya Fan > [Java] Test fuzzer inputs > - > > Key:

[jira] [Updated] (ARROW-13194) [Java][Document] Create prose document about Java algorithms

2021-06-28 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan updated ARROW-13194: - Description: The document should include the basics of comparing vector elements, searching values in a

[jira] [Updated] (ARROW-13194) [Java][Document] Create prose document about Java algorithms

2021-06-28 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan updated ARROW-13194: - Description: The document should > [Java][Document] Create prose document about Java algorithms >

[jira] [Assigned] (ARROW-13194) [Java][Document] Create prose document about Java algorithms

2021-06-28 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan reassigned ARROW-13194: Assignee: Liya Fan > [Java][Document] Create prose document about Java algorithms >

[jira] [Created] (ARROW-13194) [Java]]

2021-06-28 Thread Liya Fan (Jira)
Liya Fan created ARROW-13194: Summary: [Java]] Key: ARROW-13194 URL: https://issues.apache.org/jira/browse/ARROW-13194 Project: Apache Arrow Issue Type: New Feature Reporter: Liya

[jira] [Updated] (ARROW-13194) [Java][Document] Create prose document about Java algorithms

2021-06-28 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan updated ARROW-13194: - Summary: [Java][Document] Create prose document about Java algorithms (was: [Java]]) >

[jira] [Created] (ARROW-13147) [Java] Respect the rounding policy when allocating vector buffers

2021-06-23 Thread Liya Fan (Jira)
Liya Fan created ARROW-13147: Summary: [Java] Respect the rounding policy when allocating vector buffers Key: ARROW-13147 URL: https://issues.apache.org/jira/browse/ARROW-13147 Project: Apache Arrow

[jira] [Resolved] (ARROW-12907) [Java] Memory leak possible when exception reading from channel happens

2021-06-03 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan resolved ARROW-12907. -- Fix Version/s: 5.0.0 Resolution: Fixed Issue resolved by pull request 10423

[jira] [Resolved] (ARROW-12679) [Java] JDBC adapter does not preserve SQL-nullability

2021-05-16 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan resolved ARROW-12679. -- Fix Version/s: 5.0.0 Resolution: Fixed Issue resolved by pull request 10285

[jira] [Commented] (ARROW-8672) [Java] Implement RecordBatch IPC buffer compression from ARROW-300

2021-05-12 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343223#comment-17343223 ] Liya Fan commented on ARROW-8672: - Make sense. So it should be reasonable to close this issue now. >

[jira] [Commented] (ARROW-8672) [Java] Implement RecordBatch IPC buffer compression from ARROW-300

2021-05-12 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343217#comment-17343217 ] Liya Fan commented on ARROW-8672: - Almost. I think there are still some performance tuning and clean-up

[jira] [Commented] (ARROW-8672) [Java] Implement RecordBatch IPC buffer compression from ARROW-300

2021-05-12 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-8672?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17343201#comment-17343201 ] Liya Fan commented on ARROW-8672: - [~apitrou] We have already supported it in ARROW-12110. I have linked

[jira] [Commented] (ARROW-12377) [Doc][Java] Java doc build broken

2021-04-15 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17321980#comment-17321980 ] Liya Fan commented on ARROW-12377: -- The build failed because: {noformat} [ERROR] Failed to execute goal

[jira] [Created] (ARROW-12310) [Java] ValueVector#getObject should support covariance for complex types

2021-04-09 Thread Liya Fan (Jira)
Liya Fan created ARROW-12310: Summary: [Java] ValueVector#getObject should support covariance for complex types Key: ARROW-12310 URL: https://issues.apache.org/jira/browse/ARROW-12310 Project: Apache

[jira] [Commented] (ARROW-7779) [Java] Enable integration tests for dictionaries-within-dictionaries

2021-04-09 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-7779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17317743#comment-17317743 ] Liya Fan commented on ARROW-7779: - I can provide help if needed. > [Java] Enable integration tests for

[jira] [Resolved] (ARROW-12012) [Java] [JDBC] BinaryConsumer cannot reallocate memory correctly

2021-03-23 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan resolved ARROW-12012. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 9744

[jira] [Commented] (ARROW-11901) [Java] Investigate potential performance improvement of compression codec

2021-03-19 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11901?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17304790#comment-17304790 ] Liya Fan commented on ARROW-11901: -- [~bobtinsman] Thanks for your valuable input. It seems Airlift

[jira] [Commented] (ARROW-9513) [Java] Improve documentation in regards to basic-usage / memory-management

2021-03-18 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-9513?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17303899#comment-17303899 ] Liya Fan commented on ARROW-9513: - [~benmosher] Thanks for your feedback. Your comments about

[jira] [Updated] (ARROW-12006) updates to make dev on Java and Windows easier

2021-03-17 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-12006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan updated ARROW-12006: - Priority: Major (was: Minor) > updates to make dev on Java and Windows easier >

[jira] [Created] (ARROW-11999) [Java] Support parallel vector element search with user-specified comparator

2021-03-17 Thread Liya Fan (Jira)
Liya Fan created ARROW-11999: Summary: [Java] Support parallel vector element search with user-specified comparator Key: ARROW-11999 URL: https://issues.apache.org/jira/browse/ARROW-11999 Project: Apache

[jira] [Created] (ARROW-11901) [Java] Investigate potential performance improvement of compression codec

2021-03-07 Thread Liya Fan (Jira)
Liya Fan created ARROW-11901: Summary: [Java] Investigate potential performance improvement of compression codec Key: ARROW-11901 URL: https://issues.apache.org/jira/browse/ARROW-11901 Project: Apache

[jira] [Created] (ARROW-11899) [Java] Refactor the compression codec implementation into core/Arrow specific parts

2021-03-07 Thread Liya Fan (Jira)
Liya Fan created ARROW-11899: Summary: [Java] Refactor the compression codec implementation into core/Arrow specific parts Key: ARROW-11899 URL: https://issues.apache.org/jira/browse/ARROW-11899 Project:

[jira] [Resolved] (ARROW-11788) [Java] Appending Empty List Vector yields NPE

2021-02-28 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan resolved ARROW-11788. -- Fix Version/s: 4.0.0 Resolution: Fixed Issue resolved by pull request 9581

[jira] [Resolved] (ARROW-11193) [Documentation] Add docs for Java ListVector

2021-01-17 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11193?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan resolved ARROW-11193. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 9142

[jira] [Resolved] (ARROW-11114) [Java] Metadata serialization is broken for Field class

2021-01-07 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-4?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan resolved ARROW-4. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 9088

[jira] [Assigned] (ARROW-10962) [Java][FlightRPC] FlightData deserializer should accept missing fields

2021-01-07 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan reassigned ARROW-10962: Assignee: David Li > [Java][FlightRPC] FlightData deserializer should accept missing fields >

[jira] [Resolved] (ARROW-10962) [Java][FlightRPC] FlightData deserializer should accept missing fields

2021-01-07 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan resolved ARROW-10962. -- Resolution: Fixed Issue resolved by pull request 8963 [https://github.com/apache/arrow/pull/8963] >

[jira] [Commented] (ARROW-11114) [Java] Metadata serialization is broken for Field class

2021-01-03 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-4?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17257889#comment-17257889 ] Liya Fan commented on ARROW-4: -- [~nickb611] Thanks for reporting the problem. It seems likes a bug.

[jira] [Created] (ARROW-11081) [Java] Make IPC option immutable

2020-12-30 Thread Liya Fan (Jira)
Liya Fan created ARROW-11081: Summary: [Java] Make IPC option immutable Key: ARROW-11081 URL: https://issues.apache.org/jira/browse/ARROW-11081 Project: Apache Arrow Issue Type: Improvement

[jira] [Commented] (ARROW-10957) Expanding pyarrow buffer size more than 2GB for pandas_udf functions

2020-12-29 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255968#comment-17255968 ] Liya Fan commented on ARROW-10957: -- Sure. Please find the test case here:

[jira] [Commented] (ARROW-10957) Expanding pyarrow buffer size more than 2GB for pandas_udf functions

2020-12-27 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17255385#comment-17255385 ] Liya Fan commented on ARROW-10957: -- [~dishka_krauch] Sorry for my late reply. I am not farmiliar with

[jira] [Commented] (ARROW-10957) Expanding pyarrow buffer size more than 2GB for pandas_udf functions

2020-12-23 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17254054#comment-17254054 ] Liya Fan commented on ARROW-10957: -- [~dishka_krauch] Thanks for the information. I can take a look

[jira] [Commented] (ARROW-10957) Expanding pyarrow buffer size more than 2GB for pandas_udf functions

2020-12-22 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17253444#comment-17253444 ] Liya Fan commented on ARROW-10957: -- [~dishka_krauch] Sorry I don't know how to help. It seems difficult

[jira] [Commented] (ARROW-10957) Expanding pyarrow buffer size more than 2GB for pandas_udf functions

2020-12-21 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252829#comment-17252829 ] Liya Fan commented on ARROW-10957: -- Yes. I have copied the stack trace of the original exception:

[jira] [Commented] (ARROW-10957) Expanding pyarrow buffer size more than 2GB for pandas_udf functions

2020-12-20 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10957?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17252575#comment-17252575 ] Liya Fan commented on ARROW-10957: -- [~dishka_krauch] I guess the reason is that the metadata size for

[jira] [Commented] (ARROW-4890) [Python] Spark+Arrow Grouped pandas UDAF - read length must be positive or -1

2020-12-18 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-4890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251693#comment-17251693 ] Liya Fan commented on ARROW-4890: - I think some discussions are needed. > [Python] Spark+Arrow Grouped

[jira] [Commented] (ARROW-4890) [Python] Spark+Arrow Grouped pandas UDAF - read length must be positive or -1

2020-12-18 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-4890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251653#comment-17251653 ] Liya Fan commented on ARROW-4890: - {{ARROW_PRE_0_15_IPC_FORMAT}} controls the {{write_legacy_ipc_format}}

[jira] [Commented] (ARROW-4890) [Python] Spark+Arrow Grouped pandas UDAF - read length must be positive or -1

2020-12-17 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-4890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251544#comment-17251544 ] Liya Fan commented on ARROW-4890: - [~emkornfield] You are right. According to the above stack trace, the

[jira] [Commented] (ARROW-4890) [Python] Spark+Arrow Grouped pandas UDAF - read length must be positive or -1

2020-12-17 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-4890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17251535#comment-17251535 ] Liya Fan commented on ARROW-4890: - [~dishka_krauch] Thanks for the detailed information. It seems the

[jira] [Commented] (ARROW-4890) [Python] Spark+Arrow Grouped pandas UDAF - read length must be positive or -1

2020-12-16 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-4890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250862#comment-17250862 ] Liya Fan commented on ARROW-4890: - [~dishka_krauch] The problem occured during IPC from python to Java? I

[jira] [Commented] (ARROW-4890) [Python] Spark+Arrow Grouped pandas UDAF - read length must be positive or -1

2020-12-16 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-4890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17250749#comment-17250749 ] Liya Fan commented on ARROW-4890: - [~dishka_krauch] It is difficult to find the cause without providing

[jira] [Commented] (ARROW-10853) [Java] Undeprecate sqlToArrow helpers

2020-12-13 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17248739#comment-17248739 ] Liya Fan commented on ARROW-10853: -- [~uwe] Thanks a lot for your feedback. By setting

[jira] [Created] (ARROW-10880) [Java] Support compressing RecordBatch IPC buffers by LZ4

2020-12-11 Thread Liya Fan (Jira)
Liya Fan created ARROW-10880: Summary: [Java] Support compressing RecordBatch IPC buffers by LZ4 Key: ARROW-10880 URL: https://issues.apache.org/jira/browse/ARROW-10880 Project: Apache Arrow

[jira] [Resolved] (ARROW-10860) [Java] Avoid integer overflow for generated classes in Vector

2020-12-09 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan resolved ARROW-10860. -- Fix Version/s: 3.0.0 Resolution: Fixed Issue resolved by pull request 8876

[jira] [Assigned] (ARROW-10860) [Java] Avoid integer overflow for generated classes in Vector

2020-12-09 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan reassigned ARROW-10860: Assignee: Kazuaki Ishizaki > [Java] Avoid integer overflow for generated classes in Vector >

[jira] [Updated] (ARROW-10860) [Java] Avoid integer overflow for generated classes in Vector

2020-12-09 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liya Fan updated ARROW-10860: - Summary: [Java] Avoid integer overflow for generated classes in Vector (was: [Java] Avoid integer

[jira] [Comment Edited] (ARROW-10762) [Java] Configuration does not provide a mapping for array column

2020-12-02 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17242879#comment-17242879 ] Liya Fan edited comment on ARROW-10762 at 12/3/20, 3:10 AM: [~dclong] Sure

[jira] [Commented] (ARROW-10762) [Java] Configuration does not provide a mapping for array column

2020-12-02 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17242879#comment-17242879 ] Liya Fan commented on ARROW-10762: -- [~dclong] Sure we have a default mapping, which can be found here

[jira] [Commented] (ARROW-10762) Configuration does not provide a mapping for array column

2020-12-02 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17242279#comment-17242279 ] Liya Fan commented on ARROW-10762: -- Yes. An example can be found in {{JdbcToArrowVectorIteratorTest}}

[jira] [Commented] (ARROW-10762) Configuration does not provide a mapping for array column

2020-11-30 Thread Liya Fan (Jira)
[ https://issues.apache.org/jira/browse/ARROW-10762?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17241296#comment-17241296 ] Liya Fan commented on ARROW-10762: -- This issue may be fixed by the patch for ARROW-10492. >

  1   2   >