[jira] [Created] (ARROW-6221) [Java] Improve the performance of RangeEqualVisitor for comparing variable-width vectors

2019-08-12 Thread Liya Fan (JIRA)
Liya Fan created ARROW-6221: --- Summary: [Java] Improve the performance of RangeEqualVisitor for comparing variable-width vectors Key: ARROW-6221 URL: https://issues.apache.org/jira/browse/ARROW-6221

Re: Running an Arrow hackathon

2019-08-12 Thread Micah Kornfield
Hi David, This is cool, thank you for doing it. My thoughts: > - Is there a label we already use for easy-to-start-with issues? I see > variations on newbie/easy-fix/beginner on JIRA, is there a preference > for one? I think beginner would be my preferred label. Note that I don't think it has

[jira] [Created] (ARROW-6220) [Java] Add API to avro adapter to limit number of rows returned at a time.

2019-08-12 Thread Micah Kornfield (JIRA)
Micah Kornfield created ARROW-6220: -- Summary: [Java] Add API to avro adapter to limit number of rows returned at a time. Key: ARROW-6220 URL: https://issues.apache.org/jira/browse/ARROW-6220

[jira] [Created] (ARROW-6219) [Java] Add API for JDBC adapter that can convert less then the full result set at a time.

2019-08-12 Thread Micah Kornfield (JIRA)
Micah Kornfield created ARROW-6219: -- Summary: [Java] Add API for JDBC adapter that can convert less then the full result set at a time. Key: ARROW-6219 URL: https://issues.apache.org/jira/browse/ARROW-6219

[jira] [Created] (ARROW-6218) [Java] Add UINT type test in integration to avoid potential overflow

2019-08-12 Thread Ji Liu (JIRA)
Ji Liu created ARROW-6218: - Summary: [Java] Add UINT type test in integration to avoid potential overflow Key: ARROW-6218 URL: https://issues.apache.org/jira/browse/ARROW-6218 Project: Apache Arrow

Re: [Discussion][Java] Redesign the dictionary encoder

2019-08-12 Thread Micah Kornfield
Hi Liya Fan, Ji Liu has an open pull request [1] that refactors the existing implementation to address the re-use aspect. I think it can also be extended to fix the memory ownership problem you highlighted. More work would need to be address to address the customizable hash customizable hash.

[jira] [Created] (ARROW-6217) [Website] Remove needless _site/ directory

2019-08-12 Thread Sutou Kouhei (JIRA)
Sutou Kouhei created ARROW-6217: --- Summary: [Website] Remove needless _site/ directory Key: ARROW-6217 URL: https://issues.apache.org/jira/browse/ARROW-6217 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-6216) Allow user to select the ZSTD compression level

2019-08-12 Thread Martin Radev (JIRA)
Martin Radev created ARROW-6216: --- Summary: Allow user to select the ZSTD compression level Key: ARROW-6216 URL: https://issues.apache.org/jira/browse/ARROW-6216 Project: Apache Arrow Issue

[jira] [Created] (ARROW-6215) [Java] RangeEqualVisitor does not properly compare ZeroVector

2019-08-12 Thread Bryan Cutler (JIRA)
Bryan Cutler created ARROW-6215: --- Summary: [Java] RangeEqualVisitor does not properly compare ZeroVector Key: ARROW-6215 URL: https://issues.apache.org/jira/browse/ARROW-6215 Project: Apache Arrow

[jira] [Created] (ARROW-6214) Sanitizer errors triggered via R bindings

2019-08-12 Thread Jeroen (JIRA)
Jeroen created ARROW-6214: - Summary: Sanitizer errors triggered via R bindings Key: ARROW-6214 URL: https://issues.apache.org/jira/browse/ARROW-6214 Project: Apache Arrow Issue Type: Bug

Re: [DISCUSS] Developing a "data frame" subproject in the Arrow C++ libraries

2019-08-12 Thread Wes McKinney
hi Eric -- there have not been any patches yet related to it. I'm currently in the midst of some internal restructuring of the Parquet C++ library to address long-standing efficiency and memory use issues. It's my intention to spend time on the data frame project as one of my next focus areas,

RE: [DISCUSS] Developing a "data frame" subproject in the Arrow C++ libraries

2019-08-12 Thread Eric Erhardt
Hey Wes, I just wanted to check-in on this work. Have there been any updates to the Arrow "data frame" project worth sharing? Thanks, Eric -Original Message- From: Wes McKinney Sent: Tuesday, May 21, 2019 8:17 AM To: dev@arrow.apache.org Subject: Re: [DISCUSS] Developing a "data

[jira] [Created] (ARROW-6213) C++ tests fails for AVX512

2019-08-12 Thread Charles Coulombe (JIRA)
Charles Coulombe created ARROW-6213: --- Summary: C++ tests fails for AVX512 Key: ARROW-6213 URL: https://issues.apache.org/jira/browse/ARROW-6213 Project: Apache Arrow Issue Type: Bug

Re: Proposal to move website source to arrow-site, add automatic builds

2019-08-12 Thread Neal Richardson
I started https://github.com/apache/arrow/pull/5015 for the removal last week; will finish that up today or tomorrow. Neal On Sun, Aug 11, 2019 at 8:23 AM Wes McKinney wrote: > > It looks like the git pruning is done. So we can remove the site/ > directory from the main repository at some point

Running an Arrow hackathon

2019-08-12 Thread David Li
Hi all, We're thinking of hosting an internal open-source hackathon in September. I wanted to make Apache Arrow one of the projects we work on, so I wanted to give maintainers here a heads up, and clarify a few things. I would be around to help set up environments and make sure that PRs follow

Re: [Discuss][FlightRPC] Extensions to Flight: middleware and DoPut tickets

2019-08-12 Thread David Li
I've (finally) put up a draft implementation of middleware for Java: https://github.com/apache/arrow/pull/5068 Hopefully this helps clarify how the proposal works. Best, David On 7/25/19, David Li wrote: > Thanks for the feedback, Antoine. That would be a natural method to > have - then the

[jira] [Created] (ARROW-6212) [Java] Support vector rank operation

2019-08-12 Thread Liya Fan (JIRA)
Liya Fan created ARROW-6212: --- Summary: [Java] Support vector rank operation Key: ARROW-6212 URL: https://issues.apache.org/jira/browse/ARROW-6212 Project: Apache Arrow Issue Type: New Feature

Re: [ANNOUNCE] New Arrow PMC member: Micah Kornfield

2019-08-12 Thread Praveen Kumar
Congrats Micah, very well deserved !! On Mon, Aug 12, 2019 at 8:35 AM Micah Kornfield wrote: > Thanks everyone for the good wishes! > > On Fri, Aug 9, 2019 at 5:41 PM Fan Liya wrote: > > > Big congratulations! Micah > > Thank you so much for all the help! > > > > Best, > > Liya Fan > > > > On

[jira] [Created] (ARROW-6211) [Java] Remove dependency on RangeEqualsVisitor from ValueVector interface

2019-08-12 Thread Pindikura Ravindra (JIRA)
Pindikura Ravindra created ARROW-6211: - Summary: [Java] Remove dependency on RangeEqualsVisitor from ValueVector interface Key: ARROW-6211 URL: https://issues.apache.org/jira/browse/ARROW-6211

[jira] [Created] (ARROW-6210) [Java] remove equals API from ValueVector

2019-08-12 Thread Pindikura Ravindra (JIRA)
Pindikura Ravindra created ARROW-6210: - Summary: [Java] remove equals API from ValueVector Key: ARROW-6210 URL: https://issues.apache.org/jira/browse/ARROW-6210 Project: Apache Arrow

[jira] [Created] (ARROW-6209) [Java] Extract set null method to the base class for fixed width vectors

2019-08-12 Thread Liya Fan (JIRA)
Liya Fan created ARROW-6209: --- Summary: [Java] Extract set null method to the base class for fixed width vectors Key: ARROW-6209 URL: https://issues.apache.org/jira/browse/ARROW-6209 Project: Apache Arrow

[jira] [Created] (ARROW-6208) [Java] Correct byte order before comparing in ByteFunctionHelpers

2019-08-12 Thread Prudhvi Porandla (JIRA)
Prudhvi Porandla created ARROW-6208: --- Summary: [Java] Correct byte order before comparing in ByteFunctionHelpers Key: ARROW-6208 URL: https://issues.apache.org/jira/browse/ARROW-6208 Project: