[ANNOUNCE] New Arrow committer: Praveen Kumar

2019-06-27 Thread Wes McKinney
On behalf of the Arrow PMC I'm happy to announce that Praveen has accepted an invitation to become an Arrow committer! Welcome, and thank you for your contributions!

0.14.0: C++ TestDictionary.Validate is crashed with release build

2019-06-27 Thread Sutou Kouhei
Hi, I'm testing dev/release/verify-release-candidate.sh that is a script to verify RC. I found that TestDictionary.Validate C++ test is crashed with release build. Note that this isn't crashed with debug build. Could C++ developers take a look this? JIRA:

Re: 0.14.0: C++ TestDictionary.Validate is crashed with release build

2019-06-27 Thread Wes McKinney
hi Kou, I'm taking a look now. - Wes On Thu, Jun 27, 2019 at 4:47 PM Sutou Kouhei wrote: > > Hi, > > I'm testing dev/release/verify-release-candidate.sh that is > a script to verify RC. > > I found that TestDictionary.Validate C++ test is crashed > with release build. Note that this isn't

[jira] [Created] (ARROW-5762) [Integration][JS] Integration Tests for MapType

2019-06-27 Thread Bryan Cutler (JIRA)
Bryan Cutler created ARROW-5762: --- Summary: [Integration][JS] Integration Tests for MapType Key: ARROW-5762 URL: https://issues.apache.org/jira/browse/ARROW-5762 Project: Apache Arrow Issue

[jira] [Created] (ARROW-5763) [JS] enable integration tests for MapVector

2019-06-27 Thread Benjamin Kietzman (JIRA)
Benjamin Kietzman created ARROW-5763: Summary: [JS] enable integration tests for MapVector Key: ARROW-5763 URL: https://issues.apache.org/jira/browse/ARROW-5763 Project: Apache Arrow

Re: [ANNOUNCE] New Arrow committer: Praveen Kumar

2019-06-27 Thread Micah Kornfield
Congrats Praveen! On Thursday, June 27, 2019, Wes McKinney wrote: > On behalf of the Arrow PMC I'm happy to announce that Praveen has > accepted an invitation to become an Arrow committer! > > Welcome, and thank you for your contributions! >

[jira] [Created] (ARROW-5766) [Python] Unpin jpype1 version

2019-06-27 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-5766: --- Summary: [Python] Unpin jpype1 version Key: ARROW-5766 URL: https://issues.apache.org/jira/browse/ARROW-5766 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-5761) [R] Improve autosplice cpp code

2019-06-27 Thread Neal Richardson (JIRA)
Neal Richardson created ARROW-5761: -- Summary: [R] Improve autosplice cpp code Key: ARROW-5761 URL: https://issues.apache.org/jira/browse/ARROW-5761 Project: Apache Arrow Issue Type:

Re: 0.14.0: Javadoc failed with OpenJDK 11

2019-06-27 Thread Wes McKinney
hi Kou, I think that JDK8 is still treated as the "main production JDK version" but based on https://blogs.oracle.com/java-platform-group/end-of-public-updates-is-a-process%2c-not-an-event it seems like the project should cease JDK8 support at some point in the next 18 months (or sooner). I

[jira] [Created] (ARROW-5764) [Java] Failed to build document with OpenJDK 11

2019-06-27 Thread Sutou Kouhei (JIRA)
Sutou Kouhei created ARROW-5764: --- Summary: [Java] Failed to build document with OpenJDK 11 Key: ARROW-5764 URL: https://issues.apache.org/jira/browse/ARROW-5764 Project: Apache Arrow Issue

0.14.0: Javadoc failed with OpenJDK 11

2019-06-27 Thread Sutou Kouhei
Hi, I'm trying to run dev/release/00-prepare.sh that is the first script to create RC. It fails with OpenJDK 11 by the following Javadoc error: [ERROR] Exit code: 1 - javadoc: error - The code being documented uses modules but the packages defined in http://docs.oracle.com/javase/8/docs/api/

Re: [ANNOUNCE] New Arrow committer: Praveen Kumar

2019-06-27 Thread Chao Sun
Congratulations Praveen! On Thu, Jun 27, 2019 at 1:35 PM Micah Kornfield wrote: > Congrats Praveen! > > On Thursday, June 27, 2019, Wes McKinney wrote: > > > On behalf of the Arrow PMC I'm happy to announce that Praveen has > > accepted an invitation to become an Arrow committer! > > > >

[jira] [Created] (ARROW-5765) [C++] TestDictionary.Validate test is crashed with release build

2019-06-27 Thread Sutou Kouhei (JIRA)
Sutou Kouhei created ARROW-5765: --- Summary: [C++] TestDictionary.Validate test is crashed with release build Key: ARROW-5765 URL: https://issues.apache.org/jira/browse/ARROW-5765 Project: Apache Arrow

[jira] [Created] (ARROW-5756) [Python] Remove manylinux1 support

2019-06-27 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-5756: - Summary: [Python] Remove manylinux1 support Key: ARROW-5756 URL: https://issues.apache.org/jira/browse/ARROW-5756 Project: Apache Arrow Issue Type: Task

[jira] [Created] (ARROW-5757) [Python] Stop supporting Python 2.7

2019-06-27 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-5757: - Summary: [Python] Stop supporting Python 2.7 Key: ARROW-5757 URL: https://issues.apache.org/jira/browse/ARROW-5757 Project: Apache Arrow Issue Type: Task

[jira] [Created] (ARROW-5758) [C++][Gandiva] Support casting decimals to varchar and vice versa

2019-06-27 Thread Prudhvi Porandla (JIRA)
Prudhvi Porandla created ARROW-5758: --- Summary: [C++][Gandiva] Support casting decimals to varchar and vice versa Key: ARROW-5758 URL: https://issues.apache.org/jira/browse/ARROW-5758 Project:

[jira] [Created] (ARROW-5759) Suspend CI builds for draft pull requests on GitHub

2019-06-27 Thread Prudhvi Porandla (JIRA)
Prudhvi Porandla created ARROW-5759: --- Summary: Suspend CI builds for draft pull requests on GitHub Key: ARROW-5759 URL: https://issues.apache.org/jira/browse/ARROW-5759 Project: Apache Arrow

Re: [ANNOUNCE] New Arrow committer: Praveen Kumar

2019-06-27 Thread Ravindra Pindikura
Congrats Praveen! Sent from my iPhone > On 28-Jun-2019, at 1:55 AM, Wes McKinney wrote: > > On behalf of the Arrow PMC I'm happy to announce that Praveen has > accepted an invitation to become an Arrow committer! > > Welcome, and thank you for your contributions!

Re: 0.14.0: Java org.apache.arrow.flight.TestTls is failed via dev/release/00-prepare.sh

2019-06-27 Thread Micah Kornfield
It's an environment problem. The arrow testing repo needs to be checked out and an environment variable set. I'll try to have a PR out to fix this tonight On Thursday, June 27, 2019, Sutou Kouhei wrote: > Hi, > > I'm trying dev/release/00-prepare.sh that is the first > script to create RC. >

Re: [DISCUSS] Making the Arrow 0.14 release, outstanding items

2019-06-27 Thread Sutou Kouhei
We can merge pull request that doesn't change pom.xml for 0.14.0 until I finished ARROW-4301 and ARROW-5695. In <20190628.134059.632882213120446354@clear-code.com> "Re: [DISCUSS] Making the Arrow 0.14 release, outstanding items" on Fri, 28 Jun 2019 13:40:59 +0900 (JST), Sutou Kouhei

[jira] [Created] (ARROW-5769) [Java] org.apache.arrow.flight.TestTls is failed via dev/release/00-prepare.sh

2019-06-27 Thread Sutou Kouhei (JIRA)
Sutou Kouhei created ARROW-5769: --- Summary: [Java] org.apache.arrow.flight.TestTls is failed via dev/release/00-prepare.sh Key: ARROW-5769 URL: https://issues.apache.org/jira/browse/ARROW-5769 Project:

Re: 0.14.0: C++ TestDictionary.Validate is crashed with release build

2019-06-27 Thread Sutou Kouhei
Thanks!!! In "Re: 0.14.0: C++ TestDictionary.Validate is crashed with release build" on Thu, 27 Jun 2019 17:07:27 -0500, Wes McKinney wrote: > Patch here: https://github.com/apache/arrow/pull/4730 > > We aren't testing release builds of the C++ project at all in Travis > CI. The longer

Re: 0.14.0: Java org.apache.arrow.flight.TestTls is failed via dev/release/00-prepare.sh

2019-06-27 Thread Sutou Kouhei
Thanks! I also get the same feedback from lidavidm on JIRA. I'll create a pull request to ensure setting up test data. In "Re: 0.14.0: Java org.apache.arrow.flight.TestTls is failed via dev/release/00-prepare.sh" on Thu, 27 Jun 2019 18:17:06 -0700, Micah Kornfield wrote: > It's an

Re: [DISCUSS] Making the Arrow 0.14 release, outstanding items

2019-06-27 Thread Sutou Kouhei
Thanks! I'm testing ARROW-4301 (00-prepare.sh) and ARROW-5695 (verify-release-candidate.sh). ARROW-4301: We need to build C++ with Gandiva and ORC in 00-prepare.sh. I'm working on this. ARROW-5695: I'll merge this when I confirmed all verification patterns are passed with master. I'm running.

Re: [Discuss][Java][Typical use cases for dictionary encoding string vectors]

2019-06-27 Thread Wes McKinney
hi Liya, I left a couple of comments in the document. You might look at what we have developed in C++ and JavaSript which is more mature and widely used in those languages than what currently exists in Java. In particular, I strongly encourage you to avoid creating a coupling between the Schema

[jira] [Created] (ARROW-5767) [Format] Permit dictionary replacements in IPC protocol

2019-06-27 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-5767: --- Summary: [Format] Permit dictionary replacements in IPC protocol Key: ARROW-5767 URL: https://issues.apache.org/jira/browse/ARROW-5767 Project: Apache Arrow

[jira] [Created] (ARROW-5768) [Release] There are needless newlines at the end of CHANGELOG.md

2019-06-27 Thread Sutou Kouhei (JIRA)
Sutou Kouhei created ARROW-5768: --- Summary: [Release] There are needless newlines at the end of CHANGELOG.md Key: ARROW-5768 URL: https://issues.apache.org/jira/browse/ARROW-5768 Project: Apache Arrow

Re: [Discuss][Java][Typical use cases for dictionary encoding string vectors]

2019-06-27 Thread Fan Liya
@Wes McKinney, I see your comments. Thank you so much. I agree with you that the schema and dictionary should be separated. However, according to the current Java implementation, the dictionary is attached to the schema, so a refactoring is required. BTW, a somewhat related problem is that the

Re: [DISCUSS] Making the Arrow 0.14 release, outstanding items

2019-06-27 Thread Wes McKinney
It looks like we're down to 4 open issues. The remaining items can be merged at Kou's discretion. The one uncertain item is ARROW-5579 -- shading Flatbuffers. It seems like it might not be prudent to rush in a patch that might potentially cause problems On Thu, Jun 27, 2019 at 12:23 PM Wes

0.14.0: Java org.apache.arrow.flight.TestTls is failed via dev/release/00-prepare.sh

2019-06-27 Thread Sutou Kouhei
Hi, I'm trying dev/release/00-prepare.sh that is the first script to create RC. It fails with OpenJDK 8 by Flight test. I'm not sure whether this is my environment problem or not. Could Java developers take a look this? JIRA: https://issues.apache.org/jira/browse/ARROW-5769 Error message:

[jira] [Created] (ARROW-5770) Fix -Wpessimizing-move in result.h

2019-06-27 Thread Micah Kornfield (JIRA)
Micah Kornfield created ARROW-5770: -- Summary: Fix -Wpessimizing-move in result.h Key: ARROW-5770 URL: https://issues.apache.org/jira/browse/ARROW-5770 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-5771) [Python] Docker python-nopandas job fails

2019-06-27 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-5771: --- Summary: [Python] Docker python-nopandas job fails Key: ARROW-5771 URL: https://issues.apache.org/jira/browse/ARROW-5771 Project: Apache Arrow Issue Type: Bug

Re: 0.14.0: C++ TestDictionary.Validate is crashed with release build

2019-06-27 Thread Wes McKinney
Patch here: https://github.com/apache/arrow/pull/4730 We aren't testing release builds of the C++ project at all in Travis CI. The longer build times probably pose a problem anyway, so I have set up a docker-compose build so we can add this to Ursabot to prevent this from happening in the future

[jira] [Created] (ARROW-5773) [R] Clean up documentation before release

2019-06-27 Thread Neal Richardson (JIRA)
Neal Richardson created ARROW-5773: -- Summary: [R] Clean up documentation before release Key: ARROW-5773 URL: https://issues.apache.org/jira/browse/ARROW-5773 Project: Apache Arrow Issue

Re: [DISCUSS] Making the Arrow 0.14 release, outstanding items

2019-06-27 Thread Neal Richardson
I'd like to squeeze https://issues.apache.org/jira/browse/ARROW-5773 into 0.14 if you'll allow. It's just documentation. I just put the PR up now: https://github.com/apache/arrow/pull/4736 Thanks, Neal On Thu, Jun 27, 2019 at 9:55 PM Sutou Kouhei wrote: > We can merge pull request that doesn't

[jira] [Created] (ARROW-5772) [GLib][Plasma][CUDA] Plasma::Client#refer_object test is failed

2019-06-27 Thread Sutou Kouhei (JIRA)
Sutou Kouhei created ARROW-5772: --- Summary: [GLib][Plasma][CUDA] Plasma::Client#refer_object test is failed Key: ARROW-5772 URL: https://issues.apache.org/jira/browse/ARROW-5772 Project: Apache Arrow

[jira] [Created] (ARROW-5774) [Java][Documentation] Document the need to checkout git submodules for flight

2019-06-27 Thread Micah Kornfield (JIRA)
Micah Kornfield created ARROW-5774: -- Summary: [Java][Documentation] Document the need to checkout git submodules for flight Key: ARROW-5774 URL: https://issues.apache.org/jira/browse/ARROW-5774

[jira] [Created] (ARROW-5755) [Rust] [Parquet] Add derived clone for Type

2019-06-27 Thread Renjie Liu (JIRA)
Renjie Liu created ARROW-5755: - Summary: [Rust] [Parquet] Add derived clone for Type Key: ARROW-5755 URL: https://issues.apache.org/jira/browse/ARROW-5755 Project: Apache Arrow Issue Type: New