[jira] [Created] (ARROW-5458) Apache Arrow parallel CRC32c computation optimization

2019-05-30 Thread Yuqi Gu (JIRA)
Yuqi Gu created ARROW-5458: -- Summary: Apache Arrow parallel CRC32c computation optimization Key: ARROW-5458 URL: https://issues.apache.org/jira/browse/ARROW-5458 Project: Apache Arrow Issue Type: Im

[jira] [Created] (ARROW-5457) [GLib][Plasma] Environment variable name for test is wrong

2019-05-30 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-5457: --- Summary: [GLib][Plasma] Environment variable name for test is wrong Key: ARROW-5457 URL: https://issues.apache.org/jira/browse/ARROW-5457 Project: Apache Arrow

[jira] [Created] (ARROW-5456) [GLib][Plasma] Installed plasma-glib may be used on building document

2019-05-30 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-5456: --- Summary: [GLib][Plasma] Installed plasma-glib may be used on building document Key: ARROW-5456 URL: https://issues.apache.org/jira/browse/ARROW-5456 Project: Apache Arr

[jira] [Created] (ARROW-5455) [Rust] Build broken by 2019-05-30 Rust nightly

2019-05-30 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-5455: --- Summary: [Rust] Build broken by 2019-05-30 Rust nightly Key: ARROW-5455 URL: https://issues.apache.org/jira/browse/ARROW-5455 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-5454) [C++] Implement Take on ChunkedArray for DataFrame use

2019-05-30 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-5454: --- Summary: [C++] Implement Take on ChunkedArray for DataFrame use Key: ARROW-5454 URL: https://issues.apache.org/jira/browse/ARROW-5454 Project: Apache Arrow Iss

[jira] [Created] (ARROW-5453) [C++] Just-released cmake-format 0.5.2 breaks the build

2019-05-30 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-5453: --- Summary: [C++] Just-released cmake-format 0.5.2 breaks the build Key: ARROW-5453 URL: https://issues.apache.org/jira/browse/ARROW-5453 Project: Apache Arrow Is

Re: Reduced Arrow CI capacity

2019-05-30 Thread Antoine Pitrou
Le 30/05/2019 à 22:39, Uwe L. Korn a écrit : > Hello all, > > Krisztián has been lately working on getting Buildbot running for Arrow. > While I have not yet had the time to look at it in detail what would hinder > us using it as the main Linux builder and ditching Travis except for OSX? > >

Re: Timeline for 0.14 release?

2019-05-30 Thread Wes McKinney
hi Eric, We haven't discussed it yet but I think it would be a good goal to be release-ready by the end of June if that sounds reasonable. - Wes On Thu, May 30, 2019 at 3:47 PM Eric Erhardt wrote: > > Do we have an idea on a 0.14 release timeframe? > > Historically, it seems there has been a re

Timeline for 0.14 release?

2019-05-30 Thread Eric Erhardt
Do we have an idea on a 0.14 release timeframe? Historically, it seems there has been a release every 2-3 months. Do we think the next release would be about that long after 0.13 was released? Note: I'm not pushing for a release any time soon - I am just curious when it would roughly be. I want

Re: Reduced Arrow CI capacity

2019-05-30 Thread Uwe L. Korn
Hello all, Krisztián has been lately working on getting Buildbot running for Arrow. While I have not yet had the time to look at it in detail what would hinder us using it as the main Linux builder and ditching Travis except for OSX? Otherwise I have lately made really good experiences with Git

Re: Propose custom_metadata for Footer

2019-05-30 Thread Wes McKinney
hi John, In principle I don't see a problem with adding a custom_metadata: [KeyValue] field to the Footer table in File.fbs https://github.com/apache/arrow/blob/master/format/File.fbs#L26 This field could be used for application-level information about the file's provenance, etc. Note here are

Reduced Arrow CI capacity

2019-05-30 Thread Wes McKinney
hi folks, Over the last several months we have probably been overutilizing the ASF's Travis CI capacity; it seems that we are being limited as of very recently to 5 concurrent build workers so CI feedback is taking longer. We have an INFRA ticket about the issue here https://issues.apache.org/ji

[jira] [Created] (ARROW-5452) [R] Add documentation website (pkgdown)

2019-05-30 Thread Neal Richardson (JIRA)
Neal Richardson created ARROW-5452: -- Summary: [R] Add documentation website (pkgdown) Key: ARROW-5452 URL: https://issues.apache.org/jira/browse/ARROW-5452 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-5451) [C++][Gandiva] Add round functions for decimals

2019-05-30 Thread Pindikura Ravindra (JIRA)
Pindikura Ravindra created ARROW-5451: - Summary: [C++][Gandiva] Add round functions for decimals Key: ARROW-5451 URL: https://issues.apache.org/jira/browse/ARROW-5451 Project: Apache Arrow

[jira] [Created] (ARROW-5450) [Python] TimestampArray.to_pylist() fails with OverflowError: Python int too large to convert to C long

2019-05-30 Thread Tim Swast (JIRA)
Tim Swast created ARROW-5450: Summary: [Python] TimestampArray.to_pylist() fails with OverflowError: Python int too large to convert to C long Key: ARROW-5450 URL: https://issues.apache.org/jira/browse/ARROW-5450

Re: Not testing Python 2.7 on CI

2019-05-30 Thread Wes McKinney
I think as long as we have an easy docker-compose Python 2 build we can run nightly or ad hoc Python 2.7 builds. Running such builds should be part of getting ready for a release, anyway. Hopefully the Ursa Labs build cluster will be operational in the near future and can help with automating this.

Re: Not testing Python 2.7 on CI

2019-05-30 Thread Uwe L. Korn
Hello Antoine, when we're not testing Python 2.7 on CI anymore, I would suggest to drop Python 2 support completely then. My personal experience tells me that once we drop Python 2 on CI, we will immediately build a simple thing that breaks Python 2 support. Pushing out releases that might wo

Re: [DISCUSS] PR Backlog reduction

2019-05-30 Thread Antoine Pitrou
One of the aspects of the problem is that our tools (Github, JIRA) don't allow us to work with categories easily. Regards Antoine. Le 30/05/2019 à 15:59, Wes McKinney a écrit : > They're complementary. At least in the short term the spreadsheet can > help us get our current backlog under cont

[jira] [Created] (ARROW-5449) [C++] Local filesystem implementation: investigate Windows UNC paths

2019-05-30 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-5449: - Summary: [C++] Local filesystem implementation: investigate Windows UNC paths Key: ARROW-5449 URL: https://issues.apache.org/jira/browse/ARROW-5449 Project: Apache

Not testing Python 2.7 on CI

2019-05-30 Thread Antoine Pitrou
Hello, Python 2.7 will soon be end-of-life. It will stop being supported upstream on January 1st, 2020. Many projects have started publishing Python 3-only releases (see https://python3statement.org/). PyArrow will soon stop supporting Python 2 as well, perhaps at the end of the year. In the

Re: [DISCUSS] PR Backlog reduction

2019-05-30 Thread Wes McKinney
They're complementary. At least in the short term the spreadsheet can help us get our current backlog under control. I'd like to at least be thinking about tools that can help us when patch volume inevitably grows to 2-3 times the current level. On Thu, May 30, 2019 at 12:28 AM Micah Kornfield wr

[jira] [Created] (ARROW-5448) [CI] MinGW build failures on AppVeyor

2019-05-30 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-5448: - Summary: [CI] MinGW build failures on AppVeyor Key: ARROW-5448 URL: https://issues.apache.org/jira/browse/ARROW-5448 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-5447) [CI] [Ruby] CI is failued on AppVeyor

2019-05-30 Thread Yosuke Shiro (JIRA)
Yosuke Shiro created ARROW-5447: --- Summary: [CI] [Ruby] CI is failued on AppVeyor Key: ARROW-5447 URL: https://issues.apache.org/jira/browse/ARROW-5447 Project: Apache Arrow Issue Type: Improvem

[jira] [Created] (ARROW-5446) Use cmake header install directory instead of include

2019-05-30 Thread Nuno Almeida (JIRA)
Nuno Almeida created ARROW-5446: --- Summary: Use cmake header install directory instead of include Key: ARROW-5446 URL: https://issues.apache.org/jira/browse/ARROW-5446 Project: Apache Arrow Issu

Re: [DISCUSS][Java] How to solve the problem of OutOfMemoryException when there is sufficient memory?

2019-05-30 Thread Ravindra Pindikura
On Thu, May 30, 2019 at 12:23 PM Micah Kornfield wrote: > (Adding Java to thread title) > > For more context, I pushed back on the changes in > https://github.com/apache/arrow/pull/4358 because they don't seem typical > in memory management systems (i.e. they expose internal implementation > deta