[jira] [Created] (ARROW-6704) [C++] Cast from timestamp to higher resolution does not check out of bounds timestamps

2019-09-26 Thread Joris Van den Bossche (Jira)
Joris Van den Bossche created ARROW-6704: Summary: [C++] Cast from timestamp to higher resolution does not check out of bounds timestamps Key: ARROW-6704 URL:

Re: Timeline for 0.15.0 release

2019-09-26 Thread Micah Kornfield
Just an I've started the RC generation process off, the last commit from master is [1] I am currently waiting the crossbow builds (build-690 on ursa-labs/crossbow). I think this will take a little while so I will pick it up tomorrow (Thursday). Thanks, Micah [1]

[jira] [Created] (ARROW-6702) [Rust] [DataFusion] Incorrect partition read

2019-09-26 Thread Adam Lippai (Jira)
Adam Lippai created ARROW-6702: -- Summary: [Rust] [DataFusion] Incorrect partition read Key: ARROW-6702 URL: https://issues.apache.org/jira/browse/ARROW-6702 Project: Apache Arrow Issue Type:

Re: Thread-safety guarantees of pyarrow Table (and other) objects

2019-09-26 Thread Antoine Pitrou
Hi Yevgeni, The main Arrow classes (such as Array, ChunkedArray, RecordBatch, Table) are immutable so support multi-thread usage out of the box. We have mutable classes as well (e.g. IO classes, ArrayBuilders, mutable Buffers...) and those are not thread-safe. Regards Antoine. Le

[jira] [Created] (ARROW-6701) [C++][R] Lint failing on R cpp code

2019-09-26 Thread Micah Kornfield (Jira)
Micah Kornfield created ARROW-6701: -- Summary: [C++][R] Lint failing on R cpp code Key: ARROW-6701 URL: https://issues.apache.org/jira/browse/ARROW-6701 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-6703) [Packaging][Linux] Restore ARROW_VERSION environment variable

2019-09-26 Thread Kouhei Sutou (Jira)
Kouhei Sutou created ARROW-6703: --- Summary: [Packaging][Linux] Restore ARROW_VERSION environment variable Key: ARROW-6703 URL: https://issues.apache.org/jira/browse/ARROW-6703 Project: Apache Arrow

[NIGHTLY] Arrow Build Report for Job nightly-2019-09-26-0

2019-09-26 Thread Crossbow
Arrow Build Report for Job nightly-2019-09-26-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-09-26-0 Failed Tasks: - docker-spark-integration: URL:

Re: Timeline for 0.15.0 release

2019-09-26 Thread Ji Liu
Hi Micah, Hmm, unfortunately, I just found a bug in JDBC adapter and open a PR, could this change catch up with 0.15? See https://github.com/apache/arrow/pull/5511 Thanks, Ji Liu -- From:Micah Kornfield Send

Re: Timeline for 0.15.0 release

2019-09-26 Thread Krisztián Szűcs
There are still missing linux artifacts [1]: - for amd64 debug symbol packages - for arm64 optional CUDA, plasma and Gandiva modules I think we can safely ignore them for the release, crossbow will report them as missing but the artifact downloading step finish. Let me know Micah if you have any

[jira] [Created] (ARROW-6706) [Developer Tools] Cannot merge PRs from authors with "Á" (U+00C1) in their name

2019-09-26 Thread Andy Grove (Jira)
Andy Grove created ARROW-6706: - Summary: [Developer Tools] Cannot merge PRs from authors with "Á" (U+00C1) in their name Key: ARROW-6706 URL: https://issues.apache.org/jira/browse/ARROW-6706 Project:

Re: Unnesting ListArrays

2019-09-26 Thread Suhail Razzak
Thanks Wes, makes sense. I appreciate that there are use cases where both could be applicable. In my example, the most applicable I can think of is unnesting a ListArray column for a DataFrame (in the future C++ DataFrames API?) similar to the tidyr unnest function. I don't believe the current

[jira] [Created] (ARROW-6708) [C++] "cannot find -lboost_filesystem_static"

2019-09-26 Thread Antoine Pitrou (Jira)
Antoine Pitrou created ARROW-6708: - Summary: [C++] "cannot find -lboost_filesystem_static" Key: ARROW-6708 URL: https://issues.apache.org/jira/browse/ARROW-6708 Project: Apache Arrow Issue

[jira] [Created] (ARROW-6710) [Java] Add JDBC adapter test to cover cases which contains some null values

2019-09-26 Thread Ji Liu (Jira)
Ji Liu created ARROW-6710: - Summary: [Java] Add JDBC adapter test to cover cases which contains some null values Key: ARROW-6710 URL: https://issues.apache.org/jira/browse/ARROW-6710 Project: Apache Arrow

[jira] [Created] (ARROW-6712) [Rust] [Parquet] Reading parquet file into an ndarray

2019-09-26 Thread Adam Lippai (Jira)
Adam Lippai created ARROW-6712: -- Summary: [Rust] [Parquet] Reading parquet file into an ndarray Key: ARROW-6712 URL: https://issues.apache.org/jira/browse/ARROW-6712 Project: Apache Arrow

Re: Build issues on macOS [newbie]

2019-09-26 Thread Wes McKinney
It looks like the development toolchain dependencies in conda_env_cpp.yml aren't installed in your "main" conda environment, e.g. https://github.com/apache/arrow/blob/master/ci/conda_env_cpp.yml#L42 You can see what's installed by running "conda list" Note that most of these dependencies are

[jira] [Created] (ARROW-6713) [Python] Getting "ArrowIOError: Corrupted file, smaller than file footer" when reading large number of parquet files through ParquetDataset()

2019-09-26 Thread Harini Kannan (Jira)
Harini Kannan created ARROW-6713: Summary: [Python] Getting "ArrowIOError: Corrupted file, smaller than file footer" when reading large number of parquet files through ParquetDataset() Key: ARROW-6713 URL:

Re: [NIGHTLY] Arrow Build Report for Job nightly-2019-09-26-0

2019-09-26 Thread Wes McKinney
Should we disable the fuzzit job? This is for a third party CI-type service, so the failure here seems like it's adding unneeded noise On Thu, Sep 26, 2019 at 12:31 PM Crossbow wrote: > > > Arrow Build Report for Job nightly-2019-09-26-0 > > All tasks: >

[jira] [Created] (ARROW-6714) [R] Fix untested RecordBatchWriter case

2019-09-26 Thread Neal Richardson (Jira)
Neal Richardson created ARROW-6714: -- Summary: [R] Fix untested RecordBatchWriter case Key: ARROW-6714 URL: https://issues.apache.org/jira/browse/ARROW-6714 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-6715) [Website] Describe "non-free" section is needed for Plasma packages in install page

2019-09-26 Thread Kouhei Sutou (Jira)
Kouhei Sutou created ARROW-6715: --- Summary: [Website] Describe "non-free" section is needed for Plasma packages in install page Key: ARROW-6715 URL: https://issues.apache.org/jira/browse/ARROW-6715

[jira] [Created] (ARROW-6716) [CI] [Rust] New 1.40.0 nightly causing builds to fail

2019-09-26 Thread Andy Grove (Jira)
Andy Grove created ARROW-6716: - Summary: [CI] [Rust] New 1.40.0 nightly causing builds to fail Key: ARROW-6716 URL: https://issues.apache.org/jira/browse/ARROW-6716 Project: Apache Arrow Issue

[jira] [Created] (ARROW-6718) [Rust] packed_simd requires nightly

2019-09-26 Thread Andy Grove (Jira)
Andy Grove created ARROW-6718: - Summary: [Rust] packed_simd requires nightly Key: ARROW-6718 URL: https://issues.apache.org/jira/browse/ARROW-6718 Project: Apache Arrow Issue Type: Sub-task

[jira] [Created] (ARROW-6717) Support stable Rust

2019-09-26 Thread Andy Grove (Jira)
Andy Grove created ARROW-6717: - Summary: Support stable Rust Key: ARROW-6717 URL: https://issues.apache.org/jira/browse/ARROW-6717 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-6719) Parquet read_table error in Python3.7: pyarrow.lib.ArrowInvalid: Column data for field with type list<...> is inconsistent with schema list<...>

2019-09-26 Thread V Luong (Jira)
V Luong created ARROW-6719: -- Summary: Parquet read_table error in Python3.7: pyarrow.lib.ArrowInvalid: Column data for field with type list<...> is inconsistent with schema list<...> Key: ARROW-6719 URL:

Re: Travis CI delays

2019-09-26 Thread Micah Kornfield
My understanding is the Travis CI queue is shared among all apache projects, and there are few including Arrow that make heavy use of the resources. Hence, a lot of time waiting for jobs to start. I think there are some open JIRAs to finish dockerization of builds, I don't know the current

[jira] [Created] (ARROW-6720) [JAVA][C++]Support Parquet Read and Write in Java

2019-09-26 Thread Chendi.Xue (Jira)
Chendi.Xue created ARROW-6720: - Summary: [JAVA][C++]Support Parquet Read and Write in Java Key: ARROW-6720 URL: https://issues.apache.org/jira/browse/ARROW-6720 Project: Apache Arrow Issue Type: