[jira] [Created] (ARROW-7306) [C++] Add Result-returning version of FileSystemFromUri
Kenta Murata created ARROW-7306: --- Summary: [C++] Add Result-returning version of FileSystemFromUri Key: ARROW-7306 URL: https://issues.apache.org/jira/browse/ARROW-7306 Project: Apache Arrow Issue Type: Task Components: C++ Reporter: Kenta Murata Assignee: Kenta Murata -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (ARROW-7305) High memory usage writing pyarrow.Table to parquet
Bogdan Klichuk created ARROW-7305:
-
Summary: High memory usage writing pyarrow.Table to parquet
Key: ARROW-7305
URL: https://issues.apache.org/jira/browse/ARROW-7305
Project: Apache Arrow
Issue Type: Task
Components: Python
Affects Versions: 0.15.1
Environment: Mac OSX
Reporter: Bogdan Klichuk
My case of datasets stored is specific. I have large strings (1-100MB each).
Let's take for example a single row.
43mb.csv is a 1-row CSV with 10 columns. One column a 43mb string.
When I read this csv with pandas and then dump to parquet, my script consumes
10x of the 43mb.
With increasing amount of such rows memory footprint overhead diminishes, but I
want to focus on this specific case.
Here's the footprint after running using memory profiler:
{code:java}
Line #Mem usageIncrement Line Contents
4 48.9 MiB 48.9 MiB @profile
5 def test():
6143.7 MiB 94.7 MiB data = pd.read_csv('43mb.csv')
7498.6 MiB354.9 MiB data.to_parquet('out.parquet')
{code}
Is this typical for parquet in case of big strings?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
Re: [C++] CSV string column category to dictionary/indices?
Hello
Thank you for your advice! I'll try to adapt it to my code.
Best,
--
вт, 3 дек. 2019 г. в 17:16, Antoine Pitrou :
>
> Agreed. I've opened https://issues.apache.org/jira/browse/ARROW-7302 to
> track it.
>
> Regards
>
> Antoine.
>
>
> Le 03/12/2019 à 04:55, Wes McKinney a écrit :
> > An option was recently added to dictionary encode all string columns
> >
> >
> https://github.com/apache/arrow/blob/master/cpp/src/arrow/csv/options.h#L82
> >
> > I think it would be useful to be able to hard-opt-in to
> > dictionary-encode a particular column (regardless of the what
> > cardinality ends up being). Whatever the way to do this, it should be
> > clear and well documented. A new JIRA issue may be in order. Antoine,
> > what do you think?
> >
> > On Sun, Dec 1, 2019 at 5:32 PM ntfs hard wrote:
> >>
> >> Hello
> >>
> >> I'm a newcomer and not quite sure about the library usage. I tried to
> find
> >> some documentation about it but failed.
> >>
> >> I have a dataset in CSV file where one column(let's call it colour) is a
> >> string category. I'd like to get indices instead of text_lines to pass
> it
> >> inside algorithm.
> >> I tried to set column_types in ConvertOptions in
> >> {{"colour", arrow::dictionary(std::make_shared(),
> >> arrow::utf8()) }} but it seems to be not right api usage, a wild
> run-time
> >> error appears: NotImplemented: CSV conversion to
> dictionary >> indices=int32, ordered=0> is not supported
> >> Also I find a merged PR #5785 <
> https://github.com/apache/arrow/pull/5785> but
> >> not quite sure that's applicable for my case.
> >>
> >> So, my question is: can I get indices inside a category column only w/
> >> library API. And if yes, what I doing wrong. :)
> >>
> >> *In other word,* I'd like to something like such python pandas code:
> >> df[column] = df[column].cat.codes # if str(column_data_type) ==
> "category"
> >>
> >> Thank you!
>
Re: [NIGHTLY] Arrow Build Report for Job nightly-2019-12-03-0
I'm going to wait until tomorrow, and fall back to the previous organization depending on or the absence of the INFRA's answer. On Tue, Dec 3, 2019 at 10:39 PM Wes McKinney wrote: > Can we point to an image outside of the Apache DockerHub org in the > meantime? This is part of why I was asking in that JIRA why we need to > be dependent on INFRA to set permissions for us on development > matters. > > On Tue, Dec 3, 2019 at 3:31 PM Krisztián Szűcs > wrote: > > > > I'm waiting for https://issues.apache.org/jira/browse/INFRA-19499 > > > > On Tue, Dec 3, 2019 at 10:07 PM Neal Richardson < > neal.p.richard...@gmail.com> > > wrote: > > > > > Is there a jira for this yet? > > > > > > On Tue, Dec 3, 2019 at 12:31 PM Wes McKinney > wrote: > > > > > > > The manylinux builds are failing because of a missing Docker image > > > > > > > > $ docker-compose pull $BUILD_IMAGE > > > > 228Pulling centos-python-manylinux2010 ... > > > > 229ERROR: for centos-python-manylinux2010 manifest for > > > > apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 not found > > > > 230manifest for > > > > apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 not found > > > > > > > > These have been failing for several days -- what needs to be done to > fix > > > > this? > > > > > > > > On Tue, Dec 3, 2019 at 7:17 AM Crossbow > wrote: > > > > > > > > > > > > > > > Arrow Build Report for Job nightly-2019-12-03-0 > > > > > > > > > > All tasks: > > > > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0 > > > > > > > > > > Failed Tasks: > > > > > - test-debian-10-rust-nightly-2019-09-25: > > > > > URL: > > > > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-circle-test-debian-10-rust-nightly-2019-09-25 > > > > > - test-ubuntu-fuzzit-regression: > > > > > URL: > > > > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-circle-test-ubuntu-fuzzit-regression > > > > > - ubuntu-disco: > > > > > URL: > > > > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-ubuntu-disco > > > > > - wheel-manylinux1-cp27m: > > > > > URL: > > > > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp27m > > > > > - wheel-manylinux1-cp27mu: > > > > > URL: > > > > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp27mu > > > > > - wheel-manylinux1-cp35m: > > > > > URL: > > > > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp35m > > > > > - wheel-manylinux1-cp36m: > > > > > URL: > > > > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp36m > > > > > - wheel-manylinux1-cp37m: > > > > > URL: > > > > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp37m > > > > > - wheel-manylinux2010-cp27m: > > > > > URL: > > > > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp27m > > > > > - wheel-manylinux2010-cp27mu: > > > > > URL: > > > > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp27mu > > > > > - wheel-manylinux2010-cp35m: > > > > > URL: > > > > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp35m > > > > > - wheel-manylinux2010-cp36m: > > > > > URL: > > > > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp36m > > > > > - wheel-manylinux2010-cp37m: > > > > > URL: > > > > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp37m > > > > > > > > > > Succeeded Tasks: > > > > > - centos-6: > > > > > URL: > > > > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-centos-6 > > > > > - centos-7: > > > > > URL: > > > > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-centos-7 > > > > > - centos-8: > > > > > URL: > > > > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-centos-8 > > > > > - conda-linux-gcc-py27: > > > > > URL: > > > > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-linux-gcc-py27 > > > > > - conda-linux-gcc-py36: > > > > > URL: > > > > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-linux-gcc-py36 > > > > > - conda-linux-gcc-py37: > > > > > URL: > > > > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-linux-gcc-py37 > > > > > - conda-osx-clang-py27: > > > > > URL: > > > > > > > >
Re: [NIGHTLY] Arrow Build Report for Job nightly-2019-12-03-0
Can we point to an image outside of the Apache DockerHub org in the meantime? This is part of why I was asking in that JIRA why we need to be dependent on INFRA to set permissions for us on development matters. On Tue, Dec 3, 2019 at 3:31 PM Krisztián Szűcs wrote: > > I'm waiting for https://issues.apache.org/jira/browse/INFRA-19499 > > On Tue, Dec 3, 2019 at 10:07 PM Neal Richardson > wrote: > > > Is there a jira for this yet? > > > > On Tue, Dec 3, 2019 at 12:31 PM Wes McKinney wrote: > > > > > The manylinux builds are failing because of a missing Docker image > > > > > > $ docker-compose pull $BUILD_IMAGE > > > 228Pulling centos-python-manylinux2010 ... > > > 229ERROR: for centos-python-manylinux2010 manifest for > > > apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 not found > > > 230manifest for > > > apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 not found > > > > > > These have been failing for several days -- what needs to be done to fix > > > this? > > > > > > On Tue, Dec 3, 2019 at 7:17 AM Crossbow wrote: > > > > > > > > > > > > Arrow Build Report for Job nightly-2019-12-03-0 > > > > > > > > All tasks: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0 > > > > > > > > Failed Tasks: > > > > - test-debian-10-rust-nightly-2019-09-25: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-circle-test-debian-10-rust-nightly-2019-09-25 > > > > - test-ubuntu-fuzzit-regression: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-circle-test-ubuntu-fuzzit-regression > > > > - ubuntu-disco: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-ubuntu-disco > > > > - wheel-manylinux1-cp27m: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp27m > > > > - wheel-manylinux1-cp27mu: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp27mu > > > > - wheel-manylinux1-cp35m: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp35m > > > > - wheel-manylinux1-cp36m: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp36m > > > > - wheel-manylinux1-cp37m: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp37m > > > > - wheel-manylinux2010-cp27m: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp27m > > > > - wheel-manylinux2010-cp27mu: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp27mu > > > > - wheel-manylinux2010-cp35m: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp35m > > > > - wheel-manylinux2010-cp36m: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp36m > > > > - wheel-manylinux2010-cp37m: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp37m > > > > > > > > Succeeded Tasks: > > > > - centos-6: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-centos-6 > > > > - centos-7: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-centos-7 > > > > - centos-8: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-centos-8 > > > > - conda-linux-gcc-py27: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-linux-gcc-py27 > > > > - conda-linux-gcc-py36: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-linux-gcc-py36 > > > > - conda-linux-gcc-py37: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-linux-gcc-py37 > > > > - conda-osx-clang-py27: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-osx-clang-py27 > > > > - conda-osx-clang-py36: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-osx-clang-py36 > > > > - conda-osx-clang-py37: > > > > URL: > > > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-osx-clang-py37 > > > > - conda-win-vs2015-py36: > > > > URL: > > > > >
Re: [NIGHTLY] Arrow Build Report for Job nightly-2019-12-03-0
I'm waiting for https://issues.apache.org/jira/browse/INFRA-19499 On Tue, Dec 3, 2019 at 10:07 PM Neal Richardson wrote: > Is there a jira for this yet? > > On Tue, Dec 3, 2019 at 12:31 PM Wes McKinney wrote: > > > The manylinux builds are failing because of a missing Docker image > > > > $ docker-compose pull $BUILD_IMAGE > > 228Pulling centos-python-manylinux2010 ... > > 229ERROR: for centos-python-manylinux2010 manifest for > > apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 not found > > 230manifest for > > apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 not found > > > > These have been failing for several days -- what needs to be done to fix > > this? > > > > On Tue, Dec 3, 2019 at 7:17 AM Crossbow wrote: > > > > > > > > > Arrow Build Report for Job nightly-2019-12-03-0 > > > > > > All tasks: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0 > > > > > > Failed Tasks: > > > - test-debian-10-rust-nightly-2019-09-25: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-circle-test-debian-10-rust-nightly-2019-09-25 > > > - test-ubuntu-fuzzit-regression: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-circle-test-ubuntu-fuzzit-regression > > > - ubuntu-disco: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-ubuntu-disco > > > - wheel-manylinux1-cp27m: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp27m > > > - wheel-manylinux1-cp27mu: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp27mu > > > - wheel-manylinux1-cp35m: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp35m > > > - wheel-manylinux1-cp36m: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp36m > > > - wheel-manylinux1-cp37m: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp37m > > > - wheel-manylinux2010-cp27m: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp27m > > > - wheel-manylinux2010-cp27mu: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp27mu > > > - wheel-manylinux2010-cp35m: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp35m > > > - wheel-manylinux2010-cp36m: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp36m > > > - wheel-manylinux2010-cp37m: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp37m > > > > > > Succeeded Tasks: > > > - centos-6: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-centos-6 > > > - centos-7: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-centos-7 > > > - centos-8: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-centos-8 > > > - conda-linux-gcc-py27: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-linux-gcc-py27 > > > - conda-linux-gcc-py36: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-linux-gcc-py36 > > > - conda-linux-gcc-py37: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-linux-gcc-py37 > > > - conda-osx-clang-py27: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-osx-clang-py27 > > > - conda-osx-clang-py36: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-osx-clang-py36 > > > - conda-osx-clang-py37: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-osx-clang-py37 > > > - conda-win-vs2015-py36: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-win-vs2015-py36 > > > - conda-win-vs2015-py37: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-win-vs2015-py37 > > > - debian-buster: > > > URL: > > > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-debian-buster > > > - debian-stretch: > > > URL: > > >
Re: [NIGHTLY] Arrow Build Report for Job nightly-2019-12-03-0
Is there a jira for this yet? On Tue, Dec 3, 2019 at 12:31 PM Wes McKinney wrote: > The manylinux builds are failing because of a missing Docker image > > $ docker-compose pull $BUILD_IMAGE > 228Pulling centos-python-manylinux2010 ... > 229ERROR: for centos-python-manylinux2010 manifest for > apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 not found > 230manifest for > apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 not found > > These have been failing for several days -- what needs to be done to fix > this? > > On Tue, Dec 3, 2019 at 7:17 AM Crossbow wrote: > > > > > > Arrow Build Report for Job nightly-2019-12-03-0 > > > > All tasks: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0 > > > > Failed Tasks: > > - test-debian-10-rust-nightly-2019-09-25: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-circle-test-debian-10-rust-nightly-2019-09-25 > > - test-ubuntu-fuzzit-regression: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-circle-test-ubuntu-fuzzit-regression > > - ubuntu-disco: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-ubuntu-disco > > - wheel-manylinux1-cp27m: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp27m > > - wheel-manylinux1-cp27mu: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp27mu > > - wheel-manylinux1-cp35m: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp35m > > - wheel-manylinux1-cp36m: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp36m > > - wheel-manylinux1-cp37m: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp37m > > - wheel-manylinux2010-cp27m: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp27m > > - wheel-manylinux2010-cp27mu: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp27mu > > - wheel-manylinux2010-cp35m: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp35m > > - wheel-manylinux2010-cp36m: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp36m > > - wheel-manylinux2010-cp37m: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp37m > > > > Succeeded Tasks: > > - centos-6: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-centos-6 > > - centos-7: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-centos-7 > > - centos-8: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-centos-8 > > - conda-linux-gcc-py27: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-linux-gcc-py27 > > - conda-linux-gcc-py36: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-linux-gcc-py36 > > - conda-linux-gcc-py37: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-linux-gcc-py37 > > - conda-osx-clang-py27: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-osx-clang-py27 > > - conda-osx-clang-py36: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-osx-clang-py36 > > - conda-osx-clang-py37: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-osx-clang-py37 > > - conda-win-vs2015-py36: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-win-vs2015-py36 > > - conda-win-vs2015-py37: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-win-vs2015-py37 > > - debian-buster: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-debian-buster > > - debian-stretch: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-debian-stretch > > - gandiva-jar-osx: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-gandiva-jar-osx > > - gandiva-jar-trusty: > > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-gandiva-jar-trusty > > - homebrew-cpp: > > URL: >
Re: [DISCUSS] C data interface updated
I started a vote and left comments (mostly clarifications) on the
specification PR. I'm reviewing the C++ patch and will post comments
when I can
On Wed, Nov 13, 2019 at 4:39 AM Antoine Pitrou wrote:
>
>
> Yes, we should probably need to hold a vote at some point. Perhaps wait
> a week or so for further comments.
>
> Regards
>
> Antoine.
>
>
> Le 08/11/2019 à 03:00, Wes McKinney a écrit :
> > Thanks Antoine.
> >
> > Do we need to hold a vote to adopt the C API? I will see if I can
> > review the C++ implementation prior to leaving for ~1 week of vacation
> > next Tuesday
> >
> > On Thu, Nov 7, 2019 at 1:24 PM Antoine Pitrou wrote:
> >>
> >>
> >> Hello,
> >>
> >> The C data interface spec was updated following a suggestion
> >> by Wes and Uwe:
> >> https://github.com/apache/arrow/blob/3173f88dfa32ce3296a121b032f351e089888601/docs/source/format/CDataInterface.rst
> >>
> >> The metadata encoding was changed. It does not use JSON anymore
> >> but a very simple binary encoding. Quoting the spec:
> >>
> >>This string is not null-terminated but follows a specific format::
> >>
> >> int32: number of key/value pairs (noted N below)
> >> int32: byte length of key 0
> >> key 0 (not null-terminated)
> >> int32: byte length of value 0
> >> value 0 (not null-terminated)
> >> ...
> >> int32: byte length of key N - 1
> >> key N - 1 (not null-terminated)
> >> int32: byte length of value N - 1
> >> value N - 1 (not null-terminated)
> >>
> >>For example, the metadata ``[('key1', 'value1')]`` is encoded as::
> >>
> >> \x01\x00\x00\x00\x04\x00\x00\x00key1\x06\x00\x00\x00value1
> >>
> >>
> >> The C++ draft implementation now supports metadata exporting and importing:
> >> https://github.com/apache/arrow/pull/5608
> >>
> >> Regards
> >>
> >> Antoine.
Re: [NIGHTLY] Arrow Build Report for Job nightly-2019-12-03-0
The manylinux builds are failing because of a missing Docker image $ docker-compose pull $BUILD_IMAGE 228Pulling centos-python-manylinux2010 ... 229ERROR: for centos-python-manylinux2010 manifest for apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 not found 230manifest for apache/arrow-dev:amd64-centos-6.10-python-manylinux2010 not found These have been failing for several days -- what needs to be done to fix this? On Tue, Dec 3, 2019 at 7:17 AM Crossbow wrote: > > > Arrow Build Report for Job nightly-2019-12-03-0 > > All tasks: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0 > > Failed Tasks: > - test-debian-10-rust-nightly-2019-09-25: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-circle-test-debian-10-rust-nightly-2019-09-25 > - test-ubuntu-fuzzit-regression: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-circle-test-ubuntu-fuzzit-regression > - ubuntu-disco: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-ubuntu-disco > - wheel-manylinux1-cp27m: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp27m > - wheel-manylinux1-cp27mu: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp27mu > - wheel-manylinux1-cp35m: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp35m > - wheel-manylinux1-cp36m: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp36m > - wheel-manylinux1-cp37m: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp37m > - wheel-manylinux2010-cp27m: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp27m > - wheel-manylinux2010-cp27mu: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp27mu > - wheel-manylinux2010-cp35m: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp35m > - wheel-manylinux2010-cp36m: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp36m > - wheel-manylinux2010-cp37m: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp37m > > Succeeded Tasks: > - centos-6: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-centos-6 > - centos-7: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-centos-7 > - centos-8: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-centos-8 > - conda-linux-gcc-py27: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-linux-gcc-py27 > - conda-linux-gcc-py36: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-linux-gcc-py36 > - conda-linux-gcc-py37: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-linux-gcc-py37 > - conda-osx-clang-py27: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-osx-clang-py27 > - conda-osx-clang-py36: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-osx-clang-py36 > - conda-osx-clang-py37: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-osx-clang-py37 > - conda-win-vs2015-py36: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-win-vs2015-py36 > - conda-win-vs2015-py37: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-win-vs2015-py37 > - debian-buster: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-debian-buster > - debian-stretch: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-debian-stretch > - gandiva-jar-osx: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-gandiva-jar-osx > - gandiva-jar-trusty: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-gandiva-jar-trusty > - homebrew-cpp: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-homebrew-cpp > - macos-r-autobrew: > URL: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-macos-r-autobrew > - test-conda-cpp: > URL: >
[jira] [Created] (ARROW-7304) clang-tidy diagnostics not emitted for most headers
Elvis Stansvik created ARROW-7304:
-
Summary: clang-tidy diagnostics not emitted for most headers
Key: ARROW-7304
URL: https://issues.apache.org/jira/browse/ARROW-7304
Project: Apache Arrow
Issue Type: Bug
Components: C++, CI
Affects Versions: 0.15.1
Reporter: Elvis Stansvik
The {{HeaderFilterRegex}} in {{.clang-tidy}} is written
HeaderFilterRegex:
'^(.*codegen.*|.*_generated.*|.*windows_compatibility.h|.*pyarrow_api.h|.*pyarrow_lib.h|.*python/config.h|.*python/platform.h|.*thirdparty/ae/.*|.*vendored/.*|.*RcppExports.cpp.*|)$'
as if it was an exclusion filter, but it is in fact an inclusion filter. So
clang-tidy diagnostics are not emitted for I guess most of the headers in Arrow.
See
https://github.com/apache/arrow/commit/72b553147e4bd47e100fbfd58ed49041561b7bc4#r36225046
which is where I ran into this.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
Re: [VOTE] Adopt Arrow in-process C Data Interface specification
+1 (non-binding) On Tue, Dec 3, 2019 at 10:56 AM Wes McKinney wrote: > +1 (binding) > > On Tue, Dec 3, 2019 at 12:54 PM Wes McKinney wrote: > > > > hello, > > > > We have been discussing the creation of a minimalist C-based data > > interface for applications to exchange Arrow columnar data structures > > with each other. Some notable features of this interface include: > > > > * A small amount of header-only C code can be copied into downstream > > applications, no external dependencies are needed (notable, it is not > > required to use Flatbuffers, though there are trade-offs resulting > > from this) > > * Low development investment (in other words: limited-scope use cases > > can be accomplished with little code). Enable C libraries to export > > Arrow columnar data at C call sites with minimal code > > > > This "C Data Interface" serves different use cases from the > > language-independent IPC protocol and trades away a number of features > > (such as forward/backward compatibility) in the interest of minimalism > > / simplicity. It is not a replacement for the IPC protocol and will > > only be used to interchange in-process data at C call sites. > > > > The PR providing the specification is here > > > > https://github.com/apache/arrow/pull/5442 > > > > A fairly comprehensive C++ implementation of this demonstrating its > > use is found here > > > > https://github.com/apache/arrow/pull/5608 > > > > (note that other applications implementing the interface may choose to > > only support a few features and thus have far less code to write) > > > > Please vote to adopt the SPECIFICATION (GitHub PR #5442). > > > > This vote will be open for at least 72 hours > > > > [ ] +1 Adopt C Data Interface specification > > [ ] +0 > > [ ] -1 Do not adopt because... > > > > Thank you >
[jira] [Created] (ARROW-7303) [C++] Refactor benchmarks to use new Result APIs
Ben Kietzman created ARROW-7303:
---
Summary: [C++] Refactor benchmarks to use new Result APIs
Key: ARROW-7303
URL: https://issues.apache.org/jira/browse/ARROW-7303
Project: Apache Arrow
Issue Type: Improvement
Components: C++
Affects Versions: 0.15.1
Reporter: Ben Kietzman
Assignee: Ben Kietzman
Fix For: 1.0.0
When building benchmarks, I get the following error:
{code}
../src/arrow/csv/converter_benchmark.cc:83:64: error: too many arguments to
function call, expected 2, have 3
ABORT_NOT_OK(converter->Convert(parser, 0 /* col_index */, ));
{code}
This was introduced by ARROW-7236. I guess the CI didn't catch it because we
don't currently build benchmarks? [~apitrou] [~kszucs]
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
Re: [VOTE] Adopt Arrow in-process C Data Interface specification
+1 (binding) On Tue, Dec 3, 2019 at 12:54 PM Wes McKinney wrote: > > hello, > > We have been discussing the creation of a minimalist C-based data > interface for applications to exchange Arrow columnar data structures > with each other. Some notable features of this interface include: > > * A small amount of header-only C code can be copied into downstream > applications, no external dependencies are needed (notable, it is not > required to use Flatbuffers, though there are trade-offs resulting > from this) > * Low development investment (in other words: limited-scope use cases > can be accomplished with little code). Enable C libraries to export > Arrow columnar data at C call sites with minimal code > > This "C Data Interface" serves different use cases from the > language-independent IPC protocol and trades away a number of features > (such as forward/backward compatibility) in the interest of minimalism > / simplicity. It is not a replacement for the IPC protocol and will > only be used to interchange in-process data at C call sites. > > The PR providing the specification is here > > https://github.com/apache/arrow/pull/5442 > > A fairly comprehensive C++ implementation of this demonstrating its > use is found here > > https://github.com/apache/arrow/pull/5608 > > (note that other applications implementing the interface may choose to > only support a few features and thus have far less code to write) > > Please vote to adopt the SPECIFICATION (GitHub PR #5442). > > This vote will be open for at least 72 hours > > [ ] +1 Adopt C Data Interface specification > [ ] +0 > [ ] -1 Do not adopt because... > > Thank you
[VOTE] Adopt Arrow in-process C Data Interface specification
hello, We have been discussing the creation of a minimalist C-based data interface for applications to exchange Arrow columnar data structures with each other. Some notable features of this interface include: * A small amount of header-only C code can be copied into downstream applications, no external dependencies are needed (notable, it is not required to use Flatbuffers, though there are trade-offs resulting from this) * Low development investment (in other words: limited-scope use cases can be accomplished with little code). Enable C libraries to export Arrow columnar data at C call sites with minimal code This "C Data Interface" serves different use cases from the language-independent IPC protocol and trades away a number of features (such as forward/backward compatibility) in the interest of minimalism / simplicity. It is not a replacement for the IPC protocol and will only be used to interchange in-process data at C call sites. The PR providing the specification is here https://github.com/apache/arrow/pull/5442 A fairly comprehensive C++ implementation of this demonstrating its use is found here https://github.com/apache/arrow/pull/5608 (note that other applications implementing the interface may choose to only support a few features and thus have far less code to write) Please vote to adopt the SPECIFICATION (GitHub PR #5442). This vote will be open for at least 72 hours [ ] +1 Adopt C Data Interface specification [ ] +0 [ ] -1 Do not adopt because... Thank you
Re: predict whether pa.array() will produce ChunkedArray
hi John, The documentation says array : pyarrow.Array or pyarrow.ChunkedArray A ChunkedArray instead of an Array is returned if: - the object data overflowed binary storage. - the object's ``__arrow_array__`` protocol method returned a chunked array. Overflowing binary storage means exceeding the 2^31 - 1 bytes limit for BinaryType or StringType/UTF8. We thought this was better than failing since the output of pyarrow.array is often used to instantiate a pyarrow.Table which will not argue with the ChunkedArray. Depending on your input data you might wager a guess whether the overflow will occur but it will be application-dependent. - Wes On Tue, Dec 3, 2019 at 10:51 AM John Muehlhausen wrote: > > Given input data and a type, how do we predict whether array() will produce > ChunkedArray? > > I figure the formula involves: > - the length of input > - the type, and max length (to be conservative) for variable length types > - some constant(s) that Arrow knows internally... that may change in the > future? > > Should there be an API to make this easy? Am I missing one that already > exists? > > Thanks, > John
predict whether pa.array() will produce ChunkedArray
Given input data and a type, how do we predict whether array() will produce ChunkedArray? I figure the formula involves: - the length of input - the type, and max length (to be conservative) for variable length types - some constant(s) that Arrow knows internally... that may change in the future? Should there be an API to make this easy? Am I missing one that already exists? Thanks, John
Re: [C++] CSV string column category to dictionary/indices?
Agreed. I've opened https://issues.apache.org/jira/browse/ARROW-7302 to
track it.
Regards
Antoine.
Le 03/12/2019 à 04:55, Wes McKinney a écrit :
> An option was recently added to dictionary encode all string columns
>
> https://github.com/apache/arrow/blob/master/cpp/src/arrow/csv/options.h#L82
>
> I think it would be useful to be able to hard-opt-in to
> dictionary-encode a particular column (regardless of the what
> cardinality ends up being). Whatever the way to do this, it should be
> clear and well documented. A new JIRA issue may be in order. Antoine,
> what do you think?
>
> On Sun, Dec 1, 2019 at 5:32 PM ntfs hard wrote:
>>
>> Hello
>>
>> I'm a newcomer and not quite sure about the library usage. I tried to find
>> some documentation about it but failed.
>>
>> I have a dataset in CSV file where one column(let's call it colour) is a
>> string category. I'd like to get indices instead of text_lines to pass it
>> inside algorithm.
>> I tried to set column_types in ConvertOptions in
>> {{"colour", arrow::dictionary(std::make_shared(),
>> arrow::utf8()) }} but it seems to be not right api usage, a wild run-time
>> error appears: NotImplemented: CSV conversion to dictionary> indices=int32, ordered=0> is not supported
>> Also I find a merged PR #5785 but
>> not quite sure that's applicable for my case.
>>
>> So, my question is: can I get indices inside a category column only w/
>> library API. And if yes, what I doing wrong. :)
>>
>> *In other word,* I'd like to something like such python pandas code:
>> df[column] = df[column].cat.codes # if str(column_data_type) == "category"
>>
>> Thank you!
[jira] [Created] (ARROW-7302) [C++] CSV: allow converting a column to a specific dictionary type
Antoine Pitrou created ARROW-7302:
-
Summary: [C++] CSV: allow converting a column to a specific
dictionary type
Key: ARROW-7302
URL: https://issues.apache.org/jira/browse/ARROW-7302
Project: Apache Arrow
Issue Type: Improvement
Components: C++
Reporter: Antoine Pitrou
We can probably limit ourselves to {{dictionary(int32, utf8)}}.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[NIGHTLY] Arrow Build Report for Job nightly-2019-12-03-0
Arrow Build Report for Job nightly-2019-12-03-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0 Failed Tasks: - test-debian-10-rust-nightly-2019-09-25: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-circle-test-debian-10-rust-nightly-2019-09-25 - test-ubuntu-fuzzit-regression: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-circle-test-ubuntu-fuzzit-regression - ubuntu-disco: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-ubuntu-disco - wheel-manylinux1-cp27m: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp27m - wheel-manylinux1-cp27mu: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp27mu - wheel-manylinux1-cp35m: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp35m - wheel-manylinux1-cp36m: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp36m - wheel-manylinux1-cp37m: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux1-cp37m - wheel-manylinux2010-cp27m: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp27m - wheel-manylinux2010-cp27mu: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp27mu - wheel-manylinux2010-cp35m: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp35m - wheel-manylinux2010-cp36m: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp36m - wheel-manylinux2010-cp37m: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-wheel-manylinux2010-cp37m Succeeded Tasks: - centos-6: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-centos-6 - centos-7: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-centos-7 - centos-8: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-centos-8 - conda-linux-gcc-py27: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-linux-gcc-py27 - conda-linux-gcc-py36: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-linux-gcc-py36 - conda-linux-gcc-py37: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-linux-gcc-py37 - conda-osx-clang-py27: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-osx-clang-py27 - conda-osx-clang-py36: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-osx-clang-py36 - conda-osx-clang-py37: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-osx-clang-py37 - conda-win-vs2015-py36: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-win-vs2015-py36 - conda-win-vs2015-py37: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-conda-win-vs2015-py37 - debian-buster: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-debian-buster - debian-stretch: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-azure-debian-stretch - gandiva-jar-osx: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-gandiva-jar-osx - gandiva-jar-trusty: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-gandiva-jar-trusty - homebrew-cpp: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-homebrew-cpp - macos-r-autobrew: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-travis-macos-r-autobrew - test-conda-cpp: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-circle-test-conda-cpp - test-conda-python-2.7-pandas-latest: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-circle-test-conda-python-2.7-pandas-latest - test-conda-python-2.7: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-circle-test-conda-python-2.7 - test-conda-python-3.6: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-12-03-0-circle-test-conda-python-3.6 - test-conda-python-3.7-dask-latest: URL:
