Re: [VOTE] Release Apache Arrow 1.0.0 - RC2

2020-07-22 Thread Bryan Cutler
+1 (non-binding)

I ran release verification script with the following args
ARROW_TMPDIR=/tmp/arrow-test TEST_DEFAULT=0 TEST_SOURCE=1 TEST_CPP=1
TEST_PYTHON=1 TEST_JAVA=1 TEST_INTEGRATION_CPP=1 TEST_INTEGRATION_JAVA=1
dev/release/verify-release-candidate.sh source 1.0.0 2

On Wed, Jul 22, 2020 at 1:19 PM Sutou Kouhei  wrote:

> >>   * Python 3.8 wheel's test is failed.
> > With the same Cython test issue?
>
> Yes.
>
> In 
>   "Re: [VOTE] Release Apache Arrow 1.0.0 - RC2" on Wed, 22 Jul 2020
> 12:33:49 +0200,
>   Krisztián Szűcs  wrote:
>
> > On Wed, Jul 22, 2020 at 3:19 AM Sutou Kouhei  wrote:
> >>
> >> Hi,
> >>
> >> +1 (binding)
> >>
> >> I ran the followings on Debian GNU/Linux sid:
> >>
> >>   * INSTALL_NODE=0 \
> >>   JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 \
> >>   CUDA_TOOLKIT_ROOT=/usr \
> >>   ARROW_CMAKE_OPTIONS="-DgRPC_SOURCE=BUNDLED
> -DBoost_NO_BOOST_CMAKE=ON" \
> >> dev/release/verify-release-candidate.sh source 1.0.0 2
> >>   * dev/release/verify-release-candidate.sh binaries 1.0.0 2
> >>   * dev/release/verify-release-candidate.sh wheels 1.0.0 2
> >>
> >> with:
> >>
> >>   * gcc version 9.3.0 (Debian 9.3.0-15)
> >>   * openjdk version "1.8.0_252"
> >>   * Node.js v12.18.1
> >>   * nvidia-cuda-dev 10.1.243-6+b1
> >>
> >> Notes:
> >>
> >>   * JavaScript tests are failed without INSTALL_NODE=0 (with
> >> Node.js 14).
> >>
> >>   * Python 3.8 wheel's test is failed.
> > With the same Cython test issue?
> >>
> >>
> >> Thanks,
> >> --
> >> kou
> >>
> >>
> >> In 
> >>   "[VOTE] Release Apache Arrow 1.0.0 - RC2" on Tue, 21 Jul 2020
> 04:07:39 +0200,
> >>   Krisztián Szűcs  wrote:
> >>
> >> > Hi,
> >> >
> >> > I would like to propose the following release candidate (RC2) of
> Apache
> >> > Arrow version 1.0.0. This is a release consisting of 838
> >> > resolved JIRA issues[1].
> >> >
> >> > This release candidate is based on commit:
> >> > b0d623957db820de4f1ff0a5ebd3e888194a48f0 [2]
> >> >
> >> > The source release rc2 is hosted at [3].
> >> > The binary artifacts are hosted at [4][5][6][7].
> >> > The changelog is located at [8].
> >> >
> >> > Please download, verify checksums and signatures, run the unit tests,
> >> > and vote on the release. See [9] for how to validate a release
> candidate.
> >> >
> >> > The vote will be open for at least 72 hours.
> >> >
> >> > [ ] +1 Release this as Apache Arrow 1.0.0
> >> > [ ] +0
> >> > [ ] -1 Do not release this as Apache Arrow 1.0.0 because...
> >> >
> >> > [1]:
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%201.0.0
> >> > [2]:
> https://github.com/apache/arrow/tree/b0d623957db820de4f1ff0a5ebd3e888194a48f0
> >> > [3]:
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-1.0.0-rc2
> >> > [4]: https://bintray.com/apache/arrow/centos-rc/1.0.0-rc2
> >> > [5]: https://bintray.com/apache/arrow/debian-rc/1.0.0-rc2
> >> > [6]: https://bintray.com/apache/arrow/python-rc/1.0.0-rc2
> >> > [7]: https://bintray.com/apache/arrow/ubuntu-rc/1.0.0-rc2
> >> > [8]:
> https://github.com/apache/arrow/blob/b0d623957db820de4f1ff0a5ebd3e888194a48f0/CHANGELOG.md
> >> > [9]:
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>


Re: [VOTE] Release Apache Arrow 1.0.0 - RC2

2020-07-22 Thread Sutou Kouhei
>>   * Python 3.8 wheel's test is failed.
> With the same Cython test issue?

Yes.

In 
  "Re: [VOTE] Release Apache Arrow 1.0.0 - RC2" on Wed, 22 Jul 2020 12:33:49 
+0200,
  Krisztián Szűcs  wrote:

> On Wed, Jul 22, 2020 at 3:19 AM Sutou Kouhei  wrote:
>>
>> Hi,
>>
>> +1 (binding)
>>
>> I ran the followings on Debian GNU/Linux sid:
>>
>>   * INSTALL_NODE=0 \
>>   JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 \
>>   CUDA_TOOLKIT_ROOT=/usr \
>>   ARROW_CMAKE_OPTIONS="-DgRPC_SOURCE=BUNDLED -DBoost_NO_BOOST_CMAKE=ON" \
>> dev/release/verify-release-candidate.sh source 1.0.0 2
>>   * dev/release/verify-release-candidate.sh binaries 1.0.0 2
>>   * dev/release/verify-release-candidate.sh wheels 1.0.0 2
>>
>> with:
>>
>>   * gcc version 9.3.0 (Debian 9.3.0-15)
>>   * openjdk version "1.8.0_252"
>>   * Node.js v12.18.1
>>   * nvidia-cuda-dev 10.1.243-6+b1
>>
>> Notes:
>>
>>   * JavaScript tests are failed without INSTALL_NODE=0 (with
>> Node.js 14).
>>
>>   * Python 3.8 wheel's test is failed.
> With the same Cython test issue?
>>
>>
>> Thanks,
>> --
>> kou
>>
>>
>> In 
>>   "[VOTE] Release Apache Arrow 1.0.0 - RC2" on Tue, 21 Jul 2020 04:07:39 
>> +0200,
>>   Krisztián Szűcs  wrote:
>>
>> > Hi,
>> >
>> > I would like to propose the following release candidate (RC2) of Apache
>> > Arrow version 1.0.0. This is a release consisting of 838
>> > resolved JIRA issues[1].
>> >
>> > This release candidate is based on commit:
>> > b0d623957db820de4f1ff0a5ebd3e888194a48f0 [2]
>> >
>> > The source release rc2 is hosted at [3].
>> > The binary artifacts are hosted at [4][5][6][7].
>> > The changelog is located at [8].
>> >
>> > Please download, verify checksums and signatures, run the unit tests,
>> > and vote on the release. See [9] for how to validate a release candidate.
>> >
>> > The vote will be open for at least 72 hours.
>> >
>> > [ ] +1 Release this as Apache Arrow 1.0.0
>> > [ ] +0
>> > [ ] -1 Do not release this as Apache Arrow 1.0.0 because...
>> >
>> > [1]: 
>> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%201.0.0
>> > [2]: 
>> > https://github.com/apache/arrow/tree/b0d623957db820de4f1ff0a5ebd3e888194a48f0
>> > [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-1.0.0-rc2
>> > [4]: https://bintray.com/apache/arrow/centos-rc/1.0.0-rc2
>> > [5]: https://bintray.com/apache/arrow/debian-rc/1.0.0-rc2
>> > [6]: https://bintray.com/apache/arrow/python-rc/1.0.0-rc2
>> > [7]: https://bintray.com/apache/arrow/ubuntu-rc/1.0.0-rc2
>> > [8]: 
>> > https://github.com/apache/arrow/blob/b0d623957db820de4f1ff0a5ebd3e888194a48f0/CHANGELOG.md
>> > [9]: 
>> > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates


Re: [VOTE] Release Apache Arrow 1.0.0 - RC2

2020-07-22 Thread Neal Richardson
+1 (binding)

Neal

On Wed, Jul 22, 2020 at 3:34 AM Krisztián Szűcs 
wrote:

> On Wed, Jul 22, 2020 at 3:19 AM Sutou Kouhei  wrote:
> >
> > Hi,
> >
> > +1 (binding)
> >
> > I ran the followings on Debian GNU/Linux sid:
> >
> >   * INSTALL_NODE=0 \
> >   JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 \
> >   CUDA_TOOLKIT_ROOT=/usr \
> >   ARROW_CMAKE_OPTIONS="-DgRPC_SOURCE=BUNDLED
> -DBoost_NO_BOOST_CMAKE=ON" \
> > dev/release/verify-release-candidate.sh source 1.0.0 2
> >   * dev/release/verify-release-candidate.sh binaries 1.0.0 2
> >   * dev/release/verify-release-candidate.sh wheels 1.0.0 2
> >
> > with:
> >
> >   * gcc version 9.3.0 (Debian 9.3.0-15)
> >   * openjdk version "1.8.0_252"
> >   * Node.js v12.18.1
> >   * nvidia-cuda-dev 10.1.243-6+b1
> >
> > Notes:
> >
> >   * JavaScript tests are failed without INSTALL_NODE=0 (with
> > Node.js 14).
> >
> >   * Python 3.8 wheel's test is failed.
> With the same Cython test issue?
> >
> >
> > Thanks,
> > --
> > kou
> >
> >
> > In 
> >   "[VOTE] Release Apache Arrow 1.0.0 - RC2" on Tue, 21 Jul 2020 04:07:39
> +0200,
> >   Krisztián Szűcs  wrote:
> >
> > > Hi,
> > >
> > > I would like to propose the following release candidate (RC2) of Apache
> > > Arrow version 1.0.0. This is a release consisting of 838
> > > resolved JIRA issues[1].
> > >
> > > This release candidate is based on commit:
> > > b0d623957db820de4f1ff0a5ebd3e888194a48f0 [2]
> > >
> > > The source release rc2 is hosted at [3].
> > > The binary artifacts are hosted at [4][5][6][7].
> > > The changelog is located at [8].
> > >
> > > Please download, verify checksums and signatures, run the unit tests,
> > > and vote on the release. See [9] for how to validate a release
> candidate.
> > >
> > > The vote will be open for at least 72 hours.
> > >
> > > [ ] +1 Release this as Apache Arrow 1.0.0
> > > [ ] +0
> > > [ ] -1 Do not release this as Apache Arrow 1.0.0 because...
> > >
> > > [1]:
> https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%201.0.0
> > > [2]:
> https://github.com/apache/arrow/tree/b0d623957db820de4f1ff0a5ebd3e888194a48f0
> > > [3]:
> https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-1.0.0-rc2
> > > [4]: https://bintray.com/apache/arrow/centos-rc/1.0.0-rc2
> > > [5]: https://bintray.com/apache/arrow/debian-rc/1.0.0-rc2
> > > [6]: https://bintray.com/apache/arrow/python-rc/1.0.0-rc2
> > > [7]: https://bintray.com/apache/arrow/ubuntu-rc/1.0.0-rc2
> > > [8]:
> https://github.com/apache/arrow/blob/b0d623957db820de4f1ff0a5ebd3e888194a48f0/CHANGELOG.md
> > > [9]:
> https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates
>


Re: language independent representation of filter expressions

2020-07-22 Thread Patrick Pai
Hi all,

After some discussion with Steve, we'd like to propose and get feedback on an 
alternative to representing expressions entirely with flatbuffers.

To give some context, we thought about how we'd construct flatbuffer 
expressions in Java or another language if we went down that route. We realized 
that it'd be possible, but not user friendly. An example is specifying an array 
of int values in Java for an InExpression. In Java, we'd ideally have some 
user-friendly class (i.e. arrow's IntVector) that then gets converted to the 
appropriate flatbuffer representation. I think this is what Jacques was saying 
about language support being too weak - it's possible for Java users to 
construct a flatbuffer expression, but not easily without an additional 
conversion layer for every language.

An alternative we're thinking about is to only represent enum values (i.e. 
those defined in arrow::dataset::ExpressionType::type) in a flatbuffer schema, 
and rely on the existing IPC format (used to serialize/deserialize cpp 
expressions) to pass the struct array representation of an expression from for 
example Java to C++. The one difference is in the struct array representation, 
we use the enum values defined in our flatbuffer schema instead of existing cpp 
enums. This approach requires us on the Java side (and languages other than 
C++) to construct the struct array, but the benefit is minimal changes to the 
C++ code (the main change being using our flatbuffer schema enum values).


On 2020/07/13 09:21:19, Antoine Pitrou  wrote:
> On Sat, 11 Jul 2020 09:55:16 -0700
> Jacques Nadeau  wrote:
> >
> > I'm against extending use of flatbuf within Arrow. The language support is
> > too weak. Language support isn't just about having a binding for different
> > languages, it is about having a high-quality binding.
>
> Could you please expand on this?  ("the language support is too weak")
>
> Thank you
>
> Antoine.
>
>
>

This e-mail and any attachments may contain information that is confidential 
and proprietary and otherwise protected from disclosure. If you are not the 
intended recipient of this e-mail, do not read, duplicate or redistribute it by 
any means. Please immediately delete it and any attachments and notify the 
sender that you have received it by mistake. Unintended recipients are 
prohibited from taking action on the basis of information in this e-mail or any 
attachments. The DRW Companies make no representations that this e-mail or any 
attachments are free of computer viruses or other defects.


Arrow sync call July 22 at 12:00 US/Eastern, 16:00 UTC

2020-07-22 Thread Neal Richardson
Hi all,
Reminder that our biweekly call is coming up at the top of the hour at
https://meet.google.com/vtm-teks-phx. All are welcome to join. Notes will
be sent out to the mailing list afterward.

Neal


Re: Introducing Cylon

2020-07-22 Thread Uwe L. Korn
Hello Niranda,

cool to see this. Feel free to open a PR to add it to the Powered By list on 
https://arrow.apache.org/powered_by/

Cheers
Uwe

On Tue, Jul 21, 2020, at 8:03 PM, Niranda Perera wrote:
> Hi all,
> 
> We would like to introduce Cylon to the Arrow community. It is an
> open-source, lean distributed data processing library using the Arrow data
> format underneath. It is developed in C++ with bindings to Java, and
> Python. It has an in-memory Table API that integrates with PyArrow Table
> API. Cylon enables distributed data operations (ex: join (all variants),
> union, intersection, difference, etc). It can be imported as a library to
> existing applications or operate as a standalone framework. At the moment
> it is using OpenMPI to distribute and communicate. It is released with
> Apache License.
> 
> We are developing a distributed data-frame API on top of Cylon table API.
> It would be similar to the Dask/ Modin data-frame. Our initial experiments
> show promising performance. Cylon language bindings are also very
> lightweight. We just had the very first release of Cylon. We would like to
> hear from the Arrow community... Any comments, ideas are most appreciated!
> 
> Web visit - https://cylondata.org/  
> Github - https://github.com/cylondata/cylon
> Paper - https://arxiv.org/abs/2007.09589
> 
> Best
> -- 
> Niranda Perera
> @n1r44 
> +1 812 558 8884 / +94 71 554 8430
> https://www.linkedin.com/in/niranda
>


Re: Java Arrow to C++ Arrow and vice versa

2020-07-22 Thread Chathura Widanage
Thanks Ji Liu and Micha.

On Wed, Jul 22, 2020, 01:34 Micah Kornfield  wrote:

> >
> > Was there any particular reason for not writing Java Arrow as a JNI
> binding
> > for CPP Arrow?
>
>
> The Java code base originated from Apache Drill and was the first
> implementation of Arrow.  There is value in having a pure java
> implementation separate from any C++ code base (JNI cannot be used in all
> contexts).
>
> On Tue, Jul 21, 2020 at 7:48 PM Ji Liu  wrote:
>
> > Hi Chathura,
> >
> >
> >
> https://lists.apache.org/thread.html/5bf70a6f1a3fa3e543a92b3217e64465a3b761ca307e8114550f9d8b@%3Cdev.arrow.apache.org%3E
> > has
> > the relevant pointers.
> >
> >
> > Thanks,
> > Ji Liu
> >
> >
> >
> > Chathura Widanage  于2020年7月22日周三 上午3:03写道:
> >
> > > Hi all,
> > >
> > > Was there any particular reason for not writing Java Arrow as a JNI
> > binding
> > > for CPP Arrow?
> > >
> > > What is the most straightforward and efficient way to convert a java
> > arrow
> > > schema/table to a JNI backed C++ arrow schema/table?
> > >
> > > Regards,
> > > Chathura
> > >
> >
>


Re: [RUST] Zero-copy Vec -> PrimitiveArray

2020-07-22 Thread vertexclique vertexclique
Hi;

If you have odd sized Vec it is not possible to get a zero-copy array
with Arrow. Since you will access to non allocated memory region if you try
to get a zero-copy view on that. What you will receive at the end of your
buffer will be some garbage bytes (not mentioning UB and ownership of the
data and such when overwritten in your next operation). In Rust arrow, you
get different byte alignments for your target_arch. So there is no strict
rule about alignments, but it is mostly 64 bytes.

Best,
Mahmut Bulut

On Jul 22, 2020, at 11:01, Ritchie Vink  wrote:
>
> Hey all,
>
> Is it possible in any way to go from a Rust Vec to an Arrow buffer. I
> know the alignments of arrow memory is 8 or 64 bits and this isn't the case
> for Rust's Vec type. Could we instantiate a Vec in any way such that a zero
> copy PrimitiveArray is possible?
>
> Thanks in advance,
>
> Ritchie Vink
>
>


Re: [VOTE] Release Apache Arrow 1.0.0 - RC2

2020-07-22 Thread Krisztián Szűcs
On Wed, Jul 22, 2020 at 3:19 AM Sutou Kouhei  wrote:
>
> Hi,
>
> +1 (binding)
>
> I ran the followings on Debian GNU/Linux sid:
>
>   * INSTALL_NODE=0 \
>   JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64 \
>   CUDA_TOOLKIT_ROOT=/usr \
>   ARROW_CMAKE_OPTIONS="-DgRPC_SOURCE=BUNDLED -DBoost_NO_BOOST_CMAKE=ON" \
> dev/release/verify-release-candidate.sh source 1.0.0 2
>   * dev/release/verify-release-candidate.sh binaries 1.0.0 2
>   * dev/release/verify-release-candidate.sh wheels 1.0.0 2
>
> with:
>
>   * gcc version 9.3.0 (Debian 9.3.0-15)
>   * openjdk version "1.8.0_252"
>   * Node.js v12.18.1
>   * nvidia-cuda-dev 10.1.243-6+b1
>
> Notes:
>
>   * JavaScript tests are failed without INSTALL_NODE=0 (with
> Node.js 14).
>
>   * Python 3.8 wheel's test is failed.
With the same Cython test issue?
>
>
> Thanks,
> --
> kou
>
>
> In 
>   "[VOTE] Release Apache Arrow 1.0.0 - RC2" on Tue, 21 Jul 2020 04:07:39 
> +0200,
>   Krisztián Szűcs  wrote:
>
> > Hi,
> >
> > I would like to propose the following release candidate (RC2) of Apache
> > Arrow version 1.0.0. This is a release consisting of 838
> > resolved JIRA issues[1].
> >
> > This release candidate is based on commit:
> > b0d623957db820de4f1ff0a5ebd3e888194a48f0 [2]
> >
> > The source release rc2 is hosted at [3].
> > The binary artifacts are hosted at [4][5][6][7].
> > The changelog is located at [8].
> >
> > Please download, verify checksums and signatures, run the unit tests,
> > and vote on the release. See [9] for how to validate a release candidate.
> >
> > The vote will be open for at least 72 hours.
> >
> > [ ] +1 Release this as Apache Arrow 1.0.0
> > [ ] +0
> > [ ] -1 Do not release this as Apache Arrow 1.0.0 because...
> >
> > [1]: 
> > https://issues.apache.org/jira/issues/?jql=project%20%3D%20ARROW%20AND%20status%20in%20%28Resolved%2C%20Closed%29%20AND%20fixVersion%20%3D%201.0.0
> > [2]: 
> > https://github.com/apache/arrow/tree/b0d623957db820de4f1ff0a5ebd3e888194a48f0
> > [3]: https://dist.apache.org/repos/dist/dev/arrow/apache-arrow-1.0.0-rc2
> > [4]: https://bintray.com/apache/arrow/centos-rc/1.0.0-rc2
> > [5]: https://bintray.com/apache/arrow/debian-rc/1.0.0-rc2
> > [6]: https://bintray.com/apache/arrow/python-rc/1.0.0-rc2
> > [7]: https://bintray.com/apache/arrow/ubuntu-rc/1.0.0-rc2
> > [8]: 
> > https://github.com/apache/arrow/blob/b0d623957db820de4f1ff0a5ebd3e888194a48f0/CHANGELOG.md
> > [9]: 
> > https://cwiki.apache.org/confluence/display/ARROW/How+to+Verify+Release+Candidates


[NIGHTLY] Arrow Build Report for Job nightly-2020-07-22-0

2020-07-22 Thread Crossbow


Arrow Build Report for Job nightly-2020-07-22-0

All tasks: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0

Failed Tasks:
- debian-buster-arm64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-travis-debian-buster-arm64
- test-conda-python-3.7-hdfs-2.9.2:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-github-test-conda-python-3.7-hdfs-2.9.2

Pending Tasks:
- test-conda-python-3.8-dask-master:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-github-test-conda-python-3.8-dask-master

Succeeded Tasks:
- centos-6-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-github-centos-6-amd64
- centos-7-aarch64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-travis-centos-7-aarch64
- centos-7-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-github-centos-7-amd64
- centos-8-aarch64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-travis-centos-8-aarch64
- centos-8-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-github-centos-8-amd64
- conda-clean:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-azure-conda-clean
- conda-linux-gcc-py36-cpu:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-azure-conda-linux-gcc-py36-cpu
- conda-linux-gcc-py36-cuda:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-azure-conda-linux-gcc-py36-cuda
- conda-linux-gcc-py37-cpu:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-azure-conda-linux-gcc-py37-cpu
- conda-linux-gcc-py37-cuda:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-azure-conda-linux-gcc-py37-cuda
- conda-linux-gcc-py38-cpu:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-azure-conda-linux-gcc-py38-cpu
- conda-linux-gcc-py38-cuda:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-azure-conda-linux-gcc-py38-cuda
- conda-osx-clang-py36:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-azure-conda-osx-clang-py36
- conda-osx-clang-py37:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-azure-conda-osx-clang-py37
- conda-osx-clang-py38:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-azure-conda-osx-clang-py38
- conda-win-vs2017-py36:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-azure-conda-win-vs2017-py36
- conda-win-vs2017-py37:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-azure-conda-win-vs2017-py37
- conda-win-vs2017-py38:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-azure-conda-win-vs2017-py38
- debian-buster-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-github-debian-buster-amd64
- debian-stretch-amd64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-github-debian-stretch-amd64
- debian-stretch-arm64:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-travis-debian-stretch-arm64
- gandiva-jar-osx:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-travis-gandiva-jar-osx
- gandiva-jar-xenial:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-travis-gandiva-jar-xenial
- homebrew-cpp:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-travis-homebrew-cpp
- homebrew-r-autobrew:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-travis-homebrew-r-autobrew
- nuget:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-github-nuget
- test-conda-cpp-valgrind:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-github-test-conda-cpp-valgrind
- test-conda-cpp:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-github-test-conda-cpp
- test-conda-python-3.6-pandas-0.23:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-github-test-conda-python-3.6-pandas-0.23
- test-conda-python-3.6:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-github-test-conda-python-3.6
- test-conda-python-3.7-dask-latest:
  URL: 
https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-07-22-0-github-test-conda-python-3.7-dask-latest
- test-conda-python-3.7-kartothek-latest:
  URL: 

[RUST] Zero-copy Vec -> PrimitiveArray

2020-07-22 Thread Ritchie Vink
Hey all,

Is it possible in any way to go from a Rust Vec to an Arrow buffer. I
know the alignments of arrow memory is 8 or 64 bits and this isn't the case
for Rust's Vec type. Could we instantiate a Vec in any way such that a zero
copy PrimitiveArray is possible?

Thanks in advance,

Ritchie Vink