Re: [Format] C Data Interface integration testing

2023-10-19 Thread Aldrin
t;> Hello again,>> Quick update: the C++, C#, Go and Java implementations now all> participate in C Data Interface integration testing.>> (this helped us fix a few interoperability bugs, and add deterministic> releasing of imported data in Go)>> Arrow Rust does not p

Re: [Format] C Data Interface integration testing

2023-10-19 Thread Richard Haven
UNSUBSCRIBE BAJARSE ANFOSGRIFIAD ОТПИШИ HLOKOMELA On Thu, Oct 19, 2023 at 9:56 AM Antoine Pitrou wrote: > > Hello again, > > Quick update: the C++, C#, Go and Java implementations now all > participate in C Data Interface integration testing. > > (this helped us fix a

Re: [Format] C Data Interface integration testing

2023-10-19 Thread Richard Haven
> > > UNSUBSCRIBE >

Re: [Format] C Data Interface integration testing

2023-10-19 Thread Neal Richardson
Nice work! Neal On Thu, Oct 19, 2023 at 4:01 PM Antoine Pitrou wrote: > > Hello again, > > Quick update: the C++, C#, Go and Java implementations now all > participate in C Data Interface integration testing. > > (this helped us fix a few interoperability bugs,

Re: [Format] C Data Interface integration testing

2023-10-19 Thread Antoine Pitrou
Hello again, Quick update: the C++, C#, Go and Java implementations now all participate in C Data Interface integration testing. (this helped us fix a few interoperability bugs, and add deterministic releasing of imported data in Go) Arrow Rust does not participate yet, but given how

Re: [Format] C Data Interface integration testing

2023-09-26 Thread Dewey Dunnington
Thank you for setting this up! I look forward to adding nanoarrow as soon as time allows. Cheers, -dewey On Tue, Sep 26, 2023 at 9:48 AM Antoine Pitrou wrote: > > > Hello, > > We have added some infrastructure for integration testing of the C Data > Interface between Arrow i

[Format] C Data Interface integration testing

2023-09-26 Thread Antoine Pitrou
Hello, We have added some infrastructure for integration testing of the C Data Interface between Arrow implementations. We are now testing the C++ and Go implementations, but the goal in the future is for all major implementations to be tested there (perhaps including nanoarrow). - PR

Re: Proposal for C Data Interface Integration testing

2022-11-04 Thread Matt Topol
a > Interface, I've put together a small proposal for developing the > integration testing for the C Data interface. For the most part it's an > extension of Archery and the way Archery's integration testing works. I've > put it into a Google doc and anyone with the link[1] should be

Proposal for C Data Interface Integration testing

2022-10-28 Thread Matt Topol
Hey all! Given various discussions about our testing and the C Data Interface, I've put together a small proposal for developing the integration testing for the C Data interface. For the most part it's an extension of Archery and the way Archery's integration testing works. I've put

Re: Status of Rust Integration Testing

2020-07-11 Thread Neville Dipale
Neville Dipale > wrote: > > > Good day Arrow devs, > > > > I've spent a few evenings looking into the issues that we're experiencing > > with Rust integration testing. > > In summary, none of our tests pass (zero batch doesn't count :) ). > > This is mai

Re: Status of Rust Integration Testing

2020-07-10 Thread Micah Kornfield
at 1:03 PM Neville Dipale wrote: > Good day Arrow devs, > > I've spent a few evenings looking into the issues that we're experiencing > with Rust integration testing. > In summary, none of our tests pass (zero batch doesn't count :) ). > This is mainly because of changes from the

Status of Rust Integration Testing

2020-07-10 Thread Neville Dipale
Good day Arrow devs, I've spent a few evenings looking into the issues that we're experiencing with Rust integration testing. In summary, none of our tests pass (zero batch doesn't count :) ). This is mainly because of changes from the legacy padding in the 0.15.0 release, which we never made

[jira] [Created] (ARROW-8883) [Rust] [Integration Testing] Disable unsupported tests

2020-05-21 Thread Neville Dipale (Jira)
Neville Dipale created ARROW-8883: - Summary: [Rust] [Integration Testing] Disable unsupported tests Key: ARROW-8883 URL: https://issues.apache.org/jira/browse/ARROW-8883 Project: Apache Arrow

[jira] [Created] (ARROW-8859) [Rust] [Integration Testing] Implement --quiet / verbose correctly

2020-05-19 Thread Andy Grove (Jira)
Andy Grove created ARROW-8859: - Summary: [Rust] [Integration Testing] Implement --quiet / verbose correctly Key: ARROW-8859 URL: https://issues.apache.org/jira/browse/ARROW-8859 Project: Apache Arrow

[jira] [Created] (ARROW-8856) [Rust] [Integration Testing] Reading types other than record batches not yet supported

2020-05-18 Thread Andy Grove (Jira)
Andy Grove created ARROW-8856: - Summary: [Rust] [Integration Testing] Reading types other than record batches not yet supported Key: ARROW-8856 URL: https://issues.apache.org/jira/browse/ARROW-8856

[jira] [Created] (ARROW-8855) [Rust] [Integration Testing] data type Date32(Day) not supported

2020-05-18 Thread Andy Grove (Jira)
Andy Grove created ARROW-8855: - Summary: [Rust] [Integration Testing] data type Date32(Day) not supported Key: ARROW-8855 URL: https://issues.apache.org/jira/browse/ARROW-8855 Project: Apache Arrow

[jira] [Created] (ARROW-8854) [Rust] [Integration Testing] Show output from arrow-json-integration-test

2020-05-18 Thread Andy Grove (Jira)
Andy Grove created ARROW-8854: - Summary: [Rust] [Integration Testing] Show output from arrow-json-integration-test Key: ARROW-8854 URL: https://issues.apache.org/jira/browse/ARROW-8854 Project: Apache

[jira] [Created] (ARROW-8853) [Rust] [Integration Testing] Enable Flight tests

2020-05-18 Thread Andy Grove (Jira)
Andy Grove created ARROW-8853: - Summary: [Rust] [Integration Testing] Enable Flight tests Key: ARROW-8853 URL: https://issues.apache.org/jira/browse/ARROW-8853 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-8835) [Rust] Implement arrow-stream-to-file for integration testing

2020-05-17 Thread Andy Grove (Jira)
Andy Grove created ARROW-8835: - Summary: [Rust] Implement arrow-stream-to-file for integration testing Key: ARROW-8835 URL: https://issues.apache.org/jira/browse/ARROW-8835 Project: Apache Arrow

[jira] [Created] (ARROW-8834) [Rust] Implement arrow-file-to-stream for integration testing

2020-05-17 Thread Andy Grove (Jira)
Andy Grove created ARROW-8834: - Summary: [Rust] Implement arrow-file-to-stream for integration testing Key: ARROW-8834 URL: https://issues.apache.org/jira/browse/ARROW-8834 Project: Apache Arrow

[jira] [Created] (ARROW-8827) [Integration Testing] Initial skeleton for Rust integration tests

2020-05-16 Thread Andy Grove (Jira)
Andy Grove created ARROW-8827: - Summary: [Integration Testing] Initial skeleton for Rust integration tests Key: ARROW-8827 URL: https://issues.apache.org/jira/browse/ARROW-8827 Project: Apache Arrow

[jira] [Created] (ARROW-8807) [Docs] Integration testing instructions for base docker image are incorrect

2020-05-14 Thread Andy Grove (Jira)
Andy Grove created ARROW-8807: - Summary: [Docs] Integration testing instructions for base docker image are incorrect Key: ARROW-8807 URL: https://issues.apache.org/jira/browse/ARROW-8807 Project: Apache

Re: Integration testing

2020-03-05 Thread Neal Richardson
On Thu, Mar 5, 2020 at 8:44 PM Micah Kornfield wrote: > Hi Neal, > Sorry for the late reply. > > Unsigned integers in Java was resolved via > https://github.com/apache/arrow/pull/4432 > > Thanks, I've updated the spreadsheet to reflect that. > We might want to separate out Dense/Sparse union

Re: Integration testing

2020-03-05 Thread Micah Kornfield
Hi Neal, Sorry for the late reply. Unsigned integers in Java was resolved via https://github.com/apache/arrow/pull/4432 We might want to separate out Dense/Sparse union testing into their own issues. Thanks, Micah On Fri, Feb 21, 2020 at 2:12 PM Neal Richardson wrote: > Thanks, I've marked

Re: Integration testing

2020-02-21 Thread Neal Richardson
Thanks, I've marked that as not required for 1.0 (and added a legend to the bottom of the table). Anything else that needs to be added or reclassified? Neal On Fri, Feb 21, 2020 at 12:19 AM Antoine Pitrou wrote: > > Hi, > > I don't think float16 support is required for 1.0. > On the C++ side

Re: Integration testing

2020-02-21 Thread Antoine Pitrou
Hi, I don't think float16 support is required for 1.0. On the C++ side at least, it will require integrating a dedicated library (probably in other languages as well). Regards Antoine. Le 21/02/2020 à 00:33, Neal Richardson a écrit : > Hi all, > To help us reach 1.0 with as complete and

Integration testing

2020-02-20 Thread Neal Richardson
Hi all, To help us reach 1.0 with as complete and thoroughly tested implementations of the Arrow format, I've surveyed our integration test suite and open issues and collected information here: https://docs.google.com/spreadsheets/d/1Yu68rn2XMBpAArUfCOP9LC7uHb06CQrtqKE5vQ4bQx4/edit#gid=782909347

[jira] [Created] (ARROW-6109) [Integration] Docker image for integration testing can't be built on windows

2019-08-01 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-6109: -- Summary: [Integration] Docker image for integration testing can't be built on windows Key: ARROW-6109 URL: https://issues.apache.org/jira/browse/ARROW-6109 Project

[jira] [Created] (ARROW-5405) [Documentation] Move integration testing documentation to Sphinx docs, add instructions for JavaScript

2019-05-23 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-5405: --- Summary: [Documentation] Move integration testing documentation to Sphinx docs, add instructions for JavaScript Key: ARROW-5405 URL: https://issues.apache.org/jira/browse/ARROW

[jira] [Created] (ARROW-5312) [C++] Move JSON integration testing utilities to arrow/testing and libarrow_testing.so

2019-05-13 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-5312: --- Summary: [C++] Move JSON integration testing utilities to arrow/testing and libarrow_testing.so Key: ARROW-5312 URL: https://issues.apache.org/jira/browse/ARROW-5312

[jira] [Created] (ARROW-5143) [Flight] Enable integration testing of batches with dictionaries

2019-04-08 Thread David Li (JIRA)
David Li created ARROW-5143: --- Summary: [Flight] Enable integration testing of batches with dictionaries Key: ARROW-5143 URL: https://issues.apache.org/jira/browse/ARROW-5143 Project: Apache Arrow

[jira] [Created] (ARROW-4575) Add Python Flight implementation to integration testing

2019-02-14 Thread David Li (JIRA)
David Li created ARROW-4575: --- Summary: Add Python Flight implementation to integration testing Key: ARROW-4575 URL: https://issues.apache.org/jira/browse/ARROW-4575 Project: Apache Arrow Issue

Re: Rust IPC and Integration Testing

2018-11-20 Thread Chao Sun
t > > > > >> (I'm > > > > >> > >> sure this is going to take quite a while though so don't want > > to > > > get > > > > >> > >> anyones hopes up too much). For anyon

Re: Rust IPC and Integration Testing

2018-11-20 Thread Krisztián Szűcs
Andy. > > > >> > >> > > > >> > >> > > > >> > >> On Sat, May 19, 2018 at 4:05 PM Wes McKinney < > > wesmck...@gmail.com> > > > >> wrote: > > > >> > >> > > > >&

Re: Rust IPC and Integration Testing

2018-11-20 Thread Chao Sun
wesmck...@gmail.com> > > >> wrote: > > >> > >> > > >> > >>> Sorry to hear, it's a bit of a rough situation with Flatbuffers > and > > >> > >>> Rust. One possibility is to build an interface to the > Flatbuf

Re: Rust IPC and Integration Testing

2018-11-19 Thread Wes McKinney
re header-only like C++ and if that makes things any > >> easier > >> > >>> for you. > >> > >>> > >> > >>> If you defined an API in Rust for reading and writing the Arrow > >> > >>> metadata that does not expos

Re: Rust IPC and Integration Testing

2018-11-19 Thread Andy Grove
>> > >>> for you. >> > >>> >> > >>> If you defined an API in Rust for reading and writing the Arrow >> > >>> metadata that does not expose any Flatbuffers-specific details, then >> > >>> once there is a produc

Re: Rust IPC and Integration Testing

2018-11-17 Thread Andy Grove
mentation details could be swapped out without disruption. > > >>> > > >>> > my recent attempts at contacting the author have been unsuccessful > > >>> > > >>> Have you e-mailed the author directly or only pings on GitHub? Pings > &

Re: Rust IPC and Integration Testing

2018-11-04 Thread Wes McKinney
>>> Have you e-mailed the author directly or only pings on GitHub? Pings > >>> may not be making it to their inbox. > >>> > >>> Appreciate your efforts on this; I think we'll see a lot more work in > >>> data processing in Rust in the coming yea

Re: Rust IPC and Integration Testing

2018-11-03 Thread Andy Grove
; I think we'll see a lot more work in >>> data processing in Rust in the coming years. >>> >>> - Wes >>> >>> On Fri, May 18, 2018 at 9:21 AM, Andy Grove >>> wrote: >>> > Hi, >>> > >>> > Now that the refactor

[jira] [Created] (ARROW-3690) [Rust] add Rust to integration testing

2018-11-01 Thread Chao Sun (JIRA)
Chao Sun created ARROW-3690: --- Summary: [Rust] add Rust to integration testing Key: ARROW-3690 URL: https://issues.apache.org/jira/browse/ARROW-3690 Project: Apache Arrow Issue Type: Test

Re: Rust IPC and Integration Testing

2018-09-03 Thread Andy Grove
nk we'll see a lot more work in >> data processing in Rust in the coming years. >> >> - Wes >> >> On Fri, May 18, 2018 at 9:21 AM, Andy Grove >> wrote: >> > Hi, >> > >> > Now that the refactor I've been working on has been merged, the

Re: Rust IPC and Integration Testing

2018-06-19 Thread Andy Grove
M, Andy Grove wrote: > > Hi, > > > > Now that the refactor I've been working on has been merged, the next > > priority for me personally with the Rust implementation is getting IPC > and > > integration testing working. > > > > Unfortunately the of

Re: Rust IPC and Integration Testing

2018-05-19 Thread Wes McKinney
ndy Grove <andygrov...@gmail.com> wrote: > Hi, > > Now that the refactor I've been working on has been merged, the next > priority for me personally with the Rust implementation is getting IPC and > integration testing working. > > Unfortunately the official Flatbuffers Rus

Rust IPC and Integration Testing

2018-05-18 Thread Andy Grove
Hi, Now that the refactor I've been working on has been merged, the next priority for me personally with the Rust implementation is getting IPC and integration testing working. Unfortunately the official Flatbuffers Rust version is not available yet and my recent attempts at contacting

[jira] [Created] (ARROW-1502) [JS] Define code entry point for integration testing

2017-09-08 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-1502: --- Summary: [JS] Define code entry point for integration testing Key: ARROW-1502 URL: https://issues.apache.org/jira/browse/ARROW-1502 Project: Apache Arrow

[jira] [Created] (ARROW-941) [Docs] Improve "cold start" integration testing instructions

2017-05-02 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-941: -- Summary: [Docs] Improve "cold start" integration testing instructions Key: ARROW-941 URL: https://issues.apache.org/jira/browse/ARROW-941 Project: Ap

[jira] [Created] (ARROW-921) Add scripts to facilitate integration testing between revisions of the codebase

2017-04-30 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-921: -- Summary: Add scripts to facilitate integration testing between revisions of the codebase Key: ARROW-921 URL: https://issues.apache.org/jira/browse/ARROW-921 Project

[jira] [Created] (ARROW-620) [C++] Add date/time support to JSON reader/writer for integration testing

2017-03-12 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-620: -- Summary: [C++] Add date/time support to JSON reader/writer for integration testing Key: ARROW-620 URL: https://issues.apache.org/jira/browse/ARROW-620 Project: Apache

[jira] [Closed] (ARROW-310) [Java] Create CLI tool to read an Arrow file and write it out (for integration testing)

2017-01-26 Thread Wes McKinney (JIRA)
CLI tool to read an Arrow file and write it out (for > integration testing) > --- > > Key: ARROW-310 > URL: https://issues.apache.org/jira/browse/ARROW-310 >

[jira] [Resolved] (ARROW-506) Implement Arrow Echo server for integration testing

2017-01-23 Thread Wes McKinney (JIRA)
] > Implement Arrow Echo server for integration testing > --- > > Key: ARROW-506 > URL: https://issues.apache.org/jira/browse/ARROW-506 > Project: Apache Arrow > Issue Type: Task

[jira] [Created] (ARROW-506) Implement Arrow Echo server for integration testing

2017-01-21 Thread Nong Li (JIRA)
Nong Li created ARROW-506: - Summary: Implement Arrow Echo server for integration testing Key: ARROW-506 URL: https://issues.apache.org/jira/browse/ARROW-506 Project: Apache Arrow Issue Type: Task

[jira] [Created] (ARROW-310) [Java] Create CLI tool to read an Arrow file and write it out (for integration testing)

2016-09-29 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-310: -- Summary: [Java] Create CLI tool to read an Arrow file and write it out (for integration testing) Key: ARROW-310 URL: https://issues.apache.org/jira/browse/ARROW-310