C++ Write Schema with RecordBatchStreamWriter

Hello, I have a RecordBatch that I would like to write to a file. I'm using FileOutputStream::Open to open the file and RecordBatchStreamWriter::Open to open the stream. I write a record batch with WriteRecordBatch. Finally, I close the RecordBatchWriter and OutputStream. The resulting file size

Re: [NIGHTLY] Arrow Build Report for Job nightly-2020-06-14-0

Hi, I took a look failed tasks: * Dask and kartothek related tasks: https://github.com/apache/arrow/pull/7421 breaks these tasks. Details: https://github.com/apache/arrow/pull/7421#issuecomment-643821762 * Turbodbc related tasks: https://github.com/apache/arrow/pull/7335

[ACTION REQUIRED] Changes to Arrow JIRA-related e-mail notifications

hi folks, Per the mailing list discussion and INFRA-20419 we have just executed some changes to our JIRA e-mail notification schemes: * dev@arrow will no longer receive "JIRA created" e-mails. This should hopefully help with having more e-mail engagement from developers who may not be paying

Re: [DISCUSS] Move JIRA notifications to separate mailing list?

This has been completed. I'll send a new e-mail to dev@ providing instructions for what to do On Fri, Jun 12, 2020 at 1:46 PM Wes McKinney wrote: > > I have requested this > > https://issues.apache.org/jira/browse/INFRA-20419 > > On Thu, Jun 11, 2020 at 11:37 AM Wes McKinney wrote: > > > >

Re: C++ IPC Array length did not match record batch length (5)

It sounds like "arrowBatch" is invalid. What happens when you run ARROW_RETURN_NOT_OK(arrowBatch->Validate())? On Sun, Jun 14, 2020 at 2:09 PM Rares Vernica wrote: > > Hello, > > I'm porting a C++ program from Arrow 0.9.0 to 0.16.0. The *sender* uses > BufferOutputStream and RecordBatchWriter to

C++ IPC Array length did not match record batch length (5)

Hello, I'm porting a C++ program from Arrow 0.9.0 to 0.16.0. The *sender* uses BufferOutputStream and RecordBatchWriter to serialize a set of Arrow arrays. The *receiver* uses BufferReader and RecordBatchReader to deserialize them. I get the runtime error *Array length did not match record batch

[jira] [Created] (ARROW-9127) [Rust] Update thirft library dependencies

Andrew Lamb created ARROW-9127: -- Summary: [Rust] Update thirft library dependencies Key: ARROW-9127 URL: https://issues.apache.org/jira/browse/ARROW-9127 Project: Apache Arrow Issue Type: Bug

[NIGHTLY] Arrow Build Report for Job nightly-2020-06-14-0

Arrow Build Report for Job nightly-2020-06-14-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-06-14-0 Failed Tasks: - test-conda-python-3.7-dask-latest: URL: