RE: ADBC -> Arrow references for C#

2023-05-23 Thread Eric Erhardt
How do the other languages in apache/arrow-adbc consume bits from apache/arrow before they are officially released in a major version? For example, I see Java uses the 11.0.0 version (https://github.com/apache/arrow-adbc/blob/main/java/pom.xml#L31). What would happen if it is dependent on a

Empty RecordBatch in Java Flight client

2020-12-16 Thread Eric Erhardt
.NET gRPC code, not just Arrow Flight. Does anyone have any thoughts/opinions on whether this should be fixed in the Java code or the .NET code? Which way aligns with the spec? Thanks Eric Erhardt

RE: [EXTERNAL] Re: Value of Date64 type over Date32

2020-08-11 Thread Eric Erhardt
languages handle this? Eric -Original Message- From: Wes McKinney Sent: Tuesday, August 11, 2020 12:18 PM To: dev Subject: [EXTERNAL] Re: Value of Date64 type over Date32 On Mon, Aug 10, 2020 at 6:19 PM Eric Erhardt wrote: > > I don't understand what the value of the Date64 ty

Value of Date64 type over Date32

2020-08-10 Thread Eric Erhardt
I don't understand what the value of the Date64 type is over using Date32: >From https://github.com/apache/arrow/blob/master/format/Schema.fbs#L193-L206 enum DateUnit: short { DAY, MILLISECOND } /// Date is either a 32-bit or 64-bit type representing elapsed time since UNIX /// epoch

RE: [EXTERNAL] Re: .NET support for Arrow

2020-07-10 Thread Eric Erhardt
I agree with Adam, the more usage and feedback we can get the better on the .NET Library. > However there is no library for C# listed anywhere else in the > documentation. We have some XML style doc comments in the code. It would be great if we could generate a website/markdown from those XML

[jira] [Created] (ARROW-9048) [C#] Support Float16

2020-06-06 Thread Eric Erhardt (Jira)
Eric Erhardt created ARROW-9048: --- Summary: [C#] Support Float16 Key: ARROW-9048 URL: https://issues.apache.org/jira/browse/ARROW-9048 Project: Apache Arrow Issue Type: Bug Components

[jira] [Created] (ARROW-8953) [C#] Update to .NET SDK 3.1

2020-05-26 Thread Eric Erhardt (Jira)
Eric Erhardt created ARROW-8953: --- Summary: [C#] Update to .NET SDK 3.1 Key: ARROW-8953 URL: https://issues.apache.org/jira/browse/ARROW-8953 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-8882) [C#] Add .editorconfig to C# code

2020-05-21 Thread Eric Erhardt (Jira)
Eric Erhardt created ARROW-8882: --- Summary: [C#] Add .editorconfig to C# code Key: ARROW-8882 URL: https://issues.apache.org/jira/browse/ARROW-8882 Project: Apache Arrow Issue Type: Bug

RE: C# - Appetite for breaking changes to public API?

2020-04-27 Thread Eric Erhardt
' thoughts as well. Eric Erhardt -Original Message- From: Adam Szmigin Sent: Monday, April 27, 2020 7:10 AM To: dev@arrow.apache.org Subject: [EXTERNAL] C# - Appetite for breaking changes to public API? Dear team, I am keen to work on a number of the tickets relating to the C# impl

[jira] [Created] (ARROW-7516) [C#] .NET Benchmarks are broken

2020-01-08 Thread Eric Erhardt (Jira)
Eric Erhardt created ARROW-7516: --- Summary: [C#] .NET Benchmarks are broken Key: ARROW-7516 URL: https://issues.apache.org/jira/browse/ARROW-7516 Project: Apache Arrow Issue Type: Bug

RE: [ANNOUNCE] New Arrow committer: Eric Erhardt

2019-10-21 Thread Eric Erhardt
Thanks, everyone! I'm looking forward to continue working with you all on this great project. Eric -Original Message- From: Krisztián Szűcs Sent: Friday, October 18, 2019 11:55 AM To: dev Subject: Re: [ANNOUNCE] New Arrow committer: Eric Erhardt Congrats! On Fri, Oct 18, 2019 at 12

[jira] [Created] (ARROW-6795) [C#] Reading large Arrow files in C# results in an exception

2019-10-04 Thread Eric Erhardt (Jira)
Eric Erhardt created ARROW-6795: --- Summary: [C#] Reading large Arrow files in C# results in an exception Key: ARROW-6795 URL: https://issues.apache.org/jira/browse/ARROW-6795 Project: Apache Arrow

[jira] [Created] (ARROW-6728) [C#] Support reading and writing Date32 and Date64 arrays

2019-09-27 Thread Eric Erhardt (Jira)
Eric Erhardt created ARROW-6728: --- Summary: [C#] Support reading and writing Date32 and Date64 arrays Key: ARROW-6728 URL: https://issues.apache.org/jira/browse/ARROW-6728 Project: Apache Arrow

[jira] [Created] (ARROW-6643) [C#] Write no IPC buffer metadata for NullType

2019-09-20 Thread Eric Erhardt (Jira)
Eric Erhardt created ARROW-6643: --- Summary: [C#] Write no IPC buffer metadata for NullType Key: ARROW-6643 URL: https://issues.apache.org/jira/browse/ARROW-6643 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-6603) [C#] ArrayBuilder API to support writing nulls

2019-09-18 Thread Eric Erhardt (Jira)
Eric Erhardt created ARROW-6603: --- Summary: [C#] ArrayBuilder API to support writing nulls Key: ARROW-6603 URL: https://issues.apache.org/jira/browse/ARROW-6603 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-6553) [C#] Decide how to read message lengths - little-endian or machine dependent

2019-09-12 Thread Eric Erhardt (Jira)
Eric Erhardt created ARROW-6553: --- Summary: [C#] Decide how to read message lengths - little-endian or machine dependent Key: ARROW-6553 URL: https://issues.apache.org/jira/browse/ARROW-6553 Project

RE: Timeline for 0.15.0 release

2019-09-11 Thread Eric Erhardt
I assume the plan is to merge the ARROW-6313-flatbuffer-alignment branch into master before the 0.15 release, correct? BTW - I believe the C# alignment changes are ready to be merged into the alignment branch - https://github.com/apache/arrow/pull/5280/ Eric -Original Message- From:

RE: Plasma scenarios

2019-09-09 Thread Eric Erhardt
ew months. Thanks, -- kou In "Re: Plasma scenarios" on Mon, 9 Sep 2019 12:00:00 -0500, Wes McKinney wrote: > hi Eric, > > On Fri, Sep 6, 2019 at 5:09 PM Eric Erhardt > wrote: >> >> I was looking for the high level scenarios for the Plasma In-Memory Object &g

Plasma scenarios

2019-09-06 Thread Eric Erhardt
I was looking for the high level scenarios for the Plasma In-Memory Object Store. A colleague of mine suggested we could use it to pass data between a C# process and a Python process. I've read the intro blog [0] on Plasma, which describes using the same data set from multiple processes -

RE: [RESULT] [VOTE] Alter Arrow binary protocol to address 8-byte Flatbuffer alignment requirements (2nd vote)

2019-09-04 Thread Eric Erhardt
The C# PR is up. https://github.com/apache/arrow/pull/5280 Eric -Original Message- From: Eric Erhardt Sent: Wednesday, September 4, 2019 10:12 AM To: dev@arrow.apache.org; Ji Liu Cc: emkornfield ; Paul Taylor Subject: RE: [RESULT] [VOTE] Alter Arrow binary protocol to address 8-byte

RE: [RESULT] [VOTE] Alter Arrow binary protocol to address 8-byte Flatbuffer alignment requirements (2nd vote)

2019-09-04 Thread Eric Erhardt
I'm working on a PR for the C# bindings. I hope to have it up in the next day or two. Integration tests for C# would be a great addition at some point - it's been on my backlog. For now I plan on manually testing it. -Original Message- From: Wes McKinney Sent: Tuesday, September 3,

[jira] [Created] (ARROW-6322) [C#] Implement a plasma client

2019-08-22 Thread Eric Erhardt (Jira)
Eric Erhardt created ARROW-6322: --- Summary: [C#] Implement a plasma client Key: ARROW-6322 URL: https://issues.apache.org/jira/browse/ARROW-6322 Project: Apache Arrow Issue Type: New Feature

RE: [DISCUSS] Developing a "data frame" subproject in the Arrow C++ libraries

2019-08-12 Thread Eric Erhardt
Hey Wes, I just wanted to check-in on this work. Have there been any updates to the Arrow "data frame" project worth sharing? Thanks, Eric -Original Message- From: Wes McKinney Sent: Tuesday, May 21, 2019 8:17 AM To: dev@arrow.apache.org Subject: Re: [DISCUSS] Developing a "data

RE: [VOTE] Release Apache Arrow 0.14.1 - RC0

2019-07-18 Thread Eric Erhardt
+1 Tested: - C# source verification on Ubuntu 18 - I verified the C# source contained the fixes for the two issues I needed fixed in this patch. -Original Message- From: Krisztián Szűcs Sent: Tuesday, July 16, 2019 9:55 PM To: dev@arrow.apache.org Subject: [VOTE] Release Apache Arrow

RE: [DISCUSS] Need for 0.14.1 release due to Python package problems, Parquet forward compatibility problems

2019-07-11 Thread Eric Erhardt
ther > > > issues that need to be fixed before we go down one of these paths? > > > > > > Would anyone like to help with release management? I can do so if > > > necessary, but I've already done a lot of release management :) > > > > > > - Wes >

RE: New CI system: Ursabot

2019-07-11 Thread Eric Erhardt
My apologies if this is already covered in the docs, but I couldn't find it. How do I re-run a single leg in the Ursabot tests? The 'AMD64 Debian 9 Rust 1.35' failed on my PR, and I wanted to try re-running just that leg, but the only option I found was to re-run all Ursabot legs. Eric

[jira] [Created] (ARROW-5896) [C#] Array Builders should take an initial capacity in their constructors

2019-07-09 Thread Eric Erhardt (JIRA)
Eric Erhardt created ARROW-5896: --- Summary: [C#] Array Builders should take an initial capacity in their constructors Key: ARROW-5896 URL: https://issues.apache.org/jira/browse/ARROW-5896 Project

RE: [Discuss] Compatibility Guarantees and Versioning Post "1.0.0"

2019-07-09 Thread Eric Erhardt
Just to be sure I fully understand the proposal: For the Library Version, we are going to increment the MAJOR version on every normal release, and increment the MINOR version if we need to release a patch/bug fix type of release. Since SemVer allows for API breaking changes on MAJOR versions,

RE: [DISCUSS] Need for 0.14.1 release due to Python package problems, Parquet forward compatibility problems

2019-07-09 Thread Eric Erhardt
Can we propose getting changes other than Python or Parquet related into this release? For example, I found a critical issue in the C# implementation that, if possible, I'd like to get included in a patch release. https://github.com/apache/arrow/pull/4836 Eric -Original Message-

[jira] [Created] (ARROW-5887) [C#] ArrowStreamWriter writes FieldNodes in wrong order

2019-07-09 Thread Eric Erhardt (JIRA)
Eric Erhardt created ARROW-5887: --- Summary: [C#] ArrowStreamWriter writes FieldNodes in wrong order Key: ARROW-5887 URL: https://issues.apache.org/jira/browse/ARROW-5887 Project: Apache Arrow

RE: [DISCUSS] Ongoing Travis CI service degradation

2019-07-02 Thread Eric Erhardt
Has anyone considered using Azure DevOps for CI and patch validation? https://azure.microsoft.com/en-us/services/devops/pipelines/ > Get cloud-hosted pipelines for Linux, macOS, and Windows with unlimited > minutes and 10 free parallel jobs for open source I guess I am not familiar with ASF

[jira] [Created] (ARROW-5708) [C#] Null support for BooleanArray

2019-06-24 Thread Eric Erhardt (JIRA)
Eric Erhardt created ARROW-5708: --- Summary: [C#] Null support for BooleanArray Key: ARROW-5708 URL: https://issues.apache.org/jira/browse/ARROW-5708 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-5546) [C#] Remove IArrowArray and use Array base class.

2019-06-10 Thread Eric Erhardt (JIRA)
Eric Erhardt created ARROW-5546: --- Summary: [C#] Remove IArrowArray and use Array base class. Key: ARROW-5546 URL: https://issues.apache.org/jira/browse/ARROW-5546 Project: Apache Arrow Issue

Timeline for 0.14 release?

2019-05-30 Thread Eric Erhardt
Do we have an idea on a 0.14 release timeframe? Historically, it seems there has been a release every 2-3 months. Do we think the next release would be about that long after 0.13 was released? Note: I'm not pushing for a release any time soon - I am just curious when it would roughly be. I

[jira] [Created] (ARROW-5278) [C#] ArrowBuffer should either implement IEquatable correctly or not at all

2019-05-07 Thread Eric Erhardt (JIRA)
Eric Erhardt created ARROW-5278: --- Summary: [C#] ArrowBuffer should either implement IEquatable correctly or not at all Key: ARROW-5278 URL: https://issues.apache.org/jira/browse/ARROW-5278 Project

[jira] [Created] (ARROW-5277) [C#] MemoryAllocator.Allocate(length: 0) should not return null

2019-05-07 Thread Eric Erhardt (JIRA)
Eric Erhardt created ARROW-5277: --- Summary: [C#] MemoryAllocator.Allocate(length: 0) should not return null Key: ARROW-5277 URL: https://issues.apache.org/jira/browse/ARROW-5277 Project: Apache Arrow

[jira] [Created] (ARROW-5276) [C#] NativeMemoryAllocator expose an option for clearing allocated memory

2019-05-07 Thread Eric Erhardt (JIRA)
Eric Erhardt created ARROW-5276: --- Summary: [C#] NativeMemoryAllocator expose an option for clearing allocated memory Key: ARROW-5276 URL: https://issues.apache.org/jira/browse/ARROW-5276 Project

[jira] [Created] (ARROW-5092) [C#] Source Link doesn't work with the C# release script

2019-04-02 Thread Eric Erhardt (JIRA)
Eric Erhardt created ARROW-5092: --- Summary: [C#] Source Link doesn't work with the C# release script Key: ARROW-5092 URL: https://issues.apache.org/jira/browse/ARROW-5092 Project: Apache Arrow

[jira] [Created] (ARROW-5035) [C#] ArrowBuffer.Builder is broken

2019-03-27 Thread Eric Erhardt (JIRA)
Eric Erhardt created ARROW-5035: --- Summary: [C#] ArrowBuffer.Builder is broken Key: ARROW-5035 URL: https://issues.apache.org/jira/browse/ARROW-5035 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-5034) [C#] ArrowStreamWriter should expose synchronous Write methods

2019-03-27 Thread Eric Erhardt (JIRA)
Eric Erhardt created ARROW-5034: --- Summary: [C#] ArrowStreamWriter should expose synchronous Write methods Key: ARROW-5034 URL: https://issues.apache.org/jira/browse/ARROW-5034 Project: Apache Arrow

[jira] [Created] (ARROW-5019) [C#] ArrowStreamWriter doesn't work on a non-seekable stream

2019-03-26 Thread Eric Erhardt (JIRA)
Eric Erhardt created ARROW-5019: --- Summary: [C#] ArrowStreamWriter doesn't work on a non-seekable stream Key: ARROW-5019 URL: https://issues.apache.org/jira/browse/ARROW-5019 Project: Apache Arrow

[jira] [Created] (ARROW-4997) [C#] ArrowStreamReader doesn't consume whole stream and doesn't implement sync read

2019-03-22 Thread Eric Erhardt (JIRA)
Eric Erhardt created ARROW-4997: --- Summary: [C#] ArrowStreamReader doesn't consume whole stream and doesn't implement sync read Key: ARROW-4997 URL: https://issues.apache.org/jira/browse/ARROW-4997

MemoryPool in Arrow libraries

2019-03-18 Thread Eric Erhardt
ispose() in the .NET nomenclature) types that hold memory? Ex. RecordBatch, ArrowArray, etc. I assume these mechanisms are super useful to the other implementations, so I'm trying to keep the C# library designed roughly the same. But I'd appreciate some advice. Eric Erhardt

RE: Publishing C# NuGet package

2019-03-14 Thread Eric Erhardt
blishing C# NuGet package thanks Eric -- that sounds great. I think we're going to want to cut the 0.13 release candidate around 2 weeks from now, so that gives some time to get the packaging things sorted out - Wes On Thu, Mar 7, 2019 at 4:46 PM Eric Erhardt wrote: > > > Some changes

[jira] [Created] (ARROW-4839) [C#] Add NuGet support

2019-03-12 Thread Eric Erhardt (JIRA)
Eric Erhardt created ARROW-4839: --- Summary: [C#] Add NuGet support Key: ARROW-4839 URL: https://issues.apache.org/jira/browse/ARROW-4839 Project: Apache Arrow Issue Type: Improvement

RE: Timeline for 0.13 Arrow release

2019-03-12 Thread Eric Erhardt
> Having C# NuGet package working would be nice I've opened https://issues.apache.org/jira/browse/ARROW-4839 for this and I will be working on it this week. I'd like to see an official Arrow NuGet package on www.nuget.org soon, so getting it in this release would work out perfect from my side.

RE: Publishing C# NuGet package

2019-03-07 Thread Eric Erhardt
> Some changes may need to be made to the release scripts to update C# metadata > files. The intent it to make it so that the code artifact can be pushed to a > package manager using the official ASF release artifact. If we don't get it > 100% right for 0.13 then > at least we can get a

Publishing C# NuGet package

2019-03-07 Thread Eric Erhardt
When would it be possible to publish the C# Arrow library to https://www.nuget.org/? Is this something we can do as part of the 0.13.0 release? For anyone who is unfamiliar with NuGet - it is the .NET package manager and is the typical way to "ship" a .NET library. Eric

[jira] [Created] (ARROW-4737) [C#] tests are not running in CI

2019-03-01 Thread Eric Erhardt (JIRA)
Eric Erhardt created ARROW-4737: --- Summary: [C#] tests are not running in CI Key: ARROW-4737 URL: https://issues.apache.org/jira/browse/ARROW-4737 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-4717) [C#] Consider exposing ValueTask instead of Task

2019-02-28 Thread Eric Erhardt (JIRA)
Eric Erhardt created ARROW-4717: --- Summary: [C#] Consider exposing ValueTask instead of Task Key: ARROW-4717 URL: https://issues.apache.org/jira/browse/ARROW-4717 Project: Apache Arrow Issue

[jira] [Created] (ARROW-4571) [Format] Tensor.fbs file has multiple root_type declarations

2019-02-14 Thread Eric Erhardt (JIRA)
Eric Erhardt created ARROW-4571: --- Summary: [Format] Tensor.fbs file has multiple root_type declarations Key: ARROW-4571 URL: https://issues.apache.org/jira/browse/ARROW-4571 Project: Apache Arrow

[jira] [Created] (ARROW-4543) [C#] Update Flat Buffers code to latest version

2019-02-12 Thread Eric Erhardt (JIRA)
Eric Erhardt created ARROW-4543: --- Summary: [C#] Update Flat Buffers code to latest version Key: ARROW-4543 URL: https://issues.apache.org/jira/browse/ARROW-4543 Project: Apache Arrow Issue

[jira] [Created] (ARROW-4503) [C#] ArrowStreamReader allocates and copies data excessively

2019-02-07 Thread Eric Erhardt (JIRA)
Eric Erhardt created ARROW-4503: --- Summary: [C#] ArrowStreamReader allocates and copies data excessively Key: ARROW-4503 URL: https://issues.apache.org/jira/browse/ARROW-4503 Project: Apache Arrow

[jira] [Created] (ARROW-4502) [C#] Add support for zero-copy reads

2019-02-07 Thread Eric Erhardt (JIRA)
Eric Erhardt created ARROW-4502: --- Summary: [C#] Add support for zero-copy reads Key: ARROW-4502 URL: https://issues.apache.org/jira/browse/ARROW-4502 Project: Apache Arrow Issue Type