Re: Depending on non-released Apache projects (C++ Avro)

2019-03-12 Thread Micah Kornfield
Thanks. This work has been pushed off a bit because I need to get existing PRs into better shape. Hopefully 1.9 is released when I pick it up (otherwise I would lean towards forking for the time being as well). On Tue, Mar 12, 2019 at 3:01 AM Uwe L. Korn wrote: > Hello Micah, > > > Uwe, I'm no

Re: Depending on non-released Apache projects (C++ Avro)

2019-03-12 Thread Uwe L. Korn
Hello Micah, > Uwe, I'm not sure I understand what type of support/help you are thinking > of. Could you elaborate a little bit more before I reach out? I would help them with the same build system improvement we have done in the recent time (and are currently) doing in Arrow for C++. Nothing

Re: Depending on non-released Apache projects (C++ Avro)

2019-03-06 Thread Micah Kornfield
Thanks for the input Wes and Uwe, given no one from the Avro community has chimed in, I will try to reach out on there dev mailing list. Uwe, I'm not sure I understand what type of support/help you are thinking of. Could you elaborate a little bit more before I reach out? -Micah On Tue, Mar 5,

Re: Depending on non-released Apache projects (C++ Avro)

2019-03-05 Thread Wes McKinney
I am OK with that, but if we find ourselves making compromises that affect performance or memory efficiency (where possibly invasive refactoring may be required) perhaps we should reconsider option #3. On Tue, Mar 5, 2019 at 11:29 AM Uwe L. Korn wrote: > > I'm leaning a bit towards 1) but I would

Re: Depending on non-released Apache projects (C++ Avro)

2019-03-05 Thread Uwe L. Korn
I'm leaning a bit towards 1) but I would love to get some input from the Avro community as 1) depends also on their side as we will submit some patches upstream that need to be reviewed and someday also released. Are AVRO committers subscribed here or should we reach out to them on their ML? Gi

Re: Depending on non-released Apache projects (C++ Avro)

2019-03-05 Thread Wes McKinney
I'd be +0.5 in favor of forking in this particular case. Since Avro is not vectorized (unlike Parquet and ORC) I suspect it may be more difficult to get the best performance using a general purpose API versus one that is more specialized to producing Arrow record batches. Given that has been relati

Depending on non-released Apache projects (C++ Avro)

2019-03-04 Thread Micah Kornfield
I'm looking at incorporating Avro in Arrow C++ [1]. It seems that the Avro C++ library APIs have improved from the last release. However, it is not clear when a new release will be available (I asked on the JIRA Item for the next release [2] and received no response). I was wondering if there