I used Arrow for this purpose in the past. I don't have much to add
but just a few thoughts off the top of my head...
* The line between data and metadata can be blurry - For most
measurements we were able to store the "expected distribution" as
metadata (e.g. this measurement should have an expe
Hi Michael,
The answer to your question about metadata will likely be
application-specific.
For small amounts of metadata (i.e. communicating a bounding box of
included geometry), there isn't much room for optimization, so a string
could be fine.
For larger amounts of metadata (or other constrai
Hey Neal,
Thanks for the response and I am glad I am using this correctly. I have never
really used email servers so hopefully this works.
That’s exactly what I was thinking of doing is to create a standard metadata
schema to built on top of Apache Arrow with some predefined user types.
I gues
The Arrow IPC specification allows for custom metadata in both the Schema
and the individual Fields:
https://arrow.apache.org/docs/format/Columnar.html#schema-message
Might that work for you? Another alternative would be to track your
metadata in a separate object outside of the Arrow data.
Neal
Hi Fernando,
The website source is at https://github.com/apache/arrow-site. Have a look,
and you can make a pull request there.
Neal
On Fri, Feb 26, 2021 at 1:32 AM Fernando Herrera <
fernando.j.herr...@gmail.com> wrote:
> Hi Apache Arrow website devs,
>
> Is there somebody that could help me to
Hi Emilio,
Thanks for your feedback. It is working!
It has been a long time since that PR was rebased last time, so all pom.xml
files have their parent versions set to 3.0.0-SNAPSHOT.
Best,
Liya Fan
On Fri, Feb 26, 2021 at 8:41 PM Emilio Lahr-Vivaz
wrote:
> Hello,
>
> I think the issue is that
Hello Everyone,
Some background. My name is Michael and I work at FactSet, which if you use
Arrow you may have heard because one of our architects did a talk on using
Arrow and Dremio.
https://hello.dremio.com/eliminate-data-transfer-bottlenecks-with-apache-arrow-flight.html?utm_medium=social-fr
Hello,
I think the issue is that current master is version 4.0.0-SNAPSHOT now,
but your PR is 3.0.0-SNAPSHOT:
https://github.com/apache/arrow/blob/master/java/format/pom.xml#L18
Thanks,
Emilio
On 2/26/21 4:58 AM, Fan Liya wrote:
Dear all,
In a recent PR [1], I have created a new sub-modul
Arrow Build Report for Job nightly-2021-02-26-0
All tasks:
https://github.com/ursacomputing/crossbow/branches/all?query=nightly-2021-02-26-0
Failed Tasks:
- test-build-vcpkg-win:
URL:
https://github.com/ursacomputing/crossbow/branches/all?query=nightly-2021-02-26-0-github-test-build-vcpkg-w
Dear all,
In a recent PR [1], I have created a new sub-module of the Java project
(arrow-compression). It works on my local machine, and the build finished
successfully.
However, it fails in the docker build [2], pointing to an error in the new
pom.xml [3] file:
*Non-resolvable parent POM for
or
Hi Apache Arrow website devs,
Is there somebody that could help me to set up two pages that we are
working on for Rust?
Both are markdown books, one is a list of RFCs for the project and the
other is a guide for Arrow in Rust.
I dont know what would be the process to set up space in your server t
Hi Dominic,
I would be interested in a demo. Im curious to see your implementation and
what advantages you have seen over javascript
thanks
Fernando
On Thu, Feb 25, 2021 at 10:39 PM Dominik Moritz wrote:
> Hello Rust Arrow Devs,
>
> I have been working on a wasm version of Arrow using the Rust
12 matches
Mail list logo
