RE: Some questions/proposals for the spec (Layout.md)

I'm from Intel but not any hardware folks, just would provide my thoughts. Yes the width and alignment requirement can be very different according to what version of SIMD is used. And also, sometimes it's hard to keep the alignment to access specific fields or parts in the even aligned memory

RE: Does arrow/cpp setup google flatbuffers lib by itself?

several libraries in $TP_DIR): TP_DIR=$HOME/local export FLATBUFFERS_HOME=$TP_DIR I recommend setting up an environment configuration script that works for your preferred development setup. Thanks On Sun, Mar 27, 2016 at 10:57 PM, Zheng, Kai <kai.zh...@intel.com> wrote: > I d

RE: Does arrow/cpp setup google flatbuffers lib by itself?

s.h` On Sun, Mar 27, 2016 at 6:55 PM, Zheng, Kai <kai.zh...@intel.com> wrote: > Thanks Micah. Got noted. OK right now I will work around my setup and if any > further interesting finding I will post here for your reference. > > Regards, > Kai > > -Original Messag

RE: Does arrow/cpp setup google flatbuffers lib by itself?

On Sun, Mar 27, 2016 at 6:12 PM, Zheng, Kai <kai.zh...@intel.com> wrote: > Hi Wes, > > Yes I did `sh setup_build_env.sh`. Everything else works fine, except > the flatbuffers lib. > If it assumes equipping the lib by itself, I can look into the issue > an

RE: Does arrow/cpp setup google flatbuffers lib by itself?

yourself (see the setup_build_env.sh and also the Travis CI scripts for a complete accounting). Thanks Wes On Sun, Mar 27, 2016 at 5:25 PM, Zheng, Kai <kai.zh...@intel.com> wrote: > Hi, > > Does Arrow/cpp assumes the building set up all its dependencies including > google flatbuffer

RE: Shared memory "IPC" of Arrow row batches in C++

on, Mar 21, 2016 at 8:40 AM, Zheng, Kai <kai.zh...@intel.com> wrote: > Thanks Wes. This sounds a good starting on the IPC direction. > >>> It's be great to get some benchmark code written so that we are also able >>> to make technical decisions on the basis of

How Arrow is related to Parquet

Hi, By quick looking at the codes, it looks like Arrow is depending on Parquet, however Parquet looks kinds of heavy for Arrow. Not sure what's the exact part in Parquet Arrow is using. Not sure if the vice versa is better or not, say in Parquet project, have a new reader that reads parquet

RE: How to use Arrow?

Yes, Micah is right. There was a similar question before, "Getting started guide" and see the thread: http://mail-archives.apache.org/mod_mbox/arrow-dev/201602.mbox/%3CCAK2z7j7zOpz8Sw7dmH=ajBjwvHre4EoRW4=ja2wme2g5kpq...@mail.gmail.com%3E Hope there may be some useful information for you.

RE: Understanding "shared" memory implications

e specific comments there might be valuable on the Parquet mailing list.) - Wes On Thu, Mar 17, 2016 at 3:44 PM, Zheng, Kai <kai.zh...@intel.com> wrote: > Sounds good to have all these compatible, modular goals and changes, for > Apache Arrow, in the early stage. > > On the

RE: Understanding "shared" memory implications

Sounds good to have all these compatible, modular goals and changes, for Apache Arrow, in the early stage. On the other hand, not being afraid of changes keep evolving towards the core goals and the well-defined initiatives, which is also important. Parquet is relevant and also a good example.