[jira] [Created] (ARROW-2840) [C++] See if stream alignment logic can be simplified

Wes McKinney created ARROW-2840: --- Summary: [C++] See if stream alignment logic can be simplified Key: ARROW-2840 URL: https://issues.apache.org/jira/browse/ARROW-2840 Project: Apache Arrow

[jira] [Created] (ARROW-2839) [JS] Support whatwg/streams in IPC reader/writer

Paul Taylor created ARROW-2839: -- Summary: [JS] Support whatwg/streams in IPC reader/writer Key: ARROW-2839 URL: https://issues.apache.org/jira/browse/ARROW-2839 Project: Apache Arrow Issue

Re: [Go] Go failures on Travis-CI

I opened https://issues.apache.org/jira/browse/ARROW-2841. Thanks! On Thu, Jul 12, 2018 at 2:36 PM, Sebastien Binet wrote: > I'll have a look tomorrow (Paris time). > It looks like a GOPATH issue. > > sent from my droid > > On Thu, Jul 12, 2018, 20:52 Antoine Pitrou wrote: > >> >> Hello, >> >>

[jira] [Created] (ARROW-2841) [Go] Fix recent Go build failures in Travis CI

Wes McKinney created ARROW-2841: --- Summary: [Go] Fix recent Go build failures in Travis CI Key: ARROW-2841 URL: https://issues.apache.org/jira/browse/ARROW-2841 Project: Apache Arrow Issue

[Go] Go failures on Travis-CI

Hello, I'm getting persistent failures in the Go job on Travis-CI: https://travis-ci.org/pitrou/arrow/jobs/403221354 Is this expected? Excerpt: """ $ go get -t -v ./... github.com/apache/arrow (download) github.com/stretchr/testify (download) go/arrow/type_traits_boolean.go:20:2: use of

Re: [Go] Go failures on Travis-CI

I'll have a look tomorrow (Paris time). It looks like a GOPATH issue. sent from my droid On Thu, Jul 12, 2018, 20:52 Antoine Pitrou wrote: > > Hello, > > I'm getting persistent failures in the Go job on Travis-CI: > https://travis-ci.org/pitrou/arrow/jobs/403221354 > > Is this expected?

Re: Help understanding IPC Message/Buffer structure

Thanks Paul, all your detail is super-helpful. I became paralyzed by looking at too many codebases, but now I think I get it. Wes, you’re absolutely right that this is complicated by the lack of support. I’m working this example because it’s a good use of work time, and then hopefully success

Help understanding IPC Message/Buffer structure

I’m trying to understand how to parse a Buffer into a Schema, but using using pdb with Python and reading the TS/Python/C++ Arrow source hasn’t really cleared much up for me. Nor has studying https://arrow.apache.org/docs/ipc.html Here’s are the steps of what I’ve tried (the code is Julia, but

Re: Housing longer-term Arrow development, design, and roadmap documents

Yup I see it now, thanks! On Thu, Jul 12, 2018 at 10:37 AM, Wes McKinney wrote: > hey Bryan -- I just enabled "Add/Edit" permission for all registered > Confluence users. Let me know if it works now > > On Thu, Jul 12, 2018 at 1:34 PM, Bryan Cutler wrote: > > I haven't used confluence before,

Re: Help understanding IPC Message/Buffer structure

hi Randy, In Julia I think this is complicated by the lack of a Flatbuffers compiler for the language. In the case of Feather files, in Feather.jl they have implemented the Flatbuffers schema in Julia code: https://github.com/JuliaData/Feather.jl/blob/master/src/metadata.jl#L3 So you need to do

Re: Help understanding IPC Message/Buffer structure

Hi Randy, The first four bytes are the int32 length of the flatbuffers Message metadata plus 4 bytes of padding between the length and the Message metadata itself. The Message metadata

[jira] [Created] (ARROW-2842) [Python] Cannot read parquet files with row group size of 1 From HDFS

Robert Gruener created ARROW-2842: - Summary: [Python] Cannot read parquet files with row group size of 1 From HDFS Key: ARROW-2842 URL: https://issues.apache.org/jira/browse/ARROW-2842 Project:

[jira] [Created] (ARROW-2843) [Format/C++/Java] Removing field layout from Schema.fbs breaks backward compatibility

Yuliya Feldman created ARROW-2843: - Summary: [Format/C++/Java] Removing field layout from Schema.fbs breaks backward compatibility Key: ARROW-2843 URL: https://issues.apache.org/jira/browse/ARROW-2843

[jira] [Created] (ARROW-2835) [C++] ReadAt/WriteAt are inconsistent with moving the files position

Dimitri Vorona created ARROW-2835: - Summary: [C++] ReadAt/WriteAt are inconsistent with moving the files position Key: ARROW-2835 URL: https://issues.apache.org/jira/browse/ARROW-2835 Project: Apache

[jira] [Created] (ARROW-2836) [Packaging] Expanding build matrices to multiple tasks

Krisztian Szucs created ARROW-2836: -- Summary: [Packaging] Expanding build matrices to multiple tasks Key: ARROW-2836 URL: https://issues.apache.org/jira/browse/ARROW-2836 Project: Apache Arrow

[jira] [Created] (ARROW-2837) [C++] ArrayBuilder::null_bitmap returns PoolBuffer

Dimitri Vorona created ARROW-2837: - Summary: [C++] ArrayBuilder::null_bitmap returns PoolBuffer Key: ARROW-2837 URL: https://issues.apache.org/jira/browse/ARROW-2837 Project: Apache Arrow

Need a release manager for Arrow 0.10.0 [was Re: Packaging status update]

Can a member of the Arrow PMC volunteer to be the release manager for 0.10.0? There is some prep work to be done to make sure that you can produce the binary packages as part of the release vote; if this is done at the last minute it will probably delay the release. Thank you, Wes On Wed, Jul

[jira] [Created] (ARROW-2838) [Python] Speed up null testing with Pandas semantics

Antoine Pitrou created ARROW-2838: - Summary: [Python] Speed up null testing with Pandas semantics Key: ARROW-2838 URL: https://issues.apache.org/jira/browse/ARROW-2838 Project: Apache Arrow

Re: Housing longer-term Arrow development, design, and roadmap documents

I haven't used confluence before, but do I need permission to edit a page? I believe there should be a button in the menu bar, but I don't see anything except "Spaces" and "People." If so, could someone please add me, my user id is "cutlerb", thanks! On Fri, Jul 6, 2018 at 10:35 AM, Wes McKinney

Re: Housing longer-term Arrow development, design, and roadmap documents

hey Bryan -- I just enabled "Add/Edit" permission for all registered Confluence users. Let me know if it works now On Thu, Jul 12, 2018 at 1:34 PM, Bryan Cutler wrote: > I haven't used confluence before, but do I need permission to edit a page? > I believe there should be a button in the menu