Re: Arrow sync at 12pm EDT today

2018-05-16 Thread Krisztián Szűcs
Same On May 16 2018, at 6:06 pm, Uwe L. Korn wrote: > > On my side I'm waiting to someone to let me in... > On Wed, May 16, 2018, at 6:05 PM, Wes McKinney wrote: > > Google Meet says the meeting is full > > > > On Wed, May 16, 2018, 11:25 AM Alex Hagerman

[C++] Avoiding Nullptrs?

2018-06-01 Thread Krisztián Szűcs
Hi Everyone, Recently I've investigated a parquet edge case ARROW-2591 which is caused by a returned nullptr here.

[Celebrate] Arrow has reached 2000 stargeezers

2018-05-28 Thread Krisztián Szűcs
Which makes Arrow the 33rd most starred Apache repository (out of 1555, according to github). Congratulations!

Re: [RESULT][VOTE] Release Apache Arrow 0.10.0 (RC1)

2018-08-06 Thread Krisztián Szűcs
e latest version of node.js and npm > > > > > installed. > > > > > > > > > > npm ERR! If you do, this is most likely a problem with the > > > > > apache-arrow > > > > > package, > > > > > > > > > > npm ERR! not wit

Re: [VOTE] Release Apache Arrow 0.10.0 (RC1)

2018-08-03 Thread Krisztián Szűcs
+1 ran ./dev/release/verify-release-candidate.sh 0.10.0 1 (same GISCAN issue Uwe has mentioned in RC0 thread) * macOS 10.13.5 * java 10.0.2 * python 3.6.5 * clang-902.0.39.2 * node v10.6.0 On Aug 3 2018, at 5:52 pm, Uwe L. Korn wrote: > > +1 (binding) > * ran

Re: [RESULT][VOTE] Release Apache Arrow 0.10.0 (RC1)

2018-08-06 Thread Krisztián Szűcs
t; > > npm ERR! Make sure you have the latest version of node.js and npm > > > > > installed. > > > > > > > > > > npm ERR! If you do, this is most likely a problem with the > > > > > apache-arrow > > > > > package,

Re: [ANNOUNCE] New Arrow committers: Andy Grove and Krisztián Szűcs

2018-08-15 Thread Krisztián Szűcs
I feel honored! Thank You! Congrats Andy! - Krisztian On Aug 15, 2018 6:29 PM, "Wes McKinney" wrote: On behalf of the Arrow PMC, I'm happy to announce that Andy Grove and Krisztián Szűcs have been invited to be committers on the project. Welcome, and thanks for your contributions! - Wes

Re: [DISCUSS] Re-think CI strategy?

2018-08-06 Thread Krisztián Szűcs
Hi, A straightforward way would be to run non-critical CI jobs as nightlies. Nightly package builds work pretty well, see the following link https://github.com/kszucs/crossbow/branches/all?query=nightly the notification logic requires improvement though. We should also run integrations tests

Re: [RESULT][VOTE] Release Apache Arrow 0.10.0 (RC1)

2018-08-06 Thread Krisztián Szűcs
Wes, I can help You with the forge packages. I'm creating the PRs. On Aug 6 2018, at 8:52 pm, Wes McKinney wrote: > > I'm going to start kicking along the conda-forge packages. If anyone > can assist with these, it would be much appreciated. > > I will update the website and write a blog post

Re: Need a release manager for Arrow 0.10.0

2018-07-19 Thread Krisztián Szűcs
a script in > > > > https://github.com/apache/arrow/tree/master/dev/release that will > > > > fetch the artifacts, sign them, and upload to the dist system. The tag > > > > and source release artifact will have already been tagged, built, > > > >

Re: Need a release manager for Arrow 0.10.0 [was Re: Packaging status update]

2018-07-18 Thread Krisztián Szűcs
> > > > > > > > > > > We need a PMC member to step up to be the release manager for 0.10. > > > > > > Ideally they should undertake one or more dry runs of simulating the > > > > > > 0.10 release so we aren't faced wi

Re: Need a release manager for Arrow 0.10.0 [was Re: Packaging status update]

2018-07-18 Thread Krisztián Szűcs
r Arrow release managers so we can make releases roughly > every month going forward. > > - Wes > On Wed, Jul 18, 2018 at 2:51 PM, Krisztián Szűcs > wrote: > > I won't be available between 27th and 31st. > > > > On Jul 18 2018, at 7:53 pm, Phillip Cloud wrote:

Packaging status update

2018-07-11 Thread Krisztián Szűcs
Hi All! Just want to send a quick summary about the packaging. What's working: python wheel builds conda package builds (the recent conda forge changes caused some unexpected problems) linux package builds (enriched with ubuntu bionic) scheduled daily builds (triggered by travis) query build

Re: Introducing myself

2018-03-07 Thread Krisztián Szűcs
Hey Andy! In the last couple of days I was digging arrow and iron-arrow (https://link.getmailspring.com/link/local-f599f61d-1722-v1.1.4-22d9f20d@kszucs-mbp.local/0?redirect=https%3A%2F%2Fgithub.com%2Fjihoonson%2Firon-arrow=dev%40arrow.apache.org) in order to create a rust impl for arrow. My

Re: Confronting Arrow packaging problems

2018-03-24 Thread Krisztián Szűcs
Just want to mention two other build systems: Pants: https://github.com/pantsbuild/pants (https://link.getmailspring.com/link/1521936116.local-4d31e945-727a-v1.1.5-5834c...@getmailspring.com/0?redirect=https%3A%2F%2Fgithub.com%2Fpantsbuild%2Fpants=ZGV2QGFycm93LmFwYWNoZS5vcmc%3D) Meson:

Re: Rust bindings

2018-03-23 Thread Krisztián Szűcs
Hey! I've done a little research about implementing arrow in rust and I'd like to share my thoughts. Please Andy correct me if I'm wrong, still hiking rust's learning curve. My first plan was to re-implement iron-arrow and mirror the cpp api as close as possible, but realized that rust can

Re: [VOTE] Release Apache Arrow 0.11.0 (RC1)

2018-10-08 Thread Krisztián Szűcs
I'll create the conda-forge PRs. On Oct 8 2018, at 10:31 am, Wes McKinney wrote: > > Also: I will write a blog post about the 0.11 release and have that > ready later today. Any volunteers to update the Python conda and pip > packages? > On Mon, Oct 8, 2018 at 4:30 AM Wes McKinney wrote: > > >

Re: [VOTE] Accept donation of Arrow C# .NET implementation

2018-10-15 Thread Krisztián Szűcs
+1 On Mon, Oct 15, 2018 at 5:30 PM Uwe L. Korn wrote: > +1 > > On Mon, Oct 15, 2018, at 5:27 PM, Wes McKinney wrote: > > hi folks, > > > > Individuals from Feyen Zylstra LLC have developed a C# implementation > > of Apache Arrow and are proposing to donate it to the Apache project, > > as

Re: Gandiva snapshot releases

2018-10-15 Thread Krisztián Szűcs
we would be doing at-least once a day > > with the flexibility to manually trigger too. > > > > Thx. > > > > On Thu, Oct 11, 2018 at 9:41 PM Krisztián Szűcs < > szucs.kriszt...@gmail.com> > > wrote: > > > >> On Thu, Oct 11, 2018 at 1

Re: Gandiva snapshot releases

2018-10-15 Thread Krisztián Szűcs
n > (https://github.com/dremio/crossbow). > > Thx. > > On Mon, Oct 15, 2018 at 4:09 PM Krisztián Szűcs > > wrote: > > > Hi Praveen, > > > > I assume We're planning to run it on travis, so We need to pass en > > encrypted env variable: > > > >

Re: [VOTE] Accept donation of Ruby bindings to Parquet GLib

2018-10-19 Thread Krisztián Szűcs
+1 On Fri, Oct 19, 2018, 9:44 AM Antoine Pitrou wrote: > > +1 from me. Makes entire sense. > > > Le 18/10/2018 à 23:02, Uwe L. Korn a écrit : > > +1 > > > >> Am 18.10.2018 um 22:59 schrieb Wes McKinney : > >> > >> hello, > >> > >> Kouhei Sutou is proposing to donate Ruby bindings to the

Re: [VOTE] Release Apache Arrow 0.11.1 (RC0)

2018-10-21 Thread Krisztián Szűcs
I can't run the verification script right now, but I've followed the changes, and it's a (non-binding) +1 from me. On Sun, Oct 21, 2018, 11:06 PM Wes McKinney wrote: > One logistical matter -- since this is a very minor change compared > with 0.11.0, if there are the requisite votes I will

Re: Making a bugfix 0.11.1 release

2018-10-18 Thread Krisztián Szűcs
I've added the two zlib issues to 0.11.1 version: https://issues.apache.org/jira/projects/ARROW/versions/12344316 On Wed, Oct 17, 2018 at 10:51 PM Wes McKinney wrote: > Got it, thank you for clarifying. It wasn't clear whether the bug > would occur in the build environment (CentOS 5 +

Re: [VOTE] Release Apache Arrow 0.11.0 (RC1)

2018-10-05 Thread Krisztián Szűcs
On OSX mojave I c_glib linking error and the same plasma test error Uwe mentioned. With the verification script: - meson: https://gist.github.com/kszucs/d6a47425764dea9ef76d8e69f589241f - autotools: https://gist.github.com/kszucs/52291265bc0f35a2e033fb3970795d9d When I use CONDA_PREFIX as

Re: Nightly tests for Arrow

2018-10-11 Thread Krisztián Szűcs
s to plot a course to where we want > to go. Would someone like to take point on this? > > Thanks > Wes > On Tue, Oct 9, 2018 at 2:33 PM Krisztián Szűcs > wrote: > > > > On Tue, Oct 9, 2018 at 6:02 PM Antoine Pitrou > wrote: > > > > > > > &

Re: Gandiva snapshot releases

2018-10-06 Thread Krisztián Szűcs
packaging tasks are run. How would you propose handling > that? > On Fri, Oct 5, 2018 at 8:03 AM Krisztián Szűcs > wrote: > > > > Ohh, just read the thread, sorry! > > > > So crossbow is located here > https://github.com/apache/arrow/tree/master/dev/tasks > &

Re: Nightly tests for Arrow

2018-10-09 Thread Krisztián Szűcs
On Tue, Oct 9, 2018 at 6:02 PM Antoine Pitrou wrote: > > Le 09/10/2018 à 17:54, Wes McKinney a écrit : > > hi folks, > > > > After the packaging automation work for 0.10 was completed, we have > > stalled out a bit on one of the objectives of this framework, which is > > to allow contributors to

Re: [VOTE] Accept donation of C GLib bindings to Parquet C++ libraries

2018-09-25 Thread Krisztián Szűcs
+1 On Sep 25 2018, at 1:36 pm, Wes McKinney wrote: > > hello, > Kouhei Sutou is proposing to donate C GLib bindings to the Parquet C++ > libraries (which can read Arrow tables back), designed to work > together with the existing GLib bindings in Apache Arrow. This work > was originally developed

Re: [Rust] move parquet into a separate sub-crate

2018-12-30 Thread Krisztián Szűcs
Hi! I support the idea[1]! Cheers, Krisztian [1] https://github.com/apache/arrow/pull/3050#discussion_r237412529 On Thu, Dec 27, 2018 at 9:10 PM Chao Sun wrote: > Hi, > > It just occurs to me that it may be a better idea to move the parquet > module into a separate sub-crate by using cargo

[Celebrate] Arrow has reached 3000 stargeezers

2018-12-30 Thread Krisztián Szűcs
Increased by 1000 stars in the last 7 months. [image: image.png] As Wes said, the journey continues :-) Congrats!

Re: Enabling an installation path for Arrow R users

2019-01-03 Thread Krisztián Szűcs
Perhaps an R conda-forge feedstock? I'm not sure how widely conda-forge is used in the R commmunity, but it already hosts around a thousand packages[1]. [1] https://github.com/conda-forge?=r- On Wed, Jan 2, 2019 at 6:09 PM Wes McKinney wrote: > hi folks, > > With 0.12 around the corner and

Re: [VOTE] Release Apache Arrow 0.12.0 RC4

2019-01-16 Thread Krisztián Szűcs
/github.com/apache/arrow/pull/3397 > > Regards > > Antoine. > > > Le 16/01/2019 à 12:59, Krisztián Szűcs a écrit : > > Hi, > > > > I'd like to propose the 2nd voteable release candidate (RC4) of Apache > > Arrow > > version 0.12.0. This is a major release

[VOTE] Release Apache Arrow 0.12.0 RC4

2019-01-16 Thread Krisztián Szűcs
Hi, I'd like to propose the 2nd voteable release candidate (RC4) of Apache Arrow version 0.12.0. This is a major release consisting of 610 resolved JIRAs [1]. We've hit several roadblocks during the release. The most recent issues were caused by the simultaneous releases of numpy, pandas, and

Re: [RESULT] [VOTE] Release Apache Arrow 0.12.0 RC4

2019-01-20 Thread Krisztián Szűcs
(Rust) to crates.io > > > > > > > > https://crates.io/crates/arrow > > > > > > > > Chao will need to now publish the parquet crate. > > > > > > > > I will start a separate thread about adding other owners to > crates.io for &g

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

2019-01-14 Thread Krisztián Szűcs
nal compiler error: Erreur de segmentation > >>>> FOR_TABLE_BITS_(BAKE_METHOD_PARAM_) > >>>> ^~~ > >>>> Please submit a full bug report, > >>>> with preprocessed source if appropriate. > >>>> See for instructi

[ANNOUNCE] Apache Arrow 0.12.0 released

2019-01-21 Thread Krisztián Szűcs
The Apache Arrow community is pleased to announce the 0.12.0 release. It includes 614 resolved issues ([1]) since the 0.11.1 release. The release is available now from our website, [2] and [3]: https://arrow.apache.org/install/ Read about what's new in the release

Re: [Rust] Adding owners to crates.io for arrow and parquet crates

2019-01-19 Thread Krisztián Szűcs
Me too please: https://crates.io/users/kszucs Thanks, Krisztian On Sat, Jan 19, 2019 at 10:18 PM Kouhei Sutou wrote: > Could you add me? > > Here is my account: https://crates.io/users/kou > > Thanks, > -- > kou > > In > "[Rust] Adding owners to crates.io for arrow and parquet crates" on >

Re: [RESULT] [VOTE] Release Apache Arrow 0.12.0 RC4

2019-01-19 Thread Krisztián Szűcs
gt; > > > > > >> +1 (binding) > > > > >> > > > > >> I ran the followings on Debian GNU/Linux sid: > > > > >> > > > > >> * CC=gcc-7 CXX=g++-7 dev/release/verify-release-candidate.sh > source > > > > >> 0.12.0 4 > &g

Re: Reviewing PRs (was: Re: Arrow sync call)

2018-12-12 Thread Krisztián Szűcs
I like the GitHub teams approach. Do We need to ask INFRA to create them? On Wed, Dec 12, 2018, 7:28 PM Sebastien Binet On Wed, Dec 12, 2018 at 7:25 PM Antoine Pitrou wrote: > > > > > Hi, > > > > Now that we have a lot of different implementations and a growing number > > of assorted topics, it

Re: Reviewing PRs (was: Re: Arrow sync call)

2018-12-12 Thread Krisztián Szűcs
ms/arrow-xxx/members > > However, I cannot create a child team inside of the arrow-committers > team. The button "Add a team" here is grayed out: > https://github.com/orgs/apache/teams/arrow-committers/teams > > Regards > > Antoine. > > > Le 12/12/2018 à

Re: C++ documentation overhaul

2018-12-17 Thread Krisztián Szűcs
You can also build the documentations via docker-compose, see: https://github.com/apache/arrow/blob/master/docker-compose.yml#L206 You can inspect the required steps from the Dockerfile itself: https://github.com/apache/arrow/blob/master/docs/Dockerfile On Mon, Dec 17, 2018 at 10:50 AM Antoine

Re: [VOTE] Accept donation of Rust Parquet implementation

2018-12-02 Thread Krisztián Szűcs
+1 On Sat, Dec 1, 2018 at 2:46 PM Phillip Cloud wrote: > +1 from me. > > On Sat, Dec 1, 2018, 06:24 Uwe L. Korn > > +1, nice to see this joining the Apache community > > > > Uwe > > > > > Am 01.12.2018 um 10:16 schrieb Antoine Pitrou : > > > > > > > > >> Le 01/12/2018 à 00:50, Wes McKinney a

Re: Rust IPC and Integration Testing

2018-11-20 Thread Krisztián Szűcs
Auto generation sounds like a good idea, similarly like rust-bindgen does it: https://rust-lang-nursery.github.io/rust-bindgen/tutorial-3.html Of course it depends on the complexity of manual edits. We can still separate the crates later if that's desired. On Tue, Nov 20, 2018 at 6:39 PM Chao

Re: Timeline for Arrow 0.12.0 release

2019-01-07 Thread Krisztián Szűcs
w, but let's see where we > stand by Wednesday or so and decide when to cut the release > > On Mon, Jan 7, 2019 at 4:38 AM Krisztián Szűcs > wrote: > > > > Hey! > > > > On Fri, Jan 4, 2019 at 10:31 PM Wes McKinney > wrote: > > > > > hi all, >

Re: Timeline for Arrow 0.12.0 release

2019-01-07 Thread Krisztián Szűcs
Hey! On Fri, Jan 4, 2019 at 10:31 PM Wes McKinney wrote: > hi all, > > We should try to cut a release candidate for 0.12 as soon as > practical. Since we're just coming off the holidays, it would be good > to work for a few more business days to close out as many outstanding > patches as

Re: Rust bindings for Gandiva

2019-01-07 Thread Krisztián Szűcs
I'm not sure, that a binding is a good idea. Both Arrow and Parquet already have their own rust implementation, and a interfacing with cpp isn't as easy and straightforward than it is with C. Otherwise We could simply just maintain bindings for all of the cpp libraries, rather than of having a

Re: [Rust] crate versions and release process

2019-01-04 Thread Krisztián Szűcs
Agree, +1 On Thu, Jan 3, 2019 at 10:49 PM Andy Grove wrote: > +1 from me. Keeping the code in a single repo makes sense but no need to > artificially keep versions numbers consistent between the sub-crates. > > Andy. > > On Wed, Jan 2, 2019 at 10:28 PM Chao Sun wrote: > > > Hi, > > > > This is

Re: Move arrow-site.git to gitbox

2019-01-03 Thread Krisztián Szűcs
+1 On Thu, Jan 3, 2019 at 4:34 PM Wes McKinney wrote: > +1 > > On Thu, Jan 3, 2019, 9:22 AM Uwe L. Korn > > Hello, > > > > as requested per the mail from ASF infra, I would like to move the > > arrow-site git repo to gitbox. This is the repo used for the distribution > > of the rendered

[VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

2019-01-12 Thread Krisztián Szűcs
Hi, I'd like to propose the 1st release candidate (RC2) of Apache Arrow version 0.12.0. This is a major release consisting of 600 resolved JIRAs [1]. The previous RCs were not voted, because: - RC0: the source archive didn't include required files to build gandiva-glib documents, also causing

Re: [VOTE] Release Apache Arrow 0.12.0 (RC2) ARROW

2019-01-13 Thread Krisztián Szűcs
is a blocker. > > Other modules work well with ARROW_HAVE_GPU=yes. > > > There is a problem with GCC 8: > > https://issues.apache.org/jira/browse/ARROW-4242 > > I don't think that this is a blocker. > > > Thanks, > -- > kou > > In > "[VOTE]

Re: Timeline for Arrow 0.12.0 release

2019-01-09 Thread Krisztián Szűcs
gt; > > * ARROW-3578: The release manager will need to be careful to see what > > happens with RAT in the build > > * ARROW-4199: patch available > > * ARROW-854: To be merged with experimental designation on green build > > * ARROW-4197: Emscripten issues with C++. Would

Re: pyarrow data type casting problem when safe=True

2019-01-14 Thread Krisztián Szűcs
Verified, issue: https://issues.apache.org/jira/browse/ARROW-4258 On Mon, Jan 14, 2019 at 12:31 AM Wes McKinney wrote: > This seems like a bug to me; I would not expect this to fail. It's too > bad it didn't get fixed in time for 0.12 > > On Thu, Jan 10, 2019 at 4:20 PM Bryan Cutler wrote: > >

Re: Reviewing PRs (was: Re: Arrow sync call)

2018-12-19 Thread Krisztián Szűcs
We now have nightly docs build: https://github.com/kszucs/crossbow/branches/all?utf8=%E2%9C%93=docs If We decide where to upload it, We can publish nightly dev docs. On Wed, Dec 19, 2018 at 3:12 PM Wes McKinney wrote: > Indeed. I had opened an issue about this some time ago > >

Re: [RESULT] [VOTE] Release Apache Arrow 0.12.0 RC4

2019-01-27 Thread Krisztián Szűcs
ry pick > >> > >> I'm going to update the documentation manually on my laptop -- I think > >> the Dockerfile is out of date now, and we now have a CUDA dependency > >> for the Python part of the docs. > >> > >> On Sun, Jan 20, 2019 at 4:02 PM Kri

Re: C++ and Python size problems with Arrow 0.13.0

2019-04-03 Thread Krisztián Szűcs
On Wed, Apr 3, 2019 at 2:24 AM Wes McKinney wrote: > hi folks, > > I that the arrow-cpp conda packages for Windows have ballooned in size > to nearly 140 megabytes for RC4 > > > https://bintray.com/apache/arrow/python-rc/0.13.0-rc4#files/python-rc/0.13.0-rc4 > > Looking at one of these packages

Re: C++ and Python size problems with Arrow 0.13.0

2019-04-03 Thread Krisztián Szűcs
This is what the wheel contains before running auditwheel: -rwxr-xr-x 1 root root 128K Apr 3 09:02 libarrow_boost_filesystem.so -rwxr-xr-x 1 root root 128K Apr 3 09:02 libarrow_boost_filesystem.so.1.66.0 -rwxr-xr-x 1 root root 1.2M Apr 3 09:02 libarrow_boost_regex.so -rwxr-xr-x 1 root root

Re: [VOTE] Release Apache Arrow JS 0.4.1 - RC0

2019-03-20 Thread Krisztián Szűcs
+1 (binding) I usually don't like to vote on my own release, but ran `dev/release/js-verify-release-candidate.sh 0.4.1 0` with Node v11.12.0 on OSX 10.14.3 and it looks good. On Thu, Mar 21, 2019 at 12:09 AM Krisztián Szűcs wrote: > Hello all, > > I would like to propose the followin

[VOTE] Release Apache Arrow JS 0.4.1 - RC0

2019-03-20 Thread Krisztián Szűcs
Hello all, I would like to propose the following release candidate (rc0) of Apache Arrow JavaScript version 0.4.1. The source release rc0 is hosted at [1]. This release candidate is based on commit f55542eeb59dde8ff4512c707b9eca1b43b62073 Please download, verify checksums and signatures, run

Re: [DISCUSS] Cutting a JavaScript 0.4.1 bugfix release

2019-03-20 Thread Krisztián Szűcs
No worries, it's fairly straightforward. RC0 is ready, please verify. On Wed, Mar 20, 2019 at 11:35 PM Brian Hulette wrote: > Thanks Wes. > > Krisztian - Uwe cut 0.4.0 for us and said he was pretty comfortable with > the process, so you may be able to defer to him if you don't have time. > > On

Re: Timeline for 0.13 Arrow release

2019-03-26 Thread Krisztián Szűcs
> > >> the week? What are the blocking issues? > > >> > > >> Thanks > > >> Wes > > >> > > >> On Sat, Mar 16, 2019 at 9:57 PM Kouhei Sutou > wrote: > > >>> > > >>> Hi, > > >&g

Re: [VOTE] Release Apache Arrow JS 0.4.1 - RC1

2019-03-24 Thread Krisztián Szűcs
Thu, Mar 21, 2019 at 1:54 PM Krisztián Szűcs > > wrote: > > > +1 (binding) > > > > Ran `dev/release/js-verify-release-candidate.sh 0.4.1 1` > > with Node v11.12.0 on OSX 10.14.3 and it looks good. > > > > On Thu, Mar 21, 2019 at 8:45 PM Krisztián Szűcs

Re: [VOTE] Release Apache Arrow JS 0.4.1 - RC1

2019-03-24 Thread Krisztián Szűcs
All of the packages are out now: https://www.npmjs.com/settings/apache-arrow/packages On Sun, Mar 24, 2019 at 10:37 PM Krisztián Szűcs wrote: > Thanks Paul! I'm trying it. > > On Sun, Mar 24, 2019 at 10:26 PM Paul Taylor wrote: > >> Yes, the solution here is to publish all

Re: [VOTE] Release Apache Arrow JS 0.4.1 - RC1

2019-03-24 Thread Krisztián Szűcs
I guess those three packages were updated by Kou, so I won't try to update/publish the packages. But I suppose the rest of the packages should be updated as well: https://www.npmjs.com/settings/apache-arrow/packages On Sun, Mar 24, 2019 at 10:10 PM Krisztián Szűcs wrote: > Hi Kou, > >

Re: [VOTE] Release Apache Arrow JS 0.4.1 - RC1

2019-03-24 Thread Krisztián Szűcs
me your user name at mpmjs? I'll > add you to maintainers. > > > Thanks, > -- > kou > > In > "Re: [VOTE] Release Apache Arrow JS 0.4.1 - RC1" on Sun, 24 Mar 2019 > 19:27:25 +0100, > Krisztián Szűcs wrote: > > > Hi All, > > > > The vote car

Re: [VOTE] Release Apache Arrow JS 0.4.1 - RC1

2019-03-24 Thread Krisztián Szűcs
> > > On Mar 24, 2019, at 2:10 PM, Krisztián Szűcs > wrote: > > > > Hi Kou, > > > > Paul has already added me, and I was trying to publish the > > packages, but it fails with: > > 19 verbose stack Error: 403 Forbidden - PUT > > https://re

Re: Timeline for 0.13 Arrow release

2019-03-25 Thread Krisztián Szűcs
> > > > >>"Re: Timeline for 0.13 Arrow release" on Mon, 18 Mar 2019 > > 20:51:12 > > > -0500, > > > > >>Wes McKinney wrote: > > > > >> > > > > >>> hi folks, > > > > >>> > > > >

Re: Timeline for 0.13 Arrow release

2019-03-25 Thread Krisztián Szűcs
these issues (eg end of day Tuesday) > Sounds good to me. Do We have a release manager? > > On Mon, Mar 25, 2019, 2:12 PM Krisztián Szűcs > wrote: > > > Hello all, > > > > I'm working on the conda and wheel builds: > > https://github.com/apache/arrow/pull

Re: Timeline for 0.13 Arrow release

2019-03-27 Thread Krisztián Szűcs
Yes, check the windows wheels please. We test them in a conda env [1], so theoretically they should be fine. [1]: https://github.com/apache/arrow/blob/master/dev/tasks/python-wheels/win-build.bat#L76-L88 On Wed, Mar 27, 2019 at 10:09 PM Wes McKinney wrote: > That's definitely a problem, we

Re: CI failure by Sphinx

2019-04-01 Thread Krisztián Szűcs
Sphinx has a new release which is not followed by breathe yet. I'm pinning sphinx. On Mon, Apr 1, 2019 at 4:55 AM Kouhei Sutou wrote: > Hi, > > Our CI is failed since 2 days ago: > https://travis-ci.org/apache/arrow/jobs/513191828#L5131-L5141 > > >

Re: [RESULT][VOTE] Release Apache Arrow 0.13.0 - RC4

2019-04-01 Thread Krisztián Szűcs
I'm updating the conda-forge packages. On Mon, Apr 1, 2019 at 7:47 AM Kouhei Sutou wrote: > Hi Andy, > > Thanks for resending invites. > I found both invites of parquet and datafusion crates and > accepted them. > > Thanks for publishing crates. > > > Thanks, > -- > kou > > In > "Re:

Re: Unable to merge PRs on new computer

2019-04-01 Thread Krisztián Szűcs
Hey Andy, What's the error message? Ensure, that You've correctly set up the environment variables described in the docstring: # This utility assumes you already have a local Arrow git clone and that you # have added remotes corresponding to both (i) the Github Apache Arrow mirror # and (ii) the

Re: [VOTE] Add new DurationInterval Type to Arrow Format

2019-04-08 Thread Krisztián Szűcs
The vote carries with 4 binding +1 votes. Micah, what are the next steps? Are You going to finalize the PR? On Sun, Apr 7, 2019 at 11:13 AM Uwe L. Korn wrote: > +1 (binding) > > On Sat, Apr 6, 2019, at 2:44 AM, Kouhei Sutou wrote: > > +1 (binding) > > > > In > > "[VOTE] Add new

Re: Timeline for 0.13 Arrow release

2019-03-25 Thread Krisztián Szűcs
r for 0.13.0. But I don't have > enough time. Could someone help me? > > Thanks, > -- > kou > > In > "Re: Timeline for 0.13 Arrow release" on Mon, 25 Mar 2019 15:37:46 +0100, > Krisztián Szűcs wrote: > > > On Mon, Mar 25, 2019 at 3:21 PM Wes M

Nightly binary packages

2019-02-25 Thread Krisztián Szűcs
Hi, Currently We have nightly package builds, currently under my github account, which is not really visible. It would be great to make them available for developer purposes, and additionally it'd test the binary scripts too. The nightly packages are produced the same way like it is documented in

Re: Nightly binary packages

2019-03-01 Thread Krisztián Szűcs
7 days is enough. > > We can do this by just deleting a version for old nightly > packages on Bintray: > https://bintray.com/docs/api/#url_delete_version Sounds good. > > > I think that we should create a version such as "2019-02-28" > for each nightly. > I wouldn't t

Re: [Rust] [DataFusion] Preferences on futures / threading crates?

2019-03-04 Thread Krisztián Szűcs
On Mon, Mar 4, 2019 at 5:55 AM Andy Grove wrote: > I have been working on a PoC of parallel query execution and it is working > well, and I am now starting to create PRs for the various refactors > necessary for this in DataFusion. > > I haven't been following the async/await and futures/tokio

Re: Boost and manylinux CI builds

2019-02-26 Thread Krisztián Szűcs
Hi Ravindra! You'll need to rebuild the docker image and change this line accordingly: https://github.com/apache/arrow/blob/master/ci/travis_script_manylinux.sh#L57 On Wed, Feb 27, 2019 at 8:29 AM Ravindra Pindikura wrote: > Hi, > > I added an include for boost header file in gandiva. This

Re: [ANNOUNCE] New Arrow committer: Paddy Horan

2019-03-01 Thread Krisztián Szűcs
Congrats Paddy! On Fri, Mar 1, 2019 at 3:19 AM Chao Sun wrote: > Congratulations Paddy! > > On Thu, Feb 28, 2019 at 5:52 PM paddy horan > wrote: > > > Thanks All, > > > > I honored to be a part of such a great, talented community. > > > > P > > > > > > From:

Re: [ANNOUNCE] New Arrow committer: Chao Sun

2019-03-01 Thread Krisztián Szűcs
Congrats Chao! On Fri, Mar 1, 2019 at 3:19 AM Chao Sun wrote: > Thanks everyone. Looking forward to contributing more! > > Chao > > On Thu, Feb 28, 2019 at 4:24 PM Renjie Liu > wrote: > > > Congrats! > > > > Micah Kornfield 于 2019年3月1日周五 上午7:26写道: > > > > > Congrats! > > > > > > On Thu, Feb

Re: Timeline for 0.13 Arrow release

2019-03-14 Thread Krisztián Szűcs
asks and get a full accounting of > what is broken so we aren't surprised during the release process > > On Wed, Mar 13, 2019 at 9:39 AM Krisztián Szűcs > wrote: > > > > The proof of the pudding is in the eating. You convinced me. > > > > On Wed, Mar 13, 2019 at 3:

Re: Timeline for 0.13 Arrow release

2019-03-13 Thread Krisztián Szűcs
The proof of the pudding is in the eating. You convinced me. On Wed, Mar 13, 2019 at 3:31 PM Wes McKinney wrote: > Krisztian -- are you all right with proceeding with merging the CMake > refactor? I'm pretty committed to helping fix the problems that come > up. Since most consumers of the

Re: Building Arrow + Gandiva on Ubuntu Trusty

2019-03-20 Thread Krisztián Szűcs
Hi Praveen, On Wed, Mar 20, 2019 at 1:26 PM Praveen Kumar wrote: > Hi Folks, > > Post the CMake Refactor, we are running into issues in the Gandiva crossbow > jobs. > > We are using conda to setup the dependencies currently. The following are > the issues that we ran into > > 1. I am not sure

Re: [C++] Failing constructors and internal state

2019-03-12 Thread Krisztián Szűcs
+1 on Make and MakeUnsafe On Mon, Mar 11, 2019 at 3:15 PM Francois Saint-Jacques < fsaintjacq...@gmail.com> wrote: > I can settle with Micah's proposal of `MakeValidate`, though I'd prefer > that Make is safe by default and responsible users use MakeUnsafe :), I'll > settle with the pragmatic

Re: Timeline for 0.13 Arrow release

2019-03-12 Thread Krisztián Szűcs
Hi, The CMake refactor is huge enough to cause unexpected post-release defects. I'd consider shipping it with the next release and let is stabilize during the development of 0.14. On Tue, Mar 12, 2019 at 3:41 PM Wes McKinney wrote: > hi Uwe, > > I would be OK with trying to release next week.

[VOTE] Release Apache Arrow JS 0.4.1 - RC1

2019-03-21 Thread Krisztián Szűcs
Hello all, I would like to propose the following release candidate (rc1) of Apache Arrow JavaScript version 0.4.1. This is the second release candidate, including the fix for node version requirement [3]. The source release rc1 is hosted at [1]. This release candidate is based on commit

Re: [VOTE] Release Apache Arrow JS 0.4.1 - RC1

2019-03-21 Thread Krisztián Szűcs
+1 (binding) Ran `dev/release/js-verify-release-candidate.sh 0.4.1 1` with Node v11.12.0 on OSX 10.14.3 and it looks good. On Thu, Mar 21, 2019 at 8:45 PM Krisztián Szűcs wrote: > Hello all, > > I would like to propose the following release candidate (rc1) of Apache > Arrow JavaSc

Re: [VOTE] Release Apache Arrow JS 0.4.1 - RC0

2019-03-21 Thread Krisztián Szűcs
1.6.0 > >> > > > >> > > > >> > > On Wed, Mar 20, 2019 at 5:21 PM Kouhei Sutou > >> wrote: > >> > > > >> > > > +1 (binding) > >> > > > > >> > > > I ran the followi

Re: [VOTE] Accept donation of Rust DataFusion library for Apache Arrow

2019-01-24 Thread Krisztián Szűcs
+1 (binding) On Thu, Jan 24, 2019 at 11:19 AM Uwe L. Korn wrote: > +1 (binding) as the Rust community seems to support this. > > Uwe > > On Thu, Jan 24, 2019, at 7:45 AM, Melik-Adamyan, Areg wrote: > > +1 (non-binding) > > > > Is there a plan for C++ API? > > > > -Original Message- > >

Re: [VOTE] Release Apache Arrow JS 0.4.0 - RC1

2019-01-31 Thread Krisztián Szűcs
+1 (binding), verified on OSX Mojave and Node v11.4.0 On Thu, Jan 31, 2019 at 6:06 PM Brian Hulette wrote: > +1 > > verified on Archlinux with Node v11.9.0 > > Thanks a lot for putting the RC together Uwe! > > On Thu, Jan 31, 2019 at 8:08 AM Uwe L. Korn wrote: > > > +1 (binding), > > > >

Re: [ANNOUNCE] New Arrow PMC member: Andy Grove

2019-02-04 Thread Krisztián Szűcs
Congrats Andy! :) On Mon, Feb 4, 2019 at 4:39 PM Wes McKinney wrote: > The Project Management Committee (PMC) for Apache Arrow has invited > Andy Grove to become a PMC member and we are pleased to announce that > Andy has accepted. > > Congratulations and welcome! >

Re: [ANNOUNCE] New Arrow committer: Ravindra Pindikura

2019-02-05 Thread Krisztián Szűcs
Congratulations! On Mon, Feb 4, 2019 at 4:41 PM Wes McKinney wrote: > On behalf of the Arrow PMC, I'm happy to announce that Ravindra has an > accepted an invitation to become a committer on Apache Arrow. > > Welcome, and thank you for your contributions! >

Re: [Python/C++] Help running HDFS integration test for C++/Python

2019-04-15 Thread Krisztián Szűcs
Hey Micah, Try the following [1]: export PYTHON_VERSION=3.6 docker-compose build cpp docker-compose build python docker-compose build hdfs-integration docker-compose run hdfs-integration [1]: https://github.com/apache/arrow/blob/master/docker-compose.yml#L444 On Mon, Apr 15, 2019 at 8:38 AM

Re: [Python/C++] Help running HDFS integration test for C++/Python

2019-04-15 Thread Krisztián Szűcs
Or: `make -f Makefile.docker run-hdfs-integration` dev/container/README.md is definitely outdated On Mon, Apr 15, 2019 at 9:09 AM Krisztián Szűcs wrote: > Hey Micah, > > Try the following [1]: > > export PYTHON_VERSION=3.6 > docker-compose build cpp > docker-compose

New CI system: Ursabot

2019-06-14 Thread Krisztián Szűcs
Hello All, We're developing a buildbot application to utilize Ursa Labs’ physical machines called Ursabot. Buildbot [1] is used by major open source projects, like CPython and WebKit [2]. The source code is hosted at [3], the web interface is accessible at [4]. The repository contains a short

Re: New CI system: Ursabot

2019-06-14 Thread Krisztián Szűcs
rk). [1]: https://www.docker.com/products/windows-containers [2]: https://github.com/ursa-labs/ursabot/blob/master/ursabot/builders.py#L420 [3]: http://docs.buildbot.net/2.3.1/full.html#multi-master-mode > Thanks, > Wes > > [1]: https://en.wikipedia.org/wiki/2010_Tennessee_floods >

Re: New CI system: Ursabot

2019-06-17 Thread Krisztián Szűcs
/commentauthorassociation/ On Mon, Jun 17, 2019 at 3:16 PM Wes McKinney wrote: > On Mon, Jun 17, 2019 at 7:25 AM Krisztián Szűcs > wrote: > > > > On Sun, Jun 16, 2019 at 6:17 AM Micah Kornfield > > wrote: > > > > > Hi Krisztian, > > > This is really cool, th

Re: [ANNOUNCE] New Arrow committer: Francois Saint-Jacques

2019-06-12 Thread Krisztián Szűcs
Congratulations François! On Wed, Jun 12, 2019 at 10:30 PM Bryan Cutler wrote: > Congratulations! > > On Wed, Jun 12, 2019 at 10:49 AM Chao Sun wrote: > > > Congrats Francois! > > > > On Wed, Jun 12, 2019 at 9:01 AM Micah Kornfield > > wrote: > > > > > Congrats Francois, well deserved! > > >

Re: Failures in Arrow tests run outside of continuous integration

2019-06-20 Thread Krisztián Szűcs
smithy now uses pipelines with more maintainable configurations: https://github.com/conda-forge/arrow-cpp-feedstock/tree/master/.azure-pipelines On Thu, Jun 20, 2019 at 11:16 AM Antoine Pitrou wrote: > > Le 20/06/2019 à 11:14, Krisztián Szűcs a écrit : > > Travis provides 50 min

Re: Failures in Arrow tests run outside of continuous integration

2019-06-20 Thread Krisztián Szűcs
Travis provides 50 minutes timeout for free builds [1], so We need to run those tests either on ursabot or another hosted CI service. With crossbow we're not limited to certain CI services, so we can use CircleCI and Azure Pipelines too, and simultaneously. Created issue

Re: New CI system: Ursabot

2019-06-24 Thread Krisztián Szűcs
> > Obvious initial candidate for this process is the lint job, to give > > faster linter failures on PRs which currently can take a while > > > > Thoughts? > > > > - Wes > > > > On Mon, Jun 17, 2019 at 3:48 PM Kris

  1   2   3   4   5   6   >