Re: [DataFusion] New Blog Post -- DataFusion 34.0

2024-01-23 Thread Antoine Pitrou



Impressive, thank you!


Le 23/01/2024 à 14:06, Andrew Lamb a écrit :

If anyone is interested, here is a new blog post about the last 6 months in
DataFusion[1] and where we are heading this year.

Andrew

[1]: https://arrow.apache.org/blog/2024/01/19/datafusion-34.0.0/



[DataFusion] New Blog Post -- DataFusion 34.0

2024-01-23 Thread Andrew Lamb
If anyone is interested, here is a new blog post about the last 6 months in
DataFusion[1] and where we are heading this year.

Andrew

[1]: https://arrow.apache.org/blog/2024/01/19/datafusion-34.0.0/


[DISCUSS] [DataFusion] Unifying BuiltIn and User Defined Functions

2024-01-23 Thread Andrew Lamb
I would like to bring attention to the project of unifying built in and
user defined functions [1], and specifically a PR[2] that starts
implementing that approach.

Please provide any feedback you have on the ticket or PR.

Thank you,
Andrew

[1]: https://github.com/apache/arrow-datafusion/issues/8045
[2]: https://github.com/apache/arrow-datafusion/pull/8705


[RESULT][VOTE] Release Apache Arrow 15.0.0 - RC1

2024-01-23 Thread Raúl Cumplido
Hi,

I forgot to change the subject to RESULT.

El dom, 21 ene 2024 a las 15:04, Raúl Cumplido () escribió:
>
> Hi,
>
> Thanks everyone.
>
> The result of the vote was successful with 5 +1 binding votes, 2 +1
> non-binding vote and no -1 votes.
> I will start the post release tasks for 15.0.0.
>
> Thanks,
> Raúl
>

The current post-release tasks status:
[Done] Update the released milestone Date and set to "Closed" on GitHub
[Done] Add the new release to the Apache Reporter System
[Done] Upload source
[Done] Upload binaries
[Done] Merge changes on release branch to maintenance branch for patch releases
[Done] Publish Maven artifacts
[Done] Upload C# packages
[Done] Upload wheels/sdist to pypi
[Done] Bump versions
[Done] Update tags for Go modules
[Done] Update website --> https://github.com/apache/arrow-site/pull/465
[Done] Update MSYS2 package -->
https://github.com/msys2/MINGW-packages/pull/19828
[Done] Upload JavaScript packages
[Done] Remove old artifacts
[Done] Announce the release on Twitter (I've tweeted on my personal
twitter as I don't have access to the Arrow one)
[Done] Publish release blog posts -->
https://github.com/apache/arrow-site/pull/464
[Done] Announce the new release
[Done] Update docs --> https://github.com/apache/arrow-site/pull/466
[Done] Update Conan recipe -->
https://github.com/conan-io/conan-center-index/pull/22491

[In progress] Update Homebrew packages --> Done by community:
https://github.com/Homebrew/homebrew-core/pull/160553
[In progress] Update vcpkg port -->
https://github.com/microsoft/vcpkg/pull/36298
[In progress] Update conda recipes -->
https://github.com/conda-forge/arrow-cpp-feedstock/pull/1290

TODO:
[TODO] Upload RubyGems (Waiting for Homebrew to be merged)
[TODO ] Make the CPP PARQUET related version as "RELEASED" on JIRA
[TODO] Start the new version on JIRA for the related CPP PARQUET version
[TODO] Update R packages

> El sáb, 20 ene 2024 a las 14:19, Sutou Kouhei () 
> escribió:
> >
> > Hi,
> >
> > > - hash and signature look good (NB: I think we can provide only
> > > sha512, no need to provide sha256 anymore imho)
> >
> > Right. Could you open an issue for this?
> > Let's remove sha256 in the next release.
> >
> > Thanks,
> > --
> > kou
> >
> > In 
> >   "Re: [VOTE] Release Apache Arrow 15.0.0 - RC1" on Wed, 17 Jan 2024 
> > 17:02:30 +0100,
> >   Jean-Baptiste Onofré  wrote:
> >
> > > +0.5 (non binding)
> > >
> > > I checked:
> > > - hash and signature look good (NB: I think we can provide only
> > > sha512, no need to provide sha256 anymore imho)
> > > - no binary files found in the source distribution (py/pxd files are OK)
> > > - few files don't have or not correct ASF headers (for instance in cpp
> > > and r modules). It's not a blocker for this release but I will open a
> > > PR for discussion, upgrading RAT as well.
> > > - LICENSE and NOTICE are there and correct
> > > - I have a build issue on JS module on Mac M1:
> > >
> > > [16:59:25] 'compile:es2015:umd' errored after 1.03 s
> > > [16:59:25] Error: [16:59:24] 'compile:es2015:umd' errored after 1.57 ms
> > > [16:59:24] TypeError: Function.prototype.apply was called on
> > > undefined, which is a undefined and not a function
> > > at Lo 
> > > (/Users/jbonofre/apache-arrow-15.0.0/js/node_modules/esm/esm.js:1:233359)
> > > at au 
> > > (/Users/jbonofre/apache-arrow-15.0.0/js/node_modules/esm/esm.js:1:236294)
> > > at ou 
> > > (/Users/jbonofre/apache-arrow-15.0.0/js/node_modules/esm/esm.js:1:236969)
> > > at Module.
> > > (/Users/jbonofre/apache-arrow-15.0.0/js/node_modules/esm/esm.js:1:304731)
> > > at require 
> > > (/Users/jbonofre/apache-arrow-15.0.0/js/node_modules/esm/esm.js:1:288360)
> > > at 
> > > file:///Users/jbonofre/apache-arrow-15.0.0/js/gulp/closure-task.js:46:46
> > > at Array.reduce ()
> > > at closure 
> > > (file:///Users/jbonofre/apache-arrow-15.0.0/js/gulp/closure-task.js:43:60)
> > > at fn 
> > > (file:///Users/jbonofre/apache-arrow-15.0.0/js/gulp/memoize-task.js:31:41)
> > > at compile 
> > > (file:///Users/jbonofre/apache-arrow-15.0.0/js/gulp/compile-task.js:30:86)
> > > [16:59:24] 'compile' errored after 4 ms
> > > at formatError
> > > (/Users/jbonofre/apache-arrow-15.0.0/js/node_modules/gulp-cli/lib/versioned/^4.0.0/format-error.js:21:10)
> > > at Gulp.
> > > (/Users/jbonofre/apache-arrow-15.0.0/js/node_modules/gulp-cli/lib/versioned/^4.0.0/log/events.js:33:15)
> > > at Gulp.emit (node:events:531:35)
> > > at Gulp.emit (node:domain:488:12)
> > > at Object.error
> > > (/Users/jbonofre/apache-arrow-15.0.0/js/node_modules/undertaker/lib/helpers/createExtensions.js:61:10)
> > > at handler 
> > > (/Users/jbonofre/apache-arrow-15.0.0/js/node_modules/now-and-later/lib/mapSeries.js:47:14)
> > > at f 
> > > (/Users/jbonofre/apache-arrow-15.0.0/js/node_modules/once/once.js:25:25)
> > > at f 
> > > (/Users/jbonofre/apache-arrow-15.0.0/js/node_modules/once/once.js:25:25)
> > > at tryCatch
> > >