Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-20 Thread via GitHub
alamb commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2991723331 > Do you think we need to do `48.0.1` to include fix for [#16444](https://github.com/apache/datafusion/issues/16444)? I think we can argue if that was a regression or not (i

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-19 Thread via GitHub
blaginin commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-298367 Do you think we need to do `48.0.1` to include fix for https://github.com/apache/datafusion/issues/16444? -- This is an automated message from the Apache Git Service. To res

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-11 Thread via GitHub
alamb closed issue #15771: Release DataFusion `48.0.0` (June 2025) URL: https://github.com/apache/datafusion/issues/15771 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-11 Thread via GitHub
alamb commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2964540689 We have released to crates.io so I think we are all good here now: https://github.com/apache/datafusion/issues/15915 -- This is an automated message from the Apache Git Service.

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-06 Thread via GitHub
xudong963 commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2951966229 RC3 voting is out: https://lists.apache.org/thread/b7r28j9bzk82cvgcoorxk2cz4c90lso1 -- This is an automated message from the Apache Git Service. To respond to the message, p

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-06 Thread via GitHub
xudong963 commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2951911403 I'm cooking rc3! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-06 Thread via GitHub
andygrove commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2951210118 Here is the cherry-pick PR to backport https://github.com/apache/datafusion/pull/16170 into `branch-48`. Once this is merged, we can cut rc3. https://github.com/apache/

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-06 Thread via GitHub
alamb commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2950732437 BTW I think we should cut any release candidate off the `release-48` branch and main is now open for 49.0.0 features -- This is an automated message from the Apache Git Service.

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-06 Thread via GitHub
alamb commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2950586335 Update: - @andygrove reverted the regression in the `release-48`: https://github.com/apache/datafusion/pull/16307 - I am pretty sure the upgrade works for Delta.rs: https:/

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-06 Thread via GitHub
andygrove commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2949900182 > Upgrading Comet to use rc2 causes tests to fail with a `attempt to subtract with overflow` panic. This did not happen with rc1. I have not debugged this yet to find the root

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-06 Thread via GitHub
andygrove commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2949450136 Upgrading Comet to use rc2 causes tests to fail with a `attempt to subtract with overflow` panic. This did not happen with rc1. I have not debugged this yet to find the root c

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-06 Thread via GitHub
XiangpengHao commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2949445945 No issue found from Parquet Viewer and LiquidCache! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-06 Thread via GitHub
timsaucer commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2948783313 The one I was hoping to get in but didn’t make it before this vote started was https://github.com/apache/datafusion/pull/16170 This was the last of the breaking metadata

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-06 Thread via GitHub
xudong963 commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2948697756 The voting process ⏳ https://lists.apache.org/thread/tqwcgz5567pwo8pfn2p2dvvd5wsbg9bx -- This is an automated message from the Apache Git Service. To respond to the message

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-06 Thread via GitHub
xudong963 commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2948600758 > > [#16267](https://github.com/apache/datafusion/pull/16267) After it's merged, I'll push the 48.0.0-rc2 and start vote > > No issues were found when testing `48.0.0-rc

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-06 Thread via GitHub
xudong963 commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2948577456 One subtle thing found in https://github.com/datafusion-contrib/datafusion-materialized-views/pull/61#discussion_r2131717796, I've opened a separate issue: https://github.com

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-06 Thread via GitHub
shehabgamin commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2948560397 > [#16267](https://github.com/apache/datafusion/pull/16267) After it's merged, I'll push the 48.0.0-rc2 and start vote No issues were found when testing `48.0.0-rc1` o

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-05 Thread via GitHub
xudong963 commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2948082010 https://github.com/apache/datafusion/pull/16267 After it's merged, I'll push the 48.0.0-rc2 and start vote -- This is an automated message from the Apache Git Service. T

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-05 Thread via GitHub
xudong963 commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2948015656 > It looks like these changes all went into the `main` branch. I've been testing off of the `48.0.0-rc1` tag, should I switch to test off of `main`? I'll update branch46

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-05 Thread via GitHub
shehabgamin commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2947035398 > I think we have merged all the desired PRs now: > > * [fix: NaN semantics in GROUP BY #16256](https://github.com/apache/datafusion/pull/16256) > > * [

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-05 Thread via GitHub
alamb commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2946169144 I think we have merged all the desired PRs now: - https://github.com/apache/datafusion/pull/16256 - https://github.com/apache/datafusion/pull/16261 - https://github.com/apa

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-05 Thread via GitHub
alamb commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2945615819 > I would also like to include https://github.com/apache/datafusion/pull/16256 Merged! -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-05 Thread via GitHub
alamb commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2945310225 I started testing with delta.rs: https://github.com/delta-io/delta-rs/pull/3520 -- This is an automated message from the Apache Git Service. To respond to the message, please lo

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-05 Thread via GitHub
andygrove commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2944294392 I would also like to include https://github.com/apache/datafusion/pull/16256 -- This is an automated message from the Apache Git Service. To respond to the message, please lo

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-05 Thread via GitHub
timsaucer commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2943926417 > I really want to get in these two PRs: > > * [feat: Add Aggregate UDF to FFI crate #14775](https://github.com/apache/datafusion/pull/14775) > > * [feat:

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-05 Thread via GitHub
xudong963 commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2943445579 Test with datafusion-materialized-views ✅ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-04 Thread via GitHub
shehabgamin commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2942182941 This is a WIP: https://github.com/lakehq/sail/pull/518 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub an

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-04 Thread via GitHub
alamb commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2941353112 I am sorry I ran out of time today to try and test an upgrade with delta rs -- I will work on it tomorrow morning -- This is an automated message from the Apache Git Service. To

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-04 Thread via GitHub
timsaucer commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2940780703 They're linked in the above comment. I'll try to get to them first thing tomorrow. -- This is an automated message from the Apache Git Service. To respond to the message, pl

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-04 Thread via GitHub
alamb commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2940668740 FYI @xudong963 I think @timsaucer has some PRs he would like to try and get into DataFusion 48 -- I'll let him comment here -- This is an automated message from the Apache Git

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-04 Thread via GitHub
alamb commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2940640461 > We need to pass backtrace env for running new sqllogictest, it can be passed by locally testing: I will try and fix this locally -- This is an automated message from th

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-04 Thread via GitHub
alamb commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2940639917 @mbutrovich FWIW I think that means datafusion requires arrow-flight 55.1 but could run with arrow 55.1 or 55.0 > Are there reasons not to sync on 55.1.0 for a DF 48?

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-04 Thread via GitHub
zhuqi-lucas commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2940544620 > ``` > > 1. statement is expected to fail with error: >(multiline) DataFusion error: Error during planning: Failed to coerce arguments to satisfy a call to 'ap

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-04 Thread via GitHub
mbutrovich commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2940482148 It looks like DataFusion is currently using a mix of Arrow-rs 55.0 and 55.1.0: ``` arrow = { version = "55.1.0", features = [ "prettyprint", "chrono-tz",

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-04 Thread via GitHub
timsaucer commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2940466020 I really want to get in these two PRs: - https://github.com/apache/datafusion/pull/14775 - https://github.com/apache/datafusion/pull/16170 I'm going to focus on get

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-04 Thread via GitHub
xudong963 commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2940461831 It seems to be related to https://github.com/apache/datafusion/issues/16250 -- This is an automated message from the Apache Git Service. To respond to the message, please log

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-04 Thread via GitHub
xudong963 commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2940459402 ``` 1. statement is expected to fail with error: (multiline) DataFusion error: Error during planning: Failed to coerce arguments to satisfy a call to 'approx_per

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-04 Thread via GitHub
xudong963 commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2940255974 > It would be better for the whole community to have the opportunity to participate in the testing, which is part of the voting process. My concern is that otherwise, it may l

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-04 Thread via GitHub
andygrove commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2940253204 Also, the vote can run for longer than three days if we need more time for testing. Three days is just the minimum time. -- This is an automated message from the Apache Git

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-04 Thread via GitHub
andygrove commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2940237225 > was thinking of starting the vote after testing, maybe Friday. WDYT? It would be better for the whole community to have the opportunity to participate in the testing,

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-04 Thread via GitHub
xudong963 commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2940197051 > I don't seem to have received an email about the start of the vote for this release candidate. I was thinking of starting the vote after testing, maybe Friday. WDYT?

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-04 Thread via GitHub
andygrove commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2940101271 > 48.0.0 rc1 is ready: https://github.com/apache/datafusion/tree/48.0.0-rc1 Thanks @xudong963. I'll start testing this with Comet. I don't seem to have received a

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-03 Thread via GitHub
xudong963 commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2938210171 48.0.0 rc1 is ready: https://github.com/apache/datafusion/tree/48.0.0-rc1 -- This is an automated message from the Apache Git Service. To respond to the message, please log o

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-03 Thread via GitHub
alamb commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2935196264 I hope to begin working on the delta-rs upgrade tomorrow as well -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-03 Thread via GitHub
shehabgamin commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2934117630 I plan to test over the next couple of days as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-06-02 Thread via GitHub
xudong963 commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2933415726 I plan to update version and changelog today and then test with MV tomorrow. I hope we can start the vote process on Friday, and release early next week. -- Th

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-05-29 Thread via GitHub
andygrove commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2920373095 > Since updating Comet to use latest DataFusion (pinned dependency), we have been seeing regular but intermittent CI failures that we are still trying to debug. This is

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-05-28 Thread via GitHub
alamb commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2916986710 > [@alamb](https://github.com/alamb), how about starting test next week? I think that would be a great idea. Thanks @xudong963 -- This is an automated message from the Ap

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-05-28 Thread via GitHub
xudong963 commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2916890212 @alamb, how about starting test next week? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-05-25 Thread via GitHub
alamb commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2907743279 I am not sure if it is related, but we have also seen some intermittent failures in DataFusion CI - https://github.com/apache/datafusion/issues/16180 -- This is an automated

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-05-24 Thread via GitHub
andygrove commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2906874047 Since updating Comet to use latest DataFusion (pinned dependency), we have been seeing regular but intermittent CI failures that we are still trying to debug. It may or

Re: [I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-04-21 Thread via GitHub
xudong963 commented on issue #15771: URL: https://github.com/apache/datafusion/issues/15771#issuecomment-2818101312 I'll help to test DF48 by upgrading df in https://github.com/datafusion-contrib/datafusion-materialized-views -- This is an automated message from the Apache Git Service. To

[I] Release DataFusion `48.0.0` (June 2025) [datafusion]

2025-04-19 Thread via GitHub
alamb opened a new issue, #15771: URL: https://github.com/apache/datafusion/issues/15771 ### Is your feature request related to a problem or challenge? _No response_ ### Describe the solution you'd like _No response_ ### Describe alternatives you've considered