Re: [PR] feat: support array_append [datafusion-comet]

2024-11-13 Thread via GitHub
andygrove merged PR #1072: URL: https://github.com/apache/datafusion-comet/pull/1072 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@

Re: [PR] feat: support array_append [datafusion-comet]

2024-11-13 Thread via GitHub
NoeB commented on PR #1072: URL: https://github.com/apache/datafusion-comet/pull/1072#issuecomment-2474685268 It seems that Spark 4.0 rewrites array_append into an array_insert expression, therefor the test is disabled for spark 4.0+. see https://github.com/apache/spark/blob/f0d465e09b8d89

Re: [PR] feat: support array_append [datafusion-comet]

2024-11-12 Thread via GitHub
NoeB commented on PR #1072: URL: https://github.com/apache/datafusion-comet/pull/1072#issuecomment-2471225538 Thank you @andygrove for the review I have updated the code to match the refactor you did yesterday I guess that's also the reason for the failing tests. -- This is an automa

Re: [PR] feat: support array_append [datafusion-comet]

2024-11-12 Thread via GitHub
NoeB commented on PR #1072: URL: https://github.com/apache/datafusion-comet/pull/1072#issuecomment-2469942871 Because array_append has been added in Spark 3.4 I had to rewrite the match statement in QueryPlanSerde because it would not compile with spark 3.3 the same thing applies to the t

Re: [PR] feat: support array_append [datafusion-comet]

2024-11-12 Thread via GitHub
NoeB commented on code in PR #1072: URL: https://github.com/apache/datafusion-comet/pull/1072#discussion_r1837701619 ## native/core/src/execution/datafusion/planner.rs: ## @@ -691,6 +693,34 @@ impl PhysicalPlanner { expr.ordinal as usize, ))

Re: [PR] feat: support array_append [datafusion-comet]

2024-11-11 Thread via GitHub
andygrove commented on code in PR #1072: URL: https://github.com/apache/datafusion-comet/pull/1072#discussion_r1837147575 ## native/core/src/execution/datafusion/planner.rs: ## @@ -691,6 +693,34 @@ impl PhysicalPlanner { expr.ordinal as usize,

Re: [PR] feat: support array_append [datafusion-comet]

2024-11-11 Thread via GitHub
NoeB commented on code in PR #1072: URL: https://github.com/apache/datafusion-comet/pull/1072#discussion_r1836921855 ## spark/src/test/scala/org/apache/comet/CometExpressionSuite.scala: ## @@ -2313,4 +2313,22 @@ class CometExpressionSuite extends CometTestBase with AdaptiveSpar

Re: [PR] feat: support array_append [datafusion-comet]

2024-11-10 Thread via GitHub
andygrove commented on code in PR #1072: URL: https://github.com/apache/datafusion-comet/pull/1072#discussion_r1835886113 ## spark/src/test/scala/org/apache/comet/CometExpressionSuite.scala: ## @@ -2313,4 +2313,22 @@ class CometExpressionSuite extends CometTestBase with Adaptiv

Re: [PR] feat: support array_append [datafusion-comet]

2024-11-10 Thread via GitHub
NoeB commented on code in PR #1072: URL: https://github.com/apache/datafusion-comet/pull/1072#discussion_r1835759807 ## spark/src/test/scala/org/apache/comet/CometExpressionSuite.scala: ## @@ -2313,4 +2313,22 @@ class CometExpressionSuite extends CometTestBase with AdaptiveSpar

Re: [PR] feat: support array_append [datafusion-comet]

2024-11-10 Thread via GitHub
codecov-commenter commented on PR #1072: URL: https://github.com/apache/datafusion-comet/pull/1072#issuecomment-2466808384 ## [Codecov](https://app.codecov.io/gh/apache/datafusion-comet/pull/1072?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_ca

Re: [PR] feat: support array_append [datafusion-comet]

2024-11-10 Thread via GitHub
andygrove commented on code in PR #1072: URL: https://github.com/apache/datafusion-comet/pull/1072#discussion_r1835729939 ## spark/src/test/scala/org/apache/comet/CometExpressionSuite.scala: ## @@ -2313,4 +2313,22 @@ class CometExpressionSuite extends CometTestBase with Adaptiv

Re: [PR] feat: support array_append [datafusion-comet]

2024-11-09 Thread via GitHub
NoeB commented on PR #1072: URL: https://github.com/apache/datafusion-comet/pull/1072#issuecomment-2466260009 I am unsure if I implemented the operation correctly, so I just implemented the array_append operation as a first step. If the approach is correct, I think I can extract it to a fu

[PR] feat: support array_append [datafusion-comet]

2024-11-09 Thread via GitHub
NoeB opened a new pull request, #1072: URL: https://github.com/apache/datafusion-comet/pull/1072 ## Which issue does this PR close? Related to #1042: Adds support for array_append operation ## Rationale for this change ## What changes are included in this