Re: [I] [SUPPORT] Hudi MERGE INTO on Glue fails when using functions such as (filter, zip_with) on array of structs [hudi]

rita-ihnatsyeva commented on issue #9838: URL: https://github.com/apache/hudi/issues/9838#issuecomment-1788789248 Thank you for support! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [I] [SUPPORT] Hudi MERGE INTO on Glue fails when using functions such as (filter, zip_with) on array of structs [hudi]

codope closed issue #9838: [SUPPORT] Hudi MERGE INTO on Glue fails when using functions such as (filter, zip_with) on array of structs URL: https://github.com/apache/hudi/issues/9838 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [I] [SUPPORT] Hudi MERGE INTO on Glue fails when using functions such as (filter, zip_with) on array of structs [hudi]

rita-ihnatsyeva commented on issue #9838: URL: https://github.com/apache/hudi/issues/9838#issuecomment-1785794247 Well I changed calculation logic. But for what I've tried it seems that Nullpointer was the case. so probably it failed because of the arriving array values, somewhere with

Re: [I] [SUPPORT] Hudi MERGE INTO on Glue fails when using functions such as (filter, zip_with) on array of structs [hudi]

ad1happy2go commented on issue #9838: URL: https://github.com/apache/hudi/issues/9838#issuecomment-1761806703 Thanks @rita-ihnatsyeva for trying out. Let me know if you need any more help on this. -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [I] [SUPPORT] Hudi MERGE INTO on Glue fails when using functions such as (filter, zip_with) on array of structs [hudi]

rita-ihnatsyeva commented on issue #9838: URL: https://github.com/apache/hudi/issues/9838#issuecomment-1758607355 @ad1happy2go I tried your code in prod env, it works fine, so I guess smth wrong with my input data, as for now I can't understand what's wrong. Doesn't seem like a

Re: [I] [SUPPORT] Hudi MERGE INTO on Glue fails when using functions such as (filter, zip_with) on array of structs [hudi]

rita-ihnatsyeva commented on issue #9838: URL: https://github.com/apache/hudi/issues/9838#issuecomment-1755807962 With upgrade to Glue 4 job fails in another place, just dealing with array type columns. Glue 3 is much more stable as for now, so I only use Glue 3 and Hudi from provided Glue

Re: [I] [SUPPORT] Hudi MERGE INTO on Glue fails when using functions such as (filter, zip_with) on array of structs [hudi]

ad1happy2go commented on issue #9838: URL: https://github.com/apache/hudi/issues/9838#issuecomment-1755449481 @rita-ihnatsyeva Did you upgraded the glue version or Hudi version? Is it stopped working after upgrading Hudi version or glue? -- This is an automated message from the Apache

Re: [I] [SUPPORT] Hudi MERGE INTO on Glue fails when using functions such as (filter, zip_with) on array of structs [hudi]

rita-ihnatsyeva commented on issue #9838: URL: https://github.com/apache/hudi/issues/9838#issuecomment-1754617849 @ad1happy2go yes, it did work as expected on Glue3, but now it fails, though all data seems to be correct, and any other array operations don't cause MERGE to fail. Thank you,

Re: [I] [SUPPORT] Hudi MERGE INTO on Glue fails when using functions such as (filter, zip_with) on array of structs [hudi]

ad1happy2go commented on issue #9838: URL: https://github.com/apache/hudi/issues/9838#issuecomment-1754472931 @rita-ihnatsyeva Are you saying it worked before but now stopped working. I tried the below code and it worked with OSS hudi. ``` test("Test MergeInto With Complex Data

[I] [SUPPORT] Hudi MERGE INTO on Glue fails when using functions such as (filter, zip_with) on array of structs [hudi]

rita-ihnatsyeva opened a new issue, #9838: URL: https://github.com/apache/hudi/issues/9838 - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)? yes **Describe the problem you faced** Prerequisites: 1. I have a permanent hudi table in AWS Glue 2.