Re: [I] [SUPPORT] AWS Athena query fail when compaction is scheduled for MOR table [hudi]

2024-04-09 Thread via GitHub
codope commented on issue #9907: URL: https://github.com/apache/hudi/issues/9907#issuecomment-2045299912 Downgrading is an interim workaround. We should aim fixing HUDI-7554 in 0.15.0. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [I] [SUPPORT] AWS Athena query fail when compaction is scheduled for MOR table [hudi]

2024-04-09 Thread via GitHub
codope commented on issue #9907: URL: https://github.com/apache/hudi/issues/9907#issuecomment-2045298649 Part of the issues are fixed in https://github.com/apache/hudi/pull/10846. There is still one issue https://issues.apache.org/jira/browse/HUDI-7554 -- This is an automated message

Re: [I] [SUPPORT] AWS Athena query fail when compaction is scheduled for MOR table [hudi]

2024-04-08 Thread via GitHub
nsivabalan commented on issue #9907: URL: https://github.com/apache/hudi/issues/9907#issuecomment-2044029051 hey @codope @rahil-c : is athena querying hudi related issues are all fixed as of now? or do we still have any pending gaps. -- This is an automated message from the Apache

Re: [I] [SUPPORT] AWS Athena query fail when compaction is scheduled for MOR table [hudi]

2024-04-05 Thread via GitHub
brightwon commented on issue #9907: URL: https://github.com/apache/hudi/issues/9907#issuecomment-2039252471 @ad1happy2go I resolved the issue by downgrading the version, and we didn't find anything else to check. I don't need help right now. -- This is an automated message from the

Re: [I] [SUPPORT] AWS Athena query fail when compaction is scheduled for MOR table [hudi]

2024-04-01 Thread via GitHub
ad1happy2go commented on issue #9907: URL: https://github.com/apache/hudi/issues/9907#issuecomment-2029651546 @brightwon Were you able to identify the root cause issue? Do let us know in case you still need help here . -- This is an automated message from the Apache Git Service. To

Re: [I] [SUPPORT] AWS Athena query fail when compaction is scheduled for MOR table [hudi]

2024-01-31 Thread via GitHub
codope commented on issue #9907: URL: https://github.com/apache/hudi/issues/9907#issuecomment-1919583511 @rahil-c Can you confirm that it is the same Athena version that can read Hudi 0.13.1 table but not 0.14.0 table? If so, then it eliminates any engine issue, and we need to debug

Re: [I] [SUPPORT] AWS Athena query fail when compaction is scheduled for MOR table [hudi]

2024-01-29 Thread via GitHub
brightwon commented on issue #9907: URL: https://github.com/apache/hudi/issues/9907#issuecomment-1916086956 @ad1happy2go Sorry I'm late. The above error log provided by the Athena console is all. To fix this problem, Athena's hudi version need to be upgraded? -- This is an

Re: [I] [SUPPORT] AWS Athena query fail when compaction is scheduled for MOR table [hudi]

2023-12-01 Thread via GitHub
rahil-c commented on issue #9907: URL: https://github.com/apache/hudi/issues/9907#issuecomment-1836943531 When trying with emr 6.14.0 hudi 0.13.1 I dont see the issue as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [I] [SUPPORT] AWS Athena query fail when compaction is scheduled for MOR table [hudi]

2023-11-30 Thread via GitHub
rahil-c commented on issue #9907: URL: https://github.com/apache/hudi/issues/9907#issuecomment-1834810588 @codope Was also able to reproduce this error on EMR 6.15.0 using hudi 0.14.0. Wrote a simple hudi pyspark script with inline compaction on and then during compaction queried

Re: [I] [SUPPORT] AWS Athena query fail when compaction is scheduled for MOR table [hudi]

2023-10-23 Thread via GitHub
ad1happy2go commented on issue #9907: URL: https://github.com/apache/hudi/issues/9907#issuecomment-1775119269 @brightwon Interesting. Thanks for raising this. Looks like a regression. Can you provide full stack trace. -- This is an automated message from the Apache Git Service. To

Re: [I] [SUPPORT] AWS Athena query fail when compaction is scheduled for MOR table [hudi]

2023-10-23 Thread via GitHub
brightwon commented on issue #9907: URL: https://github.com/apache/hudi/issues/9907#issuecomment-1775080933 Now, I downgraded my Hudi version to 0.13.1 and the error no longer occurs. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[I] [SUPPORT] AWS Athena query fail when compaction is scheduled for MOR table [hudi]

2023-10-23 Thread via GitHub
brightwon opened a new issue, #9907: URL: https://github.com/apache/hudi/issues/9907 I'm using hudi 0.14.0 with flink 1.16.1 to store data from kafka to s3. but Athena(Engine 3) query to MOR table is not working because of this error. ``` Error running query: HIVE_UNKNOWN_ERROR: