Hfal91 opened a new issue, #11725:
URL: https://github.com/apache/hudi/issues/11725

   Env: AWS EMR on EKS 7.1 
   Hudi version: 0.14.1
   Athena engine: v3
   Table mode: MOR
   
   
   **This happens ONLY if I use custom Payload class.** 
   When RT and RO table aren’t synced, selecting RT table in Athena returns the 
below error:
   _GENERIC_INTERNAL_ERROR: Exception when constructing record reader
   This query ran against the “xxx database, unless qualified by the query. 
Please post the error message on our forum_ 
   
   
   Initially, i though that i was doing something wrong in my custom code, but 
then, i created the class empty, just extending the default 
_OverwriteWithLatestAvroPayload_, and i continue getting the error, so at this 
point, seems that only the fact that i'm using a Custom payload class is 
provoking the error (?)
   
   I'm providing the main code that i'm using, as well as the "empty" custom 
payload class:
   
[main_code_attach.txt](https://github.com/user-attachments/files/16472848/main_code_attach.txt)
   
[custom_java.txt](https://github.com/user-attachments/files/16472873/custom_java.txt)
   
   To reproduce, do one execution with BATCH 1 (commented in the main file), 
and do a second execution with BATCH 2.
   After it, if you query the RT table in Athena, you should see the error
   GENERIC_INTERNAL_ERROR: Exception when constructing record reader
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to