vinothchandar commented on issue #1780:
URL: https://github.com/apache/hudi/issues/1780#issuecomment-655194540


   @a-uddhav are you facing the same issue as well? 
   
   @zuyanton by any chance you upgraded the writers before dropping new jars 
for queries?  I think the issue is that 
   
   https://hudi.apache.org/releases.html#release-051-incubating-docs
   ```
   With 0.5.1, we added functionality to stop using renames for Hudi timeline 
metadata operations. This feature is automatically enabled for newly created 
Hudi tables. For existing tables, this feature is turned off by default. Please 
read this section, before enabling this feature for existing hudi tables. To 
enable the new hudi timeline layout which avoids renames, use the write config 
“hoodie.timeline.layout.version=1”. Alternatively, you can use “repair 
overwrite-hoodie-props” to append the line “hoodie.timeline.layout.version=1” 
to hoodie.properties. Note that in any case, upgrade hudi readers (query 
engines) first with 0.5.1-incubating release before upgrading writer.
   ```
   
   this is what seems relevant to me.. If you are spinning up EMR cluster, 
these jars should be same? or may be you are getting the 0.5.0 jar from EMR's 
installation? 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to