xushiyan commented on issue #1480: [SUPPORT] Backwards Incompatible Schema 
Evolution
URL: https://github.com/apache/incubator-hudi/issues/1480#issuecomment-609466504
 
 
   @vinothchandar Yes the exporter tool can be used for this purpose, with some 
changes. It currently supports copying Hudi dataset as is. With this migration 
use case, we could extend the feature to include transformation when 
`--output-format hudi`, using a custom `Transformer`.
   
   Though MOR is a bit troublesome with log files conversions, we could start 
with COW tables support? Does this work for your case? @symfrog 
   
   As for splitting/merging usecases, something feasible as well; some more 
logic to implement for exporter to take multiple source/target paths. Also some 
efforts to support multiple datasets in `Transformer` interface.
   
   @vinothchandar Are my thoughts above aligned with yours?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to