zenfenan commented on pull request #12146:
URL: https://github.com/apache/flink/pull/12146#issuecomment-634832954


   @rmetzger This Hadoop Configuration serialization problem comes up every now 
and then, especially since we have multiple modules which use Hadoop in one way 
or another. 
   
   @kl0u has taken care of this in `flink-sequence-file` which is somewhat 
similar to `HbaseConfigurationUtil.serializeConfiguration()`, and even in other 
two modules which I had an opportunity work on (`flink-compress`, `flink-orc`) 
needed this ability but right now uses a work around[1][2]. With that in mind, 
I created a 'discuss' thread some time back[3]. Do you think something like 
what I had proposed in my thread would be a worthy contribution?
   
   
[1]https://github.com/apache/flink/blob/master/flink-formats/flink-compress/src/main/java/org/apache/flink/formats/compress/CompressWriterFactory.java#L87:L96
   
[2]https://github.com/apache/flink/blob/master/flink-formats/flink-orc/src/main/java/org/apache/flink/orc/writer/OrcBulkWriterFactory.java#L93:L102
   
[3]https://lists.apache.org/thread.html/rf885987160bede5911a7f61923307a6d5ae07f850da0a90555728e5f%40%3Cdev.flink.apache.org%3E


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]


Reply via email to