Re: [PROPOSAL] "IOChannelFactory" Redesign and Make it Configurable

2016-11-17 Thread Pei He
Hi JB, My proposals are based on the current IOChannelFactory, and how they are used in FileBasedSink. Let's me spend more time to investigate Hadoop FileSystem interface. -- Pei On Thu, Nov 17, 2016 at 1:21 AM, Jean-Baptiste Onofré wrote: > By the way, Pei, for the record:

Re: [PROPOSAL] "IOChannelFactory" Redesign and Make it Configurable

2016-11-17 Thread Jean-Baptiste Onofré
By the way, Pei, for the record: why introducing BeamFileSystem and not using the Hadoop FileSystem interface ? Thanks Regards JB On 11/17/2016 01:09 AM, Pei He wrote: Hi, I am working on BEAM-59 "IOChannelFactory redesign". The goals are: 1.