Hi, the code looks very good! Do you think it can be adapted to the slightly modified interface introduced here: https://issues.apache.org/jira/browse/FLINK-3637
It basically requires the writer to know the write position, so that we can truncate to a valid position in case of failure. Cheers, Aljoscha On Thu, 21 Apr 2016 at 18:40 Igor Berman <igor.ber...@gmail.com> wrote: > ok, > I have working prototype already, if somebody is interested(attached) > > I might add it as PR latter(with tests etc) > > tested locally & with s3 > > > > > > > > On 21 April 2016 at 12:01, Aljoscha Krettek <aljos...@apache.org> wrote: > >> Hi, >> as far as I know there is no one working on this. I'm only aware of >> someone working on an ORC (from Hive) Writer. >> >> This would be a welcome addition! I think you are already on the right >> track, the only thing required will probably be an AvroFileWriter and you >> already started looking at SequenceFileWriter, which should be similar. >> >> Cheers, >> Aljoscha >> >> On Thu, 21 Apr 2016 at 09:45 Igor Berman <igor.ber...@gmail.com> wrote: >> >>> Hi All, >>> Is there such implementation somewhere?(before I start to implement it >>> myself, it seems not too difficult based on SequenceFileWriter example) >>> >>> anyway any ideas/pointers will be highly appreciated >>> >>> thanks in advance >>> >>> >
