Hi Rico, As a short-term workaround, you should also be able to use the HadoopFileSource with AvroInputFormat. https://avro.apache.org/docs/1.7.6/api/java/org/apache/avro/mapred/AvroInputFormat.html
On Mon, Nov 21, 2016 at 3:34 AM, Amit Sela <amitsel...@gmail.com> wrote: > Hi Rico, > > We're working on supporting different IOChannelFactory implementations. > HDFS is definitely at the top of the list. > For now it is supported only with HdfsIO but that won't help you with > using AvroIO or TextIO on top of HDFS. > > You can follow the progress in the ticket BEAM-59 > <https://issues.apache.org/jira/browse/BEAM-59>. > And here > <https://docs.google.com/document/d/11TdPyZ9_zmjokhNWM3Id-XJsVG3qel2lhdKTknmZ_7M/edit?usp=sharing>'s > a design proposal. > > I'll make sure we properly announce this as well once it's in. > > Thanks! > > On Mon, Nov 21, 2016 at 1:29 PM Bergmann, Rico (GfK External) < > rico.bergm...@ext.gfk.com> wrote: > > Hi! > > > > I was using the AvroIO.Read to read am avro file (snappy encoded) from > HDFS. But the IOChannelFactory has per default no handler for hdfs > resources. Is there any and if so how can I usew it? > > > > Best, Rico > > ------------------------------ > > > GfK SE, Nuremberg, Germany, commercial register at the local court > Amtsgericht Nuremberg HRB 25014; Management Board: Dr. Gerhard > Hausruckinger (Speaker of the Management Board), Christian Diedrich (CFO), > Matthias Hartmann, David Krajicek, Alessandra Cama; Chairman of the > Supervisory Board: Ralf Klein-Bölting This email and any attachments may > contain confidential or privileged information. Please note that > unauthorized copying, disclosure or distribution of the material in this > email is not permitted. > >
