Hi Rico, We're working on supporting different IOChannelFactory implementations. HDFS is definitely at the top of the list. For now it is supported only with HdfsIO but that won't help you with using AvroIO or TextIO on top of HDFS.
You can follow the progress in the ticket BEAM-59 <https://issues.apache.org/jira/browse/BEAM-59>. And here <https://docs.google.com/document/d/11TdPyZ9_zmjokhNWM3Id-XJsVG3qel2lhdKTknmZ_7M/edit?usp=sharing>'s a design proposal. I'll make sure we properly announce this as well once it's in. Thanks! On Mon, Nov 21, 2016 at 1:29 PM Bergmann, Rico (GfK External) < [email protected]> wrote: Hi! I was using the AvroIO.Read to read am avro file (snappy encoded) from HDFS. But the IOChannelFactory has per default no handler for hdfs resources. Is there any and if so how can I usew it? Best, Rico ------------------------------ GfK SE, Nuremberg, Germany, commercial register at the local court Amtsgericht Nuremberg HRB 25014; Management Board: Dr. Gerhard Hausruckinger (Speaker of the Management Board), Christian Diedrich (CFO), Matthias Hartmann, David Krajicek, Alessandra Cama; Chairman of the Supervisory Board: Ralf Klein-Bölting This email and any attachments may contain confidential or privileged information. Please note that unauthorized copying, disclosure or distribution of the material in this email is not permitted.
