Re: Reading from ORC Files in HDFS

2017-12-19 Thread Allan Wilson
Had a feeling that would be the answer, but being new to Beam I wanted to make sure I wasn’t missing something. :) Thanks Ismael On 12/18/17, 3:07 AM, "Ismaël Mejía" wrote: >Hello, > >There is not support yet to read ORC files directly on Beam, You can >track the

Reading from ORC Files in HDFS

2017-12-17 Thread Allan Wilson
Hi, Is there anyway to read ORC files from HDFS directly using Apache Beam? I’m looking at loading up Kafka with data stored in ORC files backing Hive tables. After doing some research it doesn’t look possible, but I thought I ask to make sure. It may be possible to use jdbc or hcatalog to