Re: Slack request

Can you add me as well? Allan Wilson Principal Software Engineer Pandora Media Inc Thanks From: Lukasz Cwik <lc...@google.com<mailto:lc...@google.com>> Reply-To: "user@beam.apache.org<mailto:user@beam.apache.org>" <user@beam.apache.org<mailto:user@beam.apa

Re: Reading from ORC Files in HDFS

k-ybtF8=BVnOfRDnazZ6nFSJN0tyuBb-qNOUTvab47qT5Nykuws= > > >You better use HCatalogIO than JdbcIO (the split should be better). > > > > >On Mon, Dec 18, 2017 at 4:17 AM, Allan Wilson <awils...@pandora.com> wrote: >> Hi, >> >> Is there anyway to read ORC files from H

Reading from ORC Files in HDFS

Hi, Is there anyway to read ORC files from HDFS directly using Apache Beam? I’m looking at loading up Kafka with data stored in ORC files backing Hive tables. After doing some research it doesn’t look possible, but I thought I ask to make sure. It may be possible to use jdbc or hcatalog to