Hi, I am not looking for a way to actually execute the query on Hive. I would like to do something similar to Spark SQL/HiveContext, but with Beam. Just have a HiveIO that reads metadata from Hive metastore, and then later use a Spark runner to execute the query. So, HiveJDBC is not an option I would like to pursue. Thanks for the pointer, though!
And does the HiveIO that is being planned, work similarly as above? Thanks Vinoth On Tue, Dec 6, 2016 at 4:55 AM, Ismaël Mejía <ieme...@gmail.com> wrote: > Hello, > > If you really need to read/write via Hive, remember that you can use the > Hive Jdbc driver, and achieve this with Beam using the JdbcIO (this is > probably less efficient for the streaming case but still a valid solution). > > Ismaël > > > On Tue, Dec 6, 2016 at 12:04 PM, Vinoth Chandar <vin...@uber.com> wrote: > > > Great. Thanks! > > > > Thanks, > > Vinoth > > > > > On Dec 6, 2016, at 2:06 AM, Jean-Baptiste Onofré <j...@nanthrax.net> > > wrote: > > > > > > Hi, > > > > > > Ismaël and I started HiveIO. > > > > > > I have several IOs ready to propose as PR, but, in order to limit the > > number of open PRs, I would like to merge the pending ones. > > > > > > I will let you know when the branches/PRs will be available. > > > > > > Regards > > > JB > > > > > >> On 12/05/2016 11:40 PM, Vinoth Chandar wrote: > > >> Hi guys, > > >> > > >> Saw a post around HiveIO on the users list with a PR followup. I am > > >> interested in this too and can pitch in on developement and testing.. > > >> > > >> Who & where is this work happening? > > >> > > >> Thanks > > >> VInoth > > >> > > > > > > -- > > > Jean-Baptiste Onofré > > > jbono...@apache.org > > > http://blog.nanthrax.net > > > Talend - http://www.talend.com > > >
