Re: Hive storm streaming with s3 file system

> So transactional tables only work with hdfs. Thanks for the confirmation > Elliot. No, that's not what said. Streaming ingest into transactional tables requires strong filesystem consistency and a flush-to-remote operation (hflush). S3 supports neither of those things and HDFS is not the

Log user name in the hive-server2 logs?

(This is for hive 1.2.x) I noticed in places like ParseDriver.java, LOG.info("Parsing command: " + command); It does not log the user who submitted the query. Just wonder if there is any setting that allows me to log the user name as well? Thanks! Kaidi

Re: Hive storm streaming with s3 file system

So transactional tables only work with hdfs. Thanks for the confirmation Elliot. On Tue, Jun 12, 2018 at 10:25 PM, Elliot West wrote: > I don't not believe that S3 is currently a supported filesystem for > transactional tables. I believe there are plans to make this so. > > On 12 June 2018 at

Re: Hive storm streaming with s3 file system

I don't not believe that S3 is currently a supported filesystem for transactional tables. I believe there are plans to make this so. On 12 June 2018 at 17:50, Abhishek Raj wrote: > Hi. I'm using HiveBolt from Apache Storm to stream >

Re: Hive storm streaming with s3 file system

Hi. I'm using HiveBolt from Apache Storm to stream data into a transactional hive table. It works great when the table is backed by hdfs, but starts throwing error when the location

[no subject]

Hi Guys, I have 4datanodes and one master node EMR cluster with 120GB data storage left. I have been running sqoop jobs which loads data to hive table. After some jobs ran successfully I suddenly see these errors all over the name node logs and datanodes logs. I have tried changing so many

Re: issues with Hive 3 simple sellect from an ORC table

This is a diff file that let me compile Hive 3.0 on Hadoop 2.8.0 (and also run it on Hadoop 2.7.x). diff --git a/pom.xml b/pom.xml index c57ff58..8445288 100644 --- a/pom.xml +++ b/pom.xml @@ -146,7 +146,7 @@ 19.0 2.4.11 1.3.166 -3.1.0 +2.8.0

CachedStore for hive.metastore.rawstore.impl in Hive 3.0

Hello Hive users, I am experience a problem with MetaStore in Hive 3.0. 1. Start MetaStore with hive.metastore.rawstore.impl=org.apache.hadoop.hive.metastore.ObjectStore. 2. Generate TPC-DS data. 3. TPC-DS queries run okay and produce correct results. E.g., from query 1: +---+

Re: Which version of Hive can hanle creating XML table?

*Apologies, here is the link to the product: https://sonra.io/flexter-for-xml/ * *and how it can be used with Hive: https://sonra.io/2018/01/27/converting-xml-hive/ * On Mon, Jun 11, 2018 at 5:46 PM, Mich