Re: use jdbc connect to hive2.0

2016-05-04 Thread kevin
*Thanks* ,Thejas Nair. It's work. 2016-05-04 15:40 GMT+08:00 Thejas Nair : > The property should be named hadoop.proxyuser.dcos.groups and > hadoop.proxyuser.dcos.groups if you are running HS2 as user dcos. > Also, user dcos should belong to the group dcos if that setting

CDH 5.7 Hive crash when performing a join on a parquet external table

2016-05-04 Thread Nicholas Hakobian
Has anyone else encountered issues when using a partitioned Parquet external tables in Hive on CDH 5.7 (Hive is running in map reduce mode) ? When I perform a simple query such as (I've removed any names/fields that I am not allowed to publicly share): select * from user_event left join names on

Spark Streaming, Batch interval, Windows length and Sliding Interval settings

2016-05-04 Thread Mich Talebzadeh
Hi, Just wanted opinions on this. In Spark streaming the parameter val ssc = new StreamingContext(sparkConf, Seconds(n)) defines the batch or sample interval for the incoming streams In addition there is windows Length // window length - The duration of the window below that must be multiple

RE: Unsupported SubQuery Expression '1': Only SubQuery expressions that are top level conjuncts are allowed

2016-05-04 Thread Markovitz, Dudu
Hi The syntax is not Hive specific but SQL ANSI/ISO. In a series of “JOIN … ON …” any “ON” can (but not necessarily have to) refer any of its preceding tables, e.g. – select … from t1 join t2 on … *1 … join t3 on … *2 … join t4 on … *3 … *1 The 1st “ON” can refer tables t1 & t2 *2 The

Re: Unsupported SubQuery Expression '1': Only SubQuery expressions that are top level conjuncts are allowed

2016-05-04 Thread mahender bigdata
Thanks Dudu, Can you help me in parsing below logic, I see First you are starting join of table1 with result set of Group by > 1 and perform left join with table2, how can we get reference a. alias of joined result or will hive pickup "a" column from table 1 and 3 column in table2. thanks

Re: use jdbc connect to hive2.0

2016-05-04 Thread Thejas Nair
The property should be named hadoop.proxyuser.dcos.groups and hadoop.proxyuser.dcos.groups if you are running HS2 as user dcos. Also, user dcos should belong to the group dcos if that setting is to work. I assume you are trying to have hive.server2.enable.doAs=true. I am not sure why you are

Re: use jdbc connect to hive2.0

2016-05-04 Thread kevin
I found hadoop info is :2016-05-04 13:49:33,785 INFO org.apache.hadoop.ipc.Server: Socket Reader #1 for port 9000: readAndProcess from client 10.1.3.120 threw exception [org.apache.hadoop.security.authorize.AuthorizationException: User: dcos is not allowed to impersonate dcos] and when I trun to