About the hive python client pyhs2

Hello ! I contact you because I have a question related to interact with hive with python. The python client pyhs2 is recommended on the apache site : https://cwiki.apache.org/confluence/display/Hive/Setting+Up+HiveServer2#SettingUpHiveServer2-PythonClientDriver I was wondering if I can use it o

Mechanism when doing a select *

Hello guys ! I'm trying to understand the mechanism for a simple query select * from my_table when using HiveServer2. I'm using the hortonworks ODBC Driver for HiveServer2. I just do a select * from my_table. my_table is an ORC table based on files divised into blocks located on all my datanodes.

Re: How to work around non-executive /tmp with Hive in Parquet+Snappy compression?

Hey ! Are you talking about the hdfs /tmp or the local FS /tmp ? For the HDFS one, I think it should be the property : hive.exec.scratchdir For the local, I think it should be the property : hive.exec.local.scratchdir BR Tale On Sat, Mar 19, 2016 at 8:46 PM, Rex X wrote: > The local /tmp is

Re: Mechanism when doing a select *

gt; Dr Mich Talebzadeh > > > > LinkedIn * > https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* > > > > http://talebzadehmich.wordpress.com > > &

Re: Mechanism when doing a select *

dIn * > https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* > > > > http://talebzadehmich.wordpress.com > > > > On 21 March 2016 at 15:32, Tale Firefly wrote: > &g

Re: Mechanism when doing a select *

Oh my bad, even with the execution engine set to MR, my query turns into a MR job. I'm gonna make more tests with Hive CLI and beeline, and excel to check if this behaviour is linked to the ODBC driver. BR. Tale. On Mon, Mar 21, 2016 at 4:56 PM, Tale Firefly wrote: > Hm, I need to

Re: Mechanism when doing a select *

ile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > <https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw>* > > > http://talebzadehmich.wordpress.com > > > > On 21 March 2016 at 15:56, Tale Firefly wrote: > >> Hm, I need to check if s

High-Availbility of HiveServer2 and different transport modes

Hello ! I send you this mail because I have a cluster with multiple servers, with among them four edge servers hosting each one of them an hiveserver2 : On two of them, there are HiveServer2 using HTTP as transport mode. On the other two, there are HiveServer2 using Thrift as transport mode. My

Re: Mechanism when doing a select *

treshhold, is there a risk my HS2 crash because the result is too big ? Best regards. Tale On Tue, Mar 22, 2016 at 10:21 AM, Tale Firefly wrote: > Hello everyone. > > Thanks for your answers. > > I'm gonna test this. > > Best regards. > > Tale > > > >

HiveServer2 - Serious problem - Permission denied with another user than the one I am using

Hello ! I send you this mail because I have a problem with a table in Hive through HiveServer2 (HTTP or thrift). I'm using an HDP 2.3.2 with Hive 1.2.1. The problem is the following. I have the following table : ### CREATE TABLE `mytable`( `field1` timestamp, `field2` string, `field

Error message "Read past end of RLE integer from compressed stream Stream for column"

Hello ! I have an HDP 2.2.4.2.(it has normally hive 0.14.0). I have a ORC table with multiple fields : ### CREATE TABLE `table1`( `field1` varchar(10), `field2` varchar(10), `field3` date, `field4` varchar(8), `field5` varchar(64) PARTITIONED BY ( `year` string, `month` string, `d

Hive query fails with error "expecting dummy store operator but found: FS[26]"

Hello ! I send you this mail because I perform an hive query with Tez and it fails with a strange error : The error is like this : ### ERROR : Vertex failed, vertexName=Reducer 2, vertexId=vertex_1473870963805_157168_11_02, diagnostics=[Task failed, taskId=task_1473870963805_157168_11_02_35,

Re: hiveserver2 oom

Hey Sanjeev. Can you put the /tmp/hive/hive.log (on the hvevserver2 host) when you launch the query ? Best regards. Tale On Thu, Sep 22, 2016 at 5:03 AM, Sanjeev Verma wrote: > lowered 1073741824 to half of it but still getting the same issue. > > On Wed, Sep 21, 2016 at 6:44 PM, Sanjeev Verm