[DISCUSS] Writing Fast Vectorized UDFs

2016-09-06 Thread Gopal Vijayaraghavan
Hi, I'm writing this because I realize this stuff needs users to comment on before it gets set into an ABI release. Hive 2.2.0 will check if a user's UDF has a vectorized version before wrapping it row-by-row. @VectorizedExpressions(value = { VectorStringRot13.class })

Re: Write access to the Hive wiki

2016-09-06 Thread Marta Kuczora
Hi Lefty, thanks a lot. Regards, Marta On Fri, Sep 2, 2016 at 7:29 AM, Lefty Leverenz wrote: > Done. Welcome to the Hive wiki team, Marta! > > -- Lefty > > > On Thu, Sep 1, 2016 at 8:13 AM, Marta Kuczora > wrote: > >> Sorry, forgot to write my

Write access to wiki

2016-09-06 Thread Zsombor Klara
Hi, I would like to have write access to the hive wiki. My username is zsombor.klara. Thanks, Zsombor

HCatStorer appends, but not overwrites

2016-09-06 Thread Artur Sukhenko
Hi, While loading data in hive from pig using HCatalog the data is getting appended instead of overwritten, however documentation states otherwise: "You can write to a non-partitioned table simply by using HCatStorer. The contents of the table will be overwritten:"

RE: Beeline throws OOM on large input query

2016-09-06 Thread Markovitz, Dudu
Hi Adam Are you familiar with MBR (Minimum Bounding Rectangle) and tessellations technics? You might be able to significantly reduce the number of potentially intersected polygons. Dudu From: Adam [mailto:work@gmail.com] Sent: Sunday, September 04, 2016 4:07 AM To: user@hive.apache.org

Re: hive.root.logger influencing query plan?? so it's not so

2016-09-06 Thread Gopal Vijayaraghavan
> another case of a query hangin' in v2.1.0. I'm not sure that's a hang. If you can repro this, can you please do a jstack while it is "hanging" (like a jstack of hiveserver2 or cli)? I have a theory that you're hitting a slow path in HDFS remote read because of the following stacktrace.

Re: Re:CREATE FUNCTION ERROR: does not have following privileges for operation CREATEFUNCTION

2016-09-06 Thread Jason Dere
Can you create the functions as permanent functions once, so you don't have to create temp functions every time? https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-Create/Drop/ReloadFunction? From: Maria

Re: Beeline throws OOM on large input query

2016-09-06 Thread Gopal Vijayaraghavan
> 1) confirm your beeline java process is indeed running with expanded memory The OOM error is clearly coming from the HiveServer2 CBO codepath post beeline. at org.apache.calcite.rel.AbstractRelNode$1.explain_(AbstractRelNode.java:409) at

Re: Write access to wiki

2016-09-06 Thread Lefty Leverenz
You've got it. Welcome to the Hive wiki team, Zsombor! -- Lefty On Tue, Sep 6, 2016 at 9:59 AM, Zsombor Klara wrote: > Hi, > > I would like to have write access to the hive wiki. My username is > zsombor.klara. > > Thanks, > Zsombor >

load data Failed with exception java.lang.IndexOutOfBoundsException

2016-09-06 Thread
hi, Can anybody reproduce following error : ( My env is hadoop2.7.2 and hive2.01) create external table ods.loadtest ( c1 string ) location '/tmp/loadtest'; LOAD DATA LOCAL INPATH '1.dat' overwrite INTO TABLE ODS.loadtest; Loading data to table ods.loadtest Failed with exception