Re: Query result cache size

hive.query.results.cache.max.size is the limit per HS2 instance. hive.query.results.cache.max.entry.size is the limit for a single query result. On Mon, Jun 3, 2019 at 8:24 AM Kristopher Kane wrote: > 'hive.query.results.cache.max.size' - Is this limit per query result, > total for all users ac

Re: Hive Custom UDF evaluate behavior when @UDFType is set

taking in parameters based on the table's column values (then no constant propagation). From: PradeepKumar Yadav Sent: Sunday, May 13, 2018 11:44 PM To: Jason Dere; user@hive.apache.org Subject: RE: Hive Custom UDF evaluate behavior when @UDF

Re: Hive Custom UDF evaluate behavior when @UDFType is set

xception("initialize"); From: PradeepKumar Yadav Sent: Monday, April 16, 2018 4:53 AM To: user@hive.apache.org Cc: Jason Dere Subject: FW: Hive Custom UDF evaluate behavior when @UDFType is set Hi, Regarding the previous mail sent, I have attached following

Re: Hive Custom UDF evaluate behavior when @UDFType is set

Might have to do with constant propagation because the function was listed as deterministic. You can try logging the stack trace during execution and pasting both stack traces here, may help give more clues as to what is going on. From: PradeepKumar Yadav Sent:

Re: compilation errors on hive for hadoop-3.0.0

It looks like hadoop-3.0.0-beta1 may no longer be available, my copy in ~/.m2 looks like it's from last November. The hadoop version should be changed in the hive build. In the meantime you can try building with hadoop 3.0.0, either by changing hadoop.version in your pom.xml or by adding -Dhad

Re: ORC ACID table returning Array Index Out of Bounds

I've opened HIVE-18817 for this.​ From: Aviral Agarwal Sent: Thursday, February 15, 2018 6:11 PM To: user@hive.apache.org Subject: Re: ORC ACID table returning Array Index Out of Bounds Hive version is 1.2.1000.

Re: Using JAR files located on HDFS for SerDe

There is an existing Jira to be able to specify the necessary JARs in the CREATE TABLE command, but this is not in yet - HIVE-9252 From: Jörn Franke Sent: Wednesday, April 12, 2017 8:04 AM To: user@hive.apache.or

Re: Seems I found a bug (Partitioned Field)

I think this may be https://issues.apache.org/jira/browse/HIVE-14995? From: balajee venkatesh Sent: Sunday, February 05, 2017 8:14 AM To: user@hive.apache.org Subject: Seems I found a bug (Partitioned Field) Hi there, In case data type of partitioning field is

Re: Usage of complex types

> SELECT array(1, 2) a UNION ALL SELECT NULL; Error: Error while compiling statement: FAILED: SemanticException Schema of both sides of union should match: Column a is of type array on first table and type void on second table. Cannot tell the position of null AST. (state=42000,code=4) Mig

Re: beeline null pointer exception

You probably need to take a look at the HiveServer2 logs which might have a stack trace for that error. From: Brotanek, Jan Sent: Friday, December 16, 2016 1:05 PM To: user@hive.apache.org Subject: beeline null pointer exception Hello, I have problem executing

Re: hive2.1.0 timestamp

Looks like this might be HIVE-15291. From: ? ? Sent: Wednesday, November 23, 2016 6:59 PM To: user@hive.apache.org Subject: hive2.1.0 timestamp Hi: I am using hive2.1 and hava a problem.I have a table 'xp' which contains a timestamp field 'createdate'.When I

Re: load data Failed with exception java.lang.IndexOutOfBoundsException

Is there a related stack trace in the hive.log? From: ? Sent: Tuesday, September 06, 2016 8:38 PM To: user@hive.apache.org Subject: load data Failed with exception java.lang.IndexOutOfBoundsException hi, Can anybody reproduce following error : ( My env is hadoo

Re: Re:CREATE FUNCTION ERROR: does not have following privileges for operation CREATEFUNCTION

Can you create the functions as permanent functions once, so you don't have to create temp functions every time? https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-Create/Drop/ReloadFunction? From: Maria Sent: Friday, Septembe

Re: Where are jars stored for permanent functions

Hive doesn't currently handle storing of the JARs. Doing ADD JAR only adds the jars to the current session, but won't help for other sessions. The permanent functions syntax allows you to specify JAR paths when you create the function. These should be on HDFS or other non-local path. create fu

Re: hive with ua paser (external) library gives IOException

at 1:44 PM, Jason Dere mailto:jd...@hortonworks.com>> wrote: Maybe check the Hive logs or the Hadoop logs of the tasks that were started by the query. Looks like that error happens when an exception is hit while trying to invoke the UDF, it might be logged somewhere.

Re: hive with ua paser (external) library gives IOException

Maybe check the Hive logs or the Hadoop logs of the tasks that were started by the query. Looks like that error happens when an exception is hit while trying to invoke the UDF, it might be logged somewhere. From: dhruv kapatel Sent: Friday, April 15, 2016 3:36

Re: [VOTE] Bylaws change to allow some commits without review

?+1 From: Lefty Leverenz Sent: Friday, April 15, 2016 1:36 AM To: user@hive.apache.org Subject: Re: [VOTE] Bylaws change to allow some commits without review +1 Navis, you've just reactivated your PMC membership. ;-) A PMC member is considered emeritus by thei

Re: Hive UDF to fetch value from distributed cache not working with outer queries

?You might be using the wrong path to reference the distributed cache - I was under the impression that the distributed cache files would accessible using a local path not something starting with '/'. I suspect query 1 is working because fetch task conversion is running the select in a local ta

Re: Hive 0.12 MAPJOIN hangs sometimes

A join between bigint and string might actually be evaluated by converting both values to a double .. try doing an EXPLAIN of the query, that might show what conversion is being done for the join keys. If that is the case, you could try explicitly casting the join keys to either string or bigin

Re: Hive Permanent functions not working after a cluster restart.

Yeah it looks like 1.1.0+cdh5.4.3+151 backported HIVE-2573, which has the bug you are seeing (fixed in HIVE-10288). From: Chagarlamudi, Prasanth Sent: Thursday, February 11, 2016 2:07 PM To: user@hive.apache.org

Re: Hive Permanent functions not working after a cluster restart.

n from a new cli. It only return the attached error when the hive server or cluster is restarted. Also it’s a cloudera distribution and version is 1.1.0+cdh5.4.3+151. Not sure if this will make any difference. Thanks Prasanth Chagarlamudi From: Jason Dere [mailto:jd...@hortonworks.com] Sent:

Re: Hive Permanent functions not working after a cluster restart.

AM To: user@hive.apache.org Subject: RE: Hive Permanent functions not working after a cluster restart. Hey Jason, Its 1.1.0. Thank you for your time. Prasanth Chagarlamudi From: Jason Dere [mailto:jd...@hortonworks.com] Sent: Monday, February 08, 2016 1:04 PM To: user@hive.apache.org Subject: Re

Re: Hive Permanent functions not working after a cluster restart.

What version of Hive? From: Chagarlamudi, Prasanth Sent: Monday, February 08, 2016 7:38 AM To: user@hive.apache.org Subject: Hive Permanent functions not working after a cluster restart. I created permanent functions(rather than temp functions) in Hive to use it

Re: GenericUDF

orary function in the query. Can you put some more light on the call flow to the initialize method.? Regards, Anirudh Paramshetti On Wed, Feb 3, 2016 at 6:08 AM, Jason Dere mailto:jd...@hortonworks.com>> wrote: - Created once when registering the function to the FunctionRegistry. - The UD

Re: GenericUDF

- Created once when registering the function to the FunctionRegistry. - The UDF is copied from the version in the registry during query compilation - The query plan is serialized, then deserialized by the tasks during query execution, which constructs another instance of the UDF.

Re: Metastore and SerDe jars

I think this is still an outstanding issue. Couple of (still open) Jiras relating to solutions for this: https://issues.apache.org/jira/browse/HIVE-9252? https://issues.apache.org/jira/browse/HIVE-6343 From: Andy Srine Sent: Wednesday, December 09, 2015 1:33

Re: timestamp to date conversion

Can you get the full stack trace for this error? If this is HiveCLI you can get this from hive.log, if hiveserver2 you might be able to find this in the hiveserver2 log. ?What version of Hive? From: murali parimi Sent: Monday, November 02, 2015 11:15 AM To: u

Re: Disabling local mode optimization

Take a look at fetch.task.conversion in https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties? From: Daniel Haviv Sent: Monday, November 02, 2015 1:16 AM To: user@hive.apache.org Subject: Re: Disabling local mode optimization Hi, I'm trying

Re: Hive Generic UDF invoking Hbase

Not totally familiar with the aux jars property .. does that make sure that the JAR is shipped as part of the MR job? If it does not, you could try adding the necessary jars using ADD JAR to see if that is the issue From: Yogesh Keshetty Sent: Wednesday, Septe

Re: Hive Generic UDF invoking Hbase

So your custom UDF is using org.apache.hadoop.hbase.client.HTable​? How do you resolve your UDF JAR (and this class) on the Hive client - are you doing ADD JAR, or are your UDF JARs and HBase JARs in your Hive class path? ​ From: Ryan Harris Sent: Wednesday, Se

Re: Hive Generic UDF invoking Hbase

Take a look at hive.fetch.task.conversion in https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties?, try setting to "none" or "minimal" From: Ryan Harris Sent: Wednesday, September 30, 2015 9:19 AM To: user@hive.apache.org Subject: RE: Hive

Re: binary column data consistency in hive table copy

Looks like your table is using text storage format. Binary data needs to be stored as base64 in TextInputformat, so those values are probably being interpreted as base64 strings. From: Ujjwal Wadhawan Sent: Monday, September 14, 2015 2:32 PM To: user@hive.apach

Re: Starting Hive Thrift Server

Pretty sure those are just warning messages: http://stackoverflow.com/questions/22896243/maven-slf4j-class-path-contains-multiple-slf4j-bindings Try to connect to your server and see if it's working. ? From: Paulo Moniz Sent: Wednesday, September 09, 2015 5:1

Re: UDF Configure method not getting called

without using UDF's at all? I looked at transformation scripts a while back but I don't think those would work for our use case either. On Tue, Aug 25, 2015 at 5:05 PM, Jason Dere mailto:jd...@hortonworks.com>> wrote: For getting the configuration without configure(), this may

Re: UDF Configure method not getting called

a map reduce job via hive, as the processing is fairly compute extensive. Is there a way to force map-reduce jobs? I think hive.fetch.task.conversion to minimal might help, is there anything that can be done? Thanks a ton. On Tue, Aug 25, 2015 at 2:36 PM, Jason Dere mailto:jd...@hortonworks.com

Re: UDF Configure method not getting called

?There might be a few cases where a UDF is executed locally and not as part of a Map/Reduce job?: - Hive might choose not to run a M/R task for your query (see hive.fetch.task.conversion) - If the UDF is deterministic and has deterministic inputs, Hive might decide to run the UDF once to get

Re: Running hive on tez locally

16 PM, Jason Dere mailto:jd...@hortonworks.com>> wrote: If you add these settings (paths are up to you), you can run Hive with Tez in local mode. You'll also need to make sure your classpath has the Tez libs etc. set hive.user.install.directory=file:///tmp; set fs.default.name<htt

Re: Running hive on tez locally

If you add these settings (paths are up to you), you can run Hive with Tez in local mode. You'll also need to make sure your classpath has the Tez libs etc. set hive.user.install.directory=file:///tmp; set fs.default.name=file:///; set fs.defaultFS=file:///; set tez.staging-dir=/tmp; set tez.ign

Re: NPE error during file sink stage when inserting into bucketed table

Got a stack trace? Might help someone identify the issue. From: Muni Chada Sent: Thursday, August 06, 2015 4:12 PM To: user@hive.apache.org Subject: NPE error during file sink stage when inserting into bucketed table Hi, We are on hive 0.14 and running into NPE

Re: UDTF fails with java.lang.ClassCastException

Would have to look at the UDTF to know for sure what is going on - it might not be using the object inspectors properly here. Is it using the ObjectInspectors that were passed in during initialize(), or is it creating a WritableStringObjectInspector and assuming this will work with the value ob

Re: Hive metastore using Oracle

Looks like it's having trouble with the hive.exec.local.scratchdir setting (which defaults to "${system:java.io.tmpdir}/${system:user.name}"). Is variable substitution disabled (hive.variable.substitute)? You might want to try explicitly setting hive.exec.local.scratchdir when running on the co

Re: Alter table statement for "create table like"-tables

Probably has to do with the fact that it is an Avro table. I don't have any experience using Avro, but maybe take a look at https://issues.apache.org/jira/browse/HIVE-7446 for some of the issues described there, or maybe look at the test that was added for that Jira. On Jun 16, 2015, at 2:42

Re: hive udf from oozie not working

Do you have a full stack trace here? Also what Hive/Hadoop versions? It looks like Hive somehow thinks that the local copy of the JAR that was downloaded (/tmp/f5dc5d85-903e-422d-af1a-892b994ecfda_resources/hive-udf.jar) is an HDFS path for some reason, and the the distributed cache is trying to

Re: Hive : plan serialization format option

you see any issues." is this issue resolved in hive 0.14 ? On Tue, May 5, 2015 at 11:36 PM, Jason Dere mailto:jd...@hortonworks.com>> wrote: Looks like you are running into https://issues.apache.org/jira/browse/HIVE-8321, fixed in Hive-0.14. You might be stuck having to use Kryo, w

Re: Can't access file in Distributed Cache in Hive 1.1.0

Is this on Hive CLI, or using HiveServer2? Can you run "explain select in_file('a', './testfile') from a;" from both Hive 1.0.0 and hive 1.1.0 and see if they look different? One possibile thing that might be happening here is that in Hive-1.1.0, this query is being executed without the need for

Re: Hive : plan serialization format option

turn code 1 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask On Tue, May 5, 2015 at 3:10 PM, Jason Dere mailto:jd...@hortonworks.com>> wrote: kryo/javaXML are the only available options. What are the errors you see with each setting? On May 1, 2015, at 9:41 AM, Bhagwan S. Soni mailto:bhgwnsson...@

Re: Hive : plan serialization format option

kryo/javaXML are the only available options. What are the errors you see with each setting? On May 1, 2015, at 9:41 AM, Bhagwan S. Soni mailto:bhgwnsson...@gmail.com>> wrote: Hi Hive Users, I'm using cloudera's hive 0.13 version which by default provide Kryo plan serialization format. hive

Re: UDF cannot be found when the query is submitted via templeton

Does fully qualifying the function name (HiveUDF.FindPattern()) in the query help here? On Apr 17, 2015, at 6:44 AM, Xiaoyong Zhu mailto:xiaoy...@microsoft.com>> wrote: Hi experts I am trying to use an UDF (I have already put that in the metastore using CREATE FUNCTION) as following. select

Re: Any getting-started with UDAF development

I think the Java code is likely still fine for the examples (though someone who actually knows about UDAFs might want to correct me here). If anything is out of date, it would be the build/test commands, which have switched from using ant to maven. Jason On Mar 11, 2015, at 4:01 AM, shahab mai

Re: casting of hour and minute addition issue

I believe this is due to https://issues.apache.org/jira/browse/HIVE-9278, which has been fixed in trunk (also 1.0). This affects UDFs using the old-style UDF classes (which include hour()/minute()/second()) A workaround is to do "set hive.cache.expr.evaluation=false;" before running the query.

Re: Create Function using JDBC Client ( All Databases)

You can call a function created in another database by using the fully qualified function name - select db_name.function_name(…) from … This is similar to referencing tables from other databases in your query. On Feb 17, 2015, at 8:03 PM, vengatesh.babu mailto:vengatesh.b...@zohocorp.com>> wrot

Re: Unable to retrieve date

to_date() expects a string like '2014-12-07 23:59:04' rather than '07-Dec-2014 23:59:04' On Jan 29, 2015, at 1:42 AM, Nagarjuna Vissarapu wrote: > Hi All, > > I wrote hive UDF to convert > > 07/Dec/2014:23:59:04 to 07-Dec-2014 23:59:04 > > I attached UDF. PFA ... > > I added jar to hiv

Re: EXIST vs EXISTS keyword?

Doing a quick search in the lexer/parser files (*.g), I only see KW_EXISTS and not KW_EXIST. On Jan 22, 2015, at 1:25 AM, Xiaoyong Zhu wrote: > Hello experts > > I am wondering when the keyword “EXIST” will be used in Hive – and if it is > used, then what’s the difference between EXIST and

Re: show create table issue

Looks like this is https://issues.apache.org/jira/browse/HIVE-7270, which has only recently been committed. On Jan 18, 2015, at 10:32 PM, AnilKumar B wrote: > Hi All, > > We have observed that "show create table " is not providing the information > on serde's. Is it a bug or intention? > > d

Re: date_add statement problem

Devopam is right, your date format looks wrong (should be -mm-dd rather than /mm/dd. Casting should work, trying this with Hive trunk: hive> select c1, date_add('1985-01-01', c1) from short1; FAILED: SemanticException [Error 10014]: Line 1:11 Wrong arguments 'c1': DATE_ADD() only takes

Re: Hive Query o/p to HDFS as CSV file

A workaround might be to create an external table with the correct format, insert overwrite into the external table, then drop the external table (which I think shouldn't delete the directory) On Jan 9, 2015, at 5:46 AM, vengatesh.babu wrote: > Hi, > > How to write Hive query output to HDFS

Re: CREATE FUNCTION: How to automatically load extra jar file?

ace for Hive jobs > > > > > Will this related to configuration issue or a bug? > > Please help! > > Regards > Arthur > > > On 6 Jan, 2015, at 3:45 am, Jason Dere wrote: > >> During query compilation Hive needs to instantiate the UDF class and

Re: CREATE FUNCTION: How to automatically load extra jar file?

oes not exist on the local file system. >> >> >> Is there a way to set the another “tmp" folder for HIVE? or any suggestions >> to fix this issue? >> >> Thanks !! >> >> Arthur >> >> >> >> On 3 Jan, 2015, at

Re: Custom UDF Not Working Properly

The steps you've described sound correct. Do you have a small example (tables, data, query) to demonstrate the problem? On Dec 25, 2014, at 12:03 AM, vengatesh.babu wrote: > Hi, > > Please tell me steps to be followed to add Custom UDF in Hive 0.14 Source > Code. > > Thanks > Vengatesh Bab

Re: CREATE FUNCTION: How to automatically load extra jar file?

The point of USING JAR as part of the CREATE FUNCTION statement to try to avoid having to do ADD JAR/aux path stuff to get the UDF to work. Are all of these commands (Step 1-5) from the same Hive CLI prompt? >> hive> CREATE FUNCTION sysdate AS 'com.nexr.platform.hive.udf.UDFSysDate' >> using J

Re: Hive 0.14 SQL Inserts Complex Data Types

There are UDFs to create complex types, would something like this work? INSERT .. VALUES select map('key1', 'val1', 'key2', 'val2'); On Dec 19, 2014, at 8:50 AM, Skyler Beckman wrote: > Thanks > > From: Alan Gates [mailto:ga...@hortonworks.com] > Sent: Friday, December 19, 2014 11:35 AM

Re: Hive UDFs?

Another option is https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL#LanguageManualDDL-PermanentFunctions, as another user mentioned on this list a few days ago. On Dec 18, 2014, at 5:54 AM, Stéphane Verlet wrote: > You only need the jar on the computer where you execute the h

Re: Question on varchar in 0.12.0 version of nive

Varchar was only added to Hive in 0.12, before that there was only string if you wanted to deal with string types. Varchar will enforce the max character length, truncating the string value if necessary. We've tried to make it as compatible with string as possible. One thing about varchars, if y

Re: Issue with windowing function UDAF registeration

Created HIVE-9073 (with patch) for this. On Dec 4, 2014, at 3:40 PM, Jason Dere wrote: > Hi Wesley, > > Sorry for the late response on this .. is it true you saw this work on a > different version (later) of Hive? Based on what I think should be the > problem, this would still

Re: [ANNOUNCE] New Hive PMC Member - Prasad Mujumdar

Congrats! On Dec 9, 2014, at 3:02 PM, Venkat V wrote: > Congrats Prasad! > > On Tue, Dec 9, 2014 at 2:32 PM, Brock Noland wrote: > Congratulations Prasad!! > > On Tue, Dec 9, 2014 at 2:17 PM, Carl Steinbach wrote: > I am pleased to announce that Prasad Mujumdar has been elected to the Hive

Re: Issue with windowing function UDAF registeration

Hi Wesley, Sorry for the late response on this .. is it true you saw this work on a different version (later) of Hive? Based on what I think should be the problem, this would still be an issue in later versions of Hive. Looks like the error may be occurring because the Hive is trying to look up

Re: from_unixtime() and epoch definition

That would be great! On Nov 5, 2014, at 10:49 PM, Nitin Pawar wrote: > May be a JIRA ? > > I remember having my own UDF for doing this. If possible I will share the > code > > On Thu, Nov 6, 2014 at 6:22 AM, Jason Dere wrote: > Hive should probably at least provide

Re: from_unixtime() and epoch definition

; Would be really nice if Hive offers some elegant way to support this. > I'm thinking of similar ALTER SESSION statement equivalent, maybe parameter > SET in hive or extra parameter for the from_unixtime() Hive function? > > On Mon, Nov 3, 2014 at 10:33 PM, Jason Dere wrote

Re: from_unixtime() and epoch definition

As Nitin mentions, the behavior is "to a string representing the timestamp of that moment in the current system time zone". What are the timezone settings on your machine? $ TZ="GMT" date -r 0 Thu Jan 1 00:00:00 GMT 1970 $ TZ="UTC" date -r 0 Thu Jan 1 00:00:00 UTC 1970 $ TZ="Europe/London

Re: [ANNOUNCE] New Hive PMC Member - Alan Gates

Congrats Alan! On Oct 27, 2014, at 3:45 PM, "Prasanth Jayachandran" wrote: > Congrats! > > - Prasanth > > > On Mon, Oct 27, 2014 at 3:44 PM, Matthew McCline > wrote: > > Congratulations! > > On Mon, Oct 27, 2014 at 3:38 PM, Carl Steinbach wrote: > > > I am pleased to announce that Al

Re: String to Timestamp conversion bug

1 23:59:59" )); > on both 1.7 and 1.6 version and it works in both cases. > > On Wed, Sep 10, 2014 at 10:12 PM, Jason Dere wrote: > Hmm that's odd .. it looks like this works for me: > > hive> select cast('2999-12-31 23:59:59' as timestamp); &

Re: Error in running udf that interacts with hive jdbc client

It looks like the issue is here at the bottom of the list of stack traces, where it can't resolve the HiveDriver class. I think only hive-exec.jar is shipped as part of a map/reduce job, you would have to make sure hive-jdbc is in the class path during the map/reduce jobs. Are you sure your UDF

Re: Unxpected exception: Unxpected exception: org.apache.hadoop.io.LongWritable cannot be cast to java.lang.Long

What does your GenericUDF look like? What version of Hive? Does the query work without the UDF? On Sep 22, 2014, at 3:28 PM, Dan Fan wrote: > Dear hive users: > > Quick question about hive longwritable convert to long. > I have a generic udf called protected_column, which works well as follo

Re: UDF for MONTHS_BETWEEN

I don't think there such a function yet in Hive. On Sep 19, 2014, at 2:23 PM, Binal Jhaveri wrote: > > Is there currently a Hive UDF to mimic the Oracle function MONTHS_BETWEEN?? > -- CONFIDENTIALITY NOTICE NOTICE: This message is intended for the use of the individual or entity to which i

Re: String to Timestamp conversion bug

Hmm that's odd .. it looks like this works for me: hive> select cast('2999-12-31 23:59:59' as timestamp); OK 2999-12-31 23:59:59 Time taken: 0.212 seconds, Fetched: 1 row(s) For string to timestamp conversion, it should be using java.sql.Timestamp.valueOf(). What version of jvm are you using?

Re: Best way to add custom UDF jar in HiveServer2

If you have a recent version of Hive (0.13+), you could try registering your UDF as a "permanent" UDF which was added in HIVE-6047: 1) Copy your JAR somewhere on HDFS, say hdfs:///home/nirmal/udf/hiveUDF-1.0-SNAPSHOT.jar. 2) In Hive, run CREATE FUNCTION zeroifnull AS 'com.test.udf.ZeroIfNullUDF

Re: varchar

What version of Hive? Do you have some sample SQL? On Aug 26, 2014, at 1:20 PM, upd r wrote: > Hi, > > I have a created a table with fields defined as varchar(length). Is it > correct to insert data in to the table casting the fields as VARCHAR(length). > > I am getting this error. > Error o

Re: UDF with dependent JARs

Does the order that you add the JARs in Hive matter - say adding b.jar first, then a.jar? On Aug 2, 2014, at 4:47 AM, Brian Jeltema wrote: > I've written a small UDF and placed it in a JAR (a.jar). > > The UDF has a dependency on a class in another JAR (b.jar). > > in Hive, I do: > > add

Re: FAILED: ClassCastException org.apache.hadoop.io.Text cannot be cast to java.lang.String

Would probably have to see the whole code of your evaluate() function. Is this while trying to use treat the arguments to the UDF as a String object? It was probably passed into the GenericUDF as a Text object (Hadoop Writable version of string type), not a String object. It would have to be conv

Re: hive udf cannot recognize generic method

Sounds like you are using the older style UDF class. In that case, yes you would have to override evaluate() for each type of input. You could also try overriding the GenericUDF class - that would allow you to do a single method, though it may be a bit more complicated (can look at the Hive cod

Re: UDTF

Looking at call hierarchy in Eclipse: initiaize(): org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genUDTFPlan(GenericUDTF, String, ArrayList, QB, Operator, boolean) org.apache.hadoop.hive.ql.exec.UDTFOperator.initializeOp(Configuration) process(): org.apache.hadoop.hive.ql.exec.UDTFOperator.

Re: Issue while running Hive 0.13

Looking at that error online, I see http://slf4j.org/faq.html#compatibility Maybe try to find what version of the slf libraries you have installed (in hadoop? hive?), and try updating to later version. On Jul 10, 2014, at 9:57 PM, Sarath Chandra wrote: > I'm using Hadoop 1.0.4. Suspecting so

Re: [ANNOUNCE] New Hive Committers - Gopal Vijayaraghavan and Szehon Ho

Congrats! On Jun 23, 2014, at 10:28 AM, Hari Subramaniyan wrote: > congrats to Gopal and Szehon! > > Thanks > Hari > > > On Mon, Jun 23, 2014 at 9:59 AM, Xiaobing Zhou > wrote: > >> Congrats! >> >> >> >> On Mon, Jun 23, 2014 at 9:52 AM, Vaibhav Gumashta < >> vgumas...@hortonworks.com >>

Re: Hive UDF error

What version of Hive are you running? It looks like the error you're seeing might be from Hive trying to retrieve the error message from the logs and might not be related to the actual error. Might want to check the logs for the Hadoop task that was run as part of this query, to see if that ha

Are these SerDe's/InputFormats still being used?

Looking into some code cleanup and question of these SerDes/InputFormats came up. Are these still ones that are being used by folks? DynamicSerDe SymlinkTextInputFormat If there is not much usage then we could try to set them as deprecated, so they could be removed in a future release. Thank

Re: UDFs in Beeline w/ Hive 0.13.0

Is this embedded beeline, or going against HiveServer2? Which one is picking up the .hiverc? Hive really should be printing the exact exception message there (GenericUDFBridge), it prints that error on any exception it encounters in that part of the logic. It might be hiding what the actual er

Re: [ANNOUNCE] New Hive PMC Member - Xuefu Zhang

Congrats Xuefu! On Feb 28, 2014, at 1:43 AM, Biswajit Nayak wrote: > Congrats Xuefu.. > > With Best Regards > Biswajit > > ~Biswa > -oThe important thing is not to stop questioning o- > > > On Fri, Feb 28, 2014 at 2:50 PM, Carl Steinbach wrote: > I am pleased to announce that Xuef

Re: Class not found exception from serde

I'm assuming the jar was loaded using ADD JAR as opposed to the jar being on the classpath? On Feb 24, 2014, at 2:40 PM, Jason Dere wrote: > I think TableDesc may not be using the right class loader here when it's > trying to get the class - other parts of the code specify the

Re: Class not found exception from serde

I think TableDesc may not be using the right class loader here when it's trying to get the class - other parts of the code specify the class loader to use but in this context it does not. I've opened https://issues.apache.org/jira/browse/HIVE-6495. On Feb 23, 2014, at 4:05 AM, Andreas Koch wr

Re: Can data be passed to the final mode init call in a UDAF?

I've only used Hive 0.12+ and I'm not really familiar with UDAFs, but had to pass some info to a GenericUDF so this might give you some ideas: - During query planning you might be able to set the hive conf using SessionState.get().getConf(). When the query is executing you might be able to acc

Re: GenericUDF Testing in Hive

Tried your example with Hive trunk. Didn't quite work out of the box, you'll need to replace List with List. Otherwise, this seemed to work: hive> select ComplexUDFExample(array('a', 'b', 'c'), 'a') from src limit 3; …. OK true true true Time taken: 6.271 seconds, Fetched: 3 row(s) On Feb 4, 20

Re: [ANNOUNCE] New Hive Committers - Sergey Shelukhin and Jason Dere

> >> Congrats Sergey and Jason! > >> > >> Thanks > >> Vikram. > >> > >> On Jan 27, 2014, at 8:36 AM, Carl Steinbach wrote: > >> > >> > The Apache Hive PMC has voted to make Sergey Shelukhin and

Re: Usage of TIMESTAMP

See HIVE-2558 - the comparison between timestamp and string was done by converting both values to a number. i think this behavior should be changed, as of Hive-0.12 Jason On Jan 23, 2014, at 6:20 AM, Petter von Dolwitz (Hem) wrote: > Hi, > > I have a table where one column (ts) is of type TI

Re: [ANNOUNCE] New Hive Committer - Vikram Dixit

Congrats Vikram! On Jan 6, 2014, at 11:10 AM, Prasanth Jayachandran wrote: > Congratulations Vikram!! > > Thanks > Prasanth Jayachandran > > On Jan 6, 2014, at 11:50 PM, Eugene Koifman wrote: > >> Congratulations! >> >> >> On Mon, Jan 6, 2014 at 9:44 AM, Gunther Hagleitner < >> ghagleit..

Re: [ANNOUNCE] New Hive Committers - Jitendra Nath Pandey and Eric Hanson

Congrats! On Nov 22, 2013, at 2:25 AM, Biswajit Nayak wrote: > Congrats to both of you.. > > > On Fri, Nov 22, 2013 at 1:26 PM, Lefty Leverenz > wrote: > Congratulations, Jitendra and Eric! The more the merrier. > > -- Lefty > > > On Thu, Nov 21, 2013 at 6:31 PM, Jarek Jarcec Cecho wro

Re: [ANNOUNCE] New Hive PMC Member - Harish Butani

Congrats Harish! On Nov 14, 2013, at 5:17 PM, Carl Steinbach wrote: > I am pleased to announce that Harish Butani has been elected to the Hive > Project Management Committee. Please join me in congratulating Harish! > > Thanks. > > Carl -- CONFIDENTIALITY NOTICE NOTICE: This message is inte

Re: [ANNOUNCE] New Hive Committer - Xuefu Zhang

Xuefu, congrats! On Nov 4, 2013, at 9:53 AM, Vaibhav Gumashta wrote: > Congrats Xuefu! > > > On Mon, Nov 4, 2013 at 9:17 AM, Prasad Mujumdar wrote: > >> Congratulations Xuefu! >> >> thanks >> Prasad >> >> >> >> On Sun, Nov 3, 2013 at 8:06 PM, Carl Steinbach >> wrote: >> >>> The Apache

Re: Problème with min function in HiveQL

Looks like the issue is the use of min() within the WHERE clause - the place where the exception is being thrown has the following comment: // UDAF in filter condition, group-by caluse, param of funtion, etc. On Aug 29, 2013, at 3:01 AM, Jérôme Verdier wrote: > Hi everybody, > > I am