Re: Install Hadoop and Hive

2014-07-28 Thread Ricardo Birmele
Check out blogs.msdn.comhttp://blogs.msdn.com. Search for how to install the PowerShell commandlets for Apache Hadoop-based services for windows services. The commands in your example below are Linux, and there are differences in syntax. For example the PowerShell equivalent of the Linux ls

UDTF

2014-07-28 Thread Doug Christie
Can anyone point me to the source code in hive where the calls to initialize, process and forward in a UDTF are made? Thanks. Doug

Re: UDTF

2014-07-28 Thread Nitin Pawar
you want to know how initializes an udtf or how to build udtf ? On Tue, Jul 29, 2014 at 1:30 AM, Doug Christie doug.chris...@sas.com wrote: Can anyone point me to the source code in hive where the calls to initialize, process and forward in a UDTF are made? Thanks. Doug -- Nitin

java.lang.NumberFormatException.forInputString

2014-07-28 Thread Sameer Tilak
Hi everyone,I have a TSV file (around 4 GB). I have creted a hive table on that using the following command. It works finr without indexing. However, when I create an index based on 2 columsn I get the following error: create table products (user_id String, session_id String, ordering_date

RE: UDTF

2014-07-28 Thread Doug Christie
I want to know where the call to initialize for a UDTF is made in the hive source code. Doug From: Nitin Pawar [mailto:nitinpawar...@gmail.com] Sent: Monday, July 28, 2014 4:03 PM To: user@hive.apache.org Subject: Re: UDTF you want to know how initializes an udtf or how to build udtf ? On

Re: java.lang.NumberFormatException.forInputString

2014-07-28 Thread Nishant Kelkar
Hi Sameer, Try the following: CREATE INDEX user_id_ordering_mode_index ON TABLE products(user_id,ordering_mode) AS 'COMPACT' ROW FORMAT DELIMITED FIELDS TERMINATED BY '\t' STORED AS TEXTFILE; Let me know what it says. On Mon, Jul 28, 2014 at 1:03 PM, Sameer Tilak ssti...@live.com wrote:

Passing hive conf variables through ODBC/JDBC

2014-07-28 Thread sai chaitanya tirumerla
Hi, We are connecting ODBC/JDBC tools to hiveserver2 using ipaddr:1 and ldap authentication and wanted to pass hiveconf variables explicitly through it. Can anybody help me how to pass the hiveconf variables explicitly when the connection is made to hiveserver2. It works perfectly fine from

Re: Passing hive conf variables through ODBC/JDBC

2014-07-28 Thread Lars Francke
Yes there is. The format is: jdbc:hive2://host:port/dbName;sess_var_list?hive_conf_list#hive_var_list Example: jdbc:hive2://foobar:1/database;auth=noSasl?fs.s3.awsAccessKeyId=xxx; fs.s3.awsSecretAccesskey=xx#foo=bar Cheers, Lars On Tue, Jul 29, 2014 at 1:28 AM, sai chaitanya

Re: UDTF

2014-07-28 Thread Jason Dere
Looking at call hierarchy in Eclipse: initiaize(): org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.genUDTFPlan(GenericUDTF, String, ArrayListString, QB, Operator, boolean) org.apache.hadoop.hive.ql.exec.UDTFOperator.initializeOp(Configuration) process():

Re: Passing hive conf variables through ODBC/JDBC

2014-07-28 Thread sai chaitanya tirumerla
Hi Lars, Thank you so much for the information. I have couple of questions here 1. I would like to also access from ODBC tools , can i do it in any other way? 2. What if my authentication is LDAP , can i use jdbc:hive2://foobar:1/database;auth=*LDAP*?fs.s3.awsAccessKeyId=xxx;

Re: Passing hive conf variables through ODBC/JDBC

2014-07-28 Thread Lars Francke
Hi, 1. I'm afraid I have no idea about ODBC 2. No need to specify anything on the client side when using LDAP. That was just an example So it'd look like this for you: jdbc:hive2://foobar:1/database?fs.s3. awsAccessKeyId=xxx;fs.s3.awsSecretAccesskey=xx Cheers, Lars On Tue, Jul

Metastore Event Listeners

2014-07-28 Thread Raymond Lau
Hey guys, I'm having some trouble getting my Metastore Event Listener to do anything, none of my print statements are occuring. What am I missing? I added the jar in the classpath and i'm pretty sure that it's getting loaded. Nothing is showing up in the hive CLI when i create partition on an