Re: support for arrays, maps, structs while writing output of custom reduce script to table

2010-03-22 Thread Dilip Joseph
) ; On Mon, Mar 22, 2010 at 1:50 PM, Dilip Joseph dilip.antony.jos...@gmail.com wrote: Hello, Does Hive currently support arrays, maps, structs while using custom reduce/map scripts? 'myreduce.py' in the example below produces an array of structs delimited by \2s and \3s. CREATE TABLE SS

Re: support for arrays, maps, structs while writing output of custom reduce script to table

2010-03-23 Thread Dilip Joseph
Opened JIRA https://issues.apache.org/jira/browse/HIVE-1271 Dilip On Mon, Mar 22, 2010 at 3:26 PM, Zheng Shao zsh...@gmail.com wrote: Great! This is a bug. Hive field names should be case-insensitive. Can you open a JIRA for that? Zheng On Mon, Mar 22, 2010 at 2:43 PM, Dilip Joseph

Truncation error when creating table with column containing struct with many fields

2010-04-06 Thread Dilip Joseph
Hello, I got the following error when creating a table with a column that has an ARRAY of STRUCTS with many fields. It appears that there is a 128 character limit on the column definition. FAILED: Error in metadata: javax.jdo.JDODataStoreException: Add request failed : INSERT INTO COLUMNS

HIVE_AUX_JARS_PATH interfering with startup of Hive Web Interface

2010-04-07 Thread Dilip Joseph
The Hive Webserver fails to startup with the following error message, if HIVE_AUX_JARS_PATH environment variable is set (works fine if unset). Is this a bug? $ build/dist/bin/hive --service hwi Exception in thread main java.io.IOException: Error opening job jar: -libjars at

Re: HIVE_AUX_JARS_PATH interfering with startup of Hive Web Interface

2010-04-07 Thread Dilip Joseph
Created JIRA ticket https://issues.apache.org/jira/browse/HIVE-1294 Dilip On Wed, Apr 7, 2010 at 12:08 PM, Edward Capriolo edlinuxg...@gmail.com wrote: On Wed, Apr 7, 2010 at 2:54 PM, Dilip Joseph dilip.antony.jos...@gmail.com wrote: The Hive Webserver fails to startup with the following

Support for lists in JDBC client?

2010-04-11 Thread Dilip Joseph
Does the Hive JDBC client support lists and structs in the ResultSet? I am getting an array of nulls when I try to do a SELECT * on the following table from a JDBC client written in Jython. CREATE TABLE pokes ( key INT, vals ARRAYINT ); Works fine from the command line $ hive

Re: Referencing External Files from Hive

2010-05-13 Thread Dilip Joseph
I had the same problem. Adding the following lines before the import solved the problem: import sys import os sys.path.append(os.getcwd()) Dilip On Thu, May 13, 2010 at 10:58 AM, Ray Duong ray.du...@gmail.com wrote: Hi, I have two python scripts that is loaded into Hive, one of the python

tracking progress when using Hive JDBC client

2010-05-14 Thread Dilip Joseph
Hello, I am using the Hive JDBC client to execute queries. Is there any way to track the progress of the various Map Reduce jobs involved in the query's execution? Thanks, Dilip

Re: Error when creating custom UDFs

2010-05-17 Thread Dilip Joseph
Did you add the jar containing the class com.example.hive.udf.Lower using ADD JAR? This error definitely occurs when the appropriate jar is not on the path, and when there is a typo in class name. There are probably other causes as well. Dilip On Mon, May 17, 2010 at 1:03 PM, Edmar Ferreira

Re: tracking progress when using Hive JDBC client

2010-05-17 Thread Dilip Joseph
to achieve. Can you describe why you'd like to monitor the jobs? -Vinithra On Fri, May 14, 2010 at 11:37 AM, Dilip Joseph dilip.antony.jos...@gmail.com wrote: Hello, I am using the Hive JDBC client to execute queries. Is there any way to track the progress of the various Map Reduce jobs

Percentile UDAF throws error on empty data?

2010-05-27 Thread Dilip Joseph
I am getting an exception when using the Percentile UDAF on an empty data set (details below)? Has anyone seen/solved this before? Thanks Dilip 1. Create the following table and load it with 4 rows: 10, 20, 30, 40 CREATE TABLE pct_test ( val INT ); 2. SELECT

Re: Hwo to use JDBC client embedded mode

2010-08-10 Thread Dilip Joseph
I have posted an example about using Hive from Jython at http://csgrad.blogspot.com/2010/04/to-use-language-other-than-java-say.html. Since the example uses the standard Hive JDBC drivers, it may be useful to you. Dilip On Tue, Aug 10, 2010 at 8:05 AM, lei liu liulei...@gmail.com wrote: Can

Re: question..partitioned table...

2010-08-21 Thread Dilip Joseph
504 4847* *My Blog : http://ronakbaps.posterous.com* * * * * On Fri, Aug 20, 2010 at 7:34 PM, Dilip Joseph dilip.antony.jos...@gmail.com wrote: You don't need to specify EXEC_DATE STRING, in your column definition as it is already specified by PARTITIONED BY(EXEC_DATE STRING) Dilip