Re: Hive queries returning all NULL values.

2014-08-26 Thread Tor Ivry
Raymond - you were the closest. Parquet field names contained '::' ex. bag1::user_name Hope it will help anyone in the future Thanks for all your help Tor On Sun, Aug 17, 2014 at 7:50 PM, Raymond Lau raymond.lau...@gmail.com wrote: Do your field names in your parquet files contain upper

Distribution of Data

2014-08-26 Thread CHEBARO Abdallah
This question is not directly related to Hive, but: I configured 3 datanodes on my Linux machine. In my configuration, I configured the number of replication to be 1. I am submitting a file to the hdfs, and found that the file has 3 copies on each datanodes (I checked it from the browser)

RE: Distribution of Data

2014-08-26 Thread CHEBARO Abdallah
What does it mean my replication have set as final? From: hadoop hive [mailto:hadooph...@gmail.com] Sent: Tuesday, August 26, 2014 4:36 PM To: user@hive.apache.org Subject: Re: Distribution of Data Can you check if your replication have set as final or not else it won't be effected. On Aug 26,

OOM with Hive on Tez

2014-08-26 Thread Suma Shivaprasad
Trying to run a query on Tez with the following configurations *set hive.tez.container.size=5120* *set mapreduce.map.child.java.opts=-Xmx5120M* *set hive.tez.java.opts=-Xmx4096M* *set hive.auto.convert.join.noconditionaltask.size=805306000* *set tez.am.resource.memory.mb=5120* *set

RE: Distribution of Data

2014-08-26 Thread hadoop hive
If in your core-site.xml or hdfs-site.XML .. Property is Marked as final it would not be overwrite by your code On Aug 26, 2014 7:07 PM, CHEBARO Abdallah abdallah.cheb...@murex.com wrote: What does it mean my replication have set as final? *From:* hadoop hive [mailto:hadooph...@gmail.com]

RE: Distribution of Data

2014-08-26 Thread CHEBARO Abdallah
I marked it as final, and tried again, still facing the same issue. From: hadoop hive [mailto:hadooph...@gmail.com] Sent: Tuesday, August 26, 2014 5:19 PM To: user@hive.apache.org Subject: RE: Distribution of Data If in your core-site.xml or hdfs-site.XML .. Property is Marked as final it

Re: OOM with Hive on Tez

2014-08-26 Thread Suma Shivaprasad
Am using Tez 0.4.0 and counters for the query run are as below 2014-08-26 14:06:41,203 INFO [Thread-13]: exec.Task (TezTask.java:execute(171)) - org.apache.tez.common.counters.DAGCounter: 2014-08-26 14:06:41,205 INFO [Thread-13]: exec.Task (TezTask.java:execute(173)) -NUM_FAILED_TASKS: 67

Reg: Controlling number of Precision digits

2014-08-26 Thread upd r
Hi, Can someone please tell me if there is a way to alter the precision digits for a double/float data type to 2 or 3. Eg: 232879.7979879 to 232879.79 Thanks, UPD

Re: Reg: Controlling number of Precision digits

2014-08-26 Thread Bala Krishna Gangisetty
I suppose your query is against HIVE, you can take advantage of round() built-in UDF function. --Bala G. On Tue, Aug 26, 2014 at 11:24 AM, upd r updbigd...@gmail.com wrote: Hi, Can someone please tell me if there is a way to alter the precision digits for a double/float data type to 2 or

Re: Reg: Controlling number of Precision digits

2014-08-26 Thread upd r
Thanks Bala. On Tue, Aug 26, 2014 at 11:31 AM, Bala Krishna Gangisetty b...@altiscale.com wrote: I suppose your query is against HIVE, you can take advantage of round() built-in UDF function. --Bala G. On Tue, Aug 26, 2014 at 11:24 AM, upd r updbigd...@gmail.com wrote: Hi, Can

varchar

2014-08-26 Thread upd r
Hi, I have a created a table with fields defined as varchar(length). Is it correct to insert data in to the table casting the fields as VARCHAR(length). I am getting this error. Error occurred executing hive query: OK FAILED: SemanticException Generate Map Join Task Error: Class cannot be

Re: varchar

2014-08-26 Thread upd r
Hi, I have a created a table with fields defined as varchar(length). Is it correct to insert data in to the table casting the fields as VARCHAR(length). I am getting this error. Error occurred executing hive query: OK FAILED: SemanticException Generate Map Join Task Error: Class cannot be

Re: varchar

2014-08-26 Thread Jason Dere
What version of Hive? Do you have some sample SQL? On Aug 26, 2014, at 1:20 PM, upd r updbigd...@gmail.com wrote: Hi, I have a created a table with fields defined as varchar(length). Is it correct to insert data in to the table casting the fields as VARCHAR(length). I am getting this

Re: Hive User Group Meeting

2014-08-26 Thread Xuefu Zhang
Dear Apache Hive users and developers, The next Hive user group meeting mentioned previously was officially announced here: http://www.meetup.com/Hive-User-Group-Meeting/events/202007872/. As it's only about one and a half month away, please RSVP if you plan to go so that the organizers can plan

Re: Reg: Controlling number of Precision digits

2014-08-26 Thread Nagarjuna Vissarapu
If you want to convert 232879.7979879 to 232879.79 use BigDecimal class On Tue, Aug 26, 2014 at 2:24 PM, upd r updbigd...@gmail.com wrote: Hi, Can someone please tell me if there is a way to alter the precision digits for a double/float data type to 2 or 3. Eg: 232879.7979879 to 232879.79