Re: Read error : Varchar cannot be cast to string

2015-06-18 Thread Devansh Srivastava
Gopal, I have raised the bug (ATLAS-27). Thanks, Devansh From: Devansh Srivastava devansh.srivast...@datametica.com Sent: Thursday, June 18, 2015 4:05 PM To: user@hive.apache.org Subject: Re: Read error : Varchar cannot be cast to string Hi Gopal, Yes,

Re: Read error : Varchar cannot be cast to string

2015-06-18 Thread Gopal Vijayaraghavan
Hi, I don¹t think I have the privileges to move an ATLAS JIRA into HIVE. And the pre-commit tests for HIVE do not run for ATLAS issues. If you have access to the JIRA admin for that project, please move that issue over into the right project. Cheers, Gopal On 6/18/15, 4:11 AM, Devansh

Re: delta file compact take no effect

2015-06-18 Thread Alan Gates
Which version of Hive are you running? A number of deadlock issues were resolved in HIVE-10500 which was released in Hive 1.2. Based on your log it appears it recovered properly from the deadlocks and did manage to compact. Alan. r7raul1...@163.com mailto:r7raul1...@163.com June 17, 2015

Can not Drop Table/View in Hive

2015-06-18 Thread Amjad ALSHABANI
Hello All, I m having an issue when trying to droping a table (or a view) in hive: I m using Hive0.14, metastore MySql, hadoop 2.4, HDP 2.2.4 when issuing the following command: $ hive -e use poc_pdd; show tables; it hangs... when activating the DEBUG (just getting hte last lines from the

Re: Hive - Tez error with big join - Container expired.

2015-06-18 Thread Gopal Vijayaraghavan
I have a pretty big Hive Query. I¹m joining over 3 Hive-Tables which have thousands of lines each. I¹m grouping this join by several columns. Hive-on-Tez shouldn¹t have any issue even with billion of lines on a JOIN. 0 failed, info=[Containercontainer_1434357133795_0008_01_39 finished

error on hive 1.2.0

2015-06-18 Thread Sateesh Karuturi
iam using *hive 1.2.0* and *hadoop 2.6.0*. whenever iam running hive on my machine... *select* query works fine but in case of *count(*)* it shows following *error*: Diagnostic Messages for this Task: Container launch failed for container_1434646588807_0001_01_05

Re: Updating hive metadata

2015-06-18 Thread Devopam Mittra
hi Prasanth, I would not suggest tweaking hive metastore info unless you have full knowledge of the entire tables that will get impacted due to such a change. And such things break a lot with upgrades since this is quite unmanageable manually. Why don't you create my_managed_table_2 as type

Error using UNION ALL operator on tables of different storage format !!!

2015-06-18 Thread @Sanjiv Singh
Hi All I was trying to combine records of two tables using UNION ALL. One table testTableText is on TEXT format and another table testTableORC is on ORC format. It is failing with given error. It seems error related to input format. Is it bug ? or .. See the given scenario : *Hive

RE: Updating hive metadata

2015-06-18 Thread Ryan Harris
you *should* be able to do: create my_table_2 like my_table; dfs -cp /user/hive/warehouse/my_table/* /user/hive/warehouse/my_table_2/ MSCK repair table my_table_2; From: Devopam Mittra [mailto:devo...@gmail.com] Sent: Thursday, June 18, 2015 10:12 PM To: user@hive.apache.org Subject: Re:

Re: Error using UNION ALL operator on tables of different storage format !!!

2015-06-18 Thread Xuefu Zhang
Sounds like a bug. However, could you reproduce with the latest Hive code? --Xuefu On Thu, Jun 18, 2015 at 8:56 PM, @Sanjiv Singh sanjiv.is...@gmail.com wrote: Hi All I was trying to combine records of two tables using UNION ALL. One table testTableText is on TEXT format and another table

Updating hive metadata

2015-06-18 Thread Chagarlamudi, Prasanth
Hello, Is there a way to update metadata in hive? Created database mydb; Created my_point_table; Created my_managed_table; Insert into my_managed_table from my_point_table; Now, Create my_point_table_2; //Copy data from hive managed_table to managed_table_2's location hdfs dfs -cp

Re: Hive wiki write access request

2015-06-18 Thread Lefty Leverenz
Ben, what is your Confluence username? (See About This Wiki -- How to get permission to edit https://cwiki.apache.org/confluence/display/Hive/AboutThisWiki#AboutThisWiki-Howtogetpermissiontoedit .) -- Lefty On Thu, Jun 18, 2015 at 5:13 PM, Ben Tse ben@gmail.com wrote: Hi, I would like to

Hive wiki write access request

2015-06-18 Thread Ben Tse
Hi, I would like to request write access to Hive wiki. Thanks, Ben Tse

Doubt Regards SPARK

2015-06-18 Thread Vinod Kuamr
Hi folks, Can anyone please tell me how to show databases list in SPARK? Regards,Vinod

Re: Query in column name

2015-06-18 Thread Renuka Be
Hi 김영우, Thanks for your reply. It work for me. Regards, Renuka N On Thu, Jun 18, 2015 at 4:31 AM, 김영우 warwit...@gmail.com wrote: If you are running Hive .13+, use *backticks*. {quote} create table x (`col name` string); No rows affected (0.148 seconds) select `col name` from x;

Query in Pattern of string value of Date

2015-06-18 Thread Renuka Be
Hi Folks, I have a column with value like 10/05/2012 type of string. I need to convert this string to timestamp. Is there any way to convert string value date to specific format. Regards, Renuka N

Re: Query in Pattern of string value of Date

2015-06-18 Thread silva
Check this tutorial: http://snowplowanalytics.com/blog/2013/02/08/writing-hive-udfs-and-serdes Cheers Avanz Quoting Renuka Be renunalin...@gmail.com: Hi Folks, I have a column with value like 10/05/2012 type of string. I need to convert this string to timestamp. Is there any way to convert

Re: Query in Pattern of string value of Date

2015-06-18 Thread Buntu Dev
Did you already checkout the built-in Date Functions supported by Hive: https://cwiki.apache.org/confluence/display/Hive/LanguageManual+UDF#LanguageManualUDF-DateFunctions Also might want to search for any existing UDFs if the Data Functions does not satisfy your needs or write one yourself

Re: Doubt Regards SPARK

2015-06-18 Thread Anilkumar Kalshetti
Hi, Please check below things Spark SQL commands. show databases; show tables; Note: database and tables are already created using Hive database, and stored in Hive Metastore For “show databases” command, it list databases ‘default’ and ‘dbanil’.. For “show tables” command, it list

Re: Query in column name

2015-06-18 Thread 김영우
If you are running Hive .13+, use *backticks*. {quote} create table x (`col name` string); No rows affected (0.148 seconds) select `col name` from x; {quote} You can refer to Hive wiki for details, https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL HTH, Youngwoo On Thu, Jun

Re: Read error : Varchar cannot be cast to string

2015-06-18 Thread Devansh Srivastava
Hi Gopal, Yes, one of the partition column is having VARCHAR as datatype. My target table has structure like this :-- CREATE EXTERNAL TABLE test_table( dob string COMMENT '', version_nbr int COMMENT '', record_status string COMMENT '', creation_timestamp timestamp COMMENT '')

Re: Hive - Tez error with big join - Container expired.

2015-06-18 Thread Jianfeng (Jeff) Zhang
Tez will hold the idle containers for a while, but it would also expire the container if it reach some threshold. Have you set property tez.am.container.idle.release-timeout-max.millis in tez-site.xml ? And can you attach the yarn app log ? Best Regard, Jeff Zhang From: Daniel Klinger