How to set default value for a certain field

Hi, is there Ideal solution in Hive to specify default values at schema level. Currently we are using *COALESCE *operator in converting null values to default value, this would require reading entire table. But it would be nice if some one has different approach of setting default values for

Re: TBLPROPERTIES K/V Comprehensive List

There is no comprehensive list, each serde could use the parameters for whatever it desires while other serde's use none at all. On Fri, Feb 19, 2016 at 3:23 PM, mahender bigdata < mahender.bigd...@outlook.com> wrote: > +1, Any information available ? > > On 2/10/2016 1:26 AM, Mathan Rajendran

Re: TBLPROPERTIES K/V Comprehensive List

+1, Any information available ? On 2/10/2016 1:26 AM, Mathan Rajendran wrote: Hi , Is there any place where I can see a list of Key/Value Pairs used in Hive while creating a Table. I went through the code and find the java doc hive_metastoreConstants.java is having few constants list but

Re: Hive query on Tez slower than on MR (fails in some cases) ..

Hi, > Here's the Tez DAG swimlane. Haven't gotten vertex.py to work.. will >send that too soon. Pretty clear that the map-side is fine - splitting sort buffers isn't bothering this at all. We want to over-partition Reducer 7 and possibly have all of them pick the total # of reducers dynamically

Re: DB2 DDL to Hive DDL conversion **Need Help**

Abhi, The approach is quite simple and straightforward: 1) HPL/SQL is available since Hive 2.0 released a few days ago, so if you are using a previous Hive version (or Impala, Spark SQL, Presto etc) you can take the tool at http://hplsql.org/download 2) Follow http://hplsql.org/start to set it

Re: DB2 DDL to Hive DDL conversion **Need Help**

Hi Dmitry, You understood my requirements. Our requirement is to create tables in hive using DB2 DDL script. Means converting DB2 DDL into hive DDL. I think HPL/SQL tool will work. Can you please share the details and user guide of the tool. Abhi Sent from my iPhone > On Feb 19, 2016, at

Re: DB2 DDL to Hive DDL conversion **Need Help**

Chandeep, My target tables are existing DB2 tables and we have to move data from Hive staging tables to target DB2 tables using informatica BDE. Means, we are looking for one to one mapping between hive and DB2 metadata. As DB2 tables are existing we are looking for a reverse re engineering to

Re: DB2 DDL to Hive DDL conversion **Need Help**

Tables can be imported directly into Hive using Sqoop with the following flag --hive-import. Once you have the tables in Hive you can get their create DDL scripts using SHOW CREATE TABLE ; > On Feb 19, 2016, at 5:31 PM, Mohit Durgapal wrote: > > If he can import the

Re: DB2 DDL to Hive DDL conversion **Need Help**

If he can import the scripts in db2 rdbms then it can create equivalent hive ddl script using sqoop. On Friday 19 February 2016, Dmitry Tolpeko wrote: > Abhi needs to convert SQL scripts so I am afraid Sqoop will not help. > > Abhi, do you need to get equivalent Hive

Re: External table returns no result.

Hi It's not enough to make dirs in hdfs. You need to let the metastore know you're adding partitions. Try to Recover Partitions (MSCK REPAIR TABLE) . hth Gabriel Balan The statements and opinions expressed here are my own and do not necessarily represent those of Oracle Corporation.

Re: DB2 DDL to Hive DDL conversion **Need Help**

Abhi needs to convert SQL scripts so I am afraid Sqoop will not help. Abhi, do you need to get equivalent Hive scripts or creating tables in Hive will be enough (without having scripts)? The new HPL/SQL tool is designed to execute existing DDL (created for any database), convert on the fly and

Re: What is the real meaning of negative value in Vertex.

Thanks Prasanth for sharing information On 2/18/2016 3:23 PM, Prasanth Jayachandran wrote: Negative values are failed attempts count. First number if completed task count. Second number is running task count. Third number if failed task attempts count. Last number is total task count. :

Re: What is the real meaning of negative value in Vertex.

Thanks Gopal. On 2/18/2016 3:24 PM, Gopal Vijayaraghavan wrote: Hi, If you use the newer in.place.progress UI, it will look much better as we have legends [1] which also shows killed tasks (due to pre-emption or to prevent DAG dead-locks). Map 1: 0(+77,-185)/122 Map 2: 1/1 0(+77,

Re: Apache sqoop and hive

sqoop import-all-tables \ --connect "jdbc:mysql://host_name:3306/db_name" \ --username=username \ --password=password \ --warehouse-dir=/user/hive/warehouse/hive_db.db Have you tried this On 19 February 2016 at 12:17, Archana Patel wrote: > > hi , Divya > >

Re: DB2 DDL to Hive DDL conversion **Need Help**

Have you considered using Sqoop? If not, then please have a look at the following links: https://sqoop.apache.org/docs/1.4.3/SqoopUserGuide.html#_importing_data_into_hive http://stackoverflow.com/questions/17064144/how-do-i-use-sqoop-for-importing-data-from-a-relational-db-to-sandbox-hive On