Re: Unable to pick data from subdirectories into hive table in CDH 5.3.3

agreed but it still needs to know where the hive top node directory starts from, which is normally under ../../ warehouse Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

Re: Unable to pick data from subdirectories into hive table in CDH 5.3.3

Read about hive partitions and bucketing. Since your location has multiple directories, Hive needs to know how to traverse them.. Hope this helps. On May 19, 2016 5:51 AM, "Abhishek Dubey" wrote: > Hi, > > > > In hdfs I have a directory structure like this. > >

Re: Unable to pick data from subdirectories into hive table in CDH 5.3.3

Hi, I am not familiar with CDH, but in a default set -up, the hive directory is under hdfs://https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com

Re: Hive 2 database Entity-Relationship Diagram

Thanks These are the list of tables and views Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com On

Re: Hive 2 database Entity-Relationship Diagram

The pdf is not upside for me, in chrome browser. However, there seems to be many tables that are not related to (or rather used by) hive, specifically DMRV_* and DMRS_* ones. Thanks, Thejas From: Mich Talebzadeh Sent: Thursday,

Re: Hive 2 database Entity-Relationship Diagram

thanks Dudu for your comments I will check. I will realign the overlapping tables Only partial tables have relationship not all I am afraid. Most DMRS_% tables are standalone. I can see the PDF as it is can you kindly check the top left hand corner. The one below Do you see this upside

RE: Hive 2 database Entity-Relationship Diagram

Thanks Mich I’m afraid the current format is not completely user friendly. I would suggest to divide the tables to multiple sets by subjects / graph connectivity (BTW, it seems odd that most of the tables are disconnected) Also – · HIVEUSER.PARTITION_KEY_VALS is partially covering

Hive 2 database Entity-Relationship Diagram

Hi All, I use Hive 2 with metastore created for Oracle Database with hive-txn-schema-2.0.0.oracle.sql. It already includes concurrency stuff added into metastore The RDBMS is Oracle Database 12c Enterprise Edition Release 12.1.0.2.0. I created an Entity-Relationship (ER) diagram from the

Re: Hive setup on Hadoop cluster

Hi John, stderr does not say much Exception in thread "main" java.lang.IncompatibleClassChangeError: Implementing class at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:800) at

how can I access HDFS(namenode HA) by using hive-common-1.2.1.jar??

Hi guys, who knows why class HiveConf has no HADOOPCONF enum type in hive common jar now? I write code using hive-common-1.2.1.jar HiveConf class to access HDFS(HA namenode), and I get an error below. I realized my code didn't config HADOOPCONF so it can't connect to HDFS, but there is no

Re: Hive system catalog

1) If your metastore use a RDBMS for the backend, you can query it by program. 2) If you want a more "command line" approach try the hcatalog cli tool 3) If you want to stay on hive, you could use beeline (HIVE as few meta data commands like SHOW DATABASES) Hope it helps, Damien 2016-05-19

Unable to pick data from subdirectories into hive table in CDH 5.3.3

Hi, In hdfs I have a directory structure like this. /user/hdfs/Data/Data1/File1 /user/hdfs/Data/Data2/File2 And I am creating an external table like: CREATE external TABLE db.tablename ( amt1 STRING, amt2 STRING, amt3 STRING ) row format delimited fields terminated by ',' location

Re: Could i use Hive SQL parser in our application?

Hi, I wrote this hive ql ast visualizer tool last summer using JRuby,hope it would help. here: https://github.com/liprais/hive_ast_tree_vis 2016-05-19 14:31 GMT+08:00 Heng Chen : > We should use pd.parse(sql) instead of pd.parse(sql, context); > > And when i use

Re: Could i use Hive SQL parser in our application?

We should use pd.parse(sql) instead of pd.parse(sql, context); And when i use pd.parse(sql), i could see exception thrown out like below, it is due to HIVE-10731 , the issue was fixed in 1.3.0, but i use hive-exec-1.2.0.jar in my application.