Re: Error with flush_length File in Orc, in hive 2.1.0 and mr execution engine.

2016-10-25 Thread Eugene Koifman
Which of your tables are are transactional? Can you provide the DDL? I don’t think “File does not exist” error is causing your queries to fail. It’s an INFO level msg. There should be some other error. Eugene From: satyajit vegesna

答复: Can I specify database name in hive metastore service?

2016-10-25 Thread Huang Meilong
Look at this local metastore architecture: [cid:87afe275-ff1d-4dc3-88ed-b2081163c512] If I set different database name in javax.jdo.option.ConnectionURL, say, "jdbc:mysql://x/hivemeta_1?createDatabaseIfNotExist=truecharacterEncoding=UTF-8" and

Re: hive transactional table compaction fails

2016-10-25 Thread Eugene Koifman
does this happen for 1 specific partition or all of them? On 10/25/16, 12:47 AM, "aft" wrote: >Hi, > >Table created with this : > >$hive>create table syslog_staged (id string, facility string, >sender string, severity string, tstamp string, service string, msg >string)

Re: Can I specify database name in hive metastore service?

2016-10-25 Thread Peter Vary
Hi Huang, Hive metastore is a component of the "Hive database". See: https://cwiki.apache.org/confluence/display/Hive/Design The metastore uses traditional RDBMS to store "the structure information of the various tables and partitions in the warehouse". The javax.jdo.option.ConnectionURL and the

Can I specify database name in hive metastore service?

2016-10-25 Thread Huang Meilong
Hi, To use hive metastore service, I must set `javax.jdo.option.ConnectionURL`, `javax.jdo.option.ConnectionDriverName` and `hive.metastore.uris` in hive-site.xml, like this: javax.jdo.option.ConnectionURL

Re: Hive metadata on Hbase

2016-10-25 Thread Furcy Pin
Hi Mich, I mostly agree with you, but I would comment on the part about using HBase as a maintenance free core product: I would say that most medium company using Hadoop rely on Hortonworks or Cloudera, that both provides a pre-packaged HBase installation. It would probably make sense for them to

Re: class not found exception

2016-10-25 Thread Rajendra Bhat
Hi , I have configured mysql metastore. issues is on s3 supporting jar. On Tue, Oct 25, 2016 at 4:43 PM, dv akhil wrote: > Hi, >which metastore are you using for hive? . Have you copied the jar > containing the JDBC driver for your metadata db into hive's lib dir? >

Re: class not found exception

2016-10-25 Thread dv akhil
Hi, which metastore are you using for hive? . Have you copied the jar containing the JDBC driver for your metadata db into hive's lib dir? down voteaccepted On Tue, Oct 25, 2016 at 4:29 PM, Rajendra Bhat wrote: > hive> list jars; >

Re: class not found exception

2016-10-25 Thread Rajendra Bhat
hive> list jars; /opt/apache-hive-2.0.1-bin/lib/hadoop-aws-2.7.1.jar /opt/apache-hive-2.0.1-bin/lib/aws-java-sdk-1.7.4.jar hive> On Tue, Oct 25, 2016 at 4:27 PM, Rajendra Bhat wrote: > yes, I have added the jar on hive prompt. > > On Tue, Oct 25, 2016 at 4:25 PM, aft

Re: class not found exception

2016-10-25 Thread Rajendra Bhat
yes, I have added the jar on hive prompt. On Tue, Oct 25, 2016 at 4:25 PM, aft wrote: > On Tue, Oct 25, 2016 at 6:11 AM, Rajendra Bhat > wrote: > > Hi, > > > > i am getting below error on create extrnal table. I have copied > > hadoop-aws-2.7.1.jar and

class not found exception

2016-10-25 Thread Rajendra Bhat
Hi, i am getting below error on create extrnal table. I have copied hadoop-aws-2.7.1.jar and aws-java-sdk-1.7.4.jar to hive_home/lib folder. please let me know where should need to place supporting jar.. hive> create external table kv (key int, value string) location

Re: Connect metadata

2016-10-25 Thread Rajendra Bhat
I have setup the meta store. I need to create hive external table, table data stored in S3 with parquet format. As i am not installed hive server for execute create command. How can I possible execute to create table commands..? On Tue, Oct 25, 2016 at 1:41 PM, Rajendra Bhat

Re: Connect metadata

2016-10-25 Thread Rajendra Bhat
I need external table. data should refer from S3. On Tue, Oct 25, 2016 at 1:00 PM, Damien Carol wrote: > You could use CTAS in presto > > 2016-10-25 9:09 GMT+02:00 Rajendra Bhat : > >> Hi Team, >> >> I have configured only meta store and started the

Re: Connect metadata

2016-10-25 Thread Mich Talebzadeh
I don't understand what you mean by Hive installing your schema at startup. If you have created an empty database/schema in postgres (I am not familiar with it), you can run the relevant script in directory $HIVE_HOME/scripts/metastore/upgrade/postgres That will create all the associated tables

Re: Connect metadata

2016-10-25 Thread Gopal Vijayaraghavan
> Could someone provide me with a code snippet (preferably Java) that installs > the schema (through datanucleus) on my empty metastore (postgres) I wish it was that simple, but do not leave it to the Hive startup to create it - create it explicitly with schematool

Re: Connect metadata

2016-10-25 Thread Per Ullberg
Sorry, no help from me I'm afraid, but I have a similar question: Could someone provide me with a code snippet (preferably Java) that installs the schema (through datanucleus) on my empty metastore (postgres). I don't want Hive to install the schema at startup, but rather do it explicitly myself.

Re: Connect metadata

2016-10-25 Thread Damien Carol
You could use CTAS in presto 2016-10-25 9:09 GMT+02:00 Rajendra Bhat : > Hi Team, > > I have configured only meta store and started the meta store service, > hwich i ma used on presto. > > I need create table on metastore.. how can i able create that.. as i am > not started

Connect metadata

2016-10-25 Thread Rajendra Bhat
Hi Team, I have configured only meta store and started the meta store service, hwich i ma used on presto. I need create table on metastore.. how can i able create that.. as i am not started hive server service, bcoz hadoop not installed on my syatem. -- Thanks and Regards Rajendra Bhat

Re: confirm subscribe to user@hive.apache.org

2016-10-25 Thread Rajendra Bhat
reply On Tue, Oct 25, 2016 at 12:19 PM, wrote: > Hi! This is the ezmlm program. I'm managing the > user@hive.apache.org mailing list. > > To confirm that you would like > >rajhalk...@gmail.com > > added to the user mailing list, please send > a short reply to this