RE: Call for case studies for Programming Hive, 2nd edition

. Pretty easy. You will need to download the ASE driver called jconn4.jar and place it in $HIVE_HOME/lib directory. If these are relevant then let me know. Thanks, Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid for Trading

RE: view over partitioned table

OK, This is the way I read it. Crearte table t1 .. partitioned by date will use horizontal partitioning as per common with any RDBMS say Oracle. The view I will create it as follows: hive create view v1 as select * from t1; OK Time taken: 0.073 seconds hive analyze table t1

RE: Executing HQL files from JAVA application.

(object_id) as 'COMPACT' WITH DEFERRED REBUILD; HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid for Trading Systems with Oracle TimesTen and Coherence Cache NOTE: The information in this email is proprietary

RE: Executing HQL files from JAVA application.

. Regards, Amal From: Mich Talebzadeh [mailto:m...@peridale.co.uk] Sent: Saturday, March 21, 2015 6:59 PM To: user@hive.apache.org Subject: RE: Executing HQL files from JAVA application. Hi Amal, Do you have hiveserver2 running? You can use beeline to execute the query outside of JAVA

RE: view over partitioned table

From: Mich Talebzadeh m...@peridale.co.uk Reply-To: user@hive.apache.org Date: Sun, 15 Mar 2015 19:01:57 + To: user@hive.apache.org, 'cobby cohen' ququr...@yahoo.com Subject: RE: view over partitioned table OK, This is the way I read it. Crearte table t1 .. partitioned by date

RE: view over partitioned table

/Hive/PartitionedViews - Douglas From: Mich Talebzadeh m...@peridale.co.uk Reply-To: user@hive.apache.org Date: Sun, 15 Mar 2015 19:01:57 + To: user@hive.apache.org, 'cobby cohen' ququr...@yahoo.com Subject: RE: view over partitioned table OK, This is the way I read it. Crearte table

Show databases in beeline throws Error: Error retrieving next row

Hi, When I log in to hive via beeline and do show databases, I get the following errors! Transaction isolation: TRANSACTION_REPEATABLE_READ 0: jdbc:hive2://rhes564:1/ashehadoop show databases; org.apache.thrift.TApplicationException: Internal error processing FetchResults at

Configuring Hive metastore service to use SAP ASE as container for metastore

Hi, As you may be aware hive metastore stores hive metadata in a relational database. The recommendation is to have this database in a remote container. Currently this database can be created remotely on MySQL and PostgresSQL plus Oracle and I believe MSSQL. I have now adapted the relevant

RE: configuring Hive metastore to use Oracle DB ignored

, therefore neither Peridale Ltd, its subsidiaries nor their employees accept any responsibility. From: Mich Talebzadeh [mailto:m...@peridale.co.uk] Sent: 09 March 2015 09:28 To: user@hive.apache.org Subject: configuring Hive metastore to use Oracle DB ignored Hi all, I am trying to use

RE: is there a way to read Hive configurations from the REST APIs?

You can use the command *set* in hive to get the behaviour. You can also do the same through beeline. HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid for Trading Systems with Oracle TimesTen and Coherence Cache

Connecting to hiveserver via beeline is established but I never get beeline prompt

Hi, I am trying to use beeline to access Hive/Hadoop. Hive server is running on the Linux node that Hadoop is installed as follows: hduser@rhes564::/home/hduser/jobs hive --service hiveserver 10001 -v [1] 30025 hduser@rhes564::/home/hduser/jobs Starting Hive Thrift Server This

RE: Connecting to hiveserver via beeline is established but I never get beeline prompt

prompt Looks like you are trying to connect to HiveServer v1. Beeline is the CLI client that is supported to work with HiveServer2. You can start HiveServer2 like this: hive --service hiveserver2 and then connect to it using beeline. Thanks, -Vaibhav From: Mich Talebzadeh m...@peridale.co.uk

RE: Show databases in beeline throws Error: Error retrieving next row

Rebooted hive server and it now works! Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid for Trading Systems with Oracle TimesTen and Coherence Cache NOTE: The information in this email is proprietary and confidential

connectivity issue

Hi, I have set up hiverserv2 running on port 10010 and I can use beeline from remote host to connect to the server host beeline -u jdbc:hive2://rhes564:10010/default org.apache.hive.jdbc.HiveDriver -n hduser -p x scan complete in 5ms Connecting to jdbc:hive2://rhes564:10010/default

RE: drop table command hang

Have you truncated the table before dropping it? I Truncate table table_name Drop table rable_name Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid for Trading Systems with Oracle TimesTen and Coherence Cache NOTE

RE: Which SerDe for Custom Binary Data.

. At the consumer level what tools are you going to use? Do you a propriety tool with the correct drivers to access the data? HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid for Trading Systems with Oracle TimesTen

RE: hive 1.1.0 Error while Metastore starting

From the sql code do you know which table and primary key it is complaining? I have used the script for Oracle 11g and modified one work with SAP Sybase ASE 15.7 and they both worked fine. HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory

RE: how to set column level privileges

I do not know for sure but you can always create a view on the table excluding columns that you don't want this particular application to see. Rather tedious. HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid

RE: ORDER BY clause in Hive

Gents, Hive as I see it does not support ORDER BY Column position. It only supports ORDER BY Column name. Thanks Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid for Trading Systems with Oracle TimesTen and Coherence

RE: ORDER BY clause in Hive

namehive.groupby.orderby.position.alias/name valuetrue/value descriptionEenables using Column Position Alias in GROUP BY and ORDER BY clauses of queries./description /property And ran the above query without session level setting and it worked Regards, Mich Talebzadeh

RE: Standard deviation (STDDEV) function calculation in Hive

documentation. The value provided by STDDEV in Hive does not appear to be industry standard HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid for Trading Systems with Oracle TimesTen and Coherence Cache NOTE

RE: Understanding Hive's execution plan

Sure Daniel. Apologies. Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid for Trading Systems with Oracle TimesTen and Coherence Cache NOTE: The information in this email is proprietary and confidential. This message

Hive optimiser seems not to use for a covered query

thanks Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid for Trading Systems with Oracle TimesTen and Coherence Cache NOTE: The information in this email is proprietary and confidential. This message is for the designated

RE: ORDER BY clause in Hive

| +-+--+---+-- ---++--+ 9 rows selected (209.699 seconds) Regards, Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid for Trading Systems with Oracle TimesTen and Coherence Cache NOTE: The information in this email

RE: Bucket pruning

-d -b 25 hqlfile HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid for Trading Systems with Oracle TimesTen and Coherence Cache NOTE: The information in this email is proprietary and confidential. This message

My query on Standard deviation function STDDEV() in Hive

Hi gurus, STDDEV function can be used for both aggregates and analytics. Fortunately in Hive it has been implemented which is great. I have a simple question on this if I may I would expect the in-built function STDDEV to run pretty efficiently in most databases as they are system defined

RE: Adding update/delete to the hive-hcatalog-streaming API

. What you are mentioning as temp is (I gather if I am correct) is eferred to staging in DW. However, there are now requirement for DW to receive replicate data from transactional databases through SAP replication server or Oracle Golden Gate. HTH, Mich Talebzadeh http

RE: Adding update/delete to the hive-hcatalog-streaming API

Hi Elliot, How do you determine a record in a partition has changed? Are you relying on timestamp or something like that? Thanks Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid for Trading Systems with Oracle TimesTen

RE: Adding update/delete to the hive-hcatalog-streaming API

Thanks for that Elliot. As a matter of interest what is the source of data in this case. Is the data delivered periodically including new rows and deltas? Cheers, Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid

RE: Understanding Hive's execution plan

seconds, Fetched: 50 row(s) Trying to understand above does keys: object_id (type: double) refers to use of index here? I dropped that index and the same plan was produced! Thanks Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data

RE: Adding update/delete to the hive-hcatalog-streaming API

Have you seen this article although it looks a bit dated. Adding ACID to Apache Hive http://hortonworks.com/blog/adding-acid-to-apache-hive/ HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid for Trading Systems

Analyze stats on 4 million rows table fails with exception Buffer underflow.

not update stats.Failed with exception Buffer underflow. org.apache.hive.com.esotericsoftware.kryo.KryoException: Buffer underflow. Appreciate any feedback on this Thanks Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid

RE: Analyze stats on 4 million rows table fails with exception Buffer underflow.

is virus free, therefore neither Peridale Ltd, its subsidiaries nor their employees accept any responsibility. From: Mich Talebzadeh [mailto:m...@peridale.co.uk] Sent: 24 March 2015 20:43 To: user@hive.apache.org Subject: Analyze stats on 4 million rows table fails with exception Buffer underflow

RE: Connecting to hiveserver via beeline is established but I never get beeline prompt

, its subsidiaries nor their employees accept any responsibility. From: Mich Talebzadeh [mailto:m...@peridale.co.uk] Sent: 06 March 2015 20:02 To: user@hive.apache.org Subject: RE: Connecting to hiveserver via beeline is established but I never get beeline prompt Thanks Vaibhav I

RE: [ANNOUNCE] New Hive Committers - Jimmy Xiang, Matt McCline, and Sergio Pena

Me too J Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid for Trading Systems with Oracle TimesTen and Coherence Cache NOTE: The information in this email is proprietary and confidential. This message

RE: question on create database

the one who looks after DDL in production (drop, create, truncate tables etc) is the administrator who does releases through approved processes. HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid for Trading Systems

Re: org.apache.hadoop.hive.ql.lockmgr.LockException: No record of lock could be found, may have timed out

: org.apache.hadoop.hive.ql.lockmgr.LockException: No record of lock could be found, may have timed out What lock or transaction manager are you using? Alan. Mich Talebzadeh mailto:m...@peridale.co.uk April 23, 2015 at 8:19 Hi all, Trying to do a direct load from RDBMS to Hive (not using Sqoop). It sends data in files of rows

RE: Orc file and Hive Optimiser

Thanks John, I have already registered my interest on development work for Hive. So hopefully I may be able to contribute at some level. Regards, Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books A Practitioner's Guide to Upgrading to Sybase ASE 15

Orc file and Hive Optimiser

functionality, is there any reason why one should deploy a columnar database such as Hbase or Cassandra If Hive can do the job as well? Thanks, Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books A Practitioner's Guide to Upgrading to Sybase ASE 15, ISBN 978-0-9563693-0-7

RE: Orc file and Hive Optimiser

Thanks John for the link Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books A Practitioner's Guide to Upgrading to Sybase ASE 15, ISBN 978-0-9563693-0-7. co-author Sybase Transact SQL Guidelines Best Practices, ISBN 978-0-9759693-0-4 Publications due shortly

RE: create statement is not working

20:43:30 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Found 1 items drwxr-xr-x - hduser supergroup 0 2015-04-24 20:42 /xyz/pqr/aggregated_rspns HTH Mich Talebzadeh http

RE: create statement is not working

= 100 log on logdev01_HDD = 50 2 go Msg 156, Level 15, State 2: Server 'SYB_157', Line 1: Incorrect syntax near the keyword 'table'. Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books A Practitioner’s Guide to Upgrading to Sybase ASE 15, ISBN 978-0-9563693-0

RE: create statement is not working

Hi Eugene, What this with regard to the following thread of mine? org.apache.hadoop.hive.ql.lockmgr.LockException: No record of lock could be found, may have timed out Thanks Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books A Practitioner's Guide

RE: hive metastore's schematool -upgradeSchema on postgres throws an error on CREATE TABLE PART_COL_STATS

previous version and 0.14 and see anything has changed in DDL? Do you have any records in that table? Mine is empty HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books A Practitioner’s Guide to Upgrading to Sybase ASE 15, ISBN 978-0-9563693-0-7. co-author

RE: Hive Alter Partition Location Issue

Hi Harsha, Have you updated stats on table1 after partition adding? In other words it is possible that the optimiser is not aware of that partition yet? analyze table table1 partition (dt=201501) compute statistics; HTH Mich Talebzadeh http://talebzadehmich.wordpress.com

RE: How to compare data in two tables?

enough. HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books A Practitioner’s Guide to Upgrading to Sybase ASE 15, ISBN 978-0-9563693-0-7. co-author Sybase Transact SQL Guidelines Best Practices, ISBN 978-0-9759693-0-4 Publications due shortly: Creating

RE: How to compare data in two tables?

identifier for each row in each table? HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books A Practitioner’s Guide to Upgrading to Sybase ASE 15, ISBN 978-0-9563693-0-7. co-author Sybase Transact SQL Guidelines Best Practices, ISBN 978-0-9759693-0-4

FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. Exception while processing TABLE

! Thanks Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books A Practitioner's Guide to Upgrading to Sybase ASE 15, ISBN 978-0-9563693-0-7. co-author Sybase Transact SQL Guidelines Best Practices, ISBN 978-0-9759693-0-4 Publications due shortly: Creating

RE: Hive and Impala

the axiom of Hadoop with HDFS + MapReduce. HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books A Practitioner's Guide to Upgrading to Sybase ASE 15, ISBN 978-0-9563693-0-7. co-author Sybase Transact SQL Guidelines Best Practices, ISBN 978-0-9759693-0-4

RE: downloading RDBMS table data to Hive with Sqoop import

or so. A row in RDBMS is created once, updated many and deleted once. So the prime interest would be to look for Inserts and updates. HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books A Practitioner’s Guide to Upgrading to Sybase ASE 15, ISBN 978-0-9563693

RE: hive sql on tez run forever

This may work. HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books A Practitioner’s Guide to Upgrading to Sybase ASE 15, ISBN 978-0-9563693-0-7. co-author Sybase Transact SQL Guidelines Best Practices, ISBN 978-0-9759693-0-4 Publications due shortly

Re: Output of Hive

try to put the query in a file called name.hql don't forget to add exit! to the bottom. Then run it as hive -f name.hql name.log The output will be streamed to that file. In general you should see both the execution and result. if you do the way I mentioned, you would only see the result

RE: Index Rebuild - DUG failes due to vertex failure

HI Marc, Regardless of whether you rebuild an index or not I came across checking whether indexes are used in Hive. In so far as I know indexes are not fully implemented in Hive and Hive does not use the index. See the attached emails. HTH Mich Talebzadeh http

RE: [Hive 0.13.1] - Explanation/confusion over Fatal error occurred when node tried to create too many dynamic partitions on small dataset with dynamic partitions

Hi, I believe partitioning followed by hash cluster allows only up to 32 buckets within a single partition? HTH, Mich NOTE: The information in this email is proprietary and confidential. This message is for the designated recipient only, if you are not the intended recipient,

RE: [Hive 0.13.1] - Explanation/confusion over Fatal error occurred when node tried to create too many dynamic partitions on small dataset with dynamic partitions

and will get back on that. HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books A Practitioner’s Guide to Upgrading to Sybase ASE 15, ISBN 978-0-9563693-0-7. co-author Sybase Transact SQL Guidelines Best Practices, ISBN 978-0-9759693-0-4 Publications due

Hive support for concurrency with Oracle Metastore

| +--+---+-++-+--- +-+-++-+ ---+--+ The question I have is if we delete from the whole table it seems that only one lock is applied to whole table. Does that mean a full table lock rather that locks for every row deleted? Thanks, Mich Talebzadeh http://talebzadehmich.wordpress.com

RE: partition and bucket

Hi, I will try to have a go at your points but I am sure there are many experts around. As you may know already in RDBMS partitioning (dividing a very large table into sub-tables conceptually) is deployed to address three areast. 1. Availability -- each partition can reside on a

RE: Table bucketing on structured fields

structa:string, b:string) CLUSTERED BY (id) INTO 32 buckets; OK Time taken: 0.787 seconds HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books A Practitioner’s Guide to Upgrading to Sybase ASE 15, ISBN 978-0-9563693-0-7. co-author Sybase Transact SQL

RE: Hive Stats shows numRows=0 when data imported through Sqoop

Hi Suresh, I guess you are also using MySQL as your Hive metastore? What configuration have you set for stats collection? HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books A Practitioner’s Guide to Upgrading to Sybase ASE 15, ISBN 978-0-9563693-0

RE: Error when connecting Hue to HiveServer2

Hi Gary, Is your hiverserver2 running OK. How did you start it? $HIVE_HOME/bin/hiveserver2 What do you when you run the command below? I assume that your hiveserver is running on port 1? netstat -alnp|egrep 'Local|1|9083' HTH Mich Talebzadeh http

RE: Error when connecting Hue to HiveServer2

) PAM: Pluggable authentication module NOSASL: Raw transport /description /property Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books A Practitioner’s Guide to Upgrading to Sybase ASE 15, ISBN 978-0-9563693-0-7. co-author Sybase Transact SQL

RE: External Table with unclosed orc files.

last save It will behave much like versioning in an RDBMS. HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books A Practitioner's Guide to Upgrading to Sybase ASE 15, ISBN 978-0-9563693-0-7. co-author Sybase Transact SQL Guidelines Best Practices, ISBN

RE: External Table with unclosed orc files.

Hi Grant, Thanks for insight. You mentioned and I quote Acid tables have been a real pain for us. We don’t believe they are production ready.. Can you please elaborate on this/ Thanks Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books A Practitioner’s Guide

Concurrency issue, Setting hive.txn.manager to org.apache.hadoop.hive.ql.lockmgr.DbTxnManager

to default hive.txn.manager= org.apache.hadoop.hive.ql.lockmgr.DummyTxnManager and recycled again and all worked! Sounds like concurrency does not work or something extra I need to do? Thanks Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly

RE: Concurrency issue, Setting hive.txn.manager to org.apache.hadoop.hive.ql.lockmgr.DbTxnManager

10280]: Error communicating with the metastore Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid for Trading Systems with Oracle TimesTen and Coherence Cache NOTE: The information in this email is proprietary and confidential

A simple insert stuck in hive

appreciated. Thanks Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid for Trading Systems with Oracle TimesTen and Coherence Cache NOTE: The information in this email is proprietary and confidential. This message

RE: A simple insert stuck in hive

in mapred-site! I recycled Hadoop and it is now working. HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Publications due shortly: Creating in-memory Data Grid for Trading Systems with Oracle TimesTen and Coherence Cache NOTE: The information in this email is proprietary

RE: Hive-1.2.0 does not work with stock hadoop 2.6.0

unset CLASSPATH CLASSPATH=.:$HADOOP_HOME/share/hadoop/common/hadoop-common-2.6.0-tests.jar:$HADOOP_HOME/share/hadoop/common/hadoop-common-2.6.0.jar:hadoop-nfs-2.6.0.jar:$HIVE_HOME/conf export CLASSPATH for i in ${HIVE_HOME}/lib/*.jar ; do CLASSPATH=$CLASSPATH:$i done HTH Mich

RE: Hiveserver2 stops logging

Do you have any issue with hive metastore? Where is the metastore situated? Hive will crash if connections to metastore are lost or there is a network issue! Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books A Practitioner’s Guide to Upgrading to Sybase

RE: current_date function in hive

, DAY(op_time) AS Day , count(*) AS Total_Rows FROM t GROUP BY op_type , YEAR(op_time) , MONTH(op_time) , DAY(op_time) ) rs HTH Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books A Practitioner’s Guide

RE: Metastore client initial failed, connection refused

Where is your hive metastore? If it is on a database instance, is the instance hosting metastore running? Mich Talebzadeh http://talebzadehmich.wordpress.com Author of the books A Practitioner’s Guide to Upgrading to Sybase ASE 15, ISBN 978-0-9563693-0-7. co-author Sybase

RE: locks are held on tables even when no job running

) FROM t_staging ; I killed the program using Ctrl C and then used mapred job as below to kill mapred job -kill job_1445590859106_0002 Killed job job_1445590859106_0002 Still locks were held HTH Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy

locks are held on tables even when no job running

UsedContainers RsvdContainers UsedMem RsvdMem NeededMem AM info No locks are held in metastore (Oracle in my case) as well. Thanks Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 15 <h

RE: locks are held on tables even when no job running

and the locks are held until rollback is complete. Killing a process itself will not release the locks! Regards, Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 15 http://login.sybase.com/files/Product_Overviews

RE: locks are held on tables even when no job running

TYPE, HL_LAST_HEARTBEAT, HL_ACQUIRED_AT from hiveuser.HIVE_LOCKS; no rows selected Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 15 http://login.sybase.com/files/Product_Overviews/ASE-Winning-Strategy-091908. p

RE: export/import in hive failing with nested directory exception!

Thanks Gopal. Indeed table t is defined as ORC and transactional. Any reason why this should not work for transactional tables? Regards, Mich NOTE: The information in this email is proprietary and confidential. This message is for the designated recipient only, if you are not the intended

RE: export/import in hive failing with nested directory exception!

for import/export to highlight the limitations with regard to transactional tables 2.Provide an alternative mechanism on how to migrate transactional tables. HTH, Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE

create table as ORC with SORTED BY fails

Hi, Any idea why this simple create table fails? hive> create table test ( > owner varchar(30) > ,object_name varchar(30) > ,object_id bigint > ) > SORTED BY (object_id) > STORED AS ORC > TBLPROPERTIES

SemanticException Unable to fetch table t. null

Hi, Has anyone got a quick fix for dropping such table please? hive> drop table t; FAILED: SemanticException Unable to fetch table t. null hive> desc t; FAILED: SemanticException Unable to fetch table t. null Thanks, Mich Talebzadeh Sybase ASE 15 Gold Medal Awar

RE: SemanticException Unable to fetch table t. null

table t; OK HTH Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 15 http://login.sybase.com/files/Product_Overviews/ASE-Winning-Strategy-091908.pdf Author of the books "A Practitioner’s Guide to Upgrading

RE: SemanticException Unable to fetch table t. null

Thanks where is it fixed? Is there any patch available. Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 15 http://login.sybase.com/files/Product_Overviews/ASE-Winning-Strategy-091908.pdf Author of the books

RE: SemanticException Unable to fetch table t. null

including DROP TABLE FAILED: SemanticException Unable to fetch table t. null I believe the table should not be created in the first place with hive. HTH Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 1

RE: create table as ORC with SORTED BY fails

amp ) CLUSTERED BY (object_id) INTO 256 BUCKETS STORED AS ORC TBLPROPERTIES ( "orc.compress"="SNAPPY", "orc.create.index"="true", "orc.bloom.filter.columns"="object_id", "orc.bloom.filter.fpp"="0.05", &quo

RE: SemanticException Unable to fetch table t. null

that the column cannot contain any NULL values. Only constraints may follow the datatype. Specifying a maximum length on a DATE or LONG datatype also causes this error. So I may have to hack the metadata manually. Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running

job submitted but not running

ion to this problem is to restart Hadoop, hive and yarn. It will then work. However, I am not sure about the cause. Sounds like resources are not released for one reason or other! Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial D

RE: Problem with Hive metastore

What type of metastore are you using? Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 15 http://login.sybase.com/files/Product_Overviews/ASE-Winning-Strategy-091908.pdf Author of the books "A Practitioner’s

RE: Problem with Hive metastore

ESTABLISHED 20598/java If you see it is running just do kill -9 20598 To get rid of it and start it again. HTH Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 15 http://login.sybase.com/files/Product_Overviews

RE: Beeline and hiveserver2

You need to pass username and password. For example assuming the OS username is hduser and password is beeline -u jdbc:hive2://rhes564:10010/default org.apache.hive.jdbc.HiveDriver -n hduser -p Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy

RE: Beeline and hiveserver2

Where are you running beeline client? >From another host or on the same host where hive is installed? Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 15 http://login.sybase.com/files/Product_Overviews/ASE-Winn

RE: Beeline and hiveserver2

What do you have in your xml file for hive.metastore.sasl.enabled false If true, the metastore Thrift interface will be secured with SASL. Clients must authenticate with Kerberos. Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running

Container is running beyond physical memory limits

explanation I would be interested. Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 15 <http://login.sybase.com/files/Product_Overviews/ASE-Winning-Strategy-091908 .pdf> http://login.sybase.com/files/Product_Overvie

RE: Container is running beyond physical memory limits

mapreduce.map) and their correlation to each other mapreduce.reduce.memory.mb 8192 mapreduce.map.java.opts -Xmx3072m mapreduce.reduce.java.opts -Xmx6144m Can you please verify if these settings are correct and how they relate to each other? Thanks Mich Talebzadeh

RE: Container is running beyond physical memory limits

Thank you. Very helpful Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 15 http://login.sybase.com/files/Product_Overviews/ASE-Winning-Strategy-091908.pdf Author of the books "A Practitioner’s Guide to Upgr

RE: Container is running beyond physical memory limits

Many thanks Gopal. Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 15 http://login.sybase.com/files/Product_Overviews/ASE-Winning-Strategy-091908. pdf Author of the books "A Practitioner's Guide to Upgrading to Sybase A

full DDL for an index

ject_id; FAILED: ParseException line 1:12 missing TABLE at 'index' near '' line 1:18 extraneous input 'idx_object_id' expecting EOF near '' Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 15 <http://log

RE: Join vs. Where...In

: jdbc:hive2://rhes564:10010/default select count(1) from t, smallt where t.object_id = smallt.object_id; +--+--+ | _c0 | +--+--+ | 100 | +--+--+ 1 row selected (68.978 seconds) You can see the results and judge for yourself HTH Mich Talebzadeh Sybase ASE 15 Gold

RE: Bucketing- Identify Number of Buckets

this?). You need to work out the selectivity of column you are using for bucketing using the above formulae or something similar then decide on the number of buckets say clustered by (object_id) into 256 buckets. HTH Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning

RE: Permission denied error when starting HiveServer2

ESTABLISHED 2943/java HTH Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 15 <http://login.sybase.com/files/Product_Overviews/ASE-Winning-Strategy-091908.pdf> http://login.sybase.com

RE: Adding JAR in Hive classpath

$CLASSPATH HTH, Mich Talebzadeh Sybase ASE 15 Gold Medal Award 2008 A Winning Strategy: Running the most Critical Financial Data on ASE 15 <http://login.sybase.com/files/Product_Overviews/ASE-Winning-Strategy-091908.pdf> http://login.sybase.com/files/Product_Overviews/ASE-W

RE: ORA-8177 with Hive transactions

015-04-29 22:38:01,262 Stage-1 map = 80%, reduce = 0%, Cumulative CPU 11.8 sec 2015-04-29 22:38:02,295 Stage-1 map = 100%, reduce = 0%, Cumulative CPU 13.28 sec 2015-04-29 22:38:03,335 Stage-1 map = 100%, reduce = 100%, Cumulative CPU 14.52 sec OK 500000 I really need to go back and

  1   2   3   4   5   6   7   8   >