Re: query orc file by hive

2015-11-13 Thread patcharee
Hi, It work with non-partition ORC, but does not work with (2-column) partitioned ORC. Thanks, Patcharee On 09. nov. 2015 10:55, Elliot West wrote: Hi, You can create a table and point the location property to the folder containing your ORC file: CREATE EXTERNAL TABLE orc_table (

Re: query orc file by hive

2015-11-13 Thread Dave Maughan
Hi, Expand Elliot's answer for a partitioned table, e.g.: CREATE EXTERNAL TABLE orc_table ( ) PARTITIONED BY (col1 type, col2 type) STORED AS ORC LOCATION '/hdfs/folder/containing/orc/files'; ALTER TABLE orc_table ADD PARTITION (col1 = 'val1', col2 = 'val2') LOCATION

RE: export/import in hive failing with nested directory exception!

2015-11-13 Thread Mich Talebzadeh
This potentially breaks the ACID properties of Hive. My own take is that export/import functionality was added before ACID properties and transactional tables were added to Hive and as such did not cater for this type of work. There are two options IMO: 1.Update documentation for

Re: Cross join/cartesian product explanation

2015-11-13 Thread Rory Sawyer
Hi Gopal, Thanks for the detailed response. It’s really a very simple query that I’m trying to run: select a.a_id, b.b_id, count(*) as c from table_a a, table_b b where bloom_contains(a_id, b_id_bloom) group by a.a_id, b.b_id; Where “bloom_contains” is a custom

Best practices for monitoring hive

2015-11-13 Thread Ashok Kumar
Hi, I would like to know best practices to monitor the health and performance of Hive and hive server, trouble shooting and catching errors etc. to be clear we do not use any bespoke monitoring tool and keen on developing our own in house tools to be integrated into general monitoring tools to

does hive support non equality join?

2015-11-13 Thread glen
from cwiki, the answer is no. it seems supported after some test. by the way, is there any better doc for hive?

Re: [VOTE] Hive 2.0 release plan

2015-11-13 Thread Gopal Vijayaraghavan
(+user@) +1. Cheers, Gopal On 11/13/15, 5:54 PM, "Lefty Leverenz" wrote: >The Hive bylaws require this to be submitted on the user@hive mailing list >(even though users don't get to vote). See Release Plan in Actions

Re: hive transaction strange behaviour

2015-11-13 Thread Elliot West
It is the compaction process that creates the base files. Check your configuration to ensure that compaction should be running. I believe the compactor should run periodically. You can also request a compaction using the appropriate ALTER TABLE HQL DDL command. Elliot. On Friday, 13 November

Re: query orc file by hive

2015-11-13 Thread patcharee
Hi, It works after I altered add partition. Thanks! My partitioned orc file (directory) is created by Spark, therefore hive is not aware of the partitions automatically. Best, Patcharee On 13. nov. 2015 13:08, Elliot West wrote: Have you added the partitions to the meta store? ALTER TABLE