RE: Impact of partitioning on certain queries

neither Peridale Ltd, its subsidiaries nor their employees accept any responsibility. From: Jörn Franke [mailto:jornfra...@gmail.com] Sent: 08 January 2016 06:20 To: user@hive.apache.org Subject: Re: Impact of partitioning on certain queries This observation is correct and it is the

Re: Impact of partitioning on certain queries

ed. It is the > responsibility of the recipient to ensure that this email is virus free, > therefore neither Peridale Ltd, its subsidiaries nor their employees accept > any responsibility. > > From: Jörn Franke [mailto:jornfra...@gmail.com] > Sent: 08 January 2016 06:20 &g

RE: Impact of partitioning on certain queries

rn Franke [mailto:jornfra...@gmail.com] Sent: 08 January 2016 08:49 To: user@hive.apache.org Subject: Re: Impact of partitioning on certain queries Well you use a text format for your data so you should not be surprised. For text based formats, such as csv, you can always use the hive bitmap

RE: Impact of partitioning on certain queries

Of Gopal Vijayaraghavan Sent: 08 January 2016 09:34 To: user@hive.apache.org Subject: Re: Impact of partitioning on certain queries > Ok we hope that partitioning improves performance where the predicate >is on partitioned columns Nope. Partitioning *only* improves perfo

Re: Impact of partitioning on certain queries

is the > responsibility of the recipient to ensure that this email is virus free, > therefore neither Peridale Ltd, its subsidiaries nor their employees accept > any responsibility. > > From: Jörn Franke [mailto:jornfra...@gmail.com] > Sent: 08 January 2016 08:49 > To:

Impact of partitioning on certain queries

Ok we hope that partitioning improves performance where the predicate is on partitioned columns I have two tables. One a basic table called smallsales defined as below CREATE TABLE `smallsales`( | | `prod_id` bigint,

Re: Impact of partitioning on certain queries

This observation is correct and it is the same behavior as you see it in other databases supporting partitions. Usually you should avoid many small partitions. > On 07 Jan 2016, at 23:53, Mich Talebzadeh wrote: > > Ok we hope that partitioning improves performance where