[jira] Commented: (HIVE-1750) Remove Partition Filtering Conditions when Possible

2010-11-02 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927312#action_12927312 ] Namit Jain commented on HIVE-1750: -- OpProcFactory: for (Partition p:

Anyway in hive to measure query performance.

2010-11-02 Thread Prafulla Tekawade
Hi, I was wondering if there is anyway in hive that can be used to measure the performance of variour components/operations of a single query run. Eg. Typecally query involvs various operations like tablescan, joins, aggregation, orderby etc. Can I get how much time was required for each of this?

[jira] Commented: (HIVE-1750) Remove Partition Filtering Conditions when Possible

2010-11-02 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927334#action_12927334 ] Amareshwari Sriramadasu commented on HIVE-1750: --- A couple of minor comments: *

[jira] Updated: (HIVE-1761) Support show locks for a particular table

2010-11-02 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-1761: --- Resolution: Fixed Status: Resolved (was: Patch Available) I just committed! Thanks Namit!

[jira] Assigned: (HIVE-1721) use bloom filters to improve the performance of joins

2010-11-02 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1721?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain reassigned HIVE-1721: Assignee: Siying Dong (was: Liyin Tang) use bloom filters to improve the performance of joins

[ANNOUNCE] New Committer - Carl Steinbach

2010-11-02 Thread Ashish Thusoo
Hi Folks, The Hive PMC has passed the vote to make Carl Steinbach a new committer on the Apache Hive project. Carl has made a lot of contributions to Hive with the latest being him serving as the release manager for 0.6.0 release. Following is a list of some of the contributions that he has

Re: [ANNOUNCE] New Committer - Carl Steinbach

2010-11-02 Thread Edward Capriolo
On Tue, Nov 2, 2010 at 2:23 PM, Ashish Thusoo athu...@facebook.com wrote: Hi Folks, The Hive PMC has passed the vote to make Carl Steinbach a new committer on the Apache Hive project. Carl has made a lot of contributions to Hive with the latest being him serving as the release manager for

[jira] Commented: (HIVE-1750) Remove Partition Filtering Conditions when Possible

2010-11-02 Thread Siying Dong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927533#action_12927533 ] Siying Dong commented on HIVE-1750: --- Amareshwari, it's a good catch. I'll make a put

[jira] Commented: (HIVE-1750) Remove Partition Filtering Conditions when Possible

2010-11-02 Thread Siying Dong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927535#action_12927535 ] Siying Dong commented on HIVE-1750: --- In the case that at least one partition is a table,

Build failed in Hudson: Hive-trunk-h0.20 #410

2010-11-02 Thread Apache Hudson Server
See https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/410/ -- [...truncated 15162 lines...] [junit] POSTHOOK: Output: defa...@src1 [junit] OK [junit] Copying data from

[jira] Commented: (HIVE-1721) use bloom filters to improve the performance of joins

2010-11-02 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927545#action_12927545 ] Namit Jain commented on HIVE-1721: -- T2 does not fit in memory completely. We create a bloom

[jira] Commented: (HIVE-1526) Hive should depend on a release version of Thrift

2010-11-02 Thread Pradeep Kamath (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927549#action_12927549 ] Pradeep Kamath commented on HIVE-1526: -- Hi Carl - just wondering if you have had a

[jira] Commented: (HIVE-1721) use bloom filters to improve the performance of joins

2010-11-02 Thread Siying Dong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927551#action_12927551 ] Siying Dong commented on HIVE-1721: --- It is a common use case? Small table is so big that

[jira] Commented: (HIVE-1721) use bloom filters to improve the performance of joins

2010-11-02 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927553#action_12927553 ] Namit Jain commented on HIVE-1721: -- Yes, even after all the optimizations, map-join is

RE: Anyway in hive to measure query performance.

2010-11-02 Thread Siying Dong
We are still building infrastructure to make performance optimizing easier, but for now, all the measurements are kind of manual. Especially to the component/operations level, we don't have a good tool to tell it yet. What we are doing now, is to select some typical benchmark queries that cover

Re: [ANNOUNCE] New Committer - Carl Steinbach

2010-11-02 Thread yongqiang he
Congrats Carl. On Tue, Nov 2, 2010 at 11:27 AM, Edward Capriolo edlinuxg...@gmail.com wrote: On Tue, Nov 2, 2010 at 2:23 PM, Ashish Thusoo athu...@facebook.com wrote: Hi Folks, The Hive PMC has passed the vote to make Carl Steinbach a new committer on the Apache Hive project. Carl has made

[jira] Commented: (HIVE-1721) use bloom filters to improve the performance of joins

2010-11-02 Thread Joydeep Sen Sarma (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927555#action_12927555 ] Joydeep Sen Sarma commented on HIVE-1721: - @Siyin - that's a good question. I don't

[jira] Commented: (HIVE-1721) use bloom filters to improve the performance of joins

2010-11-02 Thread Siying Dong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927567#action_12927567 ] Siying Dong commented on HIVE-1721: --- So the idea is, the filtered rows in the big table

[jira] Commented: (HIVE-1721) use bloom filters to improve the performance of joins

2010-11-02 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1721?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927568#action_12927568 ] Namit Jain commented on HIVE-1721: -- That depends on the size of the filtered big table: To

[jira] Created: (HIVE-1763) drop table (or view) should issue warning if table doesn't exist

2010-11-02 Thread dan f (JIRA)
drop table (or view) should issue warning if table doesn't exist Key: HIVE-1763 URL: https://issues.apache.org/jira/browse/HIVE-1763 Project: Hive Issue Type: Improvement

[jira] Commented: (HIVE-1332) Archiving partitions

2010-11-02 Thread Paul Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1332?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927627#action_12927627 ] Paul Yang commented on HIVE-1332: - Added archiving sections at:

[jira] Commented: (HIVE-1750) Remove Partition Filtering Conditions when Possible

2010-11-02 Thread Siying Dong (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927697#action_12927697 ] Siying Dong commented on HIVE-1750: --- Namit, sorry I misunderstood. Yes, maybe

RE: [ANNOUNCE] New Committer - Carl Steinbach

2010-11-02 Thread Paul Yang
Congrats, Carl! Great work -Original Message- From: Ashish Thusoo [mailto:athu...@facebook.com] Sent: Tuesday, November 02, 2010 11:23 AM To: dev@hive.apache.org Subject: [ANNOUNCE] New Committer - Carl Steinbach Hi Folks, The Hive PMC has passed the vote to make Carl Steinbach a new

[jira] Updated: (HIVE-1501) when generating reentrant INSERT for index rebuild, quote identifiers using backticks

2010-11-02 Thread Skye Berghel (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Skye Berghel updated HIVE-1501: --- Status: Patch Available (was: Open) when generating reentrant INSERT for index rebuild, quote

[jira] Updated: (HIVE-1497) support COMMENT clause on CREATE INDEX, and add new commands for SHOW/DESCRIBE indexes

2010-11-02 Thread Russell Melick (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1497: - Attachment: HIVE-1497.4.patch support COMMENT clause on CREATE INDEX, and add new commands for

[jira] Commented: (HIVE-1750) Remove Partition Filtering Conditions when Possible

2010-11-02 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927735#action_12927735 ] Namit Jain commented on HIVE-1750: -- The code changes look good to me. Can you add some

[jira] Commented: (HIVE-1750) Remove Partition Filtering Conditions when Possible

2010-11-02 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927737#action_12927737 ] Namit Jain commented on HIVE-1750: -- Amareshwari, can you also confirm the changes ?

[jira] Issue Comment Edited: (HIVE-1750) Remove Partition Filtering Conditions when Possible

2010-11-02 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1750?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12927735#action_12927735 ] Namit Jain edited comment on HIVE-1750 at 11/3/10 12:58 AM: The