[jira] [Updated] (HIVE-1803) Implement bitmap indexing in Hive

2011-03-22 Thread Marquis Wang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marquis Wang updated HIVE-1803: --- Attachment: HIVE-1803.7.patch New patch which I believe takes care of all the issues in the review

[jira] [Updated] (HIVE-1803) Implement bitmap indexing in Hive

2011-03-22 Thread Marquis Wang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1803?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Marquis Wang updated HIVE-1803: --- Status: Patch Available (was: Open) Implement bitmap indexing in Hive

[jira] [Commented] (HIVE-2042) In error scenario some opened streams may not closed in ExplainTask.java and Throttle.java

2011-03-22 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13009567#comment-13009567 ] Amareshwari Sriramadasu commented on HIVE-2042: --- Running tests. Will commit

Work around for using OR in Joins

2011-03-22 Thread MIS
I want to use OR in the join expression, but it seems only AND is supported as of now. I have a work around though to use DeMorgan's law {C1 OR C2 = !(!C1 AND !C2))} , but it would be nice if somebody can point me to the location in code base that would need modification to support the OR in the

Re: Work around for using OR in Joins

2011-03-22 Thread MIS
Found it at *org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.java* line no. 1122 There is some concern mentioned that supporting OR would lead to data explosion. Is it discussed/documneted in a little more detail somewhere ? If so, some pointers towards the same will be helpful. Thanks, MIS.

[jira] [Commented] (HIVE-2031) Correct the exception message for the better traceability for the scenario load into the partitioned table having 2 partitions by specifying only one partition in the l

2011-03-22 Thread Chinna Rao Lalam (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2031?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13009586#comment-13009586 ] Chinna Rao Lalam commented on HIVE-2031: Updated the patch with test cases.

[jira] [Updated] (HIVE-2042) In error scenario some opened streams may not closed in ExplainTask.java and Throttle.java

2011-03-22 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HIVE-2042: -- Resolution: Fixed Fix Version/s: 0.8.0 Status: Resolved (was:

[jira] [Updated] (HIVE-2042) In error scenario some opened streams may not closed

2011-03-22 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HIVE-2042: -- Summary: In error scenario some opened streams may not closed (was: In error

[jira] [Commented] (HIVE-2063) jdbc return only 1 collumn

2011-03-22 Thread Alexey Diomin (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13009623#comment-13009623 ] Alexey Diomin commented on HIVE-2063: - wait bug very interesting reproducing on

[jira] [Updated] (HIVE-1538) FilterOperator is applied twice with ppd on.

2011-03-22 Thread Amareshwari Sriramadasu (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-1538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amareshwari Sriramadasu updated HIVE-1538: -- Attachment: patch-1538-2.txt Added configuration

[jira] [Updated] (HIVE-2049) Push down partition pruning to JDO filtering for a subset of partition predicates

2011-03-22 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2049: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available)

[jira] [Updated] (HIVE-2003) LOAD compilation does not set the outputs during semantic analysis resulting in no authorization checks being done for it.

2011-03-22 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Krishna Kumar updated HIVE-2003: Status: Patch Available (was: Open) Please review asap as there are lots of changes to q.out files

[jira] [Commented] (HIVE-2003) LOAD compilation does not set the outputs during semantic analysis resulting in no authorization checks being done for it.

2011-03-22 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13009739#comment-13009739 ] Namit Jain commented on HIVE-2003: -- I will take a look right away LOAD compilation does

[jira] [Commented] (HIVE-2003) LOAD compilation does not set the outputs during semantic analysis resulting in no authorization checks being done for it.

2011-03-22 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13009772#comment-13009772 ] Namit Jain commented on HIVE-2003: -- Instead of adding a new configuration parameter

Build failed in Jenkins: Hive-0.7.0-h0.20 #50

2011-03-22 Thread Apache Hudson Server
See https://hudson.apache.org/hudson/job/Hive-0.7.0-h0.20/50/ -- [...truncated 27029 lines...] [junit] POSTHOOK: Output: default@srcbucket2 [junit] OK [junit] Copying file:

Build failed in Jenkins: Hive-trunk-h0.20 #632

2011-03-22 Thread Apache Hudson Server
See https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/632/ -- [...truncated 28061 lines...] [junit] POSTHOOK: query: load data local inpath 'https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt' into table

[jira] [Created] (HIVE-2069) NullPointerException on getSchemas

2011-03-22 Thread Bennie Schut (JIRA)
NullPointerException on getSchemas -- Key: HIVE-2069 URL: https://issues.apache.org/jira/browse/HIVE-2069 Project: Hive Issue Type: Bug Components: JDBC Affects Versions: 0.8.0

[jira] [Commented] (HIVE-2069) NullPointerException on getSchemas

2011-03-22 Thread Bennie Schut (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13009825#comment-13009825 ] Bennie Schut commented on HIVE-2069: java.lang.NullPointerException at

[jira] [Updated] (HIVE-2069) NullPointerException on getSchemas

2011-03-22 Thread Bennie Schut (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bennie Schut updated HIVE-2069: --- Attachment: HIVE-2069.1.patch.txt This patch includes a fix and a test which can be used to reproduce

[jira] [Updated] (HIVE-2069) NullPointerException on getSchemas

2011-03-22 Thread Bennie Schut (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bennie Schut updated HIVE-2069: --- Release Note: Fix for NullPointerException on the jdbc driver on getSchemas Status: Patch

[jira] [Commented] (HIVE-2069) NullPointerException on getSchemas

2011-03-22 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13009841#comment-13009841 ] Ning Zhang commented on HIVE-2069: -- +1. will commit if tests pass. NullPointerException

[jira] [Updated] (HIVE-2003) LOAD compilation does not set the outputs during semantic analysis resulting in no authorization checks being done for it.

2011-03-22 Thread Namit Jain (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2003?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Namit Jain updated HIVE-2003: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available)

Review Request: HIVE-2050. batch processing partition pruning process

2011-03-22 Thread Ning Zhang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/522/ --- Review request for hive. Summary --- Introducing a new metastore API to

[jira] [Updated] (HIVE-2050) batch processing partition pruning process

2011-03-22 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-2050: - Status: Patch Available (was: Open) batch processing partition pruning process

[jira] [Updated] (HIVE-2050) batch processing partition pruning process

2011-03-22 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-2050: - Attachment: HIVE-2050.patch Uploading a new patch for review. Still running tests. The review board

Meanings of privileges

2011-03-22 Thread Jonathan Natkins
Hi all, I'm trying to understand the meaning of some of the privileges in the system, and I'm a bit stumped on what some of them actually do. Privileges that confuse me: INDEX - my best guess is that this allows me to create/drop indexes on a table? Is it the case that if I have select access

Re: Meanings of privileges

2011-03-22 Thread yongqiang he
INDEX - my best guess is that this allows me to create/drop indexes on a table? Yes. It is there for this purpose. Is it the case that if I have select access on a table, I can use any index that exists on a table? No. index is also a table now, so you need to have access to both of them. LOCK

[jira] [Commented] (HIVE-2065) RCFile issues

2011-03-22 Thread Krishna Kumar (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13009981#comment-13009981 ] Krishna Kumar commented on HIVE-2065: - Hmm. #3 is taking me a bit too far than I

[jira] [Commented] (HIVE-2065) RCFile issues

2011-03-22 Thread He Yongqiang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2065?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13009982#comment-13009982 ] He Yongqiang commented on HIVE-2065: if being compatible with sequencefile does not

[jira] [Commented] (HIVE-2050) batch processing partition pruning process

2011-03-22 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13009993#comment-13009993 ] Ning Zhang commented on HIVE-2050: -- passed all unit tests. batch processing partition

Re: Work around for using OR in Joins

2011-03-22 Thread Ning Zhang
Joins with OR conditions are not supported by Hive currently. I think even though you rewrite the condition to use NOT and AND only, the results may be wrong. It is quite hard to implement joins of any tables with OR conditions in a MapReduce framework. it is straightforward to implement it

Bug in using columns with leading underscores in subqueries

2011-03-22 Thread Marquis Wang
Hi, I believe I've found a bug in the semantic analyzer (or maybe something else?). It occurs when using a column with a leading underscore in a subquery. create table temp (`_col` int, key int); select key from temp; select `_col` from temp; select key from (select key from temp) t; The

Review Request: HIVE-2069: NullPointerException on getSchemas

2011-03-22 Thread Bennie Schut
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/521/ --- Review request for hive. Summary --- HIVE-2069: NullPointerException on

[jira] [Created] (HIVE-2071) enforcereadonlytables hook should not check a configuration variable

2011-03-22 Thread Namit Jain (JIRA)
enforcereadonlytables hook should not check a configuration variable Key: HIVE-2071 URL: https://issues.apache.org/jira/browse/HIVE-2071 Project: Hive Issue Type: Bug

Re: Review Request: HIVE-1803: Implement bitmap indexing in Hive (new review starting from patch 6)

2011-03-22 Thread Marquis Wang
On None, John Sichi wrote: ql/src/java/org/apache/hadoop/hive/ql/index/compact/HiveCompactIndexInputFormat.java, line 45 https://reviews.apache.org/r/481/diff/1/?file=13771#file13771line45 I'm confused about how the backwards compatibility works for the index filename

Re: Review Request: HIVE-2054: fix for IOException on the jdbc driver on windows.

2011-03-22 Thread Bennie Schut
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/513/ --- (Updated 2011-03-21 12:50:40.422997) Review request for hive. Changes ---

Review Request: Patch for HIVE-2003: Load analysis should add table/partition to the outputs

2011-03-22 Thread Krishna
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/518/ --- Review request for hive. Summary --- Patch for HIVE-2003: Load analysis

Re: skew join optimization

2011-03-22 Thread Ted Yu
How about link to http://imageshack.us/ or TinyPic ? Thanks On Sun, Mar 20, 2011 at 7:56 AM, Edward Capriolo edlinuxg...@gmail.comwrote: On Sun, Mar 20, 2011 at 10:30 AM, Ted Yu yuzhih...@gmail.com wrote: Can someone re-attach the missing figures for that wiki ? Thanks On Sun, Mar

Re: skew join optimization

2011-03-22 Thread Ted Yu
Can someone re-attach the missing figures for that wiki ? Thanks On Sun, Mar 20, 2011 at 7:15 AM, bharath vissapragada bharathvissapragada1...@gmail.com wrote: Hi Igor, See http://wiki.apache.org/hadoop/Hive/JoinOptimization and see the jira 1642 which automatically converts a normal join

[jira] [Commented] (HIVE-2050) batch processing partition pruning process

2011-03-22 Thread Ning Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-2050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13010001#comment-13010001 ] Ning Zhang commented on HIVE-2050: -- Note that this patch implements a simple API that

Build failed in Jenkins: Hive-trunk-h0.20 #634

2011-03-22 Thread Apache Hudson Server
See https://hudson.apache.org/hudson/job/Hive-trunk-h0.20/634/changes Changes: [namit] HIVE-2003 LOAD compilation does not set the outputs during semantic analysis resulting in no authorization checks being done for it (Krishna Kumar via namit)