[jira] [Updated] (HIVE-2153) Stats JDBC LIKE queries should escape '_' and '%'

2011-05-10 Thread Paul Yang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Paul Yang updated HIVE-2153:


   Resolution: Fixed
Fix Version/s: 0.8.0
   Status: Resolved  (was: Patch Available)

Committed. Thanks Ning!

 Stats JDBC LIKE queries should escape '_' and '%'
 -

 Key: HIVE-2153
 URL: https://issues.apache.org/jira/browse/HIVE-2153
 Project: Hive
  Issue Type: Bug
Reporter: Ning Zhang
Assignee: Ning Zhang
 Fix For: 0.8.0

 Attachments: HIVE-2153.2.patch, HIVE-2153.patch


 DELETE /* Hive stats aggregation: 
 org.apache.hadoop.hive.ql.stats.jdbc.JDBCStatsAggregator */ FROM 
 PARTITION_STAT_TBL WHERE ID LIKE 
 'hdfs://dfsnode:9000/tmp/hive-root/hive_2011-05-09_04-30-28_586_4184342157898880918/-ext-1/ds=2011-05-08/table_name=dim_page_to_user_suggest_assoc/%'
 It is a prefix query but the '_' in the ID column should be escaped. The same 
 applies to '%' if they appear in ID. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


Build failed in Jenkins: Hive-trunk-h0.20 #718

2011-05-10 Thread Apache Jenkins Server
See https://builds.apache.org/hudson/job/Hive-trunk-h0.20/718/changes

Changes:

[pauly] HIVE-2153. Stats JDBC LIKE queries should escape '_' and '%' (Ning 
Zhang via pauly)

--
[...truncated 30222 lines...]
[junit] OK
[junit] PREHOOK: query: select count(1) as cnt from testhivedrivertable
[junit] PREHOOK: type: QUERY
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output: 
file:/tmp/hudson/hive_2011-05-10_05-55-36_661_6513275468715107186/-mr-1
[junit] Total MapReduce jobs = 1
[junit] Launching Job 1 out of 1
[junit] Number of reduce tasks determined at compile time: 1
[junit] In order to change the average load for a reducer (in bytes):
[junit]   set hive.exec.reducers.bytes.per.reducer=number
[junit] In order to limit the maximum number of reducers:
[junit]   set hive.exec.reducers.max=number
[junit] In order to set a constant number of reducers:
[junit]   set mapred.reduce.tasks=number
[junit] Job running in-process (local Hadoop)
[junit] Hadoop job information for null: number of mappers: 0; number of 
reducers: 0
[junit] 2011-05-10 05:55:39,782 null map = 100%,  reduce = 100%
[junit] Ended Job = job_local_0001
[junit] POSTHOOK: query: select count(1) as cnt from testhivedrivertable
[junit] POSTHOOK: type: QUERY
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output: 
file:/tmp/hudson/hive_2011-05-10_05-55-36_661_6513275468715107186/-mr-1
[junit] OK
[junit] PREHOOK: query: drop table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output: default@testhivedrivertable
[junit] POSTHOOK: query: drop table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] Hive history 
file=https://builds.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/build/service/tmp/hive_job_log_hudson_201105100555_1602658695.txt
[junit] PREHOOK: query: drop table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] POSTHOOK: query: drop table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] OK
[junit] PREHOOK: query: create table testhivedrivertable (num int)
[junit] PREHOOK: type: CREATETABLE
[junit] POSTHOOK: query: create table testhivedrivertable (num int)
[junit] POSTHOOK: type: CREATETABLE
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] PREHOOK: query: load data local inpath 
'https://builds.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt'
 into table testhivedrivertable
[junit] PREHOOK: type: LOAD
[junit] PREHOOK: Output: default@testhivedrivertable
[junit] Copying data from 
https://builds.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt
[junit] Loading data to table default.testhivedrivertable
[junit] POSTHOOK: query: load data local inpath 
'https://builds.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt'
 into table testhivedrivertable
[junit] POSTHOOK: type: LOAD
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] PREHOOK: query: select * from testhivedrivertable limit 10
[junit] PREHOOK: type: QUERY
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output: 
file:/tmp/hudson/hive_2011-05-10_05-55-41_363_8338264626926698227/-mr-1
[junit] POSTHOOK: query: select * from testhivedrivertable limit 10
[junit] POSTHOOK: type: QUERY
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output: 
file:/tmp/hudson/hive_2011-05-10_05-55-41_363_8338264626926698227/-mr-1
[junit] OK
[junit] PREHOOK: query: drop table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output: default@testhivedrivertable
[junit] POSTHOOK: query: drop table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] Hive history 
file=https://builds.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/build/service/tmp/hive_job_log_hudson_201105100555_705006652.txt
[junit] PREHOOK: query: drop table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] POSTHOOK: query: drop table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] OK
[junit] PREHOOK: query: create table testhivedrivertable (num int)
[junit] PREHOOK: type: CREATETABLE
[junit] POSTHOOK: query: create table testhivedrivertable (num int)
[junit] POSTHOOK: type: CREATETABLE
[junit] POSTHOOK: Output: default@testhivedrivertable

[jira] [Resolved] (HIVE-2151) Too many open files in running negative cli tests

2011-05-10 Thread Ning Zhang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ning Zhang resolved HIVE-2151.
--

   Resolution: Fixed
Fix Version/s: 0.8.0

Committed. Thanks Yongqiang!

 Too many open files in running negative cli tests
 -

 Key: HIVE-2151
 URL: https://issues.apache.org/jira/browse/HIVE-2151
 Project: Hive
  Issue Type: Bug
  Components: CLI, Testing Infrastructure
Reporter: He Yongqiang
Assignee: He Yongqiang
 Fix For: 0.8.0

 Attachments: HIVE-2151.1.patch, HIVE-2151.2.patch, HIVE-2151.3.patch, 
 HIVE-2151.4.patch




--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-1937) DDLSemanticAnalyzer won't take newly set Hive parameters

2011-05-10 Thread He Yongqiang (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13031265#comment-13031265
 ] 

He Yongqiang commented on HIVE-1937:


+1, will commit after tests pass

 DDLSemanticAnalyzer won't take newly set Hive parameters
 

 Key: HIVE-1937
 URL: https://issues.apache.org/jira/browse/HIVE-1937
 Project: Hive
  Issue Type: Bug
Reporter: Ning Zhang
Assignee: Ning Zhang
 Attachments: HIVE-1937.2.patch, HIVE-1937.3.patch, HIVE-1937.patch


 Hive DDLSemanticAnalyzer maintains a static reservedPartitionValue set whose 
 values come from several Hive parameters. However even if these parameters 
 are set to new values, the reservedPartitionValue are not changed. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


Build failed in Jenkins: Hive-trunk-h0.20 #719

2011-05-10 Thread Apache Jenkins Server
See https://builds.apache.org/hudson/job/Hive-trunk-h0.20/719/changes

Changes:

[nzhang] HIVE-2151. Too many open files in running negative cli tests 
(Yongqiang He via Ning Zhang)

--
[...truncated 30167 lines...]
[junit] OK
[junit] PREHOOK: query: select count(1) as cnt from testhivedrivertable
[junit] PREHOOK: type: QUERY
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output: 
file:/tmp/hudson/hive_2011-05-10_12-43-58_324_6145737906149891012/-mr-1
[junit] Total MapReduce jobs = 1
[junit] Launching Job 1 out of 1
[junit] Number of reduce tasks determined at compile time: 1
[junit] In order to change the average load for a reducer (in bytes):
[junit]   set hive.exec.reducers.bytes.per.reducer=number
[junit] In order to limit the maximum number of reducers:
[junit]   set hive.exec.reducers.max=number
[junit] In order to set a constant number of reducers:
[junit]   set mapred.reduce.tasks=number
[junit] Job running in-process (local Hadoop)
[junit] Hadoop job information for null: number of mappers: 0; number of 
reducers: 0
[junit] 2011-05-10 12:44:01,453 null map = 100%,  reduce = 100%
[junit] Ended Job = job_local_0001
[junit] POSTHOOK: query: select count(1) as cnt from testhivedrivertable
[junit] POSTHOOK: type: QUERY
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output: 
file:/tmp/hudson/hive_2011-05-10_12-43-58_324_6145737906149891012/-mr-1
[junit] OK
[junit] PREHOOK: query: drop table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output: default@testhivedrivertable
[junit] POSTHOOK: query: drop table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] Hive history 
file=https://builds.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/build/service/tmp/hive_job_log_hudson_201105101244_573531838.txt
[junit] PREHOOK: query: drop table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] POSTHOOK: query: drop table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] OK
[junit] PREHOOK: query: create table testhivedrivertable (num int)
[junit] PREHOOK: type: CREATETABLE
[junit] POSTHOOK: query: create table testhivedrivertable (num int)
[junit] POSTHOOK: type: CREATETABLE
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] PREHOOK: query: load data local inpath 
'https://builds.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt'
 into table testhivedrivertable
[junit] PREHOOK: type: LOAD
[junit] PREHOOK: Output: default@testhivedrivertable
[junit] Copying data from 
https://builds.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt
[junit] Loading data to table default.testhivedrivertable
[junit] POSTHOOK: query: load data local inpath 
'https://builds.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt'
 into table testhivedrivertable
[junit] POSTHOOK: type: LOAD
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] PREHOOK: query: select * from testhivedrivertable limit 10
[junit] PREHOOK: type: QUERY
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output: 
file:/tmp/hudson/hive_2011-05-10_12-44-02_999_7514280683366234705/-mr-1
[junit] POSTHOOK: query: select * from testhivedrivertable limit 10
[junit] POSTHOOK: type: QUERY
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output: 
file:/tmp/hudson/hive_2011-05-10_12-44-02_999_7514280683366234705/-mr-1
[junit] OK
[junit] PREHOOK: query: drop table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] PREHOOK: Input: default@testhivedrivertable
[junit] PREHOOK: Output: default@testhivedrivertable
[junit] POSTHOOK: query: drop table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] POSTHOOK: Input: default@testhivedrivertable
[junit] POSTHOOK: Output: default@testhivedrivertable
[junit] OK
[junit] Hive history 
file=https://builds.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/build/service/tmp/hive_job_log_hudson_201105101244_336340304.txt
[junit] PREHOOK: query: drop table testhivedrivertable
[junit] PREHOOK: type: DROPTABLE
[junit] POSTHOOK: query: drop table testhivedrivertable
[junit] POSTHOOK: type: DROPTABLE
[junit] OK
[junit] PREHOOK: query: create table testhivedrivertable (num int)
[junit] PREHOOK: type: CREATETABLE
[junit] POSTHOOK: query: create table testhivedrivertable (num int)
[junit] POSTHOOK: type: CREATETABLE
[junit] POSTHOOK: Output: 

[jira] [Created] (HIVE-2157) NPE in MapJoinObjectKey

2011-05-10 Thread He Yongqiang (JIRA)
NPE in MapJoinObjectKey
---

 Key: HIVE-2157
 URL: https://issues.apache.org/jira/browse/HIVE-2157
 Project: Hive
  Issue Type: Bug
Reporter: He Yongqiang




--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-2157) NPE in MapJoinObjectKey

2011-05-10 Thread He Yongqiang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

He Yongqiang updated HIVE-2157:
---

Attachment: HIVE-2157.1.patch

 NPE in MapJoinObjectKey
 ---

 Key: HIVE-2157
 URL: https://issues.apache.org/jira/browse/HIVE-2157
 Project: Hive
  Issue Type: Bug
Reporter: He Yongqiang
 Attachments: HIVE-2157.1.patch




--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-2157) NPE in MapJoinObjectKey

2011-05-10 Thread Namit Jain (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13031353#comment-13031353
 ] 

Namit Jain commented on HIVE-2157:
--

+1

 NPE in MapJoinObjectKey
 ---

 Key: HIVE-2157
 URL: https://issues.apache.org/jira/browse/HIVE-2157
 Project: Hive
  Issue Type: Bug
Reporter: He Yongqiang
Assignee: He Yongqiang
 Attachments: HIVE-2157.1.patch




--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-2096) throw a error if the input is larger than a threshold for index input format

2011-05-10 Thread Wojciech Galuba (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Wojciech Galuba updated HIVE-2096:
--

Affects Version/s: 0.8.0
   Status: Patch Available  (was: Open)

Added two options:
hive.index.compact.query.max.bytes - the maximum number of bytes that a query 
using the compact index can read
hive.index.compact.query.max.entries - the maximum number of entries to read 
from the index file during a query

If any of these thresholds are exceeded then an exception is thrown.

 throw a error if the input is larger than a threshold for index input format
 

 Key: HIVE-2096
 URL: https://issues.apache.org/jira/browse/HIVE-2096
 Project: Hive
  Issue Type: Bug
Affects Versions: 0.8.0
Reporter: Namit Jain
Assignee: He Yongqiang

 This can hang for ever.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-243) ^C breaks out of running query, but not whole CLI

2011-05-10 Thread jirapos...@reviews.apache.org (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13031404#comment-13031404
 ] 

jirapos...@reviews.apache.org commented on HIVE-243:



---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/626/
---

(Updated 2011-05-10 21:55:56.707055)


Review request for hive.


Changes
---

Fixed some white space formatting


Summary
---

Fixed by adding INT signal hander that interrupts the CLI thread. The CLI 
thread gets InterruptedException and it stops the current command.


This addresses bug HIVE-243.
https://issues.apache.org/jira/browse/HIVE-243


Diffs (updated)
-

  trunk/cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java 1100312 
  
trunk/common/src/java/org/apache/hadoop/hive/common/HiveInterruptCallback.java 
PRE-CREATION 
  trunk/common/src/java/org/apache/hadoop/hive/common/HiveInterruptUtils.java 
PRE-CREATION 
  trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java 
1100312 
  trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java 
1100312 
  trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java 1100312 

Diff: https://reviews.apache.org/r/626/diff


Testing
---

Manual test Ctrl+C on bunch of command (show tables, select, etc)
Tested interrupting the command on large data set in different stages of the 
processing (JDO, MapReduce, building the input summary).
example queries:
explain select count(*) from xyz where ds = '2011-02-01';
select count(*) from xyz where ds = '2011-02-01';


Thanks,

georgedj



 ^C breaks out of running query, but not whole CLI
 -

 Key: HIVE-243
 URL: https://issues.apache.org/jira/browse/HIVE-243
 Project: Hive
  Issue Type: Wish
  Components: Query Processor
Affects Versions: 0.8.0
Reporter: Adam Kramer

 It would be lovely if, when I know a query is bad, I could just ^C out of it. 
 I can do that now, but the whole CLI quits.
 It'd be quite nice if it took an extra ^C to break the CLI, or if there was 
 some control character to break out of a query without breaking out of the 
 CLI.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


Re: Review Request: HIVE-243 - ^C breaks out of running query, but not whole CLI.

2011-05-10 Thread djabarov

---
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/626/
---

(Updated 2011-05-10 21:55:56.707055)


Review request for hive.


Changes
---

Fixed some white space formatting


Summary
---

Fixed by adding INT signal hander that interrupts the CLI thread. The CLI 
thread gets InterruptedException and it stops the current command.


This addresses bug HIVE-243.
https://issues.apache.org/jira/browse/HIVE-243


Diffs (updated)
-

  trunk/cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java 1100312 
  
trunk/common/src/java/org/apache/hadoop/hive/common/HiveInterruptCallback.java 
PRE-CREATION 
  trunk/common/src/java/org/apache/hadoop/hive/common/HiveInterruptUtils.java 
PRE-CREATION 
  trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java 
1100312 
  trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java 
1100312 
  trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java 1100312 

Diff: https://reviews.apache.org/r/626/diff


Testing
---

Manual test Ctrl+C on bunch of command (show tables, select, etc)
Tested interrupting the command on large data set in different stages of the 
processing (JDO, MapReduce, building the input summary).
example queries:
explain select count(*) from xyz where ds = '2011-02-01';
select count(*) from xyz where ds = '2011-02-01';


Thanks,

georgedj



[jira] [Assigned] (HIVE-1502) finish the index design doc

2011-05-10 Thread He Yongqiang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

He Yongqiang reassigned HIVE-1502:
--

Assignee: (was: He Yongqiang)

 finish the index design doc
 ---

 Key: HIVE-1502
 URL: https://issues.apache.org/jira/browse/HIVE-1502
 Project: Hive
  Issue Type: Improvement
  Components: Indexing
Affects Versions: 0.7.0
Reporter: John Sichi

 * regenerate the metastore schema diagram to match the final column names
 * update Plugin Interface section to match the latest code
 * fill out TBD's in the Reference Implementation section
 * resolve other TBD's or link them to followup JIRA's

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Assigned] (HIVE-1800) Lock and Unlock does not populate inputs and outputs.

2011-05-10 Thread He Yongqiang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

He Yongqiang reassigned HIVE-1800:
--

Assignee: (was: He Yongqiang)

 Lock and Unlock does not populate inputs and outputs.
 -

 Key: HIVE-1800
 URL: https://issues.apache.org/jira/browse/HIVE-1800
 Project: Hive
  Issue Type: Bug
Reporter: He Yongqiang



--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Assigned] (HIVE-1285) does sort merge join work with preserve join

2011-05-10 Thread He Yongqiang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

He Yongqiang reassigned HIVE-1285:
--

Assignee: (was: He Yongqiang)

 does sort merge join work with preserve join
 

 Key: HIVE-1285
 URL: https://issues.apache.org/jira/browse/HIVE-1285
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Reporter: Namit Jain

 This needs to be checked

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Assigned] (HIVE-1210) code cleanup for sort-merge join

2011-05-10 Thread He Yongqiang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

He Yongqiang reassigned HIVE-1210:
--

Assignee: (was: He Yongqiang)

 code cleanup for sort-merge join 
 -

 Key: HIVE-1210
 URL: https://issues.apache.org/jira/browse/HIVE-1210
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Reporter: Namit Jain

 It would be good to have a operator-local work mapping.
 The operator in question knows how to process the local work

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Assigned] (HIVE-2013) Add a parameter in the Partition object to indicate it's privilege is the same as table level privilege

2011-05-10 Thread He Yongqiang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

He Yongqiang reassigned HIVE-2013:
--

Assignee: (was: He Yongqiang)

 Add a parameter in the Partition object to indicate it's privilege is the 
 same as table level privilege
 ---

 Key: HIVE-2013
 URL: https://issues.apache.org/jira/browse/HIVE-2013
 Project: Hive
  Issue Type: Improvement
Reporter: Ning Zhang

 If a query involves many partitions, checking privilege for each partition 
 could be very expensive. An optimization is to indicate in the partition 
 metadata that its privilege is the same as table level (default) privilege so 
 that we only do 1 ACL checking for the set of partitions having the default 
 privilege. 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Assigned] (HIVE-2089) Add a new input format to be able to combine multiple .gz text files

2011-05-10 Thread He Yongqiang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

He Yongqiang reassigned HIVE-2089:
--

Assignee: (was: He Yongqiang)

 Add a new input format to be able to combine multiple .gz text files
 

 Key: HIVE-2089
 URL: https://issues.apache.org/jira/browse/HIVE-2089
 Project: Hive
  Issue Type: New Feature
Reporter: He Yongqiang
 Attachments: HIVE-2089.1.patch


 For files that is not splittable, CombineHiveInputFormat won't help. This 
 jira is to add a new inputformat to support this feature. This is very useful 
 for partitions with tens of thousands of .gz files.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Assigned] (HIVE-2035) Use block-level merge for RCFile if merging intermediate results are needed

2011-05-10 Thread He Yongqiang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

He Yongqiang reassigned HIVE-2035:
--

Assignee: (was: He Yongqiang)

 Use block-level merge for RCFile if merging intermediate results are needed
 ---

 Key: HIVE-2035
 URL: https://issues.apache.org/jira/browse/HIVE-2035
 Project: Hive
  Issue Type: Improvement
Reporter: Ning Zhang

 Currently if hive.merge.mapredfiles and/or hive.merge.mapfile is set to true 
 the intermediate data could be merged using an additional MapReduce job. This 
 could be quite expensive if the data size is large. With HIVE-1950, merging 
 can be done in the RCFile block level so that it bypasses the 
 (de-)compression, (de-)serialization phases. This could improve the merge 
 process significantly. 
 This JIRA should handle the case where the input table is not stored in 
 RCFile, but the destination table is (which requires the intermediate data 
 should be stored in the same format as the destination table). 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Assigned] (HIVE-2096) throw a error if the input is larger than a threshold for index input format

2011-05-10 Thread He Yongqiang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

He Yongqiang reassigned HIVE-2096:
--

Assignee: (was: He Yongqiang)

 throw a error if the input is larger than a threshold for index input format
 

 Key: HIVE-2096
 URL: https://issues.apache.org/jira/browse/HIVE-2096
 Project: Hive
  Issue Type: Bug
Affects Versions: 0.8.0
Reporter: Namit Jain
 Attachments: HIVE-2096.1.patch.txt


 This can hang for ever.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Assigned] (HIVE-1886) HIVE-78 Followup: move a list of columns from PrivilegeDesc to PrivilegeObjectDesc

2011-05-10 Thread He Yongqiang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

He Yongqiang reassigned HIVE-1886:
--

Assignee: (was: He Yongqiang)

 HIVE-78 Followup: move a list of columns from PrivilegeDesc to 
 PrivilegeObjectDesc
 --

 Key: HIVE-1886
 URL: https://issues.apache.org/jira/browse/HIVE-1886
 Project: Hive
  Issue Type: Improvement
Reporter: He Yongqiang

 This is a follow up for HIVE-78.
 {quote}
 PrivilegeObjectDesc.java: should contain a list of columns.
 Remove columns from PrivilegeDesc. - PrivilegeDesc can be removed all 
 together
 It is same as Privilege
 {quote}

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Assigned] (HIVE-1282) sort merge join should error out if bucketizedhiveinputformat is not used

2011-05-10 Thread He Yongqiang (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

He Yongqiang reassigned HIVE-1282:
--

Assignee: (was: He Yongqiang)

 sort merge join should error out if bucketizedhiveinputformat is not used
 -

 Key: HIVE-1282
 URL: https://issues.apache.org/jira/browse/HIVE-1282
 Project: Hive
  Issue Type: Bug
  Components: Query Processor
Reporter: Namit Jain

 Please add a check 

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-2148) Add interface classification in Hive.

2011-05-10 Thread Carl Steinbach (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Carl Steinbach updated HIVE-2148:
-

  Resolution: Fixed
Hadoop Flags: [Reviewed]
  Status: Resolved  (was: Patch Available)

Committed to trunk. Thanks Ashutosh!

 Add interface classification in Hive.
 -

 Key: HIVE-2148
 URL: https://issues.apache.org/jira/browse/HIVE-2148
 Project: Hive
  Issue Type: Improvement
  Components: Metastore
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Attachments: classification.patch


 Add mechanism for marking stability and intended audiences in Hive.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-2148) Add interface classification in Hive.

2011-05-10 Thread Carl Steinbach (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Carl Steinbach updated HIVE-2148:
-

Fix Version/s: 0.8.0

 Add interface classification in Hive.
 -

 Key: HIVE-2148
 URL: https://issues.apache.org/jira/browse/HIVE-2148
 Project: Hive
  Issue Type: Improvement
  Components: Metastore
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Fix For: 0.8.0

 Attachments: classification.patch


 Add mechanism for marking stability and intended audiences in Hive.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-2147) Add api to send / receive message to metastore

2011-05-10 Thread Carl Steinbach (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13031476#comment-13031476
 ] 

Carl Steinbach commented on HIVE-2147:
--

@Ashutosh: can you please post a reviewboard request? Thanks.

 Add api to send / receive message to metastore
 --

 Key: HIVE-2147
 URL: https://issues.apache.org/jira/browse/HIVE-2147
 Project: Hive
  Issue Type: Improvement
  Components: Metastore
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Fix For: 0.8.0

 Attachments: api-without-thrift.patch


 This is follow-up work on HIVE-2038.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Commented] (HIVE-2134) Remove System.exit

2011-05-10 Thread Amareshwari Sriramadasu (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13031541#comment-13031541
 ] 

Amareshwari Sriramadasu commented on HIVE-2134:
---

Looks fine. Will commit if tests pass.

 Remove System.exit 
 ---

 Key: HIVE-2134
 URL: https://issues.apache.org/jira/browse/HIVE-2134
 Project: Hive
  Issue Type: Improvement
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Fix For: 0.8.0

 Attachments: hive_2134.patch, no_sysexit.patch


 System.exit exists in various places in code. Its good to get rid of it.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-2148) Add interface classification in Hive.

2011-05-10 Thread Ashutosh Chauhan (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-2148:
---

Attachment: hive_2148.patch

Sorry Carl, the patch was incomplete. There is one more method run() of Command 
whose visibility I wanted to change. Incremental patch attached.

 Add interface classification in Hive.
 -

 Key: HIVE-2148
 URL: https://issues.apache.org/jira/browse/HIVE-2148
 Project: Hive
  Issue Type: Improvement
  Components: Metastore
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Fix For: 0.8.0

 Attachments: classification.patch, hive_2148.patch


 Add mechanism for marking stability and intended audiences in Hive.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Reopened] (HIVE-2148) Add interface classification in Hive.

2011-05-10 Thread Ashutosh Chauhan (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan reopened HIVE-2148:



 Add interface classification in Hive.
 -

 Key: HIVE-2148
 URL: https://issues.apache.org/jira/browse/HIVE-2148
 Project: Hive
  Issue Type: Improvement
  Components: Metastore
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Fix For: 0.8.0

 Attachments: classification.patch, hive_2148.patch


 Add mechanism for marking stability and intended audiences in Hive.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira


[jira] [Updated] (HIVE-2148) Add interface classification in Hive.

2011-05-10 Thread Ashutosh Chauhan (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ashutosh Chauhan updated HIVE-2148:
---

Status: Patch Available  (was: Reopened)

 Add interface classification in Hive.
 -

 Key: HIVE-2148
 URL: https://issues.apache.org/jira/browse/HIVE-2148
 Project: Hive
  Issue Type: Improvement
  Components: Metastore
Reporter: Ashutosh Chauhan
Assignee: Ashutosh Chauhan
 Fix For: 0.8.0

 Attachments: classification.patch, hive_2148.patch


 Add mechanism for marking stability and intended audiences in Hive.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira