[jira] [Updated] (HIVE-2153) Stats JDBC LIKE queries should escape '_' and '%'
[ https://issues.apache.org/jira/browse/HIVE-2153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Yang updated HIVE-2153: Resolution: Fixed Fix Version/s: 0.8.0 Status: Resolved (was: Patch Available) Committed. Thanks Ning! Stats JDBC LIKE queries should escape '_' and '%' - Key: HIVE-2153 URL: https://issues.apache.org/jira/browse/HIVE-2153 Project: Hive Issue Type: Bug Reporter: Ning Zhang Assignee: Ning Zhang Fix For: 0.8.0 Attachments: HIVE-2153.2.patch, HIVE-2153.patch DELETE /* Hive stats aggregation: org.apache.hadoop.hive.ql.stats.jdbc.JDBCStatsAggregator */ FROM PARTITION_STAT_TBL WHERE ID LIKE 'hdfs://dfsnode:9000/tmp/hive-root/hive_2011-05-09_04-30-28_586_4184342157898880918/-ext-1/ds=2011-05-08/table_name=dim_page_to_user_suggest_assoc/%' It is a prefix query but the '_' in the ID column should be escaped. The same applies to '%' if they appear in ID. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
Build failed in Jenkins: Hive-trunk-h0.20 #718
See https://builds.apache.org/hudson/job/Hive-trunk-h0.20/718/changes Changes: [pauly] HIVE-2153. Stats JDBC LIKE queries should escape '_' and '%' (Ning Zhang via pauly) -- [...truncated 30222 lines...] [junit] OK [junit] PREHOOK: query: select count(1) as cnt from testhivedrivertable [junit] PREHOOK: type: QUERY [junit] PREHOOK: Input: default@testhivedrivertable [junit] PREHOOK: Output: file:/tmp/hudson/hive_2011-05-10_05-55-36_661_6513275468715107186/-mr-1 [junit] Total MapReduce jobs = 1 [junit] Launching Job 1 out of 1 [junit] Number of reduce tasks determined at compile time: 1 [junit] In order to change the average load for a reducer (in bytes): [junit] set hive.exec.reducers.bytes.per.reducer=number [junit] In order to limit the maximum number of reducers: [junit] set hive.exec.reducers.max=number [junit] In order to set a constant number of reducers: [junit] set mapred.reduce.tasks=number [junit] Job running in-process (local Hadoop) [junit] Hadoop job information for null: number of mappers: 0; number of reducers: 0 [junit] 2011-05-10 05:55:39,782 null map = 100%, reduce = 100% [junit] Ended Job = job_local_0001 [junit] POSTHOOK: query: select count(1) as cnt from testhivedrivertable [junit] POSTHOOK: type: QUERY [junit] POSTHOOK: Input: default@testhivedrivertable [junit] POSTHOOK: Output: file:/tmp/hudson/hive_2011-05-10_05-55-36_661_6513275468715107186/-mr-1 [junit] OK [junit] PREHOOK: query: drop table testhivedrivertable [junit] PREHOOK: type: DROPTABLE [junit] PREHOOK: Input: default@testhivedrivertable [junit] PREHOOK: Output: default@testhivedrivertable [junit] POSTHOOK: query: drop table testhivedrivertable [junit] POSTHOOK: type: DROPTABLE [junit] POSTHOOK: Input: default@testhivedrivertable [junit] POSTHOOK: Output: default@testhivedrivertable [junit] OK [junit] Hive history file=https://builds.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/build/service/tmp/hive_job_log_hudson_201105100555_1602658695.txt [junit] PREHOOK: query: drop table testhivedrivertable [junit] PREHOOK: type: DROPTABLE [junit] POSTHOOK: query: drop table testhivedrivertable [junit] POSTHOOK: type: DROPTABLE [junit] OK [junit] PREHOOK: query: create table testhivedrivertable (num int) [junit] PREHOOK: type: CREATETABLE [junit] POSTHOOK: query: create table testhivedrivertable (num int) [junit] POSTHOOK: type: CREATETABLE [junit] POSTHOOK: Output: default@testhivedrivertable [junit] OK [junit] PREHOOK: query: load data local inpath 'https://builds.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt' into table testhivedrivertable [junit] PREHOOK: type: LOAD [junit] PREHOOK: Output: default@testhivedrivertable [junit] Copying data from https://builds.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt [junit] Loading data to table default.testhivedrivertable [junit] POSTHOOK: query: load data local inpath 'https://builds.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt' into table testhivedrivertable [junit] POSTHOOK: type: LOAD [junit] POSTHOOK: Output: default@testhivedrivertable [junit] OK [junit] PREHOOK: query: select * from testhivedrivertable limit 10 [junit] PREHOOK: type: QUERY [junit] PREHOOK: Input: default@testhivedrivertable [junit] PREHOOK: Output: file:/tmp/hudson/hive_2011-05-10_05-55-41_363_8338264626926698227/-mr-1 [junit] POSTHOOK: query: select * from testhivedrivertable limit 10 [junit] POSTHOOK: type: QUERY [junit] POSTHOOK: Input: default@testhivedrivertable [junit] POSTHOOK: Output: file:/tmp/hudson/hive_2011-05-10_05-55-41_363_8338264626926698227/-mr-1 [junit] OK [junit] PREHOOK: query: drop table testhivedrivertable [junit] PREHOOK: type: DROPTABLE [junit] PREHOOK: Input: default@testhivedrivertable [junit] PREHOOK: Output: default@testhivedrivertable [junit] POSTHOOK: query: drop table testhivedrivertable [junit] POSTHOOK: type: DROPTABLE [junit] POSTHOOK: Input: default@testhivedrivertable [junit] POSTHOOK: Output: default@testhivedrivertable [junit] OK [junit] Hive history file=https://builds.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/build/service/tmp/hive_job_log_hudson_201105100555_705006652.txt [junit] PREHOOK: query: drop table testhivedrivertable [junit] PREHOOK: type: DROPTABLE [junit] POSTHOOK: query: drop table testhivedrivertable [junit] POSTHOOK: type: DROPTABLE [junit] OK [junit] PREHOOK: query: create table testhivedrivertable (num int) [junit] PREHOOK: type: CREATETABLE [junit] POSTHOOK: query: create table testhivedrivertable (num int) [junit] POSTHOOK: type: CREATETABLE [junit] POSTHOOK: Output: default@testhivedrivertable
[jira] [Resolved] (HIVE-2151) Too many open files in running negative cli tests
[ https://issues.apache.org/jira/browse/HIVE-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang resolved HIVE-2151. -- Resolution: Fixed Fix Version/s: 0.8.0 Committed. Thanks Yongqiang! Too many open files in running negative cli tests - Key: HIVE-2151 URL: https://issues.apache.org/jira/browse/HIVE-2151 Project: Hive Issue Type: Bug Components: CLI, Testing Infrastructure Reporter: He Yongqiang Assignee: He Yongqiang Fix For: 0.8.0 Attachments: HIVE-2151.1.patch, HIVE-2151.2.patch, HIVE-2151.3.patch, HIVE-2151.4.patch -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-1937) DDLSemanticAnalyzer won't take newly set Hive parameters
[ https://issues.apache.org/jira/browse/HIVE-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13031265#comment-13031265 ] He Yongqiang commented on HIVE-1937: +1, will commit after tests pass DDLSemanticAnalyzer won't take newly set Hive parameters Key: HIVE-1937 URL: https://issues.apache.org/jira/browse/HIVE-1937 Project: Hive Issue Type: Bug Reporter: Ning Zhang Assignee: Ning Zhang Attachments: HIVE-1937.2.patch, HIVE-1937.3.patch, HIVE-1937.patch Hive DDLSemanticAnalyzer maintains a static reservedPartitionValue set whose values come from several Hive parameters. However even if these parameters are set to new values, the reservedPartitionValue are not changed. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
Build failed in Jenkins: Hive-trunk-h0.20 #719
See https://builds.apache.org/hudson/job/Hive-trunk-h0.20/719/changes Changes: [nzhang] HIVE-2151. Too many open files in running negative cli tests (Yongqiang He via Ning Zhang) -- [...truncated 30167 lines...] [junit] OK [junit] PREHOOK: query: select count(1) as cnt from testhivedrivertable [junit] PREHOOK: type: QUERY [junit] PREHOOK: Input: default@testhivedrivertable [junit] PREHOOK: Output: file:/tmp/hudson/hive_2011-05-10_12-43-58_324_6145737906149891012/-mr-1 [junit] Total MapReduce jobs = 1 [junit] Launching Job 1 out of 1 [junit] Number of reduce tasks determined at compile time: 1 [junit] In order to change the average load for a reducer (in bytes): [junit] set hive.exec.reducers.bytes.per.reducer=number [junit] In order to limit the maximum number of reducers: [junit] set hive.exec.reducers.max=number [junit] In order to set a constant number of reducers: [junit] set mapred.reduce.tasks=number [junit] Job running in-process (local Hadoop) [junit] Hadoop job information for null: number of mappers: 0; number of reducers: 0 [junit] 2011-05-10 12:44:01,453 null map = 100%, reduce = 100% [junit] Ended Job = job_local_0001 [junit] POSTHOOK: query: select count(1) as cnt from testhivedrivertable [junit] POSTHOOK: type: QUERY [junit] POSTHOOK: Input: default@testhivedrivertable [junit] POSTHOOK: Output: file:/tmp/hudson/hive_2011-05-10_12-43-58_324_6145737906149891012/-mr-1 [junit] OK [junit] PREHOOK: query: drop table testhivedrivertable [junit] PREHOOK: type: DROPTABLE [junit] PREHOOK: Input: default@testhivedrivertable [junit] PREHOOK: Output: default@testhivedrivertable [junit] POSTHOOK: query: drop table testhivedrivertable [junit] POSTHOOK: type: DROPTABLE [junit] POSTHOOK: Input: default@testhivedrivertable [junit] POSTHOOK: Output: default@testhivedrivertable [junit] OK [junit] Hive history file=https://builds.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/build/service/tmp/hive_job_log_hudson_201105101244_573531838.txt [junit] PREHOOK: query: drop table testhivedrivertable [junit] PREHOOK: type: DROPTABLE [junit] POSTHOOK: query: drop table testhivedrivertable [junit] POSTHOOK: type: DROPTABLE [junit] OK [junit] PREHOOK: query: create table testhivedrivertable (num int) [junit] PREHOOK: type: CREATETABLE [junit] POSTHOOK: query: create table testhivedrivertable (num int) [junit] POSTHOOK: type: CREATETABLE [junit] POSTHOOK: Output: default@testhivedrivertable [junit] OK [junit] PREHOOK: query: load data local inpath 'https://builds.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt' into table testhivedrivertable [junit] PREHOOK: type: LOAD [junit] PREHOOK: Output: default@testhivedrivertable [junit] Copying data from https://builds.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt [junit] Loading data to table default.testhivedrivertable [junit] POSTHOOK: query: load data local inpath 'https://builds.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/data/files/kv1.txt' into table testhivedrivertable [junit] POSTHOOK: type: LOAD [junit] POSTHOOK: Output: default@testhivedrivertable [junit] OK [junit] PREHOOK: query: select * from testhivedrivertable limit 10 [junit] PREHOOK: type: QUERY [junit] PREHOOK: Input: default@testhivedrivertable [junit] PREHOOK: Output: file:/tmp/hudson/hive_2011-05-10_12-44-02_999_7514280683366234705/-mr-1 [junit] POSTHOOK: query: select * from testhivedrivertable limit 10 [junit] POSTHOOK: type: QUERY [junit] POSTHOOK: Input: default@testhivedrivertable [junit] POSTHOOK: Output: file:/tmp/hudson/hive_2011-05-10_12-44-02_999_7514280683366234705/-mr-1 [junit] OK [junit] PREHOOK: query: drop table testhivedrivertable [junit] PREHOOK: type: DROPTABLE [junit] PREHOOK: Input: default@testhivedrivertable [junit] PREHOOK: Output: default@testhivedrivertable [junit] POSTHOOK: query: drop table testhivedrivertable [junit] POSTHOOK: type: DROPTABLE [junit] POSTHOOK: Input: default@testhivedrivertable [junit] POSTHOOK: Output: default@testhivedrivertable [junit] OK [junit] Hive history file=https://builds.apache.org/hudson/job/Hive-trunk-h0.20/ws/hive/build/service/tmp/hive_job_log_hudson_201105101244_336340304.txt [junit] PREHOOK: query: drop table testhivedrivertable [junit] PREHOOK: type: DROPTABLE [junit] POSTHOOK: query: drop table testhivedrivertable [junit] POSTHOOK: type: DROPTABLE [junit] OK [junit] PREHOOK: query: create table testhivedrivertable (num int) [junit] PREHOOK: type: CREATETABLE [junit] POSTHOOK: query: create table testhivedrivertable (num int) [junit] POSTHOOK: type: CREATETABLE [junit] POSTHOOK: Output:
[jira] [Created] (HIVE-2157) NPE in MapJoinObjectKey
NPE in MapJoinObjectKey --- Key: HIVE-2157 URL: https://issues.apache.org/jira/browse/HIVE-2157 Project: Hive Issue Type: Bug Reporter: He Yongqiang -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2157) NPE in MapJoinObjectKey
[ https://issues.apache.org/jira/browse/HIVE-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang updated HIVE-2157: --- Attachment: HIVE-2157.1.patch NPE in MapJoinObjectKey --- Key: HIVE-2157 URL: https://issues.apache.org/jira/browse/HIVE-2157 Project: Hive Issue Type: Bug Reporter: He Yongqiang Attachments: HIVE-2157.1.patch -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2157) NPE in MapJoinObjectKey
[ https://issues.apache.org/jira/browse/HIVE-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13031353#comment-13031353 ] Namit Jain commented on HIVE-2157: -- +1 NPE in MapJoinObjectKey --- Key: HIVE-2157 URL: https://issues.apache.org/jira/browse/HIVE-2157 Project: Hive Issue Type: Bug Reporter: He Yongqiang Assignee: He Yongqiang Attachments: HIVE-2157.1.patch -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2096) throw a error if the input is larger than a threshold for index input format
[ https://issues.apache.org/jira/browse/HIVE-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wojciech Galuba updated HIVE-2096: -- Affects Version/s: 0.8.0 Status: Patch Available (was: Open) Added two options: hive.index.compact.query.max.bytes - the maximum number of bytes that a query using the compact index can read hive.index.compact.query.max.entries - the maximum number of entries to read from the index file during a query If any of these thresholds are exceeded then an exception is thrown. throw a error if the input is larger than a threshold for index input format Key: HIVE-2096 URL: https://issues.apache.org/jira/browse/HIVE-2096 Project: Hive Issue Type: Bug Affects Versions: 0.8.0 Reporter: Namit Jain Assignee: He Yongqiang This can hang for ever. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-243) ^C breaks out of running query, but not whole CLI
[ https://issues.apache.org/jira/browse/HIVE-243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13031404#comment-13031404 ] jirapos...@reviews.apache.org commented on HIVE-243: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/626/ --- (Updated 2011-05-10 21:55:56.707055) Review request for hive. Changes --- Fixed some white space formatting Summary --- Fixed by adding INT signal hander that interrupts the CLI thread. The CLI thread gets InterruptedException and it stops the current command. This addresses bug HIVE-243. https://issues.apache.org/jira/browse/HIVE-243 Diffs (updated) - trunk/cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java 1100312 trunk/common/src/java/org/apache/hadoop/hive/common/HiveInterruptCallback.java PRE-CREATION trunk/common/src/java/org/apache/hadoop/hive/common/HiveInterruptUtils.java PRE-CREATION trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java 1100312 trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java 1100312 trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java 1100312 Diff: https://reviews.apache.org/r/626/diff Testing --- Manual test Ctrl+C on bunch of command (show tables, select, etc) Tested interrupting the command on large data set in different stages of the processing (JDO, MapReduce, building the input summary). example queries: explain select count(*) from xyz where ds = '2011-02-01'; select count(*) from xyz where ds = '2011-02-01'; Thanks, georgedj ^C breaks out of running query, but not whole CLI - Key: HIVE-243 URL: https://issues.apache.org/jira/browse/HIVE-243 Project: Hive Issue Type: Wish Components: Query Processor Affects Versions: 0.8.0 Reporter: Adam Kramer It would be lovely if, when I know a query is bad, I could just ^C out of it. I can do that now, but the whole CLI quits. It'd be quite nice if it took an extra ^C to break the CLI, or if there was some control character to break out of a query without breaking out of the CLI. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: Review Request: HIVE-243 - ^C breaks out of running query, but not whole CLI.
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/626/ --- (Updated 2011-05-10 21:55:56.707055) Review request for hive. Changes --- Fixed some white space formatting Summary --- Fixed by adding INT signal hander that interrupts the CLI thread. The CLI thread gets InterruptedException and it stops the current command. This addresses bug HIVE-243. https://issues.apache.org/jira/browse/HIVE-243 Diffs (updated) - trunk/cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java 1100312 trunk/common/src/java/org/apache/hadoop/hive/common/HiveInterruptCallback.java PRE-CREATION trunk/common/src/java/org/apache/hadoop/hive/common/HiveInterruptUtils.java PRE-CREATION trunk/metastore/src/java/org/apache/hadoop/hive/metastore/ObjectStore.java 1100312 trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/HadoopJobExecHelper.java 1100312 trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java 1100312 Diff: https://reviews.apache.org/r/626/diff Testing --- Manual test Ctrl+C on bunch of command (show tables, select, etc) Tested interrupting the command on large data set in different stages of the processing (JDO, MapReduce, building the input summary). example queries: explain select count(*) from xyz where ds = '2011-02-01'; select count(*) from xyz where ds = '2011-02-01'; Thanks, georgedj
[jira] [Assigned] (HIVE-1502) finish the index design doc
[ https://issues.apache.org/jira/browse/HIVE-1502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang reassigned HIVE-1502: -- Assignee: (was: He Yongqiang) finish the index design doc --- Key: HIVE-1502 URL: https://issues.apache.org/jira/browse/HIVE-1502 Project: Hive Issue Type: Improvement Components: Indexing Affects Versions: 0.7.0 Reporter: John Sichi * regenerate the metastore schema diagram to match the final column names * update Plugin Interface section to match the latest code * fill out TBD's in the Reference Implementation section * resolve other TBD's or link them to followup JIRA's -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-1800) Lock and Unlock does not populate inputs and outputs.
[ https://issues.apache.org/jira/browse/HIVE-1800?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang reassigned HIVE-1800: -- Assignee: (was: He Yongqiang) Lock and Unlock does not populate inputs and outputs. - Key: HIVE-1800 URL: https://issues.apache.org/jira/browse/HIVE-1800 Project: Hive Issue Type: Bug Reporter: He Yongqiang -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-1285) does sort merge join work with preserve join
[ https://issues.apache.org/jira/browse/HIVE-1285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang reassigned HIVE-1285: -- Assignee: (was: He Yongqiang) does sort merge join work with preserve join Key: HIVE-1285 URL: https://issues.apache.org/jira/browse/HIVE-1285 Project: Hive Issue Type: Bug Components: Query Processor Reporter: Namit Jain This needs to be checked -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-1210) code cleanup for sort-merge join
[ https://issues.apache.org/jira/browse/HIVE-1210?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang reassigned HIVE-1210: -- Assignee: (was: He Yongqiang) code cleanup for sort-merge join - Key: HIVE-1210 URL: https://issues.apache.org/jira/browse/HIVE-1210 Project: Hive Issue Type: Bug Components: Query Processor Reporter: Namit Jain It would be good to have a operator-local work mapping. The operator in question knows how to process the local work -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-2013) Add a parameter in the Partition object to indicate it's privilege is the same as table level privilege
[ https://issues.apache.org/jira/browse/HIVE-2013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang reassigned HIVE-2013: -- Assignee: (was: He Yongqiang) Add a parameter in the Partition object to indicate it's privilege is the same as table level privilege --- Key: HIVE-2013 URL: https://issues.apache.org/jira/browse/HIVE-2013 Project: Hive Issue Type: Improvement Reporter: Ning Zhang If a query involves many partitions, checking privilege for each partition could be very expensive. An optimization is to indicate in the partition metadata that its privilege is the same as table level (default) privilege so that we only do 1 ACL checking for the set of partitions having the default privilege. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-2089) Add a new input format to be able to combine multiple .gz text files
[ https://issues.apache.org/jira/browse/HIVE-2089?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang reassigned HIVE-2089: -- Assignee: (was: He Yongqiang) Add a new input format to be able to combine multiple .gz text files Key: HIVE-2089 URL: https://issues.apache.org/jira/browse/HIVE-2089 Project: Hive Issue Type: New Feature Reporter: He Yongqiang Attachments: HIVE-2089.1.patch For files that is not splittable, CombineHiveInputFormat won't help. This jira is to add a new inputformat to support this feature. This is very useful for partitions with tens of thousands of .gz files. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-2035) Use block-level merge for RCFile if merging intermediate results are needed
[ https://issues.apache.org/jira/browse/HIVE-2035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang reassigned HIVE-2035: -- Assignee: (was: He Yongqiang) Use block-level merge for RCFile if merging intermediate results are needed --- Key: HIVE-2035 URL: https://issues.apache.org/jira/browse/HIVE-2035 Project: Hive Issue Type: Improvement Reporter: Ning Zhang Currently if hive.merge.mapredfiles and/or hive.merge.mapfile is set to true the intermediate data could be merged using an additional MapReduce job. This could be quite expensive if the data size is large. With HIVE-1950, merging can be done in the RCFile block level so that it bypasses the (de-)compression, (de-)serialization phases. This could improve the merge process significantly. This JIRA should handle the case where the input table is not stored in RCFile, but the destination table is (which requires the intermediate data should be stored in the same format as the destination table). -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-2096) throw a error if the input is larger than a threshold for index input format
[ https://issues.apache.org/jira/browse/HIVE-2096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang reassigned HIVE-2096: -- Assignee: (was: He Yongqiang) throw a error if the input is larger than a threshold for index input format Key: HIVE-2096 URL: https://issues.apache.org/jira/browse/HIVE-2096 Project: Hive Issue Type: Bug Affects Versions: 0.8.0 Reporter: Namit Jain Attachments: HIVE-2096.1.patch.txt This can hang for ever. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-1886) HIVE-78 Followup: move a list of columns from PrivilegeDesc to PrivilegeObjectDesc
[ https://issues.apache.org/jira/browse/HIVE-1886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang reassigned HIVE-1886: -- Assignee: (was: He Yongqiang) HIVE-78 Followup: move a list of columns from PrivilegeDesc to PrivilegeObjectDesc -- Key: HIVE-1886 URL: https://issues.apache.org/jira/browse/HIVE-1886 Project: Hive Issue Type: Improvement Reporter: He Yongqiang This is a follow up for HIVE-78. {quote} PrivilegeObjectDesc.java: should contain a list of columns. Remove columns from PrivilegeDesc. - PrivilegeDesc can be removed all together It is same as Privilege {quote} -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-1282) sort merge join should error out if bucketizedhiveinputformat is not used
[ https://issues.apache.org/jira/browse/HIVE-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] He Yongqiang reassigned HIVE-1282: -- Assignee: (was: He Yongqiang) sort merge join should error out if bucketizedhiveinputformat is not used - Key: HIVE-1282 URL: https://issues.apache.org/jira/browse/HIVE-1282 Project: Hive Issue Type: Bug Components: Query Processor Reporter: Namit Jain Please add a check -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2148) Add interface classification in Hive.
[ https://issues.apache.org/jira/browse/HIVE-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-2148: - Resolution: Fixed Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Committed to trunk. Thanks Ashutosh! Add interface classification in Hive. - Key: HIVE-2148 URL: https://issues.apache.org/jira/browse/HIVE-2148 Project: Hive Issue Type: Improvement Components: Metastore Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Attachments: classification.patch Add mechanism for marking stability and intended audiences in Hive. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2148) Add interface classification in Hive.
[ https://issues.apache.org/jira/browse/HIVE-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach updated HIVE-2148: - Fix Version/s: 0.8.0 Add interface classification in Hive. - Key: HIVE-2148 URL: https://issues.apache.org/jira/browse/HIVE-2148 Project: Hive Issue Type: Improvement Components: Metastore Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Fix For: 0.8.0 Attachments: classification.patch Add mechanism for marking stability and intended audiences in Hive. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2147) Add api to send / receive message to metastore
[ https://issues.apache.org/jira/browse/HIVE-2147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13031476#comment-13031476 ] Carl Steinbach commented on HIVE-2147: -- @Ashutosh: can you please post a reviewboard request? Thanks. Add api to send / receive message to metastore -- Key: HIVE-2147 URL: https://issues.apache.org/jira/browse/HIVE-2147 Project: Hive Issue Type: Improvement Components: Metastore Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Fix For: 0.8.0 Attachments: api-without-thrift.patch This is follow-up work on HIVE-2038. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-2134) Remove System.exit
[ https://issues.apache.org/jira/browse/HIVE-2134?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13031541#comment-13031541 ] Amareshwari Sriramadasu commented on HIVE-2134: --- Looks fine. Will commit if tests pass. Remove System.exit --- Key: HIVE-2134 URL: https://issues.apache.org/jira/browse/HIVE-2134 Project: Hive Issue Type: Improvement Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Fix For: 0.8.0 Attachments: hive_2134.patch, no_sysexit.patch System.exit exists in various places in code. Its good to get rid of it. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2148) Add interface classification in Hive.
[ https://issues.apache.org/jira/browse/HIVE-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-2148: --- Attachment: hive_2148.patch Sorry Carl, the patch was incomplete. There is one more method run() of Command whose visibility I wanted to change. Incremental patch attached. Add interface classification in Hive. - Key: HIVE-2148 URL: https://issues.apache.org/jira/browse/HIVE-2148 Project: Hive Issue Type: Improvement Components: Metastore Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Fix For: 0.8.0 Attachments: classification.patch, hive_2148.patch Add mechanism for marking stability and intended audiences in Hive. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (HIVE-2148) Add interface classification in Hive.
[ https://issues.apache.org/jira/browse/HIVE-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan reopened HIVE-2148: Add interface classification in Hive. - Key: HIVE-2148 URL: https://issues.apache.org/jira/browse/HIVE-2148 Project: Hive Issue Type: Improvement Components: Metastore Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Fix For: 0.8.0 Attachments: classification.patch, hive_2148.patch Add mechanism for marking stability and intended audiences in Hive. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-2148) Add interface classification in Hive.
[ https://issues.apache.org/jira/browse/HIVE-2148?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-2148: --- Status: Patch Available (was: Reopened) Add interface classification in Hive. - Key: HIVE-2148 URL: https://issues.apache.org/jira/browse/HIVE-2148 Project: Hive Issue Type: Improvement Components: Metastore Reporter: Ashutosh Chauhan Assignee: Ashutosh Chauhan Fix For: 0.8.0 Attachments: classification.patch, hive_2148.patch Add mechanism for marking stability and intended audiences in Hive. -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira