[jira] Updated: (HIVE-1991) Hive Shell to output number of mappers and number of reducers
[ https://issues.apache.org/jira/browse/HIVE-1991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1991: - Resolution: Fixed Fix Version/s: 0.8.0 Status: Resolved (was: Patch Available) Committed. Thanks Siying! Hive Shell to output number of mappers and number of reducers - Key: HIVE-1991 URL: https://issues.apache.org/jira/browse/HIVE-1991 Project: Hive Issue Type: Improvement Components: CLI Reporter: Siying Dong Assignee: Siying Dong Priority: Trivial Fix For: 0.8.0 Attachments: HIVE-1991.1.patch, HIVE-1991.2.patch Number of mappers and number of reducers are nice information to be outputted for users to know. -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HIVE-1990) Logging fails due to moved EventCounter class in Hadoop 0.20.100
[
https://issues.apache.org/jira/browse/HIVE-1990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12994941#comment-12994941
]
Joep Rottinghuis commented on HIVE-1990:
Good point Ashutosh. This change does not seem to break unit tests, but would
indeed break when running with Hadoop 0.17, 0.18, 0.29, or plain 0.20.
I see three options:
1) Leave this as a standalone for who wants to run against 0.20.100. In those
cases it is unlikely that they'll ever run against the other shimmed in
versions anyway. Your cluster is more likely to be either one of the other.
2) File a bug against Hadoop 0.20.100 to see if there is apetite to move
Metrics back to o.a.h.metrics.jvm
3) Build in more sophistication into the build to be able to pick one config
file or the other, depending on the version of Hadoop.
(options are in increasing level of effort).
Logging fails due to moved EventCounter class in Hadoop 0.20.100
Key: HIVE-1990
URL: https://issues.apache.org/jira/browse/HIVE-1990
Project: Hive
Issue Type: Bug
Components: Logging
Affects Versions: 0.6.0
Environment: Red Hat 2.6.18
Reporter: Joep Rottinghuis
Fix For: 0.6.0
Attachments: hive-1990.patch
When compiling Hive against Hadoop 0.20.100 logging on command line and in
unit tests fails due to the EventCounter class being moved from
o.a.h.metrics.jvm.EventCounter to o.a.h.log.EventCounter.
{code}
[junit] Running org.apache.hadoop.hive.serde2.TestTCTLSeparatedProtocol
[junit] log4j:ERROR Could not instantiate class
[org.apache.hadoop.metrics.jvm.EventCounter].
[junit] java.lang.ClassNotFoundException:
org.apache.hadoop.metrics.jvm.EventCounter
[junit] at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
[junit] at java.security.AccessController.doPrivileged(Native Method)
[junit] at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
[junit] at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
[junit] at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
[junit] at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
{code}
As a note: In order to re-produce I first applied patch as per HIVE-1264 to
0.6 branch in order to resolve jar naming issues in build.
Then I locally modified the build.properties to my locally built 0.20.100
Hadoop build:
{code}
hadoop.security.url=file:.../hadoop/core/hadoop-${hadoop.version}
hadoop.security.version=${hadoop.version}
{code}
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HIVE-1987) HWI admin_list_jobs JSP page throws exception
[
https://issues.apache.org/jira/browse/HIVE-1987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12994944#comment-12994944
]
Carl Steinbach commented on HIVE-1987:
--
@Ed: I like option 1 (removing the page). Changing the signature back to public
doesn't seem ok to me.
HWI admin_list_jobs JSP page throws exception
-
Key: HIVE-1987
URL: https://issues.apache.org/jira/browse/HIVE-1987
Project: Hive
Issue Type: Bug
Components: Web UI
Affects Versions: 0.7.0
Reporter: Carl Steinbach
Assignee: Edward Capriolo
It looks like the admin_list_jobs.jsp page is trying to reference
ExecDriver.runningJobKillURIs, which is now a private to ExecDriver:
{code}
RequestURI=/hwi/admin_list_jobs.jsp
Caused by:
org.apache.jasper.JasperException: Unable to compile class for JSP
An error occurred at line: 24 in the jsp file: /admin_list_jobs.jsp
Generated servlet error:
The field ExecDriver.runningJobKillURIs is not visible
An error occurred at line: 27 in the jsp file: /admin_list_jobs.jsp
Generated servlet error:
The field ExecDriver.runningJobKillURIs is not visible
at
org.apache.jasper.compiler.DefaultErrorHandler.javacError(DefaultErrorHandler.java:84)
at
org.apache.jasper.compiler.ErrorDispatcher.javacError(ErrorDispatcher.java:328)
at
org.apache.jasper.compiler.JDTCompiler.generateClass(JDTCompiler.java:409)
at org.apache.jasper.compiler.Compiler.compile(Compiler.java:288)
at org.apache.jasper.compiler.Compiler.compile(Compiler.java:267)
at org.apache.jasper.compiler.Compiler.compile(Compiler.java:255)
at
org.apache.jasper.JspCompilationContext.compile(JspCompilationContext.java:563)
at
org.apache.jasper.servlet.JspServletWrapper.service(JspServletWrapper.java:293)
at
org.apache.jasper.servlet.JspServlet.serviceJspFile(JspServlet.java:314)
at org.apache.jasper.servlet.JspServlet.service(JspServlet.java:264)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:820)
at
org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:502)
at
org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:363)
at
org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
at
org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:181)
at
org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
at org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:417)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at
org.mortbay.jetty.handler.RequestLogHandler.handle(RequestLogHandler.java:49)
at
org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
at org.mortbay.jetty.Server.handle(Server.java:324)
at
org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:534)
at
org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:864)
at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:533)
at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:207)
at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:403)
at
org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
at
org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:522)
{code}
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
Build failed in Hudson: Hive-0.7.0-h0.20 #2
See https://hudson.apache.org/hudson/job/Hive-0.7.0-h0.20/2/ -- [...truncated 25841 lines...] [junit] Job running in-process (local Hadoop) [junit] 2011-02-15 11:46:57,586 null map = 100%, reduce = 0% [junit] Ended Job = job_local_0001 [junit] POSTHOOK: query: select key, value from testhivedrivertable [junit] POSTHOOK: type: QUERY [junit] POSTHOOK: Input: default@testhivedrivertable [junit] POSTHOOK: Output: file:/tmp/hudson/hive_2011-02-15_11-46-55_052_142901053124351264/-mr-1 [junit] OK [junit] Hive history file=https://hudson.apache.org/hudson/job/Hive-0.7.0-h0.20/ws/hive/build/service/tmp/hive_job_log_hudson_201102151146_1492191894.txt [junit] PREHOOK: query: drop table testhivedrivertable [junit] PREHOOK: type: DROPTABLE [junit] PREHOOK: Input: default@testhivedrivertable [junit] PREHOOK: Output: default@testhivedrivertable [junit] POSTHOOK: query: drop table testhivedrivertable [junit] POSTHOOK: type: DROPTABLE [junit] POSTHOOK: Input: default@testhivedrivertable [junit] POSTHOOK: Output: default@testhivedrivertable [junit] OK [junit] PREHOOK: query: create table testhivedrivertable (key int, value string) [junit] PREHOOK: type: CREATETABLE [junit] POSTHOOK: query: create table testhivedrivertable (key int, value string) [junit] POSTHOOK: type: CREATETABLE [junit] POSTHOOK: Output: default@testhivedrivertable [junit] OK [junit] PREHOOK: query: load data local inpath 'https://hudson.apache.org/hudson/job/Hive-0.7.0-h0.20/ws/hive/data/files/kv1.txt' into table testhivedrivertable [junit] PREHOOK: type: LOAD [junit] Copying data from https://hudson.apache.org/hudson/job/Hive-0.7.0-h0.20/ws/hive/data/files/kv1.txt [junit] Loading data to table testhivedrivertable [junit] POSTHOOK: query: load data local inpath 'https://hudson.apache.org/hudson/job/Hive-0.7.0-h0.20/ws/hive/data/files/kv1.txt' into table testhivedrivertable [junit] POSTHOOK: type: LOAD [junit] POSTHOOK: Output: default@testhivedrivertable [junit] OK [junit] PREHOOK: query: select key, value from testhivedrivertable where key 10 [junit] PREHOOK: type: QUERY [junit] PREHOOK: Input: default@testhivedrivertable [junit] PREHOOK: Output: file:/tmp/hudson/hive_2011-02-15_11-46-58_452_3858282071504824997/-mr-1 [junit] Total MapReduce jobs = 1 [junit] Launching Job 1 out of 1 [junit] Number of reduce tasks is set to 0 since there's no reduce operator [junit] Job running in-process (local Hadoop) [junit] 2011-02-15 11:47:01,162 null map = 100%, reduce = 0% [junit] Ended Job = job_local_0001 [junit] POSTHOOK: query: select key, value from testhivedrivertable where key 10 [junit] POSTHOOK: type: QUERY [junit] POSTHOOK: Input: default@testhivedrivertable [junit] POSTHOOK: Output: file:/tmp/hudson/hive_2011-02-15_11-46-58_452_3858282071504824997/-mr-1 [junit] OK [junit] PREHOOK: query: select count(1) as c from testhivedrivertable [junit] PREHOOK: type: QUERY [junit] PREHOOK: Input: default@testhivedrivertable [junit] PREHOOK: Output: file:/tmp/hudson/hive_2011-02-15_11-47-01_341_8593372343534106635/-mr-1 [junit] Total MapReduce jobs = 1 [junit] Launching Job 1 out of 1 [junit] Number of reduce tasks determined at compile time: 1 [junit] In order to change the average load for a reducer (in bytes): [junit] set hive.exec.reducers.bytes.per.reducer=number [junit] In order to limit the maximum number of reducers: [junit] set hive.exec.reducers.max=number [junit] In order to set a constant number of reducers: [junit] set mapred.reduce.tasks=number [junit] Job running in-process (local Hadoop) [junit] 2011-02-15 11:47:04,033 null map = 100%, reduce = 100% [junit] Ended Job = job_local_0001 [junit] POSTHOOK: query: select count(1) as c from testhivedrivertable [junit] POSTHOOK: type: QUERY [junit] POSTHOOK: Input: default@testhivedrivertable [junit] POSTHOOK: Output: file:/tmp/hudson/hive_2011-02-15_11-47-01_341_8593372343534106635/-mr-1 [junit] OK [junit] - --- [junit] [junit] Testcase: testExecute took 10.319 sec [junit] Testcase: testNonHiveCommand took 0.977 sec [junit] Testcase: testMetastore took 0.297 sec [junit] Testcase: testGetClusterStatus took 0.105 sec [junit] Testcase: testFetch took 9.564 sec [junit] Testcase: testDynamicSerde took 6.731 sec test-conditions: gen-test: create-dirs: compile-ant-tasks: create-dirs: init: compile: [echo] Compiling: anttasks [javac] https://hudson.apache.org/hudson/job/Hive-0.7.0-h0.20/ws/hive/ant/build.xml:40: warning: 'includeantruntime' was not set, defaulting to build.sysclasspath=last; set to false for repeatable builds deploy-ant-tasks: create-dirs: init:
Re: Review Request: HIVE-1817: Remove Hive dependency on unrelease commons-cli 2.0 Snapshot
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/421/ --- (Updated 2011-02-15 12:07:15.736487) Review request for hive. Summary --- Review for HIVE-1817. This addresses bug HIVE-1817. https://issues.apache.org/jira/browse/HIVE-1817 Diffs (updated) - bin/ext/cli.sh 054d1e8 bin/ext/help.sh 6d1e484 bin/ext/hiveserver.sh d8f6657 bin/ext/hwi.sh 74de9ad bin/ext/jar.sh d16aa4c bin/ext/metastore.sh a894f7f bin/ext/rcfilecat.sh 21d515c bin/ext/util/execHiveCmd.sh 61b8635 bin/hive c0eba07 bin/hive-config.sh f474189 build.properties f27af9c build.xml b74371c cli/build.xml 2d16b91 cli/ivy.xml 86ad1ee cli/src/java/org/apache/hadoop/hive/cli/OptionsProcessor.java 0346060 eclipse-templates/.classpath e40a07a ivy/libraries.properties 0ede62a lib/commons-cli-2.0-SNAPSHOT.jar 0b1d510 shims/build.xml 2021cfb shims/ivy.xml 82b6688 Diff: https://reviews.apache.org/r/421/diff Testing --- Verified that Hive CLI options work. Verified that version check logic passes against 0.20.1 and 0.20.1, but not against 0.20.0, 0.19.2, or 0.21.0. Also verified that it's possible to start hiveserver, metastore, HWI, etc. Thanks, Carl
[jira] Updated: (HIVE-1211) Tapping logs from child processes
[
https://issues.apache.org/jira/browse/HIVE-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jonathan Natkins updated HIVE-1211:
---
Status: Patch Available (was: Open)
Tapping logs from child processes
-
Key: HIVE-1211
URL: https://issues.apache.org/jira/browse/HIVE-1211
Project: Hive
Issue Type: Improvement
Components: Logging
Reporter: bc Wong
Assignee: Carl Steinbach
Attachments: HIVE-1211-2.patch, HIVE-1211.1.patch,
HIVE-1211.3.patch.txt, HIVE-1211.4.patch.txt, HIVE-1211.5.patch.txt,
HIVE-1211.6.patch.txt, HIVE-1211.7.patch.txt, HIVE-1211.8.patch.txt
Stdout/stderr from child processes (e.g. {{MapRedTask}}) are redirected to
the parent's stdout/stderr. There is little one can do to to sort out which
log is from which query.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HIVE-1990) Logging fails due to moved EventCounter class in Hadoop 0.20.100
[
https://issues.apache.org/jira/browse/HIVE-1990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12995094#comment-12995094
]
Ashutosh Chauhan commented on HIVE-1990:
This is kind of tricky. It has been stated that Hive trunk currently supports
only 20 and 20-secure (someone can correct me here if its not correct). Since
there was no official apache release for hadoop-0.20 yet, Hive relied on
0.20.3-CDH3-SNAPSHOT for security integration which didn't have this issue.
But, now with official Apache release knocking on door (0.20.100) we should
probably switch over to that and then we need to commit this fix.
Logging fails due to moved EventCounter class in Hadoop 0.20.100
Key: HIVE-1990
URL: https://issues.apache.org/jira/browse/HIVE-1990
Project: Hive
Issue Type: Bug
Components: Logging
Affects Versions: 0.6.0
Environment: Red Hat 2.6.18
Reporter: Joep Rottinghuis
Fix For: 0.6.0
Attachments: hive-1990.patch
When compiling Hive against Hadoop 0.20.100 logging on command line and in
unit tests fails due to the EventCounter class being moved from
o.a.h.metrics.jvm.EventCounter to o.a.h.log.EventCounter.
{code}
[junit] Running org.apache.hadoop.hive.serde2.TestTCTLSeparatedProtocol
[junit] log4j:ERROR Could not instantiate class
[org.apache.hadoop.metrics.jvm.EventCounter].
[junit] java.lang.ClassNotFoundException:
org.apache.hadoop.metrics.jvm.EventCounter
[junit] at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
[junit] at java.security.AccessController.doPrivileged(Native Method)
[junit] at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
[junit] at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
[junit] at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
[junit] at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
{code}
As a note: In order to re-produce I first applied patch as per HIVE-1264 to
0.6 branch in order to resolve jar naming issues in build.
Then I locally modified the build.properties to my locally built 0.20.100
Hadoop build:
{code}
hadoop.security.url=file:.../hadoop/core/hadoop-${hadoop.version}
hadoop.security.version=${hadoop.version}
{code}
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HIVE-1990) Logging fails due to moved EventCounter class in Hadoop 0.20.100
[
https://issues.apache.org/jira/browse/HIVE-1990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12995095#comment-12995095
]
Ashutosh Chauhan commented on HIVE-1990:
I meant no official apache release for hadoop-0.20-secure yet.
Logging fails due to moved EventCounter class in Hadoop 0.20.100
Key: HIVE-1990
URL: https://issues.apache.org/jira/browse/HIVE-1990
Project: Hive
Issue Type: Bug
Components: Logging
Affects Versions: 0.6.0
Environment: Red Hat 2.6.18
Reporter: Joep Rottinghuis
Fix For: 0.6.0
Attachments: hive-1990.patch
When compiling Hive against Hadoop 0.20.100 logging on command line and in
unit tests fails due to the EventCounter class being moved from
o.a.h.metrics.jvm.EventCounter to o.a.h.log.EventCounter.
{code}
[junit] Running org.apache.hadoop.hive.serde2.TestTCTLSeparatedProtocol
[junit] log4j:ERROR Could not instantiate class
[org.apache.hadoop.metrics.jvm.EventCounter].
[junit] java.lang.ClassNotFoundException:
org.apache.hadoop.metrics.jvm.EventCounter
[junit] at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
[junit] at java.security.AccessController.doPrivileged(Native Method)
[junit] at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
[junit] at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
[junit] at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
[junit] at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
{code}
As a note: In order to re-produce I first applied patch as per HIVE-1264 to
0.6 branch in order to resolve jar naming issues in build.
Then I locally modified the build.properties to my locally built 0.20.100
Hadoop build:
{code}
hadoop.security.url=file:.../hadoop/core/hadoop-${hadoop.version}
hadoop.security.version=${hadoop.version}
{code}
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Work started: (HIVE-1644) use filter pushdown for automatically accessing indexes
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HIVE-1644 started by Russell Melick. use filter pushdown for automatically accessing indexes --- Key: HIVE-1644 URL: https://issues.apache.org/jira/browse/HIVE-1644 Project: Hive Issue Type: Improvement Components: Indexing Affects Versions: 0.7.0 Reporter: John Sichi Assignee: Russell Melick HIVE-1226 provides utilities for analyzing filters which have been pushed down to a table scan. The next step is to use these for selecting available indexes and generating access plans for those indexes. -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HIVE-1644) use filter pushdown for automatically accessing indexes
[ https://issues.apache.org/jira/browse/HIVE-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Russell Melick updated HIVE-1644: - Attachment: HIVE-1644.1.patch I'm having trouble joining the operator trees together. Within org.apache.hadoop.hive.ql.optimizer.index.IndexWhereProcessor, I'm working within rewriteForIndex(...). I added a unit test called index_opt_where.q, which is what I'll be using for examples. After line 139, I have 2 parseContexts: 1 is the original parse context of the normal query (SELECT * FROM src WHERE key=86 ORDER BY key), and the other is the parseContext of the reentrant query used to generate the temporary table. (INSERT OVERWRITE DIRECTORY /tmp/index_result_where1 SELECT `_bucketname` , `_offsets` FROM default__src_src_index__ WHERE key=86) I don't really know how to join the operator trees from these parseContexts together. I tried just setting the topOps of the original query to include the topOps of the reentrant query. I ran into null pointer exceptions when it went to optimize using other Transforms. I then tried add the topOps of the original query as the child of the very bottom child node of the reentrant query, and then setting that combined operator tree as the topOp of the original parseContext. That gave me trouble. For some reason, the IndexWhereProcessor.process(...) method is called twice, and the second time, it would try to use the reentrant topOp table name (default__src_src_index...) to lookup the tblScan operator, but the new topOp only had src as a TableScan. The new topOp was the reentrant query, and that doesn't scan it default__src... table, it creates it. I've attached a patch, in hopes that it will reasonably easy to see what I'm talking about. There are lot of hacks in it (it always uses indexOptimizing as an Optimization, and the query reconstruction is bad), but it's stuff I didn't want to worry about until I could get it working. use filter pushdown for automatically accessing indexes --- Key: HIVE-1644 URL: https://issues.apache.org/jira/browse/HIVE-1644 Project: Hive Issue Type: Improvement Components: Indexing Affects Versions: 0.7.0 Reporter: John Sichi Assignee: Russell Melick Attachments: HIVE-1644.1.patch HIVE-1226 provides utilities for analyzing filters which have been pushed down to a table scan. The next step is to use these for selecting available indexes and generating access plans for those indexes. -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Created: (HIVE-1995) Mismatched open/commit transaction calls when using get_partition()
Mismatched open/commit transaction calls when using get_partition() --- Key: HIVE-1995 URL: https://issues.apache.org/jira/browse/HIVE-1995 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.7.0 Reporter: Paul Yang Priority: Minor Nested executeWithRetry() calls caused by using HiveMetaStore.get_partition() can result in mis-matched open/commit calls. Fixes the same issue as described in HIVE-1760. -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HIVE-1995) Mismatched open/commit transaction calls when using get_partition()
[ https://issues.apache.org/jira/browse/HIVE-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Paul Yang updated HIVE-1995: Attachment: HIVE-1995.1.patch Mismatched open/commit transaction calls when using get_partition() --- Key: HIVE-1995 URL: https://issues.apache.org/jira/browse/HIVE-1995 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.7.0 Reporter: Paul Yang Priority: Minor Attachments: HIVE-1995.1.patch Nested executeWithRetry() calls caused by using HiveMetaStore.get_partition() can result in mis-matched open/commit calls. Fixes the same issue as described in HIVE-1760. -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Assigned: (HIVE-1211) Tapping logs from child processes
[
https://issues.apache.org/jira/browse/HIVE-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carl Steinbach reassigned HIVE-1211:
Assignee: Jonathan Natkins (was: Carl Steinbach)
Tapping logs from child processes
-
Key: HIVE-1211
URL: https://issues.apache.org/jira/browse/HIVE-1211
Project: Hive
Issue Type: Improvement
Components: Logging
Reporter: bc Wong
Assignee: Jonathan Natkins
Attachments: HIVE-1211-2.patch, HIVE-1211.1.patch,
HIVE-1211.3.patch.txt, HIVE-1211.4.patch.txt, HIVE-1211.5.patch.txt,
HIVE-1211.6.patch.txt, HIVE-1211.7.patch.txt, HIVE-1211.8.patch.txt
Stdout/stderr from child processes (e.g. {{MapRedTask}}) are redirected to
the parent's stdout/stderr. There is little one can do to to sort out which
log is from which query.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HIVE-1817) Remove Hive dependency on unreleased commons-cli 2.0 Snapshot
[
https://issues.apache.org/jira/browse/HIVE-1817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
John Sichi updated HIVE-1817:
-
Status: Open (was: Patch Available)
Tests pass now, but when I try to run CLI interactively, I get the failure
below. hadoop -version is no longer returning information in the expected
format.
{noformat}
[jsichi@dev1066 ~/open/test-trunk] build/dist/bin/hive
Hive requires Hadoop 0.20.x (x = 1).
'hadoop version' returned:
Hadoop 0.20.0 Subversion
https://svn.apache.org/repos/asf/hadoop/core/branches/branch-0.20 -r 763504
Compiled by ndaley on Thu Apr 9 05:18:40 UTC 2009
{noformat}
Remove Hive dependency on unreleased commons-cli 2.0 Snapshot
-
Key: HIVE-1817
URL: https://issues.apache.org/jira/browse/HIVE-1817
Project: Hive
Issue Type: Task
Components: Build Infrastructure, CLI
Reporter: Carl Steinbach
Assignee: Carl Steinbach
Priority: Blocker
Fix For: 0.7.0
Attachments: HIVE-1817.2.patch.txt, HIVE-1817.3.patch.txt,
HIVE-1817.4.patch.txt, HIVE-1817.wip.1.patch.txt
The Hive CLI depends on commons-cli-2.0-SNAPSHOT. This branch of of the
commons-cli project is dead.
Hive needs to use commons-cli-1.2 instead. See MAPREDUCE-767 for more
information.
--
This message is automatically generated by JIRA.
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HIVE-1995) Mismatched open/commit transaction calls when using get_partition()
[ https://issues.apache.org/jira/browse/HIVE-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12995147#comment-12995147 ] Ning Zhang commented on HIVE-1995: -- +1. Will commit if tests pass. Mismatched open/commit transaction calls when using get_partition() --- Key: HIVE-1995 URL: https://issues.apache.org/jira/browse/HIVE-1995 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.7.0 Reporter: Paul Yang Priority: Minor Attachments: HIVE-1995.1.patch Nested executeWithRetry() calls caused by using HiveMetaStore.get_partition() can result in mis-matched open/commit calls. Fixes the same issue as described in HIVE-1760. -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HIVE-1517) ability to select across a database
[ https://issues.apache.org/jira/browse/HIVE-1517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12995182#comment-12995182 ] Siying Dong commented on HIVE-1517: --- Namit, Driver.java just lock db of the table when locking any table, which should be the same reason as you explained DROP DATABASE does not work while any table/partition is being accessed/modified. Also, zookeeper path are something like /PREFIX/db/table_name. Without locking db in advance, parent path is missing and locking the tables will fail. ability to select across a database --- Key: HIVE-1517 URL: https://issues.apache.org/jira/browse/HIVE-1517 Project: Hive Issue Type: Improvement Components: Query Processor Reporter: Namit Jain Assignee: Siying Dong Priority: Blocker Fix For: 0.7.0 Attachments: HIVE-1517.1.patch.txt, HIVE-1517.2.patch.txt, HIVE-1517.3.patch, HIVE-1517.4.patch After https://issues.apache.org/jira/browse/HIVE-675, we need a way to be able to select across a database for this feature to be useful. For eg: use db1 create table foo(); use db2 select .. from db1.foo. -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HIVE-1995) Mismatched open/commit transaction calls when using get_partition()
[ https://issues.apache.org/jira/browse/HIVE-1995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-1995: - Resolution: Fixed Fix Version/s: 0.8.0 Assignee: Paul Yang Hadoop Flags: [Reviewed] Status: Resolved (was: Patch Available) Committed. Thanks Paul! Mismatched open/commit transaction calls when using get_partition() --- Key: HIVE-1995 URL: https://issues.apache.org/jira/browse/HIVE-1995 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.7.0 Reporter: Paul Yang Assignee: Paul Yang Priority: Minor Fix For: 0.8.0 Attachments: HIVE-1995.1.patch Nested executeWithRetry() calls caused by using HiveMetaStore.get_partition() can result in mis-matched open/commit calls. Fixes the same issue as described in HIVE-1760. -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Assigned: (HIVE-1902) create script for the metastore upgrade due to HIVE-78
[ https://issues.apache.org/jira/browse/HIVE-1902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach reassigned HIVE-1902: Assignee: Arvind Prabhakar (was: Carl Steinbach) create script for the metastore upgrade due to HIVE-78 -- Key: HIVE-1902 URL: https://issues.apache.org/jira/browse/HIVE-1902 Project: Hive Issue Type: Bug Components: Metastore Reporter: Namit Jain Assignee: Arvind Prabhakar Priority: Blocker Fix For: 0.7.0 -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Assigned: (HIVE-1905) Provide MetaStore schema upgrade scripts for changes made in HIVE-1823
[ https://issues.apache.org/jira/browse/HIVE-1905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Steinbach reassigned HIVE-1905: Assignee: Arvind Prabhakar (was: Carl Steinbach) Provide MetaStore schema upgrade scripts for changes made in HIVE-1823 -- Key: HIVE-1905 URL: https://issues.apache.org/jira/browse/HIVE-1905 Project: Hive Issue Type: Task Components: Metastore Reporter: Carl Steinbach Assignee: Arvind Prabhakar Priority: Blocker Fix For: 0.7.0 This is a blocker for the 0.7.0 release. -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HIVE-818) Create a Hive CLI that connects to hive ThriftServer
[ https://issues.apache.org/jira/browse/HIVE-818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang updated HIVE-818: Attachment: HIVE-818.4.patch Uploading a patch that resolves some failures in TestHiveServer and TestJdbcCliDriver. Create a Hive CLI that connects to hive ThriftServer Key: HIVE-818 URL: https://issues.apache.org/jira/browse/HIVE-818 Project: Hive Issue Type: New Feature Components: Clients, Server Infrastructure Reporter: Edward Capriolo Assignee: Ning Zhang Attachments: HIVE-818.2.patch, HIVE-818.3.patch, HIVE-818.4.patch, HIVE-818.patch, Hive-881_2.patch We should have an alternate CLI that works by interacting with the HiveServer, in this way it will be ready when/if we deprecate the current CLI. -- This message is automatically generated by JIRA. - For more information on JIRA, see: http://www.atlassian.com/software/jira
