[jira] [Created] (HIVE-4993) Add HCatalog documentation to Hive wiki
Lefty Leverenz created HIVE-4993: Summary: Add HCatalog documentation to Hive wiki Key: HIVE-4993 URL: https://issues.apache.org/jira/browse/HIVE-4993 Project: Hive Issue Type: Bug Components: Documentation Affects Versions: 0.11.0 Reporter: Lefty Leverenz Assignee: Lefty Leverenz The documentation for HCatalog versions 0.5.0 and earlier (Apache incubator) had xml source files which generated html pdf output files. Now that HCatalog is part of the Hive project, the HCatalog documents need to be added to the Hive wiki. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4994) Add WebHCat (Templeton) documentation to Hive wiki
Lefty Leverenz created HIVE-4994: Summary: Add WebHCat (Templeton) documentation to Hive wiki Key: HIVE-4994 URL: https://issues.apache.org/jira/browse/HIVE-4994 Project: Hive Issue Type: Bug Components: Documentation Affects Versions: 0.11.0 Reporter: Lefty Leverenz Assignee: Lefty Leverenz WebHCat (Templeton) documentation in the Apache incubator had xml source files which generated html pdf output files. Now that HCatalog and WebHCat are part of the Hive project, all the WebHCat documents need to be added to the Hive wiki. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: Review Request 11046: HIVE-4233- The TGT gotten from class 'CLIService' should be renewed on time
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/11046/#review24628 --- metastore/src/java/org/apache/hadoop/hive/metastore/RetryingMetaStoreClient.java https://reviews.apache.org/r/11046/#comment48722 is this necessary to create a new instance? metastore/src/java/org/apache/hadoop/hive/metastore/RetryingMetaStoreClient.java https://reviews.apache.org/r/11046/#comment48721 do you really need to call this in two places? can't you just let the call below take care of things? (fail - relogin - reconnect - succeed). metastore/src/java/org/apache/hadoop/hive/metastore/RetryingMetaStoreClient.java https://reviews.apache.org/r/11046/#comment48724 minor: checkAndRelogin or similar would say in the name that the method doesn't actually relogin every time. shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java https://reviews.apache.org/r/11046/#comment48723 can you say hadoop v 20 or use the actual version of the user? or maybe before version 1.0.0. This message sounds like there's still no version that supports it. Same for message below. - Gunther Hagleitner On Aug. 3, 2013, 3 a.m., Thejas Nair wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/11046/ --- (Updated Aug. 3, 2013, 3 a.m.) Review request for hive. Bugs: HIVE-4233 https://issues.apache.org/jira/browse/HIVE-4233 Repository: hive-git Description --- HIVE-4233- The TGT gotten from class 'CLIService' should be renewed on time Diffs - metastore/src/java/org/apache/hadoop/hive/metastore/RetryingMetaStoreClient.java 76b1989 shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java c9baa7f shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java 9edcafd shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java b0f5077 Diff: https://reviews.apache.org/r/11046/diff/ Testing --- manually tested on secure hadoop cluster. Thanks, Thejas Nair
[jira] [Commented] (HIVE-4233) The TGT gotten from class 'CLIService' should be renewed on time
[ https://issues.apache.org/jira/browse/HIVE-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728806#comment-13728806 ] Gunther Hagleitner commented on HIVE-4233: -- Looks mostly good to me. Couple of comments on RB. [~thejas]/[~prasadm] is there really no way we can add automated tests for these scenarios? The TGT gotten from class 'CLIService' should be renewed on time - Key: HIVE-4233 URL: https://issues.apache.org/jira/browse/HIVE-4233 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.11.0 Environment: CentOS release 6.3 (Final) jdk1.6.0_31 HiveServer2 0.10.0-cdh4.2.0 Kerberos Security Reporter: Dongyong Wang Assignee: Thejas M Nair Priority: Critical Attachments: 0001-FIX-HIVE-4233.patch, HIVE-4233-2.patch, HIVE-4233-3.patch, HIVE-4233.4.patch When the HIveServer2 have started more than 7 days, I use beeline shell to connect the HiveServer2,all operation failed. The log of HiveServer2 shows it was caused by the Kerberos auth failure,the exception stack trace is: 2013-03-26 11:55:20,932 ERROR hive.ql.metadata.Hive: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1084) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(RetryingMetaStoreClient.java:51) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:61) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2140) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2151) at org.apache.hadoop.hive.ql.metadata.Hive.getDelegationToken(Hive.java:2275) at org.apache.hive.service.cli.CLIService.getDelegationTokenFromMetaStore(CLIService.java:358) at org.apache.hive.service.cli.thrift.ThriftCLIService.OpenSession(ThriftCLIService.java:127) at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1073) at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1058) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge20S.java:565) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:206) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.GeneratedConstructorAccessor52.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1082) ... 16 more Caused by: java.lang.IllegalStateException: This ticket is no longer valid at javax.security.auth.kerberos.KerberosTicket.toString(KerberosTicket.java:601) at java.lang.String.valueOf(String.java:2826) at java.lang.StringBuilder.append(StringBuilder.java:115) at sun.security.jgss.krb5.SubjectComber.findAux(SubjectComber.java:120) at sun.security.jgss.krb5.SubjectComber.find(SubjectComber.java:41) at sun.security.jgss.krb5.Krb5Util.getTicket(Krb5Util.java:130) at sun.security.jgss.krb5.Krb5InitCredential$1.run(Krb5InitCredential.java:328) at java.security.AccessController.doPrivileged(Native Method) at sun.security.jgss.krb5.Krb5InitCredential.getTgt(Krb5InitCredential.java:325) at sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:128) at sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106) at sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172) at sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162) at
[jira] [Commented] (HIVE-4343) HS2 with kerberos- local task for map join fails
[ https://issues.apache.org/jira/browse/HIVE-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728807#comment-13728807 ] Hudson commented on HIVE-4343: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #44 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/44/]) HIVE-4343: HS2 with kerberos - local task for map join fails (Thejas M Nair via Gunther Hagleitner) (gunther: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1510097) * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/SecureCmdDoAs.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/ExecDriver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/MapredLocalTask.java * /hive/trunk/shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java * /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java * /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java * /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java HS2 with kerberos- local task for map join fails Key: HIVE-4343 URL: https://issues.apache.org/jira/browse/HIVE-4343 Project: Hive Issue Type: Bug Components: HiveServer2 Reporter: Thejas M Nair Assignee: Thejas M Nair Fix For: 0.12.0 Attachments: HIVE-4343.1.patch, HIVE-4343.2.patch, HIVE-4343.3.patch With hive server2 configured with kerberos security, when a (map) join query is run, it results in failure with GSSException: No valid credentials provided -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4993) Add HCatalog documentation to Hive wiki
[ https://issues.apache.org/jira/browse/HIVE-4993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728810#comment-13728810 ] Lefty Leverenz commented on HIVE-4993: -- These HCatalog documents must be converted to wiki markup and added to the Hive wiki: * Overview * Installation from Tarball [needs revision for Hive installation] * Load and Store Interfaces * Input and Output Interfaces * Reader and Writer Interfaces * Command Line Interface * Storage Formats * Dynamic Partitioning * Notification * Storage Based Authorization Until they are converted, the wiki can have links to the HCatalog 0.5.0 docs on the Hive site. Add HCatalog documentation to Hive wiki --- Key: HIVE-4993 URL: https://issues.apache.org/jira/browse/HIVE-4993 Project: Hive Issue Type: Bug Components: Documentation Affects Versions: 0.11.0 Reporter: Lefty Leverenz Assignee: Lefty Leverenz The documentation for HCatalog versions 0.5.0 and earlier (Apache incubator) had xml source files which generated html pdf output files. Now that HCatalog is part of the Hive project, the HCatalog documents need to be added to the Hive wiki. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4573) Support alternate table types for HiveServer2
[
https://issues.apache.org/jira/browse/HIVE-4573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728811#comment-13728811
]
Gunther Hagleitner commented on HIVE-4573:
--
Seems like a lot of code for something that I expect everyone will want to have
as CLASSIC anyways. It's almost more of a bug to me that we leak out these
hive-only concepts.
Questions: Can we get away with just classic? Can we at least mark HIVE as
deprecated if we need both? Are we planning to always have both?
If we go with the current code can you fill out the release notes and document
the new config variable?
Support alternate table types for HiveServer2
-
Key: HIVE-4573
URL: https://issues.apache.org/jira/browse/HIVE-4573
Project: Hive
Issue Type: Bug
Components: HiveServer2, JDBC
Affects Versions: 0.10.0
Reporter: Johndee Burks
Assignee: Prasad Mujumdar
Priority: Minor
Attachments: HIVE-4573.1.patch
The getTables jdbc function no longer returns information when using normal
JDBC table types like TABLE or VIEW. You must now use a more specific type
such as MANAGED_TABLE or VIRTUAL_VIEW. An example application that will fail
to return results against 0.10 is below, works without issue in 0.9. In my
0.10 test I used HS2.
{code}
import java.sql.SQLException;
import java.sql.Connection;
import java.sql.ResultSet;
import java.sql.Statement;
import java.sql.DriverManager;
import org.apache.hive.jdbc.HiveDriver;
import java.sql.DatabaseMetaData;
public class TestGet {
private static String driverName = org.apache.hive.jdbc.HiveDriver;
/**
* @param args
* @throws SQLException
*/
public static void main(String[] args) throws SQLException {
try {
Class.forName(driverName);
} catch (ClassNotFoundException e) {
// TODO Auto-generated catch block
e.printStackTrace();
System.exit(1);
}
Connection con =
DriverManager.getConnection(jdbc:hive2://hostname:1/default);
DatabaseMetaData dbmd = con.getMetaData();
String[] types = {TABLE};
ResultSet rs = dbmd.getTables(null, null, %, types);
while (rs.next()) {
System.out.println(rs.getString(TABLE_NAME));
}
}
}
}
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4233) The TGT gotten from class 'CLIService' should be renewed on time
[ https://issues.apache.org/jira/browse/HIVE-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728812#comment-13728812 ] Prasad Mujumdar commented on HIVE-4233: --- [~hagleitn] Thanks for the review. AFAIK, there's no testing framework for kerberos related changes. I am not sure if Knox or other hadoop ecosystem projects has something that we can reuse. The TGT gotten from class 'CLIService' should be renewed on time - Key: HIVE-4233 URL: https://issues.apache.org/jira/browse/HIVE-4233 Project: Hive Issue Type: Bug Components: HiveServer2 Affects Versions: 0.11.0 Environment: CentOS release 6.3 (Final) jdk1.6.0_31 HiveServer2 0.10.0-cdh4.2.0 Kerberos Security Reporter: Dongyong Wang Assignee: Thejas M Nair Priority: Critical Attachments: 0001-FIX-HIVE-4233.patch, HIVE-4233-2.patch, HIVE-4233-3.patch, HIVE-4233.4.patch When the HIveServer2 have started more than 7 days, I use beeline shell to connect the HiveServer2,all operation failed. The log of HiveServer2 shows it was caused by the Kerberos auth failure,the exception stack trace is: 2013-03-26 11:55:20,932 ERROR hive.ql.metadata.Hive: java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1084) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.init(RetryingMetaStoreClient.java:51) at org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:61) at org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2140) at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2151) at org.apache.hadoop.hive.ql.metadata.Hive.getDelegationToken(Hive.java:2275) at org.apache.hive.service.cli.CLIService.getDelegationTokenFromMetaStore(CLIService.java:358) at org.apache.hive.service.cli.thrift.ThriftCLIService.OpenSession(ThriftCLIService.java:127) at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1073) at org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1058) at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) at org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge20S.java:565) at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:206) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) at java.lang.Thread.run(Thread.java:662) Caused by: java.lang.reflect.InvocationTargetException at sun.reflect.GeneratedConstructorAccessor52.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) at java.lang.reflect.Constructor.newInstance(Constructor.java:513) at org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1082) ... 16 more Caused by: java.lang.IllegalStateException: This ticket is no longer valid at javax.security.auth.kerberos.KerberosTicket.toString(KerberosTicket.java:601) at java.lang.String.valueOf(String.java:2826) at java.lang.StringBuilder.append(StringBuilder.java:115) at sun.security.jgss.krb5.SubjectComber.findAux(SubjectComber.java:120) at sun.security.jgss.krb5.SubjectComber.find(SubjectComber.java:41) at sun.security.jgss.krb5.Krb5Util.getTicket(Krb5Util.java:130) at sun.security.jgss.krb5.Krb5InitCredential$1.run(Krb5InitCredential.java:328) at java.security.AccessController.doPrivileged(Native Method) at sun.security.jgss.krb5.Krb5InitCredential.getTgt(Krb5InitCredential.java:325) at sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:128) at sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106) at sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172) at sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195) at sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:162)
Re: Review Request 13262: HIVE-4573: JDBC Compliance getTables
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13262/#review24629 --- common/src/java/org/apache/hadoop/hive/conf/HiveConf.java https://reviews.apache.org/r/13262/#comment48725 is confusing. Default is HIVE right? I also think that the hive-site template should be updated with a description of the variable. service/src/java/org/apache/hive/service/cli/operation/ClassicTableTypeMapping.java https://reviews.apache.org/r/13262/#comment48726 test seems unnecessary. private final can't change to null. service/src/java/org/apache/hive/service/cli/operation/ClassicTableTypeMapping.java https://reviews.apache.org/r/13262/#comment48727 see above - Gunther Hagleitner On Aug. 4, 2013, 1:03 a.m., Prasad Mujumdar wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13262/ --- (Updated Aug. 4, 2013, 1:03 a.m.) Review request for hive. Bugs: HIVE-4573 https://issues.apache.org/jira/browse/HIVE-4573 Repository: hive-git Description --- Support alternate table type name for GetTables() and GetTableTypes(). Currently HiveServer2 supports Hive's native table type names eg. MANAGED_TABLE, VIRTUAL_VIEW etc. The more common terms used by various DB vendors and tools are TABLE and VIEW. This makes it difficult to integrate Hive with various tools or custom applications. The patch introduces an alternate table type name mapping that can be configured at instance level or session level. Diffs - common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 555343e jdbc/src/test/org/apache/hive/jdbc/TestJdbcDriver2.java 1042125 service/src/java/org/apache/hive/service/cli/operation/ClassicTableTypeMapping.java PRE-CREATION service/src/java/org/apache/hive/service/cli/operation/GetTableTypesOperation.java eaf867e service/src/java/org/apache/hive/service/cli/operation/GetTablesOperation.java d9d0e9c service/src/java/org/apache/hive/service/cli/operation/HiveTableTypeMapping.java PRE-CREATION service/src/java/org/apache/hive/service/cli/operation/TableTypeMapping.java PRE-CREATION service/src/java/org/apache/hive/service/cli/operation/TableTypeMappingFactory.java PRE-CREATION Diff: https://reviews.apache.org/r/13262/diff/ Testing --- Added test cases in TestJdbcDriver2. Thanks, Prasad Mujumdar
[jira] [Commented] (HIVE-4573) Support alternate table types for HiveServer2
[
https://issues.apache.org/jira/browse/HIVE-4573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728813#comment-13728813
]
Gunther Hagleitner commented on HIVE-4573:
--
Comments on RB.
Support alternate table types for HiveServer2
-
Key: HIVE-4573
URL: https://issues.apache.org/jira/browse/HIVE-4573
Project: Hive
Issue Type: Bug
Components: HiveServer2, JDBC
Affects Versions: 0.10.0
Reporter: Johndee Burks
Assignee: Prasad Mujumdar
Priority: Minor
Attachments: HIVE-4573.1.patch
The getTables jdbc function no longer returns information when using normal
JDBC table types like TABLE or VIEW. You must now use a more specific type
such as MANAGED_TABLE or VIRTUAL_VIEW. An example application that will fail
to return results against 0.10 is below, works without issue in 0.9. In my
0.10 test I used HS2.
{code}
import java.sql.SQLException;
import java.sql.Connection;
import java.sql.ResultSet;
import java.sql.Statement;
import java.sql.DriverManager;
import org.apache.hive.jdbc.HiveDriver;
import java.sql.DatabaseMetaData;
public class TestGet {
private static String driverName = org.apache.hive.jdbc.HiveDriver;
/**
* @param args
* @throws SQLException
*/
public static void main(String[] args) throws SQLException {
try {
Class.forName(driverName);
} catch (ClassNotFoundException e) {
// TODO Auto-generated catch block
e.printStackTrace();
System.exit(1);
}
Connection con =
DriverManager.getConnection(jdbc:hive2://hostname:1/default);
DatabaseMetaData dbmd = con.getMetaData();
String[] types = {TABLE};
ResultSet rs = dbmd.getTables(null, null, %, types);
while (rs.next()) {
System.out.println(rs.getString(TABLE_NAME));
}
}
}
}
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4573) Support alternate table types for HiveServer2
[
https://issues.apache.org/jira/browse/HIVE-4573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728815#comment-13728815
]
Prasad Mujumdar commented on HIVE-4573:
---
[~hagleitn] Thanks for taking a look.
IMO, both use cases are valid. For applications or admin/monitoring tools
developed specifically for hive, it would be useful to keep the hive specific
details. Also we don't would break backward compatibility for existing apps
that are expecting the hive way. That's my rationale for the fix.
If that sounds reasonable, I will go ahead and make the necessary doc changes.
Support alternate table types for HiveServer2
-
Key: HIVE-4573
URL: https://issues.apache.org/jira/browse/HIVE-4573
Project: Hive
Issue Type: Bug
Components: HiveServer2, JDBC
Affects Versions: 0.10.0
Reporter: Johndee Burks
Assignee: Prasad Mujumdar
Priority: Minor
Attachments: HIVE-4573.1.patch
The getTables jdbc function no longer returns information when using normal
JDBC table types like TABLE or VIEW. You must now use a more specific type
such as MANAGED_TABLE or VIRTUAL_VIEW. An example application that will fail
to return results against 0.10 is below, works without issue in 0.9. In my
0.10 test I used HS2.
{code}
import java.sql.SQLException;
import java.sql.Connection;
import java.sql.ResultSet;
import java.sql.Statement;
import java.sql.DriverManager;
import org.apache.hive.jdbc.HiveDriver;
import java.sql.DatabaseMetaData;
public class TestGet {
private static String driverName = org.apache.hive.jdbc.HiveDriver;
/**
* @param args
* @throws SQLException
*/
public static void main(String[] args) throws SQLException {
try {
Class.forName(driverName);
} catch (ClassNotFoundException e) {
// TODO Auto-generated catch block
e.printStackTrace();
System.exit(1);
}
Connection con =
DriverManager.getConnection(jdbc:hive2://hostname:1/default);
DatabaseMetaData dbmd = con.getMetaData();
String[] types = {TABLE};
ResultSet rs = dbmd.getTables(null, null, %, types);
while (rs.next()) {
System.out.println(rs.getString(TABLE_NAME));
}
}
}
}
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4573) Support alternate table types for HiveServer2
[
https://issues.apache.org/jira/browse/HIVE-4573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728818#comment-13728818
]
Gunther Hagleitner commented on HIVE-4573:
--
I see. That makes sense. Although it seems that eventually (.13?) you would
want the default to be CLASSIC (since it's easier for hive specific tools to
set it to HIVE before they do their thing than for generic JDBC tools to set it
to CLASSIC).
Support alternate table types for HiveServer2
-
Key: HIVE-4573
URL: https://issues.apache.org/jira/browse/HIVE-4573
Project: Hive
Issue Type: Bug
Components: HiveServer2, JDBC
Affects Versions: 0.10.0
Reporter: Johndee Burks
Assignee: Prasad Mujumdar
Priority: Minor
Attachments: HIVE-4573.1.patch
The getTables jdbc function no longer returns information when using normal
JDBC table types like TABLE or VIEW. You must now use a more specific type
such as MANAGED_TABLE or VIRTUAL_VIEW. An example application that will fail
to return results against 0.10 is below, works without issue in 0.9. In my
0.10 test I used HS2.
{code}
import java.sql.SQLException;
import java.sql.Connection;
import java.sql.ResultSet;
import java.sql.Statement;
import java.sql.DriverManager;
import org.apache.hive.jdbc.HiveDriver;
import java.sql.DatabaseMetaData;
public class TestGet {
private static String driverName = org.apache.hive.jdbc.HiveDriver;
/**
* @param args
* @throws SQLException
*/
public static void main(String[] args) throws SQLException {
try {
Class.forName(driverName);
} catch (ClassNotFoundException e) {
// TODO Auto-generated catch block
e.printStackTrace();
System.exit(1);
}
Connection con =
DriverManager.getConnection(jdbc:hive2://hostname:1/default);
DatabaseMetaData dbmd = con.getMetaData();
String[] types = {TABLE};
ResultSet rs = dbmd.getTables(null, null, %, types);
while (rs.next()) {
System.out.println(rs.getString(TABLE_NAME));
}
}
}
}
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4993) Add HCatalog documentation to Hive wiki
[ https://issues.apache.org/jira/browse/HIVE-4993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728828#comment-13728828 ] Lefty Leverenz commented on HIVE-4993: -- Added a section to the Hive wiki's home page for HCatalog WebHCat docs and created pages for them: * [Hive Home|https://cwiki.apache.org/confluence/display/Hive/Home] * [HCatalog manual|https://cwiki.apache.org/confluence/display/Hive/HCatalog] * [WebHCat (Templeton) manual|https://cwiki.apache.org/confluence/display/Hive/WebHCat] The organization of the wiki can be changed later, if necessary. Add HCatalog documentation to Hive wiki --- Key: HIVE-4993 URL: https://issues.apache.org/jira/browse/HIVE-4993 Project: Hive Issue Type: Bug Components: Documentation Affects Versions: 0.11.0 Reporter: Lefty Leverenz Assignee: Lefty Leverenz The documentation for HCatalog versions 0.5.0 and earlier (Apache incubator) had xml source files which generated html pdf output files. Now that HCatalog is part of the Hive project, the HCatalog documents need to be added to the Hive wiki. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
Re: Review Request 13262: HIVE-4573: JDBC Compliance getTables
On Aug. 4, 2013, 9:23 a.m., Gunther Hagleitner wrote: common/src/java/org/apache/hadoop/hive/conf/HiveConf.java, line 741 https://reviews.apache.org/r/13262/diff/1/?file=336851#file336851line741 is confusing. Default is HIVE right? I also think that the hive-site template should be updated with a description of the variable. Changed to HIVE. On Aug. 4, 2013, 9:23 a.m., Gunther Hagleitner wrote: service/src/java/org/apache/hive/service/cli/operation/ClassicTableTypeMapping.java, line 61 https://reviews.apache.org/r/13262/diff/1/?file=336853#file336853line61 test seems unnecessary. private final can't change to null. It's just checking the arguments, though not really needed. Fixed. On Aug. 4, 2013, 9:23 a.m., Gunther Hagleitner wrote: service/src/java/org/apache/hive/service/cli/operation/ClassicTableTypeMapping.java, line 73 https://reviews.apache.org/r/13262/diff/1/?file=336853#file336853line73 see above Done - Prasad --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13262/#review24629 --- On Aug. 4, 2013, 1:03 a.m., Prasad Mujumdar wrote: --- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13262/ --- (Updated Aug. 4, 2013, 1:03 a.m.) Review request for hive. Bugs: HIVE-4573 https://issues.apache.org/jira/browse/HIVE-4573 Repository: hive-git Description --- Support alternate table type name for GetTables() and GetTableTypes(). Currently HiveServer2 supports Hive's native table type names eg. MANAGED_TABLE, VIRTUAL_VIEW etc. The more common terms used by various DB vendors and tools are TABLE and VIEW. This makes it difficult to integrate Hive with various tools or custom applications. The patch introduces an alternate table type name mapping that can be configured at instance level or session level. Diffs - common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 555343e jdbc/src/test/org/apache/hive/jdbc/TestJdbcDriver2.java 1042125 service/src/java/org/apache/hive/service/cli/operation/ClassicTableTypeMapping.java PRE-CREATION service/src/java/org/apache/hive/service/cli/operation/GetTableTypesOperation.java eaf867e service/src/java/org/apache/hive/service/cli/operation/GetTablesOperation.java d9d0e9c service/src/java/org/apache/hive/service/cli/operation/HiveTableTypeMapping.java PRE-CREATION service/src/java/org/apache/hive/service/cli/operation/TableTypeMapping.java PRE-CREATION service/src/java/org/apache/hive/service/cli/operation/TableTypeMappingFactory.java PRE-CREATION Diff: https://reviews.apache.org/r/13262/diff/ Testing --- Added test cases in TestJdbcDriver2. Thanks, Prasad Mujumdar
Re: Review Request 13262: HIVE-4573: JDBC Compliance getTables
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13262/ --- (Updated Aug. 4, 2013, 10:06 a.m.) Review request for hive. Changes --- Changes per review comments Bugs: HIVE-4573 https://issues.apache.org/jira/browse/HIVE-4573 Repository: hive-git Description --- Support alternate table type name for GetTables() and GetTableTypes(). Currently HiveServer2 supports Hive's native table type names eg. MANAGED_TABLE, VIRTUAL_VIEW etc. The more common terms used by various DB vendors and tools are TABLE and VIEW. This makes it difficult to integrate Hive with various tools or custom applications. The patch introduces an alternate table type name mapping that can be configured at instance level or session level. Diffs (updated) - common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 555343e conf/hive-default.xml.template f01e715 jdbc/src/test/org/apache/hive/jdbc/TestJdbcDriver2.java 1042125 service/src/java/org/apache/hive/service/cli/operation/ClassicTableTypeMapping.java PRE-CREATION service/src/java/org/apache/hive/service/cli/operation/GetTableTypesOperation.java eaf867e service/src/java/org/apache/hive/service/cli/operation/GetTablesOperation.java d9d0e9c service/src/java/org/apache/hive/service/cli/operation/HiveTableTypeMapping.java PRE-CREATION service/src/java/org/apache/hive/service/cli/operation/TableTypeMapping.java PRE-CREATION service/src/java/org/apache/hive/service/cli/operation/TableTypeMappingFactory.java PRE-CREATION Diff: https://reviews.apache.org/r/13262/diff/ Testing --- Added test cases in TestJdbcDriver2. Thanks, Prasad Mujumdar
[jira] [Commented] (HIVE-4994) Add WebHCat (Templeton) documentation to Hive wiki
[ https://issues.apache.org/jira/browse/HIVE-4994?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728835#comment-13728835 ] Lefty Leverenz commented on HIVE-4994: -- Added a section to the Hive wiki's home page for HCatalog WebHCat documentation. Created a wikidoc for the WebHCat manual which currently contains links to WebHCat chapters in the HCatalog 0.5.0 docs: * [Hive Home|https://cwiki.apache.org/confluence/display/Hive/Home] * [WebHCat (Templeton) manual|https://cwiki.apache.org/confluence/display/Hive/WebHCat] Add WebHCat (Templeton) documentation to Hive wiki -- Key: HIVE-4994 URL: https://issues.apache.org/jira/browse/HIVE-4994 Project: Hive Issue Type: Bug Components: Documentation Affects Versions: 0.11.0 Reporter: Lefty Leverenz Assignee: Lefty Leverenz WebHCat (Templeton) documentation in the Apache incubator had xml source files which generated html pdf output files. Now that HCatalog and WebHCat are part of the Hive project, all the WebHCat documents need to be added to the Hive wiki. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4573) Support alternate table types for HiveServer2
[
https://issues.apache.org/jira/browse/HIVE-4573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasad Mujumdar updated HIVE-4573:
--
Attachment: HIVE-4573.2.patch
Updated the patch per review comments.
Support alternate table types for HiveServer2
-
Key: HIVE-4573
URL: https://issues.apache.org/jira/browse/HIVE-4573
Project: Hive
Issue Type: Bug
Components: HiveServer2, JDBC
Affects Versions: 0.10.0
Reporter: Johndee Burks
Assignee: Prasad Mujumdar
Priority: Minor
Attachments: HIVE-4573.1.patch, HIVE-4573.2.patch
The getTables jdbc function no longer returns information when using normal
JDBC table types like TABLE or VIEW. You must now use a more specific type
such as MANAGED_TABLE or VIRTUAL_VIEW. An example application that will fail
to return results against 0.10 is below, works without issue in 0.9. In my
0.10 test I used HS2.
{code}
import java.sql.SQLException;
import java.sql.Connection;
import java.sql.ResultSet;
import java.sql.Statement;
import java.sql.DriverManager;
import org.apache.hive.jdbc.HiveDriver;
import java.sql.DatabaseMetaData;
public class TestGet {
private static String driverName = org.apache.hive.jdbc.HiveDriver;
/**
* @param args
* @throws SQLException
*/
public static void main(String[] args) throws SQLException {
try {
Class.forName(driverName);
} catch (ClassNotFoundException e) {
// TODO Auto-generated catch block
e.printStackTrace();
System.exit(1);
}
Connection con =
DriverManager.getConnection(jdbc:hive2://hostname:1/default);
DatabaseMetaData dbmd = con.getMetaData();
String[] types = {TABLE};
ResultSet rs = dbmd.getTables(null, null, %, types);
while (rs.next()) {
System.out.println(rs.getString(TABLE_NAME));
}
}
}
}
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4573) Support alternate table types for HiveServer2
[
https://issues.apache.org/jira/browse/HIVE-4573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728839#comment-13728839
]
Gunther Hagleitner commented on HIVE-4573:
--
Thanks! LGTM: +1
Support alternate table types for HiveServer2
-
Key: HIVE-4573
URL: https://issues.apache.org/jira/browse/HIVE-4573
Project: Hive
Issue Type: Bug
Components: HiveServer2, JDBC
Affects Versions: 0.10.0
Reporter: Johndee Burks
Assignee: Prasad Mujumdar
Priority: Minor
Attachments: HIVE-4573.1.patch, HIVE-4573.2.patch
The getTables jdbc function no longer returns information when using normal
JDBC table types like TABLE or VIEW. You must now use a more specific type
such as MANAGED_TABLE or VIRTUAL_VIEW. An example application that will fail
to return results against 0.10 is below, works without issue in 0.9. In my
0.10 test I used HS2.
{code}
import java.sql.SQLException;
import java.sql.Connection;
import java.sql.ResultSet;
import java.sql.Statement;
import java.sql.DriverManager;
import org.apache.hive.jdbc.HiveDriver;
import java.sql.DatabaseMetaData;
public class TestGet {
private static String driverName = org.apache.hive.jdbc.HiveDriver;
/**
* @param args
* @throws SQLException
*/
public static void main(String[] args) throws SQLException {
try {
Class.forName(driverName);
} catch (ClassNotFoundException e) {
// TODO Auto-generated catch block
e.printStackTrace();
System.exit(1);
}
Connection con =
DriverManager.getConnection(jdbc:hive2://hostname:1/default);
DatabaseMetaData dbmd = con.getMetaData();
String[] types = {TABLE};
ResultSet rs = dbmd.getTables(null, null, %, types);
while (rs.next()) {
System.out.println(rs.getString(TABLE_NAME));
}
}
}
}
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4343) HS2 with kerberos- local task for map join fails
[ https://issues.apache.org/jira/browse/HIVE-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728846#comment-13728846 ] Hudson commented on HIVE-4343: -- SUCCESS: Integrated in Hive-trunk-hadoop1-ptest #116 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/116/]) HIVE-4343: HS2 with kerberos - local task for map join fails (Thejas M Nair via Gunther Hagleitner) (gunther: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1510097) * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/SecureCmdDoAs.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/ExecDriver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/MapredLocalTask.java * /hive/trunk/shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java * /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java * /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java * /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java HS2 with kerberos- local task for map join fails Key: HIVE-4343 URL: https://issues.apache.org/jira/browse/HIVE-4343 Project: Hive Issue Type: Bug Components: HiveServer2 Reporter: Thejas M Nair Assignee: Thejas M Nair Fix For: 0.12.0 Attachments: HIVE-4343.1.patch, HIVE-4343.2.patch, HIVE-4343.3.patch With hive server2 configured with kerberos security, when a (map) join query is run, it results in failure with GSSException: No valid credentials provided -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4573) Support alternate table types for HiveServer2
[
https://issues.apache.org/jira/browse/HIVE-4573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728854#comment-13728854
]
Hive QA commented on HIVE-4573:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12595799/HIVE-4573.2.patch
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 2762 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_bucket_num_reducers
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_script_broken_pipe1
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/300/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/300/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests failed with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
Support alternate table types for HiveServer2
-
Key: HIVE-4573
URL: https://issues.apache.org/jira/browse/HIVE-4573
Project: Hive
Issue Type: Bug
Components: HiveServer2, JDBC
Affects Versions: 0.10.0
Reporter: Johndee Burks
Assignee: Prasad Mujumdar
Priority: Minor
Attachments: HIVE-4573.1.patch, HIVE-4573.2.patch
The getTables jdbc function no longer returns information when using normal
JDBC table types like TABLE or VIEW. You must now use a more specific type
such as MANAGED_TABLE or VIRTUAL_VIEW. An example application that will fail
to return results against 0.10 is below, works without issue in 0.9. In my
0.10 test I used HS2.
{code}
import java.sql.SQLException;
import java.sql.Connection;
import java.sql.ResultSet;
import java.sql.Statement;
import java.sql.DriverManager;
import org.apache.hive.jdbc.HiveDriver;
import java.sql.DatabaseMetaData;
public class TestGet {
private static String driverName = org.apache.hive.jdbc.HiveDriver;
/**
* @param args
* @throws SQLException
*/
public static void main(String[] args) throws SQLException {
try {
Class.forName(driverName);
} catch (ClassNotFoundException e) {
// TODO Auto-generated catch block
e.printStackTrace();
System.exit(1);
}
Connection con =
DriverManager.getConnection(jdbc:hive2://hostname:1/default);
DatabaseMetaData dbmd = con.getMetaData();
String[] types = {TABLE};
ResultSet rs = dbmd.getTables(null, null, %, types);
while (rs.next()) {
System.out.println(rs.getString(TABLE_NAME));
}
}
}
}
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4915) unit tests fail on windows because of difference in input file size
[ https://issues.apache.org/jira/browse/HIVE-4915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728859#comment-13728859 ] Hudson commented on HIVE-4915: -- ABORTED: Integrated in Hive-trunk-hadoop2 #326 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/326/]) HIVE-4915 : unit tests fail on windows because of difference in input file size (Thejas Nair via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1510040) * /hive/trunk/.gitattributes unit tests fail on windows because of difference in input file size --- Key: HIVE-4915 URL: https://issues.apache.org/jira/browse/HIVE-4915 Project: Hive Issue Type: Bug Affects Versions: 0.12.0 Reporter: Thejas M Nair Assignee: Thejas M Nair Fix For: 0.12.0 Attachments: HIVE-4915.1.patch Several qfile based tests fail on windows because in the output of explain extended, the total file size of input files shown is different on windows. This is because by default text files on windows are checked out with two char line endings, and *.dat files used as input files for the tables are considered as text files. So for every line in the .dat file, the size of the file is larger by 1 byte on windows. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4951) combine2_win.q.out needs update for HIVE-3253 (increasing nesting levels)
[ https://issues.apache.org/jira/browse/HIVE-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728860#comment-13728860 ] Hudson commented on HIVE-4951: -- ABORTED: Integrated in Hive-trunk-hadoop2 #326 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/326/]) HIVE-4951 : combine2_win.q.out needs update for HIVE3253 (increasing nesting levels) (Thejas Nair via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1510039) * /hive/trunk/ql/src/test/results/clientpositive/combine2_win.q.out combine2_win.q.out needs update for HIVE-3253 (increasing nesting levels) - Key: HIVE-4951 URL: https://issues.apache.org/jira/browse/HIVE-4951 Project: Hive Issue Type: Bug Affects Versions: 0.11.0 Reporter: Thejas M Nair Assignee: Thejas M Nair Fix For: 0.12.0 Attachments: HIVE-4951.1.patch combine2.q was updated in HIVE-3253, the corresponding change is missing in combine2_win.q, causing it to fail on windows. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4995) select * may incorrectly return empty fields with hbase-handler
Swarnim Kulkarni created HIVE-4995:
--
Summary: select * may incorrectly return empty fields with
hbase-handler
Key: HIVE-4995
URL: https://issues.apache.org/jira/browse/HIVE-4995
Project: Hive
Issue Type: Bug
Components: HBase Handler
Affects Versions: 0.11.0
Reporter: Swarnim Kulkarni
Assignee: Swarnim Kulkarni
HIVE-3725 added capability to pull hbase columns with prefixes. However the way
the current logic to add columns stands in HiveHBaseTableInput format, it might
cause some columns to incorrectly display empty fields.
Consider the following query:
{noformat}
CREATE EXTERNAL TABLE test_table(key string, value1 mapstring,string, value2
string)
ROW FORMAT SERDE 'org.apache.hadoop.hive.hbase.HBaseSerDe'
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES
(hbase.columns.mapping = :key,cf-a:prefix.*,cf-a:another_col)
TBLPROPERTIES (hbase.table.name = test_table);
{noformat}
Given the existing logic in HiveHBaseTableInputFormat:
{code}
for (int i = 0; i columnsMapping.size(); i++)
{
ColumnMapping colMap = columnsMapping.get(i);
if (colMap.hbaseRowKey) {
continue;
}
if (colMap.qualifierName == null) {
scan.addFamily(colMap.familyNameBytes);
} else {
scan.addColumn(colMap.familyNameBytes, colMap.qualifierNameBytes);
}
}
{code}
So for the above query, the 'addFamily' will be called first followed by
'addColumn' for the column family cf-a. This will wipe away whatever we had
set with the 'addFamily' call in the previous step resulting in an empty column
when queried.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4995) select * may incorrectly return empty fields with hbase-handler
[
https://issues.apache.org/jira/browse/HIVE-4995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Swarnim Kulkarni updated HIVE-4995:
---
Attachment: HIVE-4995.1.patch.txt
select * may incorrectly return empty fields with hbase-handler
---
Key: HIVE-4995
URL: https://issues.apache.org/jira/browse/HIVE-4995
Project: Hive
Issue Type: Bug
Components: HBase Handler
Affects Versions: 0.11.0
Reporter: Swarnim Kulkarni
Assignee: Swarnim Kulkarni
Attachments: HIVE-4995.1.patch.txt
HIVE-3725 added capability to pull hbase columns with prefixes. However the
way the current logic to add columns stands in HiveHBaseTableInput format, it
might cause some columns to incorrectly display empty fields.
Consider the following query:
{noformat}
CREATE EXTERNAL TABLE test_table(key string, value1 mapstring,string,
value2 string)
ROW FORMAT SERDE 'org.apache.hadoop.hive.hbase.HBaseSerDe'
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES
(hbase.columns.mapping = :key,cf-a:prefix.*,cf-a:another_col)
TBLPROPERTIES (hbase.table.name = test_table);
{noformat}
Given the existing logic in HiveHBaseTableInputFormat:
{code}
for (int i = 0; i columnsMapping.size(); i++)
{
ColumnMapping colMap = columnsMapping.get(i);
if (colMap.hbaseRowKey) {
continue;
}
if (colMap.qualifierName == null) {
scan.addFamily(colMap.familyNameBytes);
} else {
scan.addColumn(colMap.familyNameBytes, colMap.qualifierNameBytes);
}
}
{code}
So for the above query, the 'addFamily' will be called first followed by
'addColumn' for the column family cf-a. This will wipe away whatever we had
set with the 'addFamily' call in the previous step resulting in an empty
column when queried.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
Review Request 13263: select * may incorrectly return empty columns for hbase-handler.
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13263/ --- Review request for hive. Bugs: HIVE-4995 https://issues.apache.org/jira/browse/HIVE-4995 Repository: hive-git Description --- select * may incorrectly return empty columns for hbase-handler. Please refer to the JIRA for a detailed description of the issue. Diffs - hbase-handler/src/java/org/apache/hadoop/hive/hbase/HiveHBaseTableInputFormat.java e3a8133 hbase-handler/src/test/queries/positive/hbase_binary_map_queries_prefix.q PRE-CREATION hbase-handler/src/test/results/positive/hbase_binary_map_queries_prefix.q.out PRE-CREATION Diff: https://reviews.apache.org/r/13263/diff/ Testing --- Additional integration tests added to prove that the attached patch resolves the issue. Thanks, Swarnim Kulkarni
[jira] [Updated] (HIVE-4995) select * may incorrectly return empty fields with hbase-handler
[
https://issues.apache.org/jira/browse/HIVE-4995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Swarnim Kulkarni updated HIVE-4995:
---
Status: Patch Available (was: Open)
Review request: https://reviews.apache.org/r/13263/
select * may incorrectly return empty fields with hbase-handler
---
Key: HIVE-4995
URL: https://issues.apache.org/jira/browse/HIVE-4995
Project: Hive
Issue Type: Bug
Components: HBase Handler
Affects Versions: 0.11.0
Reporter: Swarnim Kulkarni
Assignee: Swarnim Kulkarni
Attachments: HIVE-4995.1.patch.txt
HIVE-3725 added capability to pull hbase columns with prefixes. However the
way the current logic to add columns stands in HiveHBaseTableInput format, it
might cause some columns to incorrectly display empty fields.
Consider the following query:
{noformat}
CREATE EXTERNAL TABLE test_table(key string, value1 mapstring,string,
value2 string)
ROW FORMAT SERDE 'org.apache.hadoop.hive.hbase.HBaseSerDe'
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES
(hbase.columns.mapping = :key,cf-a:prefix.*,cf-a:another_col)
TBLPROPERTIES (hbase.table.name = test_table);
{noformat}
Given the existing logic in HiveHBaseTableInputFormat:
{code}
for (int i = 0; i columnsMapping.size(); i++)
{
ColumnMapping colMap = columnsMapping.get(i);
if (colMap.hbaseRowKey) {
continue;
}
if (colMap.qualifierName == null) {
scan.addFamily(colMap.familyNameBytes);
} else {
scan.addColumn(colMap.familyNameBytes, colMap.qualifierNameBytes);
}
}
{code}
So for the above query, the 'addFamily' will be called first followed by
'addColumn' for the column family cf-a. This will wipe away whatever we had
set with the 'addFamily' call in the previous step resulting in an empty
column when queried.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4995) select * may incorrectly return empty fields with hbase-handler
[
https://issues.apache.org/jira/browse/HIVE-4995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728904#comment-13728904
]
Swarnim Kulkarni commented on HIVE-4995:
This should be ready for review.
select * may incorrectly return empty fields with hbase-handler
---
Key: HIVE-4995
URL: https://issues.apache.org/jira/browse/HIVE-4995
Project: Hive
Issue Type: Bug
Components: HBase Handler
Affects Versions: 0.11.0
Reporter: Swarnim Kulkarni
Assignee: Swarnim Kulkarni
Attachments: HIVE-4995.1.patch.txt
HIVE-3725 added capability to pull hbase columns with prefixes. However the
way the current logic to add columns stands in HiveHBaseTableInput format, it
might cause some columns to incorrectly display empty fields.
Consider the following query:
{noformat}
CREATE EXTERNAL TABLE test_table(key string, value1 mapstring,string,
value2 string)
ROW FORMAT SERDE 'org.apache.hadoop.hive.hbase.HBaseSerDe'
STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler'
WITH SERDEPROPERTIES
(hbase.columns.mapping = :key,cf-a:prefix.*,cf-a:another_col)
TBLPROPERTIES (hbase.table.name = test_table);
{noformat}
Given the existing logic in HiveHBaseTableInputFormat:
{code}
for (int i = 0; i columnsMapping.size(); i++)
{
ColumnMapping colMap = columnsMapping.get(i);
if (colMap.hbaseRowKey) {
continue;
}
if (colMap.qualifierName == null) {
scan.addFamily(colMap.familyNameBytes);
} else {
scan.addColumn(colMap.familyNameBytes, colMap.qualifierNameBytes);
}
}
{code}
So for the above query, the 'addFamily' will be called first followed by
'addColumn' for the column family cf-a. This will wipe away whatever we had
set with the 'addFamily' call in the previous step resulting in an empty
column when queried.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4970) BinaryConverter does not respect nulls
[ https://issues.apache.org/jira/browse/HIVE-4970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728920#comment-13728920 ] Edward Capriolo commented on HIVE-4970: --- Errors look unrelated +1 BinaryConverter does not respect nulls -- Key: HIVE-4970 URL: https://issues.apache.org/jira/browse/HIVE-4970 Project: Hive Issue Type: Bug Affects Versions: 0.10.0, 0.11.0, 0.12.0 Reporter: Mark Wagner Assignee: Mark Wagner Fix For: 0.12.0 Attachments: HIVE-4970.1.patch, HIVE-4970.2.patch Right now, the BinaryConverter in PrimitiveObjectInspectorConverter does not handle null values the same as the other converters. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4970) BinaryConverter does not respect nulls
[ https://issues.apache.org/jira/browse/HIVE-4970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Capriolo updated HIVE-4970: -- Resolution: Fixed Status: Resolved (was: Patch Available) Resolved. Thanks Mark. BinaryConverter does not respect nulls -- Key: HIVE-4970 URL: https://issues.apache.org/jira/browse/HIVE-4970 Project: Hive Issue Type: Bug Affects Versions: 0.10.0, 0.11.0, 0.12.0 Reporter: Mark Wagner Assignee: Mark Wagner Fix For: 0.12.0 Attachments: HIVE-4970.1.patch, HIVE-4970.2.patch Right now, the BinaryConverter in PrimitiveObjectInspectorConverter does not handle null values the same as the other converters. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4879) Window functions that imply order can only be registered at compile time
[ https://issues.apache.org/jira/browse/HIVE-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728927#comment-13728927 ] Edward Capriolo commented on HIVE-4879: --- Committed myself via Brock's +1 thanks for the review Brock. Window functions that imply order can only be registered at compile time Key: HIVE-4879 URL: https://issues.apache.org/jira/browse/HIVE-4879 Project: Hive Issue Type: Improvement Affects Versions: 0.11.0 Reporter: Edward Capriolo Assignee: Edward Capriolo Fix For: 0.12.0 Attachments: HIVE-4879.1.patch.txt, HIVE-4879.2.patch.txt, HIVE-4879.3.patch.txt, HIVE-4879.4.patch.txt Adding an annotation for impliesOrder -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4343) HS2 with kerberos- local task for map join fails
[ https://issues.apache.org/jira/browse/HIVE-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728928#comment-13728928 ] Hudson commented on HIVE-4343: -- SUCCESS: Integrated in Hive-trunk-h0.21 #2244 (See [https://builds.apache.org/job/Hive-trunk-h0.21/2244/]) HIVE-4343: HS2 with kerberos - local task for map join fails (Thejas M Nair via Gunther Hagleitner) (gunther: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1510097) * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/SecureCmdDoAs.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/ExecDriver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/MapredLocalTask.java * /hive/trunk/shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java * /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java * /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java * /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java HS2 with kerberos- local task for map join fails Key: HIVE-4343 URL: https://issues.apache.org/jira/browse/HIVE-4343 Project: Hive Issue Type: Bug Components: HiveServer2 Reporter: Thejas M Nair Assignee: Thejas M Nair Fix For: 0.12.0 Attachments: HIVE-4343.1.patch, HIVE-4343.2.patch, HIVE-4343.3.patch With hive server2 configured with kerberos security, when a (map) join query is run, it results in failure with GSSException: No valid credentials provided -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4879) Window functions that imply order can only be registered at compile time
[ https://issues.apache.org/jira/browse/HIVE-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Capriolo updated HIVE-4879: -- Resolution: Fixed Status: Resolved (was: Patch Available) Window functions that imply order can only be registered at compile time Key: HIVE-4879 URL: https://issues.apache.org/jira/browse/HIVE-4879 Project: Hive Issue Type: Improvement Affects Versions: 0.11.0 Reporter: Edward Capriolo Assignee: Edward Capriolo Fix For: 0.12.0 Attachments: HIVE-4879.1.patch.txt, HIVE-4879.2.patch.txt, HIVE-4879.3.patch.txt, HIVE-4879.4.patch.txt Adding an annotation for impliesOrder -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4732) Reduce or eliminate the expensive Schema equals() check for AvroSerde
[
https://issues.apache.org/jira/browse/HIVE-4732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Edward Capriolo updated HIVE-4732:
--
Status: Open (was: Patch Available)
{code}
this.recordReaderID = UUID.randomUUID();
{code}
Random UUID does not guarantee no collisions. I believe using a TimeUUID is
better
Reduce or eliminate the expensive Schema equals() check for AvroSerde
-
Key: HIVE-4732
URL: https://issues.apache.org/jira/browse/HIVE-4732
Project: Hive
Issue Type: Improvement
Components: Serializers/Deserializers
Reporter: Mark Wagner
Assignee: Mohammad Kamrul Islam
Attachments: HIVE-4732.1.patch, HIVE-4732.v1.patch
The AvroSerde spends a significant amount of time checking schema equality.
Changing to compare hashcodes (which can be computed once then reused) will
improve performance.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4732) Reduce or eliminate the expensive Schema equals() check for AvroSerde
[ https://issues.apache.org/jira/browse/HIVE-4732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728931#comment-13728931 ] Edward Capriolo commented on HIVE-4732: --- See: http://en.wikipedia.org/wiki/Universally_unique_identifier#Random_UUID_probability_of_duplicates Reduce or eliminate the expensive Schema equals() check for AvroSerde - Key: HIVE-4732 URL: https://issues.apache.org/jira/browse/HIVE-4732 Project: Hive Issue Type: Improvement Components: Serializers/Deserializers Reporter: Mark Wagner Assignee: Mohammad Kamrul Islam Attachments: HIVE-4732.1.patch, HIVE-4732.v1.patch The AvroSerde spends a significant amount of time checking schema equality. Changing to compare hashcodes (which can be computed once then reused) will improve performance. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HIVE-770) remove enum to string mapping for counters when hive deprecates hadoop 17
[ https://issues.apache.org/jira/browse/HIVE-770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Capriolo resolved HIVE-770. -- Resolution: Invalid I think this has been resolved in another issue. remove enum to string mapping for counters when hive deprecates hadoop 17 - Key: HIVE-770 URL: https://issues.apache.org/jira/browse/HIVE-770 Project: Hive Issue Type: Improvement Components: Query Processor Reporter: Namit Jain -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-599) Embedded Hive SQL into Python
[ https://issues.apache.org/jira/browse/HIVE-599?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728933#comment-13728933 ] Edward Capriolo commented on HIVE-599: -- Seems like this issue has been dormant for a while. There is still a good case to allow people do define inline UDFs possibly using groovy or clojure, or even python :) I will close for now. If anyone wants to take a series attempt at being able to add functions inline at runtime they should re-open. Embedded Hive SQL into Python - Key: HIVE-599 URL: https://issues.apache.org/jira/browse/HIVE-599 Project: Hive Issue Type: New Feature Reporter: Ashish Thusoo Assignee: Ashish Thusoo While Hive does SQL it would be very powerful to be able to embed that SQL in languages like python in such a way that the hive query is also able to invoke python functions seemlessly. One possibility is to explore integration with Dumbo. Another is to see if the internal map_reduce.py tool can be open sourced as a Hive contrib. Other thoughts? -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HIVE-599) Embedded Hive SQL into Python
[ https://issues.apache.org/jira/browse/HIVE-599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Edward Capriolo resolved HIVE-599. -- Resolution: Fixed Embedded Hive SQL into Python - Key: HIVE-599 URL: https://issues.apache.org/jira/browse/HIVE-599 Project: Hive Issue Type: New Feature Reporter: Ashish Thusoo Assignee: Ashish Thusoo While Hive does SQL it would be very powerful to be able to embed that SQL in languages like python in such a way that the hive query is also able to invoke python functions seemlessly. One possibility is to explore integration with Dumbo. Another is to see if the internal map_reduce.py tool can be open sourced as a Hive contrib. Other thoughts? -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4991) hive build with 0.20 is broken
[
https://issues.apache.org/jira/browse/HIVE-4991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Edward Capriolo updated HIVE-4991:
--
Priority: Blocker (was: Major)
hive build with 0.20 is broken
--
Key: HIVE-4991
URL: https://issues.apache.org/jira/browse/HIVE-4991
Project: Hive
Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Thejas M Nair
Priority: Blocker
Labels: newbie
As reported in HIVE-4911
ant clean package -Dhadoop.mr.rev=20
Fails with -
{code}
compile:
[echo] Project: ql
[javac] Compiling 898 source files to
/Users/malakar/code/oss/hive/build/ql/classes
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:35:
package org.apache.commons.io does not exist
[javac] import org.apache.commons.io.FileUtils;
[javac] ^
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:743:
cannot find symbol
[javac] symbol : variable FileUtils
[javac] location: class org.apache.hadoop.hive.ql.session.SessionState
[javac] FileUtils.deleteDirectory(resourceDir);
[javac] ^
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
[javac] 2 errors
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-4991) hive build with 0.20 is broken
[
https://issues.apache.org/jira/browse/HIVE-4991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Edward Capriolo reassigned HIVE-4991:
-
Assignee: Edward Capriolo
hive build with 0.20 is broken
--
Key: HIVE-4991
URL: https://issues.apache.org/jira/browse/HIVE-4991
Project: Hive
Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Thejas M Nair
Assignee: Edward Capriolo
Priority: Blocker
Labels: newbie
As reported in HIVE-4911
ant clean package -Dhadoop.mr.rev=20
Fails with -
{code}
compile:
[echo] Project: ql
[javac] Compiling 898 source files to
/Users/malakar/code/oss/hive/build/ql/classes
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:35:
package org.apache.commons.io does not exist
[javac] import org.apache.commons.io.FileUtils;
[javac] ^
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:743:
cannot find symbol
[javac] symbol : variable FileUtils
[javac] location: class org.apache.hadoop.hive.ql.session.SessionState
[javac] FileUtils.deleteDirectory(resourceDir);
[javac] ^
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
[javac] 2 errors
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
Access to trigger jobs on jenkins
Hello, I was wondering if it is possible to get access to be able to trigger jobs on the jenkins server? Or is that access limited to committers? Thanks, -- Swarnim
[jira] [Commented] (HIVE-4991) hive build with 0.20 is broken
[
https://issues.apache.org/jira/browse/HIVE-4991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728942#comment-13728942
]
Edward Capriolo commented on HIVE-4991:
---
{code}
1510097gunther public void addEnv(MapString, String env){
1510097gunther env.put(UserGroupInformation.HADOOP_TOKEN_FILE_LOCATION,
1510097gunther tokenPath.toUri().getPath());
1510097gunther }
{code}
This is wrong as well ^ remember Hiveworks with hadoop 0.20.0. So post 0.20.0
hacks need a shim.
hive build with 0.20 is broken
--
Key: HIVE-4991
URL: https://issues.apache.org/jira/browse/HIVE-4991
Project: Hive
Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Thejas M Nair
Assignee: Edward Capriolo
Priority: Blocker
Labels: newbie
As reported in HIVE-4911
ant clean package -Dhadoop.mr.rev=20
Fails with -
{code}
compile:
[echo] Project: ql
[javac] Compiling 898 source files to
/Users/malakar/code/oss/hive/build/ql/classes
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:35:
package org.apache.commons.io does not exist
[javac] import org.apache.commons.io.FileUtils;
[javac] ^
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:743:
cannot find symbol
[javac] symbol : variable FileUtils
[javac] location: class org.apache.hadoop.hive.ql.session.SessionState
[javac] FileUtils.deleteDirectory(resourceDir);
[javac] ^
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
[javac] 2 errors
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4991) hive build with 0.20 is broken
[
https://issues.apache.org/jira/browse/HIVE-4991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728943#comment-13728943
]
Edward Capriolo commented on HIVE-4991:
---
First part of fix.
{quote}
[edward@jackintosh hive-trunk]$ svn diff
Index: shims/ivy.xml
===
--- shims/ivy.xml (revision 1510299)
+++ shims/ivy.xml (working copy)
@@ -121,6 +121,12 @@
/dependency
!-- Hadoop 0.20 shim dependencies. Used for building 0.20 shims. --
+dependency org=commons-io name=commons-io rev=2.4
+ include type=jar/
+ exclude org=commons-daemon module=commons-daemon/!--bad POM--
+ exclude org=org.apache.commons module=commons-daemon/!--bad POM--
+/dependency
+
dependency org=org.apache.hadoop name=hadoop-core
rev=${hadoop-0.20.version}
conf=hadoop0.20.shim-default
{quote}
hive build with 0.20 is broken
--
Key: HIVE-4991
URL: https://issues.apache.org/jira/browse/HIVE-4991
Project: Hive
Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Thejas M Nair
Assignee: Edward Capriolo
Priority: Blocker
Labels: newbie
As reported in HIVE-4911
ant clean package -Dhadoop.mr.rev=20
Fails with -
{code}
compile:
[echo] Project: ql
[javac] Compiling 898 source files to
/Users/malakar/code/oss/hive/build/ql/classes
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:35:
package org.apache.commons.io does not exist
[javac] import org.apache.commons.io.FileUtils;
[javac] ^
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:743:
cannot find symbol
[javac] symbol : variable FileUtils
[javac] location: class org.apache.hadoop.hive.ql.session.SessionState
[javac] FileUtils.deleteDirectory(resourceDir);
[javac] ^
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
[javac] 2 errors
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4991) hive build with 0.20 is broken
[
https://issues.apache.org/jira/browse/HIVE-4991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Edward Capriolo updated HIVE-4991:
--
Attachment: HIVE-4991.patch.txt
hive build with 0.20 is broken
--
Key: HIVE-4991
URL: https://issues.apache.org/jira/browse/HIVE-4991
Project: Hive
Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Thejas M Nair
Assignee: Edward Capriolo
Priority: Blocker
Labels: newbie
Attachments: HIVE-4991.patch.txt
As reported in HIVE-4911
ant clean package -Dhadoop.mr.rev=20
Fails with -
{code}
compile:
[echo] Project: ql
[javac] Compiling 898 source files to
/Users/malakar/code/oss/hive/build/ql/classes
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:35:
package org.apache.commons.io does not exist
[javac] import org.apache.commons.io.FileUtils;
[javac] ^
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:743:
cannot find symbol
[javac] symbol : variable FileUtils
[javac] location: class org.apache.hadoop.hive.ql.session.SessionState
[javac] FileUtils.deleteDirectory(resourceDir);
[javac] ^
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
[javac] 2 errors
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4343) HS2 with kerberos- local task for map join fails
[ https://issues.apache.org/jira/browse/HIVE-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728949#comment-13728949 ] Edward Capriolo commented on HIVE-4343: --- Can you please revert this or quickly build a shim. See https://issues.apache.org/jira/browse/HIVE-4991. HS2 with kerberos- local task for map join fails Key: HIVE-4343 URL: https://issues.apache.org/jira/browse/HIVE-4343 Project: Hive Issue Type: Bug Components: HiveServer2 Reporter: Thejas M Nair Assignee: Thejas M Nair Fix For: 0.12.0 Attachments: HIVE-4343.1.patch, HIVE-4343.2.patch, HIVE-4343.3.patch With hive server2 configured with kerberos security, when a (map) join query is run, it results in failure with GSSException: No valid credentials provided -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4991) hive build with 0.20 is broken
[
https://issues.apache.org/jira/browse/HIVE-4991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Edward Capriolo updated HIVE-4991:
--
Attachment: HIVE-4991.2.patch.txt
hive build with 0.20 is broken
--
Key: HIVE-4991
URL: https://issues.apache.org/jira/browse/HIVE-4991
Project: Hive
Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Thejas M Nair
Assignee: Edward Capriolo
Priority: Blocker
Labels: newbie
Attachments: HIVE-4991.2.patch.txt, HIVE-4991.patch.txt
As reported in HIVE-4911
ant clean package -Dhadoop.mr.rev=20
Fails with -
{code}
compile:
[echo] Project: ql
[javac] Compiling 898 source files to
/Users/malakar/code/oss/hive/build/ql/classes
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:35:
package org.apache.commons.io does not exist
[javac] import org.apache.commons.io.FileUtils;
[javac] ^
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:743:
cannot find symbol
[javac] symbol : variable FileUtils
[javac] location: class org.apache.hadoop.hive.ql.session.SessionState
[javac] FileUtils.deleteDirectory(resourceDir);
[javac] ^
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
[javac] 2 errors
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4991) hive build with 0.20 is broken
[
https://issues.apache.org/jira/browse/HIVE-4991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Edward Capriolo updated HIVE-4991:
--
Status: Patch Available (was: Open)
hive build with 0.20 is broken
--
Key: HIVE-4991
URL: https://issues.apache.org/jira/browse/HIVE-4991
Project: Hive
Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Thejas M Nair
Assignee: Edward Capriolo
Priority: Blocker
Labels: newbie
Attachments: HIVE-4991.2.patch.txt, HIVE-4991.patch.txt
As reported in HIVE-4911
ant clean package -Dhadoop.mr.rev=20
Fails with -
{code}
compile:
[echo] Project: ql
[javac] Compiling 898 source files to
/Users/malakar/code/oss/hive/build/ql/classes
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:35:
package org.apache.commons.io does not exist
[javac] import org.apache.commons.io.FileUtils;
[javac] ^
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:743:
cannot find symbol
[javac] symbol : variable FileUtils
[javac] location: class org.apache.hadoop.hive.ql.session.SessionState
[javac] FileUtils.deleteDirectory(resourceDir);
[javac] ^
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
[javac] 2 errors
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4991) hive build with 0.20 is broken
[
https://issues.apache.org/jira/browse/HIVE-4991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728971#comment-13728971
]
Gunther Hagleitner commented on HIVE-4991:
--
[~appodictic] Thanks, seems you already fixed the issue from HIVE-4343 as well.
Is there anything else left I should take a look at?
+1
hive build with 0.20 is broken
--
Key: HIVE-4991
URL: https://issues.apache.org/jira/browse/HIVE-4991
Project: Hive
Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Thejas M Nair
Assignee: Edward Capriolo
Priority: Blocker
Labels: newbie
Attachments: HIVE-4991.2.patch.txt, HIVE-4991.patch.txt
As reported in HIVE-4911
ant clean package -Dhadoop.mr.rev=20
Fails with -
{code}
compile:
[echo] Project: ql
[javac] Compiling 898 source files to
/Users/malakar/code/oss/hive/build/ql/classes
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:35:
package org.apache.commons.io does not exist
[javac] import org.apache.commons.io.FileUtils;
[javac] ^
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:743:
cannot find symbol
[javac] symbol : variable FileUtils
[javac] location: class org.apache.hadoop.hive.ql.session.SessionState
[javac] FileUtils.deleteDirectory(resourceDir);
[javac] ^
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
[javac] 2 errors
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4991) hive build with 0.20 is broken
[
https://issues.apache.org/jira/browse/HIVE-4991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728976#comment-13728976
]
Edward Capriolo commented on HIVE-4991:
---
No. I was a little unsure why only hadoop-0.20 needed the commons-io lib, but I
guess it is because things in other versions of hadoop include this. Not sure
exactly when it broke but it must have been that way for a while ?
hive build with 0.20 is broken
--
Key: HIVE-4991
URL: https://issues.apache.org/jira/browse/HIVE-4991
Project: Hive
Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Thejas M Nair
Assignee: Edward Capriolo
Priority: Blocker
Labels: newbie
Attachments: HIVE-4991.2.patch.txt, HIVE-4991.patch.txt
As reported in HIVE-4911
ant clean package -Dhadoop.mr.rev=20
Fails with -
{code}
compile:
[echo] Project: ql
[javac] Compiling 898 source files to
/Users/malakar/code/oss/hive/build/ql/classes
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:35:
package org.apache.commons.io does not exist
[javac] import org.apache.commons.io.FileUtils;
[javac] ^
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:743:
cannot find symbol
[javac] symbol : variable FileUtils
[javac] location: class org.apache.hadoop.hive.ql.session.SessionState
[javac] FileUtils.deleteDirectory(resourceDir);
[javac] ^
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
[javac] 2 errors
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4991) hive build with 0.20 is broken
[
https://issues.apache.org/jira/browse/HIVE-4991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728985#comment-13728985
]
Hive QA commented on HIVE-4991:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12595823/HIVE-4991.2.patch.txt
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 2759 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testNegativeCliDriver_script_broken_pipe1
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/302/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/302/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests failed with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
hive build with 0.20 is broken
--
Key: HIVE-4991
URL: https://issues.apache.org/jira/browse/HIVE-4991
Project: Hive
Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Thejas M Nair
Assignee: Edward Capriolo
Priority: Blocker
Labels: newbie
Attachments: HIVE-4991.2.patch.txt, HIVE-4991.patch.txt
As reported in HIVE-4911
ant clean package -Dhadoop.mr.rev=20
Fails with -
{code}
compile:
[echo] Project: ql
[javac] Compiling 898 source files to
/Users/malakar/code/oss/hive/build/ql/classes
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:35:
package org.apache.commons.io does not exist
[javac] import org.apache.commons.io.FileUtils;
[javac] ^
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:743:
cannot find symbol
[javac] symbol : variable FileUtils
[javac] location: class org.apache.hadoop.hive.ql.session.SessionState
[javac] FileUtils.deleteDirectory(resourceDir);
[javac] ^
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
[javac] 2 errors
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HIVE-4683) fix coverage org.apache.hadoop.hive.cli
[ https://issues.apache.org/jira/browse/HIVE-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan resolved HIVE-4683. Resolution: Fixed Fix Version/s: 0.12.0 Committed latest patch on RB to trunk. Thanks, Aleksey! fix coverage org.apache.hadoop.hive.cli --- Key: HIVE-4683 URL: https://issues.apache.org/jira/browse/HIVE-4683 Project: Hive Issue Type: Bug Affects Versions: 0.10.0, 0.11.0 Reporter: Aleksey Gorshkov Assignee: Aleksey Gorshkov Fix For: 0.12.0 Attachments: HIVE-4683-branch-0.10.patch, HIVE-4683-branch-0.10-v1.patch, HIVE-4683-branch-0.11-v1.patch, HIVE-4683-trunk.patch, HIVE-4683-trunk-v1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4991) hive build with 0.20 is broken
[
https://issues.apache.org/jira/browse/HIVE-4991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13728996#comment-13728996
]
Gunther Hagleitner commented on HIVE-4991:
--
I see. Looked through the dependencies. You're right both hadoop 1 2 line
pull in commons-io 2.1 which we use transitively. I think this was broken in:
HIVE-4505
hive build with 0.20 is broken
--
Key: HIVE-4991
URL: https://issues.apache.org/jira/browse/HIVE-4991
Project: Hive
Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Thejas M Nair
Assignee: Edward Capriolo
Priority: Blocker
Labels: newbie
Attachments: HIVE-4991.2.patch.txt, HIVE-4991.patch.txt
As reported in HIVE-4911
ant clean package -Dhadoop.mr.rev=20
Fails with -
{code}
compile:
[echo] Project: ql
[javac] Compiling 898 source files to
/Users/malakar/code/oss/hive/build/ql/classes
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:35:
package org.apache.commons.io does not exist
[javac] import org.apache.commons.io.FileUtils;
[javac] ^
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:743:
cannot find symbol
[javac] symbol : variable FileUtils
[javac] location: class org.apache.hadoop.hive.ql.session.SessionState
[javac] FileUtils.deleteDirectory(resourceDir);
[javac] ^
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
[javac] 2 errors
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4970) BinaryConverter does not respect nulls
[ https://issues.apache.org/jira/browse/HIVE-4970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13729009#comment-13729009 ] Hudson commented on HIVE-4970: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #45 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/45/]) HIVE-4970 BinaryConverter does not respect null (Mark Wagner via egc) Submitted by: Mark Wagner Reviewed by: Edward Capriolo (ecapriolo: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1510263) * /hive/trunk/ql/src/test/queries/clientpositive/ba_table_udfs.q * /hive/trunk/ql/src/test/results/clientpositive/ba_table_udfs.q.out * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/primitive/PrimitiveObjectInspectorConverter.java * /hive/trunk/serde/src/test/org/apache/hadoop/hive/serde2/objectinspector/TestObjectInspectorConverters.java BinaryConverter does not respect nulls -- Key: HIVE-4970 URL: https://issues.apache.org/jira/browse/HIVE-4970 Project: Hive Issue Type: Bug Affects Versions: 0.10.0, 0.11.0, 0.12.0 Reporter: Mark Wagner Assignee: Mark Wagner Fix For: 0.12.0 Attachments: HIVE-4970.1.patch, HIVE-4970.2.patch Right now, the BinaryConverter in PrimitiveObjectInspectorConverter does not handle null values the same as the other converters. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4879) Window functions that imply order can only be registered at compile time
[ https://issues.apache.org/jira/browse/HIVE-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13729008#comment-13729008 ] Hudson commented on HIVE-4879: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #45 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/45/]) Hive-4879 Window function that imply order can only be registered at compile time (Edward Capriolo) Reviewed by:Brock Noland (ecapriolo: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1510269) * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/WindowFunctionDescription.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/WindowFunctionInfo.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/UDFType.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFCumeDist.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFDenseRank.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFFirstValue.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFLag.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFLastValue.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFLead.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFPercentRank.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFRank.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFLeadLag.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/exec/TestFunctionRegistry.java Window functions that imply order can only be registered at compile time Key: HIVE-4879 URL: https://issues.apache.org/jira/browse/HIVE-4879 Project: Hive Issue Type: Improvement Affects Versions: 0.11.0 Reporter: Edward Capriolo Assignee: Edward Capriolo Fix For: 0.12.0 Attachments: HIVE-4879.1.patch.txt, HIVE-4879.2.patch.txt, HIVE-4879.3.patch.txt, HIVE-4879.4.patch.txt Adding an annotation for impliesOrder -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4879) Window functions that imply order can only be registered at compile time
[ https://issues.apache.org/jira/browse/HIVE-4879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13729018#comment-13729018 ] Hudson commented on HIVE-4879: -- SUCCESS: Integrated in Hive-trunk-hadoop1-ptest #117 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/117/]) Hive-4879 Window function that imply order can only be registered at compile time (Edward Capriolo) Reviewed by:Brock Noland (ecapriolo: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1510269) * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/FunctionRegistry.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/WindowFunctionDescription.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/WindowFunctionInfo.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/UDFType.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFCumeDist.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFDenseRank.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFFirstValue.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFLag.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFLastValue.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFLead.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFPercentRank.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDAFRank.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/udf/generic/GenericUDFLeadLag.java * /hive/trunk/ql/src/test/org/apache/hadoop/hive/ql/exec/TestFunctionRegistry.java Window functions that imply order can only be registered at compile time Key: HIVE-4879 URL: https://issues.apache.org/jira/browse/HIVE-4879 Project: Hive Issue Type: Improvement Affects Versions: 0.11.0 Reporter: Edward Capriolo Assignee: Edward Capriolo Fix For: 0.12.0 Attachments: HIVE-4879.1.patch.txt, HIVE-4879.2.patch.txt, HIVE-4879.3.patch.txt, HIVE-4879.4.patch.txt Adding an annotation for impliesOrder -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4683) fix coverage org.apache.hadoop.hive.cli
[ https://issues.apache.org/jira/browse/HIVE-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13729017#comment-13729017 ] Hudson commented on HIVE-4683: -- SUCCESS: Integrated in Hive-trunk-hadoop1-ptest #117 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/117/]) HIVE-4683 : fix coverage org.apache.hadoop.hive.cli (Aleksey Gorshkov via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1510346) * /hive/trunk/cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java * /hive/trunk/cli/src/java/org/apache/hadoop/hive/cli/RCFileCat.java * /hive/trunk/cli/src/test/org/apache/hadoop/hive/cli/TestCliDriverMethods.java * /hive/trunk/cli/src/test/org/apache/hadoop/hive/cli/TestCliSessionState.java * /hive/trunk/cli/src/test/org/apache/hadoop/hive/cli/TestOptionsProcessor.java * /hive/trunk/cli/src/test/org/apache/hadoop/hive/cli/TestRCFileCat.java fix coverage org.apache.hadoop.hive.cli --- Key: HIVE-4683 URL: https://issues.apache.org/jira/browse/HIVE-4683 Project: Hive Issue Type: Bug Affects Versions: 0.10.0, 0.11.0 Reporter: Aleksey Gorshkov Assignee: Aleksey Gorshkov Fix For: 0.12.0 Attachments: HIVE-4683-branch-0.10.patch, HIVE-4683-branch-0.10-v1.patch, HIVE-4683-branch-0.11-v1.patch, HIVE-4683-trunk.patch, HIVE-4683-trunk-v1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4970) BinaryConverter does not respect nulls
[ https://issues.apache.org/jira/browse/HIVE-4970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13729019#comment-13729019 ] Hudson commented on HIVE-4970: -- SUCCESS: Integrated in Hive-trunk-hadoop1-ptest #117 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/117/]) HIVE-4970 BinaryConverter does not respect null (Mark Wagner via egc) Submitted by: Mark Wagner Reviewed by: Edward Capriolo (ecapriolo: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1510263) * /hive/trunk/ql/src/test/queries/clientpositive/ba_table_udfs.q * /hive/trunk/ql/src/test/results/clientpositive/ba_table_udfs.q.out * /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/primitive/PrimitiveObjectInspectorConverter.java * /hive/trunk/serde/src/test/org/apache/hadoop/hive/serde2/objectinspector/TestObjectInspectorConverters.java BinaryConverter does not respect nulls -- Key: HIVE-4970 URL: https://issues.apache.org/jira/browse/HIVE-4970 Project: Hive Issue Type: Bug Affects Versions: 0.10.0, 0.11.0, 0.12.0 Reporter: Mark Wagner Assignee: Mark Wagner Fix For: 0.12.0 Attachments: HIVE-4970.1.patch, HIVE-4970.2.patch Right now, the BinaryConverter in PrimitiveObjectInspectorConverter does not handle null values the same as the other converters. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4683) fix coverage org.apache.hadoop.hive.cli
[ https://issues.apache.org/jira/browse/HIVE-4683?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13729062#comment-13729062 ] Hudson commented on HIVE-4683: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #46 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/46/]) HIVE-4683 : fix coverage org.apache.hadoop.hive.cli (Aleksey Gorshkov via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1510346) * /hive/trunk/cli/src/java/org/apache/hadoop/hive/cli/CliDriver.java * /hive/trunk/cli/src/java/org/apache/hadoop/hive/cli/RCFileCat.java * /hive/trunk/cli/src/test/org/apache/hadoop/hive/cli/TestCliDriverMethods.java * /hive/trunk/cli/src/test/org/apache/hadoop/hive/cli/TestCliSessionState.java * /hive/trunk/cli/src/test/org/apache/hadoop/hive/cli/TestOptionsProcessor.java * /hive/trunk/cli/src/test/org/apache/hadoop/hive/cli/TestRCFileCat.java fix coverage org.apache.hadoop.hive.cli --- Key: HIVE-4683 URL: https://issues.apache.org/jira/browse/HIVE-4683 Project: Hive Issue Type: Bug Affects Versions: 0.10.0, 0.11.0 Reporter: Aleksey Gorshkov Assignee: Aleksey Gorshkov Fix For: 0.12.0 Attachments: HIVE-4683-branch-0.10.patch, HIVE-4683-branch-0.10-v1.patch, HIVE-4683-branch-0.11-v1.patch, HIVE-4683-trunk.patch, HIVE-4683-trunk-v1.patch -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4991) hive build with 0.20 is broken
[
https://issues.apache.org/jira/browse/HIVE-4991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13729064#comment-13729064
]
Thejas M Nair commented on HIVE-4991:
-
Sorry about introducing another 0.20 build problem with HIVE-4343. I should
have verified the 0.20 build.
Regarding the patch -
commons-io version is already defined in ivy/libraries.properties, I think we
should re-use that ie in shims/ivy.xml -
{code}
dependency org=commons-io name=commons-io rev=${commons-io.version}
{code}
hive build with 0.20 is broken
--
Key: HIVE-4991
URL: https://issues.apache.org/jira/browse/HIVE-4991
Project: Hive
Issue Type: Bug
Affects Versions: 0.12.0
Reporter: Thejas M Nair
Assignee: Edward Capriolo
Priority: Blocker
Labels: newbie
Attachments: HIVE-4991.2.patch.txt, HIVE-4991.patch.txt
As reported in HIVE-4911
ant clean package -Dhadoop.mr.rev=20
Fails with -
{code}
compile:
[echo] Project: ql
[javac] Compiling 898 source files to
/Users/malakar/code/oss/hive/build/ql/classes
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:35:
package org.apache.commons.io does not exist
[javac] import org.apache.commons.io.FileUtils;
[javac] ^
[javac]
/Users/malakar/code/oss/hive/ql/src/java/org/apache/hadoop/hive/ql/session/SessionState.java:743:
cannot find symbol
[javac] symbol : variable FileUtils
[javac] location: class org.apache.hadoop.hive.ql.session.SessionState
[javac] FileUtils.deleteDirectory(resourceDir);
[javac] ^
[javac] Note: Some input files use or override a deprecated API.
[javac] Note: Recompile with -Xlint:deprecation for details.
[javac] Note: Some input files use unchecked or unsafe operations.
[javac] Note: Recompile with -Xlint:unchecked for details.
[javac] 2 errors
{code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4343) HS2 with kerberos- local task for map join fails
[ https://issues.apache.org/jira/browse/HIVE-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13729065#comment-13729065 ] Thejas M Nair commented on HIVE-4343: - [~appodictic] Thanks for creating a patch for the 0.20 build issue this introduced (HIVE-4991). Sorry about this, I should have verified the 0.20 build. HS2 with kerberos- local task for map join fails Key: HIVE-4343 URL: https://issues.apache.org/jira/browse/HIVE-4343 Project: Hive Issue Type: Bug Components: HiveServer2 Reporter: Thejas M Nair Assignee: Thejas M Nair Fix For: 0.12.0 Attachments: HIVE-4343.1.patch, HIVE-4343.2.patch, HIVE-4343.3.patch With hive server2 configured with kerberos security, when a (map) join query is run, it results in failure with GSSException: No valid credentials provided -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4343) HS2 with kerberos- local task for map join fails
[ https://issues.apache.org/jira/browse/HIVE-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13729079#comment-13729079 ] Hudson commented on HIVE-4343: -- ABORTED: Integrated in Hive-trunk-hadoop2 #327 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/327/]) HIVE-4343: HS2 with kerberos - local task for map join fails (Thejas M Nair via Gunther Hagleitner) (gunther: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVNview=revrev=1510097) * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/SecureCmdDoAs.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/ExecDriver.java * /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/exec/mr/MapredLocalTask.java * /hive/trunk/shims/src/0.20/java/org/apache/hadoop/hive/shims/Hadoop20Shims.java * /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/shims/HadoopShimsSecure.java * /hive/trunk/shims/src/common-secure/java/org/apache/hadoop/hive/thrift/HadoopThriftAuthBridge20S.java * /hive/trunk/shims/src/common/java/org/apache/hadoop/hive/shims/HadoopShims.java HS2 with kerberos- local task for map join fails Key: HIVE-4343 URL: https://issues.apache.org/jira/browse/HIVE-4343 Project: Hive Issue Type: Bug Components: HiveServer2 Reporter: Thejas M Nair Assignee: Thejas M Nair Fix For: 0.12.0 Attachments: HIVE-4343.1.patch, HIVE-4343.2.patch, HIVE-4343.3.patch With hive server2 configured with kerberos security, when a (map) join query is run, it results in failure with GSSException: No valid credentials provided -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Created] (HIVE-4996) unbalanced calls to openTransaction/commitTransaction
wangfeng created HIVE-4996: -- Summary: unbalanced calls to openTransaction/commitTransaction Key: HIVE-4996 URL: https://issues.apache.org/jira/browse/HIVE-4996 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.10.0 Environment: hiveserver1 Java HotSpot(TM) 64-Bit Server VM (build 20.6-b01, mixed mode) Reporter: wangfeng Priority: Critical when we used hiveserver1 based on hive-0.10.0, we found the Exception thrown.It was: FAILED: Error in metadata: MetaException(message:java.lang.RuntimeException: commitTransaction was called but openTransactionCalls = 0. This probably indicates that the re are unbalanced calls to openTransaction/commitTransaction) FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask help -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4996) unbalanced calls to openTransaction/commitTransaction
[ https://issues.apache.org/jira/browse/HIVE-4996?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13729097#comment-13729097 ] wangfeng commented on HIVE-4996: this bug occurred in the hive 0.7.0 ,see https://issues.apache.org/jira/browse/HIVE-1760 .but it was reproduced in hive-0.10.0 unbalanced calls to openTransaction/commitTransaction - Key: HIVE-4996 URL: https://issues.apache.org/jira/browse/HIVE-4996 Project: Hive Issue Type: Bug Components: Metastore Affects Versions: 0.10.0 Environment: hiveserver1 Java HotSpot(TM) 64-Bit Server VM (build 20.6-b01, mixed mode) Reporter: wangfeng Priority: Critical Labels: hive, metastore Original Estimate: 504h Remaining Estimate: 504h when we used hiveserver1 based on hive-0.10.0, we found the Exception thrown.It was: FAILED: Error in metadata: MetaException(message:java.lang.RuntimeException: commitTransaction was called but openTransactionCalls = 0. This probably indicates that the re are unbalanced calls to openTransaction/commitTransaction) FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask help -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4964) Cleanup PTF code: remove code dealing with non standard sql behavior we had original introduced
[ https://issues.apache.org/jira/browse/HIVE-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Phabricator updated HIVE-4964: -- Attachment: HIVE-4964.D11985.1.patch hbutani requested code review of HIVE-4964 [jira] Cleanup PTF code: remove code dealing with non standard sql behavior we had original introduced. Reviewers: JIRA, ashutoshc fix lint issues There are still pieces of code that deal with: supporting select expressions with Windowing supporting a filter with windowing Need to do this before introducing Perf. improvements. TEST PLAN EMPTY REVISION DETAIL https://reviews.facebook.net/D11985 AFFECTED FILES ql/src/java/org/apache/hadoop/hive/ql/exec/PTFOperator.java ql/src/java/org/apache/hadoop/hive/ql/optimizer/ColumnPrunerProcFactory.java ql/src/java/org/apache/hadoop/hive/ql/parse/PTFTranslator.java ql/src/java/org/apache/hadoop/hive/ql/parse/WindowingSpec.java ql/src/java/org/apache/hadoop/hive/ql/plan/PTFDesc.java ql/src/java/org/apache/hadoop/hive/ql/plan/PTFDeserializer.java ql/src/java/org/apache/hadoop/hive/ql/udf/ptf/WindowingTableFunction.java MANAGE HERALD RULES https://reviews.facebook.net/herald/view/differential/ WHY DID I GET THIS EMAIL? https://reviews.facebook.net/herald/transcript/28635/ To: JIRA, ashutoshc, hbutani Cleanup PTF code: remove code dealing with non standard sql behavior we had original introduced --- Key: HIVE-4964 URL: https://issues.apache.org/jira/browse/HIVE-4964 Project: Hive Issue Type: Bug Reporter: Harish Butani Priority: Minor Attachments: HIVE-4964.D11985.1.patch There are still pieces of code that deal with: - supporting select expressions with Windowing - supporting a filter with windowing Need to do this before introducing Perf. improvements. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4870) Explain Extended to show partition info for Fetch Task
[ https://issues.apache.org/jira/browse/HIVE-4870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laljo John Pullokkaran updated HIVE-4870: - Attachment: HIVE-4870.patch Explain Extended to show partition info for Fetch Task -- Key: HIVE-4870 URL: https://issues.apache.org/jira/browse/HIVE-4870 Project: Hive Issue Type: Bug Components: Query Processor, Tests Affects Versions: 0.11.0 Reporter: Laljo John Pullokkaran Assignee: Laljo John Pullokkaran Fix For: 0.11.1 Attachments: HIVE-4870.patch Explain extended does not include partition information for Fetch Task (FetchWork). Map Reduce Task (MapredWork)already does this. Patch includes Partition Description info to Fetch Task. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4870) Explain Extended to show partition info for Fetch Task
[ https://issues.apache.org/jira/browse/HIVE-4870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laljo John Pullokkaran updated HIVE-4870: - Status: Open (was: Patch Available) Explain Extended to show partition info for Fetch Task -- Key: HIVE-4870 URL: https://issues.apache.org/jira/browse/HIVE-4870 Project: Hive Issue Type: Bug Components: Query Processor, Tests Affects Versions: 0.11.0 Reporter: Laljo John Pullokkaran Assignee: Laljo John Pullokkaran Fix For: 0.11.1 Attachments: HIVE-4870.patch Explain extended does not include partition information for Fetch Task (FetchWork). Map Reduce Task (MapredWork)already does this. Patch includes Partition Description info to Fetch Task. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4870) Explain Extended to show partition info for Fetch Task
[ https://issues.apache.org/jira/browse/HIVE-4870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laljo John Pullokkaran updated HIVE-4870: - Attachment: (was: HIVE-4870.4.patch) Explain Extended to show partition info for Fetch Task -- Key: HIVE-4870 URL: https://issues.apache.org/jira/browse/HIVE-4870 Project: Hive Issue Type: Bug Components: Query Processor, Tests Affects Versions: 0.11.0 Reporter: Laljo John Pullokkaran Assignee: Laljo John Pullokkaran Fix For: 0.11.1 Attachments: HIVE-4870.patch Explain extended does not include partition information for Fetch Task (FetchWork). Map Reduce Task (MapredWork)already does this. Patch includes Partition Description info to Fetch Task. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4870) Explain Extended to show partition info for Fetch Task
[ https://issues.apache.org/jira/browse/HIVE-4870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Laljo John Pullokkaran updated HIVE-4870: - Status: Patch Available (was: Open) Explain Extended to show partition info for Fetch Task -- Key: HIVE-4870 URL: https://issues.apache.org/jira/browse/HIVE-4870 Project: Hive Issue Type: Bug Components: Query Processor, Tests Affects Versions: 0.11.0 Reporter: Laljo John Pullokkaran Assignee: Laljo John Pullokkaran Fix For: 0.11.1 Attachments: HIVE-4870.patch Explain extended does not include partition information for Fetch Task (FetchWork). Map Reduce Task (MapredWork)already does this. Patch includes Partition Description info to Fetch Task. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
