[jira] [Updated] (HIVE-4343) HS2 with kerberos- local task for map join fails
[ https://issues.apache.org/jira/browse/HIVE-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunther Hagleitner updated HIVE-4343: - Resolution: Fixed Fix Version/s: 0.12.0 Status: Resolved (was: Patch Available) > HS2 with kerberos- local task for map join fails > > > Key: HIVE-4343 > URL: https://issues.apache.org/jira/browse/HIVE-4343 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Reporter: Thejas M Nair >Assignee: Thejas M Nair > Fix For: 0.12.0 > > Attachments: HIVE-4343.1.patch, HIVE-4343.2.patch, HIVE-4343.3.patch > > > With hive server2 configured with kerberos security, when a (map) join query > is run, it results in failure with "GSSException: No valid credentials > provided " -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4343) HS2 with kerberos- local task for map join fails
[ https://issues.apache.org/jira/browse/HIVE-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13728758#comment-13728758 ] Gunther Hagleitner commented on HIVE-4343: -- Committed to trunk. Thanks Thejas! > HS2 with kerberos- local task for map join fails > > > Key: HIVE-4343 > URL: https://issues.apache.org/jira/browse/HIVE-4343 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Reporter: Thejas M Nair >Assignee: Thejas M Nair > Attachments: HIVE-4343.1.patch, HIVE-4343.2.patch, HIVE-4343.3.patch > > > With hive server2 configured with kerberos security, when a (map) join query > is run, it results in failure with "GSSException: No valid credentials > provided " -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4915) unit tests fail on windows because of difference in input file size
[ https://issues.apache.org/jira/browse/HIVE-4915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13728739#comment-13728739 ] Hudson commented on HIVE-4915: -- SUCCESS: Integrated in Hive-trunk-h0.21 #2243 (See [https://builds.apache.org/job/Hive-trunk-h0.21/2243/]) HIVE-4915 : unit tests fail on windows because of difference in input file size (Thejas Nair via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1510040) * /hive/trunk/.gitattributes > unit tests fail on windows because of difference in input file size > --- > > Key: HIVE-4915 > URL: https://issues.apache.org/jira/browse/HIVE-4915 > Project: Hive > Issue Type: Bug >Affects Versions: 0.12.0 >Reporter: Thejas M Nair >Assignee: Thejas M Nair > Fix For: 0.12.0 > > Attachments: HIVE-4915.1.patch > > > Several qfile based tests fail on windows because in the output of explain > extended, the total file size of input files shown is different on windows. > This is because by default text files on windows are checked out with two > char line endings, and *.dat files used as input files for the tables are > considered as text files. So for every line in the .dat file, the size of the > file is larger by 1 byte on windows. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4951) combine2_win.q.out needs update for HIVE-3253 (increasing nesting levels)
[ https://issues.apache.org/jira/browse/HIVE-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13728740#comment-13728740 ] Hudson commented on HIVE-4951: -- SUCCESS: Integrated in Hive-trunk-h0.21 #2243 (See [https://builds.apache.org/job/Hive-trunk-h0.21/2243/]) HIVE-4951 : combine2_win.q.out needs update for HIVE3253 (increasing nesting levels) (Thejas Nair via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1510039) * /hive/trunk/ql/src/test/results/clientpositive/combine2_win.q.out > combine2_win.q.out needs update for HIVE-3253 (increasing nesting levels) > - > > Key: HIVE-4951 > URL: https://issues.apache.org/jira/browse/HIVE-4951 > Project: Hive > Issue Type: Bug >Affects Versions: 0.11.0 >Reporter: Thejas M Nair >Assignee: Thejas M Nair > Fix For: 0.12.0 > > Attachments: HIVE-4951.1.patch > > > combine2.q was updated in HIVE-3253, the corresponding change is missing in > combine2_win.q, causing it to fail on windows. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4573) Support alternate table types for HiveServer2
[
https://issues.apache.org/jira/browse/HIVE-4573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasad Mujumdar updated HIVE-4573:
--
Component/s: HiveServer2
> Support alternate table types for HiveServer2
> -
>
> Key: HIVE-4573
> URL: https://issues.apache.org/jira/browse/HIVE-4573
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2, JDBC
>Affects Versions: 0.10.0
>Reporter: Johndee Burks
>Assignee: Prasad Mujumdar
>Priority: Minor
> Attachments: HIVE-4573.1.patch
>
>
> The getTables jdbc function no longer returns information when using normal
> JDBC table types like TABLE or VIEW. You must now use a more specific type
> such as MANAGED_TABLE or VIRTUAL_VIEW. An example application that will fail
> to return results against 0.10 is below, works without issue in 0.9. In my
> 0.10 test I used HS2.
> {code}
> import java.sql.SQLException;
> import java.sql.Connection;
> import java.sql.ResultSet;
> import java.sql.Statement;
> import java.sql.DriverManager;
> import org.apache.hive.jdbc.HiveDriver;
> import java.sql.DatabaseMetaData;
> public class TestGet {
> private static String driverName = "org.apache.hive.jdbc.HiveDriver";
> /**
> * @param args
> * @throws SQLException
>*/
> public static void main(String[] args) throws SQLException {
> try {
> Class.forName(driverName);
> } catch (ClassNotFoundException e) {
> // TODO Auto-generated catch block
> e.printStackTrace();
> System.exit(1);
> }
> Connection con =
> DriverManager.getConnection("jdbc:hive2://hostname:1/default");
> DatabaseMetaData dbmd = con.getMetaData();
> String[] types = {"TABLE"};
> ResultSet rs = dbmd.getTables(null, null, "%", types);
> while (rs.next()) {
> System.out.println(rs.getString("TABLE_NAME"));
> }
> }
> }
> }
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4573) Support alternate table types for HiveServer2
[
https://issues.apache.org/jira/browse/HIVE-4573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasad Mujumdar updated HIVE-4573:
--
Status: Patch Available (was: Open)
Review request on https://reviews.apache.org/r/13262/
> Support alternate table types for HiveServer2
> -
>
> Key: HIVE-4573
> URL: https://issues.apache.org/jira/browse/HIVE-4573
> Project: Hive
> Issue Type: Bug
> Components: JDBC
>Affects Versions: 0.10.0
>Reporter: Johndee Burks
>Assignee: Prasad Mujumdar
>Priority: Minor
> Attachments: HIVE-4573.1.patch
>
>
> The getTables jdbc function no longer returns information when using normal
> JDBC table types like TABLE or VIEW. You must now use a more specific type
> such as MANAGED_TABLE or VIRTUAL_VIEW. An example application that will fail
> to return results against 0.10 is below, works without issue in 0.9. In my
> 0.10 test I used HS2.
> {code}
> import java.sql.SQLException;
> import java.sql.Connection;
> import java.sql.ResultSet;
> import java.sql.Statement;
> import java.sql.DriverManager;
> import org.apache.hive.jdbc.HiveDriver;
> import java.sql.DatabaseMetaData;
> public class TestGet {
> private static String driverName = "org.apache.hive.jdbc.HiveDriver";
> /**
> * @param args
> * @throws SQLException
>*/
> public static void main(String[] args) throws SQLException {
> try {
> Class.forName(driverName);
> } catch (ClassNotFoundException e) {
> // TODO Auto-generated catch block
> e.printStackTrace();
> System.exit(1);
> }
> Connection con =
> DriverManager.getConnection("jdbc:hive2://hostname:1/default");
> DatabaseMetaData dbmd = con.getMetaData();
> String[] types = {"TABLE"};
> ResultSet rs = dbmd.getTables(null, null, "%", types);
> while (rs.next()) {
> System.out.println(rs.getString("TABLE_NAME"));
> }
> }
> }
> }
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4573) Support alternate table types for HiveServer2
[
https://issues.apache.org/jira/browse/HIVE-4573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasad Mujumdar updated HIVE-4573:
--
Attachment: HIVE-4573.1.patch
> Support alternate table types for HiveServer2
> -
>
> Key: HIVE-4573
> URL: https://issues.apache.org/jira/browse/HIVE-4573
> Project: Hive
> Issue Type: Bug
> Components: JDBC
>Affects Versions: 0.10.0
>Reporter: Johndee Burks
>Assignee: Prasad Mujumdar
>Priority: Minor
> Attachments: HIVE-4573.1.patch
>
>
> The getTables jdbc function no longer returns information when using normal
> JDBC table types like TABLE or VIEW. You must now use a more specific type
> such as MANAGED_TABLE or VIRTUAL_VIEW. An example application that will fail
> to return results against 0.10 is below, works without issue in 0.9. In my
> 0.10 test I used HS2.
> {code}
> import java.sql.SQLException;
> import java.sql.Connection;
> import java.sql.ResultSet;
> import java.sql.Statement;
> import java.sql.DriverManager;
> import org.apache.hive.jdbc.HiveDriver;
> import java.sql.DatabaseMetaData;
> public class TestGet {
> private static String driverName = "org.apache.hive.jdbc.HiveDriver";
> /**
> * @param args
> * @throws SQLException
>*/
> public static void main(String[] args) throws SQLException {
> try {
> Class.forName(driverName);
> } catch (ClassNotFoundException e) {
> // TODO Auto-generated catch block
> e.printStackTrace();
> System.exit(1);
> }
> Connection con =
> DriverManager.getConnection("jdbc:hive2://hostname:1/default");
> DatabaseMetaData dbmd = con.getMetaData();
> String[] types = {"TABLE"};
> ResultSet rs = dbmd.getTables(null, null, "%", types);
> while (rs.next()) {
> System.out.println(rs.getString("TABLE_NAME"));
> }
> }
> }
> }
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4573) Support alternate table types for HiveServer2
[
https://issues.apache.org/jira/browse/HIVE-4573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasad Mujumdar updated HIVE-4573:
--
Summary: Support alternate table types for HiveServer2 (was: JDBC
Compliance getTables)
> Support alternate table types for HiveServer2
> -
>
> Key: HIVE-4573
> URL: https://issues.apache.org/jira/browse/HIVE-4573
> Project: Hive
> Issue Type: Bug
> Components: JDBC
>Affects Versions: 0.10.0
>Reporter: Johndee Burks
>Assignee: Prasad Mujumdar
>Priority: Minor
> Attachments: HIVE-4573.1.patch
>
>
> The getTables jdbc function no longer returns information when using normal
> JDBC table types like TABLE or VIEW. You must now use a more specific type
> such as MANAGED_TABLE or VIRTUAL_VIEW. An example application that will fail
> to return results against 0.10 is below, works without issue in 0.9. In my
> 0.10 test I used HS2.
> {code}
> import java.sql.SQLException;
> import java.sql.Connection;
> import java.sql.ResultSet;
> import java.sql.Statement;
> import java.sql.DriverManager;
> import org.apache.hive.jdbc.HiveDriver;
> import java.sql.DatabaseMetaData;
> public class TestGet {
> private static String driverName = "org.apache.hive.jdbc.HiveDriver";
> /**
> * @param args
> * @throws SQLException
>*/
> public static void main(String[] args) throws SQLException {
> try {
> Class.forName(driverName);
> } catch (ClassNotFoundException e) {
> // TODO Auto-generated catch block
> e.printStackTrace();
> System.exit(1);
> }
> Connection con =
> DriverManager.getConnection("jdbc:hive2://hostname:1/default");
> DatabaseMetaData dbmd = con.getMetaData();
> String[] types = {"TABLE"};
> ResultSet rs = dbmd.getTables(null, null, "%", types);
> while (rs.next()) {
> System.out.println(rs.getString("TABLE_NAME"));
> }
> }
> }
> }
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (HIVE-4573) JDBC Compliance getTables
[
https://issues.apache.org/jira/browse/HIVE-4573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Prasad Mujumdar reassigned HIVE-4573:
-
Assignee: Prasad Mujumdar
> JDBC Compliance getTables
> -
>
> Key: HIVE-4573
> URL: https://issues.apache.org/jira/browse/HIVE-4573
> Project: Hive
> Issue Type: Bug
> Components: JDBC
>Affects Versions: 0.10.0
>Reporter: Johndee Burks
>Assignee: Prasad Mujumdar
>Priority: Minor
>
> The getTables jdbc function no longer returns information when using normal
> JDBC table types like TABLE or VIEW. You must now use a more specific type
> such as MANAGED_TABLE or VIRTUAL_VIEW. An example application that will fail
> to return results against 0.10 is below, works without issue in 0.9. In my
> 0.10 test I used HS2.
> {code}
> import java.sql.SQLException;
> import java.sql.Connection;
> import java.sql.ResultSet;
> import java.sql.Statement;
> import java.sql.DriverManager;
> import org.apache.hive.jdbc.HiveDriver;
> import java.sql.DatabaseMetaData;
> public class TestGet {
> private static String driverName = "org.apache.hive.jdbc.HiveDriver";
> /**
> * @param args
> * @throws SQLException
>*/
> public static void main(String[] args) throws SQLException {
> try {
> Class.forName(driverName);
> } catch (ClassNotFoundException e) {
> // TODO Auto-generated catch block
> e.printStackTrace();
> System.exit(1);
> }
> Connection con =
> DriverManager.getConnection("jdbc:hive2://hostname:1/default");
> DatabaseMetaData dbmd = con.getMetaData();
> String[] types = {"TABLE"};
> ResultSet rs = dbmd.getTables(null, null, "%", types);
> while (rs.next()) {
> System.out.println(rs.getString("TABLE_NAME"));
> }
> }
> }
> }
> {code}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
Review Request 13262: HIVE-4573: JDBC Compliance getTables
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/13262/ --- Review request for hive. Bugs: HIVE-4573 https://issues.apache.org/jira/browse/HIVE-4573 Repository: hive-git Description --- Support alternate table type name for GetTables() and GetTableTypes(). Currently HiveServer2 supports Hive's native table type names eg. MANAGED_TABLE, VIRTUAL_VIEW etc. The more common terms used by various DB vendors and tools are TABLE and VIEW. This makes it difficult to integrate Hive with various tools or custom applications. The patch introduces an alternate table type name mapping that can be configured at instance level or session level. Diffs - common/src/java/org/apache/hadoop/hive/conf/HiveConf.java 555343e jdbc/src/test/org/apache/hive/jdbc/TestJdbcDriver2.java 1042125 service/src/java/org/apache/hive/service/cli/operation/ClassicTableTypeMapping.java PRE-CREATION service/src/java/org/apache/hive/service/cli/operation/GetTableTypesOperation.java eaf867e service/src/java/org/apache/hive/service/cli/operation/GetTablesOperation.java d9d0e9c service/src/java/org/apache/hive/service/cli/operation/HiveTableTypeMapping.java PRE-CREATION service/src/java/org/apache/hive/service/cli/operation/TableTypeMapping.java PRE-CREATION service/src/java/org/apache/hive/service/cli/operation/TableTypeMappingFactory.java PRE-CREATION Diff: https://reviews.apache.org/r/13262/diff/ Testing --- Added test cases in TestJdbcDriver2. Thanks, Prasad Mujumdar
[jira] [Commented] (HIVE-4951) combine2_win.q.out needs update for HIVE-3253 (increasing nesting levels)
[ https://issues.apache.org/jira/browse/HIVE-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13728686#comment-13728686 ] Hudson commented on HIVE-4951: -- SUCCESS: Integrated in Hive-trunk-hadoop1-ptest #115 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/115/]) HIVE-4951 : combine2_win.q.out needs update for HIVE3253 (increasing nesting levels) (Thejas Nair via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1510039) * /hive/trunk/ql/src/test/results/clientpositive/combine2_win.q.out > combine2_win.q.out needs update for HIVE-3253 (increasing nesting levels) > - > > Key: HIVE-4951 > URL: https://issues.apache.org/jira/browse/HIVE-4951 > Project: Hive > Issue Type: Bug >Affects Versions: 0.11.0 >Reporter: Thejas M Nair >Assignee: Thejas M Nair > Fix For: 0.12.0 > > Attachments: HIVE-4951.1.patch > > > combine2.q was updated in HIVE-3253, the corresponding change is missing in > combine2_win.q, causing it to fail on windows. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4915) unit tests fail on windows because of difference in input file size
[ https://issues.apache.org/jira/browse/HIVE-4915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13728685#comment-13728685 ] Hudson commented on HIVE-4915: -- SUCCESS: Integrated in Hive-trunk-hadoop1-ptest #115 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/115/]) HIVE-4915 : unit tests fail on windows because of difference in input file size (Thejas Nair via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1510040) * /hive/trunk/.gitattributes > unit tests fail on windows because of difference in input file size > --- > > Key: HIVE-4915 > URL: https://issues.apache.org/jira/browse/HIVE-4915 > Project: Hive > Issue Type: Bug >Affects Versions: 0.12.0 >Reporter: Thejas M Nair >Assignee: Thejas M Nair > Fix For: 0.12.0 > > Attachments: HIVE-4915.1.patch > > > Several qfile based tests fail on windows because in the output of explain > extended, the total file size of input files shown is different on windows. > This is because by default text files on windows are checked out with two > char line endings, and *.dat files used as input files for the tables are > considered as text files. So for every line in the .dat file, the size of the > file is larger by 1 byte on windows. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4951) combine2_win.q.out needs update for HIVE-3253 (increasing nesting levels)
[ https://issues.apache.org/jira/browse/HIVE-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13728674#comment-13728674 ] Hudson commented on HIVE-4951: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #43 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/43/]) HIVE-4951 : combine2_win.q.out needs update for HIVE3253 (increasing nesting levels) (Thejas Nair via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1510039) * /hive/trunk/ql/src/test/results/clientpositive/combine2_win.q.out > combine2_win.q.out needs update for HIVE-3253 (increasing nesting levels) > - > > Key: HIVE-4951 > URL: https://issues.apache.org/jira/browse/HIVE-4951 > Project: Hive > Issue Type: Bug >Affects Versions: 0.11.0 >Reporter: Thejas M Nair >Assignee: Thejas M Nair > Fix For: 0.12.0 > > Attachments: HIVE-4951.1.patch > > > combine2.q was updated in HIVE-3253, the corresponding change is missing in > combine2_win.q, causing it to fail on windows. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4915) unit tests fail on windows because of difference in input file size
[ https://issues.apache.org/jira/browse/HIVE-4915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13728673#comment-13728673 ] Hudson commented on HIVE-4915: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #43 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/43/]) HIVE-4915 : unit tests fail on windows because of difference in input file size (Thejas Nair via Ashutosh Chauhan) (hashutosh: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1510040) * /hive/trunk/.gitattributes > unit tests fail on windows because of difference in input file size > --- > > Key: HIVE-4915 > URL: https://issues.apache.org/jira/browse/HIVE-4915 > Project: Hive > Issue Type: Bug >Affects Versions: 0.12.0 >Reporter: Thejas M Nair >Assignee: Thejas M Nair > Fix For: 0.12.0 > > Attachments: HIVE-4915.1.patch > > > Several qfile based tests fail on windows because in the output of explain > extended, the total file size of input files shown is different on windows. > This is because by default text files on windows are checked out with two > char line endings, and *.dat files used as input files for the tables are > considered as text files. So for every line in the .dat file, the size of the > file is larger by 1 byte on windows. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4233) The TGT gotten from class 'CLIService' should be renewed on time
[ https://issues.apache.org/jira/browse/HIVE-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13728618#comment-13728618 ] Thejas M Nair commented on HIVE-4233: - TestMinimrCliDriver.testCliDriver_parallel_orderby failure is probably because of some flakiness with the test case. It passed when ran it again on my machine. > The TGT gotten from class 'CLIService' should be renewed on time > - > > Key: HIVE-4233 > URL: https://issues.apache.org/jira/browse/HIVE-4233 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Affects Versions: 0.11.0 > Environment: CentOS release 6.3 (Final) > jdk1.6.0_31 > HiveServer2 0.10.0-cdh4.2.0 > Kerberos Security >Reporter: Dongyong Wang >Assignee: Thejas M Nair >Priority: Critical > Attachments: 0001-FIX-HIVE-4233.patch, HIVE-4233-2.patch, > HIVE-4233-3.patch, HIVE-4233.4.patch > > > When the HIveServer2 have started more than 7 days, I use beeline shell to > connect the HiveServer2,all operation failed. > The log of HiveServer2 shows it was caused by the Kerberos auth failure,the > exception stack trace is: > 2013-03-26 11:55:20,932 ERROR hive.ql.metadata.Hive: > java.lang.RuntimeException: Unable to instantiate > org.apache.hadoop.hive.metastore.HiveMetaStoreClient > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1084) > at > org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.(RetryingMetaStoreClient.java:51) > at > org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:61) > at > org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2140) > at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2151) > at > org.apache.hadoop.hive.ql.metadata.Hive.getDelegationToken(Hive.java:2275) > at > org.apache.hive.service.cli.CLIService.getDelegationTokenFromMetaStore(CLIService.java:358) > at > org.apache.hive.service.cli.thrift.ThriftCLIService.OpenSession(ThriftCLIService.java:127) > at > org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1073) > at > org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1058) > at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39) > at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39) > at > org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge20S.java:565) > at > org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:206) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedConstructorAccessor52.newInstance(Unknown > Source) > at > sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27) > at java.lang.reflect.Constructor.newInstance(Constructor.java:513) > at > org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1082) > ... 16 more > Caused by: java.lang.IllegalStateException: This ticket is no longer valid > at > javax.security.auth.kerberos.KerberosTicket.toString(KerberosTicket.java:601) > at java.lang.String.valueOf(String.java:2826) > at java.lang.StringBuilder.append(StringBuilder.java:115) > at > sun.security.jgss.krb5.SubjectComber.findAux(SubjectComber.java:120) > at sun.security.jgss.krb5.SubjectComber.find(SubjectComber.java:41) > at sun.security.jgss.krb5.Krb5Util.getTicket(Krb5Util.java:130) > at > sun.security.jgss.krb5.Krb5InitCredential$1.run(Krb5InitCredential.java:328) > at java.security.AccessController.doPrivileged(Native Method) > at > sun.security.jgss.krb5.Krb5InitCredential.getTgt(Krb5InitCredential.java:325) > at > sun.security.jgss.krb5.Krb5InitCredential.getInstance(Krb5InitCredential.java:128) > at > sun.security.jgss.krb5.Krb5MechFactory.getCredentialElement(Krb5MechFactory.java:106) > at > sun.security.jgss.krb5.Krb5MechFactory.getMechanismContext(Krb5MechFactory.java:172) > at > sun.security.jgss.GSSManagerImpl.getMechanismContext(GSSManagerImpl.java:209) > at > sun.security.jgss.GSSContextImpl.initSecContext(GSSContextImpl.java:195) > at > sun.security.jgss.GSSContext
[jira] [Updated] (HIVE-4915) unit tests fail on windows because of difference in input file size
[ https://issues.apache.org/jira/browse/HIVE-4915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-4915: --- Resolution: Fixed Fix Version/s: 0.12.0 Status: Resolved (was: Patch Available) Committed to trunk. Thanks, Thejas! > unit tests fail on windows because of difference in input file size > --- > > Key: HIVE-4915 > URL: https://issues.apache.org/jira/browse/HIVE-4915 > Project: Hive > Issue Type: Bug >Affects Versions: 0.12.0 >Reporter: Thejas M Nair >Assignee: Thejas M Nair > Fix For: 0.12.0 > > Attachments: HIVE-4915.1.patch > > > Several qfile based tests fail on windows because in the output of explain > extended, the total file size of input files shown is different on windows. > This is because by default text files on windows are checked out with two > char line endings, and *.dat files used as input files for the tables are > considered as text files. So for every line in the .dat file, the size of the > file is larger by 1 byte on windows. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HIVE-4951) combine2_win.q.out needs update for HIVE-3253 (increasing nesting levels)
[ https://issues.apache.org/jira/browse/HIVE-4951?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ashutosh Chauhan updated HIVE-4951: --- Resolution: Fixed Fix Version/s: 0.12.0 Status: Resolved (was: Patch Available) Committed to trunk. Thanks, Thejas! > combine2_win.q.out needs update for HIVE-3253 (increasing nesting levels) > - > > Key: HIVE-4951 > URL: https://issues.apache.org/jira/browse/HIVE-4951 > Project: Hive > Issue Type: Bug >Affects Versions: 0.11.0 >Reporter: Thejas M Nair >Assignee: Thejas M Nair > Fix For: 0.12.0 > > Attachments: HIVE-4951.1.patch > > > combine2.q was updated in HIVE-3253, the corresponding change is missing in > combine2_win.q, causing it to fail on windows. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4980) Fix the compiling error in TestHadoop20SAuthBridge
[ https://issues.apache.org/jira/browse/HIVE-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13728562#comment-13728562 ] Hudson commented on HIVE-4980: -- FAILURE: Integrated in Hive-trunk-hadoop2 #324 (See [https://builds.apache.org/job/Hive-trunk-hadoop2/324/]) HIVE-4980: Fix the compiling error in TestHadoop20SAuthBridge (Yin Huai via Gunther Hagleitner) (gunther: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1509934) * /hive/trunk/shims/src/common-secure/test/org/apache/hadoop/hive/thrift/TestHadoop20SAuthBridge.java > Fix the compiling error in TestHadoop20SAuthBridge > -- > > Key: HIVE-4980 > URL: https://issues.apache.org/jira/browse/HIVE-4980 > Project: Hive > Issue Type: Sub-task >Reporter: Yin Huai >Assignee: Yin Huai > Fix For: 0.12.0 > > Attachments: HIVE-4980.D11937.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4980) Fix the compiling error in TestHadoop20SAuthBridge
[ https://issues.apache.org/jira/browse/HIVE-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13728526#comment-13728526 ] Hudson commented on HIVE-4980: -- SUCCESS: Integrated in Hive-trunk-h0.21 #2241 (See [https://builds.apache.org/job/Hive-trunk-h0.21/2241/]) HIVE-4980: Fix the compiling error in TestHadoop20SAuthBridge (Yin Huai via Gunther Hagleitner) (gunther: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1509934) * /hive/trunk/shims/src/common-secure/test/org/apache/hadoop/hive/thrift/TestHadoop20SAuthBridge.java > Fix the compiling error in TestHadoop20SAuthBridge > -- > > Key: HIVE-4980 > URL: https://issues.apache.org/jira/browse/HIVE-4980 > Project: Hive > Issue Type: Sub-task >Reporter: Yin Huai >Assignee: Yin Huai > Fix For: 0.12.0 > > Attachments: HIVE-4980.D11937.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4980) Fix the compiling error in TestHadoop20SAuthBridge
[ https://issues.apache.org/jira/browse/HIVE-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13728498#comment-13728498 ] Hudson commented on HIVE-4980: -- SUCCESS: Integrated in Hive-trunk-hadoop1-ptest #114 (See [https://builds.apache.org/job/Hive-trunk-hadoop1-ptest/114/]) HIVE-4980: Fix the compiling error in TestHadoop20SAuthBridge (Yin Huai via Gunther Hagleitner) (gunther: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1509934) * /hive/trunk/shims/src/common-secure/test/org/apache/hadoop/hive/thrift/TestHadoop20SAuthBridge.java > Fix the compiling error in TestHadoop20SAuthBridge > -- > > Key: HIVE-4980 > URL: https://issues.apache.org/jira/browse/HIVE-4980 > Project: Hive > Issue Type: Sub-task >Reporter: Yin Huai >Assignee: Yin Huai > Fix For: 0.12.0 > > Attachments: HIVE-4980.D11937.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4980) Fix the compiling error in TestHadoop20SAuthBridge
[ https://issues.apache.org/jira/browse/HIVE-4980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13728492#comment-13728492 ] Hudson commented on HIVE-4980: -- FAILURE: Integrated in Hive-trunk-hadoop2-ptest #42 (See [https://builds.apache.org/job/Hive-trunk-hadoop2-ptest/42/]) HIVE-4980: Fix the compiling error in TestHadoop20SAuthBridge (Yin Huai via Gunther Hagleitner) (gunther: http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1509934) * /hive/trunk/shims/src/common-secure/test/org/apache/hadoop/hive/thrift/TestHadoop20SAuthBridge.java > Fix the compiling error in TestHadoop20SAuthBridge > -- > > Key: HIVE-4980 > URL: https://issues.apache.org/jira/browse/HIVE-4980 > Project: Hive > Issue Type: Sub-task >Reporter: Yin Huai >Assignee: Yin Huai > Fix For: 0.12.0 > > Attachments: HIVE-4980.D11937.1.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4979) If any compiling error exists, test-shims should stop
[ https://issues.apache.org/jira/browse/HIVE-4979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13728490#comment-13728490 ] Gunther Hagleitner commented on HIVE-4979: -- Tested the latest patch. It still stops processing when a test (not compilation) fails. > If any compiling error exists, test-shims should stop > - > > Key: HIVE-4979 > URL: https://issues.apache.org/jira/browse/HIVE-4979 > Project: Hive > Issue Type: Sub-task >Reporter: Yin Huai >Assignee: Yin Huai > Attachments: HIVE-4979.4980.failedTest.txt, HIVE-4979.D11931.1.patch, > HIVE-4979.D11931.2.patch, HIVE-4979.D11931.3.patch > > -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4343) HS2 with kerberos- local task for map join fails
[ https://issues.apache.org/jira/browse/HIVE-4343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13728488#comment-13728488 ] Gunther Hagleitner commented on HIVE-4343: -- TestHCatPartitioned is a flaky test. Failure is unrelated. I re-ran locally and all is well. > HS2 with kerberos- local task for map join fails > > > Key: HIVE-4343 > URL: https://issues.apache.org/jira/browse/HIVE-4343 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Reporter: Thejas M Nair >Assignee: Thejas M Nair > Attachments: HIVE-4343.1.patch, HIVE-4343.2.patch, HIVE-4343.3.patch > > > With hive server2 configured with kerberos security, when a (map) join query > is run, it results in failure with "GSSException: No valid credentials > provided " -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HIVE-4233) The TGT gotten from class 'CLIService' should be renewed on time
[
https://issues.apache.org/jira/browse/HIVE-4233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13728482#comment-13728482
]
Hive QA commented on HIVE-4233:
---
{color:red}Overall{color}: -1 at least one tests failed
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12595727/HIVE-4233.4.patch
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 2758 tests executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMinimrCliDriver.testCliDriver_parallel_orderby
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/298/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/298/console
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests failed with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
> The TGT gotten from class 'CLIService' should be renewed on time
> -
>
> Key: HIVE-4233
> URL: https://issues.apache.org/jira/browse/HIVE-4233
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
>Affects Versions: 0.11.0
> Environment: CentOS release 6.3 (Final)
> jdk1.6.0_31
> HiveServer2 0.10.0-cdh4.2.0
> Kerberos Security
>Reporter: Dongyong Wang
>Assignee: Thejas M Nair
>Priority: Critical
> Attachments: 0001-FIX-HIVE-4233.patch, HIVE-4233-2.patch,
> HIVE-4233-3.patch, HIVE-4233.4.patch
>
>
> When the HIveServer2 have started more than 7 days, I use beeline shell to
> connect the HiveServer2,all operation failed.
> The log of HiveServer2 shows it was caused by the Kerberos auth failure,the
> exception stack trace is:
> 2013-03-26 11:55:20,932 ERROR hive.ql.metadata.Hive:
> java.lang.RuntimeException: Unable to instantiate
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient
> at
> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1084)
> at
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.(RetryingMetaStoreClient.java:51)
> at
> org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.getProxy(RetryingMetaStoreClient.java:61)
> at
> org.apache.hadoop.hive.ql.metadata.Hive.createMetaStoreClient(Hive.java:2140)
> at org.apache.hadoop.hive.ql.metadata.Hive.getMSC(Hive.java:2151)
> at
> org.apache.hadoop.hive.ql.metadata.Hive.getDelegationToken(Hive.java:2275)
> at
> org.apache.hive.service.cli.CLIService.getDelegationTokenFromMetaStore(CLIService.java:358)
> at
> org.apache.hive.service.cli.thrift.ThriftCLIService.OpenSession(ThriftCLIService.java:127)
> at
> org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1073)
> at
> org.apache.hive.service.cli.thrift.TCLIService$Processor$OpenSession.getResult(TCLIService.java:1058)
> at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
> at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
> at
> org.apache.hadoop.hive.thrift.HadoopThriftAuthBridge20S$Server$TUGIAssumingProcessor.process(HadoopThriftAuthBridge20S.java:565)
> at
> org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:206)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.lang.reflect.InvocationTargetException
> at sun.reflect.GeneratedConstructorAccessor52.newInstance(Unknown
> Source)
> at
> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:27)
> at java.lang.reflect.Constructor.newInstance(Constructor.java:513)
> at
> org.apache.hadoop.hive.metastore.MetaStoreUtils.newInstance(MetaStoreUtils.java:1082)
> ... 16 more
> Caused by: java.lang.IllegalStateException: This ticket is no longer valid
> at
> javax.security.auth.kerberos.KerberosTicket.toString(KerberosTicket.java:601)
> at java.lang.String.valueOf(String.java:2826)
> at java.lang.StringBuilder.append(StringBuilder.java:115)
> at
> sun.security.jgss.krb5.SubjectComber.findAux(SubjectComber.java:120)
> at sun.security.jgss.krb5.SubjectComber.find(SubjectComber.java:41)
> at sun.security.jgss.krb5.Krb5Util.getTicket(Krb5Util.java:130)
> at
> sun.security.jgss.krb5.Krb5InitCredential$1.run(Krb5InitCredential.java:328)
> at java.securi
