[
https://issues.apache.org/jira/browse/SPARK-21433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Owen resolved SPARK-21433.
-------------------------------
Resolution: Invalid
> Spark SQL should support higher version of Hive metastore
> ---------------------------------------------------------
>
> Key: SPARK-21433
> URL: https://issues.apache.org/jira/browse/SPARK-21433
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 2.2.0
> Environment: software platform: Spark 2.2.0, Hive metastore 1.2.1,
> Hadoop 2.6.5
> operating system: CentOS 6.9
> Reporter: Gu Chao
>
> Now. Spark SQL supports Hive metastore versions ranging from 0.12.0 to 1.2.1
> (inclusive).
> When I start the Thrift JDBC/ODBC server and test with JDBC codes, I will
> discover that some running Spark Jobs is very slowly. I want to stop running
> code to stop this running Spark Job. But the running code stopped and the
> running Spark Job does not stop. The system resource can not be released.
> Is running spark jobs stopped when a query is cancelled? I think yes.
> I checked same Hive issues and Hive will resolve this issue.
> This is My test code:
> {code:java}
> object App_2017071100 {
> private[this] val DRIER = "org.apache.hive.jdbc.HiveDriver"
> private[this] val URL = "jdbc:hive2://192.168.50.3:10000/default"
> private[this] val USERNAME = "hive"
> private[this] val PASSWORD = "hive"
> def main(args: Array[String]): Unit = {
> var connect: Connection = null
> var statement: PreparedStatement = null
> var result: ResultSet = null
> try {
> Class.forName(DRIER)
> connect = DriverManager.getConnection(URL, USERNAME, PASSWORD)
> statement = connect.prepareStatement("select count(1) from ip")
> // statement.setQueryTimeout(30)
> result = statement.executeQuery
> while (result.next) {
> println(result.getString(1))
> }
> } catch {
> case e: LinkageError => e.printStackTrace
> case e: ExceptionInInitializerError => e.printStackTrace
> case e: ClassNotFoundException => e.printStackTrace
> case e: SQLException => e.printStackTrace
> case e: SQLTimeoutException => e.printStackTrace
> } finally {
> if (result != null) result.close
> if (statement != null) statement.close
> if (connect != null) connect.close
> }
> }
> }
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
