tooptoop4 commented on issue #22794: [SPARK-24570][SQL] Implement Spark own GetTablesOperation to fix SQL client tools cannot show tables URL: https://github.com/apache/spark/pull/22794#issuecomment-467383158 When i put in spark-hive-thriftserver_2.11-3.0.0.jar cherrypicked without this PR then i don't get an error, with this PR i get below error upon doing a simple select * from sch.tbl limit 5 query, also the schemas dont show. I am on squirrel 3.9.0 (Windows 10) and my SparkThrift has TLS enabled with jks, and LDAP authentication. com.simba.spark.jdbc41.Driver from SimbaSparkJDBC41-1.1.7.1009 version is being used. java.sql.SQLException: [Simba][SparkJDBCDriver](500004) Error getting schema information: Metadata Initialization Error. at com.simba.spark.hivecommon.dataengine.metadata.HiveJDBCCatalogSchemaOnlyMetadataSource.initSchemas(Unknown Source) at com.simba.spark.hivecommon.dataengine.metadata.HiveJDBCCatalogSchemaOnlyMetadataSource.<init>(Unknown Source) at com.simba.spark.hivecommon.dataengine.HiveJDBCDataEngine.makeNewMetadataSource(Unknown Source) at com.simba.spark.dsi.dataengine.impl.DSIDataEngine.makeNewMetadataResult(Unknown Source) at com.simba.spark.hivecommon.dataengine.HiveJDBCDataEngine.makeNewMetadataResult(Unknown Source) at com.simba.spark.jdbc.jdbc41.S41DatabaseMetaData.createMetaDataResult(Unknown Source) at com.simba.spark.jdbc.common.SDatabaseMetaData.getSchemas(Unknown Source) at net.sourceforge.squirrel_sql.fw.sql.SQLDatabaseMetaData.getSchemas(SQLDatabaseMetaData.java:278) at net.sourceforge.squirrel_sql.client.session.SessionManager.areAllSchemasAllowed(SessionManager.java:639) at net.sourceforge.squirrel_sql.client.session.schemainfo.SchemaInfoCache.getAllSchemaLoadInfos(SchemaInfoCache.java:129) at net.sourceforge.squirrel_sql.client.session.schemainfo.SchemaInfoCache.getMatchingSchemaLoadInfos(SchemaInfoCache.java:163) at net.sourceforge.squirrel_sql.client.session.schemainfo.SchemaInfoCache.getMatchingSchemaLoadInfos(SchemaInfoCache.java:156) at net.sourceforge.squirrel_sql.client.session.schemainfo.SchemaInfo.privateLoadUDTs(SchemaInfo.java:664) at net.sourceforge.squirrel_sql.client.session.schemainfo.SchemaInfo.loadUDTs(SchemaInfo.java:449) at net.sourceforge.squirrel_sql.client.session.schemainfo.SchemaInfo.privateLoadAll(SchemaInfo.java:348) at net.sourceforge.squirrel_sql.client.session.schemainfo.SchemaInfo.initialLoad(SchemaInfo.java:179) at net.sourceforge.squirrel_sql.client.session.Session$1.run(Session.java:233) at net.sourceforge.squirrel_sql.fw.util.TaskExecuter.run(TaskExecuter.java:82) Caused by: com.simba.spark.support.exceptions.GeneralException: [Simba][SparkJDBCDriver](500004) Error getting schema information: Metadata Initialization Error. ... 18 more Caused by: com.simba.spark.support.exceptions.GeneralException: HIVE_METADATA_SCHEMA_ERR at com.simba.spark.hivecommon.api.ExtendedHS2Client.getSchemas(Unknown Source) ... 18 more Caused by: org.apache.thrift.transport.TTransportException: java.net.SocketException: Connection closed by remote host at org.apache.thrift.transport.TIOStreamTransport.flush(TIOStreamTransport.java:161) at org.apache.thrift.transport.TSaslTransport.flush(TSaslTransport.java:471) at org.apache.thrift.transport.TSaslClientTransport.flush(TSaslClientTransport.java:37) at org.apache.thrift.TServiceClient.sendBase(TServiceClient.java:65) at org.apache.hive.service.cli.thrift.TCLIService$Client.send_GetSchemas(TCLIService.java:291) at com.simba.spark.hivecommon.api.HS2ClientWrapper.send_GetSchemas(Unknown Source) at org.apache.hive.service.cli.thrift.TCLIService$Client.GetSchemas(TCLIService.java:283) at com.simba.spark.hivecommon.api.HS2ClientWrapper.GetSchemas(Unknown Source) at com.simba.spark.hivecommon.api.ExtendedHS2Client.getSchemas(Unknown Source) at com.simba.spark.hivecommon.dataengine.metadata.HiveJDBCCatalogSchemaOnlyMetadataSource.initSchemas(Unknown Source) at com.simba.spark.hivecommon.dataengine.metadata.HiveJDBCCatalogSchemaOnlyMetadataSource.<init>(Unknown Source) at com.simba.spark.hivecommon.dataengine.HiveJDBCDataEngine.makeNewMetadataSource(Unknown Source) at com.simba.spark.dsi.dataengine.impl.DSIDataEngine.makeNewMetadataResult(Unknown Source) at com.simba.spark.hivecommon.dataengine.HiveJDBCDataEngine.makeNewMetadataResult(Unknown Source) at com.simba.spark.jdbc.jdbc41.S41DatabaseMetaData.createMetaDataResult(Unknown Source) at com.simba.spark.jdbc.common.SDatabaseMetaData.getSchemas(Unknown Source) at net.sourceforge.squirrel_sql.fw.sql.SQLDatabaseMetaData.getSchemas(SQLDatabaseMetaData.java:278) at net.sourceforge.squirrel_sql.client.session.SessionManager.areAllSchemasAllowed(SessionManager.java:639) at net.sourceforge.squirrel_sql.client.session.schemainfo.SchemaInfoCache.getAllSchemaLoadInfos(SchemaInfoCache.java:129) at net.sourceforge.squirrel_sql.client.session.schemainfo.SchemaInfoCache.getMatchingSchemaLoadInfos(SchemaInfoCache.java:163) at net.sourceforge.squirrel_sql.client.session.schemainfo.SchemaInfoCache.getMatchingSchemaLoadInfos(SchemaInfoCache.java:156) at net.sourceforge.squirrel_sql.client.session.schemainfo.SchemaInfo.privateLoadUDTs(SchemaInfo.java:664) at net.sourceforge.squirrel_sql.client.session.schemainfo.SchemaInfo.loadUDTs(SchemaInfo.java:449) at net.sourceforge.squirrel_sql.client.session.schemainfo.SchemaInfo.privateLoadAll(SchemaInfo.java:348) at net.sourceforge.squirrel_sql.client.session.schemainfo.SchemaInfo.initialLoad(SchemaInfo.java:179) at net.sourceforge.squirrel_sql.client.session.Session$1.run(Session.java:233) at net.sourceforge.squirrel_sql.fw.util.TaskExecuter.run(TaskExecuter.java:82) at java.lang.Thread.run(Unknown Source) Caused by: java.net.SocketException: Connection closed by remote host at sun.security.ssl.SSLSocketImpl.checkWrite(Unknown Source) at sun.security.ssl.AppOutputStream.write(Unknown Source) at java.io.BufferedOutputStream.flushBuffer(Unknown Source) at java.io.BufferedOutputStream.flush(Unknown Source) at org.apache.thrift.transport.TIOStreamTransport.flush(TIOStreamTransport.java:159) ... 27 more
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
