AngersZhuuuu opened a new pull request #25721: [SPARK-29018][SQL] Implement Spark Thrift Server with it's own code base on PROTOCOL_VERSION_V9 URL: https://github.com/apache/spark/pull/25721 ### What changes were proposed in this pull request? Current SparkThriftServer need to fit so much hive version problem and it implement too much unused feature from HiveServer2. Maybe we should implement thrift server with spark's own code. Changes: 1. Construct RowSet with StructType and Row 2. Old Thrift server avoid conflicts, pass a HiveConf for execution, remove all action about HiveMetaStore to class DelegationTokenHandler 3. Remove unnecessary action for Hive execution. 4. Add `hive-service` API code dependency for `beeline` 5. Implement some class to handle version problem such as `org.apache.spark.sql.hive.thriftserver.cli.Type`, `org.apache.spark.sql.hive.thriftserver.utils.LogHelper/VariableSubstitution` 6. Remove class ThrfitserverShimUtils and dir for hive version v1.2.1 & v2.3.5 7. Based on PROTOCOL_VERSION_V9, backwards compatibleļ¼ when protocol version update, we can just replace old and add some more method since protocol is backwards compatible. ### Why are the changes needed? Get rider of HiveServer2 API 's limit and fit better for Spark ### Does this PR introduce any user-facing change? NO ### How was this patch tested?
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
