AngersZhuuuu opened a new pull request #26340: [WIP][SPARK-29108][SQL] Add new 
module sql/thriftserver  with all code and UT
URL: https://github.com/apache/spark/pull/26340
 
 
   ### What changes were proposed in this pull request?
   As comment https://github.com/apache/spark/pull/26221#issuecomment-545954335
   Raise a pr with entire code and pass origin `hive-thriftserver` 's UT
   
   Changes:
   1. Impelemnt `Type` in scala since spark con't support all type of hive
   2. Implement `Service/AbstractService` prepare for remove hive conf in future
   3. Construct RowSet with StructType and Row
   4. Implement `HiveAuthFactory` since between 1.2.1/2.3.5, their delegation 
token managerment changed. Impelment on DelegationTokenMnagerment by scala
   5. MV `tableTypeString` from `SparkMetadataOperationUtils` to 
`SparkMetadataOperation`
   5. Since there are `tableTypeString` in `SparkMetadataOperation` remove 
`ClassicTypeMapping`, `HiveTableTypeMapping`, `TableTypeMapping` and 
`TableTypeMappingFactory`
   6. Implement all oepration for spark since it execute in different way
   7. Add new method `GetQueryId`, `SetClientInfo` for thrift version v11 in 
`ThriftCLIService`
   8. Add `statementid` to `Operation` for implement `GetQueryId`
   9. Remove `GlobalHivercFileProcessor` `setFetchSize` 
`processGlobalInitFile`etc
   10. Remove unused `openSession` `openSessionWithImpersonation` in 
`CLIService`
   11. Copy `hive-thriftserver` test to `spark-thriftserver` and remove 
`ThriftSeverShimUtils` about test UT, since we won't need it.
   12. Implement it's own thrift client code. `CLIServiceClient` 
`ThrictCLIServiceClient`
   
   
   ### Why are the changes needed?
   Solve hive version conflics and finally build a thriftserver make hive 
plugability. 
   
   
   ### Does this PR introduce any user-facing change?
   
   start and stop
   ```
   ./sbin/start-spark-thriftserver.sh
   ./sbin/stop-spark-thriftserver.sh
   ```
   
   use beeline connect as origin.
   
   ### How was this patch tested?
   UT 
   

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
[email protected]


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to