njalan opened a new issue, #7431:
URL: https://github.com/apache/hudi/issues/7431
I am using spark to ingest&etl based one apache hudi for more than one years.
I suddenly faced that the many spark jobs got stuck after Hive sync
completed as below:
HiveSyncTool: Sync complete for xxx
But as successful job I also got below log after Hive sync completed:
22/12/12 13:14:59 INFO HiveSyncTool: Sync complete for xxx
**22/12/12 13:14:59 INFO metastore: Closed a connection to metastore,
current connections: 0**
All the stuck job I can see message "HiveSyncTool: Sync complete" but
without "Closed a connection to metastore, current connections: 0"
A clear and concise description of what you expected to happen.
**Environment Description**
* Hudi version : 0.9.0
* Spark version : 3.0.1
* Hive version : 3.1.2
* Hadoop version : 3.2.2
* Storage (HDFS/S3/GCS..) :S3
* Running on Docker? (yes/no) :no
**Additional context**
Add any other context about the problem here.
**Stacktrace**
```Add the stacktrace of the error.```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
