njalan opened a new issue, #9529:
URL: https://github.com/apache/hudi/issues/9529
S3 storage cpu is high when spark streaming is upserting data into hudi.
it is local storage works like s3 and when the spark steaming jobs is more
the cpu is pretty high but I/O is not high.
A clear and concise description of what you expected to happen.
**Environment Description**
* Hudi version : 0.9
* Spark version : 3.0.1
* Hive version : 3
* Hadoop version : 3.2.2
* Storage (HDFS/S3/GCS..) : s3
* Running on Docker? (yes/no) :no
Is there any way to monitor hudi ingestion process? I want to get more
metrics regarding the performance.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
