viirya commented on pull request #32136:
URL: https://github.com/apache/spark/pull/32136#issuecomment-820040504
> Yes, that's true. But normally, even in the case of offering a single
resource that released from a single task, it seems it's less possible to
schedule tasks unevenly unless the resources are really scarce.
As I saw in previous tests, it is by chance to have all tasks are evenly
distributed to all executors. Sometimes it is, but sometimes only partial
executors are scheduled at the first batch.
> Do you have logs related to the scheduling? I'd like to see how it happens.
I don't have logs now. It is a general and simple SS job reading from Kafka.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]