Avihais12344 commented on PR #51012: URL: https://github.com/apache/spark/pull/51012#issuecomment-3239528457
> Given that there is no silver bullet for all heterogeneous environments, I don't think the change of default values can give us a solution for all. > > I'd like to recommend you to apply the proper configuration in your environments (via Airflow) instead of affecting all world-wide community, @Avihais12344 . Yes, we have done it. But I still think that printing that log message every `1s` is too much. There may not be a silver bullet, but maybe we can get a better default number by calculating the responsiveness we wish for and the average time of a Spark application? @dongjoon-hyun -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
