dstandish commented on PR #34742: URL: https://github.com/apache/airflow/pull/34742#issuecomment-1745732455
> As I understood, it's recommended to use a small value for max_tis_per_query, regardless the value of parallelism, so even if the parallelism is set to 1024, a small max_tis_per_query (~50) will be recommended and not just any value smaller than 1024. That's a good point @hussein-awala yeah. I suppose it might be good to add some comment about using small value being beneficial in the config template, if there isn't one there already. But I guess that my main concern with the warning is that it isn't telling the truth -- sometimes it _will_ be used even if greater than core parallelism. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
