We can decide on the default value but I do think it is better to make it configurable, we can put comments stating clearly about if they need to tune or how to tune. In an ideal world matching the # of processes with # of (v)cores maximize the performance but in our case there might be other processes running( e.g. task runner processes from LocalExecutor, DAG parsing processes, processes from other services, e.g. webserver).
[ Full content available at: https://github.com/apache/incubator-airflow/pull/3830 ] This message was relayed via gitbox.apache.org for [email protected]
