RNHTTR commented on code in PR #32709:
URL: https://github.com/apache/airflow/pull/32709#discussion_r1272305349
##########
docs/apache-airflow/authoring-and-scheduling/deferring.rst:
##########
@@ -20,7 +20,7 @@ Deferrable Operators & Triggers
Standard :doc:`Operators </core-concepts/operators>` and :doc:`Sensors
<../core-concepts/sensors>` take up a full *worker slot* for the entire time
they are running, even if they are idle; for example, if you only have 100
worker slots available to run Tasks, and you have 100 DAGs waiting on a Sensor
that's currently running but idle, then you *cannot run anything else* - even
though your entire Airflow cluster is essentially idle. ``reschedule`` mode for
Sensors solves some of this, allowing Sensors to only run at fixed intervals,
but it is inflexible and only allows using time as the reason to resume, not
anything else.
-This is where *Deferrable Operators* come in. A deferrable operator is one
that is written with the ability to suspend itself and free up the worker when
it knows it has to wait, and hand off the job of resuming it to something
called a *Trigger*. As a result, while it is suspended (deferred), it is not
taking up a worker slot and your cluster will have a lot less resources wasted
on idle Operators or Sensors.
+This is where *Deferrable Operators* come in. A deferrable operator is one
that is written with the ability to suspend itself and free up the worker when
it knows it has to wait, and hand off the job of resuming it to something
called a *Trigger*. As a result, while it is suspended (deferred), it is not
taking up a worker slot and your cluster will have a lot less resources wasted
on idle Operators or Sensors. Note that by default a deferred tasks will not
use up a pool slot, if you would like them to, you can change this by editing
the pool in question.
Review Comment:
Typo in the following sentence ("task" should be singular)
> Note that by default a deferred task~s~ will not use up a pool slot, if
you would like them to, you can change this by editing the pool in question.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
