This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch v1-10-test
in repository https://gitbox.apache.org/repos/asf/airflow.git.
omit 6e92e21 fixup! fixup! [AIRFLOW-5413] Allow K8S worker pod to be
configured from JSON/YAML file (#6230)
omit e079659 fixup! [AIRFLOW-5413] Allow K8S worker pod to be configured
from JSON/YAML file (#6230)
omit 1799328 Fix logging issue when running tasks (#9363)
omit 2c288b7 Persist start/end date and duration for DummyOperator Task
Instance (#8663)
omit 8259de8 Ensure "started"/"ended" in tooltips are not shown if job not
started (#8667)
omit 30202a9 Add context to execution_date_fn in ExternalTaskSensor (#8702)
omit 78fd2cb [AIRFLOW-5500] Fix the trigger_dag api in the case of nested
subdags
omit 00e9cbf Document default timeout value for SSHOperator (#8744)
omit e0bdf95 [AIRFLOW-5413] Allow K8S worker pod to be configured from
JSON/YAML file (#6230)
omit c1f7451 fixup! Avoid color info in response of /dag_stats &
/task_stats (#8742)
omit 18ff4c2 Avoid color info in response of /dag_stats & /task_stats
(#8742)
omit 3f8b5bf [AIRFLOW-5898] fix alembic crash due to typing import (#6547)
omit 23af3a7 fixup! Make loading plugins from entrypoint fault-tolerant
(#8732)
omit ad70d68 Make loading plugins from entrypoint fault-tolerant (#8732)
omit 45bf7f4 Correctly restore upstream_task_ids when deserializing
Operators (#8775)
omit 340e43d Correctly store non-default Nones in serialized tasks/dags
(#8772)
omit 686716b [AIRFLOW-6778] Add a configurable DAGs volume mount path for
Kubernetes (#8147)
omit 5e238f4 [AIRFLOW-5659] Add support for ephemeral storage on
KubernetesPodOperator (#6337)
omit 7863329 [AIRFLOW-5349] Add schedulername option for
KubernetesPodOperator (#6088)
omit cda4d23 make k8s tests pass
omit 13be816 [AIRFLOW-5641] Support running git sync container as root
(#6312)
omit 7293991 [AIRFLOW-5413] Refactor worker config (#7114)
omit 450dd52 Add default `conf` parameter to Spark JDBC Hook (#8787)
omit ec3038e Allow passing backend_kwargs to AWS SSM client (#8802)
omit 3f05ec2 Filter dags by clicking on tag (#8897)
omit 6adae28 fixup! Support k8s auth method in Vault Secrets provider
(#8640)
omit 1084f9a Support k8s auth method in Vault Secrets provider (#8640)
omit 2f17299 Monitor pods by labels instead of names (#6377)
omit 33973ab Add extra options to fix SSL issue and be more flexible
(#9409)
omit c0544c8 fixup! Fix failing tests from #9250 (#9307)
omit c80a35d [AIRFLOW-6940] Improve test isolation in test_views.py (#7564)
omit 256d7f6 Optimize count query on /home (#8729)
omit d24f2c6 Monkey patch greenlet celery pools (#8559)
omit 22c95f0 Fix failing tests from #9250 (#9307)
omit fc68cf8 Fix json string escape in tree view (#8551)
omit 72af0a1 Fix tree view if config contains " (#9250)
omit c232972 fixup! fixup! [AIRFLOW-8902] Fix Dag Run UI execution date
with timezone cannot be saved issue (#8902)
omit c0be8c4 fixup! [AIRFLOW-8902] Fix Dag Run UI execution date with
timezone cannot be saved issue (#8902)
omit bb34c05 fixup! [AIRFLOW-3900] Error on undefined template variables
in unit tests. (#4719)
omit 1249b50 [AIRFLOW-8902] Fix Dag Run UI execution date with timezone
cannot be saved issue (#8902)
omit a732559 Add TaskInstance state to TI Tooltip to be colour-blind
friendlier (#8910)
omit fd3902f Add a tip to trigger DAG screen (#9049)
omit 0a4ec72 Decrypt secrets from SystemsManagerParameterStoreBackend
(#9214)
omit b006690 Use Markup for htmlcontent for landing_times (#9242)
omit 5e7867f UX Fix: Prevent undesired text selection with DAG title
selection in Chrome (#8912)
omit 53c4e1c [AIRFLOW-3900] Error on undefined template variables in unit
tests. (#4719)
omit d095b58 Pinning max pandas version to 2.0 (lesser than) to allow
pandas 1.0. (#7954)
omit c036cdf Update example webserver_config.py to show correct CSRF
config (#8944)
omit 215fc24 Fix connection add/edit for spark (#8685)
omit 5787102 Prevent clickable sorting on non sortable columns in TI view
(#8681)
omit c2e1270 Fix displaying Executor Class Name in "Base Job" table (#8679)
omit 92a1040 Fix docs on creating CustomOperator (#8678)
omit 731ee51 Improve tutorial - Include all imports statements (#8670)
omit 3127b0a Enhanced documentation around Cluster Policy (#8661)
omit 8405787 Make hive macros py3 compatible (#8598)
omit b4f7360 Use existing DagBag for 'dag_details' & `trigger` Endpoints
(#8501)
omit d65053c [AIRFLOW-4357] Fix SVG tooltip positioning with custom
scripting (#8269)
omit 5239b4c [AIRFLOW-7066] Use sphinx syntax in concepts.rst (#7729)
omit d3e3f50 fixup! JSON escape text in test_list_dagrun_includes_conf
(#9264)
omit 3368cc4 Flush pending Sentry exceptions before exiting (#7232)
omit b795a7a JSON escape text in test_list_dagrun_includes_conf (#9264)
omit 5e94fe9 [AIRFLOW-6535] Add AirflowFailException to fail without any
retry (#7133)
omit d273284 Update the version of cattrs from 0.9 to 1.0 to support
Python 3.8 (#7100)
omit d84d36c [AIRFLOW-6231] Display DAG run conf in the list view (#6794)
omit 87000c8 [AIRFLOW-5902] avoid unnecessary sleep to maintain local task
job heart rate (#6553)
omit a8abe71 Include some missing RBAC roles on User and Viewer roles
(#9133)
omit a4f6df8 Show Dag's Markdown docs on Tree View (#9448)
omit ed37913 Update README to remove Py 3.8 limitation for Master (#9451)
omit feadbbb Added more precise Python requirements to README.md (#8455)
omit 67591bc Fixes pushing prod image directly from breeze (#9449)
omit e31761f In case of worktree .git might be a file - rat-check fails
(#9435)
omit e1675c3 Fixed rendering of IMAGES.rst (#9433)
omit 3e10afc add guidance re yarn build for local virtualenv development
(#9411)
omit a6f3d3e Fix in-breeze CLI tools to work also on Linux (#9376)
omit 7835318 Fixes Breeze 'tests' command (#9384)
omit d22054f Fixed crashing webserver after /tmp is mounted from the host
(#9378)
omit 0eb1378 Fix Airflow Stable version in README.md (#9360)
omit 6efe62f clarify breeze initialize virtualenv instructions (#9319)
omit f045a8d Fixes unbound variable on MacOS (#9335)
omit ea93adc Improve production image iteration speed (#9162)
omit 5135568 Fix broken CI image optimisation (#9313)
omit fcdb35c Update pre-commit-hooks repo version (#9195)
omit 5267573 Remove generating temp remote manifest file in project dir
(#9267)
omit 42bfb2e Add missing variable in run_cli_tool.sh (#9239)
omit 00211dc Additional apt dependencies options in breeze (#9231)
omit 68d7399 Add generic CLI tool wrapper (#9223)
omit 7658c18 Correctly restore colour in logs after format arg (#9222)
omit 936d767 n Improved compatibility with Python 3.5+ - Convert
signal.SIGTERM to int (#9207)
omit 83ba24b Support additional apt dependencies (#9189)
omit c7bca9d Updated missing parameters for docker image building (#9039)
omit 3a54137 Fix typo in BREEZE.rst (#9199)
omit 7aa60b8 Remove httplib2 from Google requirements (#9194)
omit 659863d Add PR/issue note in Contribution Workflow Example (#9177)
omit 566b9d3 Don't use the term "whitelist" - language matters (#9174)
omit 910ac9a Merging multiple sql operators (#9124)
omit c7117cc Fix retries causing constraint violation on MySQL with DAG
Serialization (#9336)
omit ba39830 Add 'main' param to template_fields in
DataprocSubmitPySparkJobOperator (#9154)
omit 57225c6 Parameterized bash/python in the prod image (#9157)
omit 82b7644 [AIRFLOW-4472] Use json.dumps/loads for templating lineage
data (#5253)
omit 619720b Add SQL Branch Operator
omit 45b91ce [AIRFLOW-XXX] Extract operators and hooks to separate page
(#6213)
omit 118c37d Update AWS connection example to show how to set from env var
(#9191)
omit 4343183 Make it possible to silence warnings from Airflow (#9208)
omit 1e91572 Remove redundant count query in BaseOperator.clear() (#9362)
omit 5c21d61 set name via validator for KubernetesPodOperator
omit 2d83e77 Fix migration message (#8988)
omit ddbb15d Correctly deserialize dagrun_timeout field on DAGs (#8735)
omit 354b58e Fix performance degradation when updating dagrun state (#8435)
omit a5434ba Fix awkward log info in dbapi_hook (#8482)
omit 5e16a12 Fix KubernetesPodOperator pod name length validation (#8829)
omit ab52d1b Fix list formatting of plugins doc. (#8873)
omit 19e57d4 Add dev script to compare GH issues against merges (#9270)
omit ff827f7 Make Kubernetes tests pass (#9332)
omit fab105e Fix Migration for MSSQL (#8385)
omit 0054a20 Fix Celery default to no longer allow pickle (#7205)
omit 7d332c5 Further validation that only task commands are run by
executors (#9240)
omit d659f33 Upload kind logs to Github Actions artifact (#9230)
omit b387473 Disable KIND git-sync tests for now (#9229)
omit 9c01cac fixup! change mock import for 2.7
omit ea18f69 fixup! KubernetesPodOperator tests were not running
omit 77016b0 CI: Propogate Exit Code Correctly (#9247)
omit 929fa71 Get all pod logs on k8s launching failure (#9317)
omit 11930a2 Fix up coredns pods in KIND CI (#9224)
omit 8f552cc [AIRFLOW-3973] Commit after each alembic migration (#4797)
omit 7b7c5b1 Remove unused airflow import from docs (#9274)
omit 60f631f Don't use the `|safe` filter in code, it's risky (#9180)
omit 12a7822 Validate only task commands are run by executors (#9178)
omit 782d916 fixup! Kubernetes Cluster is started on host not in the
container (#8265)
omit 6ecede2 Chown should work now when building the documentation (#8600)
omit 5661dc9 Improved cloud tool available in the trimmed down CI
container (#9167)
omit e5162b0 Fixes failure of the build scripts when remote repo does not
exist (#9188)
omit ec12334 Add PR/issue note in Contribution Workflow Example (#9177)
omit a4dfb98 Split utils sh (#9132)
omit c0534d8 Replaces cloud-provider CLIs in CI image with scripts running
containers (#9129)
omit f16cae3 Remove vendored nvd3 and slugify libraries (#9136)
omit 410bcd4 Use static binary linked docker client in CI image (#9126)
omit 86eeb00 Restrict google-cloud-texttospeach to <v2 (#9137)
omit 4e7c48e Remove remnant kubernetes stuff from breeze scripts (#9138)
omit 7236616 Cope with multiple processes get_remote_image_info in
parallel (#9105)
omit 945b0e6 Fix INTEGRATIONS[*]: unbound variable error in breeze (#9135)
omit c34cd6d Fixes a bug where `build-image` command did not calculate md5
(#9130)
omit 8dacc27 Kubernetes Cluster is started on host not in the container
(#8265)
new 3c20d6f Kubernetes Cluster is started on host not in the container
(#8265)
new 6e69ff2 Fixes a bug where `build-image` command did not calculate md5
(#9130)
new 949e315 Fix INTEGRATIONS[*]: unbound variable error in breeze (#9135)
new ce573b9 Cope with multiple processes get_remote_image_info in
parallel (#9105)
new 4927a0c Remove remnant kubernetes stuff from breeze scripts (#9138)
new 9959743 Restrict google-cloud-texttospeach to <v2 (#9137)
new 16a98e9 Use static binary linked docker client in CI image (#9126)
new 5bffaf7 Remove vendored nvd3 and slugify libraries (#9136)
new 364f408 Replaces cloud-provider CLIs in CI image with scripts running
containers (#9129)
new b4c067a Split utils sh (#9132)
new 26e8336 Add PR/issue note in Contribution Workflow Example (#9177)
new 3ae2701 Fixes failure of the build scripts when remote repo does not
exist (#9188)
new 7d53ef1 Improved cloud tool available in the trimmed down CI
container (#9167)
new 6ec410a Chown should work now when building the documentation (#8600)
new d11cb47 Validate only task commands are run by executors (#9178)
new 9e4d375 Don't use the `|safe` filter in code, it's risky (#9180)
new ce426e9 Remove unused airflow import from docs (#9274)
new 432f19f [AIRFLOW-3973] Commit after each alembic migration (#4797)
new 4d5480e Fix up coredns pods in KIND CI (#9224)
new cc6258f Get all pod logs on k8s launching failure (#9317)
new 8388ac8 CI: Propogate Exit Code Correctly (#9247)
new f161811 fixup! KubernetesPodOperator tests were not running
new ffd936e fixup! change mock import for 2.7
new 4d618f8 Disable KIND git-sync tests for now (#9229)
new 50d1f6f Upload kind logs to Github Actions artifact (#9230)
new 10d808b Further validation that only task commands are run by
executors (#9240)
new 967e61d Fix Celery default to no longer allow pickle (#7205)
new 551fb85 Fix Migration for MSSQL (#8385)
new be989e9 Make Kubernetes tests pass (#9332)
new 58fd22d Add dev script to compare GH issues against merges (#9270)
new 787e164 Fix list formatting of plugins doc. (#8873)
new 7ef7315 Fix KubernetesPodOperator pod name length validation (#8829)
new e160a65 Fix awkward log info in dbapi_hook (#8482)
new dbb65c4 Fix performance degradation when updating dagrun state (#8435)
new 165aeba Correctly deserialize dagrun_timeout field on DAGs (#8735)
new a9ba7a5 Fix migration message (#8988)
new bc9c2d0 set name via validator for KubernetesPodOperator
new 08f3a26 Remove redundant count query in BaseOperator.clear() (#9362)
new 4e1e5ec Make it possible to silence warnings from Airflow (#9208)
new e5e0cc3 Update AWS connection example to show how to set from env var
(#9191)
new 923991e Add SQL Branch Operator
new 96db546 [AIRFLOW-4472] Use json.dumps/loads for templating lineage
data (#5253)
new bd5a894 Parameterized bash/python in the prod image (#9157)
new 2244e4f Add 'main' param to template_fields in
DataprocSubmitPySparkJobOperator (#9154)
new 4aeda81 Fix retries causing constraint violation on MySQL with DAG
Serialization (#9336)
new b574b5c Merging multiple sql operators (#9124)
new 0dbe06e Don't use the term "whitelist" - language matters (#9174)
new c494bee Add PR/issue note in Contribution Workflow Example (#9177)
new a748ad2 Remove httplib2 from Google requirements (#9194)
new 1fdc534 Fix typo in BREEZE.rst (#9199)
new c80ea5c Updated missing parameters for docker image building (#9039)
new d29b9b2 Support additional apt dependencies (#9189)
new 459b2ee n Improved compatibility with Python 3.5+ - Convert
signal.SIGTERM to int (#9207)
new aeb145e Correctly restore colour in logs after format arg (#9222)
new 23d1744 Add generic CLI tool wrapper (#9223)
new 7461cf0 Additional apt dependencies options in breeze (#9231)
new 25cbf3d Add missing variable in run_cli_tool.sh (#9239)
new e0278ec Remove generating temp remote manifest file in project dir
(#9267)
new 1a1e494 Update pre-commit-hooks repo version (#9195)
new 597ccbf Fix broken CI image optimisation (#9313)
new d340110 Improve production image iteration speed (#9162)
new 7545e36 Fixes unbound variable on MacOS (#9335)
new 19e78ba clarify breeze initialize virtualenv instructions (#9319)
new 10950c8 Fix Airflow Stable version in README.md (#9360)
new 3caa119 Fixed crashing webserver after /tmp is mounted from the host
(#9378)
new dca524b Fixes Breeze 'tests' command (#9384)
new baa5ece Fix in-breeze CLI tools to work also on Linux (#9376)
new d82f85b add guidance re yarn build for local virtualenv development
(#9411)
new f39f71d Fixed rendering of IMAGES.rst (#9433)
new ba9da48 In case of worktree .git might be a file - rat-check fails
(#9435)
new 20ea1c4 Fixes pushing prod image directly from breeze (#9449)
new 5baf53b Added more precise Python requirements to README.md (#8455)
new 88e82e0 Update README to remove Py 3.8 limitation for Master (#9451)
new 20da168 Show Dag's Markdown docs on Tree View (#9448)
new 1634133 Include some missing RBAC roles on User and Viewer roles
(#9133)
new 7b057c4 [AIRFLOW-5902] avoid unnecessary sleep to maintain local task
job heart rate (#6553)
new fb4c10e [AIRFLOW-6231] Display DAG run conf in the list view (#6794)
new 8fb9003 Update the version of cattrs from 0.9 to 1.0 to support
Python 3.8 (#7100)
new d60a2bf [AIRFLOW-6535] Add AirflowFailException to fail without any
retry (#7133)
new a26dd59 JSON escape text in test_list_dagrun_includes_conf (#9264)
new 82dd51f Flush pending Sentry exceptions before exiting (#7232)
new a8dddfb [AIRFLOW-7066] Use sphinx syntax in concepts.rst (#7729)
new f1787be [AIRFLOW-4357] Fix SVG tooltip positioning with custom
scripting (#8269)
new 1888de7 Use existing DagBag for 'dag_details' & `trigger` Endpoints
(#8501)
new 4dddbc4 Make hive macros py3 compatible (#8598)
new 7dcc9bb Enhanced documentation around Cluster Policy (#8661)
new 6676118 Improve tutorial - Include all imports statements (#8670)
new ff5b15c Fix docs on creating CustomOperator (#8678)
new 2d54916 Fix displaying Executor Class Name in "Base Job" table (#8679)
new 7497033 Prevent clickable sorting on non sortable columns in TI view
(#8681)
new 66a83be Fix connection add/edit for spark (#8685)
new 18a6a40 Update example webserver_config.py to show correct CSRF
config (#8944)
new 7389112 Pinning max pandas version to 2.0 (lesser than) to allow
pandas 1.0. (#7954)
new 2bdabe9 [AIRFLOW-3900] Error on undefined template variables in unit
tests. (#4719)
new e1e41e7 UX Fix: Prevent undesired text selection with DAG title
selection in Chrome (#8912)
new efe1419 Use Markup for htmlcontent for landing_times (#9242)
new f16c915 Decrypt secrets from SystemsManagerParameterStoreBackend
(#9214)
new 5abae4e Add a tip to trigger DAG screen (#9049)
new 2161068 Add TaskInstance state to TI Tooltip to be colour-blind
friendlier (#8910)
new e8422ff [AIRFLOW-8902] Fix Dag Run UI execution date with timezone
cannot be saved issue (#8902)
new 68fce08 Fix tree view if config contains " (#9250)
new 78085de Fix json string escape in tree view (#8551)
new 48c49ac Fix failing tests from #9250 (#9307)
new a14349c Monkey patch greenlet celery pools (#8559)
new 61514cb Optimize count query on /home (#8729)
new 5f798b8 [AIRFLOW-6940] Improve test isolation in test_views.py (#7564)
new 3986e5a Add extra options to fix SSL issue and be more flexible
(#9409)
new 4f62a99 Monitor pods by labels instead of names (#6377)
new c2ce290 Support k8s auth method in Vault Secrets provider (#8640)
new 2c92027 Filter dags by clicking on tag (#8897)
new 558ac69 Allow passing backend_kwargs to AWS SSM client (#8802)
new 0881823 Add default `conf` parameter to Spark JDBC Hook (#8787)
new 9f9d87a [AIRFLOW-5413] Refactor worker config (#7114)
new bfe27b9 [AIRFLOW-5641] Support running git sync container as root
(#6312)
new 820704b make k8s tests pass
new c1ebb9b [AIRFLOW-5349] Add schedulername option for
KubernetesPodOperator (#6088)
new 13d0095 [AIRFLOW-5659] Add support for ephemeral storage on
KubernetesPodOperator (#6337)
new 5484bc3 [AIRFLOW-6778] Add a configurable DAGs volume mount path for
Kubernetes (#8147)
new e34c89f Correctly store non-default Nones in serialized tasks/dags
(#8772)
new 75e4509 Correctly restore upstream_task_ids when deserializing
Operators (#8775)
new d731e5a Make loading plugins from entrypoint fault-tolerant (#8732)
new 850fa29 [AIRFLOW-5898] fix alembic crash due to typing import (#6547)
new a208985 Avoid color info in response of /dag_stats & /task_stats
(#8742)
new 9e7e8e7 [AIRFLOW-5413] Allow K8S worker pod to be configured from
JSON/YAML file (#6230)
new 977e62c Document default timeout value for SSHOperator (#8744)
new a89d39c [AIRFLOW-5500] Fix the trigger_dag api in the case of nested
subdags
new 74beb6f Add context to execution_date_fn in ExternalTaskSensor (#8702)
new 4d474c7 Ensure "started"/"ended" in tooltips are not shown if job not
started (#8667)
new 2c748c0 Persist start/end date and duration for DummyOperator Task
Instance (#8663)
new 273c9b7 Fix logging issue when running tasks (#9363)
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (6e92e21)
\
N -- N -- N refs/heads/v1-10-test (273c9b7)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 130 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
airflow/www_rbac/templates/airflow/dag.html | 2 +-
docs/index.rst | 1 -
docs/integration.rst | 470 +++++++++++++++++++++++++++-
3 files changed, 459 insertions(+), 14 deletions(-)
