This is an automated email from the ASF dual-hosted git repository.
kaxilnaik pushed a change to branch aip-39-docs
in repository https://gitbox.apache.org/repos/asf/airflow.git.
discard da80a15 Replace ti.xcom_pull() in extra link example
discard bb2b91b Wording tweak
discard f4e8d09 Remove logical date reference in DAG concept
discard d7cf985 Don't use dag_maker in Best Practice docs
discard 996555a4 Use run_id in Elasticsearch log ID template
discard 28bc998 Typos and wording/styling tweaks
discard be38888 Inline the example custom timetable DAG
discard 46cd187 Fix example DAG
discard ed38f31 Make the run_after description a bit vague
discard f7383ef Fix Elastic tests depending on private function
discard 35232d8 Revert TI.xcom_pull() usage
discard ee0729c Fix sentry tests to account for additional tags
discard d451fbd Fix example
discard 1e6d767 More typos
discard 0664668 Airflow's CI is American
discard 137b599 Remove execution date reference in docs
discard 159b186 Rewrite example with new last_automated_dagrun
discard 8897d1a Fix imports in example DAG
discard 02be21a Typos
discard 655ddd0 Document timetable registration via plugin
discard 21459ab Mention data interval and add timetable how-to
add 8ae2bb9 Fix error when create external table using table resource
(#17998)
add d3d847a Swap dag import error dropdown icons (#18207)
add 2474f89 Migrate Google Cloud Build from Discovery API to Python SDK
(#18184)
add 9c8f7ac Add heartbeat to TriggererJob (#18129)
add 9d49772 BugFix: Wipe ``next_kwargs`` and ``next_method`` on task
failure (#18210)
add 3b2b7e7 Upgrade ``importlib-resources`` version (#18209)
add dd313a5 Omit ``airflow._vendor`` package in coverage report (#18221)
add b7f366c Fix failing main due to #18209 (#18215)
add ca45bba Chart: Allow running and waiting for DB Migrations using
default image (#18218)
add 27144bd Doc change: XCOM / Taskflow (#18212)
add fe6a769 Add some basic metrics to the Triggerer (#18214)
add 23a68fa Advanced Params using json-schema (#17100)
add a9776d3 Remove loading dots even when last run data is empty (#18230)
add 7a19124 Return explicit error on user-add for duplicated email
(#18224)
add 37ca990 Don't check for `__init__.py` under pycache folders. (#18238)
add 778be79 Fix example dag of PostgresOperator (#18236)
add c73004d Revert Changes to ``importlib-resources`` (#18250)
add 292751c Make sure create_user arguments are keyword-ed (#18248)
add 67fddbf Improves installing from sources pages for all components
(#18251)
add 848f206 Reduce lengths of the name, username and email fields for
this test (#18263)
add 2d4f3cb Adding missing `replace` param in docstring (#18241)
add 9f7c10b Fix deleting of zipped Dags in Serialized Dag Table (#18243)
add e7925d8 Fix external_executor_id not being set for manually run jobs
(#17207)
add 9a7243a Sort adopted tasks in _check_for_stalled_adopted_tasks method
(#18208)
add 902aeb7 Fix DB session handling in XCom.set. (#18240)
add b0e91f6 Fix dag_run FK check in pre-db upgrade (#18266)
add 55649f3 Add ``triggerer`` to ``./breeze start-airflow`` command
(#18259)
add 9ed87e5 show next run if not none (#18273)
add 686c3d7 remove all reference to date in dropdown tests (#18271)
add 29d700d Add metrics docs for triggerer metrics (#18254)
add 184f394 Use try/except when closing temporary file in task_runner
(#18269)
add 671de3f Improved log handling for zombie tasks (#18277)
add ed10edd Silence warnings in tests from using SubDagOperator (#18275)
add c313feb Fix web view rendering errors without a DAG run (#18244)
add 21d53ed Fix provider test acessing importlib-resources (#18228)
add f8ba475 Make `XCom.get_one` return full, not abbreviated values
(#18274)
add 2dac083 Fixed wasb hook attempting to create container when getting a
blob client (#18287)
add 73044af Chart: Use stable API versions where available (#17211)
add 0527624 Chart: Fix applying labels on Triggerer (#18299)
add 8692cbf Fix Chart doc build (#18302)
add 3ddb389 Run Docs build when updating `chart/UPDATING.rst` (#18303)
add 5e9a877 Add information about differencies of deps in eager-upgrade
(#18293)
add 475fcd1 Added Bentego to INTHEWILD.md (#18301)
add 246e5b4 Pass exception to ``run_finished_callback`` for Debug
Executor (#17983)
add 7e132a0 Fix spelling on chart docs (#18308)
add 11621ce Build docs when chart changelog or values schema changes
(#18307)
add 3f493be Add 2.2.0b1 changelog (#18205)
add 18fef9b Fix mini scheduler not respecting wait_for_downstream (#18310)
add 4308a8c Refactor installation pages (#18282)
add 516d6d8 Chart: Ability to access http k8s via multiple hostnames
(#18257)
add d7a8a8f Chart: less fragile webserver deployment tests (#18332)
add ca97178 Fix mini scheduler not respecting ``wait_for_downstream`` dep
(#18338)
add 0b7b133 Move DB call out of ``DatabricksHook.__init__`` (#18339)
add 645d3b4 Mention data interval and add timetable how-to
add 8977cf9 Document timetable registration via plugin
add 25cbd6f Typos
add 90ed84a Fix imports in example DAG
add 12a0042 Rewrite example with new last_automated_dagrun
add 74a4d13 Remove execution date reference in docs
add 8789110 Airflow's CI is American
add 3cbbaca More typos
add efb28ee Fix example
add c75de69 Fix sentry tests to account for additional tags
add ae098ec Revert TI.xcom_pull() usage
add b3cf323 Fix Elastic tests depending on private function
add 2f30ec0 Make the run_after description a bit vague
add 52c378a Fix example DAG
add 33d85e4 Inline the example custom timetable DAG
add bf828a0 Typos and wording/styling tweaks
add e9f3203 Use run_id in Elasticsearch log ID template
add da01d3b Don't use dag_maker in Best Practice docs
add 441188d Remove logical date reference in DAG concept
add c08db80 Wording tweak
add 08c1f51 Replace ti.xcom_pull() in extra link example
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (da80a15)
\
N -- N -- N refs/heads/aip-39-docs (08c1f51)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.coveragerc | 1 +
.github/workflows/ci.yml | 4 +
CHANGELOG.txt | 275 ++++++
INTHEWILD.md | 1 +
UPDATING.md | 10 +
.../api_connexion/endpoints/dag_run_endpoint.py | 27 +-
airflow/api_connexion/endpoints/user_endpoint.py | 16 +-
airflow/api_connexion/openapi/v1.yaml | 2 +
airflow/api_connexion/schemas/dag_schema.py | 8 +-
airflow/api_connexion/schemas/task_schema.py | 7 +
airflow/cli/commands/dag_command.py | 34 +-
airflow/cli/commands/task_command.py | 13 +-
airflow/dag_processing/manager.py | 26 +-
airflow/executors/celery_executor.py | 20 +-
airflow/executors/debug_executor.py | 2 +-
airflow/jobs/local_task_job.py | 5 +-
airflow/jobs/triggerer_job.py | 20 +
airflow/models/__init__.py | 1 +
airflow/models/baseoperator.py | 8 +-
airflow/models/dag.py | 27 +-
airflow/models/dagparam.py | 47 +-
airflow/models/param.py | 205 ++++
airflow/models/taskinstance.py | 25 +-
airflow/models/xcom.py | 36 +-
airflow/operators/python.py | 3 +-
airflow/operators/subdag.py | 2 +-
.../amazon/aws/transfers/salesforce_to_s3.py | 2 +
airflow/providers/databricks/hooks/databricks.py | 4 +-
.../cloud/example_dags/example_cloud_build.py | 168 +++-
.../providers/google/cloud/hooks/cloud_build.py | 620 ++++++++++--
.../providers/google/cloud/operators/bigquery.py | 56 +-
.../google/cloud/operators/cloud_build.py | 1030 +++++++++++++++++---
airflow/providers/microsoft/azure/hooks/wasb.py | 5 +-
.../postgres/example_dags/example_postgres.py | 14 +-
airflow/serialization/enums.py | 1 +
airflow/serialization/serialized_objects.py | 62 +-
airflow/task/task_runner/base_task_runner.py | 7 +-
airflow/ui/test/TimezoneDropdown.test.tsx | 23 +-
airflow/utils/db.py | 34 +-
airflow/www/static/css/flash.css | 4 +-
airflow/www/static/js/dags.js | 4 +-
airflow/www/templates/airflow/dags.html | 4 +-
airflow/www/templates/airflow/task.html | 26 +-
airflow/www/views.py | 90 +-
chart/UPDATING.rst | 19 +-
chart/templates/NOTES.txt | 26 +-
chart/templates/_helpers.yaml | 18 +
chart/templates/cleanup/cleanup-cronjob.yaml | 4 +
chart/templates/flower/flower-ingress.yaml | 39 +-
chart/templates/jobs/migrate-database-job.yaml | 2 +-
.../pgbouncer/pgbouncer-poddisruptionbudget.yaml | 4 +
.../templates/scheduler/scheduler-deployment.yaml | 2 +-
.../scheduler/scheduler-poddisruptionbudget.yaml | 4 +
.../templates/triggerer/triggerer-deployment.yaml | 4 +-
.../templates/webserver/webserver-deployment.yaml | 2 +-
chart/templates/webserver/webserver-ingress.yaml | 70 +-
chart/templates/workers/worker-deployment.yaml | 2 +-
chart/tests/helm_template_generator.py | 45 +-
chart/tests/test_airflow_common.py | 36 +-
chart/tests/test_basic_helm_chart.py | 13 +-
chart/tests/test_cleanup_pods.py | 7 +
chart/tests/test_ingress_flower.py | 69 +-
chart/tests/test_ingress_web.py | 66 +-
chart/tests/test_migrate_database_job.py | 30 +-
.../{test_ingress_web.py => test_pdb_pgbouncer.py} | 22 +-
.../{test_ingress_web.py => test_pdb_scheduler.py} | 22 +-
chart/tests/test_triggerer.py | 15 +
chart/tests/test_webserver.py | 4 +-
chart/values.schema.json | 66 +-
chart/values.yaml | 40 +-
dev/README_RELEASE_AIRFLOW.md | 9 +-
dev/README_RELEASE_HELM_CHART.md | 4 +-
dev/README_RELEASE_PROVIDER_PACKAGES.md | 10 +-
docs/README.rst | 2 +-
.../operators/_partials/prerequisite_tasks.rst | 2 +-
.../operators/_partials/prerequisite_tasks.rst | 2 +-
.../operators/cloud/cloud_build.rst | 339 ++++++-
.../operators/_partials/prerequisite_tasks.rst | 2 +-
docs/apache-airflow-providers/index.rst | 7 +-
.../installing-from-pypi.rst | 45 +
.../installing-from-sources.rst | 46 +-
docs/apache-airflow/concepts/index.rst | 1 +
docs/apache-airflow/concepts/params.rst | 63 ++
docs/apache-airflow/extra-packages-ref.rst | 2 +-
docs/apache-airflow/index.rst | 6 +-
docs/apache-airflow/installation.rst | 361 -------
docs/apache-airflow/installation/dependencies.rst | 92 ++
docs/apache-airflow/installation/index.rst | 317 ++++++
.../installation/installing-from-pypi.rst | 207 ++++
.../{ => installation}/installing-from-sources.rst | 62 +-
.../installation/prerequisites.rst} | 42 +-
.../installation/setting-up-the-database.rst} | 41 +-
.../installation/supported-versions.rst | 67 ++
docs/apache-airflow/logging-monitoring/metrics.rst | 5 +
docs/apache-airflow/redirects.txt | 5 +
docs/apache-airflow/tutorial_taskflow_api.rst | 29 +
.../index.rst} | 44 +-
.../{ => upgrading-from-1-10}/upgrade-check.rst | 0
docs/build_docs.py | 55 +-
docs/conf.py | 26 +-
docs/docker-stack/build.rst | 3 +-
.../customizing/github-v2-1-test.sh | 2 +-
docs/exts/extra_files_with_substitutions.py | 8 +-
docs/helm-chart/index.rst | 1 +
.../installing-helm-chart-from-sources.rst} | 48 +-
docs/installing-providers-from-sources.rst | 62 +-
docs/spelling_wordlist.txt | 2 +
scripts/ci/constraints/ci_branch_constraints.sh | 6 +-
...it_check_providers_subpackages_all_have_init.py | 8 +-
scripts/ci/selective_ci_checks.sh | 3 +
.../ci_run_single_airflow_test_in_docker.sh | 23 +
scripts/in_container/bin/run_tmux | 4 +
setup.cfg | 2 +-
setup.py | 6 +-
tests/api_connexion/endpoints/test_dag_endpoint.py | 27 +-
.../api_connexion/endpoints/test_task_endpoint.py | 27 +-
.../api_connexion/endpoints/test_user_endpoint.py | 87 +-
tests/api_connexion/schemas/test_dag_schema.py | 9 +-
tests/api_connexion/schemas/test_task_schema.py | 11 +-
tests/cli/commands/test_task_command.py | 62 ++
tests/core/test_providers_manager.py | 21 +-
tests/dag_processing/test_manager.py | 32 +-
tests/dags/test_clear_subdag.py | 12 +-
tests/dags/test_impersonation_subdag.py | 9 +-
tests/dags/test_subdag.py | 12 +-
tests/executors/test_celery_executor.py | 39 +-
tests/jobs/test_local_task_job.py | 45 +
tests/models/test_dag.py | 27 +-
tests/models/test_dagparam.py | 100 --
tests/models/test_param.py | 234 +++++
tests/models/test_taskinstance.py | 30 +
tests/models/test_xcom.py | 239 +++--
tests/operators/test_python.py | 2 -
.../google/cloud/hooks/test_cloud_build.py | 382 ++++----
.../google/cloud/operators/test_cloud_build.py | 410 +++++---
.../cloud/operators/test_cloud_build_system.py | 6 +-
tests/sensors/test_timeout_sensor.py | 2 +-
tests/serialization/test_dag_serialization.py | 46 +-
tests/test_utils/api_connexion_utils.py | 7 +-
tests/www/test_security.py | 32 +-
tests/www/views/conftest.py | 2 +-
tests/www/views/test_views_task_norun.py | 50 +
tests/www/views/test_views_trigger_dag.py | 4 +-
143 files changed, 5839 insertions(+), 1808 deletions(-)
create mode 100644 airflow/models/param.py
copy chart/tests/{test_ingress_web.py => test_pdb_pgbouncer.py} (58%)
copy chart/tests/{test_ingress_web.py => test_pdb_scheduler.py} (60%)
create mode 100644 docs/apache-airflow-providers/installing-from-pypi.rst
copy docs/{apache-airflow =>
apache-airflow-providers}/installing-from-sources.rst (57%)
create mode 100644 docs/apache-airflow/concepts/params.rst
delete mode 100644 docs/apache-airflow/installation.rst
create mode 100644 docs/apache-airflow/installation/dependencies.rst
create mode 100644 docs/apache-airflow/installation/index.rst
create mode 100644 docs/apache-airflow/installation/installing-from-pypi.rst
rename docs/apache-airflow/{ => installation}/installing-from-sources.rst (57%)
copy docs/{apache-airflow-providers-apache-drill/operators.rst =>
apache-airflow/installation/prerequisites.rst} (51%)
copy docs/{apache-airflow-providers-slack/connections/slack.rst =>
apache-airflow/installation/setting-up-the-database.rst} (52%)
create mode 100644 docs/apache-airflow/installation/supported-versions.rst
rename docs/apache-airflow/{upgrading-to-2.rst =>
upgrading-from-1-10/index.rst} (97%)
rename docs/apache-airflow/{ => upgrading-from-1-10}/upgrade-check.rst (100%)
copy docs/{installing-providers-from-sources.rst =>
helm-chart/installing-helm-chart-from-sources.rst} (60%)
delete mode 100644 tests/models/test_dagparam.py
create mode 100644 tests/models/test_param.py
create mode 100644 tests/www/views/test_views_task_norun.py
