This is an automated email from the ASF dual-hosted git repository.
bbovenzi pushed a change to branch mapped-task-drawer
in repository https://gitbox.apache.org/repos/asf/airflow.git.
discard 74fada2 Fix TimezoneEvent import
discard 3fa6122 Add timezone provider
discard be432f3 Fix task/run label, dialog focus, dag details overflow, panel
open/close
discard df93dc2 Code cleanup and fix task clear
discard a3c50e8 Fix dialog scrolling
discard a3d972f Update confirm modals for runs and tasks
discard 2566a74 confirm mark task failed/success
discard 9b246fb fix extra links, hide local TZ if UTC,
discard c3d2d95 download log bug fixes
discard 778b084 add extra links to TI details
discard 3cdb10b download logs and external logs
discard 07529d7 update TI and DR buttons
discard 0410c79 fix test with mock providers
discard 1a9e6f3 move ref and selection to providers
discard 86ff203 make UI and tree work with mapped tasks
add a66c072 Addressed some issues in the tutorial mentioned in discussion
#22233 (#22236)
add d6ed9cb Add support for private key in connection for Snowflake
(#22266)
add 06e1d74 Fixed issue generation to always include last release (#22265)
add 3452f7c Enhance `db upgrade` args (#22102)
add 6448b24 [FIX] typo doc of gcs operator (#22290)
add 9b63df8 Set queued_dttm when submitting task to directly to executor
(#22259)
add e93cd4b add a few more fields to the taskinstance finished log
message (#22262)
add e07bc63 Filter out default configs when overrides exist. (#21539)
add b00fc78 Fail with error when extending image with pip run as root
(#22292)
add 926f6d1 Add arguments to filter list: start_after_key, from_datetime,
to_datetime, object_filter callable (#22231)
add d010b0d Masking extras in GET /connections/<connection> endpoint
(#22227)
add cc92096 Operator for updating Databricks Repos (#22278)
add dadb132 Added Quick Algorithm Analytics to the list of companies
using Apache Airflow (#22279)
add 774ca08 Enable JSON serialization for connections (#19857)
add 3401804 Add test to run offline SQL generation in the CI (#22177)
add 14a2d9d add an option for run id in the ui trigger screen (#21851)
add df6058c Disable default_pool delete on web ui (#21658)
add 6d1d53b Add generic connection type (#22310)
add 7bd165f Remove RefreshConfiguration workaround for K8s token
refreshing (#20759)
add 4a1503b Add recipe for BeamRunGoPipelineOperator (#22296)
add 4f1dcdd Remove incorrect deprecation warning in secrets backend
(#22326)
add ecc5b74 Stronger language about Docker Compose customizability
(#22304)
add 0ec5677 adds ability to pass config params to postgres operator
(#21551)
add 1f7836e Add back celery intersphinx mapping (#22370)
add a8de170 Fix broken links to celery documentation (#22364)
add 6a01036 Patch sql_alchemy_conn if old postgres scheme used (#22333)
add 3b47f04 fix deprecation warning in test_default_views.py (#22346)
add 8840203 Add dataflow_default_options to templated_fields (#22367)
add 5eb6335 Update sample dag and doc for S3CreateBucketOperator,
S3PutBucketTaggingOperator, S3GetBucketTaggingOperator,
S3DeleteBucketTaggingOperator, S3DeleteBucketOperator (#22312)
add 87d363e Correctly handle task_id mangling during unmapping (#22355)
add f309ea7 Reduce DB load incurred by Stale DAG deactivation (#21399)
add 3bc0da3 Add documentation on specifying a DB schema. (#22347)
add 9372aab Add description on the vendoring process we use (#22204)
add 68aa019 Add cgroupspy to _vendor folder (#22206)
add 43dfec3 Expose try_number in airflow vars (#22297)
add a3ffbee Fix skipping non-GCS located jars (#22302)
add 172df9e Apply import fixes to vendored cgroupspy library (#22207)
add ab4ba6f Fix mistakenly added install_requires for all providers
(#22382)
add 76d6089 Fix python 3.10 support in vendored in cgroupspy (#22208)
add 3182ba2 Add map_index support to all task instance-related views
(#22272)
add 71c980a Add fk between xcom and task instance (#22334)
add 716b240 make UI and tree work with mapped tasks
add 107cffd move ref and selection to providers
add 2e36bf8 fix test with mock providers
add ba1d769 update TI and DR buttons
add 84f771b download logs and external logs
add 8a3cc5c add extra links to TI details
add d7b2ca7 download log bug fixes
add f0ed02c fix extra links, hide local TZ if UTC,
add 54b2f5b confirm mark task failed/success
add 2f5f4e1 Update confirm modals for runs and tasks
add c50cb55 Fix dialog scrolling
add b49395d Code cleanup and fix task clear
add 31c5324 Fix task/run label, dialog focus, dag details overflow, panel
open/close
add 171647e Add timezone provider
add 9266c76 Fix TimezoneEvent import
add 60445c4 Improve button UX
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (74fada2)
\
N -- N -- N refs/heads/mapped-task-drawer (60445c4)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/ci.yml | 4 +
Dockerfile | 8 +-
INTHEWILD.md | 1 +
LICENSE | 1 +
UPDATING.md | 4 +
airflow/_vendor/README.md | 37 +++
.../_vendor/cgroupspy/__init__.py | 23 +-
airflow/_vendor/cgroupspy/contenttypes.py | 155 ++++++++++
airflow/_vendor/cgroupspy/controllers.py | 324 ++++++++++++++++++++
airflow/_vendor/cgroupspy/interfaces.py | 339 +++++++++++++++++++++
airflow/_vendor/cgroupspy/nodes.py | 283 +++++++++++++++++
airflow/_vendor/cgroupspy/trees.py | 246 +++++++++++++++
airflow/_vendor/cgroupspy/utils.py | 69 +++++
airflow/_vendor/vendor.md | 3 +
airflow/api/common/experimental/pool.py | 2 +-
airflow/api_connexion/schemas/connection_schema.py | 20 +-
airflow/cli/cli_parser.py | 99 ++++--
airflow/cli/commands/connection_command.py | 164 ++++++----
airflow/cli/commands/db_command.py | 52 +++-
airflow/cli/commands/task_command.py | 64 ++--
airflow/config_templates/config.yml | 8 +
airflow/config_templates/default_airflow.cfg | 4 +
airflow/configuration.py | 79 +++++
airflow/dag_processing/manager.py | 43 ++-
airflow/dag_processing/processor.py | 11 -
airflow/decorators/base.py | 6 +-
airflow/jobs/scheduler_job.py | 6 +-
airflow/kubernetes/kube_client.py | 47 +--
airflow/kubernetes/refresh_config.py | 124 --------
...c306b5b5ae4a_switch_xcom_table_to_use_run_id.py | 8 +-
airflow/models/baseoperator.py | 7 +-
airflow/models/connection.py | 31 +-
airflow/models/mappedoperator.py | 5 +-
airflow/models/pool.py | 19 +-
airflow/models/taskinstance.py | 1 +
airflow/models/xcom.py | 43 +--
.../amazon/aws/example_dags/example_s3_bucket.py | 73 +++--
.../aws/example_dags/example_s3_bucket_tagging.py | 62 ----
airflow/providers/amazon/aws/hooks/s3.py | 59 +++-
airflow/providers/apache/beam/hooks/beam.py | 10 +-
.../providers/cncf/kubernetes/utils/pod_manager.py | 8 +-
.../example_dags/example_databricks_repos.py | 56 ++++
airflow/providers/databricks/hooks/databricks.py | 24 ++
.../databricks/operators/databricks_repos.py | 104 +++++++
airflow/providers/databricks/provider.yaml | 9 +
.../providers/google/cloud/operators/dataflow.py | 45 +--
airflow/providers/google/cloud/operators/gcs.py | 4 +-
.../postgres/example_dags/example_postgres.py | 11 +-
airflow/providers/postgres/operators/postgres.py | 23 +-
airflow/providers/snowflake/hooks/snowflake.py | 66 ++--
airflow/secrets/base_secrets.py | 70 ++++-
airflow/secrets/environment_variables.py | 18 +-
airflow/serialization/serialized_objects.py | 1 +
airflow/utils/db.py | 202 ++++++------
airflow/utils/log/secrets_masker.py | 2 +
airflow/utils/operator_helpers.py | 7 +
airflow/www/static/js/dag.js | 69 +++--
airflow/www/static/js/gantt.js | 3 +-
airflow/www/static/js/graph.js | 11 +-
.../static/js/tree/ResetRoot.jsx} | 41 +--
airflow/www/static/js/tree/Tree.jsx | 5 +-
airflow/www/static/js/tree/details/content/Dag.jsx | 4 +-
.../js/tree/details/content/dagRun/index.jsx | 2 +-
.../js/tree/details/content/taskInstance/index.jsx | 2 +-
airflow/www/templates/airflow/dag.html | 2 +
airflow/www/templates/airflow/task_instance.html | 20 +-
airflow/www/templates/airflow/trigger.html | 11 +-
airflow/www/utils.py | 17 +-
airflow/www/views.py | 102 ++++---
dev/provider_packages/SETUP_TEMPLATE.cfg.jinja2 | 3 -
dev/provider_packages/prepare_provider_packages.py | 2 +-
.../operators/s3.rst | 90 +++---
.../operators/repos_update.rst | 66 ++++
.../operators/run_now.rst | 2 +-
.../operators/postgres_operator_howto_guide.rst | 15 +-
.../connections/snowflake.rst | 3 +-
docs/apache-airflow/concepts/connections.rst | 2 +
docs/apache-airflow/executor/celery.rst | 4 +-
docs/apache-airflow/howto/connection.rst | 335 +++++++++-----------
docs/apache-airflow/howto/set-config.rst | 4 +
docs/apache-airflow/howto/set-up-database.rst | 10 +
docs/apache-airflow/img/connections.png | Bin 79451 -> 0 bytes
docs/apache-airflow/img/new_tutorial-3.png | Bin 0 -> 58198 bytes
docs/apache-airflow/start/docker.rst | 22 +-
docs/apache-airflow/tutorial.rst | 224 +++++++++-----
docs/apache-airflow/usage-cli.rst | 92 +++++-
docs/conf.py | 2 +-
docs/docker-stack/build.rst | 8 +-
.../{gcloud.Dockerfile => go-beam.Dockerfile} | 29 +-
docs/docker-stack/recipes.rst | 20 ++
docs/exts/docs_build/third_party_inventories.py | 2 +-
licenses/LICENSE-cgroupspy.txt | 27 ++
scripts/ci/libraries/_testing.sh | 50 +++
scripts/ci/testing/run_downgrade_test.sh | 48 +--
.../run_offline_sql_test.sh} | 16 +-
scripts/docker/pip | 15 +
setup.cfg | 1 +
setup.py | 2 +-
tests/always/test_connection.py | 46 +++
.../endpoints/test_connection_endpoint.py | 16 +
.../api_connexion/endpoints/test_xcom_endpoint.py | 91 +++---
tests/cli/commands/test_connection_command.py | 206 +++++++++----
tests/cli/commands/test_db_command.py | 84 ++++-
tests/core/test_configuration.py | 46 +++
tests/dag_processing/test_manager.py | 48 +++
tests/dag_processing/test_processor.py | 25 --
tests/dags/test_default_views.py | 2 +-
tests/kubernetes/test_client.py | 22 +-
tests/kubernetes/test_refresh_config.py | 106 -------
tests/models/test_pool.py | 6 +
tests/models/test_taskinstance.py | 63 +++-
tests/models/test_xcom.py | 330 +++++++++++---------
tests/providers/amazon/aws/hooks/test_base_aws.py | 4 +-
tests/providers/amazon/aws/hooks/test_s3.py | 12 +
tests/providers/apache/beam/hooks/test_beam.py | 21 +-
tests/providers/apache/hive/hooks/test_hive.py | 3 +
.../kubernetes/operators/test_kubernetes_pod.py | 3 +-
.../databricks/operators/test_databricks_repos.py | 64 ++++
.../google/cloud/operators/test_dataflow.py | 63 ++++
.../providers/postgres/operators/test_postgres.py | 15 +
tests/providers/snowflake/hooks/test_snowflake.py | 26 +-
tests/serialization/test_dag_serialization.py | 3 +
tests/utils/test_db.py | 107 ++-----
tests/utils/test_operator_helpers.py | 7 +-
tests/www/views/test_views_tasks.py | 31 ++
tests/www/views/test_views_trigger_dag.py | 21 +-
126 files changed, 4456 insertions(+), 1592 deletions(-)
create mode 100644 airflow/_vendor/README.md
copy licenses/LICENSE-flask-kerberos.txt =>
airflow/_vendor/cgroupspy/__init__.py (50%)
create mode 100644 airflow/_vendor/cgroupspy/contenttypes.py
create mode 100644 airflow/_vendor/cgroupspy/controllers.py
create mode 100644 airflow/_vendor/cgroupspy/interfaces.py
create mode 100644 airflow/_vendor/cgroupspy/nodes.py
create mode 100644 airflow/_vendor/cgroupspy/trees.py
create mode 100644 airflow/_vendor/cgroupspy/utils.py
create mode 100644 airflow/_vendor/vendor.md
delete mode 100644 airflow/kubernetes/refresh_config.py
delete mode 100644
airflow/providers/amazon/aws/example_dags/example_s3_bucket_tagging.py
create mode 100644
airflow/providers/databricks/example_dags/example_databricks_repos.py
create mode 100644 airflow/providers/databricks/operators/databricks_repos.py
copy airflow/{ui/src/components/SectionNavBtn.tsx =>
www/static/js/tree/ResetRoot.jsx} (57%)
create mode 100644
docs/apache-airflow-providers-databricks/operators/repos_update.rst
delete mode 100644 docs/apache-airflow/img/connections.png
create mode 100644 docs/apache-airflow/img/new_tutorial-3.png
copy docs/docker-stack/docker-images-recipes/{gcloud.Dockerfile =>
go-beam.Dockerfile} (55%)
create mode 100644 licenses/LICENSE-cgroupspy.txt
copy scripts/ci/{constraints/ci_generate_constraints.sh =>
testing/run_offline_sql_test.sh} (77%)
create mode 100644 scripts/docker/pip
delete mode 100644 tests/kubernetes/test_refresh_config.py
create mode 100644
tests/providers/databricks/operators/test_databricks_repos.py
