This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch python-3-11
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard 04638993de Attempt to add Python 3.11 support
add f35b41e753 Set proper extension for sdist files (#27414)
add 594c6eef69 Increase tolerance of failing heartbeat test (#27397)
add 1d25105189 Add case insensitive constraint to username (#27266)
add e38322f28b Move docker installation to inside the os_dependencies
script (#27411)
add 2db27c4a75 Remove upper-bound limit to dask (#27415)
add 219df18414 Add Swisscom to INTHEWILD.md (#27421)
add b29ca4e77d Move static checks to single-line ones (#27424)
add 6cb8f4a3fd Speed-up release management and shell Breeze commands on
Mac (#27426)
add c32ffb0006 Add stub 'yield' to BaseTrigger.run (#27416)
add 98bd9b3d6b Fix minor typo (#27431)
add 10d2a71073 Remove --force option of breeze self-upgrade from docs
(#27438)
add 0a4d117b47 Fix selective checks to run all python version tests on env
change (#27387)
add e38c05db94 Add classic examples for Python Operators (#27403)
add 8829e99907 Fix BaseOperator link (#27441)
add e92e921067 [BUMP] helm chart - redis 7 (#27443)
add f06b30d030 Add missing checkout in breeze-static-checks-only workflow
(#27452)
add 4cdea86d4c [DOC] fix K8S hook with KPO (#27445)
add 8975d7c8ff Fix jinja file inclusion in cncf.kubernetes provider
package (#27451)
add 2e6bbdcce3 allow pgbouncer replicas to be configurable (#27439)
add d39e3677f7 Update CONTRIBUTORS_QUICK_START.rst in terms of Docker
Engine (#27432)
add 79896191f6 Fix cleanup of multi-processing behaviour for pyc cleanup
(#27454)
add 9b0ff3b1f2 Fix backtracking helper/docs (#27455)
add eda0893348 Fix behavior of `_` when searching for DAGs (#27448)
add 9c6d2abb2d Activate debug logging in commands with --verbose option
(#27447)
add 1a3f7857f5 Pass kwargs from vault hook to hvac client (#26680)
add a3bfa25e67 Allow setting client tags for trino connection (#27213)
add aa36f754e2 Move cleanup_generated_files up in release commend (#27459)
add 8f5e100f30 Document that KubernetesExecutor overwrites container args
(#27450)
add 63638cd216 SLAMiss is nullable and not always given back when pulling
task instances (#27423)
add 1d20bd9f23 Fix dimensions for datasets page (#27355)
add eb47c42d6b Add note about pushing the lazy XCom proxy to XCom (#27250)
add 680965b2ea Look for `extra__` instead of `extra_` in `get_field`
(#27489)
add 104ce1e7d8 Fix wording in DAG Runs description(#27470)
add 3aadc44a13 Remove unused backcompat method in k8s hook (#27490)
add f67845acc2 make tests run faster (#27492)
add 531f2d2116 Code quality improvements on sagemaker operators/hook
(#27453)
add 606bd9ea5e Ignore Black commit from blame (#27497)
add 265484dcc4 Deduplicate type hints (#27508)
add 52e90c45c4 Update INTHEWILD.md (#27510)
add 59da943428 Suppress any Exception in wasb task handler (#27495)
add 9337aa92c0 Remove support for node_selectors param in KPO (#27515)
add 701239abc3 Remove deprecated backcompat objects for KPO (#27518)
add 20ecefa416 KPO should use hook's get namespace method to get namespace
(#27516)
add fb42f38995 fix internal links in static code checks rst (#27513)
add c185752b1a Strenghten a bit and clarify importance of triaging issues
(#27262)
add 2a4f81c178 Update index.rst (#27529)
add a16f24b5d7 Remove deprecated classes in Azure provider (#27417)
add 2462d57ecc Move TriggerDagRun conf check to execute (#27035)
add 5cd78cf425 Upgrade dependencies in order to avoid backtracking (#27531)
add b2c7b64db8 Move conditional in CI "quick-image" to the job itself
(#27530)
add 194763867c Increase time for constraints generation (#27534)
add a50195d617 Add azure, google, authentication library limits to eaager
upgrade (#27535)
add cfd63df786 Adding sensor decorator (#22562)
add dc760b45ea SSHOperator ignores cmd_timeout (#27182) (#27184)
add 7aeaee93d1 Add JSON format example for Amazon Web Services Connection
(#27496)
add 8458fec1c9 Add warning if connection type already registered within
the provider (#27520)
add 96a5a63b0f Update cluster-policies.rst docs (#27362)
add 62b7bd6095 Coerce LazyXComAccess to list when pushed to XCom (#27251)
add d479b99388 Fix typo in redshift sql hook get_ui_field_behaviour
(#27533)
add 12420571f4 added contributors (#26950)
add 7297892558 Remove unnecessary newlines around single arg in signature
(#27525)
add fc59b02cfa Fix sqlalchemy primary key black-out error on DDRQ (#27538)
add baf2f3fc32 Move validation `branch_task_ids` into `SkipMixin` (#27434)
add 6307dc1acd Synchronize eager upgrade limits in all places where they
are used (#27539)
add 8c15b0a6d1 Use log.exception where more economical than log.error
(#27517)
add 199359bb38 Use non-deprecated method for on_kill in BigQueryHook
(#27547)
add eee3df4570 Improve task_id to pod name conversion (#27524)
add 25d7ca918e Correct timer units to seconds from milliseconds. (#27360)
add ada0f13a2a Add disable retry flag on backfill (#23829)
add f304df7857 Fix getting the dag/task ids from base executor (#27550)
add a691ab56a6 Add new Compute Engine Operators and fix system tests
(#25608)
add 98a9c574e3 set project_id and location when canceling BigQuery job
(#27521)
add 8f152a102b Apply log formatter on every ouput line in SSHOperator
(#27442)
add 4dc9b1c592 Sagemaker hook: remove extra call at the end when waiting
for completion (#27551)
add 2d2f0daad6 Fix KubernetesHook fail on an attribute absence (#25787)
add 9409293514 Display parameter values from serialized dag in trigger dag
view. (#27482)
add 6434b57708 Add the default None when pop actions (#27537)
add 9936d61f7b Bump loader-utils from 1.4.0 to 1.4.1 in /airflow/www
(#27552)
add 409a4de858 Add linkedin to INTHEWILD.md (#27562)
add aefadb8c5b Allow xcom sidecar container image to be configurable in
KPO (#26766)
add 47a2b9ee7f Add container_resources as KubernetesPodOperator
templatable (#27457)
add ed92e5d521 Fix mini scheduler expansion of mapped task (#27506)
add e84c032cec Separate dataset deps into individual graphs (#27356)
add 2ac45b011d Remove self.using_mysql attribute (#27571)
add b33d22c224 Replace FAB url filtering function with Airflows (#27576)
add 21063267fd Chart: add hostaliases to pod template file (#27544)
add b423869440 Init all Airflow routes when testing API (#27586)
add a16aa73068 Expand tasks in mapped group at parse time (#27158)
add 01a819a42d Enable python string normalization everywhere (#27588)
add bb6fce3138 Change host to endpoint_url in amazon remote logging docs
(#27572)
add a504a8267d Add ipc_mode for DockerOperator (#27553)
add 34e21ea3e4 External task sensor fail fix (#27190)
add 59e3198f7e Change dataprep system tests assets (#26488)
add d7d206137b PostgresHook: Added ON CONFLICT DO NOTHING statement when
all target fields are primary keys (#26661)
add 2ef15c5da0 Add default name to EMR Serverless jobs (#27458)
add a5c0aeb566 Add info about JSON Connection format for AWS SSM Parameter
Store Secrets Backend (#27134)
add 504286bf73 Cleanup backcompat code kpo (#27526)
add 85ec17fbe1 remove unused code.html (#27585)
add 933fefca27 Fix double logging with some task logging handler (#27591)
add dff35c6bd8 Drop support for PostgreSQL 10 (#27594)
add 547e6e80f3 Fix Azure Batch errors revealed by added typing to azure
batch lib (#27601)
add b609c119f4 Fix failing tests for Azure Batch (#27606)
add 3e3ff7ce52 Fix test hooks also for Azure Batch (#27607)
add 9345953568 Only run mypy/flake static tests for providers in main
branch (#27608)
add f919abc918 Fix backwards compatibility for RedshiftSQLOperator (#27602)
add e8ab8ccc0e Add backward compatibility with old versions of Apache Beam
(#27263)
add 9f9ab30218 SagemakerProcessingOperator stopped honoring
`existing_jobs_found` (#27456)
add eb06c65556 Use new job search API for triggering Databricks job by
name (#27446)
add 3aed495f50 Rename hook bigquery function `_bq_cast` to `bq_cast`
(#27543)
add c490a328f4 CloudWatch task handler doesn't fall back to local logs
when Amazon CloudWatch logs aren't found (#27564)
add 0a059eea67 sagemaker operators: mutualize init of aws_conn_id (#27579)
add 1059de6294 Dataform operators, links, update system tests and docs
(#27144)
add cc4cde987c Add max_wait for exponential_backoff in BaseSensor (#27597)
add 16b100169d Make Kubernetes Executor & Scheduler resilient to error
during PMH execution (#27611)
add e4bba54044 add dag parsed time in DAG view (#27573)
add a127d7fac1 Bump hadolint to 2.12.0 (#27621)
add 52593b061c Enable template rendering for env_vars field for the
@task.kubernetes decorator (#27433)
add d6cb70331f Add workeer log-groomer-sidecar enable option in helm chart
(#27178)
add 1d4fd5c6ea The pinot-admin.sh command is now hard-coded. (#27641)
add fc7b95d44d Add Pierre to committers list (#27643)
add 9358928815 Remove custom spark home and custom binarires for spark
(#27646)
add be8a62e596 Pig cli connection properties cannot be passed by
connection extra (#27644)
add cc571e8e0e Add nodePort declaration to chart/values.schema.json
(#26945)
add fb9e5e612e Add extraVolumeMounts to sidecars too (#27420)
add 65b78b7dbd Add new files to parsing queue on every loop of dag
processsing (#27060)
add 449a9b8e53 bump alembic minimum version (#27629)
add 150dd927c3 Filter out invalid schemas in Hive hook (#27647)
add f564d650da Fix static check coming from merging pre-normalization
change (#27651)
add f2790f6c80 Implement extra controls for SLAs (#27557)
add 40f98b2cef Fix quotes resulting from merging cross-commit (#27662)
add f816c1d290 Enable copying DagRun JSON to clipboard (#27639)
add 93699a30bd Airflow 2.4.3 has been released (#27664)
add 00af5c007e Replace urlparse with urlsplit (#27389)
add 221936cb00 Chart: Update default airflow version to 2.4.3 (#27668)
add 3ae98b824d Use unused SQLCheckOperator.parameters in
SQLCheckOperator.execute. (#27599)
add 48c210871c Continue on exception when retrieving metadata (#27665)
add 12c3c39d1a pRepare docs for November 2022 wave of Providers (#27613)
add 45b4d35a0c Fix typo in glue test example code (#27673)
add d24ea25574 Update CONTRIBUTORS_QUICK_START.rst for breeze and
pre-commit (#27685)
add c20c3f01ca Update production-deployment.rst (#27686)
add b9861f07bf Correct repo example for cloning via ssh (#27671)
add d0d7693a3b Disable nested task mapping for now (#27681)
add c9c257d18e Update build.rst for docker compose and helm chart (#27677)
add 4637c9ed5c Avoid re-fetching DAG run in TriggerDagRunOperator (#27635)
add 911d90d669 Migrate Dataflow system tests (#27375)
add 99a6bf7834 Fix ExternalTaskSensor cant check zipped dag (#27056)
add ddbc758540 Deferrable mode for BigQueryToGCSOperator (#27683)
add 52bcb7986c Adding new user to Cloudera (#27703)
add 43bb995210 Bump loader-utils from 1.4.1 to 1.4.2 in /airflow/www
(#27697)
add 7c9b1ee45b update jinja2 2.10 to 2.11.3 (#27713)
add dc03b9081f Add user comment to task instance and dag run (#26457)
add 92389cf090 Handle json encoding of V1Pod in task callback (#27609)
add bee0351f79 Bump minimatch from 3.0.4 to 3.0.8 in /airflow/www (#27688)
add fd839bbf33 Chart: Decrease default gitSync wait (#27625)
add c609477260 Implements SqlToSlackApiFileOperator (#26374)
add 7cfa1be467 Completed D400 for multiple folders (#27722)
add 0cb6450d6d Persist DataprocLink for workflow operators regardless of
job status (#26986)
add e56adc8e41 Add _serialize_cell method to TrinoHook and PrestoHook
(#27724)
add 9b025e4467 Completed D400 & D401 for airflow/api/* directory (#27716)
add 24903eb9d8 Update API & Python Client versions (#27642)
add bc0063af99 Fix to read location parameter properly in
BigQueryToBigQueryOperator (#27661)
add 5ce9c827f7 Fix clearing child dag mapped tasks from parent dag (#27501)
add 80ae49ef8d Add expanded_ti_count to ti context (#27680)
add 2063e141e4 Handle transient state errors in
`RedshiftResumeClusterOperator` and `RedshiftPauseClusterOperator` (#27276)
add 610f57fdd1 Improve "sensor timeout" messaging (#27733)
add 325b88603a Completed D400 for airflow/lineage/* directory (#27732)
add 26318774ec Completed D400 for airflow/listener/* directory (#27731)
add 0918223913 Completed D400 for airflow/api_connexion/* directory
(#27718)
add 2ad151389c Improve task deadlock messaging (#27734)
add e9d618f0c1 Allow datasets to be used in taskflow (#27540)
add b717853e4c scheduler_job, add metric for scheduler loop timer (#27605)
add 2bba98f109 Use Boto waiters instead of customer _await_status method
for RDS Operators (#27410)
add de99cd97fe Fix formatting leftovers (#27750)
add 239440df23 System Test for EMR (AIP-47) (#27286)
add 63927cb9e7 Make custom env vars optional for job templates (#27148)
add 9a1d24d8db Replace helm chart icon (#27704)
add 83dc604650 Allow SSL mode in MySQL provider (#27717)
add 7ea8475128 completed D400 for airflow/callbacks/* airflow/cli/*
(#27721)
add 65bfea2a20 reset commits, clean submodules (#27560)
add 31f34e9928 Expand tasks in mapped group at run time (#27491)
add 083e71c725 Align TaskGroup semantics to AbstractOperator (#27723)
add 2d19dddd8d Limit the full tests to representative items in
Python/Backend matrix (#27754)
add 355b008043 [FEATURE] add postgres 15 support (#27444)
add 5004dacbe8 Use context managers to simplify log serve management
(#27756)
add edf3ce6884 simplify notes accordion test (#27757)
add 973406b090 Fix typing problem revealed after recent Neo4J release
(#27759)
add 49471b097e Typescript files are also now triggering UI/WWW tests
(#27760)
add b2a88fda09 Add: #23880 :: Audit log for
AirflowModelViews(Variables/Connection) (#24079)
add 49cfb6498e Replace `unittests` in microsoft providers tests by pure
`pytest` [Wave-4] (#27735)
add 640d4f9636 Fix backfill queued task getting reset to scheduled
state. (#23720)
add 9bad850a21 optimise task instances filtering (#27102)
add e90241a56d Add critical section query duration metric (#27700)
add f5132681dc Completed D400 for multiple folders (#27748)
add 3b582bc75d Sync context.py with context.pyi (#27770)
add 80cab102cb Fix a deprecation warning related to
airflow.utils.helpers.chain (#27769)
add bede4247b0 Unify "full tests needed" and "run everything" in CI
(#27761)
add 6bc05671db Fixups of small mistakes in release providers documentation
(#27773)
add 5890b083b1 Document dag_file_processor_timeouts metric as deprecated
(#27067)
add 0438628ffd Allow hyphens in pod id used by k8s executor (#27737)
add 8b1ebdacd8 Fix doc strings for bigquery tests (#27794)
add d233c12c30 Fix menu border color (#27789)
add 263387aa4b Clear TaskGroup (#26658)
add d74c507a8f Installation instruction to use Colima instead of Docker
Desktop (#27804)
add 8a8ad4719a Add logic for XComArg to pull specific map indexes (#27771)
add 72b1c2fb0c Optimize TI.xcom_pull() with explicit task_ids and
map_indexes (#27699)
add 7e19647a7c Add a missing space in a print of initialize_virtualenv.py
(#27793)
add d8dbdccef7 Make views requiring session, keyword only args (#27790)
add b9729d9e46 Don't explicitly set include_examples to False on task run
command (#27813)
add 9c00985849 Instruct users to upgrade docker-desktop instead of work
around (#27809)
add 0cf3cb1a49 Improve TriggerRuleDep typing and readability (#27810)
add 2aaccafe9c Metric for raw task return codes (#27155)
add 093345cb61 Switch (back) to late imports (#27730)
add 9bae03137a Add CI step to run prepare provider documentation. (#27832)
add aaf5fd6fd8 Add better diagnostics in case of outdated images for
pre-commits (#27835)
add 035315f5cf Add DagRun state change to the Listener plugin
system(#27113)
add 336e065e6a Correct job name matching in SagemakerProcessingOperator
(#27634)
add 0b0d2990fd Make DagRun state updates for paused DAGs faster (#27725)
add dbb4b59dcb Restore removed (but used) methods in common.sql (#27843)
add fb7c6afc8c Use virtual env python in the script shebang of
retag_docker_images.py (#27857)
add 1486afdc9f UI: Update offset height if data changes (#27865)
add 734d156616 Fix old-style typing in Base Sensor (#27871)
add 68ee3bf44b Fix new warning appearing after new
snowflake-connector-python (#27870)
add a343bba1e3 Fix templating fields and do_xcom_push in
DatabricksSQLOperator (#27868)
add 5111e78492 Attempt to add Python 3.11 support
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (04638993de)
\
N -- N -- N refs/heads/python-3-11 (5111e78492)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.git-blame-ignore-revs | 3 +
.github/ISSUE_TEMPLATE/airflow_bug_report.yml | 2 +-
.github/ISSUE_TEMPLATE/feature_request.yml | 24 +-
.github/actions/configure-aws-credentials | 2 +-
.github/workflows/ci.yml | 27 +-
.pre-commit-config.yaml | 21 +-
BREEZE.rst | 20 +-
COMMITTERS.rst | 7 +-
CONTRIBUTORS_QUICK_START.rst | 45 +-
Dockerfile | 28 +-
Dockerfile.ci | 32 +-
IMAGES.rst | 2 +-
INTHEWILD.md | 5 +-
ISSUE_TRIAGE_PROCESS.rst | 123 +-
README.md | 15 +-
RELEASE_NOTES.rst | 48 +-
STATIC_CODE_CHECKS.rst | 8 +-
airflow/__init__.py | 18 +-
airflow/__main__.py | 8 +-
airflow/api/__init__.py | 6 +-
airflow/api/auth/backend/basic_auth.py | 8 +-
airflow/api/auth/backend/default.py | 6 +-
airflow/api/auth/backend/deny_all.py | 6 +-
airflow/api/auth/backend/kerberos_auth.py | 22 +-
airflow/api/auth/backend/session.py | 6 +-
airflow/api/client/__init__.py | 12 +-
airflow/api/client/api_client.py | 2 +-
airflow/api/client/json_client.py | 52 +-
airflow/api/client/local_client.py | 2 +-
airflow/api/common/delete_dag.py | 8 +-
airflow/api/common/experimental/__init__.py | 8 +-
.../api/common/experimental/get_dag_run_state.py | 2 +-
airflow/api/common/experimental/get_dag_runs.py | 16 +-
airflow/api/common/experimental/get_lineage.py | 4 +-
airflow/api/common/experimental/get_task.py | 2 +-
.../api/common/experimental/get_task_instance.py | 3 +-
airflow/api/common/mark_tasks.py | 53 +-
airflow/api/common/trigger_dag.py | 13 +-
airflow/api_connexion/endpoints/config_endpoint.py | 28 +-
.../api_connexion/endpoints/connection_endpoint.py | 52 +-
airflow/api_connexion/endpoints/dag_endpoint.py | 22 +-
.../api_connexion/endpoints/dag_run_endpoint.py | 53 +-
.../api_connexion/endpoints/dag_source_endpoint.py | 12 +-
.../endpoints/dag_warning_endpoint.py | 2 +-
.../api_connexion/endpoints/dataset_endpoint.py | 14 +-
.../api_connexion/endpoints/event_log_endpoint.py | 6 +-
.../api_connexion/endpoints/extra_link_endpoint.py | 2 +-
airflow/api_connexion/endpoints/health_endpoint.py | 2 +-
.../endpoints/import_error_endpoint.py | 10 +-
airflow/api_connexion/endpoints/log_endpoint.py | 14 +-
airflow/api_connexion/endpoints/plugin_endpoint.py | 2 +-
airflow/api_connexion/endpoints/pool_endpoint.py | 12 +-
.../api_connexion/endpoints/provider_endpoint.py | 2 +-
airflow/api_connexion/endpoints/request_dict.py | 1 +
.../endpoints/role_and_permission_endpoint.py | 22 +-
airflow/api_connexion/endpoints/task_endpoint.py | 4 +-
.../endpoints/task_instance_endpoint.py | 120 +-
airflow/api_connexion/endpoints/user_endpoint.py | 16 +-
.../api_connexion/endpoints/variable_endpoint.py | 34 +-
.../api_connexion/endpoints/version_endpoint.py | 4 +-
airflow/api_connexion/endpoints/xcom_endpoint.py | 10 +-
airflow/api_connexion/exceptions.py | 14 +-
airflow/api_connexion/openapi/v1.yaml | 148 +-
airflow/api_connexion/parameters.py | 14 +-
airflow/api_connexion/schemas/common_schema.py | 22 +-
airflow/api_connexion/schemas/config_schema.py | 12 +-
airflow/api_connexion/schemas/connection_schema.py | 16 +-
airflow/api_connexion/schemas/dag_run_schema.py | 30 +-
airflow/api_connexion/schemas/dag_schema.py | 38 +-
airflow/api_connexion/schemas/dag_source_schema.py | 2 +-
.../api_connexion/schemas/dag_warning_schema.py | 8 +-
airflow/api_connexion/schemas/dataset_schema.py | 32 +-
airflow/api_connexion/schemas/enum_schemas.py | 4 +-
airflow/api_connexion/schemas/error_schema.py | 8 +-
airflow/api_connexion/schemas/event_log_schema.py | 12 +-
airflow/api_connexion/schemas/health_schema.py | 8 +-
airflow/api_connexion/schemas/job_schema.py | 4 +-
airflow/api_connexion/schemas/log_schema.py | 4 +-
airflow/api_connexion/schemas/plugin_schema.py | 6 +-
airflow/api_connexion/schemas/pool_schema.py | 8 +-
.../schemas/role_and_permission_schema.py | 26 +-
airflow/api_connexion/schemas/sla_miss_schema.py | 4 +-
.../api_connexion/schemas/task_instance_schema.py | 36 +-
airflow/api_connexion/schemas/task_schema.py | 10 +-
airflow/api_connexion/schemas/trigger_schema.py | 4 +-
airflow/api_connexion/schemas/user_schema.py | 12 +-
airflow/api_connexion/schemas/variable_schema.py | 4 +-
airflow/api_connexion/schemas/version_schema.py | 2 +-
airflow/api_connexion/schemas/xcom_schema.py | 10 +-
airflow/api_connexion/security.py | 2 +-
airflow/callbacks/callback_requests.py | 16 +-
airflow/cli/cli_parser.py | 922 +++++----
airflow/cli/commands/celery_command.py | 75 +-
airflow/cli/commands/config_command.py | 10 +-
airflow/cli/commands/connection_command.py | 115 +-
airflow/cli/commands/dag_command.py | 56 +-
airflow/cli/commands/dag_processor_command.py | 16 +-
airflow/cli/commands/db_command.py | 42 +-
airflow/cli/commands/info_command.py | 32 +-
airflow/cli/commands/jobs_command.py | 2 +-
airflow/cli/commands/kerberos_command.py | 6 +-
airflow/cli/commands/kubernetes_command.py | 38 +-
airflow/cli/commands/legacy_commands.py | 2 +-
airflow/cli/commands/plugins_command.py | 2 +-
airflow/cli/commands/pool_command.py | 20 +-
airflow/cli/commands/provider_command.py | 26 +-
airflow/cli/commands/role_command.py | 22 +-
airflow/cli/commands/rotate_fernet_key_command.py | 4 +-
airflow/cli/commands/scheduler_command.py | 48 +-
airflow/cli/commands/standalone_command.py | 36 +-
airflow/cli/commands/sync_perm_command.py | 8 +-
airflow/cli/commands/task_command.py | 62 +-
airflow/cli/commands/triggerer_command.py | 6 +-
airflow/cli/commands/user_command.py | 74 +-
airflow/cli/commands/variable_command.py | 22 +-
airflow/cli/commands/version_command.py | 4 +-
airflow/cli/commands/webserver_command.py | 119 +-
airflow/cli/simple_table.py | 14 +-
airflow/config_templates/airflow_local_settings.py | 348 ++--
airflow/config_templates/default_celery.py | 76 +-
.../config_templates/default_webserver_config.py | 2 +-
airflow/configuration.py | 569 +++---
airflow/dag_processing/manager.py | 97 +-
airflow/dag_processing/processor.py | 28 +-
airflow/datasets/__init__.py | 18 +-
airflow/datasets/manager.py | 17 +-
airflow/decorators/__init__.py | 3 +
airflow/decorators/__init__.pyi | 43 +-
airflow/decorators/base.py | 60 +-
airflow/decorators/branch_python.py | 7 +-
airflow/decorators/external_python.py | 6 +-
airflow/decorators/python.py | 6 +-
airflow/decorators/python_virtualenv.py | 6 +-
airflow/decorators/sensor.py | 74 +
airflow/decorators/short_circuit.py | 6 +-
airflow/decorators/task_group.py | 21 +-
airflow/example_dags/example_bash_operator.py | 18 +-
.../example_branch_datetime_operator.py | 30 +-
.../example_branch_day_of_week_operator.py | 8 +-
airflow/example_dags/example_branch_operator.py | 14 +-
.../example_branch_operator_decorator.py | 12 +-
.../example_branch_python_dop_operator_3.py | 14 +-
airflow/example_dags/example_complex.py | 2 +-
airflow/example_dags/example_dag_decorator.py | 14 +-
airflow/example_dags/example_datasets.py | 56 +-
.../example_external_task_marker_dag.py | 14 +-
.../example_dags/example_kubernetes_executor.py | 24 +-
airflow/example_dags/example_latest_only.py | 8 +-
.../example_latest_only_with_trigger.py | 14 +-
.../example_local_kubernetes_executor.py | 16 +-
.../example_passing_params_via_test_command.py | 6 +-
airflow/example_dags/example_python_operator.py | 51 +-
...mple_sla_dag.py => example_sensor_decorator.py} | 64 +-
airflow/example_dags/example_sensors.py | 34 +-
.../example_short_circuit_decorator.py | 6 +-
.../example_dags/example_short_circuit_operator.py | 12 +-
airflow/example_dags/example_skip_dag.py | 16 +-
airflow/example_dags/example_sla_dag.py | 2 +-
airflow/example_dags/example_subdag_operator.py | 18 +-
airflow/example_dags/example_task_group.py | 6 +-
.../example_dags/example_task_group_decorator.py | 10 +-
.../example_dags/example_trigger_controller_dag.py | 2 +-
airflow/example_dags/example_trigger_target_dag.py | 4 +-
airflow/example_dags/example_xcom.py | 18 +-
airflow/example_dags/example_xcomargs.py | 6 +-
airflow/example_dags/subdags/subdag.py | 4 +-
airflow/example_dags/tutorial.py | 28 +-
airflow/example_dags/tutorial_dag.py | 28 +-
airflow/example_dags/tutorial_taskflow_api.py | 2 +-
.../tutorial_taskflow_api_virtualenv.py | 4 +-
airflow/exceptions.py | 25 +-
airflow/executors/base_executor.py | 12 +-
airflow/executors/celery_executor.py | 40 +-
airflow/executors/celery_kubernetes_executor.py | 2 +-
airflow/executors/dask_executor.py | 14 +-
airflow/executors/executor_loader.py | 18 +-
airflow/executors/kubernetes_executor.py | 180 +-
airflow/executors/local_kubernetes_executor.py | 2 +-
airflow/hooks/__init__.py | 94 +-
airflow/hooks/base.py | 8 +-
airflow/hooks/filesystem.py | 4 +-
airflow/hooks/subprocess.py | 28 +-
airflow/jobs/backfill_job.py | 47 +-
airflow/jobs/base_job.py | 31 +-
airflow/jobs/local_task_job.py | 73 +-
airflow/jobs/scheduler_job.py | 153 +-
airflow/jobs/triggerer_job.py | 16 +-
airflow/kubernetes/kube_client.py | 18 +-
airflow/kubernetes/kube_config.py | 50 +-
airflow/kubernetes/kubernetes_helper_functions.py | 42 +-
airflow/kubernetes/pod_generator.py | 78 +-
airflow/kubernetes/pod_generator_deprecated.py | 40 +-
airflow/kubernetes/pod_launcher_deprecated.py | 58 +-
airflow/kubernetes/secret.py | 16 +-
airflow/lineage/__init__.py | 57 +-
airflow/lineage/backend.py | 6 +-
airflow/lineage/entities.py | 14 +-
airflow/listeners/events.py | 10 +-
airflow/listeners/listener.py | 16 +-
.../{api_connexion => listeners/spec}/__init__.py | 0
.../default.py => listeners/spec/dagrun.py} | 27 +-
.../smooth.py => listeners/spec/lifecycle.py} | 29 +-
.../listeners/{spec.py => spec/taskinstance.py} | 0
airflow/logging_config.py | 32 +-
airflow/macros/__init__.py | 10 +-
airflow/macros/hive.py | 16 +-
airflow/migrations/db_types.py | 2 +-
airflow/migrations/env.py | 4 +-
airflow/migrations/utils.py | 2 +-
.../versions/0001_1_5_0_current_schema.py | 328 +--
.../versions/0002_1_5_0_create_is_encrypted.py | 18 +-
.../versions/0003_1_5_0_for_compatibility.py | 6 +-
.../0004_1_5_0_more_logging_into_task_isntance.py | 14 +-
.../versions/0005_1_5_2_job_id_indices.py | 10 +-
.../versions/0006_1_6_0_adding_extra_to_log.py | 10 +-
.../migrations/versions/0007_1_6_0_add_dagrun.py | 28 +-
.../versions/0008_1_6_0_task_duration.py | 8 +-
.../versions/0009_1_6_0_dagrun_config.py | 10 +-
.../0010_1_6_2_add_password_column_to_user.py | 10 +-
.../versions/0011_1_6_2_dagrun_start_end.py | 14 +-
...7_0_add_notification_sent_column_to_sla_miss.py | 10 +-
..._1_7_0_add_a_column_to_track_the_encryption_.py | 10 +-
...4_1_7_0_add_is_encrypted_column_to_variable_.py | 10 +-
.../versions/0015_1_7_1_rename_user_table.py | 10 +-
.../versions/0016_1_7_1_add_ti_state_index.py | 10 +-
.../0017_1_7_1_add_task_fails_journal_table.py | 26 +-
.../versions/0018_1_7_1_add_dag_stats_table.py | 20 +-
...1_7_1_add_fractional_seconds_to_mysql_tables.py | 104 +-
.../versions/0020_1_7_1_xcom_dag_task_indices.py | 10 +-
.../0021_1_7_1_add_pid_field_to_taskinstance.py | 10 +-
..._7_1_add_dag_id_state_index_on_dag_run_table.py | 10 +-
..._1_8_2_add_max_tries_column_to_task_instance.py | 14 +-
..._1_8_2_make_xcom_value_column_a_large_binary.py | 10 +-
.../versions/0025_1_8_2_add_ti_job_id_index.py | 10 +-
.../0026_1_8_2_increase_text_size_for_mysql.py | 10 +-
.../0027_1_10_0_add_time_zone_awareness.py | 2 +-
...1_10_0_add_kubernetes_resource_checkpointing.py | 6 +-
..._1_10_0_add_executor_config_to_task_instance.py | 6 +-
...0_1_10_0_add_kubernetes_scheduler_uniqueness.py | 6 +-
.../migrations/versions/0031_1_10_0_merge_heads.py | 6 +-
.../0032_1_10_0_fix_mysql_not_null_constraint.py | 22 +-
.../versions/0033_1_10_0_fix_sqlite_foreign_key.py | 46 +-
.../versions/0034_1_10_0_index_taskfail.py | 10 +-
.../versions/0035_1_10_2_add_idx_log_dag.py | 10 +-
.../0036_1_10_2_add_index_to_taskinstance.py | 10 +-
.../0037_1_10_2_add_task_reschedule_table.py | 40 +-
.../versions/0038_1_10_2_add_sm_dag_index.py | 10 +-
.../versions/0039_1_10_2_add_superuser_field.py | 10 +-
.../versions/0040_1_10_3_add_fields_to_dag.py | 14 +-
.../0041_1_10_3_add_schedule_interval_to_dag.py | 10 +-
..._1_10_3_task_reschedule_fk_on_cascade_delete.py | 32 +-
...3_1_10_4_make_taskinstance_pool_not_nullable.py | 26 +-
.../0044_1_10_7_add_serialized_dag_table.py | 24 +-
.../versions/0045_1_10_7_add_root_dag_id_to_dag.py | 14 +-
...0_5_change_datetime_to_datetime2_6_on_mssql_.py | 214 +-
.../0047_1_10_4_increase_queue_name_size_limit.py | 14 +-
.../versions/0048_1_10_3_remove_dag_stat_table.py | 18 +-
.../migrations/versions/0049_1_10_7_merge_heads.py | 6 +-
...10_7_increase_length_for_connection_password.py | 14 +-
.../versions/0051_1_10_8_add_dagtags_table.py | 20 +-
..._10_10_add_pool_slots_field_to_task_instance.py | 10 +-
...0_10_add_rendered_task_instance_fields_table.py | 18 +-
.../versions/0054_1_10_10_add_dag_code_table.py | 28 +-
..._11_add_precision_to_execution_date_in_mysql.py | 10 +-
...10_12_add_dag_hash_column_to_serialized_dag_.py | 12 +-
.../versions/0057_1_10_13_add_fab_tables.py | 150 +-
...1_10_13_increase_length_of_fab_ab_view_menu_.py | 12 +-
.../versions/0059_2_0_0_drop_user_and_chart.py | 78 +-
.../0060_2_0_0_remove_id_column_from_xcom.py | 38 +-
.../0061_2_0_0_increase_length_of_pool_name.py | 14 +-
.../versions/0062_2_0_0_add_dagrun_run_type.py | 4 +-
.../0063_2_0_0_set_conn_type_as_non_nullable.py | 2 +-
.../0064_2_0_0_add_unique_constraint_to_conn_id.py | 10 +-
.../0065_2_0_0_update_schema_for_smart_sensor.py | 56 +-
.../0066_2_0_0_add_queued_by_job_id_to_ti.py | 14 +-
.../0067_2_0_0_add_external_executor_id_to_ti.py | 14 +-
.../0068_2_0_0_drop_kuberesourceversion_and_.py | 6 +-
...2_0_0_add_scheduling_decision_to_dagrun_and_.py | 56 +-
...0_fix_mssql_exec_date_rendered_task_instance.py | 28 +-
.../0071_2_0_0_add_job_id_to_dagrun_table.py | 10 +-
...072_2_0_0_add_k8s_yaml_to_rendered_templates.py | 10 +-
.../versions/0073_2_0_0_prefix_dag_permissions.py | 38 +-
.../0074_2_0_0_resource_based_permissions.py | 10 +-
...75_2_0_0_add_description_field_to_connection.py | 16 +-
..._0_0_fix_description_field_in_connection_to_.py | 20 +-
...2_0_0_change_field_in_dagcode_to_mediumtext_.py | 8 +-
..._2_0_1_remove_can_read_permission_on_config_.py | 10 +-
...0_2_increase_size_of_connection_extra_field_.py | 14 +-
.../0080_2_0_2_change_default_pool_slots_to_1.py | 14 +-
.../0081_2_0_2_rename_last_scheduler_run_column.py | 22 +-
..._1_0_increase_pool_name_size_in_taskinstance.py | 24 +-
...0083_2_1_0_add_description_field_to_variable.py | 14 +-
..._1_0_resource_based_permissions_for_default_.py | 10 +-
...5_2_1_3_add_queued_at_column_to_dagrun_table.py | 12 +-
..._1_4_add_max_active_runs_column_to_dagmodel_.py | 24 +-
..._2_1_4_add_index_on_state_dag_id_for_queued_.py | 14 +-
.../0088_2_2_0_improve_mssql_compatibility.py | 76 +-
...89_2_2_0_make_xcom_pkey_columns_non_nullable.py | 18 +-
..._2_0_rename_concurrency_column_in_dag_table_.py | 18 +-
.../0091_2_2_0_add_trigger_table_and_task_info.py | 48 +-
...ta_interval_start_end_to_dagmodel_and_dagrun.py | 2 +-
.../0093_2_2_0_taskinstance_keyed_to_dagrun.py | 316 +--
...2_3_add_has_import_errors_column_to_dagmodel.py | 12 +-
.../versions/0095_2_2_4_add_session_table_to_db.py | 20 +-
.../0096_2_2_4_adding_index_for_dag_id_in_job.py | 10 +-
..._2_3_0_increase_length_of_email_and_username.py | 66 +-
...098_2_3_0_added_timetable_description_column.py | 20 +-
...9_2_3_0_add_task_log_filename_template_model.py | 2 +-
...2_3_0_add_taskmap_and_map_id_on_taskinstance.py | 2 +-
..._2_3_0_add_data_compressed_to_serialized_dag.py | 18 +-
.../0102_2_3_0_switch_xcom_table_to_use_run_id.py | 10 +-
.../0103_2_3_0_add_callback_request_table.py | 22 +-
...3_0_migrate_rtif_to_use_run_id_and_map_index.py | 100 +-
.../0105_2_3_0_add_map_index_to_taskfail.py | 86 +-
...on_for_fab_tables_to_add_missing_constraints.py | 118 +-
.../versions/0107_2_3_0_add_map_index_to_log.py | 2 +-
.../versions/0108_2_3_0_default_dag_view_grid.py | 18 +-
.../0109_2_3_1_add_index_for_event_in_log.py | 10 +-
...0110_2_3_2_add_cascade_to_dag_tag_foreignkey.py | 50 +-
.../0111_2_3_3_add_indexes_for_cascade_deletes.py | 46 +-
.../versions/0112_2_4_0_add_dagwarning_model.py | 26 +-
.../0113_2_4_0_compare_types_between_orm_and_db.py | 172 +-
.../versions/0114_2_4_0_add_dataset_model.py | 148 +-
.../versions/0115_2_4_0_remove_smart_sensors.py | 56 +-
.../0116_2_4_0_add_dag_owner_attributes_table.py | 20 +-
..._2_4_0_add_processor_subdir_to_dagmodel_and_.py | 42 +-
.../versions/0118_2_4_2_add_missing_autoinc_fab.py | 30 +-
...e_insensitive_unique_constraint_for_username.py | 89 +
... 0120_2_5_0_add_updated_at_to_dagrun_and_ti.py} | 24 +-
...dd_user_comment_to_task_instance_and_dag_run.py | 63 +
airflow/models/__init__.py | 60 +-
airflow/models/abstractoperator.py | 198 +-
airflow/models/base.py | 10 +-
airflow/models/baseoperator.py | 148 +-
airflow/models/connection.py | 88 +-
airflow/models/crypto.py | 4 +-
airflow/models/dag.py | 247 ++-
airflow/models/dagbag.py | 28 +-
airflow/models/dagcode.py | 10 +-
airflow/models/dagpickle.py | 2 +-
airflow/models/dagrun.py | 279 +--
airflow/models/dagwarning.py | 12 +-
airflow/models/dataset.py | 59 +-
airflow/models/db_callback_request.py | 2 +-
airflow/models/expandinput.py | 105 +-
airflow/models/log.py | 25 +-
airflow/models/mappedoperator.py | 166 +-
airflow/models/param.py | 41 +-
airflow/models/pool.py | 14 +-
airflow/models/renderedtifields.py | 10 +-
airflow/models/serialized_dag.py | 12 +-
airflow/models/skipmixin.py | 25 +-
airflow/models/slamiss.py | 2 +-
airflow/models/taskfail.py | 6 +-
airflow/models/taskinstance.py | 592 +++---
airflow/models/taskmixin.py | 8 +-
airflow/models/taskreschedule.py | 12 +-
airflow/models/variable.py | 28 +-
airflow/models/xcom.py | 158 +-
airflow/models/xcom_arg.py | 142 +-
airflow/operators/bash.py | 20 +-
airflow/operators/branch.py | 2 +-
airflow/operators/email.py | 10 +-
airflow/operators/empty.py | 2 +-
airflow/operators/generic_transfer.py | 14 +-
airflow/operators/latest_only.py | 16 +-
airflow/operators/python.py | 145 +-
airflow/operators/smooth.py | 2 +-
airflow/operators/subdag.py | 40 +-
airflow/operators/trigger_dagrun.py | 22 +-
airflow/plugins_manager.py | 38 +-
airflow/providers/airbyte/CHANGELOG.rst | 19 +
airflow/providers/airbyte/provider.yaml | 1 +
airflow/providers/alibaba/CHANGELOG.rst | 18 +
airflow/providers/alibaba/cloud/hooks/oss.py | 4 +-
.../alibaba/cloud/log/oss_task_handler.py | 2 +-
airflow/providers/alibaba/cloud/sensors/oss_key.py | 6 +-
airflow/providers/alibaba/provider.yaml | 1 +
airflow/providers/amazon/CHANGELOG.rst | 57 +
airflow/providers/amazon/aws/hooks/emr.py | 29 +
airflow/providers/amazon/aws/hooks/rds.py | 301 ++-
.../providers/amazon/aws/hooks/redshift_cluster.py | 15 +-
airflow/providers/amazon/aws/hooks/redshift_sql.py | 2 +-
airflow/providers/amazon/aws/hooks/s3.py | 6 +-
airflow/providers/amazon/aws/hooks/sagemaker.py | 74 +-
.../amazon/aws/log/cloudwatch_task_handler.py | 37 +-
airflow/providers/amazon/aws/operators/emr.py | 19 +-
airflow/providers/amazon/aws/operators/rds.py | 155 +-
.../amazon/aws/operators/redshift_cluster.py | 49 +-
.../providers/amazon/aws/operators/redshift_sql.py | 2 +-
.../providers/amazon/aws/operators/sagemaker.py | 53 +-
.../amazon/aws/secrets/systems_manager.py | 22 +-
airflow/providers/amazon/aws/sensors/emr.py | 3 +-
airflow/providers/amazon/aws/sensors/rds.py | 76 +-
.../providers/amazon/aws/transfers/s3_to_sftp.py | 4 +-
.../providers/amazon/aws/transfers/sftp_to_s3.py | 4 +-
airflow/providers/amazon/provider.yaml | 9 +-
airflow/providers/apache/beam/CHANGELOG.rst | 26 +
airflow/providers/apache/beam/hooks/beam.py | 57 +-
airflow/providers/apache/beam/provider.yaml | 3 +-
airflow/providers/apache/cassandra/CHANGELOG.rst | 21 +
airflow/providers/apache/cassandra/provider.yaml | 1 +
airflow/providers/apache/drill/CHANGELOG.rst | 21 +
airflow/providers/apache/drill/provider.yaml | 1 +
airflow/providers/apache/druid/CHANGELOG.rst | 21 +-
airflow/providers/apache/druid/provider.yaml | 3 +-
airflow/providers/apache/hdfs/CHANGELOG.rst | 18 +
airflow/providers/apache/hdfs/provider.yaml | 1 +
airflow/providers/apache/hive/CHANGELOG.rst | 27 +-
airflow/providers/apache/hive/hooks/hive.py | 2 +
airflow/providers/apache/hive/provider.yaml | 3 +-
airflow/providers/apache/kylin/CHANGELOG.rst | 24 +
airflow/providers/apache/kylin/provider.yaml | 1 +
airflow/providers/apache/livy/CHANGELOG.rst | 25 +
airflow/providers/apache/livy/provider.yaml | 1 +
airflow/providers/apache/pig/CHANGELOG.rst | 35 +
airflow/providers/apache/pig/hooks/pig.py | 29 +-
airflow/providers/apache/pig/operators/pig.py | 9 +-
airflow/providers/apache/pig/provider.yaml | 1 +
airflow/providers/apache/pinot/CHANGELOG.rst | 24 +
airflow/providers/apache/pinot/hooks/pinot.py | 16 +-
airflow/providers/apache/pinot/provider.yaml | 3 +-
airflow/providers/apache/spark/CHANGELOG.rst | 32 +
.../providers/apache/spark/hooks/spark_submit.py | 54 +-
.../apache/spark/operators/spark_submit.py | 3 +-
airflow/providers/apache/spark/provider.yaml | 1 +
airflow/providers/apache/sqoop/CHANGELOG.rst | 21 +
airflow/providers/apache/sqoop/provider.yaml | 1 +
airflow/providers/arangodb/CHANGELOG.rst | 22 +
airflow/providers/arangodb/provider.yaml | 1 +
airflow/providers/asana/CHANGELOG.rst | 22 +-
airflow/providers/asana/provider.yaml | 1 +
airflow/providers/atlassian/jira/CHANGELOG.rst | 15 +
airflow/providers/atlassian/jira/provider.yaml | 1 +
airflow/providers/celery/CHANGELOG.rst | 21 +
airflow/providers/celery/provider.yaml | 1 +
airflow/providers/cloudant/CHANGELOG.rst | 22 +
airflow/providers/cloudant/provider.yaml | 1 +
airflow/providers/cncf/kubernetes/CHANGELOG.rst | 75 +-
.../providers/cncf/kubernetes/backcompat/pod.py | 116 --
.../kubernetes/backcompat/pod_runtime_info_env.py | 57 -
.../providers/cncf/kubernetes/backcompat/volume.py | 63 -
.../cncf/kubernetes/backcompat/volume_mount.py | 59 -
.../cncf/kubernetes/decorators/kubernetes.py | 5 +-
.../providers/cncf/kubernetes/hooks/kubernetes.py | 47 +-
.../cncf/kubernetes/operators/kubernetes_pod.py | 67 +-
airflow/providers/cncf/kubernetes/provider.yaml | 1 +
.../cncf/kubernetes/utils/xcom_sidecar.py | 6 +-
airflow/providers/common/sql/CHANGELOG.rst | 31 +
airflow/providers/common/sql/operators/sql.py | 41 +-
airflow/providers/databricks/CHANGELOG.rst | 24 +
airflow/providers/databricks/hooks/databricks.py | 28 +-
.../providers/databricks/hooks/databricks_base.py | 4 +-
.../databricks/operators/databricks_repos.py | 4 +-
.../databricks/operators/databricks_sql.py | 36 +-
airflow/providers/databricks/provider.yaml | 1 +
airflow/providers/datadog/CHANGELOG.rst | 22 +
airflow/providers/datadog/provider.yaml | 1 +
airflow/providers/dbt/cloud/CHANGELOG.rst | 15 +
airflow/providers/dbt/cloud/provider.yaml | 1 +
airflow/providers/dingding/CHANGELOG.rst | 21 +
airflow/providers/dingding/provider.yaml | 1 +
airflow/providers/discord/CHANGELOG.rst | 24 +
airflow/providers/discord/provider.yaml | 1 +
airflow/providers/docker/CHANGELOG.rst | 22 +
airflow/providers/docker/operators/docker.py | 4 +
airflow/providers/docker/provider.yaml | 1 +
airflow/providers/elasticsearch/CHANGELOG.rst | 17 +-
airflow/providers/elasticsearch/provider.yaml | 3 +-
airflow/providers/exasol/CHANGELOG.rst | 22 +
airflow/providers/exasol/provider.yaml | 1 +
airflow/providers/facebook/CHANGELOG.rst | 18 +
airflow/providers/facebook/provider.yaml | 1 +
airflow/providers/ftp/CHANGELOG.rst | 17 +
airflow/providers/ftp/provider.yaml | 1 +
airflow/providers/github/CHANGELOG.rst | 18 +
airflow/providers/github/provider.yaml | 1 +
airflow/providers/google/CHANGELOG.rst | 60 +
.../google/cloud/example_dags/example_dataflow.py | 4 +-
.../google/cloud/example_dags/example_dataprep.py | 79 -
airflow/providers/google/cloud/hooks/bigquery.py | 34 +-
.../providers/google/cloud/hooks/cloud_composer.py | 4 +-
.../google/cloud/hooks/cloud_memorystore.py | 4 +-
airflow/providers/google/cloud/hooks/compute.py | 542 ++++-
.../providers/google/cloud/hooks/compute_ssh.py | 2 +-
airflow/providers/google/cloud/hooks/dataform.py | 382 +++-
airflow/providers/google/cloud/hooks/dataprep.py | 82 +-
airflow/providers/google/cloud/hooks/gcs.py | 4 +-
airflow/providers/google/cloud/links/base.py | 2 +-
airflow/providers/google/cloud/links/compute.py | 112 ++
airflow/providers/google/cloud/links/dataform.py | 66 +
airflow/providers/google/cloud/links/dataprep.py | 63 +
.../providers/google/cloud/operators/bigquery.py | 2 +-
.../google/cloud/operators/cloud_build.py | 6 +-
.../providers/google/cloud/operators/compute.py | 1194 ++++++++++-
.../providers/google/cloud/operators/dataflow.py | 5 +
.../providers/google/cloud/operators/dataform.py | 775 ++++++-
.../providers/google/cloud/operators/dataprep.py | 199 +-
.../providers/google/cloud/operators/dataproc.py | 18 +-
airflow/providers/google/cloud/sensors/dataprep.py | 53 +
.../google/cloud/transfers/bigquery_to_bigquery.py | 8 +-
.../google/cloud/transfers/bigquery_to_gcs.py | 61 +-
.../google/cloud/utils/bigquery.py} | 25 +-
airflow/providers/google/cloud/utils/dataform.py | 207 ++
.../marketing_platform/hooks/display_video.py | 4 +-
.../marketing_platform/operators/display_video.py | 4 +-
airflow/providers/google/provider.yaml | 15 +-
airflow/providers/grpc/CHANGELOG.rst | 34 +-
airflow/providers/grpc/hooks/grpc.py | 2 +-
airflow/providers/grpc/provider.yaml | 1 +
airflow/providers/hashicorp/CHANGELOG.rst | 20 +
airflow/providers/hashicorp/hooks/vault.py | 61 +-
airflow/providers/hashicorp/provider.yaml | 1 +
airflow/providers/http/CHANGELOG.rst | 17 +
airflow/providers/http/provider.yaml | 1 +
airflow/providers/imap/CHANGELOG.rst | 22 +
airflow/providers/imap/provider.yaml | 1 +
airflow/providers/influxdb/CHANGELOG.rst | 23 +
airflow/providers/influxdb/provider.yaml | 1 +
airflow/providers/jdbc/CHANGELOG.rst | 23 +
airflow/providers/jdbc/hooks/jdbc.py | 2 +-
airflow/providers/jdbc/provider.yaml | 6 +-
airflow/providers/jenkins/CHANGELOG.rst | 22 +
airflow/providers/jenkins/provider.yaml | 1 +
airflow/providers/microsoft/azure/CHANGELOG.rst | 38 +-
.../providers/microsoft/azure/hooks/azure_batch.py | 28 -
.../azure/hooks/azure_container_instance.py | 28 -
.../azure/hooks/azure_container_registry.py | 28 -
.../azure/hooks/azure_container_volume.py | 28 -
.../microsoft/azure/hooks/azure_cosmos.py | 33 -
.../microsoft/azure/hooks/azure_data_factory.py | 28 -
.../microsoft/azure/hooks/azure_data_lake.py | 28 -
.../microsoft/azure/hooks/azure_fileshare.py | 28 -
airflow/providers/microsoft/azure/hooks/batch.py | 15 +-
airflow/providers/microsoft/azure/hooks/wasb.py | 2 +-
.../microsoft/azure/log/wasb_task_handler.py | 15 +-
.../microsoft/azure/operators/adls_delete.py | 39 -
.../microsoft/azure/operators/adls_list.py | 40 -
.../microsoft/azure/operators/azure_batch.py | 28 -
.../azure/operators/azure_container_instances.py | 34 -
.../microsoft/azure/operators/azure_cosmos.py | 28 -
.../providers/microsoft/azure/operators/batch.py | 2 +-
airflow/providers/microsoft/azure/provider.yaml | 28 +-
.../microsoft/azure/secrets/azure_key_vault.py | 28 -
.../microsoft/azure/sensors/azure_cosmos.py | 28 -
.../microsoft/azure/transfers/file_to_wasb.py | 29 -
airflow/providers/microsoft/mssql/CHANGELOG.rst | 21 +
airflow/providers/microsoft/mssql/hooks/mssql.py | 4 +-
airflow/providers/microsoft/mssql/provider.yaml | 1 +
airflow/providers/microsoft/psrp/CHANGELOG.rst | 20 +
airflow/providers/microsoft/psrp/provider.yaml | 1 +
airflow/providers/microsoft/winrm/CHANGELOG.rst | 21 +
airflow/providers/microsoft/winrm/provider.yaml | 1 +
airflow/providers/mongo/CHANGELOG.rst | 22 +
airflow/providers/mongo/provider.yaml | 1 +
airflow/providers/mysql/CHANGELOG.rst | 21 +
airflow/providers/mysql/hooks/mysql.py | 6 +
airflow/providers/mysql/provider.yaml | 1 +
airflow/providers/neo4j/CHANGELOG.rst | 17 +
airflow/providers/neo4j/hooks/neo4j.py | 10 +-
airflow/providers/neo4j/provider.yaml | 1 +
airflow/providers/odbc/CHANGELOG.rst | 15 +
airflow/providers/odbc/provider.yaml | 3 +-
airflow/providers/openfaas/CHANGELOG.rst | 21 +
airflow/providers/openfaas/provider.yaml | 1 +
airflow/providers/opsgenie/CHANGELOG.rst | 23 +-
airflow/providers/opsgenie/provider.yaml | 1 +
airflow/providers/oracle/CHANGELOG.rst | 20 +
airflow/providers/oracle/provider.yaml | 1 +
airflow/providers/pagerduty/CHANGELOG.rst | 22 +
airflow/providers/pagerduty/provider.yaml | 1 +
airflow/providers/papermill/CHANGELOG.rst | 20 +
airflow/providers/papermill/provider.yaml | 1 +
airflow/providers/plexus/CHANGELOG.rst | 20 +
airflow/providers/plexus/provider.yaml | 1 +
airflow/providers/postgres/CHANGELOG.rst | 23 +
airflow/providers/postgres/hooks/postgres.py | 24 +-
airflow/providers/postgres/provider.yaml | 1 +
airflow/providers/presto/CHANGELOG.rst | 18 +
airflow/providers/presto/hooks/presto.py | 12 +
airflow/providers/presto/provider.yaml | 3 +-
airflow/providers/qubole/CHANGELOG.rst | 16 +
airflow/providers/qubole/provider.yaml | 3 +-
airflow/providers/redis/CHANGELOG.rst | 21 +
airflow/providers/redis/provider.yaml | 1 +
airflow/providers/salesforce/CHANGELOG.rst | 19 +
airflow/providers/salesforce/provider.yaml | 1 +
airflow/providers/samba/CHANGELOG.rst | 21 +
airflow/providers/samba/provider.yaml | 1 +
airflow/providers/segment/CHANGELOG.rst | 21 +
airflow/providers/segment/provider.yaml | 1 +
airflow/providers/sendgrid/CHANGELOG.rst | 25 +
airflow/providers/sendgrid/provider.yaml | 1 +
airflow/providers/sftp/CHANGELOG.rst | 21 +
airflow/providers/sftp/provider.yaml | 1 +
airflow/providers/singularity/CHANGELOG.rst | 20 +
airflow/providers/singularity/provider.yaml | 1 +
airflow/providers/slack/CHANGELOG.rst | 16 +
airflow/providers/slack/hooks/slack_webhook.py | 4 +-
airflow/providers/slack/provider.yaml | 3 +-
airflow/providers/slack/transfers/sql_to_slack.py | 186 +-
airflow/providers/slack/utils/__init__.py | 40 +-
airflow/providers/snowflake/CHANGELOG.rst | 32 +-
airflow/providers/snowflake/operators/snowflake.py | 2 +-
airflow/providers/snowflake/provider.yaml | 1 +
airflow/providers/sqlite/CHANGELOG.rst | 22 +
airflow/providers/sqlite/provider.yaml | 1 +
airflow/providers/ssh/CHANGELOG.rst | 29 +
airflow/providers/ssh/hooks/ssh.py | 22 +-
airflow/providers/ssh/operators/ssh.py | 23 +-
airflow/providers/ssh/provider.yaml | 1 +
airflow/providers/tableau/CHANGELOG.rst | 16 +
airflow/providers/tableau/provider.yaml | 1 +
airflow/providers/tabular/CHANGELOG.rst | 17 +
airflow/providers/tabular/provider.yaml | 1 +
airflow/providers/telegram/CHANGELOG.rst | 21 +
airflow/providers/telegram/provider.yaml | 1 +
airflow/providers/trino/CHANGELOG.rst | 24 +
airflow/providers/trino/hooks/trino.py | 16 +-
airflow/providers/trino/provider.yaml | 1 +
airflow/providers/vertica/CHANGELOG.rst | 20 +
airflow/providers/vertica/provider.yaml | 1 +
airflow/providers/yandex/CHANGELOG.rst | 22 +
airflow/providers/yandex/provider.yaml | 1 +
airflow/providers/zendesk/CHANGELOG.rst | 25 +
airflow/providers/zendesk/provider.yaml | 1 +
airflow/providers_manager.py | 61 +-
airflow/secrets/__init__.py | 2 +-
airflow/secrets/base_secrets.py | 2 +-
airflow/security/kerberos.py | 41 +-
airflow/security/utils.py | 10 +-
airflow/sensors/base.py | 60 +-
airflow/sensors/bash.py | 23 +-
airflow/sensors/date_time.py | 4 +-
airflow/sensors/external_task.py | 77 +-
airflow/sensors/filesystem.py | 12 +-
airflow/sensors/python.py | 8 +-
airflow/sensors/time_delta.py | 11 +-
airflow/sensors/time_sensor.py | 7 +-
airflow/sensors/weekday.py | 11 +-
airflow/sentry.py | 8 +-
airflow/serialization/enums.py | 35 +-
airflow/serialization/json_schema.py | 2 +-
airflow/serialization/serialized_objects.py | 115 +-
airflow/settings.py | 136 +-
airflow/stats.py | 40 +-
airflow/task/task_runner/__init__.py | 2 +-
airflow/task/task_runner/base_task_runner.py | 31 +-
airflow/task/task_runner/cgroup_task_runner.py | 13 +-
airflow/task/task_runner/standard_task_runner.py | 8 +-
airflow/templates.py | 18 +-
airflow/ti_deps/deps/base_ti_dep.py | 64 +-
airflow/ti_deps/deps/task_not_running_dep.py | 2 +-
airflow/ti_deps/deps/trigger_rule_dep.py | 217 +-
airflow/ti_deps/deps/valid_state_dep.py | 2 +-
airflow/timetables/events.py | 5 +-
airflow/timetables/simple.py | 4 +-
airflow/triggers/base.py | 5 +-
airflow/triggers/temporal.py | 4 +
airflow/typing_compat.py | 5 +-
airflow/utils/cli.py | 57 +-
airflow/utils/cli_action_loggers.py | 22 +-
airflow/utils/code_utils.py | 4 +-
airflow/utils/compression.py | 10 +-
airflow/utils/configuration.py | 2 +-
airflow/utils/context.py | 1 +
airflow/utils/context.pyi | 5 +-
airflow/utils/dates.py | 28 +-
airflow/utils/db.py | 210 +-
airflow/utils/db_cleanup.py | 60 +-
airflow/utils/decorators.py | 4 +-
airflow/utils/deprecation_tools.py | 2 +-
airflow/utils/docs.py | 8 +-
airflow/utils/email.py | 50 +-
airflow/utils/entry_points.py | 20 +-
airflow/utils/file.py | 16 +-
airflow/utils/helpers.py | 34 +-
airflow/utils/json.py | 133 +-
.../request_dict.py => utils/log/action_logger.py} | 14 +-
airflow/utils/log/colored_log.py | 6 +-
airflow/utils/log/file_processor_handler.py | 4 +-
airflow/utils/log/file_task_handler.py | 49 +-
airflow/utils/log/json_formatter.py | 4 +-
airflow/utils/log/log_reader.py | 20 +-
airflow/utils/log/logging_mixin.py | 51 +-
airflow/utils/log/secrets_masker.py | 42 +-
.../log/task_handler_with_custom_formatter.py | 2 +-
airflow/utils/log/timezone_aware.py | 6 +-
airflow/utils/mixins.py | 20 +-
airflow/utils/module_loading.py | 2 +-
airflow/utils/net.py | 6 +-
airflow/utils/operator_helpers.py | 72 +-
airflow/utils/operator_resources.py | 42 +-
airflow/utils/orm_event_handlers.py | 16 +-
airflow/utils/platform.py | 4 +-
airflow/utils/process_utils.py | 4 +-
airflow/utils/python_virtualenv.py | 14 +-
airflow/utils/retries.py | 2 +-
airflow/utils/scheduler_health.py | 4 +-
airflow/utils/serve_logs.py | 16 +-
airflow/utils/sqlalchemy.py | 72 +-
airflow/utils/state.py | 36 +-
airflow/utils/strings.py | 2 +-
airflow/utils/task_group.py | 151 +-
airflow/utils/timeout.py | 8 +-
airflow/utils/timezone.py | 14 +-
airflow/utils/trigger_rule.py | 24 +-
airflow/utils/weight_rule.py | 6 +-
airflow/version.py | 4 +-
airflow/www/api/experimental/endpoints.py | 114 +-
airflow/www/app.py | 34 +-
airflow/www/auth.py | 6 +-
airflow/www/blueprints.py | 6 +-
airflow/www/decorators.py | 101 +-
airflow/www/extensions/init_appbuilder.py | 26 +-
airflow/www/extensions/init_appbuilder_links.py | 8 +-
airflow/www/extensions/init_dagbag.py | 2 +-
airflow/www/extensions/init_jinja_globals.py | 44 +-
airflow/www/extensions/init_manifest_files.py | 4 +-
airflow/www/extensions/init_robots.py | 2 +-
airflow/www/extensions/init_security.py | 6 +-
airflow/www/extensions/init_session.py | 12 +-
airflow/www/extensions/init_views.py | 36 +-
airflow/www/extensions/init_wsgi_middlewares.py | 12 +-
airflow/www/fab_security/manager.py | 2 +-
airflow/www/fab_security/sqla/manager.py | 2 +-
airflow/www/fab_security/sqla/models.py | 36 +-
airflow/www/fab_security/views.py | 126 +-
airflow/www/forms.py | 64 +-
airflow/www/package.json | 3 +
airflow/www/security.py | 50 +-
airflow/www/session.py | 4 +-
airflow/www/static/css/bootstrap-theme.css | 2 +-
airflow/www/static/js/api/index.ts | 4 +
airflow/www/static/js/api/useClearTask.ts | 12 +-
.../www/static/js/api/useDatasetDependencies.ts | 128 +-
airflow/www/static/js/api/useDatasetEvents.ts | 2 +-
airflow/www/static/js/api/useGridData.test.ts | 1 +
airflow/www/static/js/api/useGridData.ts | 2 +-
airflow/www/static/js/api/useSetDagRunNotes.ts | 67 +
.../www/static/js/api/useSetTaskInstanceNotes.ts | 114 ++
airflow/www/static/js/api/useTaskInstance.ts | 2 +-
airflow/www/static/js/components/ConfirmDialog.tsx | 9 +-
airflow/www/static/js/dag/InstanceTooltip.test.tsx | 17 +-
airflow/www/static/js/dag/InstanceTooltip.tsx | 5 +-
airflow/www/static/js/dag/Main.tsx | 23 +-
airflow/www/static/js/dag/StatusBox.tsx | 30 +-
airflow/www/static/js/dag/details/Dag.tsx | 137 +-
.../static/js/dag/details/NotesAccordion.test.tsx | 128 ++
.../www/static/js/dag/details/NotesAccordion.tsx | 149 ++
airflow/www/static/js/dag/details/dagRun/index.tsx | 190 +-
airflow/www/static/js/dag/details/index.tsx | 10 +-
.../js/dag/details/taskInstance/Logs/index.tsx | 207 +-
.../dag/details/taskInstance/MappedInstances.tsx | 8 +-
.../www/static/js/dag/details/taskInstance/Nav.tsx | 20 +-
.../static/js/dag/details/taskInstance/index.tsx | 46 +-
.../dag/details/taskInstance/taskActions/Clear.tsx | 30 +-
.../dag/details/taskInstance/taskActions/index.tsx | 57 +-
.../dag/details/taskInstance/taskActions/types.ts | 3 +-
airflow/www/static/js/dag/grid/dagRuns/Bar.tsx | 6 +-
airflow/www/static/js/dag/grid/dagRuns/Tooltip.tsx | 3 +
.../www/static/js/dag/grid/dagRuns/index.test.tsx | 5 +-
airflow/www/static/js/dag/grid/index.test.tsx | 4 +
airflow/www/static/js/dag/grid/index.tsx | 18 +-
.../www/static/js/dag/grid/renderTaskRows.test.tsx | 2 +
airflow/www/static/js/dag/grid/renderTaskRows.tsx | 3 +-
airflow/www/static/js/datasets/Graph/Legend.tsx | 4 +-
airflow/www/static/js/datasets/Graph/index.tsx | 146 +-
airflow/www/static/js/datasets/index.tsx | 20 +-
airflow/www/static/js/types/api-generated.ts | 186 +-
airflow/www/static/js/types/index.ts | 2 +
airflow/www/static/js/utils/index.test.ts | 5 +-
airflow/www/static/js/utils/index.ts | 8 +
airflow/www/static/js/utils/useOffsetHeight.tsx | 56 +
airflow/www/templates/airflow/code.html | 43 -
airflow/www/templates/airflow/dag.html | 4 +
airflow/www/templates/airflow/dag_code.html | 5 +
airflow/www/utils.py | 163 +-
airflow/www/validators.py | 6 +-
airflow/www/views.py | 2118 +++++++++++---------
airflow/www/widgets.py | 12 +-
airflow/www/yarn.lock | 91 +-
chart/Chart.yaml | 26 +-
chart/files/pod-template-file.kubernetes-helm-yaml | 4 +
chart/newsfragments/27230.significant.rst | 3 -
chart/newsfragments/27625.significant.rst | 4 +
chart/newsfragments/27668.significant.rst | 3 +
chart/templates/jobs/create-user-job.yaml | 4 +
chart/templates/jobs/migrate-database-job.yaml | 6 +-
.../templates/pgbouncer/pgbouncer-deployment.yaml | 2 +-
.../templates/scheduler/scheduler-deployment.yaml | 6 +
.../templates/triggerer/triggerer-deployment.yaml | 3 +
.../templates/webserver/webserver-deployment.yaml | 3 +
chart/templates/workers/worker-deployment.yaml | 11 +-
chart/values.schema.json | 36 +-
chart/values.yaml | 21 +-
dev/README_RELEASE_PROVIDER_PACKAGES.md | 12 +-
dev/TRACKING_BACKTRACKING_ISSUES.md | 10 +-
dev/breeze/SELECTIVE_CHECKS.md | 13 +-
.../airflow_breeze/commands/developer_commands.py | 8 +-
.../commands/release_management_commands.py | 18 +-
.../commands/setup_commands_config.py | 1 -
.../airflow_breeze/commands/testing_commands.py | 4 +-
dev/breeze/src/airflow_breeze/global_constants.py | 6 +-
.../airflow_breeze/utils/exclude_from_matrix.py | 47 +
.../utils/find_newer_dependencies.py | 4 +-
dev/breeze/src/airflow_breeze/utils/path_utils.py | 39 +-
dev/breeze/src/airflow_breeze/utils/reinstall.py | 4 +-
.../src/airflow_breeze/utils/selective_checks.py | 62 +-
dev/breeze/tests/test_exclude_from_matrix.py | 46 +
dev/breeze/tests/test_selective_checks.py | 72 +-
dev/provider_packages/MANIFEST_TEMPLATE.in.jinja2 | 2 +
dev/provider_packages/SETUP_TEMPLATE.py.jinja2 | 1 -
dev/provider_packages/prepare_provider_packages.py | 4 +-
dev/refresh_images.sh | 2 +-
dev/requirements.txt | 2 +-
dev/retag_docker_images.py | 2 +-
docs/apache-airflow-providers-airbyte/commits.rst | 19 +-
docs/apache-airflow-providers-airbyte/index.rst | 8 +-
docs/apache-airflow-providers-alibaba/commits.rst | 18 +-
docs/apache-airflow-providers-alibaba/index.rst | 4 +-
docs/apache-airflow-providers-amazon/commits.rst | 50 +-
.../connections/aws.rst | 36 +-
docs/apache-airflow-providers-amazon/index.rst | 18 +-
.../logging/s3-task-handler.rst | 4 +-
.../operators/emr.rst | 21 +-
.../secrets-backends/aws-ssm-parameter-store.rst | 19 +-
.../commits.rst | 22 +-
.../apache-airflow-providers-apache-beam/index.rst | 10 +-
.../operators.rst | 2 +-
.../commits.rst | 21 +-
.../index.rst | 4 +-
.../commits.rst | 16 +-
.../index.rst | 10 +-
.../commits.rst | 16 +-
.../index.rst | 10 +-
.../commits.rst | 24 +-
.../apache-airflow-providers-apache-hdfs/index.rst | 4 +-
.../commits.rst | 17 +-
.../apache-airflow-providers-apache-hive/index.rst | 10 +-
.../commits.rst | 21 +-
.../index.rst | 4 +-
.../commits.rst | 21 +-
.../apache-airflow-providers-apache-livy/index.rst | 8 +-
.../commits.rst | 22 +-
docs/apache-airflow-providers-apache-pig/index.rst | 11 +-
.../commits.rst | 17 +-
.../index.rst | 13 +-
.../commits.rst | 22 +-
.../connections/spark.rst | 3 +-
.../index.rst | 4 +-
.../commits.rst | 21 +-
.../index.rst | 11 +-
docs/apache-airflow-providers-arangodb/commits.rst | 21 +-
docs/apache-airflow-providers-arangodb/index.rst | 4 +-
docs/apache-airflow-providers-asana/commits.rst | 18 +-
docs/apache-airflow-providers-asana/index.rst | 4 +-
.../commits.rst | 12 +
.../index.rst | 4 +-
docs/apache-airflow-providers-celery/commits.rst | 21 +-
docs/apache-airflow-providers-celery/index.rst | 4 +-
docs/apache-airflow-providers-cloudant/commits.rst | 22 +-
docs/apache-airflow-providers-cloudant/index.rst | 4 +-
.../commits.rst | 33 +
.../connections/kubernetes.rst | 6 +-
.../index.rst | 2 +-
.../commits.rst | 23 +-
docs/apache-airflow-providers-common-sql/index.rst | 2 +-
.../commits.rst | 19 +-
docs/apache-airflow-providers-databricks/index.rst | 10 +-
docs/apache-airflow-providers-datadog/commits.rst | 22 +-
docs/apache-airflow-providers-datadog/index.rst | 4 +-
.../apache-airflow-providers-dbt-cloud/commits.rst | 15 +-
docs/apache-airflow-providers-dbt-cloud/index.rst | 8 +-
docs/apache-airflow-providers-dingding/commits.rst | 21 +-
docs/apache-airflow-providers-dingding/index.rst | 16 +-
docs/apache-airflow-providers-discord/commits.rst | 21 +-
docs/apache-airflow-providers-discord/index.rst | 16 +-
docs/apache-airflow-providers-docker/commits.rst | 17 +-
docs/apache-airflow-providers-docker/index.rst | 3 +-
.../commits.rst | 16 +-
.../index.rst | 10 +-
docs/apache-airflow-providers-exasol/commits.rst | 18 +-
docs/apache-airflow-providers-exasol/index.rst | 10 +-
docs/apache-airflow-providers-facebook/commits.rst | 18 +-
docs/apache-airflow-providers-facebook/index.rst | 4 +-
docs/apache-airflow-providers-ftp/commits.rst | 16 +-
docs/apache-airflow-providers-ftp/index.rst | 2 +-
docs/apache-airflow-providers-github/commits.rst | 17 +-
docs/apache-airflow-providers-github/index.rst | 4 +-
docs/apache-airflow-providers-google/commits.rst | 50 +-
docs/apache-airflow-providers-google/index.rst | 12 +-
.../operators/cloud/compute.rst | 332 ++-
.../operators/cloud/dataflow.rst | 24 +-
.../operators/cloud/dataform.rst | 120 ++
.../operators/cloud/dataprep.rst | 77 +-
docs/apache-airflow-providers-grpc/commits.rst | 23 +-
docs/apache-airflow-providers-grpc/index.rst | 6 +-
.../apache-airflow-providers-hashicorp/commits.rst | 20 +-
docs/apache-airflow-providers-hashicorp/index.rst | 8 +-
docs/apache-airflow-providers-http/commits.rst | 16 +-
docs/apache-airflow-providers-http/index.rst | 2 +-
docs/apache-airflow-providers-imap/commits.rst | 21 +-
docs/apache-airflow-providers-imap/index.rst | 2 +-
docs/apache-airflow-providers-influxdb/commits.rst | 20 +-
docs/apache-airflow-providers-influxdb/index.rst | 6 +-
docs/apache-airflow-providers-jdbc/commits.rst | 19 +-
docs/apache-airflow-providers-jdbc/index.rst | 10 +-
docs/apache-airflow-providers-jenkins/commits.rst | 22 +-
docs/apache-airflow-providers-jenkins/index.rst | 4 +-
.../commits.rst | 29 +-
.../index.rst | 11 +-
.../commits.rst | 17 +-
.../index.rst | 10 +-
.../commits.rst | 20 +-
.../index.rst | 3 +-
.../commits.rst | 21 +-
.../index.rst | 4 +-
docs/apache-airflow-providers-mongo/commits.rst | 22 +-
docs/apache-airflow-providers-mongo/index.rst | 4 +-
docs/apache-airflow-providers-mysql/commits.rst | 17 +-
docs/apache-airflow-providers-mysql/index.rst | 10 +-
docs/apache-airflow-providers-neo4j/commits.rst | 17 +-
docs/apache-airflow-providers-neo4j/index.rst | 4 +-
docs/apache-airflow-providers-odbc/commits.rst | 15 +-
docs/apache-airflow-providers-odbc/index.rst | 10 +-
docs/apache-airflow-providers-openfaas/commits.rst | 20 +-
docs/apache-airflow-providers-openfaas/index.rst | 11 +-
docs/apache-airflow-providers-opsgenie/commits.rst | 23 +-
docs/apache-airflow-providers-opsgenie/index.rst | 4 +-
docs/apache-airflow-providers-oracle/commits.rst | 14 +
docs/apache-airflow-providers-oracle/index.rst | 10 +-
.../apache-airflow-providers-pagerduty/commits.rst | 22 +-
docs/apache-airflow-providers-pagerduty/index.rst | 4 +-
.../apache-airflow-providers-papermill/commits.rst | 20 +-
docs/apache-airflow-providers-papermill/index.rst | 4 +-
docs/apache-airflow-providers-plexus/commits.rst | 20 +-
docs/apache-airflow-providers-plexus/index.rst | 4 +-
docs/apache-airflow-providers-postgres/commits.rst | 19 +-
docs/apache-airflow-providers-postgres/index.rst | 10 +-
docs/apache-airflow-providers-presto/commits.rst | 18 +-
docs/apache-airflow-providers-presto/index.rst | 10 +-
docs/apache-airflow-providers-qubole/commits.rst | 16 +-
docs/apache-airflow-providers-qubole/index.rst | 10 +-
docs/apache-airflow-providers-redis/commits.rst | 21 +-
docs/apache-airflow-providers-redis/index.rst | 4 +-
.../commits.rst | 25 +-
docs/apache-airflow-providers-salesforce/index.rst | 4 +-
docs/apache-airflow-providers-samba/commits.rst | 21 +-
docs/apache-airflow-providers-samba/index.rst | 4 +-
docs/apache-airflow-providers-segment/commits.rst | 21 +-
docs/apache-airflow-providers-segment/index.rst | 4 +-
docs/apache-airflow-providers-sendgrid/commits.rst | 21 +-
docs/apache-airflow-providers-sendgrid/index.rst | 4 +-
docs/apache-airflow-providers-sftp/commits.rst | 17 +-
docs/apache-airflow-providers-sftp/index.rst | 8 +-
.../commits.rst | 20 +-
.../apache-airflow-providers-singularity/index.rst | 4 +-
docs/apache-airflow-providers-slack/commits.rst | 17 +-
docs/apache-airflow-providers-slack/index.rst | 10 +-
.../apache-airflow-providers-snowflake/commits.rst | 18 +-
docs/apache-airflow-providers-snowflake/index.rst | 10 +-
docs/apache-airflow-providers-sqlite/commits.rst | 17 +-
docs/apache-airflow-providers-sqlite/index.rst | 8 +-
docs/apache-airflow-providers-ssh/commits.rst | 21 +-
docs/apache-airflow-providers-ssh/index.rst | 4 +-
docs/apache-airflow-providers-tableau/commits.rst | 21 +-
docs/apache-airflow-providers-tableau/index.rst | 4 +-
docs/apache-airflow-providers-tabular/commits.rst | 23 +-
docs/apache-airflow-providers-tabular/index.rst | 4 +-
docs/apache-airflow-providers-telegram/commits.rst | 21 +-
docs/apache-airflow-providers-telegram/index.rst | 4 +-
docs/apache-airflow-providers-trino/commits.rst | 20 +-
.../apache-airflow-providers-trino/connections.rst | 1 +
docs/apache-airflow-providers-trino/index.rst | 12 +-
docs/apache-airflow-providers-vertica/commits.rst | 16 +-
docs/apache-airflow-providers-vertica/index.rst | 10 +-
docs/apache-airflow-providers-yandex/commits.rst | 18 +-
docs/apache-airflow-providers-yandex/index.rst | 4 +-
docs/apache-airflow-providers-zendesk/commits.rst | 21 +-
docs/apache-airflow-providers-zendesk/index.rst | 4 +-
docs/apache-airflow/concepts/cluster-policies.rst | 6 +-
.../concepts/dynamic-task-mapping.rst | 27 +-
docs/apache-airflow/concepts/taskflow.rst | 101 +
docs/apache-airflow/dag-run.rst | 2 +-
docs/apache-airflow/executor/celery.rst | 2 +-
docs/apache-airflow/executor/kubernetes.rst | 2 +-
docs/apache-airflow/howto/docker-compose/index.rst | 2 +-
docs/apache-airflow/howto/operator/python.rst | 36 +-
docs/apache-airflow/howto/set-up-database.rst | 4 +-
docs/apache-airflow/img/airflow_erd.sha256 | 2 +-
docs/apache-airflow/img/airflow_erd.svg | 910 ++++-----
docs/apache-airflow/installation/prerequisites.rst | 2 +-
.../installation/supported-versions.rst | 2 +-
docs/apache-airflow/listeners.rst | 41 +-
docs/apache-airflow/logging-monitoring/metrics.rst | 9 +-
docs/apache-airflow/migrations-ref.rst | 6 +-
docs/apache-airflow/production-deployment.rst | 2 +-
docs/apache-airflow/project.rst | 1 +
docs/apache-airflow/python-api-ref.rst | 8 +-
docs/apache-airflow/templates-ref.rst | 85 +-
docs/apache-airflow/tutorial/taskflow.rst | 16 +
docs/docker-stack/build-arg-ref.rst | 2 +-
docs/docker-stack/build.rst | 2 +-
docs/docker-stack/changelog.rst | 8 +
docs/helm-chart/index.rst | 6 +-
docs/spelling_wordlist.txt | 8 +
generated/provider_dependencies.json | 39 +-
images/breeze/output-commands-hash.txt | 14 +-
images/breeze/output-commands.svg | 208 +-
images/breeze/output_setup_config.svg | 108 +-
images/breeze/output_shell.svg | 240 +--
images/breeze/output_start-airflow.svg | 260 +--
images/breeze/output_testing_tests.svg | 216 +-
kubernetes_tests/test_kubernetes_pod_operator.py | 356 ++--
.../test_kubernetes_pod_operator_backcompat.py | 606 ------
newsfragments/27065.misc.rst | 1 -
newsfragments/27190.significant.rst | 3 +
scripts/ci/pre_commit/common_precommit_utils.py | 8 +
scripts/ci/pre_commit/pre_commit_flake8.py | 15 +-
.../ci/pre_commit/pre_commit_lint_dockerfile.py | 2 +-
.../pre_commit/pre_commit_migration_reference.py | 6 +
scripts/ci/pre_commit/pre_commit_mypy.py | 15 +-
.../ci/pre_commit/pre_commit_supported_versions.py | 2 +-
.../ci/pre_commit/pre_commit_update_er_diagram.py | 7 +
scripts/docker/common.sh | 2 +-
scripts/docker/install_os_dependencies.sh | 17 +
scripts/in_container/_in_container_utils.sh | 40 -
.../in_container/run_prepare_provider_packages.sh | 9 +-
scripts/in_container/verify_providers.py | 20 +-
scripts/tools/initialize_virtualenv.py | 2 +-
setup.cfg | 10 +-
setup.py | 11 +-
tests/__init__.py | 5 +
tests/always/test_project_structure.py | 2 +
tests/api/client/test_local_client.py | 4 +
tests/api_connexion/conftest.py | 1 +
.../endpoints/test_connection_endpoint.py | 4 +
.../endpoints/test_dag_run_endpoint.py | 80 +-
.../test_mapped_task_instance_endpoint.py | 1 +
.../endpoints/test_task_instance_endpoint.py | 161 +-
.../endpoints/test_variable_endpoint.py | 13 +-
tests/api_connexion/schemas/test_dag_run_schema.py | 6 +
.../schemas/test_task_instance_schema.py | 3 +
tests/callbacks/test_callback_requests.py | 36 +
tests/charts/test_create_user_job.py | 30 +
tests/charts/test_pgbouncer.py | 12 +
tests/charts/test_pod_template_file.py | 14 +
tests/charts/test_webserver.py | 29 +
tests/charts/test_worker.py | 17 +
tests/cli/commands/test_dag_command.py | 4 +
tests/core/test_providers_manager.py | 28 +
tests/dag_processing/test_manager.py | 77 +-
.../test_external_task_sensor_check_existense.py | 27 +-
tests/decorators/test_python.py | 41 +
tests/decorators/test_sensor.py | 146 ++
tests/decorators/test_task_group.py | 7 +-
tests/executors/test_base_executor.py | 7 +
tests/executors/test_kubernetes_executor.py | 82 +-
tests/jobs/test_backfill_job.py | 75 +
tests/jobs/test_base_job.py | 25 +
tests/jobs/test_local_task_job.py | 25 +-
tests/jobs/test_scheduler_job.py | 132 +-
.../kubernetes/test_kubernetes_helper_functions.py | 86 +
tests/lineage/test_lineage.py | 15 +-
.../{full_listener.py => class_listener.py} | 33 +-
.../{full_listener.py => dag_listener.py} | 27 +-
tests/listeners/full_listener.py | 21 +
.../{full_listener.py => lifecycle_listener.py} | 23 +-
tests/listeners/test_listeners.py | 53 +-
tests/models/test_dagrun.py | 131 +-
tests/models/test_skipmixin.py | 49 +
tests/models/test_taskinstance.py | 336 ++--
tests/operators/test_python.py | 10 +-
tests/operators/test_trigger_dagrun.py | 58 +-
tests/providers/amazon/aws/hooks/test_eks.py | 4 +-
tests/providers/amazon/aws/hooks/test_emr.py | 56 +
tests/providers/amazon/aws/hooks/test_rds.py | 312 +++
tests/providers/amazon/aws/hooks/test_sagemaker.py | 136 +-
.../amazon/aws/log/test_cloudwatch_task_handler.py | 57 +-
.../amazon/aws/operators/test_emr_serverless.py | 78 +-
tests/providers/amazon/aws/operators/test_rds.py | 135 +-
.../amazon/aws/operators/test_redshift_cluster.py | 86 +-
.../amazon/aws/operators/test_sagemaker_model.py | 37 +-
.../aws/operators/test_sagemaker_processing.py | 14 +-
.../amazon/aws/secrets/test_systems_manager.py | 64 +-
tests/providers/amazon/aws/sensors/test_rds.py | 19 +-
.../amazon/aws/sensors/test_sagemaker_endpoint.py | 2 +-
.../amazon/aws/sensors/test_sagemaker_training.py | 4 +-
.../amazon/aws/sensors/test_sagemaker_transform.py | 2 +-
.../amazon/aws/sensors/test_sagemaker_tuning.py | 2 +-
tests/providers/apache/beam/hooks/test_beam.py | 43 +-
tests/providers/apache/hive/__init__.py | 15 +
tests/providers/apache/hive/hooks/test_hive.py | 6 +
tests/providers/apache/pig/hooks/test_pig.py | 13 +-
tests/providers/apache/pinot/hooks/test_pinot.py | 17 +-
.../apache/spark/hooks/test_spark_submit.py | 135 +-
.../cncf/kubernetes/hooks/test_kubernetes.py | 13 +
.../kubernetes/operators/test_kubernetes_pod.py | 201 +-
.../kubernetes/operators/test_spark_kubernetes.py | 156 +-
tests/providers/common/sql/operators/test_sql.py | 7 +-
.../providers/databricks/hooks/test_databricks.py | 9 +-
tests/providers/docker/operators/test_docker.py | 4 +
.../providers/google/cloud/hooks/test_bigquery.py | 7 +-
.../google/cloud/hooks/test_cloud_composer.py | 8 +-
.../google/cloud/hooks/test_cloud_memorystore.py | 12 +-
tests/providers/google/cloud/hooks/test_compute.py | 648 ++++--
.../google/cloud/hooks/test_compute_ssh_system.py | 79 -
.../google/cloud/hooks/test_datacatalog.py | 16 +-
.../providers/google/cloud/hooks/test_dataform.py | 202 ++
.../providers/google/cloud/hooks/test_dataprep.py | 262 ++-
.../providers/google/cloud/hooks/test_os_login.py | 16 +-
.../cloud/log/test_stackdriver_task_handler.py | 4 +-
.../google/cloud/operators/test_bigquery.py | 10 +-
.../google/cloud/operators/test_compute.py | 1635 +++++++++++----
.../google/cloud/operators/test_compute_system.py | 45 -
.../cloud/operators/test_compute_system_helper.py | 215 --
.../google/cloud/operators/test_dataflow_system.py | 4 +-
.../google/cloud/operators/test_dataform.py | 239 +++
.../google/cloud/operators/test_dataprep.py | 217 +-
.../google/cloud/operators/test_dataproc.py | 273 ++-
.../google/cloud/sensors/test_dataprep.py | 46 +
.../cloud/transfers/test_bigquery_to_bigquery.py | 33 +-
.../google/cloud/transfers/test_bigquery_to_gcs.py | 70 +-
.../cloud/utils/test_credentials_provider.py | 8 +-
.../google/common/hooks/test_base_google.py | 8 +-
tests/providers/hashicorp/hooks/test_vault.py | 27 +
tests/providers/microsoft/azure/hooks/test_adx.py | 2 +-
.../microsoft/azure/hooks/test_azure_batch.py | 10 +-
.../azure/hooks/test_azure_container_instance.py | 5 +-
.../azure/hooks/test_azure_container_registry.py | 4 +-
.../azure/hooks/test_azure_container_volume.py | 3 +-
.../microsoft/azure/hooks/test_azure_cosmos.py | 5 +-
.../microsoft/azure/hooks/test_azure_data_lake.py | 5 +-
.../microsoft/azure/hooks/test_azure_fileshare.py | 2 +-
.../microsoft/azure/hooks/test_base_azure.py | 3 +-
tests/providers/microsoft/azure/hooks/test_wasb.py | 2 +-
.../microsoft/azure/log/test_wasb_task_handler.py | 12 +-
.../microsoft/azure/operators/test_adls_delete.py | 3 +-
.../microsoft/azure/operators/test_adls_list.py | 3 +-
.../microsoft/azure/operators/test_adx.py | 5 +-
.../microsoft/azure/operators/test_azure_batch.py | 9 +-
.../operators/test_azure_container_instances.py | 3 +-
.../microsoft/azure/operators/test_azure_cosmos.py | 5 +-
.../azure/operators/test_azure_synapse.py | 5 +-
.../azure/operators/test_wasb_delete_blob.py | 5 +-
.../azure/secrets/test_azure_key_vault.py | 18 +-
.../microsoft/azure/sensors/test_azure_cosmos.py | 3 +-
.../azure/sensors/test_azure_data_factory.py | 13 +-
.../providers/microsoft/azure/sensors/test_wasb.py | 9 +-
.../azure/transfers/test_azure_blob_to_gcs.py | 3 +-
.../azure/transfers/test_local_to_adls.py | 3 +-
.../azure/transfers/test_local_to_wasb.py | 2 +-
.../transfers/test_oracle_to_azure_data_lake.py | 3 +-
.../providers/microsoft/mssql/hooks/test_mssql.py | 10 +-
tests/providers/microsoft/psrp/hooks/test_psrp.py | 9 +-
.../microsoft/psrp/operators/test_psrp.py | 42 +-
.../providers/microsoft/winrm/hooks/test_winrm.py | 3 +-
.../microsoft/winrm/operators/test_winrm.py | 3 +-
tests/providers/mysql/hooks/test_mysql.py | 20 +
tests/providers/odbc/hooks/test_odbc.py | 8 +-
tests/providers/postgres/hooks/test_postgres.py | 30 +
tests/providers/presto/hooks/test_presto.py | 4 +
.../providers/slack/transfers/test_sql_to_slack.py | 164 +-
tests/providers/slack/utils/test_utils.py | 54 +-
tests/providers/ssh/hooks/test_ssh.py | 19 +
tests/providers/ssh/operators/test_ssh.py | 2 +-
tests/providers/trino/hooks/test_trino.py | 17 +-
tests/sensors/test_base.py | 22 +
tests/sensors/test_external_task_sensor.py | 163 +-
tests/sensors/test_timeout_sensor.py | 4 +-
tests/serialization/test_dag_serialization.py | 6 +-
tests/serialization/test_serialized_objects.py | 78 +
.../system/providers/amazon/aws}/example_emr.py | 84 +-
tests/system/providers/amazon/aws/example_glue.py | 2 +-
.../providers/amazon/aws/example_redshift.py | 35 +-
tests/system/providers/apache/beam/utils.py | 10 +-
.../cloud/bigquery/example_bigquery_to_bigquery.py | 7 +-
...igquery.py => example_bigquery_to_gcs_async.py} | 50 +-
.../cloud/cloud_build/example_cloud_build.py | 4 +-
.../providers/google/cloud/compute}/__init__.py | 0
.../google/cloud/compute/example_compute.py | 286 +++
.../google/cloud/compute/example_compute_igm.py | 254 +++
.../google/cloud/compute/example_compute_ssh.py | 129 ++
.../providers/google/cloud/dataflow}/__init__.py | 0
.../cloud/dataflow/example_dataflow_native_java.py | 116 ++
.../dataflow/example_dataflow_native_python.py | 123 ++
.../example_dataflow_native_python_async.py | 199 ++
.../cloud/dataflow/example_dataflow_template.py | 95 +
.../google/cloud/dataflow/resources}/__init__.py | 0
.../google/cloud/dataflow/resources/text.txt | 5 +
.../dataflow/resources/wordcount_debugging.txt | 168 ++
.../google/cloud/dataform/example_dataform.py | 192 +-
.../providers/google/cloud/dataprep}/__init__.py | 0
.../google/cloud/dataprep/example_dataprep.py | 175 ++
.../google/cloud/gcs/example_firestore.py | 4 +-
tests/test_utils/mapping.py | 1 -
tests/test_utils/www.py | 26 +
tests/ti_deps/deps/test_trigger_rule_dep.py | 970 +++++----
.../utils/test_dataform.py | 30 +-
tests/utils/test_json.py | 131 ++
tests/utils/test_logging_mixin.py | 95 +-
tests/utils/test_task_group.py | 35 +
tests/www/test_security.py | 21 +-
tests/www/views/test_views_connection.py | 5 +-
tests/www/views/test_views_decorators.py | 40 +-
tests/www/views/test_views_grid.py | 4 +
tests/www/views/test_views_home.py | 10 +-
tests/www/views/test_views_tasks.py | 9 +-
tests/www/views/test_views_trigger_dag.py | 36 +
tests/www/views/test_views_variable.py | 8 +-
1211 files changed, 32042 insertions(+), 15658 deletions(-)
create mode 100644 airflow/decorators/sensor.py
copy airflow/example_dags/{example_sla_dag.py => example_sensor_decorator.py}
(51%)
copy airflow/{api_connexion => listeners/spec}/__init__.py (100%)
copy airflow/{api/auth/backend/default.py => listeners/spec/dagrun.py} (61%)
copy airflow/{operators/smooth.py => listeners/spec/lifecycle.py} (58%)
rename airflow/listeners/{spec.py => spec/taskinstance.py} (100%)
create mode 100644
airflow/migrations/versions/0119_2_4_3_add_case_insensitive_unique_constraint_for_username.py
rename
airflow/migrations/versions/{0119_2_5_0_add_updated_at_to_dagrun_and_ti.py =>
0120_2_5_0_add_updated_at_to_dagrun_and_ti.py} (71%)
create mode 100644
airflow/migrations/versions/0121_2_5_0_add_user_comment_to_task_instance_and_dag_run.py
delete mode 100644 airflow/providers/cncf/kubernetes/backcompat/pod.py
delete mode 100644
airflow/providers/cncf/kubernetes/backcompat/pod_runtime_info_env.py
delete mode 100644 airflow/providers/cncf/kubernetes/backcompat/volume.py
delete mode 100644 airflow/providers/cncf/kubernetes/backcompat/volume_mount.py
delete mode 100644
airflow/providers/google/cloud/example_dags/example_dataprep.py
create mode 100644 airflow/providers/google/cloud/links/compute.py
create mode 100644 airflow/providers/google/cloud/links/dataprep.py
create mode 100644 airflow/providers/google/cloud/sensors/dataprep.py
copy airflow/{www/extensions/init_dagbag.py =>
providers/google/cloud/utils/bigquery.py} (56%)
create mode 100644 airflow/providers/google/cloud/utils/dataform.py
delete mode 100644 airflow/providers/microsoft/azure/hooks/azure_batch.py
delete mode 100644
airflow/providers/microsoft/azure/hooks/azure_container_instance.py
delete mode 100644
airflow/providers/microsoft/azure/hooks/azure_container_registry.py
delete mode 100644
airflow/providers/microsoft/azure/hooks/azure_container_volume.py
delete mode 100644 airflow/providers/microsoft/azure/hooks/azure_cosmos.py
delete mode 100644
airflow/providers/microsoft/azure/hooks/azure_data_factory.py
delete mode 100644 airflow/providers/microsoft/azure/hooks/azure_data_lake.py
delete mode 100644 airflow/providers/microsoft/azure/hooks/azure_fileshare.py
delete mode 100644 airflow/providers/microsoft/azure/operators/adls_delete.py
delete mode 100644 airflow/providers/microsoft/azure/operators/adls_list.py
delete mode 100644 airflow/providers/microsoft/azure/operators/azure_batch.py
delete mode 100644
airflow/providers/microsoft/azure/operators/azure_container_instances.py
delete mode 100644 airflow/providers/microsoft/azure/operators/azure_cosmos.py
delete mode 100644 airflow/providers/microsoft/azure/secrets/azure_key_vault.py
delete mode 100644 airflow/providers/microsoft/azure/sensors/azure_cosmos.py
delete mode 100644 airflow/providers/microsoft/azure/transfers/file_to_wasb.py
copy airflow/{api_connexion/endpoints/request_dict.py =>
utils/log/action_logger.py} (77%)
create mode 100644 airflow/www/static/js/api/useSetDagRunNotes.ts
create mode 100644 airflow/www/static/js/api/useSetTaskInstanceNotes.ts
create mode 100644 airflow/www/static/js/dag/details/NotesAccordion.test.tsx
create mode 100644 airflow/www/static/js/dag/details/NotesAccordion.tsx
create mode 100644 airflow/www/static/js/utils/useOffsetHeight.tsx
delete mode 100644 airflow/www/templates/airflow/code.html
delete mode 100644 chart/newsfragments/27230.significant.rst
create mode 100644 chart/newsfragments/27625.significant.rst
create mode 100644 chart/newsfragments/27668.significant.rst
create mode 100644 dev/breeze/src/airflow_breeze/utils/exclude_from_matrix.py
create mode 100644 dev/breeze/tests/test_exclude_from_matrix.py
delete mode 100644 kubernetes_tests/test_kubernetes_pod_operator_backcompat.py
delete mode 100644 newsfragments/27065.misc.rst
create mode 100644 newsfragments/27190.significant.rst
copy airflow/example_dags/example_latest_only.py =>
tests/dags/test_external_task_sensor_check_existense.py (60%)
create mode 100644 tests/decorators/test_sensor.py
create mode 100644 tests/kubernetes/test_kubernetes_helper_functions.py
copy tests/listeners/{full_listener.py => class_listener.py} (53%)
copy tests/listeners/{full_listener.py => dag_listener.py} (64%)
copy tests/listeners/{full_listener.py => lifecycle_listener.py} (70%)
delete mode 100644
tests/providers/google/cloud/hooks/test_compute_ssh_system.py
delete mode 100644
tests/providers/google/cloud/operators/test_compute_system.py
delete mode 100755
tests/providers/google/cloud/operators/test_compute_system_helper.py
create mode 100644 tests/providers/google/cloud/sensors/test_dataprep.py
create mode 100644 tests/serialization/test_serialized_objects.py
rename {airflow/providers/amazon/aws/example_dags =>
tests/system/providers/amazon/aws}/example_emr.py (63%)
copy
tests/system/providers/google/cloud/bigquery/{example_bigquery_to_bigquery.py
=> example_bigquery_to_gcs_async.py} (66%)
copy {airflow/api_connexion =>
tests/system/providers/google/cloud/compute}/__init__.py (100%)
create mode 100644
tests/system/providers/google/cloud/compute/example_compute.py
create mode 100644
tests/system/providers/google/cloud/compute/example_compute_igm.py
create mode 100644
tests/system/providers/google/cloud/compute/example_compute_ssh.py
copy {airflow/api_connexion =>
tests/system/providers/google/cloud/dataflow}/__init__.py (100%)
create mode 100644
tests/system/providers/google/cloud/dataflow/example_dataflow_native_java.py
create mode 100644
tests/system/providers/google/cloud/dataflow/example_dataflow_native_python.py
create mode 100644
tests/system/providers/google/cloud/dataflow/example_dataflow_native_python_async.py
create mode 100644
tests/system/providers/google/cloud/dataflow/example_dataflow_template.py
copy {airflow/api_connexion =>
tests/system/providers/google/cloud/dataflow/resources}/__init__.py (100%)
create mode 100644
tests/system/providers/google/cloud/dataflow/resources/text.txt
create mode 100644
tests/system/providers/google/cloud/dataflow/resources/wordcount_debugging.txt
copy {airflow/api_connexion =>
tests/system/providers/google/cloud/dataprep}/__init__.py (100%)
create mode 100644
tests/system/providers/google/cloud/dataprep/example_dataprep.py
copy airflow/migrations/versions/0003_1_5_0_for_compatibility.py =>
tests/utils/test_dataform.py (67%)
