This is an automated email from the ASF dual-hosted git repository.
ash pushed a change to branch v2-0-test
in repository https://gitbox.apache.org/repos/asf/airflow.git.
from dd2095f Simplify string expressions & Use f-string (#12216)
add cd85d01 [#12012]: Update INTHEWILD.md (#12235)
add 75065ac CSS Changes to adjust content width as per screen size and
responsive table with multiline td. (#12227)
add 502ba30 Enable Markdownlint rule - MD022/blanks-around-headings
(#12225)
add 50fedfb Add docs about security on GCP (#12187)
add 250436d Fix spelling in Python files (#12230)
add 45587a6 Enable markdownlint rule - MD031/blanks-around-fences (#12238)
add 5912d0c Fixes automated provider installation with extras (#12233)
add 249d174 Add back missing api_connextion/__init__.py file (#12240)
add 3ab5828 Sign release files with an apache.org key by default (#12241)
add f8ae6e5 Remove Unnecessary comprehension (#12221)
add 5ac1738 Update versions in UPDATING.md for 2.0.0b1 release (#12244)
add c5806ef Added missing sendgrid readme (#12245)
add 1521965 Release 2.0.0b2 (#12243)
add 3ddf4d0 Fix spelling (#12250)
add 09febee Fixes continuous image rebuilding with Breeze (#12256)
add ae397df Adds provider package documentation in installation.rst
(#12203)
add cf08eb2 Added Farfetch to the list of companies using Airflow (#12260)
add 4f9439d Fix spelling (#12253)
add 0cd1c84 Remove providers imports from core examples (#12252)
add 938c512 Fix: Conditionally update button URL only when it is present
(#12268)
add e0b7cae Fix spelling (#12266)
add 7d5d334 Fix pause/unpause toggle to display failed state when
unsuccessful (#12267)
add 9b7e760 Docker context files should be available earlier (#12219)
add e03a3f4 Unify user session lifetime configuration (#11970)
add cbf4984 Don't treat warning message as rich formatting codes. (#12283)
add 348510f Providers in extras are properly configured and verified
(#12265)
add 21999dd Added k9s as integrated tool to help with kubernetes testing
(#12163)
add 0d51a12 Don't wrap warrning messages when stderr is not a TTY (#12285)
add cbe4ef2 Fix indentation for affinities in helm chart (#12288)
add 6b5640d Fix test - TestImpersonation (#12274)
add 3cd317e Remove unneeded parentheses from Python files (#12270)
add fbf874a Add an alias to improve git shortlog output (#12286)
add 388736b Detect partial examples DAGs for Google (#12277)
add 0d37c59 Make dag_id, task_id, and execution_date nullable in event
log schema (#12287)
add 7478e18 Handle naive datetimes in REST APIi (#12248)
add 289c9b5 Use default view in TriggerDagRunLink (#11778)
add 4f5e0ed Update INTHEWILD.md (#12293)
add 9276607 Add session_parameters option to snowflake_hook (#12071)
add fa2b033 Add reference for SubDagOperator (#12297)
add ee544b4 Replace remaining decorated DAGs reference (#12299)
add af2f2e8 Wait option for dagrun operator (#12126)
add 3c2c291 Python base image is shared between CI and PROD image (#12280)
add ae93fdb Remove deprecated BashTaskRunner (#12295)
add 5d5c119 Remove deprecated Elasticsearch Configs (#12296)
add 82eef2e Fix -
TestSchedulerJobQueriesCount::test_process_dags_queries_count (#12273)
add dd9ac78 Fix prod image build (#12314)
add af19b12 Deploy was not working from Breeze (#12319)
add 7f828b0 Get all "tags" parameters not just one (#12324)
add 571f831 Update automated PR labels (#12326)
add 32b59f8 Fixes the sending of an empty list to BigQuery `list_rows`
(#12307)
add ce06be4 Mount airflow.cfg to pod_template_file (#12311)
add 75f25bd Fix and Unquarantine test_change_state_for_tis_without_dagrun
(#12323)
add b027223 Add install/uninstall api to databricks hook (#12316)
add 7825e8f Docs installation improvements (#12304)
add c94b124 Add extra error handling to S3 remote logging (#9908)
add 7c4fe19 For v1-10-test PRs and pushes, use target branch scripts for
images (#12339)
add 1222ebd Create DAG-level cluster policy (#12184)
add 0284c98 Enable protection for v1-10-stable branch (#12343)
add 309b325 Update deprecated Apache Pinot Broker API (#12333)
add 450bd32 Improve presentation of DAG Docs (#12330)
add e5e47da Fix/Enhancement: Disable forms and communicate to user when
no DAG Runs (#12320)
add 3e4aa06 Bugfix: REST API Variables update endpoint returns 204 No
Content (#12321)
add 64978e3 Fix helm unit test for pod_template_file (#12345)
add 458ad93 Update & Fix 'Rotate Fernet Key' Doc (#12347)
add d54f087 Use the backend-configured model (#12336)
add 4e362c1 K8s yaml templates not rendered by k8sexecutor (#12303)
add 167b9b9 Simplifies check whether the CI image should be rebuilt
(#12181)
add 438b0a0 Fix Sample CLI commands for upgrading to 2.0 (#12349)
add aac3877 Add metric for scheduling delay between first run task &
expected start time (#9544)
add 648dd7c Restructure documentation for releasing Airflow/Providers
(#12350)
add 7f4d8c6 Fix Static-check failure (#12356)
add ba76eb4 Make nav fully accessible y keyboard, fix mobile nav menus
(#12351)
add 02ef8e1 Manage Flask AppBuilder Tables using Alembic Migrations
(#12352)
add 3a72fc8 Fix Description of Provider Docs (#12361)
add 7a280d3 Show all Providers in Docs (#12363)
add 6cb8e5c Fix case for PyPI in docs (#12364)
add 4c25e76 Refactor root logger handling in task run (#12342)
add f324973 Add success/failed sets to State class (#12359)
add 9e7b7ef Reorder Database Migrations (#12362)
add 1b77ebc Visually separate pre-commits which require CI image (#12367)
add bcb2437 Remove redundant method in KubernetesExecutor (#12317)
add 221f809 Fix full_pod_spec for k8spodoperator (#12354)
add c9d2b3c Remove unused import (#12371)
add 6889a33 Improvements for operators and hooks ref docs (#12366)
add cd88af8 Removes the cidfile before generation (#12372)
add 9ba8b31 Fix RTD docs build (#12373)
add 823b3aa Reject 'connections add' CLI request if URI provided is
invalid (#12370)
add 39ea872 Check for TaskGroup in _PythonDecoratedOperator (#12312)
add cbd6daf All kubernetes tests use the same host python version (#12374)
add cfa4ecf Add DataflowJobStatusSensor and support non-blocking
execution of jobs (#11726)
add 561e459 Proper exit status for failed CLI requests (#12375)
add 0038660 Fixes pull error on building tagged image (#12378)
add bfbbb24 Add extra info when starting extra actions in Breeze (#12377)
add 6d05108 Add info log message about duration taken to load plugins
(#12308)
add 6f0cf3f Remove unneeded parentheses after Black formatting (#12380)
add 3dd2c36 Fix spelling in AWS docs (#12379)
add 917e6c4 Add provide_file_and_upload to GCSHook (#12310)
add 1623df8 Use different deserialization method in XCom init_on_load
(#12327)
add d4e1ff2 Handle outdated webserver session timeout gracefully. (#12332)
add 35b5614 Remove inapplicable configuration section [ldap] (since
2.0.0) (#12386)
add 56ee2bb Support creation of configmaps & secrets and extra env &
envFrom configuration in Helm Chart (#12164)
add ae7cb4a Update wrong commit hash in backport provider changes (#12390)
add 80a957f Add Dataflow sensors - job metrics (#12039)
add 3e994ab Fix typo in check_environment.sh (#12395)
add b137831 Update asf.yaml INFRA link (#12398)
add 8cee95f Properly mocks UUID objects (#12381)
add 2cda2f2 Add missing pre-commit definition - provider-yamls (#12393)
add 0622385 Update Ash's github handle (#12403)
add bd7acc8 Fix broken master due to ash -> ashb change (#12408)
add 525f659 Remove CodeQL from PRS. (#12406)
add 2c0920f Adds mechanism for provider package discovery. (#12383)
add c38dadb Switching to Ubuntu 20.04 as Github Actions runner. (#12404)
add 7eb23db Update Kaxil's Github handle (#12409)
add efdba2c Add stack overflow link to Github Issues (#12407)
add a4aa32b Simplify using XComArg in jinja template string (#12405)
add 5b130c8 Clearer information for webserver_config.py (#12412)
add dc31ca4 The messages about remote image check are only shown with -v
(#12402)
add bf3ead1 Change log level for User's session to DEBUG (#12414)
add a80a320 Don't display when None (#12415)
add cab86d8 Make K8sPodOperator backwards compatible (#12384)
add 506ee1f Fix issues with Gantt View (#12419)
add 79e7c5f Fix spelling (#12421)
add 78e9e62 Enable Markdownlint rule MD045/no alt text (#12423)
add f4851f7 Fix Entrypoint and _CMD config variables (#12411)
add bc4bb30 Fix docstrings for Kubernetes Backcompat module (#12422)
add 82433e1 Fix typo (#12424)
add 8a8f54f Fix tests for missing example and system tests (#12425)
add 9b3a333 Enable Markdownlint rule MD046/code-block-style (#12429)
add 763b40d Raise correct Warning in
kubernetes/backcompat/volume_mount.py (#12432)
add 966ee7d JSON Response is returned for invalid API requests (#12305)
add c9f9d2c Optimize json schema validation in providers_manager (#12420)
add 4f0d6a6 Upgrade pyupgrade to v2.7.4 (#12434)
add 66e4446 Fix case of GitHub (#12433)
add ea865e4 Move import at the top of the file (#12431)
add fd36f96 Enable Markdownlint rule MD014/commands-show-output (#12430)
add fa36f33 PR to add 'files' to template-fields in EmailOperator class
(#12428)
add 4873d97 Enable Markdownlint rule MD003/heading-style/header-style
(#12427)
add 9b9fe45 Added `files` to templated fields of `EmailOperator` (#12435)
add a9c92b6 Synchronization of supported K8S version (#12443)
add bf6da16 Add description field to connection (#10873)
add 8d09506 Fix download method in GCSToBigQueryOperator (#12442)
add 26b244c Rename test_local_setting.py to test_settings.py (#12437)
add f034d4b Move setup properties out of setup.py in to setup.cfg (#12417)
add d4c3d32 Cope with '%' in password when waiting for migrations (#12440)
add b5f92c8 Cleanup requirements in README a bit (#12446)
add 7ca0b6f Enable Markdownlint rule MD003/heading-style/header-style
(#12427) (#12438)
add b584adb Fix bug in server timezone indicator (#12447)
add 0080354 Update provider READMEs for 1.0.0b2 batch release (#12449)
add 0da73e3 Edit FAQ to reference Airflow 2 as a solution to latency
problem, closes #12348 (#12450)
add c61a62b Automatically apply "area:UI" labels to PRs (#12452)
add 7c8b71d Fix backwards compatibility further (#12451)
add 93b3270 Fix broken CI.yml (#12454)
add d84a52d Fix broken example_kubernetes DAG (#12455)
add 411c686 Improve the layout of TI modal when browser at narrower
widths (#12456)
add d32fe78 Update readmes for cncf.kube provider fixes (#12457)
add f30c0a6 Fix typoe in migrations: RESOURCE_DAGS to RESOURCE_DAG.
(#12460)
add 25a8115 Fix failed KubernetesPodOperator tests (#12461)
add 94ba200 Bump version to 2.0.0b3 (#12462)
add a3dfd04 Webserver: Further Sanitize values passed to origin param
(#12459)
add 4b59ce8 Fix case of GitHub in comment (#12474)
add 3241719 Fix setup.py to install the right provider for mysql (#12476)
add 5ffb7f4 Fix failing test on Py3.8 (#12481)
add 13128f4 Fix Python docstring parameter (#12483)
add bc01907 Improve UI file naming/patterns (#12486)
add 9e3b2c5 GCP Secrets Optional Lookup (#12360)
add 8b95e51 Improve www.security.get_accessible_dags() and webserver
performance (#12458)
add fedf633 Remove unused/uncompiled JS file (#12490)
add 93d64e5 Update tag color to be neutral (and match DAGs index view)
(#12493)
add 9e089ab Fix Kube tests (#12479)
add de9d2fa ensure Moment date is valid before attempting to render it
(#12492)
add 502e883 Make kubernetes requirement optional for Example DAGs (#12494)
add e93b7e3 Improvements for transfer operators references (#12482)
add e9cfa39 Turn off foreign keys before altering table to prevent sqlite
issue. (#12487)
add 4428235 Fixes taskInstances API endpoint when start_date, end_date or
state are None(null) (#12453)
add 7d55d45 Reorder Migrations to make it 1.10.13 compatible (#12496)
add c3cf695 Unquarantine test_cli_webserver_background (#12501)
add c34ef85 Separate out documentation building per provider (#12444)
add 20843ff Add missing file_token field to get dag details API endpoint
(#12463)
add 36a9b0f Fix the default value for VaultBackend's config_path (#12518)
add 4495685 Temporarily allow force-push on v1-10-stable (#12524)
add fd62f60 Add Energy Solutions to INTHEWILD.md (#12523)
add f0b9aae Enable v1-10-stable branch protection (#12525)
add 234d689 Fix S3ToSnowflakeOperator docstring (#12504)
add 287ed49 Fix git archive command in Release Management guide (#12526)
add 3188b13 Fix wait-for-migrations command in helm chart (#12522)
add be8f1ac Fix build on RTD (#12529)
add 370e7d0 Fix Python Docstring parameters (#12513)
add 37548f0 Fixes unneeded docker-context-files added in CI (#12534)
add 397d912 Return nonzero exit codes on pool import errors. (#12095)
add 597717d update broken link to cli-and-env-variables-ref (#12540)
add 9eb92e7 Support installing providers with no dependencies via extras
(#12497)
add 0d796e7 Fix line breaks in CeleryKubernetesExecutor docs (#12538)
add f2569de Add example DAGs to provider docs (#12528)
add ef4af21 Move providers docs to separate package + Spell-check in a
common job with docs-build (#12527)
add 919e1d8 Fix sed command on MacOS (#12549)
add de15aa3 Deprecate Read the Docs (#12541)
add ff990f2 Add capability to specify gunicorn access log format (#10261)
add ed09915 [AIRFLOW-5115] Bugfix for S3KeySensor failing to accept
template_fields (#12389)
add 8e1a6e1 Fix build on RTD (#12551)
add c133df8 Troubleshooting moved to the installation page (#12533)
add c02a3f5 Spark-on-k8s sensor logs - properly pass defined namespace to
pod log call (#11199)
add ef0e34d Fix use of `a` vs `an` (#12542)
add dd3a8df Move doc around Manual Trigger Visual diff to Tree View page
(#12565)
add 753f53f Housekeeping for www/security.py (#12516)
add 47bc530 Add MTsolutions to companies using Airflow (#12566)
add c33d86f Quarantine test_cli_webserver_background (#12570)
add 2846e03 add Vestiaire Collective to INTHEWILD.md (#12572)
add f6ba8b5 Doc Fix around Secret/Connection/Variable (#12571)
add 01ff088 Fix Dag Serialization crash caused by preset DagContext
(#12530)
add 6d0dcd2 Use html urls instead of onclick for dags view links. (#12539)
add 3fa51f9 Add check for duplicates in provider.yaml files (#12578)
add 74ed92b Drop random.choice() in BaseHook.get_connection() (#12573)
add b57b932 Improve code quality of ExternalTaskSensor (#12574)
add 936566c limit table of content at the main Airflow doc page (#12561)
add a66d29f Dev documentation uses sphinx-airflow-theme (#12582)
add ce91991 Hide ToC from the Apache Airflow doc main page (#12589)
add 91af0dd Add link to docs index to table of contents (#12594)
add 6caf260 Don't set child tasks to schedulable in test runs (#12595)
add 9f28e41 Allow webserver to read pod logs directly (#12598)
add 58e21ed Adds missing licence headers (#12593)
add 663259d Fix AWS DataSync tests failing (#11020)
add c6467ba Update logging & doc for LocalFilesystem Secrets Backend
(#12597)
add 08251c1 Remove foreign key constraint on SerializedDagModel's
dag_runs field (#12586)
add c457c97 Use AIRFLOW_CONSTRAINTS_LOCATION when passed during docker
build (#12604)
add 4861344 Rename `[scheduler] max_threads` to `[scheduler]
parsing_processes` (#12605)
add 950d80b Revert "Hide ToC from the Apache Airflow doc main page
(#12589)" (#12607)
add cdaaff1 Fix Connection.description migration for MySQL8 (#12596)
add 6d6ca14 Fixes inconsistent behaviour of utf8mb4 encoding on Mysql
5.7/8 (#12614)
add 333c871 Fixes tests that was not compatible with MySQL8 (#12615)
add 0f10207 Add docs about tagging and pushing constraints file (#12625)
add c5700a5 Sync Airflow 1.10.13 Updating.md with Master (#12624)
add 324bc6f Make AzureKeyVaultBackend backwards-compatible (#12626)
add 4f4714f Fix session_lifetime_minutes config docs (#12628)
add 54adda5 Actually run against the version of the DB we select in the
matrix. (#12591)
add 8f29c6d fix db migration downgrade actions (#12608)
add eacf40d Ensure that the `prohibit_commit` guard only applies to _one_
session. (#12575)
add 8b9d52f Adds possibility of forcing upgrade constraint by setting a
label (#12635)
add f16fa09 Clean-up airflow/kubernetes/kube_config.py (#12627)
add 3a8c344 Add Changelog for Airflow 1.10.13 (#12623)
add cf718db Improved breeze messages for initialize-local-virtualenv and
static-check --help (#12640)
add b769209 Add Corsearch to in the wild (#12641)
add 6e9c110 Housekeeping: Remove 'dirty_ids' in www/views.py (#12645)
add c084393 Allows mounting local sources for github run-id images
(#12650)
add e1ebfa6 Add DataflowJobMessagesSensor and
DataflowAutoscalingEventsSensor (#12249)
add 5fafd98 Replace foreign key constraints with foreign annotation
(#12603)
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 5 +-
.github/ISSUE_TEMPLATE/config.yml | 3 +
.github/boring-cyborg.yml | 21 +-
.github/workflows/build-images-workflow-run.yml | 40 +-
.github/workflows/ci.yml | 129 +-
.github/workflows/codeql-analysis.yml | 10 +-
.github/workflows/delete_old_artifacts.yml | 2 +-
.github/workflows/label_when_reviewed.yml | 2 +-
.../workflows/label_when_reviewed_workflow_run.yml | 8 +-
.github/workflows/repo_sync.yml | 2 +-
.github/workflows/scheduled_quarantined.yml | 4 +-
.gitignore | 4 +
.mailmap | 3 +
.markdownlint.yml | 18 -
.pre-commit-config.yaml | 70 +-
.readthedocs.yml | 2 +
BREEZE.rst | 39 +-
CHANGELOG.txt | 134 +-
CI.rst | 15 +-
CONTRIBUTING.rst | 66 +-
Dockerfile | 3 +-
Dockerfile.ci | 16 +-
IMAGES.rst | 11 +-
INSTALL | 15 +-
INTHEWILD.md | 7 +
MANIFEST.in | 1 +
PULL_REQUEST_WORKFLOW.rst | 8 +-
README.md | 27 +-
STATIC_CODE_CHECKS.rst | 12 +-
TESTING.rst | 154 +-
UPDATING.md | 195 ++-
UPGRADING_TO_2.0.md | 68 +-
.../hooks => airflow/api_connexion}/__init__.py | 0
.../api_connexion/endpoints/dag_run_endpoint.py | 6 +-
.../api_connexion/endpoints/variable_endpoint.py | 2 +-
airflow/api_connexion/exceptions.py | 6 +-
airflow/api_connexion/openapi/v1.yaml | 21 +-
airflow/api_connexion/parameters.py | 6 +
airflow/api_connexion/schemas/dag_run_schema.py | 15 +-
airflow/api_connexion/schemas/dag_schema.py | 9 +
.../api_connexion/schemas/task_instance_schema.py | 25 +-
airflow/cli/cli_parser.py | 24 +-
airflow/cli/commands/connection_command.py | 43 +-
airflow/cli/commands/pool_command.py | 40 +-
airflow/cli/commands/task_command.py | 74 +-
airflow/cli/commands/variable_command.py | 4 +-
airflow/cli/commands/webserver_command.py | 6 +
airflow/config_templates/config.yml | 112 +-
airflow/config_templates/default_airflow.cfg | 38 +-
airflow/config_templates/default_test.cfg | 2 +-
airflow/configuration.py | 14 +-
airflow/contrib/secrets/azure_key_vault.py | 30 +
airflow/example_dags/example_dag_decorator.py | 29 +-
.../example_kubernetes_executor_config.py | 253 +--
airflow/executors/celery_executor.py | 5 +-
airflow/executors/kubernetes_executor.py | 32 +-
airflow/hooks/base_hook.py | 7 +-
airflow/jobs/base_job.py | 8 +-
airflow/jobs/scheduler_job.py | 2 +-
airflow/kubernetes/kube_config.py | 16 +-
airflow/kubernetes/pod.py | 33 +
airflow/kubernetes/pod_generator.py | 1 +
airflow/kubernetes/pod_runtime_info_env.py | 51 +-
airflow/kubernetes/volume.py | 31 +
airflow/kubernetes/volume_mount.py | 31 +
...6b6f902_increase_length_of_fab_ab_view_menu_.py | 90 ++
.../2c6edca13270_resource_based_permissions.py | 8 +-
.../364159666cbd_add_job_id_to_dagrun_table.py | 4 +-
.../versions/3c20cacc0044_add_dagrun_run_type.py | 2 +-
...a3f1493b9_add_k8s_yaml_to_rendered_templates.py | 2 +-
...73d9401f_add_description_field_to_connection.py | 54 +
...7aae_fix_description_field_in_connection_to_.py | 78 +
.../849da589634d_prefix_dag_permissions.py | 10 +-
.../versions/92c57b58940d_add_fab_tables.py | 182 +++
...606e2_add_scheduling_decision_to_dagrun_and_.py | 17 +
.../bbf4a7ad0465_remove_id_column_from_xcom.py | 1 -
.../bef4f3d11e8b_drop_kuberesourceversion_and_.py | 2 +-
.../e38be357a868_update_schema_for_smart_sensor.py | 4 +-
airflow/models/baseoperator.py | 8 +
airflow/models/connection.py | 9 +-
airflow/models/dag.py | 9 +
airflow/models/dagbag.py | 5 +-
airflow/models/dagrun.py | 44 +-
airflow/models/log.py | 2 +-
airflow/models/renderedtifields.py | 5 +-
airflow/models/serialized_dag.py | 5 +-
airflow/models/taskinstance.py | 5 +-
airflow/models/xcom.py | 29 +-
airflow/models/xcom_arg.py | 3 +-
airflow/operators/dagrun_operator.py | 49 +-
airflow/operators/email.py | 5 +-
airflow/operators/python.py | 20 +-
airflow/plugins_manager.py | 9 +
airflow/provider.yaml.schema.json | 179 +++
.../amazon/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../amazon/BACKPORT_PROVIDER_CHANGES_2020.11.23.md | 26 +
.../providers/amazon/BACKPORT_PROVIDER_README.md | 31 +-
.../providers/amazon/PROVIDER_CHANGES_1.0.0b2.md | 13 +
airflow/providers/amazon/README.md | 16 +-
.../amazon/aws/example_dags/example_datasync_1.py | 2 +-
.../amazon/aws/example_dags/example_datasync_2.py | 2 +-
airflow/providers/amazon/aws/hooks/base_aws.py | 2 +-
airflow/providers/amazon/aws/hooks/datasync.py | 8 +-
airflow/providers/amazon/aws/hooks/s3.py | 6 +-
.../amazon/aws/log/cloudwatch_task_handler.py | 8 +-
.../providers/amazon/aws/log/s3_task_handler.py | 34 +-
airflow/providers/amazon/aws/operators/datasync.py | 14 +-
airflow/providers/amazon/aws/operators/ecs.py | 2 +-
airflow/providers/amazon/aws/operators/glacier.py | 2 +-
airflow/providers/amazon/aws/sensors/glacier.py | 4 +
airflow/providers/amazon/aws/sensors/s3_key.py | 31 +-
.../amazon/aws/transfers/glacier_to_gcs.py | 2 +-
.../amazon/aws/transfers/google_api_to_s3.py | 9 +
.../amazon/aws/transfers/imap_attachment_to_s3.py | 2 +-
.../amazon/aws/transfers/s3_to_redshift.py | 2 +-
airflow/providers/amazon/provider.yaml | 324 ++++
.../BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../apache/cassandra/BACKPORT_PROVIDER_README.md | 2 +-
.../apache/cassandra/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/apache/cassandra/README.md | 13 +-
airflow/providers/apache/cassandra/provider.yaml | 43 +
.../providers/apache/cassandra/sensors/record.py | 2 +-
.../providers/apache/cassandra/sensors/table.py | 2 +-
.../druid/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../apache/druid/BACKPORT_PROVIDER_README.md | 2 +-
.../apache/druid/PROVIDER_CHANGES_1.0.0b2.md | 12 +
airflow/providers/apache/druid/README.md | 15 +-
airflow/providers/apache/druid/provider.yaml | 46 +
.../hdfs/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../apache/hdfs/BACKPORT_PROVIDER_README.md | 2 +-
.../apache/hdfs/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/apache/hdfs/README.md | 13 +-
airflow/providers/apache/hdfs/hooks/webhdfs.py | 2 +-
airflow/providers/apache/hdfs/provider.yaml | 50 +
.../hive/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../apache/hive/BACKPORT_PROVIDER_README.md | 2 +-
.../apache/hive/PROVIDER_CHANGES_1.0.0b2.md | 12 +
airflow/providers/apache/hive/README.md | 15 +-
.../hive/example_dags/example_twitter_README.md | 1 +
airflow/providers/apache/hive/provider.yaml | 68 +
.../apache/hive/sensors/named_hive_partition.py | 2 +-
.../kylin/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../apache/kylin/BACKPORT_PROVIDER_README.md | 2 +-
.../apache/kylin/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/apache/kylin/README.md | 13 +-
airflow/providers/apache/kylin/provider.yaml | 40 +
.../livy/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../apache/livy/BACKPORT_PROVIDER_README.md | 2 +-
.../apache/livy/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/apache/livy/README.md | 13 +-
airflow/providers/apache/livy/provider.yaml | 44 +
.../pig/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../apache/pig/BACKPORT_PROVIDER_README.md | 2 +-
.../apache/pig/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/apache/pig/README.md | 13 +-
airflow/providers/apache/pig/provider.yaml | 38 +
.../pinot/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../pinot/BACKPORT_PROVIDER_CHANGES_2020.11.23.md | 18 +
.../apache/pinot/BACKPORT_PROVIDER_README.md | 23 +-
.../apache/pinot/PROVIDER_CHANGES_1.0.0b2.md | 12 +
airflow/providers/apache/pinot/README.md | 15 +-
airflow/providers/apache/pinot/hooks/pinot.py | 13 +-
airflow/providers/apache/pinot/provider.yaml | 34 +
.../spark/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../apache/spark/BACKPORT_PROVIDER_README.md | 2 +-
.../apache/spark/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/apache/spark/README.md | 13 +-
.../providers/apache/spark/operators/spark_jdbc.py | 2 +-
.../providers/apache/spark/operators/spark_sql.py | 2 +-
.../apache/spark/operators/spark_submit.py | 2 +-
airflow/providers/apache/spark/provider.yaml | 46 +
.../sqoop/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../apache/sqoop/BACKPORT_PROVIDER_README.md | 2 +-
.../apache/sqoop/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/apache/sqoop/README.md | 13 +-
airflow/providers/apache/sqoop/provider.yaml | 39 +
.../celery/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/celery/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/celery/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/celery/README.md | 13 +-
airflow/providers/celery/provider.yaml | 34 +
.../BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/cloudant/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/cloudant/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/cloudant/README.md | 13 +-
airflow/providers/cloudant/provider.yaml | 34 +
.../BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../BACKPORT_PROVIDER_CHANGES_2020.11.23.md | 23 +
.../cncf/kubernetes/BACKPORT_PROVIDER_README.md | 30 +-
.../cncf/kubernetes/PROVIDER_CHANGES_1.0.0b2.md | 18 +
airflow/providers/cncf/kubernetes/README.md | 21 +-
.../cncf/kubernetes/backcompat}/__init__.py | 0
.../backcompat/backwards_compat_converters.py | 151 ++
.../providers/cncf/kubernetes/backcompat/pod.py | 110 ++
.../kubernetes/backcompat/pod_runtime_info_env.py | 46 +
.../providers/cncf/kubernetes/backcompat/volume.py | 64 +
.../cncf/kubernetes/backcompat/volume_mount.py | 62 +
.../kubernetes/example_dags/example_kubernetes.py | 58 +-
.../providers/cncf/kubernetes/hooks/kubernetes.py | 2 +-
.../cncf/kubernetes/operators/kubernetes_pod.py | 67 +-
airflow/providers/cncf/kubernetes/provider.yaml | 50 +
.../cncf/kubernetes/sensors/spark_kubernetes.py | 15 +-
.../BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../BACKPORT_PROVIDER_CHANGES_2020.11.23.md | 18 +
.../databricks/BACKPORT_PROVIDER_README.md | 23 +-
.../databricks/PROVIDER_CHANGES_1.0.0b2.md | 12 +
airflow/providers/databricks/README.md | 15 +-
airflow/providers/databricks/hooks/databricks.py | 25 +
.../providers/databricks/operators/databricks.py | 4 +
airflow/providers/databricks/provider.yaml | 40 +
.../BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/datadog/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/datadog/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/datadog/README.md | 13 +-
airflow/providers/datadog/provider.yaml | 40 +
.../BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/dingding/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/dingding/PROVIDER_CHANGES_1.0.0b2.md | 11 +
airflow/providers/dingding/README.md | 14 +-
.../dingding/example_dags/example_dingding.py | 6 +-
airflow/providers/dingding/provider.yaml | 41 +
.../BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/discord/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/discord/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/discord/README.md | 13 +-
airflow/providers/discord/provider.yaml | 39 +
.../docker/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/docker/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/docker/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/docker/README.md | 13 +-
airflow/providers/docker/provider.yaml | 45 +
.../BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../BACKPORT_PROVIDER_CHANGES_2020.11.13.md | 2 +-
.../elasticsearch/BACKPORT_PROVIDER_README.md | 4 +-
.../elasticsearch/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/elasticsearch/README.md | 13 +-
airflow/providers/elasticsearch/provider.yaml | 34 +
.../exasol/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/exasol/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/exasol/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/exasol/README.md | 13 +-
airflow/providers/exasol/provider.yaml | 40 +
.../BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/facebook/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/facebook/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/facebook/README.md | 13 +-
airflow/providers/facebook/provider.yaml | 34 +
.../ftp/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
airflow/providers/ftp/BACKPORT_PROVIDER_README.md | 2 +-
airflow/providers/ftp/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/ftp/README.md | 13 +-
airflow/providers/ftp/provider.yaml | 40 +
.../google/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../google/BACKPORT_PROVIDER_CHANGES_2020.11.13.md | 2 +-
.../google/BACKPORT_PROVIDER_CHANGES_2020.11.23.md | 24 +
.../providers/google/BACKPORT_PROVIDER_README.md | 37 +-
.../providers/google/PROVIDER_CHANGES_1.0.0b2.md | 22 +
airflow/providers/google/README.md | 31 +-
airflow/providers/google/__init__.py | 5 +-
airflow/providers/google/cloud/ADDITIONAL_INFO.md | 1 +
.../google/cloud/example_dags/example_dataflow.py | 94 ++
.../cloud/example_dags/example_stackdriver.py | 2 +-
airflow/providers/google/cloud/hooks/bigquery.py | 8 +-
.../cloud/hooks/cloud_storage_transfer_service.py | 2 +-
airflow/providers/google/cloud/hooks/dataflow.py | 247 ++-
airflow/providers/google/cloud/hooks/gcs.py | 32 +
airflow/providers/google/cloud/hooks/kms.py | 2 +-
airflow/providers/google/cloud/hooks/mlengine.py | 6 +-
.../providers/google/cloud/operators/cloud_sql.py | 2 +-
.../providers/google/cloud/operators/dataflow.py | 157 +-
.../google/cloud/operators/speech_to_text.py | 4 +-
.../google/cloud/secrets/secret_manager.py | 23 +-
airflow/providers/google/cloud/sensors/dataflow.py | 388 +++++
.../google/cloud/transfers/gcs_to_bigquery.py | 6 +-
.../google/cloud/transfers/local_to_gcs.py | 2 +-
.../google/cloud/transfers/postgres_to_gcs.py | 4 +-
.../google/cloud/utils/field_validator.py | 2 +-
.../google/cloud/utils/mlengine_operator_utils.py | 17 +-
.../cloud/utils/mlengine_prediction_summary.py | 6 +-
airflow/providers/google/provider.yaml | 632 ++++++++
.../grpc/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
airflow/providers/grpc/BACKPORT_PROVIDER_README.md | 2 +-
airflow/providers/grpc/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/grpc/README.md | 13 +-
airflow/providers/grpc/provider.yaml | 39 +
.../BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../BACKPORT_PROVIDER_CHANGES_2020.11.23.md | 16 +
.../hashicorp/BACKPORT_PROVIDER_README.md | 21 +-
.../hashicorp/PROVIDER_CHANGES_1.0.0b2.md | 11 +
airflow/providers/hashicorp/README.md | 14 +-
airflow/providers/hashicorp/provider.yaml | 34 +
airflow/providers/hashicorp/secrets/vault.py | 2 +-
.../http/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../http/BACKPORT_PROVIDER_CHANGES_2020.11.23.md | 17 +
airflow/providers/http/BACKPORT_PROVIDER_README.md | 22 +-
airflow/providers/http/PROVIDER_CHANGES_1.0.0b2.md | 11 +
airflow/providers/http/README.md | 14 +-
airflow/providers/http/hooks/http.py | 2 +-
airflow/providers/http/operators/http.py | 2 +-
airflow/providers/http/provider.yaml | 46 +
airflow/providers/http/sensors/http.py | 2 +-
.../imap/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
airflow/providers/imap/BACKPORT_PROVIDER_README.md | 2 +-
airflow/providers/imap/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/imap/README.md | 13 +-
airflow/providers/imap/provider.yaml | 40 +
.../jdbc/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
airflow/providers/jdbc/BACKPORT_PROVIDER_README.md | 2 +-
airflow/providers/jdbc/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/jdbc/README.md | 13 +-
airflow/providers/jdbc/operators/jdbc.py | 4 +
airflow/providers/jdbc/provider.yaml | 40 +
.../BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/jenkins/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/jenkins/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/jenkins/README.md | 13 +-
airflow/providers/jenkins/provider.yaml | 38 +
.../jira/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
airflow/providers/jira/BACKPORT_PROVIDER_README.md | 2 +-
airflow/providers/jira/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/jira/README.md | 13 +-
airflow/providers/jira/provider.yaml | 45 +
.../azure/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../azure/BACKPORT_PROVIDER_CHANGES_2020.11.23.md | 19 +
.../microsoft/azure/BACKPORT_PROVIDER_README.md | 24 +-
.../microsoft/azure/PROVIDER_CHANGES_1.0.0b2.md | 12 +
airflow/providers/microsoft/azure/README.md | 15 +-
airflow/providers/microsoft/azure/provider.yaml | 126 ++
.../microsoft/azure/transfers/azure_blob_to_gcs.py | 2 +-
.../microsoft/azure/transfers/local_to_adls.py | 2 +-
.../mssql/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../mssql/BACKPORT_PROVIDER_CHANGES_2020.11.23.md | 15 +
.../microsoft/mssql/BACKPORT_PROVIDER_README.md | 20 +-
.../microsoft/mssql/PROVIDER_CHANGES_1.0.0b2.md | 11 +
airflow/providers/microsoft/mssql/README.md | 14 +-
airflow/providers/microsoft/mssql/provider.yaml | 39 +
.../winrm/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../winrm/BACKPORT_PROVIDER_CHANGES_2020.11.23.md | 16 +
.../microsoft/winrm/BACKPORT_PROVIDER_README.md | 21 +-
.../microsoft/winrm/PROVIDER_CHANGES_1.0.0b2.md | 11 +
airflow/providers/microsoft/winrm/README.md | 14 +-
airflow/providers/microsoft/winrm/provider.yaml | 40 +
.../mongo/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/mongo/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/mongo/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/mongo/README.md | 13 +-
airflow/providers/mongo/provider.yaml | 39 +
.../mysql/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/mysql/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/mysql/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/mysql/README.md | 13 +-
airflow/providers/mysql/operators/mysql.py | 4 +
airflow/providers/mysql/provider.yaml | 53 +
.../odbc/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
airflow/providers/odbc/BACKPORT_PROVIDER_README.md | 2 +-
airflow/providers/odbc/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/odbc/README.md | 13 +-
airflow/providers/odbc/hooks/odbc.py | 2 +-
airflow/providers/odbc/provider.yaml | 34 +
.../BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/openfaas/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/openfaas/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/openfaas/README.md | 13 +-
airflow/providers/openfaas/provider.yaml | 34 +
.../BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/opsgenie/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/opsgenie/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/opsgenie/README.md | 13 +-
airflow/providers/opsgenie/provider.yaml | 39 +
.../oracle/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/oracle/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/oracle/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/oracle/README.md | 13 +-
airflow/providers/oracle/provider.yaml | 42 +
.../BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../pagerduty/BACKPORT_PROVIDER_README.md | 2 +-
.../pagerduty/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/pagerduty/README.md | 13 +-
airflow/providers/pagerduty/provider.yaml | 35 +
.../papermill/PROVIDER_CHANGES_1.0.0b2.md | 9 +
airflow/providers/papermill/README.md | 12 +-
airflow/providers/papermill/provider.yaml | 36 +
.../plexus/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/plexus/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/plexus/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/plexus/README.md | 13 +-
airflow/providers/plexus/provider.yaml | 38 +
.../BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/postgres/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/postgres/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/postgres/README.md | 13 +-
airflow/providers/postgres/provider.yaml | 40 +
.../presto/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/presto/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/presto/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/presto/README.md | 13 +-
airflow/providers/presto/provider.yaml | 34 +
.../qubole/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/qubole/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/qubole/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/qubole/README.md | 13 +-
airflow/providers/qubole/provider.yaml | 47 +
.../redis/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/redis/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/redis/PROVIDER_CHANGES_1.0.0b2.md | 11 +
airflow/providers/redis/README.md | 14 +-
airflow/providers/redis/operators/redis_publish.py | 2 +-
airflow/providers/redis/provider.yaml | 46 +
.../BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../salesforce/BACKPORT_PROVIDER_README.md | 2 +-
.../salesforce/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/salesforce/README.md | 13 +-
airflow/providers/salesforce/provider.yaml | 46 +
.../samba/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/samba/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/samba/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/samba/README.md | 13 +-
airflow/providers/samba/provider.yaml | 35 +
.../BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/segment/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/segment/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/segment/README.md | 13 +-
airflow/providers/segment/provider.yaml | 40 +
.../providers/sendgrid/PROVIDER_CHANGES_1.0.0b1.md | 12 +
.../providers/sendgrid/PROVIDER_CHANGES_1.0.0b2.md | 8 +
airflow/providers/sendgrid/README.md | 80 +
airflow/providers/sendgrid/provider.yaml | 25 +
airflow/providers/sendgrid/utils/emailer.py | 2 +-
.../sftp/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
airflow/providers/sftp/BACKPORT_PROVIDER_README.md | 2 +-
airflow/providers/sftp/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/sftp/README.md | 13 +-
airflow/providers/sftp/provider.yaml | 45 +
.../BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../singularity/BACKPORT_PROVIDER_README.md | 2 +-
.../singularity/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/singularity/README.md | 13 +-
airflow/providers/singularity/provider.yaml | 35 +
.../slack/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/slack/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/slack/PROVIDER_CHANGES_1.0.0b2.md | 11 +
airflow/providers/slack/README.md | 14 +-
airflow/providers/slack/provider.yaml | 42 +
.../BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../BACKPORT_PROVIDER_CHANGES_2020.11.23.md | 19 +
.../snowflake/BACKPORT_PROVIDER_README.md | 25 +-
.../snowflake/PROVIDER_CHANGES_1.0.0b2.md | 12 +
airflow/providers/snowflake/README.md | 16 +-
airflow/providers/snowflake/hooks/snowflake.py | 3 +
airflow/providers/snowflake/operators/snowflake.py | 12 +-
airflow/providers/snowflake/provider.yaml | 50 +
.../snowflake/transfers/s3_to_snowflake.py | 8 +-
.../snowflake/transfers/snowflake_to_slack.py | 4 +
.../sqlite/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/sqlite/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/sqlite/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/sqlite/README.md | 13 +-
airflow/providers/sqlite/provider.yaml | 40 +
.../ssh/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
airflow/providers/ssh/BACKPORT_PROVIDER_README.md | 2 +-
airflow/providers/ssh/PROVIDER_CHANGES_1.0.0b2.md | 11 +
airflow/providers/ssh/README.md | 14 +-
airflow/providers/ssh/provider.yaml | 40 +
.../BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/vertica/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/vertica/PROVIDER_CHANGES_1.0.0b2.md | 11 +
airflow/providers/vertica/README.md | 14 +-
airflow/providers/vertica/provider.yaml | 40 +
.../yandex/BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/yandex/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/yandex/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/yandex/README.md | 13 +-
.../yandex/operators/yandexcloud_dataproc.py | 4 -
airflow/providers/yandex/provider.yaml | 49 +
.../BACKPORT_PROVIDER_CHANGES_2020.10.29.md | 2 +-
.../providers/zendesk/BACKPORT_PROVIDER_README.md | 2 +-
.../providers/zendesk/PROVIDER_CHANGES_1.0.0b2.md | 10 +
airflow/providers/zendesk/README.md | 13 +-
airflow/providers/zendesk/provider.yaml | 35 +
airflow/providers_manager.py | 87 ++
airflow/secrets/base_secrets.py | 5 +-
airflow/secrets/environment_variables.py | 3 +-
airflow/secrets/local_filesystem.py | 10 +-
airflow/secrets/metastore.py | 3 +-
airflow/sensors/external_task_sensor.py | 86 +-
airflow/settings.py | 95 +-
airflow/utils/dag_processing.py | 4 +-
airflow/utils/docs.py | 4 +-
airflow/utils/helpers.py | 12 +
airflow/utils/log/colored_log.py | 5 +-
airflow/utils/sqlalchemy.py | 6 +-
airflow/utils/state.py | 10 +
airflow/version.py | 2 +-
airflow/www/app.py | 8 +-
airflow/www/extensions/init_appbuilder.py | 2 +-
airflow/www/extensions/init_session.py | 20 -
airflow/www/extensions/init_views.py | 20 +-
airflow/www/forms.py | 1 +
airflow/www/security.py | 26 +-
airflow/www/static/css/bootstrap-theme.css | 26 +-
airflow/www/static/css/main.css | 36 +-
airflow/www/static/css/switch.css | 16 +-
airflow/www/static/js/base.js | 233 ---
airflow/www/static/js/graph.js | 63 -
airflow/www/static/js/main.js | 225 +++
airflow/www/static/js/task-instances.js | 12 +-
airflow/www/templates/airflow/chart.html | 7 +-
airflow/www/templates/airflow/dag.html | 61 +-
airflow/www/templates/airflow/dag_details.html | 2 +-
airflow/www/templates/airflow/dags.html | 65 +-
airflow/www/templates/airflow/duration_chart.html | 7 +-
airflow/www/templates/airflow/gantt.html | 9 +-
airflow/www/templates/airflow/graph.html | 11 +-
airflow/www/templates/airflow/main.html | 101 ++
airflow/www/templates/airflow/master.html | 101 --
airflow/www/templates/airflow/tree.html | 10 +-
airflow/www/templates/appbuilder/dag_docs.html | 41 +
airflow/www/templates/appbuilder/navbar_menu.html | 4 +-
airflow/www/templates/appbuilder/navbar_right.html | 10 +-
airflow/www/utils.py | 3 +-
airflow/www/views.py | 98 +-
airflow/www/webpack.config.js | 3 +-
breeze | 22 +-
breeze-complete | 8 +-
chart/README.md | 36 +-
chart/files/pod-template-file.kubernetes-helm-yaml | 35 +-
chart/requirements.lock | 4 +-
chart/templates/_helpers.yaml | 20 +-
chart/templates/{ => configmaps}/configmap.yaml | 0
chart/templates/configmaps/extra-configmaps.yaml | 45 +
chart/templates/create-user-job.yaml | 2 +
chart/templates/flower/flower-deployment.yaml | 2 +-
chart/templates/migrate-database-job.yaml | 2 +
chart/templates/rbac/pod-log-reader-role.yaml | 56 +
.../templates/rbac/pod-log-reader-rolebinding.yaml | 53 +
.../templates/scheduler/scheduler-deployment.yaml | 10 +-
chart/templates/secrets/extra-secrets.yaml | 51 +
.../templates/webserver/webserver-deployment.yaml | 8 +-
chart/templates/workers/worker-deployment.yaml | 10 +-
chart/tests/helm_template_generator.py | 12 +
chart/tests/test_basic_helm_chart.py | 4 +-
chart/tests/test_celery_kubernetes_executor.py | 2 +-
chart/tests/test_extra_configmaps_secrets.py | 110 ++
chart/tests/test_extra_env_env_from.py | 117 ++
chart/tests/test_git_sync_webserver.py | 4 +-
chart/tests/test_git_sync_worker.py | 4 +-
chart/tests/test_pod_template_file.py | 72 +
chart/values.schema.json | 48 +
chart/values.yaml | 52 +
clients/README.md | 4 +-
dev/PROVIDER_PACKAGES.md | 338 ----
dev/PROVIDER_PACKAGE_DETAILS.md | 340 ++++
dev/README.md | 1484 +-----------------
dev/README_RELEASE_AIRFLOW.md | 599 +++++++
dev/README_RELEASE_PROVIDER_PACKAGES.md | 923 +++++++++++
dev/import_all_classes.py | 2 +-
dev/provider_packages/MANIFEST_TEMPLATE.in.jinja2 | 2 +
dev/provider_packages/README.md | 18 +-
dev/provider_packages/prepare_provider_packages.py | 5 +-
.../refactor_provider_packages.py | 18 +
dev/sign.sh | 6 +-
docs/README.rst | 126 ++
docs/apache-airflow-providers-amazon/index.rst | 34 +
.../index.rst | 34 +
.../index.rst | 28 +
.../apache-airflow-providers-apache-hdfs/index.rst | 29 +
.../apache-airflow-providers-apache-hive/index.rst | 35 +
.../index.rst | 35 +
.../apache-airflow-providers-apache-livy/index.rst | 34 +
docs/apache-airflow-providers-apache-pig/index.rst | 34 +
.../index.rst | 28 +
.../index.rst | 34 +
.../index.rst | 28 +
docs/apache-airflow-providers-celery/index.rst | 29 +
docs/apache-airflow-providers-cloudant/index.rst | 29 +
.../index.rst | 35 +
docs/apache-airflow-providers-databricks/index.rst | 35 +
docs/apache-airflow-providers-datadog/index.rst | 29 +
docs/apache-airflow-providers-dingding/index.rst | 35 +
docs/apache-airflow-providers-discord/index.rst | 29 +
docs/apache-airflow-providers-docker/index.rst | 35 +
.../index.rst | 29 +
docs/apache-airflow-providers-exasol/index.rst | 29 +
docs/apache-airflow-providers-facebook/index.rst | 29 +
docs/apache-airflow-providers-ftp/index.rst | 29 +
.../api-auth-backend/google-openid.rst | 69 +
.../configurations-ref.rst | 71 +
.../connections/gcp.rst | 231 +++
.../connections}/gcp_sql.rst | 0
.../connections/gcp_ssh.rst | 73 +
.../connections/index.rst | 25 +
.../example-dags.rst | 27 +
docs/apache-airflow-providers-google/index.rst | 45 +
.../logging/gcs.rst | 57 +
.../logging/index.rst | 25 +
.../logging/stackdriver.rst | 63 +
.../operators/_partials/prerequisite_tasks.rst | 33 +
.../operators/ads.rst | 68 +
.../operators/cloud/automl.rst | 199 +++
.../operators/cloud/bigquery.rst | 379 +++++
.../operators/cloud/bigquery_dts.rst | 137 ++
.../operators/cloud/bigtable.rst | 202 +++
.../operators/cloud/cloud_build.rst | 126 ++
.../operators/cloud/cloud_memorystore.rst | 279 ++++
.../cloud/cloud_memorystore_memcached.rst | 158 ++
.../operators/cloud/cloud_sql.rst | 572 +++++++
.../cloud/cloud_storage_transfer_service.rst | 379 +++++
.../operators/cloud/compute.rst | 292 ++++
.../operators/cloud/compute_ssh.rst | 72 +
.../operators/cloud/data_loss_prevention.rst | 327 ++++
.../operators/cloud/datacatalog.rst | 614 ++++++++
.../operators/cloud/datafusion.rst | 231 +++
.../operators/cloud/dataprep.rst | 108 ++
.../operators/cloud/dataproc.rst | 188 +++
.../operators/cloud/datastore.rst | 173 +++
.../operators/cloud/functions.rst | 192 +++
.../operators/cloud/gcs.rst | 147 ++
.../operators}/cloud/index.rst | 0
.../operators/cloud/kubernetes_engine.rst | 146 ++
.../operators/cloud/life_sciences.rst | 79 +
.../operators/cloud/mlengine.rst | 233 +++
.../operators/cloud/natural_language.rst | 182 +++
.../operators/cloud/pubsub.rst | 145 ++
.../operators/cloud/spanner.rst | 280 ++++
.../operators/cloud/speech_to_text.rst | 81 +
.../operators/cloud/stackdriver.rst | 231 +++
.../operators/cloud/text_to_speech.rst | 81 +
.../operators/cloud/translate.rst | 83 +
.../operators/cloud/translate_speech.rst | 82 +
.../operators/cloud/video_intelligence.rst | 205 +++
.../operators/cloud/vision.rst | 1029 ++++++++++++
.../operators/firebase/firestore.rst | 65 +
.../operators}/index.rst | 0
.../operators/marketing_platform/analytics.rst | 86 ++
.../marketing_platform/campaign_manager.rst | 166 ++
.../operators/marketing_platform/display_video.rst | 226 +++
.../operators}/marketing_platform/index.rst | 0
.../operators/marketing_platform/search_ads.rst | 94 ++
.../operators/suite/sheets.rst | 67 +
.../operators/transfer/azure_fileshare_to_gcs.rst | 54 +
.../operators/transfer/facebook_ads_to_gcs.rst | 52 +
.../operators/transfer/gcs_to_gcs.rst | 240 +++
.../operators/transfer/gcs_to_gdrive.rst | 90 ++
.../operators/transfer/gcs_to_local.rst | 57 +
.../operators/transfer/gcs_to_sftp.rst | 104 ++
.../operators/transfer/gcs_to_sheets.rst | 52 +
.../operators}/transfer/index.rst | 0
.../operators/transfer/local_to_gcs.rst | 58 +
.../operators/transfer/mysql_to_gcs.rst | 58 +
.../operators/transfer/presto_to_gcs.rst | 142 ++
.../operators}/transfer/s3_to_gcs.rst | 0
.../operators/transfer/salesforce_to_gcs.rst | 49 +
.../operators/transfer/sftp_to_gcs.rst | 106 ++
.../operators/transfer/sheets_to_gcs.rst | 52 +
.../google-cloud-secret-manager-backend.rst | 191 +++
docs/apache-airflow-providers-grpc/index.rst | 29 +
docs/apache-airflow-providers-hashicorp/index.rst | 29 +
docs/apache-airflow-providers-http/index.rst | 35 +
docs/apache-airflow-providers-imap/index.rst | 29 +
docs/apache-airflow-providers-jdbc/index.rst | 35 +
docs/apache-airflow-providers-jenkins/index.rst | 35 +
docs/apache-airflow-providers-jira/index.rst | 29 +
.../index.rst | 35 +
.../index.rst | 29 +
.../index.rst | 35 +
docs/apache-airflow-providers-mongo/index.rst | 29 +
docs/apache-airflow-providers-mysql/index.rst | 35 +
docs/apache-airflow-providers-odbc/index.rst | 29 +
docs/apache-airflow-providers-openfaas/index.rst | 29 +
docs/apache-airflow-providers-opsgenie/index.rst | 29 +
docs/apache-airflow-providers-oracle/index.rst | 29 +
docs/apache-airflow-providers-pagerduty/index.rst | 29 +
docs/apache-airflow-providers-papermill/index.rst | 35 +
docs/apache-airflow-providers-plexus/index.rst | 35 +
docs/apache-airflow-providers-postgres/index.rst | 29 +
docs/apache-airflow-providers-presto/index.rst | 29 +
docs/apache-airflow-providers-qubole/index.rst | 35 +
docs/apache-airflow-providers-redis/index.rst | 29 +
docs/apache-airflow-providers-salesforce/index.rst | 35 +
docs/apache-airflow-providers-samba/index.rst | 29 +
docs/apache-airflow-providers-segment/index.rst | 29 +
docs/apache-airflow-providers-sendgrid/index.rst | 29 +
docs/apache-airflow-providers-sftp/index.rst | 29 +
.../apache-airflow-providers-singularity/index.rst | 35 +
docs/apache-airflow-providers-slack/index.rst | 29 +
docs/apache-airflow-providers-snowflake/index.rst | 35 +
docs/apache-airflow-providers-sqlite/index.rst | 29 +
docs/apache-airflow-providers-ssh/index.rst | 29 +
docs/apache-airflow-providers-vertica/index.rst | 29 +
docs/apache-airflow-providers-yandex/index.rst | 35 +
docs/apache-airflow-providers-zendesk/index.rst | 29 +
docs/apache-airflow-providers/index.rst | 131 ++
.../operators-and-hooks-ref/apache.rst | 42 +
.../operators-and-hooks-ref/aws.rst | 43 +
.../operators-and-hooks-ref/azure.rst | 42 +
.../operators-and-hooks-ref/google.rst | 83 +
.../operators-and-hooks-ref/index.rst | 26 +
.../operators-and-hooks-ref/protocol.rst | 38 +
.../operators-and-hooks-ref/services.rst | 38 +
.../operators-and-hooks-ref/software.rst | 38 +
docs/apache-airflow-providers/packages-ref.rst | 62 +
docs/autoapi_templates/index.rst | 294 ----
docs/build_docs.py | 956 ++++--------
docs/concepts.rst | 158 +-
docs/conf.py | 442 +++---
docs/dag-run.rst | 2 +-
docs/executor/celery_kubernetes.rst | 2 +-
docs/extra-packages-ref.rst | 228 +++
docs/exts/airflow_intersphinx.py | 198 +++
docs/exts/{ => docs_build}/__init__.py | 0
docs/exts/docs_build/code_utils.py | 62 +
docs/exts/docs_build/dev_index_generator.py | 80 +
.../exts/docs_build/dev_index_template.html.jinja2 | 54 +
docs/exts/docs_build/errors.py | 104 ++
docs/exts/docs_build/lint_checks.py | 228 +++
docs/exts/docs_build/spelling_checks.py | 172 +++
.../operators_and_hooks_ref-transfers.rst.jinja2 | 17 +
docs/exts/operators_and_hooks_ref.py | 267 ++++
docs/exts/operators_and_hooks_ref.rst.jinja2 | 19 +
docs/exts/provider_yaml_utils.py | 64 +
docs/exts/providers_packages_ref.py | 39 +
docs/exts/redirects.py | 3 -
docs/exts/sphinx_script_update.py | 20 +-
docs/faq.rst | 33 +-
docs/howto/connection/aws.rst | 14 +-
docs/howto/connection/azure.rst | 2 +-
docs/howto/connection/gcp.rst | 230 ---
docs/howto/connection/gcp_ssh.rst | 73 -
docs/howto/connection/index.rst | 4 +
docs/howto/initialize-database.rst | 4 +-
docs/howto/operator/amazon/aws/emr.rst | 2 +-
.../google/_partials/prerequisite_tasks.rst | 33 -
docs/howto/operator/google/ads.rst | 68 -
docs/howto/operator/google/cloud/automl.rst | 199 ---
docs/howto/operator/google/cloud/bigquery.rst | 379 -----
docs/howto/operator/google/cloud/bigquery_dts.rst | 137 --
docs/howto/operator/google/cloud/bigtable.rst | 202 ---
docs/howto/operator/google/cloud/cloud_build.rst | 126 --
.../operator/google/cloud/cloud_memorystore.rst | 279 ----
.../google/cloud/cloud_memorystore_memcached.rst | 158 --
docs/howto/operator/google/cloud/cloud_sql.rst | 572 -------
.../cloud/cloud_storage_transfer_service.rst | 379 -----
docs/howto/operator/google/cloud/compute.rst | 292 ----
docs/howto/operator/google/cloud/compute_ssh.rst | 72 -
.../operator/google/cloud/data_loss_prevention.rst | 327 ----
docs/howto/operator/google/cloud/datacatalog.rst | 614 --------
docs/howto/operator/google/cloud/datafusion.rst | 231 ---
docs/howto/operator/google/cloud/dataprep.rst | 108 --
docs/howto/operator/google/cloud/dataproc.rst | 188 ---
docs/howto/operator/google/cloud/datastore.rst | 173 ---
docs/howto/operator/google/cloud/functions.rst | 192 ---
docs/howto/operator/google/cloud/gcs.rst | 147 --
.../operator/google/cloud/kubernetes_engine.rst | 146 --
docs/howto/operator/google/cloud/life_sciences.rst | 79 -
docs/howto/operator/google/cloud/mlengine.rst | 233 ---
.../operator/google/cloud/natural_language.rst | 182 ---
docs/howto/operator/google/cloud/pubsub.rst | 145 --
docs/howto/operator/google/cloud/spanner.rst | 280 ----
.../howto/operator/google/cloud/speech_to_text.rst | 81 -
docs/howto/operator/google/cloud/stackdriver.rst | 231 ---
.../howto/operator/google/cloud/text_to_speech.rst | 81 -
docs/howto/operator/google/cloud/translate.rst | 83 -
.../operator/google/cloud/translate_speech.rst | 82 -
.../operator/google/cloud/video_intelligence.rst | 205 ---
docs/howto/operator/google/cloud/vision.rst | 1029 ------------
docs/howto/operator/google/firebase/firestore.rst | 65 -
.../google/marketing_platform/analytics.rst | 86 --
.../google/marketing_platform/campaign_manager.rst | 166 --
.../google/marketing_platform/display_video.rst | 226 ---
.../google/marketing_platform/search_ads.rst | 94 --
docs/howto/operator/google/suite/sheets.rst | 67 -
.../google/transfer/azure_fileshare_to_gcs.rst | 54 -
.../google/transfer/facebook_ads_to_gcs.rst | 52 -
docs/howto/operator/google/transfer/gcs_to_gcs.rst | 240 ---
.../operator/google/transfer/gcs_to_gdrive.rst | 90 --
.../operator/google/transfer/gcs_to_local.rst | 57 -
.../howto/operator/google/transfer/gcs_to_sftp.rst | 104 --
.../operator/google/transfer/gcs_to_sheets.rst | 52 -
.../operator/google/transfer/local_to_gcs.rst | 58 -
.../operator/google/transfer/mysql_to_gcs.rst | 58 -
.../operator/google/transfer/presto_to_gcs.rst | 142 --
.../operator/google/transfer/salesforce_to_gcs.rst | 49 -
.../howto/operator/google/transfer/sftp_to_gcs.rst | 106 --
.../operator/google/transfer/sheets_to_gcs.rst | 52 -
docs/howto/operator/index.rst | 1 -
docs/howto/operator/kubernetes.rst | 2 +-
.../microsoft/transfer/blob_storage_to_gcs.rst | 2 +-
docs/howto/set-config.rst | 1 -
docs/howto/variable.rst | 2 +-
docs/img/aws-web-identity-federation-gcp.png | Bin 0 -> 40170 bytes
docs/index.rst | 4 +-
docs/installation.rst | 253 +--
docs/list-roles.sh | 25 +
docs/logging-monitoring/logging-tasks.rst | 89 +-
docs/logging-monitoring/metrics.rst | 27 +-
docs/operators-and-hooks-ref.rst | 1634 +-------------------
docs/production-deployment.rst | 43 +
docs/project.rst | 4 +-
docs/rest-api-ref.rst | 4 +-
docs/rtd-deprecation/404.html | 27 +
docs/rtd-deprecation/conf.py | 20 +
docs/rtd-deprecation/index.rst | 23 +
docs/security/api.rst | 53 -
docs/security/flower.rst | 2 +-
docs/security/secrets/fernet.rst | 4 +-
.../aws-secrets-manaager-backend.rst | 15 +
.../aws-ssm-parameter-store-secrets-backend.rst | 16 +
.../azure-key-vault-secrets-backend.rst | 15 +
.../google-cloud-secret-manager-backend.rst | 16 +
.../hashicorp-vault-secrets-backend.rst | 15 +
.../local-filesystem-secrets-backend.rst | 2 +-
docs/security/webserver.rst | 3 +-
docs/spelling_wordlist.txt | 21 +-
docs/start_doc_server.sh | 2 +-
docs/templates/layout.html | 37 -
docs/tutorial.rst | 2 +-
docs/ui.rst | 9 +
images/testing/k9s.png | Bin 0 -> 238713 bytes
images/testing/kubeconfig-env.png | Bin 0 -> 231280 bytes
images/testing/kubernetes-virtualenv.png | Bin 0 -> 110011 bytes
images/testing/pytest-runner.png | Bin 0 -> 131589 bytes
images/testing/run-test.png | Bin 0 -> 140728 bytes
kubernetes_tests/test_kubernetes_executor.py | 7 +-
kubernetes_tests/test_kubernetes_pod_operator.py | 73 +-
.../test_kubernetes_pod_operator_backcompat.py | 689 +++++++++
manifests/.gitignore | 2 +-
scripts/ci/docker-compose/backend-mysql.yml | 2 +
scripts/ci/dockerfiles/bats/Dockerfile | 17 +
.../krb5-kdc-server/utils/create_admin.sh | 2 +-
scripts/ci/dockerfiles/stress/Dockerfile | 17 +
scripts/ci/images/ci_build_dockerhub.sh | 5 +
.../ci/kubernetes/ci_deploy_app_to_kubernetes.sh | 32 -
scripts/ci/kubernetes/ci_run_kubernetes_tests.sh | 15 +-
...tup_cluster_and_deploy_airflow_to_kubernetes.sh | 33 +
scripts/ci/kubernetes/kind-cluster-conf.yaml | 5 +
scripts/ci/kubernetes/nodeport.yaml | 31 +
scripts/ci/kubernetes/redeploy_airflow.sh | 28 +
scripts/ci/libraries/_build_images.sh | 182 ++-
scripts/ci/libraries/_initialization.sh | 17 +-
scripts/ci/libraries/_kind.sh | 127 +-
scripts/ci/libraries/_push_pull_remove_images.sh | 9 +-
scripts/ci/openapi/client_codegen_diff.sh | 2 +-
.../pre_commit_check_extras_have_providers.py | 67 +
.../ci/pre_commit/pre_commit_check_order_setup.py | 22 +-
.../pre_commit_check_provider_yaml_files.py | 342 ++++
.../pre_commit_check_setup_extra_packages_ref.py | 122 ++
.../pre_commit_check_setup_installation.py | 119 --
scripts/ci/pre_commit/pre_commit_sync_version.sh | 3 +-
scripts/ci/selective_ci_checks.sh | 57 +-
scripts/in_container/_in_container_utils.sh | 6 +-
scripts/in_container/airflow_ci.cfg | 2 +-
scripts/in_container/check_environment.sh | 11 +-
scripts/in_container/prod/entrypoint_prod.sh | 30 +-
scripts/in_container/quarantine_issue_header.md | 1 +
scripts/in_container/run_ci_tests.sh | 8 +-
scripts/in_container/run_docs_build.sh | 7 +-
scripts/in_container/run_mypy.sh | 12 +-
setup.cfg | 117 +-
setup.py | 215 +--
tests/always/test_project_structure.py | 149 +-
tests/api_connexion/endpoints/test_dag_endpoint.py | 39 +-
.../endpoints/test_dag_run_endpoint.py | 49 +-
.../endpoints/test_event_log_endpoint.py | 16 +-
.../endpoints/test_task_instance_endpoint.py | 135 ++
.../endpoints/test_variable_endpoint.py | 3 +-
tests/api_connexion/schemas/test_dag_schema.py | 9 +
tests/api_connexion/test_error_handling.py | 52 +
tests/api_connexion/test_parameters.py | 22 +-
tests/cli/commands/test_connection_command.py | 69 +-
tests/cli/commands/test_pool_command.py | 19 +
tests/cli/commands/test_task_command.py | 89 +-
tests/cli/commands/test_variable_command.py | 3 +-
tests/cli/commands/test_webserver_command.py | 52 +
tests/cluster_policies/__init__.py | 34 +
tests/core/test_config_templates.py | 1 -
tests/core/test_configuration.py | 16 +-
tests/core/test_core.py | 2 +-
tests/core/test_impersonation_tests.py | 7 +-
tests/core/test_local_settings.py | 182 ---
tests/core/test_providers_manager.py | 91 ++
tests/core/test_settings.py | 213 +++
tests/dags/README.md | 1 +
tests/dags/test_dag_with_no_tags.py | 31 +
tests/dags_corrupted/README.md | 3 +-
tests/executors/test_celery_executor.py | 2 +-
tests/jobs/test_scheduler_job.py | 76 +-
tests/kubernetes/test_pod_generator.py | 9 +
tests/models/test_dagbag.py | 22 +-
tests/models/test_dagrun.py | 117 +-
tests/models/test_renderedtifields.py | 4 +-
tests/models/test_taskinstance.py | 3 +-
tests/models/test_xcom.py | 16 +
tests/models/test_xcom_arg.py | 15 +-
tests/operators/test_dagrun_operator.py | 36 +-
tests/operators/test_email.py | 3 +
tests/operators/test_generic_transfer.py | 4 +-
tests/operators/test_python.py | 18 +
tests/plugins/test_plugins_manager.py | 84 +-
.../amazon/aws/hooks/test_batch_waiters.py | 1 +
.../amazon/aws/hooks/test_cloud_formation.py | 10 +-
tests/providers/amazon/aws/hooks/test_datasync.py | 21 +-
.../amazon/aws/log/test_cloudwatch_task_handler.py | 10 +-
.../amazon/aws/log/test_s3_task_handler.py | 24 +-
.../amazon/aws/operators/test_datasync.py | 63 +-
tests/providers/amazon/aws/sensors/test_s3_key.py | 47 +-
tests/providers/amazon/aws/sensors/test_sqs.py | 2 +-
tests/providers/apache/pinot/hooks/test_pinot.py | 6 +-
.../kubernetes/operators/test_kubernetes_pod.py | 154 +-
.../kubernetes/sensors/test_spark_kubernetes.py | 4 +-
.../providers/databricks/hooks/test_databricks.py | 56 +
tests/providers/dingding/hooks/test_dingding.py | 6 +-
.../providers/google/cloud/hooks/test_bigquery.py | 23 +-
.../providers/google/cloud/hooks/test_dataflow.py | 378 +++--
tests/providers/google/cloud/hooks/test_gcs.py | 31 +-
tests/providers/google/cloud/hooks/test_pubsub.py | 3 +-
.../google/cloud/operators/test_dataflow_system.py | 4 +
.../google/cloud/operators/test_mlengine_utils.py | 1 +
.../google/cloud/secrets/test_secret_manager.py | 43 +
.../google/cloud/sensors/test_dataflow.py | 299 ++++
.../google/common/hooks/test_base_google.py | 2 +-
.../google/firebase/hooks/test_firestore.py | 2 +-
.../azure/secrets/test_azure_key_vault.py | 6 +-
tests/providers/snowflake/hooks/test_snowflake.py | 3 +-
tests/serialization/test_dag_serialization.py | 7 +-
.../task/task_runner/test_standard_task_runner.py | 4 +
tests/test_utils/README.md | 1 +
tests/utils/test_dag_processing.py | 2 +-
tests/utils/test_docs.py | 14 +-
tests/utils/test_helpers.py | 13 +-
tests/utils/test_operator_helpers.py | 10 +-
tests/utils/test_process_utils.py | 2 +-
tests/utils/test_sqlalchemy.py | 38 +-
tests/www/test_app.py | 11 +
tests/www/test_security.py | 27 +
tests/www/test_utils.py | 4 +-
tests/www/test_views.py | 34 +-
936 files changed, 32615 insertions(+), 18003 deletions(-)
copy {tests/providers/zendesk/hooks => airflow/api_connexion}/__init__.py
(100%)
create mode 100644 airflow/contrib/secrets/azure_key_vault.py
create mode 100644 airflow/kubernetes/pod.py
create mode 100644 airflow/kubernetes/volume.py
create mode 100644 airflow/kubernetes/volume_mount.py
create mode 100644
airflow/migrations/versions/03afc6b6f902_increase_length_of_fab_ab_view_menu_.py
create mode 100644
airflow/migrations/versions/61ec73d9401f_add_description_field_to_connection.py
create mode 100644
airflow/migrations/versions/64a7d6477aae_fix_description_field_in_connection_to_.py
create mode 100644 airflow/migrations/versions/92c57b58940d_add_fab_tables.py
create mode 100644 airflow/provider.yaml.schema.json
create mode 100644
airflow/providers/amazon/BACKPORT_PROVIDER_CHANGES_2020.11.23.md
create mode 100644 airflow/providers/amazon/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/amazon/provider.yaml
create mode 100644
airflow/providers/apache/cassandra/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/apache/cassandra/provider.yaml
create mode 100644 airflow/providers/apache/druid/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/apache/druid/provider.yaml
create mode 100644 airflow/providers/apache/hdfs/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/apache/hdfs/provider.yaml
create mode 100644 airflow/providers/apache/hive/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/apache/hive/provider.yaml
create mode 100644 airflow/providers/apache/kylin/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/apache/kylin/provider.yaml
create mode 100644 airflow/providers/apache/livy/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/apache/livy/provider.yaml
create mode 100644 airflow/providers/apache/pig/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/apache/pig/provider.yaml
create mode 100644
airflow/providers/apache/pinot/BACKPORT_PROVIDER_CHANGES_2020.11.23.md
create mode 100644 airflow/providers/apache/pinot/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/apache/pinot/provider.yaml
create mode 100644 airflow/providers/apache/spark/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/apache/spark/provider.yaml
create mode 100644 airflow/providers/apache/sqoop/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/apache/sqoop/provider.yaml
create mode 100644 airflow/providers/celery/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/celery/provider.yaml
create mode 100644 airflow/providers/cloudant/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/cloudant/provider.yaml
create mode 100644
airflow/providers/cncf/kubernetes/BACKPORT_PROVIDER_CHANGES_2020.11.23.md
create mode 100644
airflow/providers/cncf/kubernetes/PROVIDER_CHANGES_1.0.0b2.md
copy {tests/providers/zendesk/hooks =>
airflow/providers/cncf/kubernetes/backcompat}/__init__.py (100%)
create mode 100644
airflow/providers/cncf/kubernetes/backcompat/backwards_compat_converters.py
create mode 100644 airflow/providers/cncf/kubernetes/backcompat/pod.py
create mode 100644
airflow/providers/cncf/kubernetes/backcompat/pod_runtime_info_env.py
create mode 100644 airflow/providers/cncf/kubernetes/backcompat/volume.py
create mode 100644 airflow/providers/cncf/kubernetes/backcompat/volume_mount.py
create mode 100644 airflow/providers/cncf/kubernetes/provider.yaml
create mode 100644
airflow/providers/databricks/BACKPORT_PROVIDER_CHANGES_2020.11.23.md
create mode 100644 airflow/providers/databricks/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/databricks/provider.yaml
create mode 100644 airflow/providers/datadog/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/datadog/provider.yaml
create mode 100644 airflow/providers/dingding/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/dingding/provider.yaml
create mode 100644 airflow/providers/discord/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/discord/provider.yaml
create mode 100644 airflow/providers/docker/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/docker/provider.yaml
create mode 100644 airflow/providers/elasticsearch/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/elasticsearch/provider.yaml
create mode 100644 airflow/providers/exasol/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/exasol/provider.yaml
create mode 100644 airflow/providers/facebook/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/facebook/provider.yaml
create mode 100644 airflow/providers/ftp/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/ftp/provider.yaml
create mode 100644
airflow/providers/google/BACKPORT_PROVIDER_CHANGES_2020.11.23.md
create mode 100644 airflow/providers/google/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/google/cloud/sensors/dataflow.py
create mode 100644 airflow/providers/google/provider.yaml
create mode 100644 airflow/providers/grpc/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/grpc/provider.yaml
create mode 100644
airflow/providers/hashicorp/BACKPORT_PROVIDER_CHANGES_2020.11.23.md
create mode 100644 airflow/providers/hashicorp/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/hashicorp/provider.yaml
create mode 100644
airflow/providers/http/BACKPORT_PROVIDER_CHANGES_2020.11.23.md
create mode 100644 airflow/providers/http/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/http/provider.yaml
create mode 100644 airflow/providers/imap/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/imap/provider.yaml
create mode 100644 airflow/providers/jdbc/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/jdbc/provider.yaml
create mode 100644 airflow/providers/jenkins/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/jenkins/provider.yaml
create mode 100644 airflow/providers/jira/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/jira/provider.yaml
create mode 100644
airflow/providers/microsoft/azure/BACKPORT_PROVIDER_CHANGES_2020.11.23.md
create mode 100644
airflow/providers/microsoft/azure/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/microsoft/azure/provider.yaml
create mode 100644
airflow/providers/microsoft/mssql/BACKPORT_PROVIDER_CHANGES_2020.11.23.md
create mode 100644
airflow/providers/microsoft/mssql/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/microsoft/mssql/provider.yaml
create mode 100644
airflow/providers/microsoft/winrm/BACKPORT_PROVIDER_CHANGES_2020.11.23.md
create mode 100644
airflow/providers/microsoft/winrm/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/microsoft/winrm/provider.yaml
create mode 100644 airflow/providers/mongo/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/mongo/provider.yaml
create mode 100644 airflow/providers/mysql/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/mysql/provider.yaml
create mode 100644 airflow/providers/odbc/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/odbc/provider.yaml
create mode 100644 airflow/providers/openfaas/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/openfaas/provider.yaml
create mode 100644 airflow/providers/opsgenie/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/opsgenie/provider.yaml
create mode 100644 airflow/providers/oracle/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/oracle/provider.yaml
create mode 100644 airflow/providers/pagerduty/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/pagerduty/provider.yaml
create mode 100644 airflow/providers/papermill/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/papermill/provider.yaml
create mode 100644 airflow/providers/plexus/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/plexus/provider.yaml
create mode 100644 airflow/providers/postgres/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/postgres/provider.yaml
create mode 100644 airflow/providers/presto/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/presto/provider.yaml
create mode 100644 airflow/providers/qubole/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/qubole/provider.yaml
create mode 100644 airflow/providers/redis/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/redis/provider.yaml
create mode 100644 airflow/providers/salesforce/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/salesforce/provider.yaml
create mode 100644 airflow/providers/samba/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/samba/provider.yaml
create mode 100644 airflow/providers/segment/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/segment/provider.yaml
create mode 100644 airflow/providers/sendgrid/PROVIDER_CHANGES_1.0.0b1.md
create mode 100644 airflow/providers/sendgrid/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/sendgrid/README.md
create mode 100644 airflow/providers/sendgrid/provider.yaml
create mode 100644 airflow/providers/sftp/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/sftp/provider.yaml
create mode 100644 airflow/providers/singularity/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/singularity/provider.yaml
create mode 100644 airflow/providers/slack/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/slack/provider.yaml
create mode 100644
airflow/providers/snowflake/BACKPORT_PROVIDER_CHANGES_2020.11.23.md
create mode 100644 airflow/providers/snowflake/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/snowflake/provider.yaml
create mode 100644 airflow/providers/sqlite/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/sqlite/provider.yaml
create mode 100644 airflow/providers/ssh/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/ssh/provider.yaml
create mode 100644 airflow/providers/vertica/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/vertica/provider.yaml
create mode 100644 airflow/providers/yandex/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/yandex/provider.yaml
create mode 100644 airflow/providers/zendesk/PROVIDER_CHANGES_1.0.0b2.md
create mode 100644 airflow/providers/zendesk/provider.yaml
create mode 100644 airflow/providers_manager.py
delete mode 100644 airflow/www/static/js/base.js
delete mode 100644 airflow/www/static/js/graph.js
create mode 100644 airflow/www/static/js/main.js
create mode 100644 airflow/www/templates/airflow/main.html
delete mode 100644 airflow/www/templates/airflow/master.html
create mode 100644 airflow/www/templates/appbuilder/dag_docs.html
rename chart/templates/{ => configmaps}/configmap.yaml (100%)
create mode 100644 chart/templates/configmaps/extra-configmaps.yaml
create mode 100644 chart/templates/rbac/pod-log-reader-role.yaml
create mode 100644 chart/templates/rbac/pod-log-reader-rolebinding.yaml
create mode 100644 chart/templates/secrets/extra-secrets.yaml
create mode 100644 chart/tests/test_extra_configmaps_secrets.py
create mode 100644 chart/tests/test_extra_env_env_from.py
delete mode 100644 dev/PROVIDER_PACKAGES.md
create mode 100644 dev/PROVIDER_PACKAGE_DETAILS.md
create mode 100644 dev/README_RELEASE_AIRFLOW.md
create mode 100644 dev/README_RELEASE_PROVIDER_PACKAGES.md
create mode 100644 docs/README.rst
create mode 100644 docs/apache-airflow-providers-amazon/index.rst
create mode 100644 docs/apache-airflow-providers-apache-cassandra/index.rst
create mode 100644 docs/apache-airflow-providers-apache-druid/index.rst
create mode 100644 docs/apache-airflow-providers-apache-hdfs/index.rst
create mode 100644 docs/apache-airflow-providers-apache-hive/index.rst
create mode 100644 docs/apache-airflow-providers-apache-kylin/index.rst
create mode 100644 docs/apache-airflow-providers-apache-livy/index.rst
create mode 100644 docs/apache-airflow-providers-apache-pig/index.rst
create mode 100644 docs/apache-airflow-providers-apache-pinot/index.rst
create mode 100644 docs/apache-airflow-providers-apache-spark/index.rst
create mode 100644 docs/apache-airflow-providers-apache-sqoop/index.rst
create mode 100644 docs/apache-airflow-providers-celery/index.rst
create mode 100644 docs/apache-airflow-providers-cloudant/index.rst
create mode 100644 docs/apache-airflow-providers-cncf-kubernetes/index.rst
create mode 100644 docs/apache-airflow-providers-databricks/index.rst
create mode 100644 docs/apache-airflow-providers-datadog/index.rst
create mode 100644 docs/apache-airflow-providers-dingding/index.rst
create mode 100644 docs/apache-airflow-providers-discord/index.rst
create mode 100644 docs/apache-airflow-providers-docker/index.rst
create mode 100644 docs/apache-airflow-providers-elasticsearch/index.rst
create mode 100644 docs/apache-airflow-providers-exasol/index.rst
create mode 100644 docs/apache-airflow-providers-facebook/index.rst
create mode 100644 docs/apache-airflow-providers-ftp/index.rst
create mode 100644
docs/apache-airflow-providers-google/api-auth-backend/google-openid.rst
create mode 100644 docs/apache-airflow-providers-google/configurations-ref.rst
create mode 100644 docs/apache-airflow-providers-google/connections/gcp.rst
rename docs/{howto/connection =>
apache-airflow-providers-google/connections}/gcp_sql.rst (100%)
create mode 100644 docs/apache-airflow-providers-google/connections/gcp_ssh.rst
create mode 100644 docs/apache-airflow-providers-google/connections/index.rst
create mode 100644 docs/apache-airflow-providers-google/example-dags.rst
create mode 100644 docs/apache-airflow-providers-google/index.rst
create mode 100644 docs/apache-airflow-providers-google/logging/gcs.rst
create mode 100644 docs/apache-airflow-providers-google/logging/index.rst
create mode 100644 docs/apache-airflow-providers-google/logging/stackdriver.rst
create mode 100644
docs/apache-airflow-providers-google/operators/_partials/prerequisite_tasks.rst
create mode 100644 docs/apache-airflow-providers-google/operators/ads.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/automl.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/bigquery.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/bigquery_dts.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/bigtable.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/cloud_build.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/cloud_memorystore.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/cloud_memorystore_memcached.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/cloud_sql.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/cloud_storage_transfer_service.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/compute.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/compute_ssh.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/data_loss_prevention.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/datacatalog.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/datafusion.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/dataprep.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/dataproc.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/datastore.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/functions.rst
create mode 100644 docs/apache-airflow-providers-google/operators/cloud/gcs.rst
rename docs/{howto/operator/google =>
apache-airflow-providers-google/operators}/cloud/index.rst (100%)
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/kubernetes_engine.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/life_sciences.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/mlengine.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/natural_language.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/pubsub.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/spanner.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/speech_to_text.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/stackdriver.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/text_to_speech.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/translate.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/translate_speech.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/video_intelligence.rst
create mode 100644
docs/apache-airflow-providers-google/operators/cloud/vision.rst
create mode 100644
docs/apache-airflow-providers-google/operators/firebase/firestore.rst
rename docs/{howto/operator/google =>
apache-airflow-providers-google/operators}/index.rst (100%)
create mode 100644
docs/apache-airflow-providers-google/operators/marketing_platform/analytics.rst
create mode 100644
docs/apache-airflow-providers-google/operators/marketing_platform/campaign_manager.rst
create mode 100644
docs/apache-airflow-providers-google/operators/marketing_platform/display_video.rst
rename docs/{howto/operator/google =>
apache-airflow-providers-google/operators}/marketing_platform/index.rst (100%)
create mode 100644
docs/apache-airflow-providers-google/operators/marketing_platform/search_ads.rst
create mode 100644
docs/apache-airflow-providers-google/operators/suite/sheets.rst
create mode 100644
docs/apache-airflow-providers-google/operators/transfer/azure_fileshare_to_gcs.rst
create mode 100644
docs/apache-airflow-providers-google/operators/transfer/facebook_ads_to_gcs.rst
create mode 100644
docs/apache-airflow-providers-google/operators/transfer/gcs_to_gcs.rst
create mode 100644
docs/apache-airflow-providers-google/operators/transfer/gcs_to_gdrive.rst
create mode 100644
docs/apache-airflow-providers-google/operators/transfer/gcs_to_local.rst
create mode 100644
docs/apache-airflow-providers-google/operators/transfer/gcs_to_sftp.rst
create mode 100644
docs/apache-airflow-providers-google/operators/transfer/gcs_to_sheets.rst
rename docs/{howto/operator/google =>
apache-airflow-providers-google/operators}/transfer/index.rst (100%)
create mode 100644
docs/apache-airflow-providers-google/operators/transfer/local_to_gcs.rst
create mode 100644
docs/apache-airflow-providers-google/operators/transfer/mysql_to_gcs.rst
create mode 100644
docs/apache-airflow-providers-google/operators/transfer/presto_to_gcs.rst
rename docs/{howto/operator/google =>
apache-airflow-providers-google/operators}/transfer/s3_to_gcs.rst (100%)
create mode 100644
docs/apache-airflow-providers-google/operators/transfer/salesforce_to_gcs.rst
create mode 100644
docs/apache-airflow-providers-google/operators/transfer/sftp_to_gcs.rst
create mode 100644
docs/apache-airflow-providers-google/operators/transfer/sheets_to_gcs.rst
create mode 100644
docs/apache-airflow-providers-google/secrets-backends/google-cloud-secret-manager-backend.rst
create mode 100644 docs/apache-airflow-providers-grpc/index.rst
create mode 100644 docs/apache-airflow-providers-hashicorp/index.rst
create mode 100644 docs/apache-airflow-providers-http/index.rst
create mode 100644 docs/apache-airflow-providers-imap/index.rst
create mode 100644 docs/apache-airflow-providers-jdbc/index.rst
create mode 100644 docs/apache-airflow-providers-jenkins/index.rst
create mode 100644 docs/apache-airflow-providers-jira/index.rst
create mode 100644 docs/apache-airflow-providers-microsoft-azure/index.rst
create mode 100644 docs/apache-airflow-providers-microsoft-mssql/index.rst
create mode 100644 docs/apache-airflow-providers-microsoft-winrm/index.rst
create mode 100644 docs/apache-airflow-providers-mongo/index.rst
create mode 100644 docs/apache-airflow-providers-mysql/index.rst
create mode 100644 docs/apache-airflow-providers-odbc/index.rst
create mode 100644 docs/apache-airflow-providers-openfaas/index.rst
create mode 100644 docs/apache-airflow-providers-opsgenie/index.rst
create mode 100644 docs/apache-airflow-providers-oracle/index.rst
create mode 100644 docs/apache-airflow-providers-pagerduty/index.rst
create mode 100644 docs/apache-airflow-providers-papermill/index.rst
create mode 100644 docs/apache-airflow-providers-plexus/index.rst
create mode 100644 docs/apache-airflow-providers-postgres/index.rst
create mode 100644 docs/apache-airflow-providers-presto/index.rst
create mode 100644 docs/apache-airflow-providers-qubole/index.rst
create mode 100644 docs/apache-airflow-providers-redis/index.rst
create mode 100644 docs/apache-airflow-providers-salesforce/index.rst
create mode 100644 docs/apache-airflow-providers-samba/index.rst
create mode 100644 docs/apache-airflow-providers-segment/index.rst
create mode 100644 docs/apache-airflow-providers-sendgrid/index.rst
create mode 100644 docs/apache-airflow-providers-sftp/index.rst
create mode 100644 docs/apache-airflow-providers-singularity/index.rst
create mode 100644 docs/apache-airflow-providers-slack/index.rst
create mode 100644 docs/apache-airflow-providers-snowflake/index.rst
create mode 100644 docs/apache-airflow-providers-sqlite/index.rst
create mode 100644 docs/apache-airflow-providers-ssh/index.rst
create mode 100644 docs/apache-airflow-providers-vertica/index.rst
create mode 100644 docs/apache-airflow-providers-yandex/index.rst
create mode 100644 docs/apache-airflow-providers-zendesk/index.rst
create mode 100644 docs/apache-airflow-providers/index.rst
create mode 100644
docs/apache-airflow-providers/operators-and-hooks-ref/apache.rst
create mode 100644
docs/apache-airflow-providers/operators-and-hooks-ref/aws.rst
create mode 100644
docs/apache-airflow-providers/operators-and-hooks-ref/azure.rst
create mode 100644
docs/apache-airflow-providers/operators-and-hooks-ref/google.rst
create mode 100644
docs/apache-airflow-providers/operators-and-hooks-ref/index.rst
create mode 100644
docs/apache-airflow-providers/operators-and-hooks-ref/protocol.rst
create mode 100644
docs/apache-airflow-providers/operators-and-hooks-ref/services.rst
create mode 100644
docs/apache-airflow-providers/operators-and-hooks-ref/software.rst
create mode 100644 docs/apache-airflow-providers/packages-ref.rst
create mode 100644 docs/extra-packages-ref.rst
create mode 100644 docs/exts/airflow_intersphinx.py
copy docs/exts/{ => docs_build}/__init__.py (100%)
create mode 100644 docs/exts/docs_build/code_utils.py
create mode 100644 docs/exts/docs_build/dev_index_generator.py
create mode 100644 docs/exts/docs_build/dev_index_template.html.jinja2
create mode 100644 docs/exts/docs_build/errors.py
create mode 100644 docs/exts/docs_build/lint_checks.py
create mode 100644 docs/exts/docs_build/spelling_checks.py
create mode 100644 docs/exts/operators_and_hooks_ref-transfers.rst.jinja2
create mode 100644 docs/exts/operators_and_hooks_ref.py
create mode 100644 docs/exts/operators_and_hooks_ref.rst.jinja2
create mode 100644 docs/exts/provider_yaml_utils.py
create mode 100644 docs/exts/providers_packages_ref.py
delete mode 100644 docs/howto/connection/gcp.rst
delete mode 100644 docs/howto/connection/gcp_ssh.rst
delete mode 100644 docs/howto/operator/google/_partials/prerequisite_tasks.rst
delete mode 100644 docs/howto/operator/google/ads.rst
delete mode 100644 docs/howto/operator/google/cloud/automl.rst
delete mode 100644 docs/howto/operator/google/cloud/bigquery.rst
delete mode 100644 docs/howto/operator/google/cloud/bigquery_dts.rst
delete mode 100644 docs/howto/operator/google/cloud/bigtable.rst
delete mode 100644 docs/howto/operator/google/cloud/cloud_build.rst
delete mode 100644 docs/howto/operator/google/cloud/cloud_memorystore.rst
delete mode 100644
docs/howto/operator/google/cloud/cloud_memorystore_memcached.rst
delete mode 100644 docs/howto/operator/google/cloud/cloud_sql.rst
delete mode 100644
docs/howto/operator/google/cloud/cloud_storage_transfer_service.rst
delete mode 100644 docs/howto/operator/google/cloud/compute.rst
delete mode 100644 docs/howto/operator/google/cloud/compute_ssh.rst
delete mode 100644 docs/howto/operator/google/cloud/data_loss_prevention.rst
delete mode 100644 docs/howto/operator/google/cloud/datacatalog.rst
delete mode 100644 docs/howto/operator/google/cloud/datafusion.rst
delete mode 100644 docs/howto/operator/google/cloud/dataprep.rst
delete mode 100644 docs/howto/operator/google/cloud/dataproc.rst
delete mode 100644 docs/howto/operator/google/cloud/datastore.rst
delete mode 100644 docs/howto/operator/google/cloud/functions.rst
delete mode 100644 docs/howto/operator/google/cloud/gcs.rst
delete mode 100644 docs/howto/operator/google/cloud/kubernetes_engine.rst
delete mode 100644 docs/howto/operator/google/cloud/life_sciences.rst
delete mode 100644 docs/howto/operator/google/cloud/mlengine.rst
delete mode 100644 docs/howto/operator/google/cloud/natural_language.rst
delete mode 100644 docs/howto/operator/google/cloud/pubsub.rst
delete mode 100644 docs/howto/operator/google/cloud/spanner.rst
delete mode 100644 docs/howto/operator/google/cloud/speech_to_text.rst
delete mode 100644 docs/howto/operator/google/cloud/stackdriver.rst
delete mode 100644 docs/howto/operator/google/cloud/text_to_speech.rst
delete mode 100644 docs/howto/operator/google/cloud/translate.rst
delete mode 100644 docs/howto/operator/google/cloud/translate_speech.rst
delete mode 100644 docs/howto/operator/google/cloud/video_intelligence.rst
delete mode 100644 docs/howto/operator/google/cloud/vision.rst
delete mode 100644 docs/howto/operator/google/firebase/firestore.rst
delete mode 100644 docs/howto/operator/google/marketing_platform/analytics.rst
delete mode 100644
docs/howto/operator/google/marketing_platform/campaign_manager.rst
delete mode 100644
docs/howto/operator/google/marketing_platform/display_video.rst
delete mode 100644 docs/howto/operator/google/marketing_platform/search_ads.rst
delete mode 100644 docs/howto/operator/google/suite/sheets.rst
delete mode 100644
docs/howto/operator/google/transfer/azure_fileshare_to_gcs.rst
delete mode 100644 docs/howto/operator/google/transfer/facebook_ads_to_gcs.rst
delete mode 100644 docs/howto/operator/google/transfer/gcs_to_gcs.rst
delete mode 100644 docs/howto/operator/google/transfer/gcs_to_gdrive.rst
delete mode 100644 docs/howto/operator/google/transfer/gcs_to_local.rst
delete mode 100644 docs/howto/operator/google/transfer/gcs_to_sftp.rst
delete mode 100644 docs/howto/operator/google/transfer/gcs_to_sheets.rst
delete mode 100644 docs/howto/operator/google/transfer/local_to_gcs.rst
delete mode 100644 docs/howto/operator/google/transfer/mysql_to_gcs.rst
delete mode 100644 docs/howto/operator/google/transfer/presto_to_gcs.rst
delete mode 100644 docs/howto/operator/google/transfer/salesforce_to_gcs.rst
delete mode 100644 docs/howto/operator/google/transfer/sftp_to_gcs.rst
delete mode 100644 docs/howto/operator/google/transfer/sheets_to_gcs.rst
create mode 100644 docs/img/aws-web-identity-federation-gcp.png
create mode 100644 docs/list-roles.sh
create mode 100644 docs/rtd-deprecation/404.html
create mode 100644 docs/rtd-deprecation/conf.py
create mode 100644 docs/rtd-deprecation/index.rst
delete mode 100644 docs/templates/layout.html
create mode 100644 images/testing/k9s.png
create mode 100644 images/testing/kubeconfig-env.png
create mode 100644 images/testing/kubernetes-virtualenv.png
create mode 100644 images/testing/pytest-runner.png
create mode 100644 images/testing/run-test.png
create mode 100644 kubernetes_tests/test_kubernetes_pod_operator_backcompat.py
delete mode 100755 scripts/ci/kubernetes/ci_deploy_app_to_kubernetes.sh
create mode 100755
scripts/ci/kubernetes/ci_setup_cluster_and_deploy_airflow_to_kubernetes.sh
create mode 100644 scripts/ci/kubernetes/nodeport.yaml
create mode 100755 scripts/ci/kubernetes/redeploy_airflow.sh
create mode 100755
scripts/ci/pre_commit/pre_commit_check_extras_have_providers.py
create mode 100755
scripts/ci/pre_commit/pre_commit_check_provider_yaml_files.py
create mode 100755
scripts/ci/pre_commit/pre_commit_check_setup_extra_packages_ref.py
delete mode 100755 scripts/ci/pre_commit/pre_commit_check_setup_installation.py
create mode 100644 tests/api_connexion/test_error_handling.py
delete mode 100644 tests/core/test_local_settings.py
create mode 100644 tests/core/test_providers_manager.py
create mode 100644 tests/core/test_settings.py
create mode 100644 tests/dags/test_dag_with_no_tags.py
create mode 100644 tests/providers/google/cloud/sensors/test_dataflow.py
