This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to tag nightly-master
in repository https://gitbox.apache.org/repos/asf/airflow.git.
*** WARNING: tag nightly-master was modified! ***
from 77e0a6e (commit)
to 2102122 (commit)
from 77e0a6e Add EBANX company to README.md (#10012)
add e68471a Cancel duplicate runs and HEAD runs that failed at specific
jobs (#10008)
add f149ca9 Add unit tests for samba provider (#9959)
add 1d9a634 Add airflow config get-value command (#9932)
add c12e33e Use consistent message in
SchedulerJob._process_executor_events (#9929)
add 7df41f5 Simplify if clauses in ExternalTaskSensor (#9968)
add 8de5ea3 Create a short-link for Airflow Slack Invites (#10034)
add 21371b6 Introduce BaseExecutor.validate_command to avoid duplication
(#10033)
add c70c38e Move e-mail operator to core (#10013)
add 2e0d91d Set pytest version to be < 6.0.0 due to breaking changes
(#10043)
add 1508c43 Adding new SageMaker operator for ProcessingJobs (#9594)
add 59cbff0 Fix docstrings in BigQueryGetDataOperator (#10042)
add ba2d640 Add typing for jira provider (#10005)
add 3f2eee1 Fix PythonVirtualenvOperator not working with Airflow context
(#9394)
add 7df724d UI Graph View: Focus upstream / downstream task dependencies
on mouseover (#9303)
add 116f861 Burst Virtualenv Cache for Kubernetes Testing (#10070)
add 06166fa Update writing in timezone.rst (#10066)
add 88c1603 Improve docstring note about GKEStartPodOperator on
KubernetesPodOperator (#10049)
add 03c4351 Allow `image` in `KubernetesPodOperator` to be templated
(#10068)
add 4c84661 Split Display Video 360 example into smaler DAGs (#10077)
add f1fd3e2 Fix typo on reattach property of kubernetespodoperator
(#10056)
add 2b8dea6 Fix typo in Athena sensor retries (#10079)
add 30b0aec Pin google-cloud-kms to ..,<2.0.0 due to breaking changes
(#10088)
add dacfad4 Group UPDATING.md entries into sections (#10090)
add 7f9173e Move the contribution workflow to the beginning of the file
(#10092)
add 402e22c Combine entries in logging configuration section (#10094)
add aeea712 Remove `args` parameter from provider operator constructors
(#10097)
add 3fff9e9 Minor fixes in CONTRIBUTING.rst (#10101)
add 33646db Move Naming Conventions section in CONTRIBUTING.rst (#10103)
add db1dae3 Create "major changes" section in UPDATING.md (#10100)
add bd3d55c More user-oriented change titles in Python API sections
(#10099)
add 8aaa2af Update .asf.yaml (#10110)
add ca3fa76 Add unit tests for mlengine_prediction_summary (#10022)
add 4ee35d0 Fix hook not passing gcp_conn_id to base class (#10075)
add b79466c Fix sensor not providing arguments for GCSHook (#10074)
add 5fe7da9 Combine entries in UPDATING.md file (#10102)
add 011c07a Add migration guide for CLI commands (#10078)
add 85c56b1 Add missing params to GCP Pub/Sub creation_subscription
(#10106)
add bde6332 Fixes flaky kubernetes Pod Operator tests (#10111)
add 1d68cd2 Make conn_id unique in Connections table (#9067)
add 4e3799f [AIRFLOW-4541] Replace os.mkdirs usage with
pathlib.Path(path).mkdir (#10117)
add 082e6c1 Get rid of pydruid limitation (#9965)
add 85cc2a6 Add typing annotations to Segment provider (#10120)
add 27020f8 Add try clause to DataFusionHook.wait_for_pipeline_state
(#10031)
add d0776cf Move stable REST API migration guide to UPDATING.md (#10098)
add 6efa1b9 Add additional Cloud Datastore operators (#10032)
add 76c3e21 Moved webserver background to Quarantine (#10114)
add f02ad50 Delete irrelevant entries from UPDATING.md (#10093)
add 53ada6e Add S3KeysUnchangedSensor (#9817)
add 201823b Add Legacy command displaying new CLI counterparts (#10115)
add 7269d15 [GH-9708] Add type coverage to Sendgrid module (#10134)
add 86d8e34 Status of quarantined tests is stored in Github Issue (#10119)
add e5c3bf7 Fixed mistyped quarantine.yaml extension (#10139)
add 0002877 Improve Typing coverage of amazon/aws/athena (#10025)
add e92d50e Replace file.io with artifacts (#10137)
add 5cdcf44 Fixes quarantine parsing teething issues (#10145)
add 87abea6 Retry max 3 times if failing to initialize integration
(#10146)
add 9827ecc Do not use .format() in log messages (#10150)
add dd2dec0 Update celery and kombu versions (#9496)
add 4a0fdb6 Use conn_name_attr for SqliteHook connection (#10156)
add 1bca31b Add type annotations for Sqlite (#10157)
add 73a08ed Add type annotation to providers/jenkins (#9947)
add 1437cb7 Add correct signatures for operators in google provider
package (#10144)
add 95328c4 Bring back code coverage (#10143)
add 47fe4c4 Remove coverage HTML report artifacts (#10168)
add 3f972a3 Documentation artifact are also uploaded as GitHub Actions
Artifacts (#10158)
add d820567 Add Apache Airflow CODE_OF_CONDUCT.md (#9715)
add 8527b14 Updated parameter definition docs for filesystem.py (#10159)
add 4bb32ca Disable wiki. (#10173)
add 3903152 Remove stat_name_handler attribute in plugins.rst (#10174)
add 92869f0 Improve heading on Email Configuration page (#10175)
add 1279731 Add docs for airflow config command (#10177)
add 9667314 Add correct signatures for operators in amazon provider
package (#10167)
add 3b3287d Enforce keyword only arguments on apache operators (#10170)
add 1e36666 prevent DAG callback exception from crashing scheduler
(#10096)
add 0103226 Improve handling Dataproc cluster creation with ERROR state
(#9593)
add 73ad5a4 Fix BaseSensorOperator soft_fail mode to respect downstream
tasks trigger_rule (#8867)
add 24c8e4c Changes to all the constructors to remove the args argument
(#10163)
add 817e1ac Add thredup to list of Airflow users (#10198)
add 0c77ea8 Add type annotations to S3 hook module (#10164)
add eff0f03 Update guide for Google Cloud Secret Manager Backend (#10172)
add d79e722 Type annotation for Docker operator (#9733)
add c920b1b Update JS packages to latest versions (#9811) (#9921)
add cdec301 Add correct signature to all operators and sensors (#10205)
add 1dc8b78 You can sync your fork master with apache/airflow master via
UI (#10209)
add 9e3b7d9 Pylint checks should be way faster now (#10207)
add 4146aba Fix chart: parameterize namespace (#10213)
add 9d4b914 Docs: Separate page for each Secrets backend (#10211)
add 0d81cc0 Improves stability of reported coverage and makes it nicer
(#10208)
add d2540e6 Add airflow connections export command (#9856) (#10081)
add 2102122 Handle IntegrityError while creating TIs (#10136)
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 2 +
.coveragerc | 3 +
...orkflows.yml => cancel_other_workflow_runs.yml} | 11 +-
.github/workflows/ci.yml | 241 +-
.github/workflows/quarantined.yaml | 108 +
.github/workflows/repo_sync.yml | 17 +
.pre-commit-config.yaml | 15 +-
CI.rst | 63 +-
clients/README.md => CODE_OF_CONDUCT.md | 12 +-
CONTRIBUTING.rst | 416 +--
README.md | 5 +-
STATIC_CODE_CHECKS.rst | 12 +-
UPDATING.md | 1933 ++++++++------
airflow/cli/cli_parser.py | 63 +-
airflow/cli/commands/config_command.py | 15 +
airflow/cli/commands/connection_command.py | 67 +
airflow/cli/commands/info_command.py | 2 +-
airflow/cli/commands/legacy_commands.py | 56 +
airflow/config_templates/airflow_local_settings.py | 4 +-
airflow/example_dags/example_python_operator.py | 2 +
airflow/exceptions.py | 4 +
airflow/executors/base_executor.py | 6 +
airflow/executors/celery_executor.py | 4 +-
airflow/executors/dask_executor.py | 3 +-
airflow/executors/local_executor.py | 3 +-
airflow/executors/sequential_executor.py | 5 +-
airflow/jobs/scheduler_job.py | 15 +-
...d48763f6d53_add_unique_constraint_to_conn_id.py | 67 +
airflow/models/connection.py | 2 +-
airflow/models/dag.py | 17 +-
airflow/models/dagrun.py | 22 +-
airflow/models/taskinstance.py | 9 +-
airflow/{providers/email => }/operators/email.py | 8 +-
airflow/operators/email_operator.py | 6 +-
airflow/operators/python.py | 213 +-
airflow/operators/sql.py | 12 +-
airflow/providers/amazon/aws/hooks/athena.py | 37 +-
airflow/providers/amazon/aws/hooks/s3.py | 172 +-
airflow/providers/amazon/aws/hooks/sagemaker.py | 63 +-
airflow/providers/amazon/aws/operators/athena.py | 55 +-
airflow/providers/amazon/aws/operators/batch.py | 2 +-
.../amazon/aws/operators/cloud_formation.py | 12 +-
airflow/providers/amazon/aws/operators/datasync.py | 5 +-
.../amazon/aws/operators/ec2_start_instance.py | 5 +-
.../amazon/aws/operators/ec2_stop_instance.py | 5 +-
airflow/providers/amazon/aws/operators/ecs.py | 2 +-
.../amazon/aws/operators/emr_add_steps.py | 6 +-
.../amazon/aws/operators/emr_create_job_flow.py | 6 +-
.../amazon/aws/operators/emr_modify_cluster.py | 6 +-
.../amazon/aws/operators/emr_terminate_job_flow.py | 6 +-
airflow/providers/amazon/aws/operators/glue.py | 6 +-
.../providers/amazon/aws/operators/s3_bucket.py | 10 +-
.../amazon/aws/operators/s3_copy_object.py | 6 +-
.../amazon/aws/operators/s3_delete_objects.py | 6 +-
.../amazon/aws/operators/s3_file_transform.py | 6 +-
airflow/providers/amazon/aws/operators/s3_list.py | 5 +-
.../amazon/aws/operators/sagemaker_base.py | 6 +-
.../amazon/aws/operators/sagemaker_endpoint.py | 6 +-
.../aws/operators/sagemaker_endpoint_config.py | 6 +-
.../amazon/aws/operators/sagemaker_model.py | 6 +-
...gemaker_training.py => sagemaker_processing.py} | 93 +-
.../amazon/aws/operators/sagemaker_training.py | 2 +-
.../amazon/aws/operators/sagemaker_transform.py | 6 +-
.../amazon/aws/operators/sagemaker_tuning.py | 6 +-
airflow/providers/amazon/aws/operators/sns.py | 6 +-
airflow/providers/amazon/aws/operators/sqs.py | 5 +-
.../step_function_get_execution_output.py | 4 +-
.../aws/operators/step_function_start_execution.py | 6 +-
airflow/providers/amazon/aws/sensors/athena.py | 39 +-
.../amazon/aws/sensors/cloud_formation.py | 10 +-
.../amazon/aws/sensors/ec2_instance_state.py | 5 +-
airflow/providers/amazon/aws/sensors/emr_base.py | 6 +-
.../providers/amazon/aws/sensors/emr_job_flow.py | 5 +-
airflow/providers/amazon/aws/sensors/emr_step.py | 5 +-
airflow/providers/amazon/aws/sensors/glue.py | 5 +-
.../amazon/aws/sensors/glue_catalog_partition.py | 5 +-
airflow/providers/amazon/aws/sensors/redshift.py | 5 +-
airflow/providers/amazon/aws/sensors/s3_key.py | 5 +-
.../amazon/aws/sensors/s3_keys_unchanged.py | 163 ++
airflow/providers/amazon/aws/sensors/s3_prefix.py | 5 +-
.../providers/amazon/aws/sensors/sagemaker_base.py | 6 +-
.../amazon/aws/sensors/sagemaker_endpoint.py | 5 +-
.../amazon/aws/sensors/sagemaker_training.py | 5 +-
.../amazon/aws/sensors/sagemaker_transform.py | 5 +-
.../amazon/aws/sensors/sagemaker_tuning.py | 5 +-
airflow/providers/amazon/aws/sensors/sqs.py | 5 +-
.../amazon/aws/sensors/step_function_execution.py | 6 +-
.../amazon/aws/transfers/dynamodb_to_s3.py | 8 +-
.../providers/amazon/aws/transfers/gcs_to_s3.py | 4 +-
.../amazon/aws/transfers/google_api_to_s3.py | 5 +-
.../amazon/aws/transfers/hive_to_dynamodb.py | 6 +-
.../amazon/aws/transfers/imap_attachment_to_s3.py | 5 +-
.../providers/amazon/aws/transfers/mongo_to_s3.py | 6 +-
.../providers/amazon/aws/transfers/mysql_to_s3.py | 6 +-
.../amazon/aws/transfers/redshift_to_s3.py | 6 +-
.../amazon/aws/transfers/s3_to_redshift.py | 6 +-
.../providers/amazon/aws/transfers/s3_to_sftp.py | 5 +-
.../providers/amazon/aws/transfers/sftp_to_s3.py | 5 +-
.../providers/apache/cassandra/sensors/record.py | 2 +-
.../providers/apache/cassandra/sensors/table.py | 2 +-
airflow/providers/apache/druid/operators/druid.py | 2 +-
.../apache/druid/operators/druid_check.py | 1 +
.../apache/druid/transfers/hive_to_druid.py | 2 +-
airflow/providers/apache/hdfs/sensors/hdfs.py | 1 +
airflow/providers/apache/hdfs/sensors/web_hdfs.py | 1 +
airflow/providers/apache/hive/operators/hive.py | 2 +-
.../providers/apache/hive/operators/hive_stats.py | 2 +-
.../apache/hive/sensors/hive_partition.py | 2 +-
.../apache/hive/sensors/metastore_partition.py | 2 +-
.../apache/hive/sensors/named_hive_partition.py | 2 +-
.../apache/hive/transfers/hive_to_mysql.py | 2 +-
.../apache/hive/transfers/hive_to_samba.py | 2 +-
.../apache/hive/transfers/mssql_to_hive.py | 2 +-
.../apache/hive/transfers/mysql_to_hive.py | 1 +
.../providers/apache/hive/transfers/s3_to_hive.py | 1 +
.../apache/hive/transfers/vertica_to_hive.py | 1 +
.../providers/apache/kylin/operators/kylin_cube.py | 2 +-
airflow/providers/apache/livy/operators/livy.py | 2 +-
airflow/providers/apache/livy/sensors/livy.py | 2 +-
airflow/providers/apache/pig/operators/pig.py | 2 +-
.../providers/apache/spark/operators/spark_jdbc.py | 2 +-
.../providers/apache/spark/operators/spark_sql.py | 2 +-
.../apache/spark/operators/spark_submit.py | 2 +-
airflow/providers/apache/sqoop/operators/sqoop.py | 2 +-
airflow/providers/celery/sensors/celery_queue.py | 5 +-
.../cncf/kubernetes/operators/kubernetes_pod.py | 13 +-
.../cncf/kubernetes/operators/spark_kubernetes.py | 6 +-
.../cncf/kubernetes/sensors/spark_kubernetes.py | 6 +-
.../providers/databricks/operators/databricks.py | 4 +-
airflow/providers/datadog/sensors/datadog.py | 5 +-
airflow/providers/dingding/operators/dingding.py | 5 +-
.../providers/discord/operators/discord_webhook.py | 2 +-
airflow/providers/docker/hooks/docker.py | 13 +-
airflow/providers/docker/operators/docker.py | 25 +-
airflow/providers/docker/operators/docker_swarm.py | 36 +-
.../email/PROVIDERS_CHANGES_2020.06.24.md | 18 -
airflow/providers/email/README.md | 103 -
airflow/providers/email/__init__.py | 17 -
airflow/providers/email/operators/__init__.py | 17 -
airflow/providers/exasol/operators/exasol.py | 6 +-
airflow/providers/ftp/sensors/ftp.py | 5 +-
airflow/providers/google/ads/operators/ads.py | 5 +-
.../providers/google/ads/transfers/ads_to_gcs.py | 5 +-
.../google/cloud/example_dags/example_datastore.py | 105 +-
airflow/providers/google/cloud/hooks/cloud_sql.py | 10 +-
airflow/providers/google/cloud/hooks/datafusion.py | 16 +-
airflow/providers/google/cloud/hooks/dataproc.py | 10 +-
airflow/providers/google/cloud/hooks/datastore.py | 6 +-
airflow/providers/google/cloud/hooks/pubsub.py | 41 +-
airflow/providers/google/cloud/operators/automl.py | 65 +-
.../providers/google/cloud/operators/bigquery.py | 85 +-
.../google/cloud/operators/bigquery_dts.py | 15 +-
.../providers/google/cloud/operators/bigtable.py | 30 +-
.../google/cloud/operators/cloud_build.py | 6 +-
.../google/cloud/operators/cloud_memorystore.py | 55 +-
.../providers/google/cloud/operators/cloud_sql.py | 20 +-
.../operators/cloud_storage_transfer_service.py | 48 +-
.../providers/google/cloud/operators/compute.py | 12 +-
.../google/cloud/operators/datacatalog.py | 105 +-
.../providers/google/cloud/operators/dataflow.py | 42 +-
.../providers/google/cloud/operators/datafusion.py | 50 +-
.../providers/google/cloud/operators/dataproc.py | 236 +-
.../providers/google/cloud/operators/datastore.py | 337 ++-
airflow/providers/google/cloud/operators/dlp.py | 150 +-
.../providers/google/cloud/operators/functions.py | 17 +-
airflow/providers/google/cloud/operators/gcs.py | 43 +-
.../google/cloud/operators/kubernetes_engine.py | 9 +-
.../google/cloud/operators/life_sciences.py | 5 +-
.../providers/google/cloud/operators/mlengine.py | 48 +-
.../google/cloud/operators/natural_language.py | 25 +-
airflow/providers/google/cloud/operators/pubsub.py | 224 +-
.../providers/google/cloud/operators/spanner.py | 36 +-
.../google/cloud/operators/speech_to_text.py | 5 +-
.../google/cloud/operators/stackdriver.py | 60 +-
airflow/providers/google/cloud/operators/tasks.py | 65 +-
.../google/cloud/operators/text_to_speech.py | 5 +-
.../providers/google/cloud/operators/translate.py | 5 +-
.../google/cloud/operators/translate_speech.py | 5 +-
.../google/cloud/operators/video_intelligence.py | 19 +-
airflow/providers/google/cloud/operators/vision.py | 77 +-
.../google/cloud/secrets/secret_manager.py | 5 +-
airflow/providers/google/cloud/sensors/bigquery.py | 6 +-
.../providers/google/cloud/sensors/bigquery_dts.py | 4 +-
airflow/providers/google/cloud/sensors/bigtable.py | 4 +-
.../sensors/cloud_storage_transfer_service.py | 5 +-
airflow/providers/google/cloud/sensors/gcs.py | 23 +-
airflow/providers/google/cloud/sensors/pubsub.py | 5 +-
.../google/cloud/transfers/adls_to_gcs.py | 2 +-
.../google/cloud/transfers/bigquery_to_bigquery.py | 5 +-
.../google/cloud/transfers/bigquery_to_gcs.py | 5 +-
.../google/cloud/transfers/bigquery_to_mysql.py | 5 +-
.../google/cloud/transfers/cassandra_to_gcs.py | 5 +-
.../google/cloud/transfers/facebook_ads_to_gcs.py | 5 +-
.../google/cloud/transfers/gcs_to_bigquery.py | 6 +-
.../providers/google/cloud/transfers/gcs_to_gcs.py | 5 +-
.../google/cloud/transfers/gcs_to_local.py | 5 +-
.../google/cloud/transfers/gcs_to_sftp.py | 5 +-
.../google/cloud/transfers/local_to_gcs.py | 5 +-
.../google/cloud/transfers/mssql_to_gcs.py | 5 +-
.../google/cloud/transfers/mysql_to_gcs.py | 5 +-
.../google/cloud/transfers/postgres_to_gcs.py | 5 +-
.../google/cloud/transfers/presto_to_gcs.py | 5 +-
.../providers/google/cloud/transfers/s3_to_gcs.py | 4 +-
.../google/cloud/transfers/sftp_to_gcs.py | 5 +-
.../google/cloud/transfers/sheets_to_gcs.py | 7 +-
.../providers/google/cloud/transfers/sql_to_gcs.py | 5 +-
.../google/firebase/operators/firestore.py | 4 +-
.../example_dags/example_display_video.py | 18 +-
.../google/marketing_platform/hooks/analytics.py | 2 -
.../marketing_platform/operators/analytics.py | 26 +-
.../operators/campaign_manager.py | 30 +-
.../marketing_platform/operators/display_video.py | 40 +-
.../marketing_platform/operators/search_ads.py | 10 +-
.../marketing_platform/sensors/campaign_manager.py | 5 +-
.../marketing_platform/sensors/display_video.py | 5 +-
.../marketing_platform/sensors/search_ads.py | 2 +-
airflow/providers/google/suite/operators/sheets.py | 7 +-
.../google/suite/transfers/gcs_to_gdrive.py | 5 +-
.../google/suite/transfers/gcs_to_sheets.py | 7 +-
airflow/providers/grpc/operators/grpc.py | 6 +-
airflow/providers/http/operators/http.py | 6 +-
airflow/providers/http/sensors/http.py | 7 +-
airflow/providers/imap/sensors/imap_attachment.py | 5 +-
airflow/providers/jdbc/operators/jdbc.py | 6 +-
airflow/providers/jenkins/hooks/jenkins.py | 4 +-
.../jenkins/operators/jenkins_job_trigger.py | 68 +-
airflow/providers/jira/hooks/jira.py | 8 +-
airflow/providers/jira/operators/jira.py | 20 +-
airflow/providers/jira/sensors/jira.py | 41 +-
.../microsoft/azure/operators/adls_list.py | 5 +-
airflow/providers/microsoft/azure/operators/adx.py | 5 +-
.../microsoft/azure/operators/azure_batch.py | 5 +-
.../azure/operators/azure_container_instances.py | 5 +-
.../microsoft/azure/operators/azure_cosmos.py | 5 +-
.../microsoft/azure/operators/wasb_delete_blob.py | 5 +-
.../microsoft/azure/sensors/azure_cosmos.py | 5 +-
airflow/providers/microsoft/azure/sensors/wasb.py | 10 +-
.../microsoft/azure/transfers/file_to_wasb.py | 5 +-
.../azure/transfers/oracle_to_azure_data_lake.py | 5 +-
.../providers/microsoft/mssql/operators/mssql.py | 6 +-
.../providers/microsoft/winrm/operators/winrm.py | 5 +-
airflow/providers/mongo/sensors/mongo.py | 5 +-
airflow/providers/mysql/operators/mysql.py | 6 +-
.../providers/mysql/transfers/presto_to_mysql.py | 6 +-
airflow/providers/mysql/transfers/s3_to_mysql.py | 6 +-
.../providers/mysql/transfers/vertica_to_mysql.py | 5 +-
.../providers/opsgenie/operators/opsgenie_alert.py | 5 +-
airflow/providers/oracle/operators/oracle.py | 6 +-
.../providers/oracle/transfers/oracle_to_oracle.py | 6 +-
airflow/providers/papermill/operators/papermill.py | 6 +-
airflow/providers/postgres/operators/postgres.py | 6 +-
airflow/providers/qubole/operators/qubole.py | 7 +-
airflow/providers/qubole/operators/qubole_check.py | 13 +-
airflow/providers/qubole/sensors/qubole.py | 12 +-
airflow/providers/redis/operators/redis_publish.py | 6 +-
airflow/providers/redis/sensors/redis_key.py | 4 +-
airflow/providers/redis/sensors/redis_pub_sub.py | 4 +-
.../operators/tableau_refresh_workbook.py | 5 +-
.../salesforce/sensors/tableau_job_status.py | 5 +-
airflow/providers/segment/hooks/segment.py | 10 +-
.../segment/operators/segment_track_event.py | 22 +-
airflow/providers/sendgrid/utils/emailer.py | 15 +-
airflow/providers/sftp/operators/sftp.py | 13 +-
airflow/providers/sftp/sensors/sftp.py | 4 +-
.../providers/singularity/operators/singularity.py | 5 +-
airflow/providers/slack/operators/slack.py | 2 +-
airflow/providers/slack/operators/slack_webhook.py | 4 +-
airflow/providers/snowflake/operators/snowflake.py | 6 +-
.../snowflake/transfers/s3_to_snowflake.py | 5 +-
.../snowflake/transfers/snowflake_to_slack.py | 5 +-
airflow/providers/sqlite/hooks/sqlite.py | 8 +-
airflow/providers/sqlite/operators/sqlite.py | 9 +-
airflow/providers/ssh/operators/ssh.py | 4 +-
airflow/providers/vertica/operators/vertica.py | 6 +-
.../yandex/operators/yandexcloud_dataproc.py | 29 +-
airflow/secrets/local_filesystem.py | 8 +-
airflow/sensors/base_sensor_operator.py | 12 +-
airflow/sensors/bash.py | 6 +-
airflow/sensors/date_time_sensor.py | 4 +-
airflow/sensors/external_task_sensor.py | 60 +-
airflow/sensors/filesystem.py | 7 +-
airflow/sensors/python.py | 6 +-
airflow/sensors/sql_sensor.py | 6 +-
airflow/sensors/time_delta_sensor.py | 4 +-
airflow/sensors/time_sensor.py | 4 +-
airflow/sensors/weekday_sensor.py | 6 +-
airflow/utils/file.py | 15 +-
airflow/utils/log/file_processor_handler.py | 18 +-
airflow/utils/log/file_task_handler.py | 7 +-
airflow/utils/python_virtualenv.py | 22 +
.../python_virtualenv_script.jinja2} | 47 +-
airflow/www/package.json | 50 +-
airflow/www/templates/airflow/graph.html | 32 +-
airflow/www/webpack.config.js | 109 +-
airflow/www/yarn.lock | 2753 +++++++++++---------
breeze | 11 +
chart/templates/NOTES.txt | 4 +-
codecov.yml | 70 +
dev/BACKPORT_PACKAGES.md | 2 +-
docs/autoapi_templates/index.rst | 2 -
docs/build | 1 -
docs/concepts.rst | 7 +-
docs/executor/index.rst | 8 +
docs/howto/connection/index.rst | 89 +-
docs/howto/custom-operator.rst | 16 +-
docs/howto/define_extra_link.rst | 4 +-
docs/howto/email-config.rst | 10 +-
docs/howto/index.rst | 2 +-
docs/howto/operator/google/cloud/datastore.rst | 173 ++
docs/howto/operator/python.rst | 31 +
.../aws-secrets-manaager-backend.rst | 73 +
.../aws-ssm-parameter-store-secrets-backend.rst | 51 +
.../google-cloud-secret-manager-backend.rst | 134 +
.../hashicorp-vault-secrets-backend.rst | 117 +
docs/howto/secrets-backend/index.rst | 86 +
.../local-filesystem-secrets-backend.rst | 145 ++
docs/howto/set-config.rst | 10 +
docs/howto/use-alternative-secrets-backend.rst | 458 ----
docs/index.rst | 1 -
docs/integration.rst | 2 +-
docs/metrics.rst | 1 +
docs/operators-and-hooks-ref.rst | 18 +-
docs/plugins.rst | 1 -
docs/redirects.txt | 1 +
docs/rest-api-ref.rst | 2 +-
docs/stable-rest-api/migration.rst | 181 --
docs/timezone.rst | 2 +-
kubernetes_tests/test_kubernetes_pod_operator.py | 56 +-
pylintrc | 2 +-
requirements/requirements-python3.8.txt | 4 +-
.../ci_prepare_and_test_backport_packages.sh | 6 -
...ci_test_backport_packages_import_all_classes.sh | 10 -
...ci_test_backport_packages_install_separately.sh | 11 -
scripts/ci/cancel/get_workflow_id.sh | 24 -
scripts/ci/docker-compose/base.yml | 10 +
.../docker-compose/{backend-sqlite.yml => ci.yml} | 10 +-
.../ci/docker-compose/files.yml | 10 +-
scripts/ci/docker-compose/local-prod.yml | 1 -
scripts/ci/docker-compose/local.yml | 8 -
scripts/ci/docs/ci_docs.sh | 11 +-
scripts/ci/in_container/_in_container_utils.sh | 21 +-
scripts/ci/in_container/entrypoint_ci.sh | 34 +-
.../ci/in_container/quarantine_issue_header.md | 15 +-
scripts/ci/in_container/run_ci_tests.sh | 29 +-
scripts/ci/in_container/run_docs_build.sh | 12 +-
.../in_container/run_prepare_backport_packages.sh | 9 +-
.../ci/in_container/run_prepare_backport_readme.sh | 9 +-
.../{run_pylint_main.sh => run_pylint.sh} | 2 -
scripts/ci/in_container/run_pylint_tests.sh | 51 -
scripts/ci/in_container/run_system_tests.sh | 2 +-
.../in_container/update_quarantined_test_status.py | 243 ++
scripts/ci/kubernetes/ci_run_kubernetes_tests.sh | 2 +-
.hadolint.yaml => scripts/ci/libraries/_docker.env | 19 +-
scripts/ci/libraries/_initialization.sh | 47 +-
scripts/ci/libraries/_local_mounts.sh | 1 -
scripts/ci/libraries/_runs.sh | 41 -
..._commit_pylint_main.sh => pre_commit_pylint.sh} | 4 +-
scripts/ci/pre_commit/pre_commit_pylint_tests.sh | 22 -
scripts/ci/static_checks/ci_check_license.sh | 1 -
scripts/ci/static_checks/ci_flake8.sh | 18 -
scripts/ci/static_checks/ci_mypy.sh | 9 -
.../{ci_pylint_main.sh => ci_pylint.sh} | 28 +-
scripts/ci/static_checks/ci_pylint_tests.sh | 75 -
scripts/ci/static_checks/ci_refresh_pylint_todo.sh | 9 -
scripts/ci/testing/ci_run_airflow_testing.sh | 76 +-
scripts/ci/tools/ci_clear_tmp.sh | 1 +
scripts/ci/tools/ci_fix_ownership.sh | 1 +
setup.py | 12 +-
tests/airflow_pylint/disable_checks_for_tests.py | 60 +
tests/cli/commands/test_config_command.py | 49 +-
tests/cli/commands/test_connection_command.py | 297 +++
tests/cli/commands/test_legacy_commands.py | 61 +
tests/cli/commands/test_webserver_command.py | 2 +
tests/dags/test_logging_in_dag.py | 5 +
tests/dags/test_task_view_type_check.py | 3 +
tests/deprecated_classes.py | 2 +-
tests/jobs/test_scheduler_job.py | 6 +-
tests/models/test_baseoperator.py | 4 +-
tests/models/test_dag.py | 29 +
tests/models/test_dagrun.py | 19 +
.../{providers/email => }/operators/test_email.py | 4 +-
tests/operators/test_python.py | 157 +-
.../providers/amazon/aws/operators/test_athena.py | 3 +-
.../aws/operators/test_sagemaker_processing.py | 167 ++
tests/providers/amazon/aws/sensors/test_athena.py | 2 +-
.../amazon/aws/sensors/test_s3_keys_unchanged.py | 97 +
.../kubernetes/operators/test_kubernetes_pod.py | 13 +
.../providers/google/cloud/hooks/test_dataproc.py | 1 +
.../providers/google/cloud/hooks/test_datastore.py | 9 +-
tests/providers/google/cloud/hooks/test_pubsub.py | 49 +
.../google/cloud/operators/test_dataproc.py | 95 +-
.../google/cloud/operators/test_datastore.py | 206 ++
.../cloud/operators/test_datastore_system.py | 4 +
.../cloud/operators/test_kubernetes_engine.py | 6 +-
.../google/cloud/operators/test_pubsub.py | 15 +
.../google/cloud/operators/test_speech_to_text.py | 4 +-
tests/providers/google/cloud/sensors/test_gcs.py | 11 +
.../utils/test_mlengine_prediction_summary.py | 95 +
.../marketing_platform/hooks/test_analytics.py | 19 +-
.../operators/test_display_video_system.py | 8 +
tests/providers/jira/sensors/test_jira.py | 1 +
tests/providers/pagerduty/hooks/test_pagerduty.py | 3 +-
.../experimental => providers/samba}/__init__.py | 0
.../samba/hooks}/__init__.py | 0
tests/providers/samba/hooks/test_samba.py | 116 +
tests/providers/sqlite/hooks/test_sqlite.py | 9 +-
tests/secrets/test_local_filesystem.py | 76 +-
tests/secrets/test_secrets_backends.py | 8 +-
tests/sensors/test_base_sensor.py | 15 +-
tests/sensors/test_timeout_sensor.py | 3 +-
tests/test_project_structure.py | 3 -
tests/test_utils/mock_operators.py | 8 +-
tests/test_utils/system_tests_class.py | 4 +-
tests/utils/test_decorators.py | 4 +-
414 files changed, 9472 insertions(+), 5736 deletions(-)
rename .github/workflows/{cancel_duplicate_workflows.yml =>
cancel_other_workflow_runs.yml} (75%)
create mode 100644 .github/workflows/quarantined.yaml
create mode 100644 .github/workflows/repo_sync.yml
copy clients/README.md => CODE_OF_CONDUCT.md (69%)
create mode 100644 airflow/cli/commands/legacy_commands.py
create mode 100644
airflow/migrations/versions/8d48763f6d53_add_unique_constraint_to_conn_id.py
rename airflow/{providers/email => }/operators/email.py (95%)
copy airflow/providers/amazon/aws/operators/{sagemaker_training.py =>
sagemaker_processing.py} (58%)
create mode 100644 airflow/providers/amazon/aws/sensors/s3_keys_unchanged.py
delete mode 100644 airflow/providers/email/PROVIDERS_CHANGES_2020.06.24.md
delete mode 100644 airflow/providers/email/README.md
delete mode 100644 airflow/providers/email/__init__.py
delete mode 100644 airflow/providers/email/operators/__init__.py
copy airflow/{www/templates/airflow/code.html =>
utils/python_virtualenv_script.jinja2} (57%)
create mode 100644 codecov.yml
create mode 100644 docs/howto/operator/google/cloud/datastore.rst
create mode 100644 docs/howto/secrets-backend/aws-secrets-manaager-backend.rst
create mode 100644
docs/howto/secrets-backend/aws-ssm-parameter-store-secrets-backend.rst
create mode 100644
docs/howto/secrets-backend/google-cloud-secret-manager-backend.rst
create mode 100644
docs/howto/secrets-backend/hashicorp-vault-secrets-backend.rst
create mode 100644 docs/howto/secrets-backend/index.rst
create mode 100644
docs/howto/secrets-backend/local-filesystem-secrets-backend.rst
delete mode 100644 docs/howto/use-alternative-secrets-backend.rst
delete mode 100644 docs/stable-rest-api/migration.rst
delete mode 100755 scripts/ci/cancel/get_workflow_id.sh
copy scripts/ci/docker-compose/{backend-sqlite.yml => ci.yml} (84%)
copy .hadolint.yaml => scripts/ci/docker-compose/files.yml (90%)
copy airflow/providers/papermill/ADDITIONAL_INFO.md =>
scripts/ci/in_container/quarantine_issue_header.md (60%)
rename scripts/ci/in_container/{run_pylint_main.sh => run_pylint.sh} (96%)
delete mode 100755 scripts/ci/in_container/run_pylint_tests.sh
create mode 100755 scripts/ci/in_container/update_quarantined_test_status.py
copy .hadolint.yaml => scripts/ci/libraries/_docker.env (78%)
rename scripts/ci/pre_commit/{pre_commit_pylint_main.sh =>
pre_commit_pylint.sh} (86%)
delete mode 100755 scripts/ci/pre_commit/pre_commit_pylint_tests.sh
rename scripts/ci/static_checks/{ci_pylint_main.sh => ci_pylint.sh} (68%)
delete mode 100755 scripts/ci/static_checks/ci_pylint_tests.sh
create mode 100644 tests/airflow_pylint/disable_checks_for_tests.py
create mode 100644 tests/cli/commands/test_legacy_commands.py
rename tests/{providers/email => }/operators/test_email.py (92%)
create mode 100644
tests/providers/amazon/aws/operators/test_sagemaker_processing.py
create mode 100644 tests/providers/amazon/aws/sensors/test_s3_keys_unchanged.py
create mode 100644 tests/providers/google/cloud/operators/test_datastore.py
create mode 100644
tests/providers/google/cloud/utils/test_mlengine_prediction_summary.py
copy tests/{www/api/experimental => providers/samba}/__init__.py (100%)
copy tests/{www/api/experimental => providers/samba/hooks}/__init__.py (100%)
create mode 100644 tests/providers/samba/hooks/test_samba.py
