This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch python3.12
in repository https://gitbox.apache.org/repos/asf/airflow.git
discard 84763a9a09 python 3.12 support
add e9a4bcaa16 Improve ExternalTaskSensor Async Implementation (#36916)
add 12ccb5f0ac feat: add Yandex Cloud Lockbox secrets backend (#36449)
add 67c774e3f3 Improve AIRFLOW__WEBSERVER__BASE_URL docs (#37003)
add 10ad8d9e38 Add operator to diagnose cluster (#36899)
add 8fd9fdb812 Updated config.yml for environment variable
sql_alchemy_connect_args (#36526)
add 6629e2bf7b Making links in task logs as hyperlinks by preventing HTML
injection (#36829)
add 6a210c65a0 Add a note to also update committers list in airflow-site
repo (#37017)
add fc2271a469 Add a cross reference to security policy (#37004)
add 0b680c9492 Revert "Provide the logger_name param in providers hooks in
order to override the logger name (#36675)" (#37015)
add dd627d7f46 36888-Fix k8 configmap issue in 7.14.0rc1 (#37001)
add cead3da4a6 Add docs for RC2 wave of providers for 2nd round of Jan
2024 (#37019)
add 8708bffa87 Split contributing docs to multiple files (#36969)
add bc0e0d95d4 Small follow-up after splitting contributing docs (#37031)
add 574d90f217 Handle SystemExit raised in the task. (#36986)
add 35daa3462b Enable '_enable_tcp_keepalive' functionality for GKEPodHook
(#36999)
add 35617620a9 Implement deferrable mode for
CreateHyperparameterTuningJobOperator (#36594)
add bd06434200 Add Constance to triage team (#37033)
add 0f2670e7ac Create DataprocStartClusterOperator and
DataprocStopClusterOperator (#36996)
add 714a9a79a5 Add data_interval_start and data_interval_end in dagrun
create API endpoint (#36630)
add ce246c0ed8 fix for role and permission count in export (#36589)
add edce53582c fix: DagRuns with UPSTREAM_FAILED tasks get stuck in the
backfill. (#36954)
add fee7e33983 Use execution_date= param as a backup to base date for grid
view (#37018)
add acc81213e6 Add coding rule for operators to avoid logic in
constructors (#37035)
add 004d1d3a84 Adding Amazon Neptune Hook and Operators (#37000)
add 45b6b7a7a3 Remove superfluous `@Sentry.enrich_errors` (#37002)
add 770a96f4c5 Update GCP Dataproc ClusterGenerator to support GPU params
(#37036)
add eb86df7d68 Allow for helm plugin installation to be happening more
than once (#37038)
add 1bb8126ddc add description to queue_when (#36997)
add ef428341e5 python 3.12 support
add c05a8e1c15 fixup! python 3.12 support
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (84763a9a09)
\
N -- N -- N refs/heads/python3.12 (c05a8e1c15)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 1 +
.gitattributes | 5 +-
.github/PULL_REQUEST_TEMPLATE.md | 2 +-
.github/SECURITY.md | 5 +-
.github/boring-cyborg.yml | 14 +-
.github/workflows/ci.yml | 2 +-
.pre-commit-config.yaml | 8 +-
BREEZE.rst | 2 +-
CI.rst | 8 +-
COMMITTERS.rst | 38 +-
CONTRIBUTING.rst | 1795 +-------------
Dockerfile.ci | 12 +
IMAGES.rst | 12 +-
INSTALL | 6 +
README.md | 8 +-
TESTING.rst | 2603 --------------------
.../api_connexion/endpoints/dag_run_endpoint.py | 14 +-
airflow/api_connexion/openapi/v1.yaml | 8 +-
airflow/api_connexion/schemas/dag_run_schema.py | 16 +-
airflow/config_templates/config.yml | 16 +-
airflow/jobs/backfill_job_runner.py | 8 +-
airflow/models/taskinstance.py | 23 +-
airflow/providers/MANAGING_PROVIDERS_LIFECYCLE.rst | 8 +-
airflow/providers/airbyte/CHANGELOG.rst | 1 +
airflow/providers/alibaba/CHANGELOG.rst | 1 +
airflow/providers/amazon/CHANGELOG.rst | 1 +
airflow/providers/amazon/aws/hooks/neptune.py | 85 +
airflow/providers/amazon/aws/operators/neptune.py | 218 ++
airflow/providers/amazon/aws/triggers/neptune.py | 115 +
airflow/providers/amazon/aws/waiters/neptune.json | 85 +
airflow/providers/amazon/provider.yaml | 15 +
airflow/providers/apache/beam/CHANGELOG.rst | 8 +-
airflow/providers/apache/beam/README.md | 2 +-
airflow/providers/apache/beam/hooks/beam.py | 3 +-
.../apache/cassandra/.latest-doc-only-change.txt | 2 +-
.../apache/drill/.latest-doc-only-change.txt | 2 +-
airflow/providers/apache/druid/CHANGELOG.rst | 8 +
airflow/providers/apache/druid/hooks/druid.py | 3 +-
.../apache/flink/.latest-doc-only-change.txt | 2 +-
.../apache/hdfs/.latest-doc-only-change.txt | 2 +-
airflow/providers/apache/hdfs/CHANGELOG.rst | 13 -
airflow/providers/apache/hdfs/hooks/webhdfs.py | 4 +-
airflow/providers/apache/hdfs/provider.yaml | 1 -
airflow/providers/apache/hive/CHANGELOG.rst | 10 +-
airflow/providers/apache/hive/__init__.py | 2 +-
airflow/providers/apache/hive/hooks/hive.py | 7 +-
airflow/providers/apache/hive/provider.yaml | 2 +-
.../apache/impala/.latest-doc-only-change.txt | 2 +-
.../apache/kafka/.latest-doc-only-change.txt | 2 +-
airflow/providers/apache/kafka/CHANGELOG.rst | 13 -
airflow/providers/apache/kafka/hooks/base.py | 2 +-
airflow/providers/apache/kafka/provider.yaml | 1 -
.../apache/kylin/.latest-doc-only-change.txt | 2 +-
airflow/providers/apache/kylin/CHANGELOG.rst | 13 -
airflow/providers/apache/kylin/hooks/kylin.py | 3 +-
airflow/providers/apache/kylin/provider.yaml | 1 -
.../apache/pig/.latest-doc-only-change.txt | 2 +-
airflow/providers/apache/pig/CHANGELOG.rst | 15 -
airflow/providers/apache/pig/hooks/pig.py | 7 +-
airflow/providers/apache/pig/provider.yaml | 1 -
.../apache/pinot/.latest-doc-only-change.txt | 2 +-
airflow/providers/apache/pinot/CHANGELOG.rst | 16 -
airflow/providers/apache/pinot/hooks/pinot.py | 3 +-
airflow/providers/apache/pinot/provider.yaml | 1 -
airflow/providers/apache/spark/CHANGELOG.rst | 10 +-
airflow/providers/apache/spark/__init__.py | 2 +-
airflow/providers/apache/spark/hooks/spark_sql.py | 3 +-
airflow/providers/apache/spark/provider.yaml | 2 +-
.../providers/apprise/.latest-doc-only-change.txt | 2 +-
airflow/providers/apprise/CHANGELOG.rst | 13 -
airflow/providers/apprise/hooks/apprise.py | 4 +-
airflow/providers/apprise/provider.yaml | 1 -
.../providers/arangodb/.latest-doc-only-change.txt | 2 +-
.../providers/asana/.latest-doc-only-change.txt | 2 +-
airflow/providers/atlassian/jira/CHANGELOG.rst | 13 +-
airflow/providers/atlassian/jira/__init__.py | 2 +-
airflow/providers/atlassian/jira/hooks/jira.py | 4 +-
airflow/providers/atlassian/jira/provider.yaml | 2 +-
airflow/providers/celery/CHANGELOG.rst | 1 +
.../providers/cloudant/.latest-doc-only-change.txt | 2 +-
airflow/providers/cloudant/CHANGELOG.rst | 13 -
airflow/providers/cloudant/hooks/cloudant.py | 4 +-
airflow/providers/cloudant/provider.yaml | 1 -
airflow/providers/cncf/kubernetes/CHANGELOG.rst | 5 +-
airflow/providers/cncf/kubernetes/operators/pod.py | 11 +-
airflow/providers/cohere/CHANGELOG.rst | 9 +-
airflow/providers/cohere/__init__.py | 2 +-
airflow/providers/cohere/hooks/cohere.py | 3 +-
airflow/providers/cohere/provider.yaml | 2 +-
airflow/providers/common/sql/CHANGELOG.rst | 10 +-
airflow/providers/common/sql/__init__.py | 2 +-
airflow/providers/common/sql/hooks/sql.py | 2 +-
airflow/providers/common/sql/provider.yaml | 2 +-
airflow/providers/databricks/CHANGELOG.rst | 6 +-
.../providers/databricks/hooks/databricks_base.py | 3 +-
.../providers/datadog/.latest-doc-only-change.txt | 2 +-
airflow/providers/dbt/cloud/CHANGELOG.rst | 1 +
.../providers/dingding/.latest-doc-only-change.txt | 2 +-
airflow/providers/discord/CHANGELOG.rst | 1 +
.../providers/docker/.latest-doc-only-change.txt | 2 +-
airflow/providers/docker/CHANGELOG.rst | 13 -
airflow/providers/docker/hooks/docker.py | 3 +-
airflow/providers/docker/provider.yaml | 1 -
airflow/providers/elasticsearch/CHANGELOG.rst | 10 +-
airflow/providers/elasticsearch/__init__.py | 2 +-
.../providers/elasticsearch/hooks/elasticsearch.py | 4 +-
airflow/providers/elasticsearch/provider.yaml | 2 +-
airflow/providers/exasol/CHANGELOG.rst | 1 +
.../fab/auth_manager/cli_commands/role_command.py | 4 +-
.../providers/facebook/.latest-doc-only-change.txt | 2 +-
airflow/providers/facebook/CHANGELOG.rst | 23 -
airflow/providers/facebook/ads/hooks/ads.py | 3 +-
airflow/providers/facebook/provider.yaml | 1 -
airflow/providers/ftp/.latest-doc-only-change.txt | 2 +-
airflow/providers/ftp/CHANGELOG.rst | 17 -
airflow/providers/ftp/hooks/ftp.py | 4 +-
airflow/providers/ftp/provider.yaml | 1 -
.../providers/github/.latest-doc-only-change.txt | 2 +-
airflow/providers/google/CHANGELOG.rst | 8 +-
airflow/providers/google/ads/hooks/ads.py | 3 +-
airflow/providers/google/cloud/hooks/cloud_sql.py | 3 +-
airflow/providers/google/cloud/hooks/dataprep.py | 4 +-
airflow/providers/google/cloud/hooks/dataproc.py | 146 +-
.../google/cloud/hooks/kubernetes_engine.py | 7 +
airflow/providers/google/cloud/hooks/looker.py | 3 +-
.../hooks/vertex_ai/hyperparameter_tuning_job.py | 123 +-
.../providers/google/cloud/operators/dataproc.py | 385 ++-
.../vertex_ai/hyperparameter_tuning_job.py | 61 +-
.../providers/google/cloud/triggers/dataproc.py | 44 +-
.../providers/google/cloud/triggers/vertex_ai.py | 99 +
.../__init__.py => google/cloud/utils/dataproc.py} | 25 +-
.../providers/google/common/hooks/base_google.py | 4 +-
airflow/providers/google/leveldb/hooks/leveldb.py | 4 +-
airflow/providers/google/provider.yaml | 3 +
airflow/providers/grpc/.latest-doc-only-change.txt | 2 +-
airflow/providers/grpc/CHANGELOG.rst | 14 -
airflow/providers/grpc/hooks/grpc.py | 3 +-
airflow/providers/grpc/provider.yaml | 1 -
airflow/providers/hashicorp/CHANGELOG.rst | 9 +-
airflow/providers/hashicorp/__init__.py | 2 +-
airflow/providers/hashicorp/hooks/vault.py | 2 +-
airflow/providers/hashicorp/provider.yaml | 2 +-
airflow/providers/http/CHANGELOG.rst | 5 +-
airflow/providers/http/hooks/http.py | 5 +-
airflow/providers/imap/.latest-doc-only-change.txt | 2 +-
airflow/providers/imap/CHANGELOG.rst | 15 -
airflow/providers/imap/hooks/imap.py | 4 +-
airflow/providers/imap/provider.yaml | 1 -
.../providers/influxdb/.latest-doc-only-change.txt | 2 +-
airflow/providers/jdbc/.latest-doc-only-change.txt | 2 +-
.../providers/jenkins/.latest-doc-only-change.txt | 2 +-
airflow/providers/jenkins/CHANGELOG.rst | 13 -
airflow/providers/jenkins/hooks/jenkins.py | 4 +-
airflow/providers/jenkins/provider.yaml | 1 -
airflow/providers/microsoft/azure/CHANGELOG.rst | 12 +
airflow/providers/microsoft/azure/__init__.py | 2 +-
airflow/providers/microsoft/azure/hooks/adx.py | 4 +-
airflow/providers/microsoft/azure/hooks/asb.py | 4 +-
.../providers/microsoft/azure/hooks/base_azure.py | 4 +-
airflow/providers/microsoft/azure/hooks/batch.py | 4 +-
.../microsoft/azure/hooks/container_registry.py | 4 +-
.../microsoft/azure/hooks/container_volume.py | 6 +-
airflow/providers/microsoft/azure/hooks/cosmos.py | 4 +-
.../microsoft/azure/hooks/data_factory.py | 4 +-
.../providers/microsoft/azure/hooks/data_lake.py | 8 +-
.../providers/microsoft/azure/hooks/fileshare.py | 3 +-
airflow/providers/microsoft/azure/hooks/synapse.py | 11 +-
airflow/providers/microsoft/azure/hooks/wasb.py | 3 +-
.../microsoft/mssql/.latest-doc-only-change.txt | 2 +-
.../microsoft/psrp/.latest-doc-only-change.txt | 2 +-
airflow/providers/microsoft/psrp/CHANGELOG.rst | 15 -
airflow/providers/microsoft/psrp/hooks/psrp.py | 2 -
airflow/providers/microsoft/psrp/provider.yaml | 1 -
.../microsoft/winrm/.latest-doc-only-change.txt | 2 +-
airflow/providers/microsoft/winrm/CHANGELOG.rst | 15 -
airflow/providers/microsoft/winrm/hooks/winrm.py | 3 +-
airflow/providers/microsoft/winrm/provider.yaml | 1 -
airflow/providers/mongo/CHANGELOG.rst | 4 +-
airflow/providers/mongo/hooks/mongo.py | 2 +-
airflow/providers/mysql/CHANGELOG.rst | 1 +
.../providers/neo4j/.latest-doc-only-change.txt | 2 +-
airflow/providers/odbc/CHANGELOG.rst | 2 +
.../providers/openai/.latest-doc-only-change.txt | 2 +-
.../providers/openfaas/.latest-doc-only-change.txt | 2 +-
airflow/providers/openlineage/CHANGELOG.rst | 3 +
.../opensearch/.latest-doc-only-change.txt | 2 +-
.../providers/opsgenie/.latest-doc-only-change.txt | 2 +-
airflow/providers/opsgenie/CHANGELOG.rst | 8 -
airflow/providers/opsgenie/hooks/opsgenie.py | 4 +-
airflow/providers/opsgenie/provider.yaml | 1 -
.../providers/oracle/.latest-doc-only-change.txt | 2 +-
airflow/providers/pagerduty/CHANGELOG.rst | 12 +-
airflow/providers/pagerduty/__init__.py | 2 +-
airflow/providers/pagerduty/hooks/pagerduty.py | 4 +-
.../providers/pagerduty/hooks/pagerduty_events.py | 7 +-
airflow/providers/pagerduty/provider.yaml | 2 +-
airflow/providers/papermill/CHANGELOG.rst | 1 +
.../providers/pgvector/.latest-doc-only-change.txt | 2 +-
airflow/providers/pinecone/CHANGELOG.rst | 10 +-
airflow/providers/pinecone/__init__.py | 2 +-
airflow/providers/pinecone/hooks/pinecone.py | 3 +-
airflow/providers/pinecone/provider.yaml | 2 +-
.../providers/postgres/.latest-doc-only-change.txt | 2 +-
airflow/providers/presto/CHANGELOG.rst | 1 +
.../providers/redis/.latest-doc-only-change.txt | 2 +-
airflow/providers/redis/CHANGELOG.rst | 8 -
airflow/providers/redis/hooks/redis.py | 4 +-
airflow/providers/redis/provider.yaml | 1 -
airflow/providers/salesforce/CHANGELOG.rst | 10 +-
airflow/providers/salesforce/__init__.py | 2 +-
airflow/providers/salesforce/hooks/salesforce.py | 3 +-
airflow/providers/salesforce/provider.yaml | 2 +-
.../providers/samba/.latest-doc-only-change.txt | 2 +-
airflow/providers/samba/CHANGELOG.rst | 8 -
airflow/providers/samba/hooks/samba.py | 4 +-
airflow/providers/samba/provider.yaml | 1 -
.../providers/segment/.latest-doc-only-change.txt | 2 +-
airflow/providers/segment/CHANGELOG.rst | 15 -
airflow/providers/segment/hooks/segment.py | 2 +-
airflow/providers/segment/provider.yaml | 1 -
.../providers/sendgrid/.latest-doc-only-change.txt | 2 +-
airflow/providers/sftp/.latest-doc-only-change.txt | 2 +-
.../singularity/.latest-doc-only-change.txt | 2 +-
airflow/providers/slack/CHANGELOG.rst | 4 +-
airflow/providers/slack/hooks/slack.py | 2 +-
airflow/providers/slack/hooks/slack_webhook.py | 2 +-
airflow/providers/smtp/.latest-doc-only-change.txt | 2 +-
airflow/providers/smtp/CHANGELOG.rst | 13 -
airflow/providers/smtp/hooks/smtp.py | 4 +-
airflow/providers/smtp/provider.yaml | 1 -
airflow/providers/snowflake/CHANGELOG.rst | 1 +
.../providers/sqlite/.latest-doc-only-change.txt | 2 +-
airflow/providers/ssh/.latest-doc-only-change.txt | 2 +-
airflow/providers/ssh/CHANGELOG.rst | 13 -
airflow/providers/ssh/hooks/ssh.py | 3 +-
airflow/providers/ssh/provider.yaml | 1 -
airflow/providers/tableau/CHANGELOG.rst | 10 +-
airflow/providers/tableau/__init__.py | 2 +-
airflow/providers/tableau/hooks/tableau.py | 6 +-
airflow/providers/tableau/provider.yaml | 2 +-
.../providers/tabular/.latest-doc-only-change.txt | 2 +-
airflow/providers/tabular/CHANGELOG.rst | 14 -
airflow/providers/tabular/hooks/tabular.py | 4 +-
airflow/providers/tabular/provider.yaml | 1 -
airflow/providers/telegram/CHANGELOG.rst | 10 +-
airflow/providers/telegram/__init__.py | 2 +-
airflow/providers/telegram/hooks/telegram.py | 3 +-
airflow/providers/telegram/provider.yaml | 2 +-
airflow/providers/trino/CHANGELOG.rst | 1 +
.../providers/vertica/.latest-doc-only-change.txt | 2 +-
airflow/providers/weaviate/CHANGELOG.rst | 1 +
airflow/providers/yandex/CHANGELOG.rst | 6 +-
airflow/providers/yandex/hooks/yandex.py | 125 +-
.../yandex/secrets}/__init__.py | 0
airflow/providers/yandex/secrets/lockbox.py | 280 +++
.../yandex/utils}/__init__.py | 0
airflow/providers/yandex/utils/credentials.py | 100 +
.../__init__.py => yandex/utils/defaults.py} | 28 +-
airflow/providers/yandex/utils/fields.py | 42 +
airflow/providers/yandex/utils/user_agent.py | 48 +
.../providers/zendesk/.latest-doc-only-change.txt | 2 +-
airflow/providers/zendesk/CHANGELOG.rst | 13 -
airflow/providers/zendesk/hooks/zendesk.py | 4 +-
airflow/providers/zendesk/provider.yaml | 1 -
airflow/reproducible_build.yaml | 2 +-
airflow/sensors/external_task.py | 102 +-
airflow/sentry.py | 3 +-
airflow/serialization/pydantic/taskinstance.py | 2 +-
airflow/settings.py | 3 +-
airflow/triggers/external_task.py | 99 +
airflow/utils/sensor_helper.py | 123 +
airflow/www/package.json | 2 +
.../js/dag/details/taskInstance/Logs/LogBlock.tsx | 2 +-
.../js/dag/details/taskInstance/Logs/utils.ts | 27 +-
airflow/www/static/js/dag/useFilters.tsx | 6 +-
airflow/www/static/js/types/api-generated.ts | 10 +-
airflow/www/yarn.lock | 83 +
chart/README.md | 2 +-
contributing-docs/01_roles_in_airflow_project.rst | 177 ++
contributing-docs/02_how_to_communicate.rst | 152 ++
.../03_contributors_quick_start.rst | 179 +-
contributing-docs/04_how_to_contribute.rst | 102 +
contributing-docs/05_pull_requests.rst | 284 +++
contributing-docs/06_development_environments.rst | 160 ++
.../07_local_virtualenv.rst | 123 +-
.../08_static_code_checks.rst | 139 +-
contributing-docs/09_testing.rst | 56 +
contributing-docs/10_working_with_git.rst | 199 ++
contributing-docs/11_provider_packages.rst | 233 ++
.../12_airflow_dependencies_and_extras.rst | 222 ++
contributing-docs/13_metadata_database_updates.rst | 53 +
contributing-docs/14_node_environment_setup.rst | 118 +
contributing-docs/15_architecture_diagrams.rst | 64 +
contributing-docs/16_contribution_workflow.rst | 317 +++
contributing-docs/README.rst | 118 +
.../images}/AirflowBreeze_logo.png | Bin
.../images}/airflow_unit_test_mode.png | Bin
.../images}/candidates_for_backtrack_triggers.png | Bin
.../images}/database_view.png | Bin
.../images}/disk_space_osx.png | Bin
.../images}/docker_socket.png | Bin
.../images}/docker_wsl_integration.png | Bin
{images => contributing-docs/images}/fork.png | Bin
.../images}/pycharm_debug_breeze.png | Bin
.../images}/quick_start/add Interpreter.png | Bin
.../images}/quick_start/add_configuration.png | Bin
.../images}/quick_start/add_env_variable.png | Bin
.../images}/quick_start/airflow_clone.png | Bin
.../images}/quick_start/airflow_fork.png | Bin
.../quick_start/airflow_gitpod_open_ports.png | Bin
.../images}/quick_start/airflow_gitpod_url.png | Bin
.../images}/quick_start/ci_tests.png | Bin
.../images}/quick_start/click_on_clone.png | Bin
.../images}/quick_start/creating_branch_1.png | Bin
.../images}/quick_start/creating_branch_2.png | Bin
.../images}/quick_start/local_airflow.png | Bin
.../images}/quick_start/postgresql_connection.png | Bin
.../images}/quick_start/pr1.png | Bin
.../images}/quick_start/pr2.png | Bin
.../images}/quick_start/pr3.png | Bin
.../images}/quick_start/pycharm_clone.png | Bin
.../images}/quick_start/start_airflow_tmux.png | Bin
.../quick_start/start_airflow_tmux_gitpod.png | Bin
.../quick_start/vscode_add_configuration_1.png | Bin
.../quick_start/vscode_add_configuration_2.png | Bin
.../quick_start/vscode_add_configuration_3.png | Bin
.../quick_start/vscode_add_env_variable.png | Bin
.../images}/quick_start/vscode_click_on_clone.png | Bin
.../images}/quick_start/vscode_clone.png | Bin
.../quick_start/vscode_creating_branch_1.png | Bin
.../quick_start/vscode_creating_branch_2.png | Bin
{images => contributing-docs/images}/rebase.png | Bin
{images => contributing-docs/images}/review.png | Bin
.../images}/run_unittests.png | Bin
.../images}/setup_remote_debugging.png | Bin
.../images}/source_code_mapping_ide.png | Bin
{images => contributing-docs/images}/workflow.png | Bin
contributing-docs/quick-start-ide/README.rst | 42 +
.../contributors_quick_start_codespaces.rst | 4 +-
.../contributors_quick_start_gitpod.rst | 2 +-
.../contributors_quick_start_pycharm.rst | 2 +-
.../contributors_quick_start_vscode.rst | 2 +-
BREEZE.rst => contributing-docs/testing/README.rst | 6 +-
contributing-docs/testing/dag_testing.rst | 63 +
contributing-docs/testing/docker_compose_tests.rst | 103 +
contributing-docs/testing/helm_unit_tests.rst | 111 +
.../testing/images}/k9s.png | Bin
.../testing/images}/kubeconfig-env.png | Bin
.../testing/images}/kubernetes-virtualenv.png | Bin
.../images}/pycharm/configure_test_runner.png | Bin
.../images}/pycharm/pycharm_add_to_context.png | Bin
.../images}/pycharm/pycharm_create_tool.png | Bin
.../testing/images}/pycharm/running_unittests.png | Bin
.../testing/images}/pytest-runner.png | Bin
.../testing/images}/run-test.png | Bin
.../testing/images}/vscode_add_pytest_settings.png | Bin
.../images}/vscode_configure_python_tests.png | Bin
.../images}/vscode_install_python_extension.png | Bin
.../testing/images}/vscode_run_tests.png | Bin
.../images}/vscode_select_pytest_framework.png | Bin
contributing-docs/testing/integration_tests.rst | 170 ++
contributing-docs/testing/k8s_tests.rst | 662 +++++
contributing-docs/testing/system_tests.rst | 168 ++
contributing-docs/testing/testing_packages.rst | 123 +
contributing-docs/testing/unit_tests.rst | 1152 +++++++++
...UALLY_GENERATING_IMAGE_CACHE_AND_CONSTRAINTS.md | 4 +-
dev/README_RELEASE_AIRFLOW.md | 2 +-
dev/README_RELEASE_PROVIDER_PACKAGES.md | 2 +-
dev/airflow-github | 6 +-
dev/breeze/README.md | 2 +-
dev/breeze/SELECTIVE_CHECKS.md | 2 +-
dev/breeze/doc/01_installation.rst | 4 +-
dev/breeze/doc/02_customizing.rst | 2 +-
dev/breeze/doc/03_developer_tasks.rst | 3 +-
dev/breeze/doc/05_test_commands.rst | 4 +-
dev/breeze/doc/09_release_management_tasks.rst | 2 +-
dev/breeze/doc/{breeze.rst => README.rst} | 3 +-
.../0002-implement-standalone-python-command.md | 2 +-
.../airflow_breeze/commands/ci_image_commands.py | 2 +-
.../airflow_breeze/utils/docker_command_utils.py | 1 -
docs/README.rst | 2 +-
docs/apache-airflow-providers-airbyte/commits.rst | 3 +-
docs/apache-airflow-providers-alibaba/commits.rst | 3 +-
docs/apache-airflow-providers-amazon/commits.rst | 3 +-
.../operators/neptune.rst | 77 +
.../commits.rst | 10 +-
.../commits.rst | 11 +-
.../commits.rst | 10 +-
.../commits.rst | 12 +-
.../apache-airflow-providers-apache-hive/index.rst | 6 +-
.../commits.rst | 10 +-
.../commits.rst | 10 +-
.../commits.rst | 10 +-
.../commits.rst | 10 +-
.../commits.rst | 12 +-
.../index.rst | 6 +-
docs/apache-airflow-providers-apprise/commits.rst | 10 +-
.../commits.rst | 12 +-
.../index.rst | 2 +-
docs/apache-airflow-providers-celery/commits.rst | 3 +-
docs/apache-airflow-providers-cloudant/commits.rst | 10 +-
.../commits.rst | 5 +-
docs/apache-airflow-providers-cohere/commits.rst | 12 +-
docs/apache-airflow-providers-cohere/index.rst | 2 +-
.../commits.rst | 12 +-
docs/apache-airflow-providers-common-sql/index.rst | 6 +-
.../commits.rst | 12 +-
.../apache-airflow-providers-dbt-cloud/commits.rst | 3 +-
docs/apache-airflow-providers-discord/commits.rst | 3 +-
docs/apache-airflow-providers-docker/commits.rst | 10 +-
.../commits.rst | 12 +-
.../index.rst | 6 +-
docs/apache-airflow-providers-exasol/commits.rst | 3 +-
docs/apache-airflow-providers-facebook/commits.rst | 10 +-
docs/apache-airflow-providers-ftp/commits.rst | 10 +-
docs/apache-airflow-providers-google/commits.rst | 14 +-
.../operators/cloud/dataproc.rst | 49 +
.../operators/cloud/vertex_ai.rst | 9 +
docs/apache-airflow-providers-grpc/commits.rst | 10 +-
.../apache-airflow-providers-hashicorp/commits.rst | 12 +-
docs/apache-airflow-providers-hashicorp/index.rst | 6 +-
docs/apache-airflow-providers-http/commits.rst | 5 +-
docs/apache-airflow-providers-imap/commits.rst | 10 +-
docs/apache-airflow-providers-jenkins/commits.rst | 10 +-
.../commits.rst | 23 +-
.../index.rst | 6 +-
.../commits.rst | 10 +-
.../commits.rst | 10 +-
docs/apache-airflow-providers-mongo/commits.rst | 10 +-
docs/apache-airflow-providers-mysql/commits.rst | 3 +-
docs/apache-airflow-providers-odbc/commits.rst | 10 +-
.../commits.rst | 3 +-
docs/apache-airflow-providers-opsgenie/commits.rst | 10 +-
.../apache-airflow-providers-pagerduty/commits.rst | 12 +-
docs/apache-airflow-providers-pagerduty/index.rst | 2 +-
.../apache-airflow-providers-papermill/commits.rst | 3 +-
docs/apache-airflow-providers-pinecone/commits.rst | 12 +-
docs/apache-airflow-providers-pinecone/index.rst | 2 +-
docs/apache-airflow-providers-presto/commits.rst | 3 +-
docs/apache-airflow-providers-redis/commits.rst | 10 +-
.../commits.rst | 12 +-
docs/apache-airflow-providers-salesforce/index.rst | 2 +-
docs/apache-airflow-providers-samba/commits.rst | 10 +-
docs/apache-airflow-providers-segment/commits.rst | 10 +-
docs/apache-airflow-providers-slack/commits.rst | 10 +-
docs/apache-airflow-providers-smtp/commits.rst | 10 +-
.../apache-airflow-providers-snowflake/commits.rst | 3 +-
docs/apache-airflow-providers-ssh/commits.rst | 10 +-
docs/apache-airflow-providers-tableau/commits.rst | 12 +-
docs/apache-airflow-providers-tableau/index.rst | 2 +-
docs/apache-airflow-providers-tabular/commits.rst | 10 +-
docs/apache-airflow-providers-telegram/commits.rst | 12 +-
docs/apache-airflow-providers-telegram/index.rst | 2 +-
docs/apache-airflow-providers-trino/commits.rst | 3 +-
docs/apache-airflow-providers-weaviate/commits.rst | 3 +-
docs/apache-airflow-providers-yandex/commits.rst | 11 +-
.../connections/yandexcloud.rst | 67 +-
docs/apache-airflow-providers-yandex/index.rst | 1 +
.../yandex-cloud-lockbox-secret-backend.rst | 293 +++
docs/apache-airflow-providers-zendesk/commits.rst | 10 +-
.../howto/create-custom-providers.rst | 2 +-
docs/apache-airflow/img/airflow_erd.svg | 2 +-
docs/docker-stack/README.md | 2 +-
docs/docker-stack/index.rst | 2 +-
docs/integration-logos/aws/Amazon-Neptune_64.png | Bin 0 -> 19338 bytes
docs/spelling_wordlist.txt | 1 +
generated/PYPI_README.md | 7 +-
generated/README.md | 2 +-
scripts/ci/docker-compose/local.yml | 3 -
.../pre_commit_check_integrations_list.py | 4 +-
.../pre_commit_check_pre_commit_hooks.py | 2 +-
scripts/ci/pre_commit/pre_commit_insert_extras.py | 10 +-
.../pre_commit_new_session_in_provide_session.py | 5 +-
scripts/docker/entrypoint_ci.sh | 13 +
scripts/in_container/_in_container_utils.sh | 2 +-
tests/always/test_project_structure.py | 1 +
.../endpoints/test_dag_run_endpoint.py | 89 +-
.../test_backfill_with_upstream_failed_task.py | 34 +-
tests/jobs/test_backfill_job.py | 30 +-
tests/models/test_taskinstance.py | 31 +
tests/providers/amazon/aws/hooks/test_neptune.py | 52 +
.../providers/amazon/aws/operators/test_neptune.py | 152 ++
.../providers/amazon/aws/triggers/test_neptune.py | 82 +
tests/providers/amazon/aws/waiters/test_neptune.py | 89 +
.../cncf/kubernetes/operators/test_pod.py | 2 +-
.../providers/google/cloud/hooks/test_dataproc.py | 58 +-
.../google/cloud/hooks/test_kubernetes_engine.py | 31 +
.../vertex_ai/test_hyperparameter_tuning_job.py | 287 ++-
.../google/cloud/operators/test_dataproc.py | 261 +-
.../google/cloud/operators/test_vertex_ai.py | 123 +-
.../google/cloud/triggers/test_dataproc.py | 63 +-
.../google/cloud/triggers/test_vertex_ai.py | 139 ++
.../providers/google/cloud/utils/test_dataproc.py | 30 +-
tests/providers/yandex/hooks/test_yandex.py | 152 +-
.../yandex/hooks/test_yandexcloud_dataproc.py | 56 +-
.../yandex/operators/test_yandexcloud_dataproc.py | 38 +-
.../providers/yandex/secrets}/__init__.py | 0
tests/providers/yandex/secrets/test_lockbox.py | 435 ++++
.../providers/yandex/utils}/__init__.py | 0
tests/providers/yandex/utils/test_credentials.py | 168 ++
.../providers/yandex/utils/test_defaults.py | 0
tests/providers/yandex/utils/test_fields.py | 83 +
tests/providers/yandex/utils/test_user_agent.py | 52 +
tests/sensors/test_external_task_sensor.py | 6 +-
tests/system/README.md | 39 +-
.../system/providers/amazon/aws/example_neptune.py | 68 +
...proc_cluster_create_existing_stopped_cluster.py | 120 +
.../dataproc/example_dataproc_cluster_diagnose.py | 118 +
.../example_dataproc_cluster_start_stop.py | 114 +
.../example_vertex_ai_hyperparameter_tuning_job.py | 31 +-
tests/triggers/test_external_task.py | 55 +-
511 files changed, 11531 insertions(+), 6098 deletions(-)
delete mode 100644 TESTING.rst
create mode 100644 airflow/providers/amazon/aws/hooks/neptune.py
create mode 100644 airflow/providers/amazon/aws/operators/neptune.py
create mode 100644 airflow/providers/amazon/aws/triggers/neptune.py
create mode 100644 airflow/providers/amazon/aws/waiters/neptune.json
create mode 100644 airflow/providers/google/cloud/triggers/vertex_ai.py
copy airflow/providers/{cohere/__init__.py => google/cloud/utils/dataproc.py}
(52%)
copy airflow/{api_connexion => providers/yandex/secrets}/__init__.py (100%)
create mode 100644 airflow/providers/yandex/secrets/lockbox.py
copy airflow/{api_connexion => providers/yandex/utils}/__init__.py (100%)
create mode 100644 airflow/providers/yandex/utils/credentials.py
copy airflow/providers/{cohere/__init__.py => yandex/utils/defaults.py} (51%)
create mode 100644 airflow/providers/yandex/utils/fields.py
create mode 100644 airflow/providers/yandex/utils/user_agent.py
create mode 100644 airflow/utils/sensor_helper.py
create mode 100644 contributing-docs/01_roles_in_airflow_project.rst
create mode 100644 contributing-docs/02_how_to_communicate.rst
rename CONTRIBUTORS_QUICK_START.rst =>
contributing-docs/03_contributors_quick_start.rst (83%)
create mode 100644 contributing-docs/04_how_to_contribute.rst
create mode 100644 contributing-docs/05_pull_requests.rst
create mode 100644 contributing-docs/06_development_environments.rst
rename LOCAL_VIRTUALENV.rst => contributing-docs/07_local_virtualenv.rst (88%)
rename STATIC_CODE_CHECKS.rst => contributing-docs/08_static_code_checks.rst
(91%)
create mode 100644 contributing-docs/09_testing.rst
create mode 100644 contributing-docs/10_working_with_git.rst
create mode 100644 contributing-docs/11_provider_packages.rst
create mode 100644 contributing-docs/12_airflow_dependencies_and_extras.rst
create mode 100644 contributing-docs/13_metadata_database_updates.rst
create mode 100644 contributing-docs/14_node_environment_setup.rst
create mode 100644 contributing-docs/15_architecture_diagrams.rst
create mode 100644 contributing-docs/16_contribution_workflow.rst
create mode 100644 contributing-docs/README.rst
rename {images => contributing-docs/images}/AirflowBreeze_logo.png (100%)
rename {images => contributing-docs/images}/airflow_unit_test_mode.png (100%)
rename {images =>
contributing-docs/images}/candidates_for_backtrack_triggers.png (100%)
rename {images => contributing-docs/images}/database_view.png (100%)
rename {images => contributing-docs/images}/disk_space_osx.png (100%)
rename {images => contributing-docs/images}/docker_socket.png (100%)
rename {images => contributing-docs/images}/docker_wsl_integration.png (100%)
rename {images => contributing-docs/images}/fork.png (100%)
rename {images => contributing-docs/images}/pycharm_debug_breeze.png (100%)
rename {images => contributing-docs/images}/quick_start/add Interpreter.png
(100%)
rename {images => contributing-docs/images}/quick_start/add_configuration.png
(100%)
rename {images => contributing-docs/images}/quick_start/add_env_variable.png
(100%)
rename {images => contributing-docs/images}/quick_start/airflow_clone.png
(100%)
rename {images => contributing-docs/images}/quick_start/airflow_fork.png (100%)
rename {images =>
contributing-docs/images}/quick_start/airflow_gitpod_open_ports.png (100%)
rename {images => contributing-docs/images}/quick_start/airflow_gitpod_url.png
(100%)
rename {images => contributing-docs/images}/quick_start/ci_tests.png (100%)
rename {images => contributing-docs/images}/quick_start/click_on_clone.png
(100%)
rename {images => contributing-docs/images}/quick_start/creating_branch_1.png
(100%)
rename {images => contributing-docs/images}/quick_start/creating_branch_2.png
(100%)
rename {images => contributing-docs/images}/quick_start/local_airflow.png
(100%)
rename {images =>
contributing-docs/images}/quick_start/postgresql_connection.png (100%)
rename {images => contributing-docs/images}/quick_start/pr1.png (100%)
rename {images => contributing-docs/images}/quick_start/pr2.png (100%)
rename {images => contributing-docs/images}/quick_start/pr3.png (100%)
rename {images => contributing-docs/images}/quick_start/pycharm_clone.png
(100%)
rename {images => contributing-docs/images}/quick_start/start_airflow_tmux.png
(100%)
rename {images =>
contributing-docs/images}/quick_start/start_airflow_tmux_gitpod.png (100%)
rename {images =>
contributing-docs/images}/quick_start/vscode_add_configuration_1.png (100%)
rename {images =>
contributing-docs/images}/quick_start/vscode_add_configuration_2.png (100%)
rename {images =>
contributing-docs/images}/quick_start/vscode_add_configuration_3.png (100%)
rename {images =>
contributing-docs/images}/quick_start/vscode_add_env_variable.png (100%)
rename {images =>
contributing-docs/images}/quick_start/vscode_click_on_clone.png (100%)
rename {images => contributing-docs/images}/quick_start/vscode_clone.png (100%)
rename {images =>
contributing-docs/images}/quick_start/vscode_creating_branch_1.png (100%)
rename {images =>
contributing-docs/images}/quick_start/vscode_creating_branch_2.png (100%)
rename {images => contributing-docs/images}/rebase.png (100%)
rename {images => contributing-docs/images}/review.png (100%)
rename {images => contributing-docs/images}/run_unittests.png (100%)
rename {images => contributing-docs/images}/setup_remote_debugging.png (100%)
rename {images => contributing-docs/images}/source_code_mapping_ide.png (100%)
rename {images => contributing-docs/images}/workflow.png (100%)
create mode 100644 contributing-docs/quick-start-ide/README.rst
rename CONTRIBUTORS_QUICK_START_CODESPACES.rst =>
contributing-docs/quick-start-ide/contributors_quick_start_codespaces.rst (89%)
rename CONTRIBUTORS_QUICK_START_GITPOD.rst =>
contributing-docs/quick-start-ide/contributors_quick_start_gitpod.rst (97%)
rename CONTRIBUTORS_QUICK_START_PYCHARM.rst =>
contributing-docs/quick-start-ide/contributors_quick_start_pycharm.rst (97%)
rename CONTRIBUTORS_QUICK_START_VSCODE.rst =>
contributing-docs/quick-start-ide/contributors_quick_start_vscode.rst (98%)
copy BREEZE.rst => contributing-docs/testing/README.rst (84%)
create mode 100644 contributing-docs/testing/dag_testing.rst
create mode 100644 contributing-docs/testing/docker_compose_tests.rst
create mode 100644 contributing-docs/testing/helm_unit_tests.rst
rename {images/testing => contributing-docs/testing/images}/k9s.png (100%)
rename {images/testing => contributing-docs/testing/images}/kubeconfig-env.png
(100%)
rename {images/testing =>
contributing-docs/testing/images}/kubernetes-virtualenv.png (100%)
rename {images =>
contributing-docs/testing/images}/pycharm/configure_test_runner.png (100%)
rename {images =>
contributing-docs/testing/images}/pycharm/pycharm_add_to_context.png (100%)
rename {images =>
contributing-docs/testing/images}/pycharm/pycharm_create_tool.png (100%)
rename {images =>
contributing-docs/testing/images}/pycharm/running_unittests.png (100%)
rename {images/testing => contributing-docs/testing/images}/pytest-runner.png
(100%)
rename {images/testing => contributing-docs/testing/images}/run-test.png (100%)
rename {images =>
contributing-docs/testing/images}/vscode_add_pytest_settings.png (100%)
rename {images =>
contributing-docs/testing/images}/vscode_configure_python_tests.png (100%)
rename {images =>
contributing-docs/testing/images}/vscode_install_python_extension.png (100%)
rename {images => contributing-docs/testing/images}/vscode_run_tests.png (100%)
rename {images =>
contributing-docs/testing/images}/vscode_select_pytest_framework.png (100%)
create mode 100644 contributing-docs/testing/integration_tests.rst
create mode 100644 contributing-docs/testing/k8s_tests.rst
create mode 100644 contributing-docs/testing/system_tests.rst
create mode 100644 contributing-docs/testing/testing_packages.rst
create mode 100644 contributing-docs/testing/unit_tests.rst
rename dev/breeze/doc/{breeze.rst => README.rst} (96%)
create mode 100644 docs/apache-airflow-providers-amazon/operators/neptune.rst
create mode 100644
docs/apache-airflow-providers-yandex/secrets-backends/yandex-cloud-lockbox-secret-backend.rst
create mode 100644 docs/integration-logos/aws/Amazon-Neptune_64.png
copy airflow/providers/cohere/__init__.py =>
tests/dags/test_backfill_with_upstream_failed_task.py (52%)
create mode 100644 tests/providers/amazon/aws/hooks/test_neptune.py
create mode 100644 tests/providers/amazon/aws/operators/test_neptune.py
create mode 100644 tests/providers/amazon/aws/triggers/test_neptune.py
create mode 100644 tests/providers/amazon/aws/waiters/test_neptune.py
create mode 100644 tests/providers/google/cloud/triggers/test_vertex_ai.py
copy airflow/providers/cohere/__init__.py =>
tests/providers/google/cloud/utils/test_dataproc.py (52%)
copy {airflow/api_connexion => tests/providers/yandex/secrets}/__init__.py
(100%)
create mode 100644 tests/providers/yandex/secrets/test_lockbox.py
copy {airflow/api_connexion => tests/providers/yandex/utils}/__init__.py (100%)
create mode 100644 tests/providers/yandex/utils/test_credentials.py
copy airflow/api_connexion/__init__.py =>
tests/providers/yandex/utils/test_defaults.py (100%)
create mode 100644 tests/providers/yandex/utils/test_fields.py
create mode 100644 tests/providers/yandex/utils/test_user_agent.py
create mode 100644 tests/system/providers/amazon/aws/example_neptune.py
create mode 100644
tests/system/providers/google/cloud/dataproc/example_dataproc_cluster_create_existing_stopped_cluster.py
create mode 100644
tests/system/providers/google/cloud/dataproc/example_dataproc_cluster_diagnose.py
create mode 100644
tests/system/providers/google/cloud/dataproc/example_dataproc_cluster_start_stop.py
