This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch vincbeck/add-tests-to-python-operator
in repository https://gitbox.apache.org/repos/asf/airflow.git
omit 1dfbed62a7 Merge branch 'main' into
vincbeck/add-tests-to-python-operator
omit bb8aaed68b Fix tests
omit d3c3c77909 Revert "Raise ValueError instead of custom exception"
omit 549b76845f Revert "Testing - Remove one test"
omit 96d96c4833 Testing - Remove one test
omit 4935460a6c Raise ValueError instead of custom exception
omit f3f491c2bd Fix static checks
omit 93733ce9b0 Remove message from exception
omit 353f4b728d Fix raise exception
omit 00f3c41bc4 Static checks and build docs fixes
omit 49786069dc Improve deserialization error handling
omit 6e928ffcf4 Convert log error of
_BasePythonVirtualenvOperator._read_result() into a custom exception class
omit 6dbb09fb6d Add tests to airflow/operators/python.py
add afbe98d580 Do not remove docker provider for Airflow 2.3 check (#30483)
add 73e03131d2 Separate and split run job method into
prepare/execute/complete steps (#30308)
add ffa2d479e9 Update SQLAlchemy `select()` to new style (#30515)
add 44034198c8 Remove JobRunners back reference from Job (#30376)
add 6c2ee8c661 Cast binding +1 in helm chart release vote email (#30590)
add 1e311cf036 Databricks SQL sensor (#30477)
add f080e1e398 Add Hussein to committers (#30589)
add 2ce1130006 Add support in AWS Batch Operator for multinode jobs
(#29522)
add c2679c57aa Fix CONTRIBUTORS_QUICK_START Doc (#30549)
add e89a7eeea6 Use custom validator for OpenAPI request body (#30596)
add 6d1444d68c Remove 'run-' prefix from pre-commit jobs (#30597)
add 92cab74b28 Add ability to override waiter delay in EcsRunTaskOperator
(#30586)
add 0f3b6579cb Prepare docs for RC2 of provider wave (#30606)
add 7609021ce9 Deactivate DAGs deleted from within zipfiles (#30608)
add d8af20f064 DagBag: Use dag.fileloc instead of dag.full_filepath in
exception message (#30610)
add cce9b2217b Remove gauge scheduler.tasks.running (#30374)
add 9e5fabecb0 Recover from `too old resource version exception` by
retrieving the latest `resource_version` (#30425)
add 90e66e2b5d docs: use correct import path for Dataset (#30617)
add 2c66b240cf Speed up TaskGroups with caching property of group_id
(#30284)
add 5e23de5a37 Fix `TriggerDagRunOperator` with deferrable parameter
(#30406)
add 8fc24aa1f9 Fix failing SQS tests on moto upgrade (#30625)
add fa8fe5e7b8 fix possible race condition when refreshing DAGs (#30392)
add e18b32e608 Remove Norm and Hussein from the triage group (#30627)
add 312f7e873d Remove mysql-connector-python (#30487)
add 916dd96691 Better error message where non-compatible providers are not
excluded (#30629)
add 058b6ebdd8 Updating the links to the Dataform product documentation to
fix 404 redirect error (#30631)
add 96661789cc New AWS sensor — DynamoDBValueSensor (#28338)
add 51f9910ecb Remove duplicate param docstring in EksPodOperator (#30634)
add c1a685f752 In `DockerOperator`, adding an attribute `tls_verify` to
choose whether to validate certificate (#30309) (#30310)
add 1ebeb19bf7 Add `max_active_tis_per_dagrun` for Dynamic Task Mapping
(#29094)
add 6f2277c83a Simplify logic to resolve tasks stuck in queued despite
stalled_task_timeout (#30375)
add 57c09e59ee Display Video 360 cleanup v1 API usage (#30577)
add f01051a75e Fix mapped tasks partial arguments when DAG default args
are provided (#29913)
add 55963de61e First commit of OpenLineage provider. (#29940)
add 440bf46ff0 Add v2-6-test and v2-6-stable to codecov and protected
branches (#30640)
add dcffbb4aff Adding configuration to control retry parameters for k8s
api client (#29809)
add 8413c0e15b fix(chart): webserver probes timeout and period. (#30609)
add cb5a2c56b9 Clarify release announcements on social media (#30639)
add 7c2d3617bf DynamoDBHook - waiter_path() to consider `resource_type` or
`client_type` (#30595)
add c5b685e88d Improve task & run actions ux in grid view (#30373)
add 7074167d71 Add command to get DAG Details via CLI (#30432)
add 0d2e6dce70 When clearing task instances try to get associated DAGs
from database (#29065)
add 38f2b4a4df Organize Amazon providers docs index (#30541)
add 9fab11cf51 preload airflow imports before dag parsing to save time
(#30495)
add 37cf0506b5 Add delete inactive run functionality to databricks
provider (#30646)
add 959039837c Create audit_logs.rst (#30405)
add 90ee763947 Present affected task instances as table (#30633)
add 563bc58323 Helm chart 1.9.0 has been released (#30649)
add d3aeb4db0c Add 2.6.0b1 to issue template (#30652)
add 4eab616e9f add missing project_id in BigQueryGetDataOperator (#30651)
add d87eefc15f Properly classify google_vendor package to google provider
(#30659)
add 5b42aa3b8d Make pandas optional in workday calendar example (#30660)
add da2749cae5 Update Google Campaign Manager360 operators to use API v4
(#30598)
add f511653e5a Skip KubernetesPodOperator task when it returns a provided
exit code (#29000)
add 0f107bebbf Upgrade Pip to 23.1 (#30663)
add 18e5612947 Fix docs building for workday example. (#30664)
add 1cf1fc46e9 docker compose doc changes (#30662)
add 7b8093def8 Add tests to airflow/operators/python.py
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (1dfbed62a7)
\
N -- N -- N refs/heads/vincbeck/add-tests-to-python-operator
(7b8093def8)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.asf.yaml | 5 +-
.github/ISSUE_TEMPLATE/airflow_bug_report.yml | 1 +
.../airflow_helmchart_bug_report.yml | 3 +-
.../airflow_providers_bug_report.yml | 1 +
.github/workflows/ci.yml | 8 +-
.pre-commit-config.yaml | 14 +-
BREEZE.rst | 14 +-
CONTRIBUTING.rst | 8 +-
CONTRIBUTORS_QUICK_START.rst | 10 +-
Dockerfile | 4 +-
Dockerfile.ci | 10 +-
IMAGES.rst | 2 +-
INSTALL | 8 +-
STATIC_CODE_CHECKS.rst | 34 +-
airflow/api_internal/endpoints/rpc_api_endpoint.py | 4 +-
airflow/cli/cli_config.py | 6 +
airflow/cli/commands/dag_command.py | 22 +
airflow/cli/commands/dag_processor_command.py | 32 +-
airflow/cli/commands/scheduler_command.py | 20 +-
airflow/cli/commands/task_command.py | 11 +-
airflow/cli/commands/triggerer_command.py | 9 +-
airflow/config_templates/config.yml | 75 +-
airflow/config_templates/default_airflow.cfg | 39 +-
airflow/configuration.py | 30 +-
airflow/dag_processing/manager.py | 24 +-
airflow/dag_processing/processor.py | 21 +-
airflow/example_dags/plugins/workday.py | 21 +-
airflow/executors/base_executor.py | 12 +
airflow/executors/celery_executor.py | 160 +--
airflow/executors/celery_kubernetes_executor.py | 8 +
airflow/executors/kubernetes_executor.py | 98 +-
airflow/executors/local_kubernetes_executor.py | 6 +
airflow/jobs/JOB_LIFECYCLE.md | 158 +++
airflow/jobs/backfill_job_runner.py | 36 +-
airflow/jobs/base_job_runner.py | 3 -
airflow/jobs/dag_processor_job_runner.py | 22 +-
airflow/jobs/job.py | 172 ++-
airflow/jobs/local_task_job_runner.py | 24 +-
airflow/jobs/scheduler_job_runner.py | 232 +++-
airflow/jobs/triggerer_job_runner.py | 22 +-
airflow/kubernetes/kube_client.py | 21 +-
airflow/kubernetes/kube_config.py | 7 -
.../0093_2_2_0_taskinstance_keyed_to_dagrun.py | 2 +-
...3_0_migrate_rtif_to_use_run_id_and_map_index.py | 2 +-
.../0105_2_3_0_add_map_index_to_taskfail.py | 2 +-
airflow/models/baseoperator.py | 189 +--
airflow/models/dag.py | 60 +-
airflow/models/dagbag.py | 21 +-
airflow/models/dagrun.py | 3 +-
airflow/models/mappedoperator.py | 4 +
airflow/models/serialized_dag.py | 18 +
airflow/models/taskinstance.py | 28 +-
airflow/operators/trigger_dagrun.py | 11 +-
airflow/plugins_manager.py | 2 +-
airflow/providers/amazon/aws/hooks/base_aws.py | 3 +-
airflow/providers/amazon/aws/hooks/batch_client.py | 87 +-
airflow/providers/amazon/aws/operators/batch.py | 102 +-
airflow/providers/amazon/aws/operators/ecs.py | 19 +-
airflow/providers/amazon/aws/operators/eks.py | 1 -
airflow/providers/amazon/aws/sensors/dynamodb.py | 95 ++
airflow/providers/amazon/provider.yaml | 55 +-
airflow/providers/cncf/kubernetes/operators/pod.py | 25 +-
airflow/providers/databricks/hooks/databricks.py | 10 +
airflow/providers/databricks/provider.yaml | 4 +
.../databricks/sensors}/__init__.py | 0
.../providers/databricks/sensors/databricks_sql.py | 134 ++
airflow/providers/docker/hooks/docker.py | 4 +-
airflow/providers/docker/operators/docker.py | 4 +
airflow/providers/google/CHANGELOG.rst | 11 +
.../providers/google/cloud/operators/bigquery.py | 1 +
.../example_dags/example_display_video.py | 64 -
.../marketing_platform/hooks/campaign_manager.py | 6 +-
.../marketing_platform/hooks/display_video.py | 45 +-
.../operators/campaign_manager.py | 44 +-
.../marketing_platform/operators/display_video.py | 284 ----
.../marketing_platform/sensors/campaign_manager.py | 6 +-
.../marketing_platform/sensors/display_video.py | 65 -
airflow/providers/google/provider.yaml | 1 +
airflow/providers/microsoft/azure/CHANGELOG.rst | 2 +
airflow/providers/mysql/hooks/mysql.py | 18 +-
airflow/providers/mysql/provider.yaml | 6 +-
.../{apache/impala => openlineage}/CHANGELOG.rst | 0
.../providers/openlineage/__init__.py | 26 +-
.../providers/openlineage/extractors/__init__.py | 11 +-
airflow/providers/openlineage/extractors/base.py | 102 ++
.../providers/openlineage/extractors/manager.py | 161 +++
.../openlineage/plugins}/__init__.py | 0
airflow/providers/openlineage/plugins/adapter.py | 306 +++++
airflow/providers/openlineage/plugins/facets.py | 74 ++
airflow/providers/openlineage/plugins/listener.py | 191 +++
airflow/providers/openlineage/plugins/macros.py | 58 +
.../providers/openlineage/plugins/openlineage.py | 27 +-
airflow/providers/openlineage/provider.yaml | 46 +
.../openlineage/utils}/__init__.py | 0
airflow/providers/openlineage/utils/utils.py | 396 ++++++
airflow/serialization/enums.py | 2 +-
airflow/task/task_runner/__init__.py | 2 +-
airflow/task/task_runner/base_task_runner.py | 21 +-
airflow/task/task_runner/cgroup_task_runner.py | 6 +-
airflow/task/task_runner/standard_task_runner.py | 8 +-
airflow/ti_deps/deps/task_concurrency_dep.py | 17 +-
airflow/triggers/external_task.py | 2 +-
airflow/utils/db.py | 4 +-
airflow/utils/file.py | 21 +
airflow/utils/task_group.py | 9 +-
airflow/www/extensions/init_views.py | 17 +
airflow/www/static/js/api/index.ts | 4 +-
airflow/www/static/js/api/useClearTask.ts | 7 +-
.../api/{useClearTask.ts => useClearTaskDryRun.ts} | 83 +-
airflow/www/static/js/api/useMarkFailedTask.ts | 8 +-
airflow/www/static/js/api/useMarkSuccessTask.ts | 8 +-
...{useConfirmMarkTask.ts => useMarkTaskDryRun.ts} | 51 +-
airflow/www/static/js/components/ConfirmDialog.tsx | 103 --
.../www/static/js/dag/details/dagRun/ClearRun.tsx | 81 +-
.../static/js/dag/details/dagRun/MarkFailedRun.tsx | 73 --
.../www/static/js/dag/details/dagRun/MarkRunAs.tsx | 90 ++
.../js/dag/details/dagRun/MarkSuccessRun.tsx | 77 --
.../www/static/js/dag/details/dagRun/QueueRun.tsx | 76 --
airflow/www/static/js/dag/details/dagRun/index.tsx | 19 -
airflow/www/static/js/dag/details/index.tsx | 37 +-
.../static/js/dag/details/taskInstance/index.tsx | 20 -
.../taskInstance/taskActions/ActionButton.tsx | 4 +-
.../taskInstance/taskActions/ActionModal.tsx | 130 ++
.../dag/details/taskInstance/taskActions/Clear.tsx | 174 ---
.../taskInstance/taskActions/ClearInstance.tsx | 235 ++++
.../taskInstance/taskActions/MarkFailed.tsx | 141 --
.../taskInstance/taskActions/MarkInstanceAs.tsx | 267 ++++
.../taskInstance/taskActions/MarkSuccess.tsx | 141 --
.../dag/details/taskInstance/taskActions/index.tsx | 84 --
.../dag/details/taskInstance/taskActions/types.ts | 29 -
airflow/www/static/js/types/index.ts | 17 +-
airflow/www/views.py | 19 +-
chart/Chart.yaml | 2 +-
.../templates/webserver/webserver-deployment.yaml | 16 +-
chart/values.schema.json | 12 +-
chart/values.yaml | 12 +-
codecov.yml | 4 +
dev/README_RELEASE_AIRFLOW.md | 16 +-
dev/README_RELEASE_HELM_CHART.md | 18 +-
dev/README_RELEASE_PROVIDER_PACKAGES.md | 17 +
dev/breeze/src/airflow_breeze/global_constants.py | 2 +-
dev/breeze/src/airflow_breeze/pre_commit_ids.py | 10 +-
dev/perf/scheduler_dag_execution_timing.py | 18 +-
dev/perf/sql_queries.py | 5 +-
docker_tests/test_prod_image.py | 4 +-
.../_partials/prerequisite_tasks.rst | 0
docs/apache-airflow-providers-amazon/index.rst | 1 +
.../operators/appflow.rst | 2 +-
.../operators/athena.rst | 2 +-
.../operators/batch.rst | 2 +-
.../operators/cloudformation.rst | 2 +-
.../operators/datasync.rst | 2 +-
.../operators/dms.rst | 2 +-
.../{transfer/ftp_to_s3.rst => dynamodb.rst} | 38 +-
.../operators/ec2.rst | 8 +-
.../operators/ecs.rst | 2 +-
.../operators/eks.rst | 2 +-
.../operators/{ => emr}/emr.rst | 2 +-
.../operators/{ => emr}/emr_eks.rst | 2 +-
.../operators/{ => emr}/emr_serverless.rst | 2 +-
.../operators/{transfer => emr}/index.rst | 4 +-
.../operators/glue.rst | 2 +-
.../operators/index.rst | 4 +-
.../operators/lambda.rst | 2 +-
.../operators/quicksight.rst | 2 +-
.../operators/rds.rst | 2 +-
.../operators/{transfer => redshift}/index.rst | 2 +-
.../operators/{ => redshift}/redshift_cluster.rst | 8 +-
.../operators/{ => redshift}/redshift_data.rst | 2 +-
.../operators/{ => redshift}/redshift_sql.rst | 8 +-
.../operators/{ => s3}/glacier.rst | 2 +-
.../operators/{transfer => s3}/index.rst | 4 +-
.../operators/{ => s3}/s3.rst | 2 +-
.../operators/sagemaker.rst | 2 +-
.../operators/sns.rst | 2 +-
.../operators/sqs.rst | 8 +-
.../operators/step_functions.rst | 2 +-
docs/apache-airflow-providers-amazon/redirects.txt | 33 +-
.../{operators => }/transfer/dynamodb_to_s3.rst | 0
.../{operators => }/transfer/ftp_to_s3.rst | 0
.../{operators => }/transfer/gcs_to_s3.rst | 0
.../{operators => }/transfer/glacier_to_gcs.rst | 0
.../{operators => }/transfer/google_api_to_s3.rst | 0
.../{operators => }/transfer/hive_to_dynamodb.rst | 0
.../transfer/imap_attachment_to_s3.rst | 0
.../{operators => }/transfer/index.rst | 0
.../{operators => }/transfer/local_to_s3.rst | 0
.../{operators => }/transfer/mongo_to_s3.rst | 0
.../{operators => }/transfer/redshift_to_s3.rst | 0
.../{operators => }/transfer/s3_to_ftp.rst | 0
.../{operators => }/transfer/s3_to_redshift.rst | 0
.../{operators => }/transfer/s3_to_sftp.rst | 0
.../{operators => }/transfer/s3_to_sql.rst | 0
.../{operators => }/transfer/salesforce_to_s3.rst | 0
.../{operators => }/transfer/sftp_to_s3.rst | 0
.../{operators => }/transfer/sql_to_s3.rst | 0
.../operators/sql.rst | 42 +-
docs/apache-airflow-providers-google/commits.rst | 2 +
.../operators/cloud/dataform.rst | 4 +-
.../marketing_platform/campaign_manager.rst | 8 +-
.../operators/marketing_platform/display_video.rst | 86 +-
.../commits.rst | 10 +-
.../commits.rst} | 13 +-
.../guides/developer.rst | 53 +
.../guides/structure.rst} | 18 +-
.../guides/user.rst} | 24 +-
.../apache-airflow-providers-openlineage/index.rst | 102 ++
.../installing-providers-from-sources.rst | 0
.../macros.rst} | 47 +-
.../logging-monitoring/metrics.rst | 1 -
.../security/audit_logs.rst | 64 +
.../dagfile-processing.rst | 1 +
.../authoring-and-scheduling/datasets.rst | 4 +-
docs/apache-airflow/extra-packages-ref.rst | 2 +
.../howto/docker-compose/docker-compose.yaml | 1 +
docs/apache-airflow/howto/docker-compose/index.rst | 3 +-
docs/apache-airflow/howto/set-up-database.rst | 8 +-
docs/apache-airflow/img/airflow_erd.sha256 | 2 +-
docs/apache-airflow/project.rst | 1 +
docs/conf.py | 4 +
docs/docker-stack/build-arg-ref.rst | 2 +-
docs/integration-logos/openlineage/openlineage.svg | 47 +
docs/spelling_wordlist.txt | 4 +
generated/provider_dependencies.json | 11 +-
images/breeze/output-commands-hash.txt | 12 +-
images/breeze/output-commands.svg | 90 +-
images/breeze/output_build-docs.svg | 128 +-
images/breeze/output_release-management.svg | 30 +-
...management_generate-issue-content-providers.svg | 60 +-
...e-management_prepare-provider-documentation.svg | 56 +-
...elease-management_prepare-provider-packages.svg | 42 +-
images/breeze/output_static-checks.svg | 4 +-
images/quick_start/mysql_connection.png | Bin 99933 -> 0 bytes
images/quick_start/postgresql_connection.png | Bin 0 -> 240443 bytes
newsfragments/30374.significant.rst | 5 +
newsfragments/30375.significant.rst | 9 +
.../pre_commit_check_pre_commit_hooks.py | 2 +-
.../pre_commit_update_providers_dependencies.py | 2 +
scripts/docker/common.sh | 2 +-
scripts/docker/entrypoint_ci.sh | 6 +
.../in_container/run_provider_yaml_files_check.py | 8 +-
scripts/in_container/verify_providers.py | 4 -
.../endpoints/test_health_endpoint.py | 22 +-
.../endpoints/test_task_instance_endpoint.py | 11 +-
tests/cli/commands/test_dag_command.py | 20 +
tests/cli/commands/test_dag_processor_command.py | 4 +-
tests/cli/commands/test_jobs_command.py | 69 +-
tests/cli/commands/test_task_command.py | 9 +-
tests/cli/commands/test_triggerer_command.py | 2 +-
tests/conftest.py | 2 +
tests/core/test_impersonation_tests.py | 6 +-
.../{test_manager.py => test_job_runner.py} | 671 ++++++----
.../redirects.txt => tests/dags/test_imports.py | 35 +-
tests/executors/test_base_executor.py | 1 -
tests/executors/test_celery_executor.py | 139 +-
tests/executors/test_dask_executor.py | 17 +-
tests/executors/test_kubernetes_executor.py | 177 +--
.../integration/executors/test_celery_executor.py | 5 +-
tests/jobs/test_backfill_job.py | 824 ++++++------
tests/jobs/test_base_job.py | 61 +-
tests/jobs/test_local_task_job.py | 244 ++--
tests/jobs/test_scheduler_job.py | 1382 ++++++++++++--------
tests/jobs/test_triggerer_job.py | 129 +-
tests/kubernetes/test_client.py | 11 +
tests/listeners/class_listener.py | 10 +-
tests/listeners/full_listener.py | 8 +-
tests/listeners/test_listeners.py | 31 +-
tests/models/test_cleartasks.py | 97 +-
tests/models/test_dag.py | 18 +-
tests/models/test_dagbag.py | 48 +
tests/models/test_mappedoperator.py | 14 +
tests/models/test_taskinstance.py | 13 +
tests/models/test_trigger.py | 9 +-
tests/operators/test_trigger_dagrun.py | 40 +-
.../amazon/aws/hooks/test_batch_client.py | 74 +-
tests/providers/amazon/aws/hooks/test_dynamodb.py | 7 +
tests/providers/amazon/aws/operators/test_batch.py | 86 +-
tests/providers/amazon/aws/operators/test_ecs.py | 4 +-
tests/providers/amazon/aws/operators/test_sqs.py | 4 +-
.../providers/amazon/aws/sensors/test_dynamodb.py | 93 ++
.../cncf/kubernetes/operators/test_pod.py | 95 +-
.../providers/databricks/hooks/test_databricks.py | 22 +
.../providers/databricks/sensors}/__init__.py | 0
.../databricks/sensors/test_databricks_sql.py | 97 ++
tests/providers/docker/operators/test_docker.py | 2 +
.../hooks/test_campaign_manager.py | 2 +-
.../marketing_platform/hooks/test_display_video.py | 24 +-
.../operators/test_campaign_manager.py | 2 +-
.../operators/test_display_video.py | 192 ---
.../sensors/test_campaign_manager.py | 2 +-
.../sensors/test_display_video.py | 19 -
tests/providers/mysql/hooks/test_mysql.py | 57 -
.../mysql/hooks/test_mysql_connector_python.py | 86 ++
.../providers/openlineage/__init__.py | 7 +-
.../providers/openlineage/log_config.py | 35 +-
.../providers/openlineage/plugins}/__init__.py | 0
.../providers/openlineage/plugins/test_listener.py | 70 +
.../plugins/test_openlineage_adapter.py | 278 ++++
tests/providers/openlineage/plugins/test_utils.py | 203 +++
tests/serialization/test_dag_serialization.py | 1 +
tests/serialization/test_pydantic_models.py | 3 +-
.../providers/amazon/aws/example_dynamodb.py | 113 ++
.../databricks/example_databricks_sensors.py | 86 ++
.../marketing_platform/example_campaign_manager.py | 20 +-
tests/task/task_runner/test_base_task_runner.py | 6 +-
tests/task/task_runner/test_cgroup_task_runner.py | 11 +-
.../task/task_runner/test_standard_task_runner.py | 139 +-
tests/task/task_runner/test_task_runner.py | 16 +-
tests/ti_deps/deps/test_task_concurrency.py | 41 +-
tests/utils/test_file.py | 26 +
tests/utils/test_helpers.py | 8 +-
tests/utils/test_log_handlers.py | 4 +-
tests/www/views/test_views_base.py | 6 +-
313 files changed, 8657 insertions(+), 5073 deletions(-)
create mode 100644 airflow/jobs/JOB_LIFECYCLE.md
create mode 100644 airflow/providers/amazon/aws/sensors/dynamodb.py
copy airflow/{api_connexion => providers/databricks/sensors}/__init__.py (100%)
create mode 100644 airflow/providers/databricks/sensors/databricks_sql.py
copy airflow/providers/{apache/impala => openlineage}/CHANGELOG.rst (100%)
copy docs/apache-airflow-providers-amazon/redirects.txt =>
airflow/providers/openlineage/__init__.py (55%)
copy docs/apache-airflow-providers-amazon/redirects.txt =>
airflow/providers/openlineage/extractors/__init__.py (69%)
create mode 100644 airflow/providers/openlineage/extractors/base.py
create mode 100644 airflow/providers/openlineage/extractors/manager.py
copy airflow/{api_connexion => providers/openlineage/plugins}/__init__.py
(100%)
create mode 100644 airflow/providers/openlineage/plugins/adapter.py
create mode 100644 airflow/providers/openlineage/plugins/facets.py
create mode 100644 airflow/providers/openlineage/plugins/listener.py
create mode 100644 airflow/providers/openlineage/plugins/macros.py
copy docs/apache-airflow-providers-amazon/redirects.txt =>
airflow/providers/openlineage/plugins/openlineage.py (51%)
create mode 100644 airflow/providers/openlineage/provider.yaml
copy airflow/{api_connexion => providers/openlineage/utils}/__init__.py (100%)
create mode 100644 airflow/providers/openlineage/utils/utils.py
copy airflow/www/static/js/api/{useClearTask.ts => useClearTaskDryRun.ts} (60%)
rename airflow/www/static/js/api/{useConfirmMarkTask.ts =>
useMarkTaskDryRun.ts} (70%)
delete mode 100644 airflow/www/static/js/components/ConfirmDialog.tsx
delete mode 100644 airflow/www/static/js/dag/details/dagRun/MarkFailedRun.tsx
create mode 100644 airflow/www/static/js/dag/details/dagRun/MarkRunAs.tsx
delete mode 100644 airflow/www/static/js/dag/details/dagRun/MarkSuccessRun.tsx
delete mode 100644 airflow/www/static/js/dag/details/dagRun/QueueRun.tsx
create mode 100644
airflow/www/static/js/dag/details/taskInstance/taskActions/ActionModal.tsx
delete mode 100644
airflow/www/static/js/dag/details/taskInstance/taskActions/Clear.tsx
create mode 100644
airflow/www/static/js/dag/details/taskInstance/taskActions/ClearInstance.tsx
delete mode 100644
airflow/www/static/js/dag/details/taskInstance/taskActions/MarkFailed.tsx
create mode 100644
airflow/www/static/js/dag/details/taskInstance/taskActions/MarkInstanceAs.tsx
delete mode 100644
airflow/www/static/js/dag/details/taskInstance/taskActions/MarkSuccess.tsx
delete mode 100644
airflow/www/static/js/dag/details/taskInstance/taskActions/index.tsx
delete mode 100644
airflow/www/static/js/dag/details/taskInstance/taskActions/types.ts
copy docs/apache-airflow-providers-amazon/{operators =>
}/_partials/prerequisite_tasks.rst (100%)
copy docs/apache-airflow-providers-amazon/operators/{transfer/ftp_to_s3.rst =>
dynamodb.rst} (52%)
rename docs/apache-airflow-providers-amazon/operators/{ => emr}/emr.rst (99%)
rename docs/apache-airflow-providers-amazon/operators/{ => emr}/emr_eks.rst
(99%)
rename docs/apache-airflow-providers-amazon/operators/{ =>
emr}/emr_serverless.rst (98%)
copy docs/apache-airflow-providers-amazon/operators/{transfer =>
emr}/index.rst (94%)
copy docs/apache-airflow-providers-amazon/operators/{transfer =>
redshift}/index.rst (97%)
rename docs/apache-airflow-providers-amazon/operators/{ =>
redshift}/redshift_cluster.rst (97%)
rename docs/apache-airflow-providers-amazon/operators/{ =>
redshift}/redshift_data.rst (97%)
rename docs/apache-airflow-providers-amazon/operators/{ =>
redshift}/redshift_sql.rst (95%)
rename docs/apache-airflow-providers-amazon/operators/{ => s3}/glacier.rst
(98%)
copy docs/apache-airflow-providers-amazon/operators/{transfer => s3}/index.rst
(94%)
rename docs/apache-airflow-providers-amazon/operators/{ => s3}/s3.rst (99%)
rename docs/apache-airflow-providers-amazon/{operators =>
}/transfer/dynamodb_to_s3.rst (100%)
rename docs/apache-airflow-providers-amazon/{operators =>
}/transfer/ftp_to_s3.rst (100%)
rename docs/apache-airflow-providers-amazon/{operators =>
}/transfer/gcs_to_s3.rst (100%)
rename docs/apache-airflow-providers-amazon/{operators =>
}/transfer/glacier_to_gcs.rst (100%)
rename docs/apache-airflow-providers-amazon/{operators =>
}/transfer/google_api_to_s3.rst (100%)
rename docs/apache-airflow-providers-amazon/{operators =>
}/transfer/hive_to_dynamodb.rst (100%)
rename docs/apache-airflow-providers-amazon/{operators =>
}/transfer/imap_attachment_to_s3.rst (100%)
copy docs/apache-airflow-providers-amazon/{operators => }/transfer/index.rst
(100%)
rename docs/apache-airflow-providers-amazon/{operators =>
}/transfer/local_to_s3.rst (100%)
rename docs/apache-airflow-providers-amazon/{operators =>
}/transfer/mongo_to_s3.rst (100%)
rename docs/apache-airflow-providers-amazon/{operators =>
}/transfer/redshift_to_s3.rst (100%)
rename docs/apache-airflow-providers-amazon/{operators =>
}/transfer/s3_to_ftp.rst (100%)
rename docs/apache-airflow-providers-amazon/{operators =>
}/transfer/s3_to_redshift.rst (100%)
rename docs/apache-airflow-providers-amazon/{operators =>
}/transfer/s3_to_sftp.rst (100%)
rename docs/apache-airflow-providers-amazon/{operators =>
}/transfer/s3_to_sql.rst (100%)
rename docs/apache-airflow-providers-amazon/{operators =>
}/transfer/salesforce_to_s3.rst (100%)
rename docs/apache-airflow-providers-amazon/{operators =>
}/transfer/sftp_to_s3.rst (100%)
rename docs/apache-airflow-providers-amazon/{operators =>
}/transfer/sql_to_s3.rst (100%)
copy docs/{apache-airflow-providers-amazon/operators/transfer/index.rst =>
apache-airflow-providers-openlineage/commits.rst} (72%)
create mode 100644
docs/apache-airflow-providers-openlineage/guides/developer.rst
rename docs/{apache-airflow-providers-amazon/operators/transfer/index.rst =>
apache-airflow-providers-openlineage/guides/structure.rst} (53%)
copy
docs/{apache-airflow-providers-amazon/operators/_partials/prerequisite_tasks.rst
=> apache-airflow-providers-openlineage/guides/user.rst} (62%)
create mode 100644 docs/apache-airflow-providers-openlineage/index.rst
copy docs/{apache-airflow-providers-airbyte =>
apache-airflow-providers-openlineage}/installing-providers-from-sources.rst
(100%)
rename
docs/{apache-airflow-providers-amazon/operators/_partials/prerequisite_tasks.rst
=> apache-airflow-providers-openlineage/macros.rst} (52%)
create mode 100644
docs/apache-airflow/administration-and-deployment/security/audit_logs.rst
create mode 100644 docs/integration-logos/openlineage/openlineage.svg
delete mode 100644 images/quick_start/mysql_connection.png
create mode 100644 images/quick_start/postgresql_connection.png
create mode 100644 newsfragments/30374.significant.rst
create mode 100644 newsfragments/30375.significant.rst
rename tests/dag_processing/{test_manager.py => test_job_runner.py} (68%)
copy docs/apache-airflow-providers-amazon/redirects.txt =>
tests/dags/test_imports.py (58%)
create mode 100644 tests/providers/amazon/aws/sensors/test_dynamodb.py
copy {airflow/api_connexion => tests/providers/databricks/sensors}/__init__.py
(100%)
create mode 100644 tests/providers/databricks/sensors/test_databricks_sql.py
create mode 100644 tests/providers/mysql/hooks/test_mysql_connector_python.py
copy docs/apache-airflow-providers-amazon/redirects.txt =>
tests/providers/openlineage/__init__.py (69%)
copy docs/apache-airflow-providers-amazon/redirects.txt =>
tests/providers/openlineage/log_config.py (53%)
copy {airflow/api_connexion =>
tests/providers/openlineage/plugins}/__init__.py (100%)
create mode 100644 tests/providers/openlineage/plugins/test_listener.py
create mode 100644
tests/providers/openlineage/plugins/test_openlineage_adapter.py
create mode 100644 tests/providers/openlineage/plugins/test_utils.py
create mode 100644 tests/system/providers/amazon/aws/example_dynamodb.py
create mode 100644
tests/system/providers/databricks/example_databricks_sensors.py
