This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch move-prepare-providers-packages-to-breeze
in repository https://gitbox.apache.org/repos/asf/airflow.git
omit 1219f8c13f Move prepare-provider-packages to be run entirely in Breeze
Python
omit fddf030a60 Move "prepare-provider-documentation" to Breeze
add 18dac61bf6 Add remote kernel support for papermill operator (#34840)
add c877c6860e Enhancements in IMAGE.rst (#35582)
add 31450bbe3c Remove non existing params from
`KubernetesResourceBaseOperator` docstring
add 9439111e73 Add Listener hooks for Datasets (#34418)
add a8bc6c551d added cancelled handling in dbt deferred (#35597)
add 4cc98ba664 Rename providers tests modules (#35603)
add 486ccba4cf Remove inconsequential code bits in KPO logging (#35416)
add 1a5a272312 Remove '$' sign from Linux command snippets for enhanced
copy-paste functionality (#35609)
add 0a93e2e28b Add support for securityContext in dag-processors
wait-for-migrations (#35593)
add a295ef3cb0 Bump axios from 0.26.0 to 1.6.0 in /airflow/www/ (#35624)
add 1e0a357252 Correct a typo in contributor quick start doc (#35621)
add 76ceeb4e4a Numeric values in DAG details are incorrectly rendered as
timestamps (#35538)
add 5626590406 openlineage, aws: Add OpenLineage support for
AthenaOperator. (#35090)
add acb9458d09 Refine Type Handling in OpenAI Embedding Operator to Match
OpenAI Typings (#35547)
add 21a93a060e Explain the db providers necessity in slim images (#35634)
add 9ae57d023b Add `python_kubernetes_script.jinja2` to package_data
(#35626)
add 84c40a7877 Prevent assignment of non JSON serializable values to
DagRun.conf dict (#35096)
add 6ad44edc7c Move "prepare-provider-documentation" to Breeze
new 5b7ea6731f Move prepare-provider-packages to be run entirely in Breeze
Python
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (1219f8c13f)
\
N -- N -- N refs/heads/move-prepare-providers-packages-to-breeze
(5b7ea6731f)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
CONTRIBUTORS_QUICK_START.rst | 122 +++++++--------
IMAGES.rst | 6 +-
airflow/datasets/manager.py | 23 ++-
airflow/listeners/listener.py | 3 +-
.../spec/dataset.py} | 22 ++-
airflow/models/dag.py | 16 +-
airflow/models/dagrun.py | 51 +++++-
airflow/providers/amazon/aws/hooks/athena.py | 27 +++-
airflow/providers/amazon/aws/operators/athena.py | 115 ++++++++++++++
.../cncf/kubernetes/operators/resource.py | 5 -
.../providers/cncf/kubernetes/utils/pod_manager.py | 18 +--
airflow/providers/dbt/cloud/operators/dbt.py | 15 +-
airflow/providers/openai/hooks/openai.py | 5 +-
airflow/providers/openai/operators/openai.py | 27 ++--
.../auth => providers/papermill/hooks}/__init__.py | 0
airflow/providers/papermill/hooks/kernel.py | 171 +++++++++++++++++++++
airflow/providers/papermill/operators/papermill.py | 40 ++++-
airflow/providers/papermill/provider.yaml | 10 ++
airflow/www/jest.config.js | 35 +++--
airflow/www/package.json | 2 +-
airflow/www/static/js/dag/details/Dag.tsx | 8 +-
airflow/www/static/js/utils/useErrorToast.test.tsx | 4 +-
airflow/www/yarn.lock | 34 ++--
.../dag-processor/dag-processor-deployment.yaml | 2 +
chart/values.yaml | 3 +
.../commands/release_management_commands.py | 2 +-
.../connections}/index.rst | 4 +-
.../connections/jupyter_kernel.rst} | 45 +++---
docs/apache-airflow-providers-papermill/index.rst | 1 +
.../operators.rst | 8 +
.../administration-and-deployment/listeners.rst | 7 +
docs/docker-stack/build.rst | 5 +
generated/provider_dependencies.json | 1 +
helm_tests/airflow_core/test_dag_processor.py | 23 +++
...e-management_prepare-provider-documentation.svg | 2 +-
...e-management_prepare-provider-documentation.txt | 2 +-
setup.py | 2 +
tests/always/test_project_structure.py | 31 ----
tests/datasets/test_manager.py | 35 +++++
.../{lifecycle_listener.py => dataset_listener.py} | 28 ++--
tests/listeners/test_dataset_listener.py | 60 ++++++++
tests/models/test_dagrun.py | 14 ++
.../amazon/aws/fs/{test_fs.py => test_s3.py} | 0
tests/providers/amazon/aws/hooks/test_athena.py | 19 +++
.../amazon/aws/operators/athena_metadata.json | 72 +++++++++
.../providers/amazon/aws/operators/test_athena.py | 120 ++++++++++++++-
.../hooks/{test_admin_client.py => test_client.py} | 0
.../hooks/{test_consumer.py => test_consume.py} | 0
.../hooks/{test_producer.py => test_produce.py} | 0
.../cloud/hooks/{test_dbt_cloud.py => test_dbt.py} | 0
.../operators/{test_dbt_cloud.py => test_dbt.py} | 0
.../sensors/{test_dbt_cloud.py => test_dbt.py} | 0
.../triggers/{test_dbt_cloud.py => test_dbt.py} | 0
.../hooks/{test_azure_batch.py => test_batch.py} | 0
...iner_instance.py => test_container_instance.py} | 0
...iner_registry.py => test_container_registry.py} | 0
...ontainer_volume.py => test_container_volume.py} | 0
.../hooks/{test_azure_cosmos.py => test_cosmos.py} | 0
..._azure_data_factory.py => test_data_factory.py} | 0
.../{test_azure_data_lake.py => test_data_lake.py} | 0
.../{test_azure_fileshare.py => test_fileshare.py} | 0
.../{test_azure_synapse.py => test_synapse.py} | 0
.../{test_azure_batch.py => test_batch.py} | 0
...er_instances.py => test_container_instances.py} | 0
.../{test_azure_cosmos.py => test_cosmos.py} | 0
..._azure_data_factory.py => test_data_factory.py} | 0
.../{test_azure_synapse.py => test_synapse.py} | 0
.../{test_azure_key_vault.py => test_key_vault.py} | 0
.../{test_azure_cosmos.py => test_cosmos.py} | 0
..._azure_data_factory.py => test_data_factory.py} | 0
..._azure_data_factory.py => test_data_factory.py} | 0
tests/providers/openai/operators/test_openai.py | 12 ++
.../{test_default_extractor.py => test_base.py} | 0
.../{test_bash_extractor.py => test_bash.py} | 0
.../{test_python_extractor.py => test_python.py} | 0
.../providers/papermill/hooks}/__init__.py | 0
.../hooks/test_kernel.py} | 35 ++---
.../papermill/operators/test_papermill.py | 56 ++++++-
.../{test_gcs_presto.py => test_gcs_to_presto.py} | 0
.../{test_gcs_trino.py => test_gcs_to_trino.py} | 0
tests/system/providers/papermill/conftest.py | 56 +++++++
...erify.py => example_papermill_remote_verify.py} | 22 +--
82 files changed, 1162 insertions(+), 264 deletions(-)
copy airflow/{callbacks/base_callback_sink.py => listeners/spec/dataset.py}
(72%)
copy airflow/{api/auth => providers/papermill/hooks}/__init__.py (100%)
create mode 100644 airflow/providers/papermill/hooks/kernel.py
copy docs/{apache-airflow-providers-amazon/operators/emr =>
apache-airflow-providers-papermill/connections}/index.rst (94%)
copy docs/{apache-airflow-providers-slack/connections/slack.rst =>
apache-airflow-providers-papermill/connections/jupyter_kernel.rst} (56%)
copy tests/listeners/{lifecycle_listener.py => dataset_listener.py} (70%)
create mode 100644 tests/listeners/test_dataset_listener.py
rename tests/providers/amazon/aws/fs/{test_fs.py => test_s3.py} (100%)
create mode 100644 tests/providers/amazon/aws/operators/athena_metadata.json
rename tests/providers/apache/kafka/hooks/{test_admin_client.py =>
test_client.py} (100%)
rename tests/providers/apache/kafka/hooks/{test_consumer.py =>
test_consume.py} (100%)
rename tests/providers/apache/kafka/hooks/{test_producer.py =>
test_produce.py} (100%)
rename tests/providers/dbt/cloud/hooks/{test_dbt_cloud.py => test_dbt.py}
(100%)
rename tests/providers/dbt/cloud/operators/{test_dbt_cloud.py => test_dbt.py}
(100%)
rename tests/providers/dbt/cloud/sensors/{test_dbt_cloud.py => test_dbt.py}
(100%)
rename tests/providers/dbt/cloud/triggers/{test_dbt_cloud.py => test_dbt.py}
(100%)
rename tests/providers/microsoft/azure/hooks/{test_azure_batch.py =>
test_batch.py} (100%)
rename tests/providers/microsoft/azure/hooks/{test_azure_container_instance.py
=> test_container_instance.py} (100%)
rename tests/providers/microsoft/azure/hooks/{test_azure_container_registry.py
=> test_container_registry.py} (100%)
rename tests/providers/microsoft/azure/hooks/{test_azure_container_volume.py
=> test_container_volume.py} (100%)
rename tests/providers/microsoft/azure/hooks/{test_azure_cosmos.py =>
test_cosmos.py} (100%)
rename tests/providers/microsoft/azure/hooks/{test_azure_data_factory.py =>
test_data_factory.py} (100%)
rename tests/providers/microsoft/azure/hooks/{test_azure_data_lake.py =>
test_data_lake.py} (100%)
rename tests/providers/microsoft/azure/hooks/{test_azure_fileshare.py =>
test_fileshare.py} (100%)
rename tests/providers/microsoft/azure/hooks/{test_azure_synapse.py =>
test_synapse.py} (100%)
rename tests/providers/microsoft/azure/operators/{test_azure_batch.py =>
test_batch.py} (100%)
rename
tests/providers/microsoft/azure/operators/{test_azure_container_instances.py =>
test_container_instances.py} (100%)
rename tests/providers/microsoft/azure/operators/{test_azure_cosmos.py =>
test_cosmos.py} (100%)
rename tests/providers/microsoft/azure/operators/{test_azure_data_factory.py
=> test_data_factory.py} (100%)
rename tests/providers/microsoft/azure/operators/{test_azure_synapse.py =>
test_synapse.py} (100%)
rename tests/providers/microsoft/azure/secrets/{test_azure_key_vault.py =>
test_key_vault.py} (100%)
rename tests/providers/microsoft/azure/sensors/{test_azure_cosmos.py =>
test_cosmos.py} (100%)
rename tests/providers/microsoft/azure/sensors/{test_azure_data_factory.py =>
test_data_factory.py} (100%)
rename tests/providers/microsoft/azure/triggers/{test_azure_data_factory.py =>
test_data_factory.py} (100%)
rename tests/providers/openlineage/extractors/{test_default_extractor.py =>
test_base.py} (100%)
rename tests/providers/openlineage/extractors/{test_bash_extractor.py =>
test_bash.py} (100%)
rename tests/providers/openlineage/extractors/{test_python_extractor.py =>
test_python.py} (100%)
copy {airflow/api_connexion => tests/providers/papermill/hooks}/__init__.py
(100%)
copy tests/providers/{cohere/hooks/test_cohere.py =>
papermill/hooks/test_kernel.py} (55%)
rename tests/providers/presto/transfers/{test_gcs_presto.py =>
test_gcs_to_presto.py} (100%)
rename tests/providers/trino/transfers/{test_gcs_trino.py =>
test_gcs_to_trino.py} (100%)
create mode 100644 tests/system/providers/papermill/conftest.py
copy tests/system/providers/papermill/{example_papermill_verify.py =>
example_papermill_remote_verify.py} (80%)
