This is an automated email from the ASF dual-hosted git repository.
potiuk pushed a change to branch optimize-multiplatform-builds
in repository https://gitbox.apache.org/repos/asf/airflow.git.
discard f334abe Optimize Multiplatform cache builds
add 3182ba2 Add map_index support to all task instance-related views
(#22272)
add 71c980a Add fk between xcom and task instance (#22334)
add 82d2fa7 Make date picker label visible in trigger dag view (#22379)
add 14e6b65 Add timeout and retry to the BigQueryInsertJobOperator
(#22395)
add 7b851ed Add `LocalFilesystemToGoogleDriveOperator` (#22219)
add 5178665 Update airflow_helmchart_bug_report.yml (#22400)
add 0229a28 Check if there are instances before adding a count (#22399)
add 2314694 Fix grid+calendar page titles (#22401)
add aa7d102 add issue template update to helm chart release doc (#22402)
add dd0cbaa Update doc and sample dag for S3ToSFTPOperator and
SFTPToS3Operator (#22313)
add 31096cc Correct `multiple_outputs` param descriptions mentioning
lists/tuples (#22371)
add cef004d Remove pandas upper limit now that SQLA is 1.4+ (#22162)
add cd35972 Update base sensor operator to support XCOM return value
(#20656)
add 3c24036 [FEATURE] add 1.22 1.23 K8S support (#21902)
add 179c5b6 adding `on_execute_callback` to callbacks docs (#22362)
add 62740c2 Switched cgroupspy to vendored version (#22209)
add e972b6a Add docs and example dag for AWS Glue (#22295)
add 4c28c2a Add Python 3.10 support (#22050)
add c4a59be Add default connection for redshift (#22263)
add dc4d0cc Limit Docutils to make our documentation pretty again (#22420)
add 7667d94 Fix incorrect datetime details (DagRun views) (#21357)
add 59b6e77 Optimize Multiplatform cache builds
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (f334abe)
\
N -- N -- N refs/heads/optimize-multiplatform-builds (59b6e77)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.../airflow_helmchart_bug_report.yml | 3 +-
.github/workflows/ci.yml | 4 +-
BREEZE.rst | 4 +-
LOCAL_VIRTUALENV.rst | 12 +-
PULL_REQUEST_WORKFLOW.rst | 2 +-
README.md | 31 +-
airflow/__main__.py | 10 -
airflow/cli/commands/task_command.py | 64 ++--
airflow/decorators/__init__.pyi | 18 +-
...c306b5b5ae4a_switch_xcom_table_to_use_run_id.py | 8 +-
airflow/models/taskinstance.py | 1 +
airflow/models/xcom.py | 43 +--
.../amazon/aws/example_dags/example_glue.py | 123 ++++++++
.../amazon/aws/example_dags/example_s3_to_sftp.py | 11 +-
.../amazon/aws/example_dags/example_sftp_to_s3.py | 10 +-
airflow/providers/amazon/aws/operators/glue.py | 4 +
.../providers/amazon/aws/operators/glue_crawler.py | 12 +-
airflow/providers/amazon/aws/sensors/glue.py | 4 +
.../providers/amazon/aws/sensors/glue_crawler.py | 4 +
.../providers/amazon/aws/transfers/s3_to_sftp.py | 22 +-
airflow/providers/amazon/provider.yaml | 2 +
airflow/providers/docker/decorators/docker.py | 6 +-
airflow/providers/google/cloud/hooks/bigquery.py | 7 +-
.../providers/google/cloud/operators/bigquery.py | 12 +-
airflow/providers/google/provider.yaml | 4 +
.../suite/example_dags/example_local_to_drive.py | 56 ++++
.../google/suite/transfers/local_to_drive.py | 130 ++++++++
airflow/sensors/base.py | 31 +-
airflow/task/task_runner/cgroup_task_runner.py | 2 +-
airflow/utils/db.py | 16 +
airflow/www/static/js/dag.js | 69 +++--
airflow/www/static/js/gantt.js | 3 +-
airflow/www/static/js/graph.js | 25 +-
airflow/www/static/js/tree/StatusBox.jsx | 4 +-
airflow/www/templates/airflow/calendar.html | 2 +-
airflow/www/templates/airflow/dag.html | 2 +
airflow/www/templates/airflow/task_instance.html | 20 +-
airflow/www/templates/airflow/tree.html | 2 +-
airflow/www/templates/airflow/trigger.html | 2 +-
airflow/www/utils.py | 22 +-
airflow/www/views.py | 75 ++---
breeze | 2 +-
breeze-complete | 2 +-
dev/README_RELEASE_HELM_CHART.md | 5 +
dev/REFRESHING_CI_CACHE.md | 6 +-
dev/TRACKING_BACKTRACKING_ISSUES.md | 2 +-
dev/breeze/src/airflow_breeze/global_constants.py | 4 +-
dev/prepare_prod_docker_images.sh | 2 +-
dev/provider_packages/prepare_provider_packages.py | 5 +
dev/retag_docker_images.py | 2 +-
.../connections/redshift.rst | 127 +++-----
.../operators/glue.rst | 101 +++++++
.../operators/transfer/redshift_to_s3.rst | 5 +-
.../operators/transfer/s3_to_redshift.rst | 5 +-
.../operators/transfer/s3_to_sftp.rst | 27 +-
.../operators/transfer/sftp_to_s3.rst | 28 +-
.../operators/transfer/local_to_drive.rst} | 33 +--
.../howto/create-update-providers.rst | 40 +++
docs/apache-airflow/installation/prerequisites.rst | 2 +-
.../logging-monitoring/callbacks.rst | 3 +-
docs/spelling_wordlist.txt | 1 +
scripts/ci/libraries/_initialization.sh | 4 +-
scripts/ci/libraries/_parallel.sh | 2 +-
scripts/ci/selective_ci_checks.sh | 2 +-
setup.py | 27 +-
.../api_connexion/endpoints/test_xcom_endpoint.py | 91 +++---
tests/models/test_taskinstance.py | 23 +-
tests/models/test_xcom.py | 330 +++++++++++----------
.../amazon/aws/transfers/test_s3_to_sftp.py | 2 -
.../kubernetes/operators/test_kubernetes_pod.py | 3 +-
.../providers/google/cloud/hooks/test_dataflow.py | 4 +-
.../google/cloud/operators/test_bigquery.py | 10 +-
.../google/suite/transfers/test_local_to_drive.py | 53 ++++
tests/sensors/test_base.py | 53 +++-
tests/utils/test_db_cleanup.py | 3 +-
75 files changed, 1309 insertions(+), 582 deletions(-)
create mode 100644 airflow/providers/amazon/aws/example_dags/example_glue.py
create mode 100644
airflow/providers/google/suite/example_dags/example_local_to_drive.py
create mode 100644 airflow/providers/google/suite/transfers/local_to_drive.py
create mode 100644 docs/apache-airflow-providers-amazon/operators/glue.rst
copy docs/{apache-airflow-providers-microsoft-azure/operators/adls.rst =>
apache-airflow-providers-google/operators/transfer/local_to_drive.rst} (54%)
create mode 100644
tests/providers/google/suite/transfers/test_local_to_drive.py
