See
<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/9911/display/redirect?page=changes>
Changes:
[bulat.safiullin] [Website] change case-study-card width on mobile
[noreply] feat: implement bigtable io connector with write capabilities (#23411)
[noreply] Bump google.golang.org/api from 0.101.0 to 0.102.0 in /sdks (#23957)
[noreply] Enforce splitting invariants by ensuring split state is reset in the
[noreply] Add files then check cached diff to get untracked files
[noreply] Switch && for || to fix bug in #23889 resolution (#24017)
------------------------------------------
[...truncated 1.92 MB...]
--show-capture=no \
--numprocesses=1 \
--timeout=1800 \
--junitxml=$XUNIT_FILE \
--ignore-glob '.*py3\d?\.py$' \
--log-cli-level=INFO \
--test-pipeline-options=" \
--runner=TestDataflowRunner \
--project=$PROJECT \
--region=$REGION \
--sdk_container_image=$CONTAINER:$TAG \
--staging_location=$GCS_LOCATION/staging-validatesrunner-test \
--temp_location=$GCS_LOCATION/temp-validatesrunner-test \
--output=$GCS_LOCATION/output \
--sdk_location=$SDK_LOCATION \
--num_workers=1 \
--docker_registry_push_url=$PREBUILD_SDK_CONTAINER_REGISTRY_PATH"
> Task :sdks:python:test-suites:dataflow:py37:validatesContainer
function cleanup_container {
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container image"
for image in $(docker images --format '{{.Repository}}:{{.Tag}}' | grep
$PREBUILD_SDK_CONTAINER_REGISTRY_PATH)
do docker rmi $image || echo "Failed to remove prebuilt sdk container image"
done
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to
delete container"
for digest in $(gcloud container images list-tags
$PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk
--format="get(digest)")
do gcloud container images delete
$PREBUILD_SDK_CONTAINER_REGISTRY_PATH/beam_python_prebuilt_sdk@$digest
--force-delete-tags --quiet || echo "Failed to remove prebuilt sdk container
image"
done
echo "Removed the container"
}
trap cleanup_container EXIT
echo ">>> Successfully built and push container $CONTAINER"
cd sdks/python
SDK_LOCATION=$2
# Run ValidatesRunner tests on Google Cloud Dataflow service
echo ">>> RUNNING DATAFLOW RUNNER VALIDATESCONTAINER TEST"
pytest -o junit_suite_name=$IMAGE_NAME \
-m="it_validatescontainer" \
--show-capture=no \
--numprocesses=1 \
--timeout=1800 \
--junitxml=$XUNIT_FILE \
--ignore-glob '.*py3\d?\.py$' \
--log-cli-level=INFO \
--test-pipeline-options=" \
--runner=TestDataflowRunner \
--project=$PROJECT \
--region=$REGION \
--sdk_container_image=$CONTAINER:$TAG \
--staging_location=$GCS_LOCATION/staging-validatesrunner-test \
--temp_location=$GCS_LOCATION/temp-validatesrunner-test \
--output=$GCS_LOCATION/output \
--sdk_location=$SDK_LOCATION \
--num_workers=1 \
--docker_registry_push_url=$PREBUILD_SDK_CONTAINER_REGISTRY_PATH"
cleanup_container
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:d339089b5c198858306a0c6388650bc713560c4c73f563e04b81ec5ecd2f7ca8
Associated tags:
- 20221107-225435451397302
Tags:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20221107-225435451397302
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk:20221107-225435451397302].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.7_sdk@sha256:d339089b5c198858306a0c6388650bc713560c4c73f563e04b81ec5ecd2f7ca8].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:f7a2d5d1b1a3c54e36a916b06a263cbd82f08f65515c5600dda4a3149a731dd2
Associated tags:
- 31c805b5-9672-4098-bf13-9168ea39e9e4
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:31c805b5-9672-4098-bf13-9168ea39e9e4].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:f7a2d5d1b1a3c54e36a916b06a263cbd82f08f65515c5600dda4a3149a731dd2].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:d85525e8e0905e54fa3c7171067a82a0bb935bb962d96dc6792ba8960223db39
Associated tags:
- 5322fa30-f11f-4f0e-8613-9b0cbc3d4072
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk:5322fa30-f11f-4f0e-8613-9b0cbc3d4072].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python37_sdk/beam_python_prebuilt_sdk@sha256:d85525e8e0905e54fa3c7171067a82a0bb935bb962d96dc6792ba8960223db39].
> Task :sdks:python:test-suites:dataflow:py37:validatesContainer FAILED
> Task :sdks:python:test-suites:dataflow:py310:validatesContainer
cleanup_container
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk@sha256:0426378af4e33dd0f7c5e686ecd4a1a860a2a7a21ef463ba753e469aeca1ae31
Associated tags:
- 20221107-225427524437404
Tags:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk:20221107-225427524437404
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk:20221107-225427524437404].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.10_sdk@sha256:0426378af4e33dd0f7c5e686ecd4a1a860a2a7a21ef463ba753e469aeca1ae31].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:2c287c87c0bb5679b0eaa8110674b3bf0b3e10cdc1d34211c4d6b322c0054e88
Associated tags:
- 1c45a057-b001-4ade-a1a3-9e3c4aedb095
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk:1c45a057-b001-4ade-a1a3-9e3c4aedb095].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:2c287c87c0bb5679b0eaa8110674b3bf0b3e10cdc1d34211c4d6b322c0054e88].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:785671d3a4fd3a245f6f8abcfa43d7880e6bb11c810b374d13c22e912e854272
Associated tags:
- 57592534-fab6-41ad-a985-d8ac23521802
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk:57592534-fab6-41ad-a985-d8ac23521802].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python310_sdk/beam_python_prebuilt_sdk@sha256:785671d3a4fd3a245f6f8abcfa43d7880e6bb11c810b374d13c22e912e854272].
> Task :sdks:python:test-suites:dataflow:py310:validatesContainer FAILED
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer
cleanup_container
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:33fa8329a2731bef4ee0f1b049849b0f9ec920997206f01bfb800935ba97e4ca
Associated tags:
- 20221107-225432432917600
Tags:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221107-225432432917600
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk:20221107-225432432917600].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.8_sdk@sha256:33fa8329a2731bef4ee0f1b049849b0f9ec920997206f01bfb800935ba97e4ca].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:4a840cfdf56ab12ff35cd168b7304464d5af55020b5bb22a217763aa1c7e63e4
Associated tags:
- 31debf0e-a849-4490-9d88-c3a3e85e0a7f
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:31debf0e-a849-4490-9d88-c3a3e85e0a7f].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:4a840cfdf56ab12ff35cd168b7304464d5af55020b5bb22a217763aa1c7e63e4].
> Task :sdks:python:test-suites:dataflow:py39:validatesContainer
cleanup_container
> Task :sdks:python:test-suites:dataflow:py38:validatesContainer FAILED
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:ec732d704154303cc0e5d9ab1ea6603eaf756f2cacd6f8df9f4386f3767508a5
Associated tags:
- 445299b2-af17-47c4-947d-908e87c147d3
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk:445299b2-af17-47c4-947d-908e87c147d3].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python38_sdk/beam_python_prebuilt_sdk@sha256:ec732d704154303cc0e5d9ab1ea6603eaf756f2cacd6f8df9f4386f3767508a5].
> Task :sdks:python:test-suites:dataflow:py39:validatesContainer
Untagged:
us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk:8a10c5ae-f23f-4634-96e1-77a93f5327f3
Untagged:
us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:06a0e0056171f176f6092b9992607454fe8dd409a7348052a17640b49cdee2bd
Deleted: sha256:71927b2738af4d18cbff51ca846fa50ba66028b06225d8fc8d2790ddeacccb3e
Deleted: sha256:f6ffbdbf2b3a6ef9dfbad34d79f08faaca81990bb8e9e1f4b79e0600178d486b
Deleted: sha256:4a165911f3e8dbbe3695858e87846d54128c7bf87e142149285cb21eb7675e67
Deleted: sha256:fe97cf9a63405754ff3b73cf023f26ceeb96bce037569656403b9142366dded6
Deleted: sha256:36fe6beeadd0c26dd83284979a2fd5a13ae2f8e138f62022ede1219d6c171201
Deleted: sha256:8a5e97849e2c7d1cc09acc02ba3416393c045a63573840f988cf03197f13e8e5
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk@sha256:94232c919085dca4b2c7f4169c34b52c0aeac771735cfd8564b3b98398d39254
Associated tags:
- 20221107-225432426955392
Tags:
-
us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk:20221107-225432426955392
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk:20221107-225432426955392].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_python3.9_sdk@sha256:94232c919085dca4b2c7f4169c34b52c0aeac771735cfd8564b3b98398d39254].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:06a0e0056171f176f6092b9992607454fe8dd409a7348052a17640b49cdee2bd
Associated tags:
- 8a10c5ae-f23f-4634-96e1-77a93f5327f3
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk:8a10c5ae-f23f-4634-96e1-77a93f5327f3].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:06a0e0056171f176f6092b9992607454fe8dd409a7348052a17640b49cdee2bd].
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:5d8c68c22334199a087c64319eba02223fb60e170ab21bbddd27c27084653804
Associated tags:
- 52c0e780-c625-464f-82de-3dffe7d078ac
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk:52c0e780-c625-464f-82de-3dffe7d078ac].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/prebuild_python39_sdk/beam_python_prebuilt_sdk@sha256:5d8c68c22334199a087c64319eba02223fb60e170ab21bbddd27c27084653804].
Removed the container
> Task :sdks:python:test-suites:dataflow:py39:validatesContainer FAILED
FAILURE: Build completed with 4 failures.
1: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 363
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py37:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
2: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 363
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py310:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
3: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 363
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py38:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
4: Task failed with an exception.
-----------
* Where:
Script
'<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/sdks/python/test-suites/dataflow/common.gradle'>
line: 363
* What went wrong:
Execution failed for task
':sdks:python:test-suites:dataflow:py39:validatesContainer'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
==============================================================================
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 54m 46s
62 actionable tasks: 51 executed, 4 from cache, 7 up-to-date
Publishing build scan...
https://gradle.com/s/wlr7kagabs64c
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
