See
<https://ci-beam.apache.org/job/beam_PostCommit_Go/10546/display/redirect?page=changes>
Changes:
[Moritz Mack] [Spark Dataset runner] Enable projection pushdown for Spark
dataset
[noreply] added comments for tensorflow notebook (#23726)
[noreply] Convert initialisms to all caps (#24061)
[noreply] skip output coder field in exp request (#24066)
------------------------------------------
[...truncated 886.24 KB...]
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload:
"\nlgs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test673/go-13-1668030625983976739/worker\022@66572eb66e843c17ee2deeac1a090f40774b00c6669b7c45f364911fe1d76521"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "s1"
2022/11/09 21:50:31 Staged model pipeline:
gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test673/go-13-1668030625983976739/model
2022/11/09 21:50:31 {
"environment": {
"debugOptions": {},
"experiments": [
"use_unified_worker",
"use_portable_job_submission",
"beam_fn_api",
"use_staged_dataflow_worker_jar"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "go-testemitpardoaftergbk-566"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_worker,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20221109-203728"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test673"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
},
{
"key": "temp_location",
"namespace": "go_options",
"type": "STRING",
"value":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test673"
},
{
"key": "test.paniconexit0",
"namespace": "go_options",
"type": "STRING",
"value": "true"
},
{
"key": "test.timeout",
"namespace": "go_options",
"type": "STRING",
"value": "3h0m0s"
},
{
"key": "test.v",
"namespace": "go_options",
"type": "STRING",
"value": "true"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
}
],
"options": {
"experiments": [
"use_unified_worker",
"use_portable_job_submission",
"beam_fn_api",
"use_staged_dataflow_worker_jar"
],
"pipelineUrl":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test673/go-13-1668030625983976739/model",
"region": "us-central1",
"tempLocation":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test673"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"temp_location":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test673",
"test.paniconexit0": "true",
"test.timeout": "3h0m0s",
"test.v": "true"
}
}
},
"tempStoragePrefix":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test673",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.44.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"workerPools": [
{
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test673/go-13-1668030625983976739/worker",
"name": "worker"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test673/go-13-1668030625983976739/dataflow-worker.jar",
"name": "dataflow-worker.jar"
}
],
"sdkHarnessContainerImages": [
{
"containerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20221109-203728"
}
],
"workerHarnessContainerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20221109-203728"
}
]
},
"name": "go-testemitpardoaftergbk-566",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/11/09 21:50:31 Submitted job: 2022-11-09_13_50_31-10318539236928984452
2022/11/09 21:50:31 Console:
https://console.cloud.google.com/dataflow/jobs/us-central1/2022-11-09_13_50_31-10318539236928984452?project=apache-beam-testing
2022/11/09 21:50:31 Logs:
https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-11-09_13_50_31-10318539236928984452
2022/11/09 21:50:31 Job state: JOB_STATE_PENDING ...
2022/11/09 21:51:01 Job still running ...
2022/11/09 21:51:31 Job still running ...
2022/11/09 21:52:01 Job still running ...
2022/11/09 21:52:31 Job still running ...
2022/11/09 21:53:01 Job still running ...
2022/11/09 21:53:31 Job still running ...
2022/11/09 21:54:01 Job still running ...
2022/11/09 21:54:31 Job still running ...
2022/11/09 21:55:02 Job still running ...
2022/11/09 21:55:32 Job still running ...
2022/11/09 21:56:02 Job still running ...
2022/11/09 21:56:32 Job still running ...
2022/11/09 21:57:02 Job still running ...
2022/11/09 21:57:32 Job still running ...
2022/11/09 21:58:02 Job still running ...
2022/11/09 21:58:32 Job still running ...
2022/11/09 21:59:02 Job still running ...
2022/11/09 21:59:32 Job still running ...
2022/11/09 22:00:02 Job still running ...
2022/11/09 22:00:32 Job still running ...
ptest.go:108: Failed to execute job: Job
2022-11-09_13_50_31-10318539236928984452 failed
--- FAIL: TestEmitParDoAfterGBK (636.65s)
FAIL
FAIL github.com/apache/beam/sdks/v2/go/test/regression 4316.740s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20221109-203728
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20221109-203728
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:ad791d828a52aaabfe7cdcf335d11d1b141c4aea2237c538d5a8c16d48a9c6e7
Deleted: sha256:861477de2675e96f3e6b0445242a97271e982c4c24dcda5f80db0335dc268036
Deleted: sha256:a8bd979f4b36238eb62944084121dbe034582ef2657afeb284af28a8fa69fb50
Deleted: sha256:f6c6d8beeb6d845701321f6848cb0938fa5bd02a152d5b6c74497f5b44101c1d
Deleted: sha256:d980a4d0de3078e7a78d27a5903062423ef1126cf6e57caaa1d9594aabc4fb68
Deleted: sha256:4ea5941552f154aaa57e32ec79b68ca9a9087f2540e8bc97b889fcdf48219f43
Deleted: sha256:5829de7d4af17a0679fb323008fa1a3f609569b91c2626dd8a7bb85d4e1aa11c
Deleted: sha256:35bea158bde9cd718a5774f633acee4210791696aab74c9885214f57518e1b5a
Deleted: sha256:404010648d7dc88065782f12358a1d95483c7e81b113414fa573c6ca2dfaa2f5
Deleted: sha256:dd5bd68d5c466201654017f34f29d0068d54399c248c325351299e700155e025
Deleted: sha256:59e44b510d04612859a30cae7507bbec02eb0296af3d84bbb296c8738e1e521e
Deleted: sha256:192db37c4a9fe3f3386e4609dacc623cade9cfc9eb88a248f2a315604b55c4c7
Deleted: sha256:32627ad311f7a02a042f74c7d224fb7a88541191b5cf2c847327d2b7632e66b1
Deleted: sha256:4e5db0c3a2a770ad03cf1f01806e28ee1b9e4d0b08418c8b7c162e34eab9dc1c
Deleted: sha256:4e15daf087058bdcb4499039863b894ee50b4f78f5f7d6dd67e91db36495d4c9
Deleted: sha256:ede60ef2f11055b2fcba030fd32146cc8d1eadf85cb6d9a34a7c78e3ca3ddae5
Deleted: sha256:7c5ac21b0c3e21761d5fff26499e0326979168c97202843da93cfd7819a712c8
Deleted: sha256:6e4d85b7442c84bdbde7a1da37b1e439f612e1e3f170f703351051481904ff56
$ gcloud --quiet container images delete
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20221109-203728
ERROR: (gcloud.container.images.delete)
[us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20221109-203728] is not a
valid name. Expected tag in the form "base:tag" or "tag" or digest in the form
"sha256:<digest>"
Failed to delete container
$ rm -rf /tmp/tmp.8oY0eRvQji
$ exit 1
$ exit 1
> Task :goIntegrationTests FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':goIntegrationTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 3h 3m 52s
88 actionable tasks: 53 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/j3jglim6yvga2
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
