See
<https://ci-beam.apache.org/job/beam_PostCommit_Go/10600/display/redirect?page=changes>
Changes:
[Robert Bradshaw] Add a portable runner that renders pipelines as a dot graph.
[Robert Bradshaw] Add basic tests for render runner.
[Robert Bradshaw] Add the ability to pass a pipeline proto directly.
[Robert Bradshaw] lint
[Valentyn Tymofieiev] Fix typo.
[Valentyn Tymofieiev] Serve the graph when output file is not specified.
[Valentyn Tymofieiev] Serve the graph when output file is not specified.
[Valentyn Tymofieiev] Fix parsing of standalone protos.
[Valentyn Tymofieiev] Support reading from GCS.
[Valentyn Tymofieiev] Add text logging.
[Valentyn Tymofieiev] fix typo.
[Valentyn Tymofieiev] Some lint and yapf.
[Robert Bradshaw] Fix dot detection logic.
[Robert Bradshaw] fix error detected by lint
[Robert Bradshaw] Make gcs an optional dependency.
[Robert Bradshaw] return rather than sys.exit
[Robert Bradshaw] lint
[noreply] Apply suggestions from code review
[Robert Bradshaw] More cleanup, mypy.
[noreply] Dask runner tests action (#24324)
[Robert Bradshaw] lint
------------------------------------------
[...truncated 1.06 MB...]
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
capabilities: "beam:coder:nullable:v1"
dependencies: <
type_urn: "beam:artifact:type:url:v1"
type_payload:
"\nngs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test30139/go-13-1669196709245766473/worker\022@d60d85541ad0ba7cbc6d101826b26ae3af8bfbdb0eef0b019882c85a3627442e"
role_urn: "beam:artifact:role:go_worker_binary:v1"
>
>
>
>
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "s1"
2022/11/23 09:45:14 Staged model pipeline:
gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test30139/go-13-1669196709245766473/model
2022/11/23 09:45:14 {
"environment": {
"debugOptions": {},
"experiments": [
"use_unified_worker",
"use_portable_job_submission",
"beam_fn_api",
"use_staged_dataflow_worker_jar"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "go-testemitpardoaftergbk-529"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_worker,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20221123-083621"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test30139"
},
{
"key": "temp_location",
"namespace": "go_options",
"type": "STRING",
"value":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test30139"
},
{
"key": "test.paniconexit0",
"namespace": "go_options",
"type": "STRING",
"value": "true"
},
{
"key": "test.timeout",
"namespace": "go_options",
"type": "STRING",
"value": "3h0m0s"
},
{
"key": "test.v",
"namespace": "go_options",
"type": "STRING",
"value": "true"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{\"default_remote_logging\":null}"
},
{
"key": "hookOrder",
"namespace": "go_options",
"type": "STRING",
"value": "[\"default_remote_logging\"]"
}
],
"options": {
"experiments": [
"use_unified_worker",
"use_portable_job_submission",
"beam_fn_api",
"use_staged_dataflow_worker_jar"
],
"pipelineUrl":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test30139/go-13-1669196709245766473/model",
"region": "us-central1",
"tempLocation":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test30139"
},
"beam:option:go_options:v1": {
"options": {
"hookOrder": "[\"default_remote_logging\"]",
"hooks": "{\"default_remote_logging\":null}",
"temp_location":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test30139",
"test.paniconexit0": "true",
"test.timeout": "3h0m0s",
"test.v": "true"
}
}
},
"tempStoragePrefix":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test30139",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.44.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"workerPools": [
{
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test30139/go-13-1669196709245766473/worker",
"name": "worker"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test30139/go-13-1669196709245766473/dataflow-worker.jar",
"name": "dataflow-worker.jar"
}
],
"sdkHarnessContainerImages": [
{
"containerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20221123-083621"
}
],
"workerHarnessContainerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20221123-083621"
}
]
},
"name": "go-testemitpardoaftergbk-529",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/11/23 09:45:14 Submitted job: 2022-11-23_01_45_14-2195249513362587179
2022/11/23 09:45:14 Console:
https://console.cloud.google.com/dataflow/jobs/us-central1/2022-11-23_01_45_14-2195249513362587179?project=apache-beam-testing
2022/11/23 09:45:14 Logs:
https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-11-23_01_45_14-2195249513362587179
2022/11/23 09:45:14 Job state: JOB_STATE_PENDING ...
2022/11/23 09:45:44 Job still running ...
2022/11/23 09:46:14 Job still running ...
2022/11/23 09:46:44 Job still running ...
2022/11/23 09:47:15 Job still running ...
2022/11/23 09:47:45 Job still running ...
2022/11/23 09:48:15 Job still running ...
2022/11/23 09:48:45 Job still running ...
2022/11/23 09:49:15 Job still running ...
2022/11/23 09:49:45 Job still running ...
2022/11/23 09:50:15 Job 2022-11-23_01_45_14-2195249513362587179 succeeded!
--- PASS: TestEmitParDoAfterGBK (306.09s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/regression 3689.082s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20221123-083621
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20221123-083621
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b5e7bc9e8e2e3ab7c31ac61fbcf7ce3d86df4be3c0816854e8342e32c8923dc4
Deleted: sha256:0e220647d9e202d874ade8367fd8e105ebf9eb0d1dab35a5ced3f07fc0e1f503
Deleted: sha256:c16eb06ded9ef551a3d7bad9eecab211fc7d85ddfebb5277c561663ad0edbb63
Deleted: sha256:56a7ac90a6f7c420602494786828f0461cbf8e17883759fe8e04559617ed8d73
Deleted: sha256:3b00e392897beb1296bc8713b3359979da584900a9ca121bfd732eb8c87c4bc5
Deleted: sha256:682e42626ae329266a2c729a6c736e93072ff8773c54732feaad689b86e76d58
Deleted: sha256:3c422d00f9bfd61e46a2011f8e94509cdc5203173f36a837ce8647273bc9c08b
Deleted: sha256:256f398d6d264346f2a88eb87503190e14e7a3ad14f2815b583b9a749be5584a
Deleted: sha256:b352d07a47fae01847f0ce6bcd610143cfb9bdb591cb260cde858cdc2809e0fb
Deleted: sha256:c2892f6a7fde77e1f3cea7df888cb80567040aff417ec3938a8a1812bc048940
Deleted: sha256:aaaed8251d78c5fdfe7062fb4c1737f1968e46cc4d02d0f9e0b933f9f61989ad
Deleted: sha256:ca4a1ddac6a112c5b7cccda80a104cc8d0c2053e615dec73b18d1b1ac7624da0
Deleted: sha256:f8304cd01d3f46d0b9e1279ca0eedf086d6feba28b6f0f3133354812cffc8688
Deleted: sha256:97a27004bc5c2b4fd192093f911cc56cb2bca86ca3968049cc056f23a0b16124
Deleted: sha256:a5dd34374fcbe5e3dfe8b9668af9baddc7108da939e28e160b815acc1743a2a4
Deleted: sha256:2eea846614a394a929d791e9506b7abcafc0ffe2d0345181134ed65e66d89c7d
Deleted: sha256:c2a688d7fb14e55214ecbfe043181a9f27e636520ed76a37e2d5065b9a4f66bf
Deleted: sha256:f6d5aabbc46e0debfee8cd288b78b593e4da048e05022bd729b955a907926808
$ gcloud --quiet container images delete
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20221123-083621
WARNING: Successfully resolved tag to sha256, but it is recommended to use
sha256 directly.
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b5e7bc9e8e2e3ab7c31ac61fbcf7ce3d86df4be3c0816854e8342e32c8923dc4
Associated tags:
- 20221123-083621
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20221123-083621
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20221123-083621].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:b5e7bc9e8e2e3ab7c31ac61fbcf7ce3d86df4be3c0816854e8342e32c8923dc4].
$ rm -rf /tmp/tmp.wMIQR8oGsh
$ exit 1
$ exit 1
> Task :goIntegrationTests FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':goIntegrationTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.5.1/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 2h 29m 56s
88 actionable tasks: 53 executed, 33 from cache, 2 up-to-date
Publishing build scan...
https://gradle.com/s/wuhuhxxlbew3u
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
