See
<https://ci-beam.apache.org/job/beam_PostCommit_Go/8840/display/redirect?page=changes>
Changes:
[heejong] [BEAM-12838] Update artifact local path for DataflowRunner Java
[Valentyn Tymofieiev] Disable Kafka perf tests.
[heejong] separate into resolveArtifacts method
[heejong] add test
[Andrew Pilloud] [BEAM-12850] Calcite drops empty Calc now
[Andrew Pilloud] [BEAM-12853] VALUES produces a UNION, window can't be set
afterwards
[Andrew Pilloud] [BEAM-12852] Revert BigTable changes, just cast to bigint
[heejong] update
[heejong] fix formatting
[Andrew Pilloud] [BEAM-12851] Map output table names
[Luke Cwik] [BEAM-12802] Define a prefetchable iterator and iterable and utility
------------------------------------------
[...truncated 571.16 KB...]
value: <
urn: "beam:env:docker:v1"
payload:
"\nAus.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210908-001614"
capabilities: "beam:protocol:progress_reporting:v0"
capabilities: "beam:protocol:multi_core_bundle_processing:v1"
capabilities: "beam:version:sdk_base:go"
capabilities: "beam:coder:bytes:v1"
capabilities: "beam:coder:bool:v1"
capabilities: "beam:coder:varint:v1"
capabilities: "beam:coder:double:v1"
capabilities: "beam:coder:string_utf8:v1"
capabilities: "beam:coder:length_prefix:v1"
capabilities: "beam:coder:kv:v1"
capabilities: "beam:coder:iterable:v1"
capabilities: "beam:coder:state_backed_iterable:v1"
capabilities: "beam:coder:windowed_value:v1"
capabilities: "beam:coder:global_window:v1"
capabilities: "beam:coder:interval_window:v1"
capabilities: "beam:coder:row:v1"
dependencies: <
type_urn: "beam:artifact:type:go_worker_binary:v1"
role_urn: "beam:artifact:role:staging_to:v1"
role_payload: "\n\006worker"
>
>
>
>
root_transform_ids: "e1"
root_transform_ids: "e2"
root_transform_ids: "e3"
root_transform_ids: "e4"
root_transform_ids: "e5"
root_transform_ids: "e6"
root_transform_ids: "e7"
root_transform_ids: "s1"
2021/09/08 00:56:31 Staged model pipeline:
gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1631062587216483877/model
2021/09/08 00:56:31 {
"environment": {
"experiments": [
"use_unified_worker",
"use_portable_job_submission",
"beam_fn_api",
"use_staged_dataflow_worker_jar"
],
"sdkPipelineOptions": {
"display_data": [
{
"key": "name",
"namespace": "options",
"type": "STRING",
"value": "go-job-7-1631062587216479587"
},
{
"key": "experiments",
"namespace": "options",
"type": "STRING",
"value": "use_unified_worker,use_portable_job_submission"
},
{
"key": "project",
"namespace": "options",
"type": "STRING",
"value": "apache-beam-testing"
},
{
"key": "region",
"namespace": "options",
"type": "STRING",
"value": "us-central1"
},
{
"key": "container_images",
"namespace": "options",
"type": "STRING",
"value":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210908-001614"
},
{
"key": "temp_location",
"namespace": "options",
"type": "STRING",
"value":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test"
},
{
"key": "hooks",
"namespace": "go_options",
"type": "STRING",
"value": "{}"
},
{
"key": "test.timeout",
"namespace": "go_options",
"type": "STRING",
"value": "1h0m0s"
},
{
"key": "test.v",
"namespace": "go_options",
"type": "STRING",
"value": "true"
}
],
"options": {
"experiments": [
"use_unified_worker",
"use_portable_job_submission",
"beam_fn_api",
"use_staged_dataflow_worker_jar"
],
"pipelineUrl":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1631062587216483877/model",
"region": "us-central1"
},
"beam:option:go_options:v1": {
"options": {
"hooks": "{}",
"test.timeout": "1h0m0s",
"test.v": "true"
}
}
},
"tempStoragePrefix":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.34.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"workerPools": [
{
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1631062587216483877/worker",
"name": "worker"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-7-1631062587216483877/dataflow-worker.jar",
"name": "dataflow-worker.jar"
}
],
"sdkHarnessContainerImages": [
{
"containerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210908-001614"
}
],
"workerHarnessContainerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210908-001614"
}
]
},
"name": "go-job-7-1631062587216479587",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2021/09/08 00:56:32 Submitted job: 2021-09-07_17_56_31-14419210017965608915
2021/09/08 00:56:32 Console:
https://console.cloud.google.com/dataflow/jobs/us-central1/2021-09-07_17_56_31-14419210017965608915?project=apache-beam-testing
2021/09/08 00:56:32 Logs:
https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2021-09-07_17_56_31-14419210017965608915
2021/09/08 00:56:32 Job state: JOB_STATE_PENDING ...
2021/09/08 00:57:02 Job still running ...
2021/09/08 00:57:32 Job still running ...
2021/09/08 00:58:02 Job still running ...
2021/09/08 00:58:32 Job still running ...
2021/09/08 00:59:02 Job still running ...
2021/09/08 00:59:32 Job still running ...
2021/09/08 01:00:02 Job still running ...
2021/09/08 01:00:32 Job still running ...
2021/09/08 01:01:02 Job still running ...
2021/09/08 01:01:32 Job still running ...
2021/09/08 01:02:02 Job still running ...
2021/09/08 01:02:33 Job still running ...
2021/09/08 01:03:03 Job succeeded!
--- PASS: TestEmitParDoAfterGBK (395.95s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/regression 2145.057s
cd ../..
if [[ "$RUNNER" == "dataflow" ]]; then
# Delete the container locally and remotely
docker rmi $CONTAINER:$TAG || echo "Failed to remove container"
gcloud --quiet container images delete $CONTAINER:$TAG || echo "Failed to
delete container"
if [[ -n "$TEST_EXPANSION_ADDR" || -n "$IO_EXPANSION_ADDR" ]]; then
# Delete the java cross-language container locally and remotely
docker rmi $JAVA_CONTAINER:$JAVA_TAG || echo "Failed to remove container"
gcloud --quiet container images delete $JAVA_CONTAINER:$JAVA_TAG || echo
"Failed to delete container"
fi
# Clean up tempdir
rm -rf $TMPDIR
fi
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210908-001614
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:356fafc935c881b08961380b936c956fc033175f7ae0e7479772c3c0612ae22d
Deleted: sha256:3f9b0ef3c3ef9e72ef88d6d8e9e94274758477a514db9b7965e0be5e6a262432
Deleted: sha256:cd12baf4692b7af698b178ee030499d8a967829f2214e4783d3637c8f016f137
Deleted: sha256:ccc8daf5db6dca0c15ce8d3ad4259a24439b7924fc4fbde42a64c7d5d3df683b
Deleted: sha256:2f18ddcac43cfe58c272337603b0be624cb0a3779faab951c74d84dd10da009f
Deleted: sha256:c958e6212586bc9a7b17ec006926e483a706fddeca48eb9e381cd5be7495a71e
Deleted: sha256:44931ab877f29927015ccfbc042d7a2ae87a1ab3bb755b6831c4c59785deae80
Deleted: sha256:db757276ff565e91a7422232503bda38d8bf70b17d1aaf4800b4bd13749cadf9
Deleted: sha256:5442a4bee63b51ee3b61ce4143abaa39df77c752a8a109fe5b0a7a4597d01c82
Deleted: sha256:2e9b9d1600d375849d5b3688c24e98b528fd98262bc41d99412eaa80737842ed
Deleted: sha256:a1d351bc079d891c11296b129a659420f056a376c2e27e8927febdc0a9b91706
Deleted: sha256:ac97b7384d77d0f037db65c861640e7469d765e60d4dfbe47db0eaffdb3ff2bc
Deleted: sha256:1158f94516adc9e7167a2bfba5fd51f5957da6c1e1b913148348335f51a32d73
Deleted: sha256:bd61ac73e7112f48c77cc8812a65e0fd8a3961b6c5efd5f861a7519beb15c35e
Deleted: sha256:9d6ff21f7ceddf3fb3842f95043459826afdebec41fa5a1cd843f9dc139670ee
Deleted: sha256:420e54bc61262af6c0dc6226d74ca30a0ed565e4635b88bd13cd73fbb06202a3
Deleted: sha256:c65713e2c50e5b6c94f20568304e3f0fb6e51cf0a59c5e71a5818efc5f796956
Deleted: sha256:6e200cc3bf1ad6314d7bac3e9c80452d4a8c46bbad097cc3ad0680d3da171528
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:356fafc935c881b08961380b936c956fc033175f7ae0e7479772c3c0612ae22d
Associated tags:
- 20210908-001614
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210908-001614
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20210908-001614].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:356fafc935c881b08961380b936c956fc033175f7ae0e7479772c3c0612ae22d].
exit $TEST_EXIT_CODE
exit_background_processes
> Task :goIntegrationTests FAILED
FAILURE: Build failed with an exception.
* What went wrong:
Execution failed for task ':goIntegrationTests'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
Run with --stacktrace option to get the stack trace. Run with --info or --debug
option to get more log output. Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 7.0.
Use '--warning-mode all' to show the individual deprecation warnings.
See
https://docs.gradle.org/6.8.3/userguide/command_line_interface.html#sec:command_line_warnings
BUILD FAILED in 1h 4m 6s
86 actionable tasks: 68 executed, 18 from cache
Publishing build scan...
https://gradle.com/s/qpht4tkh5dhrq
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
