See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/312/display/redirect?page=changes>
Changes:
[nielm] Add transform names to help debug flaky test
[chamikaramj] Automatically enable Runner v2 for pipelines that use
cross-language
[noreply] Bump Python beam-master container (#21820)
[noreply] Split PytorchModelHandler into PytorchModelHandlerTensor and
[noreply] Fix Hadoop Downloader Range not correct (#21778)
[noreply] [BEAM-14036] Read Configuration for Pub/Sub SchemaTransform (#17730)
[noreply] [Go SDK] Add more info to Worker Status API (#21776)
[noreply] Make PeriodicImpulse generates unbounded PCollection (#21815)
[noreply] [BEAM-14267] Update watchForNewFiles to allow watching updated files
[noreply] fix timestamp conversion in Google Cloud Datastore Connector (#17789)
[noreply] Update references to Jira to GH for the Go label (#21830)
[noreply] [#21853] Adjust Go cross-compile to target entire package (#21854)
[noreply] [BEAM-14553] Add destination coder to FileResultCoder components
[noreply] copyedited README for RunInference examples (#21855)
------------------------------------------
[...truncated 822.16 KB...]
"hooks": "{\"default_remote_logging\":null}",
"kafka_jar":
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.40.0-SNAPSHOT.jar";,>
"sdk_harness_container_image_override":
"[.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220614210011]",
"test.paniconexit0": "true",
"test.timeout": "2h0m0s",
"test.v": "true"
}
}
},
"tempStoragePrefix":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.40.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"workerPools": [
{
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-2-1655241987125124583/worker",
"name": "worker"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-2-1655241987125124583/dataflow-worker.jar",
"name": "dataflow-worker.jar"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-2-1655241987125124583/xlang/beam-sdks-java-io-google-cloud-platform-expansion-service-2.40.0-SNAPSHOT-hlINc1SH1DdairAkVOVxsZ7KBUzB7M09m4PQzQIxKN0.jar",
"name":
"beam-sdks-java-io-google-cloud-platform-expansion-service-2.40.0-SNAPSHOT-hlINc1SH1DdairAkVOVxsZ7KBUzB7M09m4PQzQIxKN0.jar"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-2-1655241987125124583/xlang/icedtea-sound-ebvtNFkfFXg4aaYFuDnwKpwDSjzsaZqlqv5iKxPTr-U.jar",
"name":
"icedtea-sound-ebvtNFkfFXg4aaYFuDnwKpwDSjzsaZqlqv5iKxPTr-U.jar"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-2-1655241987125124583/xlang/jaccess-ULFTCPsb6cLYZ0f1BG1FQfczmHNaZCx8plXuRDKpBqE.jar",
"name": "jaccess-ULFTCPsb6cLYZ0f1BG1FQfczmHNaZCx8plXuRDKpBqE.jar"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-2-1655241987125124583/xlang/localedata-dUHqyGxaTVCjfTI8MckPYarZ3_mwf62udkxaHi1aKns.jar",
"name": "localedata-dUHqyGxaTVCjfTI8MckPYarZ3_mwf62udkxaHi1aKns.jar"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-2-1655241987125124583/xlang/nashorn-XdUndQGroXOP9NCsfITpBERYcbbGXVHLjbvNWXCh-3A.jar",
"name": "nashorn-XdUndQGroXOP9NCsfITpBERYcbbGXVHLjbvNWXCh-3A.jar"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-2-1655241987125124583/xlang/cldrdata-YqzuKX1QnLCOo0cwjKRdBhGrip_ltIJZg-APT60tUPA.jar",
"name": "cldrdata-YqzuKX1QnLCOo0cwjKRdBhGrip_ltIJZg-APT60tUPA.jar"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-2-1655241987125124583/xlang/dnsns-dhEp186udEF6X6chZus-RJzWRmzlccxx1_btlXWayVI.jar",
"name": "dnsns-dhEp186udEF6X6chZus-RJzWRmzlccxx1_btlXWayVI.jar"
}
],
"sdkHarnessContainerImages": [
{
"containerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220614-212129"
},
{
"containerImage":
"us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220614210011"
}
],
"workerHarnessContainerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220614-212129"
}
]
},
"name": "go-testbigqueryio_basicwriteread",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/06/14 21:26:39 Submitted job: 2022-06-14_14_26_37-11053446582855398358
2022/06/14 21:26:39 Console:
https://console.cloud.google.com/dataflow/jobs/us-central1/2022-06-14_14_26_37-11053446582855398358?project=apache-beam-testing
2022/06/14 21:26:39 Logs:
https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-06-14_14_26_37-11053446582855398358
2022/06/14 21:26:39 Job state: JOB_STATE_PENDING ...
2022/06/14 21:27:09 Job still running ...
2022/06/14 21:27:39 Job still running ...
2022/06/14 21:28:09 Job still running ...
2022/06/14 21:28:39 Job still running ...
2022/06/14 21:29:09 Job still running ...
2022/06/14 21:29:39 Job still running ...
2022/06/14 21:30:09 Job 2022-06-14_14_26_37-11053446582855398358 succeeded!
bigquery_test.go:220: Deleting BigQuery table
apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1655241781759865543
--- PASS: TestBigQueryIO_BasicWriteRead (431.27s)
=== RUN TestBigQueryIO_BasicWriteQueryRead
integration.go:251: Test TestBigQueryIO_BasicWriteQueryRead is currently
filtered for runner dataflow
--- SKIP: TestBigQueryIO_BasicWriteQueryRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery
434.397s
=== RUN TestDebeziumIO_BasicRead
integration.go:251: Test TestDebeziumIO_BasicRead is currently filtered for
runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium
3.045s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:251: Test TestJDBCIO_BasicReadWrite is currently filtered
for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:251: Test TestJDBCIO_PostgresReadWrite is currently filtered
for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc
3.079s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:251: Test TestKafkaIO_BasicReadWrite is currently filtered
for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka
6.043s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220614-212129
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220614-212129
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6c87e555e5854f1c2db8049492594f3c6b266a0eba0f93dde8712301a2da0bb1
Deleted: sha256:cf456e4e75463430a47763be6cc3031d1ccbf1dc2bbd32ac803ec7b2358a11b5
Deleted: sha256:ba46955090923711d569c4a50eb1b7d75af248e492f03da2b26b76fc96ad3ee1
Deleted: sha256:37894c0d073c1a97d27c8e0a30be3defe412178c890bfead98cf77f0e048a92f
Deleted: sha256:a1581f7526c8b00a2bfb8ecf68e495e6f6e3f2bddce4b896e2093ee6d4f6dc10
Deleted: sha256:2f41a7f5153e1c148219c230ce894f3fb5b784497691705fd3b9f916a020a470
Deleted: sha256:f5ff09a5fbaec4e6b6adc46b3e44cf719424faf7c1a0cd761f97c44edbc8564d
Deleted: sha256:9afeb1842544913ad562838f6415607d053f819d82a0955b3681e144ecbc5fd8
Deleted: sha256:78428694b8cee2b1bd072c5be0c5b5a467511a4cbeea55bc8ab48f2ed2c7ac6a
Deleted: sha256:fdd432bd02213a603995a9bf08f628a7e99a1813750cd24a522a8b14c8e9a337
Deleted: sha256:d235e2e9cbefbf4c836a85b4d6c9ea804c6297c53036d8239c0ba3be05e01ddd
Deleted: sha256:ba3b95ebb2365ae59d1a8dc8caef95318acce3562890df2323ce28238b132317
Deleted: sha256:3ba4aac529369a77a972500a7cf4e19718db3bce7b43a572e3226bf84ee3ec67
Deleted: sha256:f9333b52d347af5c56342a73ab680a252f577c3e5470b6953f54799051754c92
Deleted: sha256:bcabba01eb7fa5b879a4dd9ddbb919ac98d4296e3692dfb313bd264f051d8afb
Deleted: sha256:b8dfb5d85ea2dec859bb61049185043803300708a6b909212accc81c088f158a
Deleted: sha256:07fa3031f7c69a716871cdb96a313c5b8aba71862793dacab0f6464b38771667
Deleted: sha256:390e5e8640cb92df2c05cb127d00d87dec692d7cf3257c6851dc33e4edb62619
$ gcloud --quiet container images delete
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220614-212129
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6c87e555e5854f1c2db8049492594f3c6b266a0eba0f93dde8712301a2da0bb1
Associated tags:
- 20220614-212129
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220614-212129
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220614-212129].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:6c87e555e5854f1c2db8049492594f3c6b266a0eba0f93dde8712301a2da0bb1].
$ rm -rf /tmp/tmp.jNZzUEuBpB
$ exit 1
$ exit 1
> Task
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava
> FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3153248.
Stopping expansion service pid: 3153249.
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220614210011
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:241af84a09d79a245a41aa916e74b08a48a68cc3be5b4dad9756e71bd779fece
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220614210011]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:241af84a09d79a245a41aa916e74b08a48a68cc3be5b4dad9756e71bd779fece]
Deleted
[[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220614210011]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:241af84a09d79a245a41aa916e74b08a48a68cc3be5b4dad9756e71bd779fece])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:241af84a09d79a245a41aa916e74b08a48a68cc3be5b4dad9756e71bd779fece
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:241af84a09d79a245a41aa916e74b08a48a68cc3be5b4dad9756e71bd779fece
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:241af84a09d79a245a41aa916e74b08a48a68cc3be5b4dad9756e71bd779fece].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220614210011
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:044b54205f9bde7e7fb0bf77cec737feb467060b890a7092c3f5b2d3c0ece0af
Deleted: sha256:1e0c55c74bbe072beffd872c69857e8610ac2ffc387aa1d7a08c6ea5b7dd5a7b
Deleted: sha256:eaa87df66c4b19cefec569a02cff2db950df63bfa8de2321063cc7c753b93f5f
Deleted: sha256:4079c21b98c245e903b44c52e29a074b37e849e00aa704de5b2b41d4fccab209
Deleted: sha256:d3b99597a521a9a10d8b0b34b02589b58c4b724d1c05fba226c8a93ac45f2a79
Deleted: sha256:6d1efd46ecb755ac4418083c8a1caeae196a53a660242e9c63c4468ab859935c
Deleted: sha256:f728f44f5c2b4bcf05a535ccc02baed77a757edab835ee61da97dd11cdcddb70
Deleted: sha256:d3ffc21b500c3fcb58a83dfffcb463b8b74a83b54dc4d3dd53c9701e9c009d0b
Deleted: sha256:fa3f3006cccc1f944575a34f2c354bca3c63a4e3b4ab414ef3a773d2d134ab2a
Deleted: sha256:9caa0dc0e8ca48543bdd9c48e825fbee1f533e7aa5f65ff4658ba1d43ef88b98
Deleted: sha256:4c42e35bd55094d9fb8d66b38acf71d159b2e41303bd742548e34b653f292454
Deleted: sha256:c02e4842fcb75d40cad71e9796472fe49352bd3ed828f91a27703dbddcc7b54e
Deleted: sha256:2d9cbe75169cd88a24d2dbe7a4766fc0ff4314bec320b20c60e2336c5349ee76
Deleted: sha256:36b3db50ca94e5ccae7ffcea624e1608c1e8b7ec48566b512447ce500569d27c
Deleted: sha256:a67974e94c92300e43276c7abbe31e01d1913369437a94b35c3ae680e3103e26
Deleted: sha256:75b76cbe315be135fcb12251f58020e4cc4fa203d313832b4448bb9d4dbb75b6
Deleted: sha256:a11fc56d85ca8e0bb8830d3f82452a117f3612358984f9b8e0d8d4e65cd3e3bc
Deleted: sha256:65e8e097726ebfab8c5adad089ee7932c38e613a5df98aca18e0b5a41153f0f8
Deleted: sha256:6d6f376aa19e072d32342338f7eb00949e2605cb37232b72e9e99c9dfd387559
Deleted: sha256:5b6638d173e1df08f7454d0a42fa8ba2e4ab27cf4690cdbe5b7c988b9b3a1e94
Deleted: sha256:31dbdd068518a6a7bdcc79870e1c849b8111ce819e82cc4cd0f8ec4a6ccbb792
Deleted: sha256:86df49a45a5a0812a10bb2921c6b5bc57264b361a1baa0a9b9ace553148b98da
Deleted: sha256:8423d8e6e6b3dd84a1f3d0b4daf9b3484849419a912b103318d796e1f9a0144a
Deleted: sha256:e321e753133ce4d839da19ef3c897dbf9fdb3edc554b6eff0b005de8804cf6c7
Deleted: sha256:538f7f560c0829cee11a63336321b7ff9598a7fa6289bcc9606b46fbff943d71
Deleted: sha256:0e8187df46e99759e11fa08ce3a5d5fe5e5863d3e086c1810cfbea3b6a746008
Deleted: sha256:e4ee87eaa6ceecbd2f201c9bfcc2bb108a01c35c3adce600b1ad2dc13295c105
Deleted: sha256:818e72dfe09fb8235139115143c556024e80cba818e549f784920f01722f0f32
Deleted: sha256:68f0bd98e86c6603aa3a0266a7fb42a2e37ca81fbbbfe84ae8612f229827591f
Deleted: sha256:99a8c2431b522a6e3e2a5103e1aac1d21f2cccc496899ed6e408e8b3b6651bcf
Deleted: sha256:65a6e70aa4c0b3258c1e834673f8e0ee402b52397fc02e9d404e2ba0c399d25e
Deleted: sha256:ea66c93ee0b3cbfeab52cd1e0a97a3e86bf43576f8ed1957da4693dfb89ff9b4
Deleted: sha256:09332b657d02d9f7efc8e8badababfca6f8bf6b66fcd1b312328a50e64a5ac6a
Deleted: sha256:967a5222e094c495cd4b056e88e89378091fab6e84baf74ce757cab4415ad838
Deleted: sha256:84172798aa664a8d7882c897a2fe0f38d20f37997c3b851808649fc88d6e8ab7
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220614210011]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:044b54205f9bde7e7fb0bf77cec737feb467060b890a7092c3f5b2d3c0ece0af]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220614210011]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:044b54205f9bde7e7fb0bf77cec737feb467060b890a7092c3f5b2d3c0ece0af])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:044b54205f9bde7e7fb0bf77cec737feb467060b890a7092c3f5b2d3c0ece0af
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:044b54205f9bde7e7fb0bf77cec737feb467060b890a7092c3f5b2d3c0ece0af
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:044b54205f9bde7e7fb0bf77cec737feb467060b890a7092c3f5b2d3c0ece0af].
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'>
line: 199
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 3m
215 actionable tasks: 150 executed, 53 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/gxdzl3avio6j4
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org
For additional commands, e-mail: builds-h...@beam.apache.org
