See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/340/display/redirect?page=changes>
Changes:
[johnjcasey] 21742 add warning for risky kafka configuration
[johnjcasey] 21742 run spotless
[noreply] [BEAM-13590]Update Pytest version to support Python 3.10 (#17791)
[noreply] Fix target email for flaky test/p0/p1 reports
[noreply] Add unit testing for graphx/user.go (#21962)
------------------------------------------
[...truncated 818.64 KB...]
"hooks": "{\"default_remote_logging\":null}",
"kafka_jar":
"<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.41.0-SNAPSHOT.jar";,>
"sdk_harness_container_image_override":
"[.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220621202038]",
"test.paniconexit0": "true",
"test.timeout": "2h0m0s",
"test.v": "true"
}
}
},
"tempStoragePrefix":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.41.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"workerPools": [
{
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-2-1655843781499120197/worker",
"name": "worker"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-2-1655843781499120197/dataflow-worker.jar",
"name": "dataflow-worker.jar"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-2-1655843781499120197/xlang/icedtea-sound-ebvtNFkfFXg4aaYFuDnwKpwDSjzsaZqlqv5iKxPTr-U.jar",
"name":
"icedtea-sound-ebvtNFkfFXg4aaYFuDnwKpwDSjzsaZqlqv5iKxPTr-U.jar"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-2-1655843781499120197/xlang/jaccess-ULFTCPsb6cLYZ0f1BG1FQfczmHNaZCx8plXuRDKpBqE.jar",
"name": "jaccess-ULFTCPsb6cLYZ0f1BG1FQfczmHNaZCx8plXuRDKpBqE.jar"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-2-1655843781499120197/xlang/localedata-dUHqyGxaTVCjfTI8MckPYarZ3_mwf62udkxaHi1aKns.jar",
"name": "localedata-dUHqyGxaTVCjfTI8MckPYarZ3_mwf62udkxaHi1aKns.jar"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-2-1655843781499120197/xlang/nashorn-XdUndQGroXOP9NCsfITpBERYcbbGXVHLjbvNWXCh-3A.jar",
"name": "nashorn-XdUndQGroXOP9NCsfITpBERYcbbGXVHLjbvNWXCh-3A.jar"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-2-1655843781499120197/xlang/cldrdata-YqzuKX1QnLCOo0cwjKRdBhGrip_ltIJZg-APT60tUPA.jar",
"name": "cldrdata-YqzuKX1QnLCOo0cwjKRdBhGrip_ltIJZg-APT60tUPA.jar"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-2-1655843781499120197/xlang/dnsns-dhEp186udEF6X6chZus-RJzWRmzlccxx1_btlXWayVI.jar",
"name": "dnsns-dhEp186udEF6X6chZus-RJzWRmzlccxx1_btlXWayVI.jar"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/go-2-1655843781499120197/xlang/beam-sdks-java-io-google-cloud-platform-expansion-service-2.41.0-SNAPSHOT-NLeCQwX_oWVR2lvC9LB0Q856Q1OeLh4N6BVwtW36TVY.jar",
"name":
"beam-sdks-java-io-google-cloud-platform-expansion-service-2.41.0-SNAPSHOT-NLeCQwX_oWVR2lvC9LB0Q856Q1OeLh4N6BVwtW36TVY.jar"
}
],
"sdkHarnessContainerImages": [
{
"containerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220621-203206"
},
{
"containerImage":
"us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220621202038"
}
],
"workerHarnessContainerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220621-203206"
}
]
},
"name": "go-testbigqueryio_basicwriteread",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/06/21 20:36:31 Submitted job: 2022-06-21_13_36_31-17200366233116058895
2022/06/21 20:36:31 Console:
https://console.cloud.google.com/dataflow/jobs/us-central1/2022-06-21_13_36_31-17200366233116058895?project=apache-beam-testing
2022/06/21 20:36:31 Logs:
https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-06-21_13_36_31-17200366233116058895
2022/06/21 20:36:31 Job state: JOB_STATE_PENDING ...
2022/06/21 20:37:01 Job still running ...
2022/06/21 20:37:31 Job still running ...
2022/06/21 20:38:02 Job still running ...
2022/06/21 20:38:32 Job still running ...
2022/06/21 20:39:02 Job still running ...
2022/06/21 20:39:32 Job still running ...
2022/06/21 20:40:02 Job 2022-06-21_13_36_31-17200366233116058895 succeeded!
bigquery_test.go:220: Deleting BigQuery table
apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1655843552471446695
--- PASS: TestBigQueryIO_BasicWriteRead (453.08s)
=== RUN TestBigQueryIO_BasicWriteQueryRead
integration.go:251: Test TestBigQueryIO_BasicWriteQueryRead is currently
filtered for runner dataflow
--- SKIP: TestBigQueryIO_BasicWriteQueryRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery
456.109s
=== RUN TestDebeziumIO_BasicRead
integration.go:251: Test TestDebeziumIO_BasicRead is currently filtered for
runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium
3.035s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:251: Test TestJDBCIO_BasicReadWrite is currently filtered
for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:251: Test TestJDBCIO_PostgresReadWrite is currently filtered
for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc
3.033s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:251: Test TestKafkaIO_BasicReadWrite is currently filtered
for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka
6.033s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220621-203206
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220621-203206
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:56acdbd4e184f8caf67c3f117babbc4f6760d87bfae63c4e37837a0139125e5f
Deleted: sha256:a16f7b0400360df0eff2fd468e1918de9e55d58676d79db4efca95f5bad096f0
Deleted: sha256:9b493d96a6005b5ab6ae7f09e0983aebf14900b2ef3e9cbf865163902abb4422
Deleted: sha256:5721bc813b0cbfd82eb5ca8e60e7a36a2bed5c508d8bc6346dc1b061b1c89bfe
Deleted: sha256:6896ccb8e5573839bc7fb9e6c6d6c25f97def04fdebe6ba8a576ea2be277836a
Deleted: sha256:772468a5de03f0525ddb3a68d34b40ea40d4f7e9e034be7933b12d54db7b18e3
Deleted: sha256:6827c4765215e9e5c488dd1eb973b28ea17e18e28a42c2cdd40814473aa37399
Deleted: sha256:f32c6980b05fb86d9efe2562e4eb0a12bc109665398181ab18d49871ca9400ec
Deleted: sha256:c2049f9b1f0fd118d942feb3c59e09ac458e756b11857b5d9a816ff90cb1bd70
Deleted: sha256:b0833f3c95d5e2a62b13ee6092b74abe600d0342046f4d415c2a395909252b41
Deleted: sha256:ba928d6296e018818a45469ae2ea1d416676cff20fb987036f8df0612f80cb1e
Deleted: sha256:e9a1a2bfa8522c22cb0f388c7838e5586d12400321ced036d5b397e9192f7829
Deleted: sha256:1839c86323b4844ef9e936fdaaf827cec13fb7de92ea46555e5085276c2eb0a1
Deleted: sha256:1cfc93434e2a2bb9738c1c9350b8e2d1cb067680632ad21415d686c1c50a057a
Deleted: sha256:8eb84bd2376f5fec060cc8f5eb4e57c22a8bd074cf14416c5c80eba17e8b46b9
Deleted: sha256:94cfe5eb8122c0a58befcf6f96dacc505959b5722f8cd16f14390f37d68e7d0c
Deleted: sha256:cfceaa51c2d35c2cb05ab5dc5852f448363253be8287974a7651fd927210f00e
Deleted: sha256:6d96154bacb83c59abaca933b0d5c0c526f93866db22f56efdcd7d8427127de0
$ gcloud --quiet container images delete
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220621-203206
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:56acdbd4e184f8caf67c3f117babbc4f6760d87bfae63c4e37837a0139125e5f
Associated tags:
- 20220621-203206
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220621-203206
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220621-203206].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:56acdbd4e184f8caf67c3f117babbc4f6760d87bfae63c4e37837a0139125e5f].
$ rm -rf /tmp/tmp.SgubDgi01v
$ exit 1
$ exit 1
> Task
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava
> FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 1219307.
Stopping expansion service pid: 1219308.
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220621202038
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:92d12f449db95d647f5fe590b929b3fc03cc8b54e4c39b7feb4dd9bb89d3b7e8
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220621202038]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:92d12f449db95d647f5fe590b929b3fc03cc8b54e4c39b7feb4dd9bb89d3b7e8]
Deleted
[[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220621202038]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:92d12f449db95d647f5fe590b929b3fc03cc8b54e4c39b7feb4dd9bb89d3b7e8])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:92d12f449db95d647f5fe590b929b3fc03cc8b54e4c39b7feb4dd9bb89d3b7e8
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:92d12f449db95d647f5fe590b929b3fc03cc8b54e4c39b7feb4dd9bb89d3b7e8
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:92d12f449db95d647f5fe590b929b3fc03cc8b54e4c39b7feb4dd9bb89d3b7e8].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220621202038
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:816b6ee71a2f98b775a2542a3bd427a3c40eeef48c055301ab928a779ce3e46e
Deleted: sha256:b840cee6e0004fb60a920606c9f5a776586830aba15baa3b55c9cf639e63a891
Deleted: sha256:d6983de7d5860cccf4718f5be86aad43928190fba7d9ba469cb95ddaec78e218
Deleted: sha256:0865eca1d6e494fad6c405cf9665f6ba590a22e52613a1d22c90394482b7677e
Deleted: sha256:b81cf40ab646f416055837b6264a8e93548e0c3523eee66fb8cfcc1ba680a9a1
Deleted: sha256:c957118462f8ba95e481e81ba324f7ddf7ef6b1e45367df235f4f17de0d26209
Deleted: sha256:e3bdf1fc60902fd5d4442e0e323ccb343cc1046e15176e6468950f585be7969d
Deleted: sha256:9a661860f7abe88eeba23cf017856219da927c6985dbbda8499ff44e8c1ea9b2
Deleted: sha256:b9630299650e1c88bc309a02b03a56f0c520df5e6d66405847755df7f2c4a8bb
Deleted: sha256:9673cca61df302be93173f71cdac58ede5959c62a550c752dbc9c7cb306227fc
Deleted: sha256:d8baa4ec69b8794d9b44f1565be4e69dfd3530289c09fbe7b6e2881eaaeee3a4
Deleted: sha256:92288019bb8c7a86bbda830990ee4d3d28322f7ab65eb80b50347a6070c4e1e6
Deleted: sha256:c06f5e725b69d58eecb087891fd6d960d63688e6f0e70bf8ca20f1fb38b789d7
Deleted: sha256:489b1d8a07d2fc1fa2335225060974d594439ec95b4c03b6e24e923a9688ce11
Deleted: sha256:72989ac99f5dc91f9868c40e5a4097525ee08c154e478870582f72de6daf31d6
Deleted: sha256:cecad24b9b33f847ae2be539de055b22f8354ff9aab7facb3a7fbc11f5d3cb14
Deleted: sha256:4bb11ab185e64d2042041b04bb6ac8476156599eff2d72d4dcd27b0333436d66
Deleted: sha256:bc05b106e5bd783f93b5ecadbcce35188207f8ae64db8c457f3cb92ac692c023
Deleted: sha256:bfde38338df9632482419c756382c3de3089fb9e60f2c3ec4912f8eb78967def
Deleted: sha256:518dc39f55608c8232717faaa99e91937fdbdda3852223e8e69de968e3987f53
Deleted: sha256:49eac355a8f4612207a2f36d02593979398706ab09da816d29a82e5875836c45
Deleted: sha256:566c48feb8da2c425c90af71efd48012433232e54d25d32c5c43d3255c091458
Deleted: sha256:41a34aba8bf34a72598613e3e237005c04a536f11409ac2dd459e54b58ed2321
Deleted: sha256:e7fa6037d803a122f748afe89e0407f0f74413991ca7c61317c53f638d14801a
Deleted: sha256:ab6129a1049601bd1d1de8c7aa2e8ce77717843c5ee484136a4a7d4983cbf5e2
Deleted: sha256:f854365fc1ac8a8dedf80c7f2a839414bf07d4b70bbb65cc176d5803ff8c7cbf
Deleted: sha256:c398fbbfc317df26cb53d6e4eba67391b5c320d690ef2a8f43ad1a21d9edf962
Deleted: sha256:e9397318e5d6d8fad65b195863be18af5e3e076dfe988a064ea273aff2d1af4c
Deleted: sha256:eaa0eccf15971690dc91c79126a0e4c606f57d6f77d685179664a57c786b9e9d
Deleted: sha256:b235c39bee92d02d7ff5048c8dcfc31a07bf46a3af0783ac8bc672ebd493602f
Deleted: sha256:fd28a8feed559be9057ed48421fd2fc1b8998875947baa03a0b789d479ecfb99
Deleted: sha256:d2d07799d052bcc66bc917956b6ac376a35f22ef7f93bf9c5d845fb852d7b618
Deleted: sha256:b0f4789dbbd0ef3506a3e6863a35451425ae79261f9f692d7f42702cee1b6921
Deleted: sha256:6b9c9591be873990f1a1144e77c8f85d90f3a334a4a71924b2bfaf5f1b523683
Deleted: sha256:90da9d5c1a6bce30a17083cff49326cba94593ddf478a815c9cda697a7613220
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220621202038]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:816b6ee71a2f98b775a2542a3bd427a3c40eeef48c055301ab928a779ce3e46e]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220621202038]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:816b6ee71a2f98b775a2542a3bd427a3c40eeef48c055301ab928a779ce3e46e])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:816b6ee71a2f98b775a2542a3bd427a3c40eeef48c055301ab928a779ce3e46e
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:816b6ee71a2f98b775a2542a3bd427a3c40eeef48c055301ab928a779ce3e46e
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:816b6ee71a2f98b775a2542a3bd427a3c40eeef48c055301ab928a779ce3e46e].
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'>
line: 199
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 51m 56s
215 actionable tasks: 145 executed, 58 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/drwkkbqhfo7zy
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
