See
<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/646/display/redirect?page=changes>
Changes:
[noreply] Allow users to pass classloader to dynamically load JDBC drivers.
[noreply] Fix withCheckStopReadingFn to not cause the pipeline to crash (#22962)
------------------------------------------
[...truncated 849.26 KB...]
"test.paniconexit0": "true",
"test.timeout": "3h0m0s",
"test.v": "true"
}
}
},
"tempStoragePrefix":
"gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test2708",
"userAgent": {
"name": "Apache Beam SDK for Go",
"version": "2.42.0.dev"
},
"version": {
"job_type": "FNAPI_BATCH",
"major": "6"
},
"workerPools": [
{
"autoscalingSettings": {},
"ipConfiguration": "WORKER_IP_UNSPECIFIED",
"kind": "harness",
"numWorkers": 1,
"packages": [
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test2708/go-2-1662475113712390380/worker",
"name": "worker"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test2708/go-2-1662475113712390380/dataflow-worker.jar",
"name": "dataflow-worker.jar"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test2708/go-2-1662475113712390380/xlang/icedtea-sound-CGRxIE9edPHnbxQhM-L5mp8h21H-ySB79uQtSquPV_Q.jar",
"name":
"icedtea-sound-CGRxIE9edPHnbxQhM-L5mp8h21H-ySB79uQtSquPV_Q.jar"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test2708/go-2-1662475113712390380/xlang/jaccess-FBI0Bb27lF3oEBieWAi7SP8X1zBR8k4BJQOVpsoK9a0.jar",
"name": "jaccess-FBI0Bb27lF3oEBieWAi7SP8X1zBR8k4BJQOVpsoK9a0.jar"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test2708/go-2-1662475113712390380/xlang/localedata-kJ2mc8rBH5-IklhfR1XzNotlIQ_mnVMA-pgaXv2r8Ag.jar",
"name": "localedata-kJ2mc8rBH5-IklhfR1XzNotlIQ_mnVMA-pgaXv2r8Ag.jar"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test2708/go-2-1662475113712390380/xlang/nashorn-B0CAb3QpJET_6VsT3hcC_89VtvhV616H8N2bHAIaqWo.jar",
"name": "nashorn-B0CAb3QpJET_6VsT3hcC_89VtvhV616H8N2bHAIaqWo.jar"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test2708/go-2-1662475113712390380/xlang/cldrdata-gclqV9lOGqQOKesG-a6TAUTGEYlyIDqpyd4M_k7gtWo.jar",
"name": "cldrdata-gclqV9lOGqQOKesG-a6TAUTGEYlyIDqpyd4M_k7gtWo.jar"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test2708/go-2-1662475113712390380/xlang/dnsns-byzoQxdXengTvA5IlbH9gSIzfhNQElRYltuMJN0vjcc.jar",
"name": "dnsns-byzoQxdXengTvA5IlbH9gSIzfhNQElRYltuMJN0vjcc.jar"
},
{
"location":
"gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test2708/go-2-1662475113712390380/xlang/beam-sdks-java-io-google-cloud-platform-expansion-service-2.42.0-SNAPSHOT-ZYFFHDg57PIM_wJt3dlxnbUwXZm_bRaWTDT9PHt9Zlk.jar",
"name":
"beam-sdks-java-io-google-cloud-platform-expansion-service-2.42.0-SNAPSHOT-ZYFFHDg57PIM_wJt3dlxnbUwXZm_bRaWTDT9PHt9Zlk.jar"
}
],
"sdkHarnessContainerImages": [
{
"containerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220906-143206"
},
{
"containerImage":
"us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220906142039"
}
],
"workerHarnessContainerImage":
"us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220906-143206"
}
]
},
"name": "go-testbigqueryio_basicwriteread-610",
"projectId": "apache-beam-testing",
"type": "JOB_TYPE_BATCH"
}
2022/09/06 14:38:54 Submitted job: 2022-09-06_07_38_53-5905247651943731828
2022/09/06 14:38:54 Console:
https://console.cloud.google.com/dataflow/jobs/us-central1/2022-09-06_07_38_53-5905247651943731828?project=apache-beam-testing
2022/09/06 14:38:54 Logs:
https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-09-06_07_38_53-5905247651943731828
2022/09/06 14:38:54 Job state: JOB_STATE_PENDING ...
2022/09/06 14:39:24 Job still running ...
2022/09/06 14:39:54 Job still running ...
2022/09/06 14:40:24 Job still running ...
2022/09/06 14:40:54 Job still running ...
2022/09/06 14:41:24 Job still running ...
2022/09/06 14:41:54 Job still running ...
2022/09/06 14:42:24 Job still running ...
2022/09/06 14:42:54 Job still running ...
2022/09/06 14:43:24 Job still running ...
2022/09/06 14:43:54 Job 2022-09-06_07_38_53-5905247651943731828 succeeded!
bigquery_test.go:220: Deleting BigQuery table
apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1662474760981547063
--- PASS: TestBigQueryIO_BasicWriteRead (679.83s)
=== RUN TestBigQueryIO_BasicWriteQueryRead
integration.go:308: Test TestBigQueryIO_BasicWriteQueryRead is currently
filtered for runner dataflow
--- SKIP: TestBigQueryIO_BasicWriteQueryRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery
682.870s
=== RUN TestDebeziumIO_BasicRead
integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for
runner dataflow
--- SKIP: TestDebeziumIO_BasicRead (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium
3.034s
=== RUN TestJDBCIO_BasicReadWrite
integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered
for runner dataflow
--- SKIP: TestJDBCIO_BasicReadWrite (0.00s)
=== RUN TestJDBCIO_PostgresReadWrite
integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered
for runner dataflow
--- SKIP: TestJDBCIO_PostgresReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc
3.033s
=== RUN TestKafkaIO_BasicReadWrite
integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered
for runner dataflow
--- SKIP: TestKafkaIO_BasicReadWrite (0.00s)
PASS
ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka
6.028s
FAIL
$ TEST_EXIT_CODE=0
$ cd ../..
$ docker rmi us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220906-143206
Untagged: us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220906-143206
Untagged:
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e62df05857ee6449e9f706c0f469a3b53784005c605b4e66a7c3287ca4862af1
Deleted: sha256:a8623ac77b3fcafb47cee5595823f0e3447af01462b801edd7831d18b97c9f8d
Deleted: sha256:ea03e9fda325c47c5d665ac53bf36b95844dc50c94422a1a75e1081de0f737b9
Deleted: sha256:51e701266a339c776fa6b417f11212a07d5b52d454795521f6d8e2571920d604
Deleted: sha256:a92a8fd758cc393749483ca0db57ca56ad6c433b3d415a8d298a9d5f7f84bbf6
Deleted: sha256:d9f691cc80b7f15decc456e90eb74a80ea1d9538a25e08dd40e6194946eba27e
Deleted: sha256:c8bf7f8f3581dc743b8ff3087e36d85014cad7cbc24400299482d6122d6524b2
Deleted: sha256:7c78a598ff46d6ca027ede013a5e0ea3aec078d341ec668130828445c9be05c0
Deleted: sha256:4d27b4d42c8a245243372bac3e01311f9167bb96401dc56fbb5d2b9a73aa61ca
Deleted: sha256:be6b3c05fd87295aba8bb2a3471ce0c7bdee9e836a6c946c87c7b923e4fe72fd
Deleted: sha256:45b182ff737484681a0d89c441cf91c9cb830eb24ab7ace5acaacc6fd4eee2aa
Deleted: sha256:ecda2baa9b46a38f6bbd6e69d396d8dc0c8fd16022d7a5d6cca2f2c5275dbbbd
Deleted: sha256:8d82fa95a1234b8c1a6ad3e127232847ef3b06bc7fa7621f1acb8d45fbd4cd96
Deleted: sha256:65372cccc84a88d2a6f0b4f645b5d02284f590eec036eb2ebce841b09819b218
Deleted: sha256:604c6ad7f4e6433bd085a001999100bc45c265d09f6f88d52281c588bc1a3df0
Deleted: sha256:59e0e1cc8f5e88e1d76d0a75bafcf585aacae8689162affb75bf21b549451ed1
Deleted: sha256:0e2cb5b8e25924180ad42c7c623126892eb0bce98dde615558e5f589ce402d52
Deleted: sha256:49bcab5ec71fdd763e55681c6a0a4d2d5d7e18a7e41e67a0acd30c1d189ea1eb
$ gcloud --quiet container images delete
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220906-143206
Digests:
-
us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e62df05857ee6449e9f706c0f469a3b53784005c605b4e66a7c3287ca4862af1
Associated tags:
- 20220906-143206
Tags:
- us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220906-143206
Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220906-143206].
Deleted
[us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:e62df05857ee6449e9f706c0f469a3b53784005c605b4e66a7c3287ca4862af1].
$ rm -rf /tmp/tmp.IdEDLQVQ9k
$ exit 1
$ exit 1
> Task
> :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava
> FAILED
> Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup
Stopping expansion service pid: 3033902.
Stopping expansion service pid: 3033903.
> Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE
> Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220906142039
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6aeaa9e9a83abfa37cbef9051f1844ee3aebeb5fbdea145c8330fc0aecc951ac
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220906142039]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6aeaa9e9a83abfa37cbef9051f1844ee3aebeb5fbdea145c8330fc0aecc951ac]
Deleted
[[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220906142039]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6aeaa9e9a83abfa37cbef9051f1844ee3aebeb5fbdea145c8330fc0aecc951ac])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6aeaa9e9a83abfa37cbef9051f1844ee3aebeb5fbdea145c8330fc0aecc951ac
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6aeaa9e9a83abfa37cbef9051f1844ee3aebeb5fbdea145c8330fc0aecc951ac
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:6aeaa9e9a83abfa37cbef9051f1844ee3aebeb5fbdea145c8330fc0aecc951ac].
> Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages
Untagged: us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220906142039
Untagged:
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1ab9c2e349a95b2a9a42417940a76db364b22127bc02a5fc9f9261bd9b0b8bb0
Deleted: sha256:3662ca9ed6882d86ca868e7c08a2b780bf9287c163832fc0e92b43fdef094268
Deleted: sha256:98e04957122ba12dd1deb8569841be3dd8b7a7e66a46422bc352fc9426df0b19
Deleted: sha256:5f1014cf5fb5b1e1e184bf3521e6922947030938fa404e9d38c75fe406948b83
Deleted: sha256:339b3fd8eeaadd3aa39059f583df2254f238b2fd55a40e71130dac5530cc154e
Deleted: sha256:6af57e6063ca0f917d9e0280a1393bedb98555d6263bf47cd7b5d113a6876a46
Deleted: sha256:9c0d038a5e0499e08386a3a4088bc7676c62959b8521b1e55b97db13d67426be
Deleted: sha256:13a56af895a12a2803659a083045f71aec978386f57adb26cd4dd75f39f1fc0b
Deleted: sha256:f64c307f0420561493d270de3267ac6f580727656eee822812425d64b390f553
Deleted: sha256:e0c2d6849b7ab722340d4b3e09c9bfd3110ec8faaf4b53d8849f49dfd5c6ad0e
Deleted: sha256:719174f72c0296e47550bc187b7c8270674a0715b4e6e4ef04c88034bf8d98a2
Deleted: sha256:0c57d822fcf67491830f42c020f6a210dc47094daba4bca0424adf696949f109
Deleted: sha256:59d3590dc498090345575f1d65510a1c7533f899ff22590db3bb7b0597ccf850
Deleted: sha256:df9f4a792df1cb8f39a353929ed2e12e8e98d492e5686867c1ff36930bc2be8f
Deleted: sha256:ee72f09114240e0b94c53261f2857e1825bc4774d9d53bce5693dff18ad278ac
Deleted: sha256:baafbfe5d23bc81307a657a51270f414c364e98fe3163286d809eaee63371954
Deleted: sha256:a1b0a96f7431bc80a49b9df6fa621a8ff0abfd74761f1e489f53f8751f3db538
Deleted: sha256:65d09553fd892c1ed79d13152ae470d4fae4dac244eda93e2804e8dd05f90339
Deleted: sha256:b2392e4405f419177d40fa8acd8eb3d4c458d1cb0f09634caeca889c2da03524
Deleted: sha256:932ac3e2658bf96e4b7fa73c4e5fe15c0017f648fe2fbfcec0e59cb185b32dc1
Deleted: sha256:e9bc70a65f60beb5a65cd851297914bb099bdaa1bb87e73599882b3a8a375542
Deleted: sha256:f33edcd88be05ae09cc9e35cb9a7eab3bde14f867ba0c9ba935eae0c3e29c09e
Deleted: sha256:b6f3d4a527bc8ec88539745cced1e65abe9b9730f2b3dd7885602c9922ea7dae
Deleted: sha256:8897689fd800a3b552c3c4d309a71c0100c5fe4282166c686c2472eb1f31c2b1
Deleted: sha256:eb4e14ce4070a54528cfe4fc9632e6277a4318fb884119f63821640cd5c4c673
Deleted: sha256:a19ab68080e8739f2f344f64aecc2bb36c825552fd6635691927b7cd3b5339c0
Deleted: sha256:d55aad2b29a67f0f5599c31e0f03e6b2d2a2e835e341ad850afe3e60ab80641d
Deleted: sha256:b7519772c0a9f26810670ad078be146b372e7acfe0f7c74d650941c5abea2b95
Deleted: sha256:514043582a3e54186e29342b3394f2728214d13f21effc45c96e067a4f28c776
Deleted: sha256:e08af79a91c0cd449d252befa03fdd10d637e69497bb592e4c25d13e0bfeb084
Deleted: sha256:125a0d9bfaebb480244b14d1bcebba9ccf75fda88736c1148baddbed99415dfd
Deleted: sha256:88e30c5e8b5a07abaf72534f2782146d072291852daa3e9eeb6db3925aef3817
Deleted: sha256:2967f2ab261917dde674b21cd26a42821892b3cbf26a7b920853acb56bd1c529
Deleted: sha256:f7243b351be870f4db5b9d9d868410b4089a4e9fe6098f95005cc1afa96c833b
Deleted: sha256:e79f928ab3ec29a86270dff83c279a7629f1c0acf378996b5c296a29bfb483b9
Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220906142039]
- referencing digest:
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1ab9c2e349a95b2a9a42417940a76db364b22127bc02a5fc9f9261bd9b0b8bb0]
Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220906142039]
(referencing
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1ab9c2e349a95b2a9a42417940a76db364b22127bc02a5fc9f9261bd9b0b8bb0])].
Removing untagged image
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1ab9c2e349a95b2a9a42417940a76db364b22127bc02a5fc9f9261bd9b0b8bb0
Digests:
-
us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1ab9c2e349a95b2a9a42417940a76db364b22127bc02a5fc9f9261bd9b0b8bb0
Deleted
[us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:1ab9c2e349a95b2a9a42417940a76db364b22127bc02a5fc9f9261bd9b0b8bb0].
FAILURE: Build failed with an exception.
* Where:
Build file
'<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'>
line: 199
* What went wrong:
Execution failed for task
':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'.
> Process 'command 'sh'' finished with non-zero exit value 1
* Try:
> Run with --stacktrace option to get the stack trace.
> Run with --info or --debug option to get more log output.
> Run with --scan to get full insights.
* Get more help at https://help.gradle.org
Deprecated Gradle features were used in this build, making it incompatible with
Gradle 8.0.
You can use '--warning-mode all' to show the individual deprecation warnings
and determine if they come from your own scripts or plugins.
See
https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings
Execution optimizations have been disabled for 1 invalid unit(s) of work during
this build to ensure correctness.
Please consult deprecation warnings for more details.
BUILD FAILED in 1h 6m 42s
215 actionable tasks: 157 executed, 46 from cache, 12 up-to-date
Publishing build scan...
https://gradle.com/s/5yewxanwtczzm
Build step 'Invoke Gradle script' changed build result to FAILURE
Build step 'Invoke Gradle script' marked build as failure
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
