See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/624/display/redirect?page=changes>
Changes: [Brian Hulette] Extract utilities in dataframe.schemas [Brian Hulette] Add pandas_type_compatibility with pandas BatchConverter implementations [Brian Hulette] Use Batched DoFns at DataFrame API boundaries [Brian Hulette] Move dtype conversion to pandas_type_compatibility [Brian Hulette] Always register pandas BatchConverters [Brian Hulette] Fix interactive runner tests [Brian Hulette] Use pandas_type_compatibility BatchConverters for dataframe.schemas [Brian Hulette] Skip test cases broken in pandas 1.1.x [Brian Hulette] Address review comments [Brian Hulette] yapf, typo in test [Brian Hulette] Add test to reproduce https://github.com/apache/beam/issues/22854 [Brian Hulette] Exercise row coder with nested optional struct [Brian Hulette] Make RowTypeConstraint callable [Brian Hulette] Add test to exercise RowTypeConstraint.__call__ [noreply] Run cred rotation every month (#22977) [noreply] [BEAM-12164] Synchronize access queue in ThroughputEstimator and ------------------------------------------ [...truncated 1.23 MB...] "key": "hookOrder", "namespace": "go_options", "type": "STRING", "value": "[\"default_remote_logging\"]" }, { "key": "temp_location", "namespace": "go_options", "type": "STRING", "value": "gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test31675" }, { "key": "test.paniconexit0", "namespace": "go_options", "type": "STRING", "value": "true" }, { "key": "kafka_jar", "namespace": "go_options", "type": "STRING", "value": "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.42.0-SNAPSHOT.jar";> }, { "key": "test.timeout", "namespace": "go_options", "type": "STRING", "value": "3h0m0s" }, { "key": "hooks", "namespace": "go_options", "type": "STRING", "value": "{\"default_remote_logging\":null}" }, { "key": "bq_dataset", "namespace": "go_options", "type": "STRING", "value": "apache-beam-testing.beam_bigquery_io_test_temp" }, { "key": "expansion_jar", "namespace": "go_options", "type": "STRING", "value": "[io:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.42.0-SNAPSHOT.jar> schemaio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/extensions/schemaio-expansion-service/build/libs/beam-sdks-java-extensions-schemaio-expansion-service-2.42.0-SNAPSHOT.jar> debeziumio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/io/debezium/expansion-service/build/libs/beam-sdks-java-io-debezium-expansion-service-2.42.0-SNAPSHOT.jar> gcpio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.42.0-SNAPSHOT.jar]";> } ], "options": { "experiments": [ "use_unified_worker", "use_portable_job_submission", "beam_fn_api", "use_staged_dataflow_worker_jar" ], "pipelineUrl": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test31675/go-2-1661999899655632531/model", "region": "us-central1", "tempLocation": "gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test31675" }, "beam:option:go_options:v1": { "options": { "bq_dataset": "apache-beam-testing.beam_bigquery_io_test_temp", "expansion_addr": "[test:localhost:33181]", "expansion_jar": "[io:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.42.0-SNAPSHOT.jar> schemaio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/extensions/schemaio-expansion-service/build/libs/beam-sdks-java-extensions-schemaio-expansion-service-2.42.0-SNAPSHOT.jar> debeziumio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/io/debezium/expansion-service/build/libs/beam-sdks-java-io-debezium-expansion-service-2.42.0-SNAPSHOT.jar> gcpio:<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/io/google-cloud-platform/expansion-service/build/libs/beam-sdks-java-io-google-cloud-platform-expansion-service-2.42.0-SNAPSHOT.jar]";,> "hookOrder": "[\"default_remote_logging\"]", "hooks": "{\"default_remote_logging\":null}", "kafka_jar": "<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.42.0-SNAPSHOT.jar";,> "sdk_harness_container_image_override": "[.*java.*,us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220901022042]", "temp_location": "gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test31675", "test.paniconexit0": "true", "test.timeout": "3h0m0s", "test.v": "true" } } }, "tempStoragePrefix": "gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test/test31675", "userAgent": { "name": "Apache Beam SDK for Go", "version": "2.42.0.dev" }, "version": { "job_type": "FNAPI_BATCH", "major": "6" }, "workerPools": [ { "autoscalingSettings": {}, "ipConfiguration": "WORKER_IP_UNSPECIFIED", "kind": "harness", "numWorkers": 1, "packages": [ { "location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test31675/go-2-1661999899655632531/worker", "name": "worker" }, { "location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test31675/go-2-1661999899655632531/dataflow-worker.jar", "name": "dataflow-worker.jar" }, { "location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test31675/go-2-1661999899655632531/xlang/beam-sdks-java-io-google-cloud-platform-expansion-service-2.42.0-SNAPSHOT-gXczStUf07UkihZkspwTgREQr25y6P9dRd6giNjuzU8.jar", "name": "beam-sdks-java-io-google-cloud-platform-expansion-service-2.42.0-SNAPSHOT-gXczStUf07UkihZkspwTgREQr25y6P9dRd6giNjuzU8.jar" }, { "location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test31675/go-2-1661999899655632531/xlang/icedtea-sound-CGRxIE9edPHnbxQhM-L5mp8h21H-ySB79uQtSquPV_Q.jar", "name": "icedtea-sound-CGRxIE9edPHnbxQhM-L5mp8h21H-ySB79uQtSquPV_Q.jar" }, { "location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test31675/go-2-1661999899655632531/xlang/jaccess-FBI0Bb27lF3oEBieWAi7SP8X1zBR8k4BJQOVpsoK9a0.jar", "name": "jaccess-FBI0Bb27lF3oEBieWAi7SP8X1zBR8k4BJQOVpsoK9a0.jar" }, { "location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test31675/go-2-1661999899655632531/xlang/localedata-kJ2mc8rBH5-IklhfR1XzNotlIQ_mnVMA-pgaXv2r8Ag.jar", "name": "localedata-kJ2mc8rBH5-IklhfR1XzNotlIQ_mnVMA-pgaXv2r8Ag.jar" }, { "location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test31675/go-2-1661999899655632531/xlang/nashorn-B0CAb3QpJET_6VsT3hcC_89VtvhV616H8N2bHAIaqWo.jar", "name": "nashorn-B0CAb3QpJET_6VsT3hcC_89VtvhV616H8N2bHAIaqWo.jar" }, { "location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test31675/go-2-1661999899655632531/xlang/cldrdata-gclqV9lOGqQOKesG-a6TAUTGEYlyIDqpyd4M_k7gtWo.jar", "name": "cldrdata-gclqV9lOGqQOKesG-a6TAUTGEYlyIDqpyd4M_k7gtWo.jar" }, { "location": "gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test/test31675/go-2-1661999899655632531/xlang/dnsns-byzoQxdXengTvA5IlbH9gSIzfhNQElRYltuMJN0vjcc.jar", "name": "dnsns-byzoQxdXengTvA5IlbH9gSIzfhNQElRYltuMJN0vjcc.jar" } ], "sdkHarnessContainerImages": [ { "containerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220901-023223" }, { "containerImage": "us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220901022042" } ], "workerHarnessContainerImage": "us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220901-023223" } ] }, "name": "go-testbigqueryio_basicwriteread-470", "projectId": "apache-beam-testing", "type": "JOB_TYPE_BATCH" } 2022/09/01 02:38:30 Submitted job: 2022-08-31_19_38_30-15910447246096888089 2022/09/01 02:38:30 Console: https://console.cloud.google.com/dataflow/jobs/us-central1/2022-08-31_19_38_30-15910447246096888089?project=apache-beam-testing 2022/09/01 02:38:30 Logs: https://console.cloud.google.com/logs/viewer?project=apache-beam-testing&resource=dataflow_step%2Fjob_id%2F2022-08-31_19_38_30-15910447246096888089 2022/09/01 02:38:30 Job state: JOB_STATE_PENDING ... 2022/09/01 02:39:00 Job still running ... 2022/09/01 02:39:31 Job still running ... 2022/09/01 02:40:01 Job still running ... 2022/09/01 02:40:31 Job still running ... 2022/09/01 02:41:01 Job still running ... 2022/09/01 02:41:31 Job still running ... 2022/09/01 02:42:01 Job still running ... 2022/09/01 02:42:31 Job still running ... 2022/09/01 02:43:01 Job still running ... 2022/09/01 02:43:31 Job still running ... 2022/09/01 02:44:02 Job 2022-08-31_19_38_30-15910447246096888089 succeeded! bigquery_test.go:220: Deleting BigQuery table apache-beam-testing.beam_bigquery_io_test_temp.go_bqio_it_temp_1661999582190768306 --- PASS: TestBigQueryIO_BasicWriteRead (663.16s) === RUN TestBigQueryIO_BasicWriteQueryRead integration.go:308: Test TestBigQueryIO_BasicWriteQueryRead is currently filtered for runner dataflow --- SKIP: TestBigQueryIO_BasicWriteQueryRead (0.00s) PASS ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/bigquery 666.188s === RUN TestDebeziumIO_BasicRead integration.go:308: Test TestDebeziumIO_BasicRead is currently filtered for runner dataflow --- SKIP: TestDebeziumIO_BasicRead (0.00s) PASS ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/debezium 3.036s === RUN TestJDBCIO_BasicReadWrite integration.go:308: Test TestJDBCIO_BasicReadWrite is currently filtered for runner dataflow --- SKIP: TestJDBCIO_BasicReadWrite (0.00s) === RUN TestJDBCIO_PostgresReadWrite integration.go:308: Test TestJDBCIO_PostgresReadWrite is currently filtered for runner dataflow --- SKIP: TestJDBCIO_PostgresReadWrite (0.00s) PASS ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/jdbc 3.031s === RUN TestKafkaIO_BasicReadWrite integration.go:308: Test TestKafkaIO_BasicReadWrite is currently filtered for runner dataflow --- SKIP: TestKafkaIO_BasicReadWrite (0.00s) PASS ok github.com/apache/beam/sdks/v2/go/test/integration/io/xlang/kafka 6.031s FAIL Digests: - us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:bf2581e95c19e69bc39788c76262382a6cb29c668fdec7bfe6cd98efbb107544 Associated tags: - 20220901-023223 Tags: - us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220901-023223 Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk:20220901-023223]. Deleted [us.gcr.io/apache-beam-testing/jenkins/beam_go_sdk@sha256:bf2581e95c19e69bc39788c76262382a6cb29c668fdec7bfe6cd98efbb107544]. > Task > :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava > FAILED > Task :runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerCleanup > Task :runners:google-cloud-dataflow-java:cleanupXVR UP-TO-DATE > Task :runners:google-cloud-dataflow-java:cleanUpDockerPythonImages Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220901022042] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1044beec877b708ddeacffb45ebc472fde27466f6f862a8421b267293df47477] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/python:20220901022042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1044beec877b708ddeacffb45ebc472fde27466f6f862a8421b267293df47477])]. Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1044beec877b708ddeacffb45ebc472fde27466f6f862a8421b267293df47477 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/python@sha256:1044beec877b708ddeacffb45ebc472fde27466f6f862a8421b267293df47477]. > Task :runners:google-cloud-dataflow-java:cleanUpDockerJavaImages Tag: [us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220901022042] - referencing digest: [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b16775e70f1982e8b2cc99f661e6986147966bb2a167f51c56c7cf299bef96c3] Deleted [[us.gcr.io/apache-beam-testing/java-postcommit-it/java:20220901022042] (referencing [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b16775e70f1982e8b2cc99f661e6986147966bb2a167f51c56c7cf299bef96c3])]. Digests: - us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b16775e70f1982e8b2cc99f661e6986147966bb2a167f51c56c7cf299bef96c3 Deleted [us.gcr.io/apache-beam-testing/java-postcommit-it/java@sha256:b16775e70f1982e8b2cc99f661e6986147966bb2a167f51c56c7cf299bef96c3]. FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_GoUsingJava_Dataflow/ws/src/sdks/go/test/build.gradle'> line: 199 * What went wrong: Execution failed for task ':runners:google-cloud-dataflow-java:validatesCrossLanguageRunnerGoUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.4/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 1h 6m 51s 215 actionable tasks: 145 executed, 58 from cache, 12 up-to-date Publishing build scan... https://gradle.com/s/qdbkdm7yrkyfk Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
