See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/5179/display/redirect?page=changes>
Changes: [mmack] [adhoc] Move aws IT tests to testing package according to best practices [noreply] fixes static checks and go lint issues (#17138) [Kyle Weaver] Don't print in task configuration. [noreply] [BEAM-14136] Clean up staticcheck and linter warnings in the Go SDK [noreply] Merge pull request #17063 from [BEAM-12164] Fix flaky tests ------------------------------------------ [...truncated 512.14 KB...] $ key=--schemaio_expansion_jar $ case --schemaio_expansion_jar in $ SCHEMAIO_EXPANSION_JAR=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/extensions/schemaio-expansion-service/build/libs/beam-sdks-java-extensions-schemaio-expansion-service-2.38.0-SNAPSHOT.jar> $ key=--debeziumio_expansion_jar $ case --debeziumio_expansion_jar in $ DEBEZIUMIO_EXPANSION_JAR=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/io/debezium/expansion-service/build/libs/beam-sdks-java-io-debezium-expansion-service-2.38.0-SNAPSHOT.jar> $ key=--pipeline_opts $ case --pipeline_opts in $ PIPELINE_OPTS=--kafka_jar=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.38.0-SNAPSHOT.jar> $ key=--test_expansion_addr $ case --test_expansion_addr in $ TEST_EXPANSION_ADDR=localhost:34573 $ key=--runner $ case --runner in $ RUNNER=flink $ key=--tests $ case --tests in $ TESTS=./test/integration/xlang ./test/integration/io/xlang/... $ key=--endpoint $ case --endpoint in $ ENDPOINT=localhost:34039 $ cd <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src> $ test -d sdks/go/test $ EXPANSION_PORT=57375 $ IO_EXPANSION_ADDR=localhost:45175 No IO expansion address specified; starting a new IO expansion server on localhost:45175 $ java -jar <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.38.0-SNAPSHOT.jar> 45175 $ IO_EXPANSION_PID=1232895 $ EXPANSION_PORT=36005 $ SCHEMAIO_EXPANSION_ADDR=localhost:42651 No SchemaIO expansion address specified; starting a new SchemaIO expansion server on localhost:42651 $ java -jar <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/extensions/schemaio-expansion-service/build/libs/beam-sdks-java-extensions-schemaio-expansion-service-2.38.0-SNAPSHOT.jar> 42651 $ SCHEMAIO_EXPANSION_PID=1232982 $ EXPANSION_PORT=48515 Starting expansion service at localhost:45175 $ DEBEZIUMIO_EXPANSION_ADDR=localhost:36375 No DebeziumIO expansion address specified; starting a new DebeziumIO expansion server on localhost:36375 $ java -jar <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/java/io/debezium/expansion-service/build/libs/beam-sdks-java-io-debezium-expansion-service-2.38.0-SNAPSHOT.jar> 36375 $ DEBEZIUMIO_EXPANSION_PID=1233045 $ SIMULTANEOUS=1 $ TAG=dev $ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev Starting expansion service at localhost:42651 Starting expansion service at localhost:36375 Configuration on demand is an incubating feature. Mar 21, 2022 6:15:20 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms INFO: Registering external transforms: [beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1] beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@516be40f beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@3c0a50da beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@646be2c3 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@797badd3 Mar 21, 2022 6:15:21 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms INFO: Registering external transforms: [beam:transform:org.apache.beam:schemaio_jdbc_read:v1, beam:transform:org.apache.beam:schemaio_jdbc_write:v1, beam:transform:org.apache.beam:schemaio_avro_read:v1, beam:transform:org.apache.beam:schemaio_avro_write:v1, beam:external:java:generate_sequence:v1] beam:transform:org.apache.beam:schemaio_jdbc_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@146044d7 beam:transform:org.apache.beam:schemaio_jdbc_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@1e9e725a beam:transform:org.apache.beam:schemaio_avro_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@15d9bc04 beam:transform:org.apache.beam:schemaio_avro_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@473b46c3 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@516be40f Mar 21, 2022 6:15:21 PM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms INFO: Registering external transforms: [beam:transform:org.apache.beam:debezium_read:v1, beam:external:java:generate_sequence:v1] beam:transform:org.apache.beam:debezium_read:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@45dd4eda beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@60611244 > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy UP-TO-DATE > Task :buildSrc:pluginDescriptors UP-TO-DATE > Task :buildSrc:processResources UP-TO-DATE > Task :buildSrc:classes UP-TO-DATE > Task :buildSrc:jar UP-TO-DATE > Task :buildSrc:assemble UP-TO-DATE > Task :buildSrc:spotlessGroovy UP-TO-DATE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle UP-TO-DATE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validatePlugins UP-TO-DATE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build UP-TO-DATE System Go installation: /snap/bin/go is go version go1.16.15 linux/amd64; Preparing to use /home/jenkins/go/bin/go1.16.12 go1.16.12: already downloaded in /home/jenkins/sdk/go1.16.12 GOCMD=/home/jenkins/go/bin/go1.16.12 > Task :sdks:go:container:copyLicenses UP-TO-DATE > Task :sdks:go:container:dockerClean > Task :sdks:go:container:goPrepare UP-TO-DATE > Task :sdks:go:container:goBuild /home/jenkins/go/bin/go1.16.12 build -o ./build/target/linux_amd64/boot boot.go boot_test.go > Task :sdks:go:container:skipPullLicenses > Task :sdks:go:container:dockerPrepare > Task :sdks:go:container:docker FAILED The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=ada856c9-cafd-4c65-a7fc-9b73db5caff2, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 1162358 log file: /home/jenkins/.gradle/daemon/7.3.2/daemon-1162358.out.log ----- Last 20 lines from daemon log file - daemon-1162358.out.log ----- go1.16.12: already downloaded in /home/jenkins/sdk/go1.16.12 GOCMD=/home/jenkins/go/bin/go1.16.12 /home/jenkins/go/bin/go1.16.12 build -o ./build/target/linux_amd64/boot boot.go boot_test.go Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt. FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':sdks:go:container:docker'. > Process 'command 'docker'' finished with non-zero exit value 143 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org BUILD FAILED in 11s 16 actionable tasks: 5 executed, 11 up-to-date ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org $ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev > Task :runners:flink:1.13:job-server:validatesCrossLanguageRunnerGoUsingJava > FAILED > Task :runners:flink:1.13:job-server:validatesCrossLanguageRunnerJavaUsingJava > Task > :runners:flink:1.13:job-server:validatesCrossLanguageRunnerJavaUsingPython > Task > :runners:flink:1.13:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly > Task > :runners:flink:1.13:job-server:validatesCrossLanguageRunnerPythonUsingJava >>> RUNNING integration tests with pipeline options: --runner=PortableRunner >>> --job_endpoint=localhost:34039 --environment_cache_millis=10000 >>> --experiments=beam_fn_api --parallelism=2 >>> pytest options: >>> collect markers: -m=xlang_transforms ============================= test session starts ============================== platform linux -- Python 3.6.15, pytest-4.6.11, py-1.11.0, pluggy-0.13.1 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python,> inifile: pytest.ini plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3 timeout: 600.0s timeout method: signal timeout func_only: False collected 5253 items / 5243 deselected / 10 selected apache_beam/io/external/generate_sequence_test.py ... [ 30%] apache_beam/transforms/validate_runner_xlang_test.py ....... [100%] =============================== warnings summary =============================== apache_beam/io/filesystems_test.py:54 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string apache_beam/io/filesystems_test.py:62 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/pytest_xlangValidateRunner.xml> - =========== 10 passed, 5243 deselected, 2 warnings in 110.55 seconds =========== > Task > :runners:flink:1.13:job-server:validatesCrossLanguageRunnerPythonUsingPython >>> RUNNING integration tests with pipeline options: --runner=PortableRunner >>> --job_endpoint=localhost:34039 --environment_cache_millis=10000 >>> --experiments=beam_fn_api --parallelism=2 >>> pytest options: >>> collect markers: -m=xlang_transforms ============================= test session starts ============================== platform linux -- Python 3.6.15, pytest-4.6.11, py-1.11.0, pluggy-0.13.1 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python,> inifile: pytest.ini plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3 timeout: 600.0s timeout method: signal timeout func_only: False collected 5253 items / 5243 deselected / 10 selected apache_beam/io/external/generate_sequence_test.py .ss [ 30%] apache_beam/transforms/validate_runner_xlang_test.py ....... [100%] - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/pytest_xlangValidateRunner.xml> - ============ 8 passed, 2 skipped, 5243 deselected in 63.30 seconds ============= > Task :runners:flink:1.13:job-server:validatesCrossLanguageRunnerPythonUsingSql >>> RUNNING integration tests with pipeline options: --runner=PortableRunner >>> --job_endpoint=localhost:34039 --environment_cache_millis=10000 >>> --experiments=beam_fn_api --parallelism=2 >>> pytest options: >>> collect markers: -m=xlang_sql_expansion_service ============================= test session starts ============================== platform linux -- Python 3.6.15, pytest-4.6.11, py-1.11.0, pluggy-0.13.1 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python,> inifile: pytest.ini plugins: xdist-1.34.0, timeout-1.4.2, forked-1.4.0, requests-mock-1.9.3 timeout: 600.0s timeout method: signal timeout func_only: False collected 5253 items / 5244 deselected / 9 selected apache_beam/transforms/sql_test.py ......... [100%] - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> - ================= 9 passed, 5244 deselected in 260.83 seconds ================== > Task :runners:flink:1.13:job-server:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 1232650. Stopping expansion service pid: 1232651. > Task :runners:flink:1.13:job-server:flinkJobServerCleanup Stopping job server pid: 1159768. FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Flink/ws/src/sdks/go/test/build.gradle'> line: 176 * What went wrong: Execution failed for task ':runners:flink:1.13:job-server:validatesCrossLanguageRunnerGoUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: > Run with --stacktrace option to get the stack trace. > Run with --info or --debug option to get more log output. > Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.3.2/userguide/command_line_interface.html#sec:command_line_warnings Execution optimizations have been disabled for 1 invalid unit(s) of work during this build to ensure correctness. Please consult deprecation warnings for more details. BUILD FAILED in 34m 3s 256 actionable tasks: 171 executed, 74 from cache, 11 up-to-date Publishing build scan... https://gradle.com/s/tpklizvdygeco Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
