See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/2898/display/redirect?page=changes>
Changes: [zhoufek] [BEAM-9487] Multiple Trigger.may_lose_data fixes [zhoufek] [BEAM-9487] Remove CONDITION_NOT_GUARANTEED as potential data loss [zhoufek] [BEAM-9487] Do AfterAny, AfterAll, and AfterEach checks properly (i.e. [zhoufek] [BEAM-9487] Remove unused import [zhoufek] [BEAM-9487] Reintroduce flag but do not use it [zhoufek] [BEAM-9487] Add test that shows AfterCount finishing [zhoufek] [BEAM-9487] Make _ParallelTriggerFn.may_finish clearer [Robert Bradshaw] Revert "Merge pull request #15441 from [BEAM-8823] Make FnApiRunner work [Robert Bradshaw] [BEAM-13040] Add some test cases enforcing side input waiting. [Robert Bradshaw] lint [brachipa] [BEAM-12393] sql support for Zeta Sql [aydar.zaynutdinov] [BEAM-12988] [Playground] [brachipa] [BEAM-12393] package private [brachipa] [BEAM-12393] returning more generic interface [noreply] [BEAM-11936] Fix some errorprone warnings (#15648) [noreply] [BEAM-13068] Add xlangx.DecodeStructPayload (#15741) [Luke Cwik] [BEAM-13015] Implement a simplified cancellable blocking queue with ------------------------------------------ [...truncated 511.74 KB...] > Task :runners:spark:2:job-server:sparkJobServerSetup Launching job server @ 40443 ... > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava $ TESTS=./test/integration/... ./test/regression $ RUNNER=portable $ TIMEOUT=1h $ SIMULTANEOUS=3 $ GCS_LOCATION=gs://temp-storage-for-end-to-end-tests $ PROJECT=apache-beam-testing $ DATAFLOW_PROJECT=apache-beam-testing $ REGION=us-central1 $ trap exit_background_processes SIGINT SIGTERM EXIT $ key=--io_expansion_jar $ case --io_expansion_jar in $ IO_EXPANSION_JAR=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.35.0-SNAPSHOT.jar> $ key=--pipeline_opts $ case --pipeline_opts in $ PIPELINE_OPTS=--kafka_jar=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.35.0-SNAPSHOT.jar> $ key=--test_expansion_addr $ case --test_expansion_addr in $ TEST_EXPANSION_ADDR=localhost:44693 $ key=--runner $ case --runner in $ RUNNER=spark $ key=--tests $ case --tests in $ TESTS=./test/integration/xlang ./test/integration/io/xlang/... $ key=--endpoint $ case --endpoint in $ ENDPOINT=localhost:40443 $ cd <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src> $ test -d sdks/go/test $ EXPANSION_PORT=34799 $ IO_EXPANSION_ADDR=localhost:36885 No IO expansion address specified; starting a new IO expansion server on localhost:36885 $ java -jar <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.35.0-SNAPSHOT.jar> 36885 $ IO_EXPANSION_PID=23528 $ SIMULTANEOUS=1 $ TAG=dev $ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev Starting expansion service at localhost:36885 Starting a Gradle Daemon, 4 busy Daemons could not be reused, use --status for details Oct 19, 2021 12:24:00 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms INFO: Registering external transforms: [beam:external:java:kafkaio:externalwithmetadata:v1, beam:external:java:kafkaio:typedwithoutmetadata:v1, beam:external:java:kafka:write:v1, beam:external:java:generate_sequence:v1] beam:external:java:kafkaio:externalwithmetadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/477289012@3d36e4cd beam:external:java:kafkaio:typedwithoutmetadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/477289012@6a472554 beam:external:java:kafka:write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/477289012@7ff2a664 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$$Lambda$51/477289012@525b461a > Task :sdks:java:io:google-cloud-platform:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:io:google-cloud-platform:classes > Task :sdks:java:io:google-cloud-platform:jar > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy UP-TO-DATE > Task :buildSrc:pluginDescriptors UP-TO-DATE > Task :buildSrc:processResources UP-TO-DATE > Task :buildSrc:classes UP-TO-DATE > Task :buildSrc:jar UP-TO-DATE > Task :buildSrc:assemble UP-TO-DATE > Task :buildSrc:spotlessGroovy UP-TO-DATE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle UP-TO-DATE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validatePlugins UP-TO-DATE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build UP-TO-DATE Configuration on demand is an incubating feature. > Task :sdks:go:container:copyLicenses UP-TO-DATE > Task :sdks:go:container:dockerClean > Task :sdks:go:container:goPrepare Use project GOPATH: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/container/.gogradle/project_gopath> > Task :sdks:go:container:resolveBuildDependencies SKIPPED > Task :sdks:go:container:installDependencies SKIPPED > Task :sdks:go:container:buildLinuxAmd64 UP-TO-DATE > Task :sdks:go:container:goBuild > Task :sdks:go:container:skipPullLicenses > Task :sdks:go:container:dockerPrepare > Task :sdks:java:extensions:sql:compileJava > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava > Task :sdks:go:container:docker Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 1m 9s 8 actionable tasks: 6 executed, 2 up-to-date Publishing build scan... https://gradle.com/s/udowcrh7wqaps $ CONTAINER=apache/beam_go_sdk $ cd sdks/go >>> RUNNING spark integration tests with pipeline options: -p 1 -timeout 1h >>> --runner=spark --project=apache-beam-testing --region=us-central1 >>> --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev >>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test >>> >>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test >>> --dataflow_worker_jar= --endpoint=localhost:40443 >>> --test_expansion_addr=localhost:44693 --io_expansion_addr=localhost:36885 >>> --kafka_jar=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.35.0-SNAPSHOT.jar> $ ./run_validatesrunner_tests.sh: line 399: go: command not found $ TEST_EXIT_CODE=0 $ cd ../.. $ exit 127 $ exit 127 > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava > FAILED > Task :sdks:java:extensions:sql:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:extensions:sql:classes > Task :sdks:java:extensions:sql:jar > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingJava > Task :sdks:java:extensions:sql:zetasql:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:extensions:sql:zetasql:classes > Task :sdks:java:extensions:sql:zetasql:jar > Task :sdks:java:extensions:sql:expansion-service:compileJava Note: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/java/extensions/sql/expansion-service/src/main/java/org/apache/beam/sdk/extensions/sql/expansion/ExternalSqlTransformRegistrar.java> uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :sdks:java:extensions:sql:expansion-service:classes > Task :sdks:java:extensions:sql:expansion-service:shadowJar > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPython > Task > :runners:spark:2:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingJava >>> RUNNING integration tests with pipeline options: --runner=PortableRunner >>> --job_endpoint=localhost:40443 --environment_cache_millis=10000 >>> --experiments=beam_fn_api >>> pytest options: >>> collect markers: -m=xlang_transforms ============================= test session starts ============================== platform linux -- Python 3.6.8, pytest-4.6.11, py-1.10.0, pluggy-0.13.1 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python,> inifile: pytest.ini plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3 timeout: 600.0s timeout method: signal timeout func_only: False collected 5094 items / 5084 deselected / 10 selected apache_beam/io/external/generate_sequence_test.py ... [ 30%] apache_beam/transforms/validate_runner_xlang_test.py ....... [100%] =============================== warnings summary =============================== apache_beam/io/filesystems_test.py:54 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string apache_beam/io/filesystems_test.py:62 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangValidateRunner.xml> - =========== 10 passed, 5084 deselected, 2 warnings in 131.44 seconds =========== > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingPython >>> RUNNING integration tests with pipeline options: --runner=PortableRunner >>> --job_endpoint=localhost:40443 --environment_cache_millis=10000 >>> --experiments=beam_fn_api >>> pytest options: >>> collect markers: -m=xlang_transforms ============================= test session starts ============================== platform linux -- Python 3.6.8, pytest-4.6.11, py-1.10.0, pluggy-0.13.1 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python,> inifile: pytest.ini plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3 timeout: 600.0s timeout method: signal timeout func_only: False collected 5094 items / 5084 deselected / 10 selected apache_beam/io/external/generate_sequence_test.py .ss [ 30%] apache_beam/transforms/validate_runner_xlang_test.py ....... [100%] - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangValidateRunner.xml> - ============ 8 passed, 2 skipped, 5084 deselected in 70.08 seconds ============= > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerPythonUsingSql >>> RUNNING integration tests with pipeline options: --runner=PortableRunner >>> --job_endpoint=localhost:40443 --environment_cache_millis=10000 >>> --experiments=beam_fn_api >>> pytest options: >>> collect markers: -m=xlang_sql_expansion_service ============================= test session starts ============================== platform linux -- Python 3.6.8, pytest-4.6.11, py-1.10.0, pluggy-0.13.1 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python,> inifile: pytest.ini plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3 timeout: 600.0s timeout method: signal timeout func_only: False collected 5094 items / 5085 deselected / 9 selected apache_beam/transforms/sql_test.py ......... [100%] - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> - ================= 9 passed, 5085 deselected in 187.24 seconds ================== > Task :runners:spark:2:job-server:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 5525. Stopping expansion service pid: 5528. > Task :runners:spark:2:job-server:sparkJobServerCleanup Stopping job server pid: 23331. FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark/ws/src/sdks/go/test/build.gradle'> line: 198 * What went wrong: Execution failed for task ':runners:spark:2:job-server:validatesCrossLanguageRunnerGoUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 127 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 47m 36s 216 actionable tasks: 181 executed, 29 from cache, 6 up-to-date Publishing build scan... https://gradle.com/s/mh7rjif3jzyai Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
