See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/405/display/redirect?page=changes>
Changes: [Luke Cwik] [BEAM-13015] Migrate bundle processing in the SDK harness to using [Brian Hulette] [BEAM-13099] Copy vendored calcite build for 1.28.0 [Brian Hulette] [BEAM-13099] Modifications for vendor/calcite-1_28_0 build [noreply] [BEAM-13001] DoFn metrics for Go SDK (#15657) ------------------------------------------ [...truncated 113.68 KB...] ---> bc798b8f54b2 Step 8/11 : COPY target/LICENSE target/go-licenses/* /opt/apache/beam/third_party_licenses/golang/ ---> 66abcf99deb3 Step 9/11 : RUN rm /opt/apache/beam/third_party_licenses/golang/LICENSE ---> Running in 5ad93c10e533 Removing intermediate container 5ad93c10e533 ---> e336992614b4 Step 10/11 : RUN if [ "$pull_licenses" = "false" ] ; then rm -rf /opt/apache/beam/third_party_licenses ; fi ---> Running in f2ed44e86320 Removing intermediate container f2ed44e86320 ---> 9d7e020bcdd8 Step 11/11 : ENTRYPOINT ["/opt/apache/beam/boot"] ---> Running in a50ba933072d Removing intermediate container a50ba933072d ---> cc2eee18be1e Successfully built cc2eee18be1e Successfully tagged apache/beam_go_sdk:latest > Task :sdks:python:container:py36:docker Collecting protobuf==3.17.3 Downloading protobuf-3.17.3-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.whl (1.0 MB) Collecting pyarrow==3.0.0 Downloading pyarrow-3.0.0-cp36-cp36m-manylinux2014_x86_64.whl (20.7 MB) Collecting pydot==1.4.1 Downloading pydot-1.4.1-py2.py3-none-any.whl (19 kB) Collecting pymongo==3.10.1 Downloading pymongo-3.10.1-cp36-cp36m-manylinux2014_x86_64.whl (460 kB) Collecting pytz==2020.1 Downloading pytz-2020.1-py2.py3-none-any.whl (510 kB) Collecting pyyaml==5.4 Downloading PyYAML-5.4-cp36-cp36m-manylinux1_x86_64.whl (640 kB) Collecting typing-extensions==3.7.4.3 Downloading typing_extensions-3.7.4.3-py3-none-any.whl (22 kB) Collecting google-auth==1.31.0 Downloading google_auth-1.31.0-py2.py3-none-any.whl (147 kB) Collecting google-api-core==1.22.2 > Task :runners:samza:job-server:samzaJobServerSetup > Task :runners:samza:job-server:validatesCrossLanguageRunnerSetup Launching Java expansion service @ 43933 Launching Python expansion service @ 45705 > Task :runners:samza:job-server:validatesCrossLanguageRunnerGoUsingJava $ TESTS=./test/integration/... ./test/regression $ RUNNER=portable $ TIMEOUT=2h $ SIMULTANEOUS=3 $ GCS_LOCATION=gs://temp-storage-for-end-to-end-tests $ PROJECT=apache-beam-testing $ DATAFLOW_PROJECT=apache-beam-testing $ REGION=us-central1 $ trap exit_background_processes SIGINT SIGTERM EXIT $ key=--io_expansion_jar $ case --io_expansion_jar in $ IO_EXPANSION_JAR=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.35.0-SNAPSHOT.jar> $ key=--pipeline_opts $ case --pipeline_opts in $ PIPELINE_OPTS=--kafka_jar=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.35.0-SNAPSHOT.jar> $ key=--test_expansion_addr $ case --test_expansion_addr in $ TEST_EXPANSION_ADDR=localhost:43933 $ key=--runner $ case --runner in $ RUNNER=samza $ key=--tests $ case --tests in $ TESTS=./test/integration/xlang ./test/integration/io/xlang/... $ key=--endpoint $ case --endpoint in $ ENDPOINT=localhost:41181 $ cd <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src> $ test -d sdks/go/test $ EXPANSION_PORT=57125 $ IO_EXPANSION_ADDR=localhost:37459 No IO expansion address specified; starting a new IO expansion server on localhost:37459 $ java -jar <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/java/io/expansion-service/build/libs/beam-sdks-java-io-expansion-service-2.35.0-SNAPSHOT.jar> 37459 $ IO_EXPANSION_PID=25860 $ SIMULTANEOUS=1 $ TAG=dev $ ./gradlew :sdks:go:container:docker -Pdocker-tag=dev Starting expansion service at localhost:37459 Starting a Gradle Daemon, 4 busy Daemons could not be reused, use --status for details Oct 30, 2021 12:33:37 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms beam:transform:org.apache.beam:kafka_read_with_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@551bdc27INFO: Registering external transforms: [beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1] beam:transform:org.apache.beam:kafka_read_without_metadata:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@58fdd99 beam:transform:org.apache.beam:kafka_write:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@6b1274d2 beam:external:java:generate_sequence:v1: org.apache.beam.sdk.expansion.service.ExpansionService$ExternalTransformRegistrarLoader$1@7bc1a03d > Task :buildSrc:compileJava NO-SOURCE > Task :buildSrc:compileGroovy UP-TO-DATE > Task :buildSrc:pluginDescriptors UP-TO-DATE > Task :buildSrc:processResources UP-TO-DATE > Task :buildSrc:classes UP-TO-DATE > Task :buildSrc:jar UP-TO-DATE > Task :buildSrc:assemble UP-TO-DATE > Task :buildSrc:spotlessGroovy UP-TO-DATE > Task :buildSrc:spotlessGroovyCheck UP-TO-DATE > Task :buildSrc:spotlessGroovyGradle UP-TO-DATE > Task :buildSrc:spotlessGroovyGradleCheck UP-TO-DATE > Task :buildSrc:spotlessCheck UP-TO-DATE > Task :buildSrc:pluginUnderTestMetadata UP-TO-DATE > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:validatePlugins UP-TO-DATE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build UP-TO-DATE Configuration on demand is an incubating feature. > Task :sdks:go:container:copyLicenses UP-TO-DATE > Task :sdks:go:container:dockerClean > Task :sdks:go:container:goPrepare Use project GOPATH: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/go/container/.gogradle/project_gopath> > Task :sdks:go:container:resolveBuildDependencies SKIPPED > Task :sdks:go:container:installDependencies SKIPPED > Task :sdks:go:container:buildLinuxAmd64 UP-TO-DATE > Task :sdks:go:container:goBuild > Task :sdks:go:container:skipPullLicenses > Task :sdks:go:container:dockerPrepare > Task :sdks:go:container:docker Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 29s 8 actionable tasks: 6 executed, 2 up-to-date Publishing build scan... https://gradle.com/s/oct6mr6b5jzoo $ CONTAINER=apache/beam_go_sdk $ cd sdks/go >>> RUNNING samza integration tests with pipeline options: -p 1 -timeout 2h >>> --runner=samza --project=apache-beam-testing --region=us-central1 >>> --environment_type=DOCKER --environment_config=apache/beam_go_sdk:dev >>> --staging_location=gs://temp-storage-for-end-to-end-tests/staging-validatesrunner-test >>> >>> --temp_location=gs://temp-storage-for-end-to-end-tests/temp-validatesrunner-test >>> --dataflow_worker_jar= --endpoint=localhost:41181 >>> --test_expansion_addr=localhost:43933 --io_expansion_addr=localhost:37459 >>> --kafka_jar=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/java/testing/kafka-service/build/libs/beam-sdks-java-testing-kafka-service-testKafkaService-2.35.0-SNAPSHOT.jar> $ ./run_validatesrunner_tests.sh: line 399: go: command not found $ TEST_EXIT_CODE=0 $ cd ../.. $ exit 127 $ exit 127 > Task :runners:samza:job-server:validatesCrossLanguageRunnerGoUsingJava FAILED > Task :runners:samza:job-server:validatesCrossLanguageRunnerJavaUsingJava > Task :runners:samza:job-server:validatesCrossLanguageRunnerJavaUsingPython > Task :runners:samza:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly > Task :runners:samza:job-server:validatesCrossLanguageRunnerPythonUsingJava >>> RUNNING integration tests with pipeline options: --runner=PortableRunner >>> --job_endpoint=localhost:41181 --environment_cache_millis=10000 >>> --experiments=beam_fn_api >>> pytest options: >>> collect markers: -m=xlang_transforms ============================= test session starts ============================== platform linux -- Python 3.6.13, pytest-4.6.11, py-1.10.0, pluggy-0.13.1 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/python,> inifile: pytest.ini plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3 timeout: 600.0s timeout method: signal timeout func_only: False collected 5107 items / 5097 deselected / 10 selected apache_beam/io/external/generate_sequence_test.py ... [ 30%] apache_beam/transforms/validate_runner_xlang_test.py ....... [100%] =============================== warnings summary =============================== apache_beam/io/filesystems_test.py:54 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:54: DeprecationWarning: invalid escape sequence \c self.assertIsNone(FileSystems.get_scheme('c:\\abc\cdf')) # pylint: disable=anomalous-backslash-in-string apache_beam/io/filesystems_test.py:62 <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/python/apache_beam/io/filesystems_test.py>:62: DeprecationWarning: invalid escape sequence \d self.assertTrue(isinstance(FileSystems.get_filesystem('c:\\abc\def'), # pylint: disable=anomalous-backslash-in-string -- Docs: https://docs.pytest.org/en/latest/warnings.html - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/python/pytest_xlangValidateRunner.xml> - =========== 10 passed, 5097 deselected, 2 warnings in 115.84 seconds =========== > Task :runners:samza:job-server:validatesCrossLanguageRunnerPythonUsingPython >>> RUNNING integration tests with pipeline options: --runner=PortableRunner >>> --job_endpoint=localhost:41181 --environment_cache_millis=10000 >>> --experiments=beam_fn_api >>> pytest options: >>> collect markers: -m=xlang_transforms ============================= test session starts ============================== platform linux -- Python 3.6.13, pytest-4.6.11, py-1.10.0, pluggy-0.13.1 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/python,> inifile: pytest.ini plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3 timeout: 600.0s timeout method: signal timeout func_only: False collected 5107 items / 5097 deselected / 10 selected apache_beam/io/external/generate_sequence_test.py .ss [ 30%] apache_beam/transforms/validate_runner_xlang_test.py ....... [100%] - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/python/pytest_xlangValidateRunner.xml> - ============ 8 passed, 2 skipped, 5097 deselected in 62.68 seconds ============= > Task :runners:samza:job-server:validatesCrossLanguageRunnerPythonUsingSql >>> RUNNING integration tests with pipeline options: --runner=PortableRunner >>> --job_endpoint=localhost:41181 --environment_cache_millis=10000 >>> --experiments=beam_fn_api >>> pytest options: >>> collect markers: -m=xlang_sql_expansion_service ============================= test session starts ============================== platform linux -- Python 3.6.13, pytest-4.6.11, py-1.10.0, pluggy-0.13.1 rootdir: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/python,> inifile: pytest.ini plugins: xdist-1.34.0, timeout-1.4.2, forked-1.3.0, requests-mock-1.9.3 timeout: 600.0s timeout method: signal timeout func_only: False collected 5107 items / 5098 deselected / 9 selected apache_beam/transforms/sql_test.py ......... [100%] - generated xml file: <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/python/pytest_xlangSqlValidateRunner.xml> - ================= 9 passed, 5098 deselected in 192.61 seconds ================== > Task :runners:samza:job-server:validatesCrossLanguageRunnerCleanup Stopping expansion service pid: 25782. Stopping expansion service pid: 25785. > Task :runners:samza:job-server:samzaJobServerCleanup Stopping job server pid: 1725. FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Samza/ws/src/sdks/go/test/build.gradle'> line: 212 * What went wrong: Execution failed for task ':runners:samza:job-server:validatesCrossLanguageRunnerGoUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 127 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 28m 14s 212 actionable tasks: 161 executed, 45 from cache, 6 up-to-date Publishing build scan... https://gradle.com/s/frip3xmqmv7bw Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
