See <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/1058/display/redirect?page=changes>
Changes: [thiagotnunes] [BEAM-12164] Add Spanner Change Stream DAOs [noreply] [BEAM-13218] Sickbay [noreply] [BEAM-13399] Add infrastructure to start JARs from Go functions (#16214) ------------------------------------------ [...truncated 94.21 KB...] Using cached atomicwrites-1.4.0-py2.py3-none-any.whl (6.8 kB) Requirement already satisfied: importlib-metadata>=0.12 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from pytest<5.0,>=4.4.0->apache-beam==2.36.0.dev0) (2.1.2) Collecting wcwidth Using cached wcwidth-0.2.5-py2.py3-none-any.whl (30 kB) Collecting pluggy<1.0,>=0.12 Using cached pluggy-0.13.1-py2.py3-none-any.whl (18 kB) Collecting pytest-forked Using cached pytest_forked-1.4.0-py3-none-any.whl (4.9 kB) Collecting execnet>=1.1 Using cached execnet-1.9.0-py2.py3-none-any.whl (39 kB) Collecting certifi>=2017.4.17 Using cached certifi-2021.10.8-py2.py3-none-any.whl (149 kB) Collecting idna<4,>=2.5 Using cached idna-3.3-py3-none-any.whl (61 kB) Collecting charset-normalizer~=2.0.0 Using cached charset_normalizer-2.0.9-py3-none-any.whl (39 kB) Collecting urllib3<1.27,>=1.21.1 Using cached urllib3-1.26.7-py2.py3-none-any.whl (138 kB) Collecting greenlet!=0.4.17 Using cached greenlet-1.1.2-cp36-cp36m-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (147 kB) Collecting deprecation Using cached deprecation-2.1.0-py2.py3-none-any.whl (11 kB) Collecting docker Using cached docker-5.0.3-py2.py3-none-any.whl (146 kB) Collecting wrapt Using cached wrapt-1.13.3-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_12_x86_64.manylinux2010_x86_64.whl (78 kB) Collecting cffi>=1.12 Using cached cffi-1.15.0-cp36-cp36m-manylinux_2_5_x86_64.manylinux1_x86_64.whl (405 kB) Collecting googleapis-common-protos<2.0dev,>=1.6.0 Using cached googleapis_common_protos-1.54.0-py2.py3-none-any.whl (207 kB) Collecting google-crc32c<2.0dev,>=1.0 Using cached google_crc32c-1.3.0-cp36-cp36m-manylinux_2_12_x86_64.manylinux2010_x86_64.whl (37 kB) Requirement already satisfied: zipp>=0.5 in <https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/build/gradleenv/1922375555/lib/python3.6/site-packages> (from importlib-metadata>=0.12->pytest<5.0,>=4.4.0->apache-beam==2.36.0.dev0) (3.6.0) Collecting typing-inspect>=0.4.0 Using cached typing_inspect-0.7.1-py3-none-any.whl (8.4 kB) Collecting requests-oauthlib>=0.5.0 Using cached requests_oauthlib-1.3.0-py2.py3-none-any.whl (23 kB) Collecting isodate>=0.6.0 Using cached isodate-0.6.1-py2.py3-none-any.whl (41 kB) Collecting websocket-client>=0.32.0 Using cached websocket_client-1.2.3-py3-none-any.whl (53 kB) Collecting pycparser Using cached pycparser-2.21-py2.py3-none-any.whl (118 kB) Collecting oauthlib>=3.0.0 Using cached oauthlib-3.1.1-py2.py3-none-any.whl (146 kB) Collecting mypy-extensions>=0.3.0 Using cached mypy_extensions-0.4.3-py2.py3-none-any.whl (4.5 kB) Building wheels for collected packages: apache-beam Building wheel for apache-beam (setup.py): started Building wheel for apache-beam (setup.py): finished with status 'done' Created wheel for apache-beam: filename=apache_beam-2.36.0.dev0-py3-none-any.whl size=2625849 sha256=40357f43c2182b12b37abc434e5f60621870cf7e410428d00b61ef8353d3fe55 Stored in directory: /home/jenkins/.cache/pip/wheels/d8/1b/4b/f6a933018d31557ecdfd2019c766338eda6339bb0f184dcf50 Successfully built apache-beam Installing collected packages: pyasn1, urllib3, rsa, pyparsing, pyasn1-modules, idna, charset-normalizer, certifi, cachetools, wcwidth, typing-extensions, requests, pytz, python-dateutil, pycparser, pluggy, oauthlib, mypy-extensions, more-itertools, jmespath, googleapis-common-protos, google-auth, attrs, atomicwrites, websocket-client, typing-inspect, requests-oauthlib, pyyaml, pytest, numpy, isodate, httplib2, grpcio-gcp, google-crc32c, google-api-core, docopt, dataclasses, cffi, botocore, wrapt, s3transfer, pytest-forked, pymongo, pydot, pyarrow, proto-plus, pbr, orjson, oauth2client, msrest, libcst, hdfs, grpc-google-iam-v1, greenlet, google-resumable-media, google-cloud-core, fasteners, fastavro, execnet, docker, dill, deprecation, cryptography, crcmod, cloudpickle, azure-core, testcontainers, tenacity, sqlalchemy, requests-mock, pytest-xdist, pytest-timeout, pyhamcrest, psycopg2-binary, parameterized, pandas, mock, google-cloud-vision, google-cloud-videointelligence, google-cloud-spanner, google-cloud-recommendations-ai, google-cloud-pubsub, google-cloud-language, google-cloud-dlp, google-cloud-datastore, google-cloud-bigtable, google-cloud-bigquery-storage, google-cloud-bigquery, google-apitools, freezegun, boto3, azure-storage-blob, apache-beam Attempting uninstall: pyparsing Found existing installation: pyparsing 3.0.6 Uninstalling pyparsing-3.0.6: Successfully uninstalled pyparsing-3.0.6 Attempting uninstall: pluggy Found existing installation: pluggy 1.0.0 Uninstalling pluggy-1.0.0: Successfully uninstalled pluggy-1.0.0 > Task :release:go-licenses:py:dockerRun + rm -rf '/output/*' + export GO111MODULE=off + GO111MODULE=off + go get github.com/apache/beam/sdks/python/container > Task :release:go-licenses:java:dockerRun + rm -rf '/output/*' + export GO111MODULE=off + GO111MODULE=off + go get github.com/apache/beam/sdks/java/container > Task :release:go-licenses:go:dockerRun + rm -rf '/output/*' + export GO111MODULE=off + GO111MODULE=off + go get github.com/apache/beam/sdks/go/container > Task :sdks:python:installGcpTest Successfully installed apache-beam-2.36.0.dev0 atomicwrites-1.4.0 attrs-21.2.0 azure-core-1.21.1 azure-storage-blob-12.9.0 boto3-1.20.24 botocore-1.23.24 cachetools-4.2.4 certifi-2021.10.8 cffi-1.15.0 charset-normalizer-2.0.9 cloudpickle-2.0.0 crcmod-1.7 cryptography-36.0.1 dataclasses-0.8 deprecation-2.1.0 dill-0.3.1.1 docker-5.0.3 docopt-0.6.2 execnet-1.9.0 fastavro-1.4.7 fasteners-0.16.3 freezegun-1.1.0 google-api-core-1.31.5 google-apitools-0.5.31 google-auth-1.35.0 google-cloud-bigquery-2.31.0 google-cloud-bigquery-storage-2.10.1 google-cloud-bigtable-1.7.0 google-cloud-core-1.7.2 google-cloud-datastore-1.15.3 google-cloud-dlp-3.4.0 google-cloud-language-1.3.0 google-cloud-pubsub-1.7.0 google-cloud-recommendations-ai-0.2.0 google-cloud-spanner-1.19.1 google-cloud-videointelligence-1.16.1 google-cloud-vision-1.0.0 google-crc32c-1.3.0 google-resumable-media-2.1.0 googleapis-common-protos-1.54.0 greenlet-1.1.2 grpc-google-iam-v1-0.12.3 grpcio-gcp-0.2.2 hdfs-2.6.0 httplib2-0.19.1 idna-3.3 isodate-0.6.1 jmespath-0.10.0 libcst-0.3.23 mock-2.0.0 more-itertools-8.12.0 msrest-0.6.21 mypy-extensions-0.4.3 numpy-1.19.5 oauth2client-4.1.3 oauthlib-3.1.1 orjson-3.6.1 pandas-1.1.5 parameterized-0.7.5 pbr-5.8.0 pluggy-0.13.1 proto-plus-1.19.8 psycopg2-binary-2.9.2 pyarrow-6.0.1 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.21 pydot-1.4.2 pyhamcrest-1.10.1 pymongo-3.12.3 pyparsing-2.4.7 pytest-4.6.11 pytest-forked-1.4.0 pytest-timeout-1.4.2 pytest-xdist-1.34.0 python-dateutil-2.8.2 pytz-2021.3 pyyaml-6.0 requests-2.26.0 requests-mock-1.9.3 requests-oauthlib-1.3.0 rsa-4.8 s3transfer-0.5.0 sqlalchemy-1.4.28 tenacity-5.1.5 testcontainers-3.4.2 typing-extensions-3.10.0.2 typing-inspect-0.7.1 urllib3-1.26.7 wcwidth-0.2.5 websocket-client-1.2.3 wrapt-1.13.3 > Task :sdks:java:io:google-cloud-platform:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:io:google-cloud-platform:classes > Task :sdks:java:io:google-cloud-platform:jar > Task :sdks:java:extensions:sql:compileJava > Task :release:go-licenses:py:dockerRun + go-licenses save github.com/apache/beam/sdks/python/container --save_path=/output/licenses > Task :release:go-licenses:go:dockerRun + go-licenses save github.com/apache/beam/sdks/go/container --save_path=/output/licenses > Task :release:go-licenses:java:dockerRun + go-licenses save github.com/apache/beam/sdks/java/container --save_path=/output/licenses + go-licenses csv github.com/apache/beam/sdks/java/container + tee /output/licenses/list.csv > Task :sdks:java:extensions:sql:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. Note: Some input files use unchecked or unsafe operations. Note: Recompile with -Xlint:unchecked for details. > Task :sdks:java:extensions:sql:classes > Task :release:go-licenses:py:dockerRun + go-licenses csv github.com/apache/beam/sdks/python/container + tee /output/licenses/list.csv > Task :sdks:java:extensions:sql:jar > Task :release:go-licenses:go:dockerRun + go-licenses csv github.com/apache/beam/sdks/go/container + tee /output/licenses/list.csv > Task :sdks:java:extensions:sql:zetasql:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:zetasql:classes UP-TO-DATE > Task :sdks:java:extensions:sql:zetasql:jar > Task :sdks:java:extensions:sql:expansion-service:compileJava FROM-CACHE > Task :sdks:java:extensions:sql:expansion-service:classes UP-TO-DATE > Task :release:go-licenses:py:dockerRun + chmod -R a+w /output/licenses > Task :sdks:java:extensions:sql:expansion-service:shadowJar FROM-CACHE > Task :release:go-licenses:go:dockerRun + chmod -R a+w /output/licenses > Task :release:go-licenses:py:createLicenses > Task :sdks:python:container:py36:copyGolangLicenses > Task :release:go-licenses:java:dockerRun + chmod -R a+w /output/licenses > Task :sdks:python:container:py36:dockerPrepare > Task :release:go-licenses:go:createLicenses > Task :sdks:go:container:copyGolangLicenses > Task :sdks:go:container:dockerPrepare > Task :release:go-licenses:java:createLicenses > Task :sdks:java:container:java8:copyGolangLicenses > Task :sdks:java:container:java8:dockerPrepare > Task :sdks:python:container:py36:docker > Task :sdks:go:container:docker > Task :sdks:java:container:java8:docker > Task :sdks:python:container:py36:docker Collecting Markdown==3.3.6 Downloading Markdown-3.3.6-py3-none-any.whl (97 kB) Collecting mmh3==3.0.0 Downloading mmh3-3.0.0-cp36-cp36m-manylinux2010_x86_64.whl (49 kB) > Task :sdks:java:container:java8:docker Removing intermediate container 8a8196712a06 ---> 28e1bb3ff366 Successfully built 28e1bb3ff366 Successfully tagged apache/beam_java8_sdk:2.36.0.dev > Task :sdks:python:container:py36:docker Collecting mock==2.0.0 > Task :runners:spark:3:job-server:validatesCrossLanguageRunnerSetup > Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava Dec 16, 2021 6:23:04 AM org.apache.beam.sdk.expansion.service.ExpansionService loadRegisteredTransforms INFO: Registering external transforms: [beam:transform:org.apache.beam:kafka_read_with_metadata:v1, beam:transform:org.apache.beam:kafka_read_without_metadata:v1, beam:transform:org.apache.beam:kafka_write:v1, beam:external:java:generate_sequence:v1] The message received from the daemon indicates that the daemon has disappeared. Build request sent: Build{id=987dcb3b-7f52-4cd0-b87e-365a65c81749, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src}> Attempting to read last messages from the daemon log... Daemon pid: 23372 log file: /home/jenkins/.gradle/daemon/6.9.1/daemon-23372.out.log ----- Last 20 lines from daemon log file - daemon-23372.out.log ----- 2021-12-16T06:23:02.909+0000 [DEBUG] [org.gradle.launcher.daemon.server.DefaultDaemonConnection] thread 250: Received non-IO message from client: Build{id=987dcb3b-7f52-4cd0-b87e-365a65c81749, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src}> 2021-12-16T06:23:02.909+0000 [INFO] [org.gradle.launcher.daemon.server.DefaultIncomingConnectionHandler] Received command: Build{id=987dcb3b-7f52-4cd0-b87e-365a65c81749, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src}.> 2021-12-16T06:23:02.909+0000 [DEBUG] [org.gradle.launcher.daemon.server.DefaultIncomingConnectionHandler] Starting executing command: Build{id=987dcb3b-7f52-4cd0-b87e-365a65c81749, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src}> with connection: socket connection from /127.0.0.1:36961 to /127.0.0.1:38590. 2021-12-16T06:23:02.909+0000 [ERROR] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] Command execution: started DaemonCommandExecution[command = Build{id=987dcb3b-7f52-4cd0-b87e-365a65c81749, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src},> connection = DefaultDaemonConnection: socket connection from /127.0.0.1:36961 to /127.0.0.1:38590] after 9.0 minutes of idle 2021-12-16T06:23:02.910+0000 [INFO] [org.gradle.launcher.daemon.server.DaemonRegistryUpdater] Marking the daemon as busy, address: [6e7a7289-624c-41f2-9c0a-a19df32cff62 port:36961, addresses:[localhost/127.0.0.1]] 2021-12-16T06:23:02.910+0000 [DEBUG] [org.gradle.launcher.daemon.registry.PersistentDaemonRegistry] Marking busy by address: [6e7a7289-624c-41f2-9c0a-a19df32cff62 port:36961, addresses:[localhost/127.0.0.1]] 2021-12-16T06:23:02.910+0000 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Waiting to acquire exclusive lock on daemon addresses registry. 2021-12-16T06:23:02.911+0000 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Lock acquired on daemon addresses registry. 2021-12-16T06:23:02.911+0000 [DEBUG] [org.gradle.cache.internal.DefaultFileLockManager] Releasing lock on daemon addresses registry. 2021-12-16T06:23:02.911+0000 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] resetting idle timer 2021-12-16T06:23:02.911+0000 [DEBUG] [org.gradle.launcher.daemon.server.DaemonStateCoordinator] daemon is running. Sleeping until state changes. 2021-12-16T06:23:02.912+0000 [INFO] [org.gradle.launcher.daemon.server.exec.StartBuildOrRespondWithBusy] Daemon is about to start building Build{id=987dcb3b-7f52-4cd0-b87e-365a65c81749, currentDir=<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src}.> Dispatching build started information... 2021-12-16T06:23:02.912+0000 [DEBUG] [org.gradle.launcher.daemon.server.SynchronizedDispatchConnection] thread 252: dispatching org.gradle.launcher.daemon.protocol.BuildStarted@3a994f1a 2021-12-16T06:23:02.913+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.EstablishBuildEnvironment] Configuring env variables: [PATH, RUN_DISPLAY_URL, HUDSON_HOME, RUN_CHANGES_DISPLAY_URL, JOB_URL, HUDSON_COOKIE, MAIL, JENKINS_SERVER_COOKIE, LOGNAME, PWD, RUN_TESTS_DISPLAY_URL, JENKINS_URL, SHELL, BUILD_TAG, ROOT_BUILD_CAUSE, BUILD_CAUSE_TIMERTRIGGER, OLDPWD, GIT_CHECKOUT_DIR, JENKINS_HOME, sha1, CODECOV_TOKEN, NODE_NAME, BUILD_DISPLAY_NAME, JOB_DISPLAY_URL, GIT_BRANCH, SETUPTOOLS_USE_DISTUTILS, SHLVL, WORKSPACE_TMP, GIT_PREVIOUS_COMMIT, JAVA_HOME, BUILD_ID, LANG, XDG_SESSION_ID, JOB_NAME, SPARK_LOCAL_IP, BUILD_CAUSE, GIT_PREVIOUS_SUCCESSFUL_COMMIT, NODE_LABELS, HUDSON_URL, WORKSPACE, ROOT_BUILD_CAUSE_TIMERTRIGGER, _, GIT_COMMIT, COVERALLS_REPO_TOKEN, CI, EXECUTOR_NUMBER, HUDSON_SERVER_COOKIE, SSH_CLIENT, JOB_BASE_NAME, USER, SSH_CONNECTION, BUILD_NUMBER, BUILD_URL, RUN_ARTIFACTS_DISPLAY_URL, GIT_URL, XDG_RUNTIME_DIR, HOME] 2021-12-16T06:23:02.914+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.LogToClient] About to start relaying all logs to the client via the connection. 2021-12-16T06:23:02.914+0000 [INFO] [org.gradle.launcher.daemon.server.exec.LogToClient] The client will now receive all logging from the daemon (pid: 23372). The daemon log file: /home/jenkins/.gradle/daemon/6.9.1/daemon-23372.out.log 2021-12-16T06:23:02.915+0000 [INFO] [org.gradle.launcher.daemon.server.exec.LogAndCheckHealth] Starting 2nd build in daemon [uptime: 11 mins 49.458 secs, performance: 100%] 2021-12-16T06:23:02.915+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] The daemon has started executing the build. 2021-12-16T06:23:02.915+0000 [DEBUG] [org.gradle.launcher.daemon.server.exec.ExecuteBuild] Executing build with daemon context: DefaultDaemonContext[uid=15122360-1ddc-4af7-ac45-b73e123a862a,javaHome=/usr/lib/jvm/java-8-openjdk-amd64,daemonRegistryDir=/home/jenkins/.gradle/daemon,pid=23372,idleTimeout=10800000,priority=NORMAL,daemonOpts=-Xss10240k,-Dfile.encoding=UTF-8,-Duser.country=US,-Duser.language=en,-Duser.variant] Daemon vm is shutting down... The daemon has exited normally or was terminated in response to a user interrupt. ----- End of the daemon log ----- FAILURE: Build failed with an exception. * What went wrong: Gradle build daemon disappeared unexpectedly (it may have been killed or may have crashed) * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org > Task :runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava > FAILED > Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingJava > Task :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPython > Task > :runners:spark:3:job-server:validatesCrossLanguageRunnerJavaUsingPythonOnly > Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingJava > Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingPython > Task :runners:spark:3:job-server:validatesCrossLanguageRunnerPythonUsingSql > Task :runners:spark:3:job-server:validatesCrossLanguageRunnerCleanup > Task :runners:spark:3:job-server:sparkJobServerCleanup FAILURE: Build failed with an exception. * Where: Build file '<https://ci-beam.apache.org/job/beam_PostCommit_XVR_Spark3/ws/src/sdks/go/test/build.gradle'> line: 212 * What went wrong: Execution failed for task ':runners:spark:3:job-server:validatesCrossLanguageRunnerGoUsingJava'. > Process 'command 'sh'' finished with non-zero exit value 1 * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.9.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 42m 5s 213 actionable tasks: 155 executed, 51 from cache, 7 up-to-date Publishing build scan... https://gradle.com/s/wxy6uckxlxvba Build step 'Invoke Gradle script' changed build result to FAILURE Build step 'Invoke Gradle script' marked build as failure --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
