See <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/6976/display/redirect?page=changes>
Changes: [neville.lyh] [BEAM-10787] make external sorter 2048MB memory limit Hadoop only [sjvanrossum] Change imports of org.codehaus.jackson to com.fasterxml.jackson ------------------------------------------ Started by timer Running as SYSTEM No JDK named ‘JDK 1.8 (latest)’ found [EnvInject] - Loading node environment variables. No JDK named ‘JDK 1.8 (latest)’ found Building remotely on apache-beam-jenkins-14 (beam) in workspace <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/> No JDK named ‘JDK 1.8 (latest)’ found No credentials specified Wiping out workspace first. No JDK named ‘JDK 1.8 (latest)’ found Cloning the remote Git repository Cloning repository https://github.com/apache/beam.git > git init <https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src> > # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git --version # timeout=10 > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* # timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 > git config --add remote.origin.fetch +refs/heads/*:refs/remotes/origin/* # > timeout=10 > git config remote.origin.url https://github.com/apache/beam.git # timeout=10 Fetching upstream changes from https://github.com/apache/beam.git > git fetch --tags --progress https://github.com/apache/beam.git > +refs/heads/*:refs/remotes/origin/* > +refs/pull/${ghprbPullId}/*:refs/remotes/origin/pr/${ghprbPullId}/* # > timeout=10 > git rev-parse origin/master^{commit} # timeout=10 No JDK named ‘JDK 1.8 (latest)’ found Checking out Revision 3cfe5a3fc46117bf1f6a2f8dba360d1c418a4bf6 (origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f 3cfe5a3fc46117bf1f6a2f8dba360d1c418a4bf6 # timeout=10 Commit message: "Merge pull request #12659: [BEAM-10787] make external sorter 2048MB memory limit Hadoop only" > git rev-list --no-walk 343fd2a7e8d8facb38f0dbd330b1f43db2fceb72 # timeout=10 No emails were triggered. [EnvInject] - Executing scripts and injecting environment variables after the SCM step. [EnvInject] - Injecting as environment variables the properties content SPARK_LOCAL_IP=127.0.0.1 SETUPTOOLS_USE_DISTUTILS=stdlib [EnvInject] - Variables injected successfully. No JDK named ‘JDK 1.8 (latest)’ found No JDK named ‘JDK 1.8 (latest)’ found No JDK named ‘JDK 1.8 (latest)’ found [beam_PostCommit_Py_ValCont] $ /bin/bash -xe /tmp/jenkins2368970393163647810.sh + cd src + bash sdks/python/container/run_validatescontainer.sh python36 This script must be executed in the root of beam project. Please set GCS_LOCATION, PROJECT and REGION as desired. # Where to store integration test outputs. GCS_LOCATION=${GCS_LOCATION:-gs://temp-storage-for-end-to-end-tests} # Project for the container and integration test PROJECT=${PROJECT:-apache-beam-testing} REGION=${REGION:-us-central1} IMAGE_PREFIX="$(grep 'docker_image_default_repo_prefix' gradle.properties | cut -d'=' -f2)" grep 'docker_image_default_repo_prefix' gradle.properties | cut -d'=' -f2 # Other variables branched by Python version. if [[ $1 == "python36" ]]; then IMAGE_NAME="${IMAGE_PREFIX}python3.6_sdk" # Use this to create CONTAINER_IMAGE variable. CONTAINER_PROJECT="sdks:python:container:py36" # Use this to build container by Gradle. PY_INTERPRETER="python3.6" # Use this in virtualenv command. elif [[ $1 == "python37" ]]; then IMAGE_NAME="${IMAGE_PREFIX}python3.7_sdk" # Use this to create CONTAINER_IMAGE variable. CONTAINER_PROJECT="sdks:python:container:py37" # Use this to build container by Gradle. PY_INTERPRETER="python3.7" # Use this in virtualenv command. elif [[ $1 == "python38" ]]; then IMAGE_NAME="${IMAGE_PREFIX}python3.8_sdk" # Use this to create CONTAINER_IMAGE variable. CONTAINER_PROJECT="sdks:python:container:py38" # Use this to build container by Gradle. PY_INTERPRETER="python3.8" # Use this in virtualenv command. else echo "Must set Python version with one of 'python36', 'python37' and 'python38' from commandline." exit 1 fi XUNIT_FILE="nosetests-$IMAGE_NAME.xml" # Verify in the root of the repository test -d sdks/python/container # Verify docker and gcloud commands exist command -v docker /usr/bin/docker command -v gcloud /usr/bin/gcloud docker -v Docker version 18.09.4, build d14af54 gcloud -v Google Cloud SDK 212.0.0 alpha 2018.08.13 beta 2018.08.13 bq 2.0.34 core 2018.08.13 gsutil 4.33 # Build the container TAG=$(date +%Y%m%d-%H%M%S) date +%Y%m%d-%H%M%S CONTAINER=us.gcr.io/$PROJECT/$USER/$IMAGE_NAME echo "Using container $CONTAINER" Using container us.gcr.io/apache-beam-testing/jenkins/beam_python3.6_sdk ./gradlew :$CONTAINER_PROJECT:docker -Pdocker-repository-root=us.gcr.io/$PROJECT/$USER -Pdocker-tag=$TAG --info Initialized native services in: /home/jenkins/.gradle/native Removing 0 daemon stop events from registry Previous Daemon (6901) stopped at Wed Oct 21 17:31:57 UTC 2020 after the daemon was no longer found in the daemon registry Previous Daemon (6996) stopped at Wed Oct 21 17:31:59 UTC 2020 after the daemon was no longer found in the daemon registry Previous Daemon (8784) stopped at Wed Oct 21 17:32:00 UTC 2020 after the daemon was no longer found in the daemon registry Starting a Gradle Daemon, 2 busy and 3 stopped Daemons could not be reused, use --status for details Starting process 'Gradle build daemon'. Working directory: /home/jenkins/.gradle/daemon/6.6.1 Command: /usr/lib/jvm/java-8-openjdk-amd64/bin/java -Xss10240k -Dfile.encoding=UTF-8 -Duser.country=US -Duser.language=en -Duser.variant -cp /home/jenkins/.gradle/wrapper/dists/gradle-6.6.1-all/ejrtlte9hlw8v6ii20a9584rs/gradle-6.6.1/lib/gradle-launcher-6.6.1.jar org.gradle.launcher.daemon.bootstrap.GradleDaemon 6.6.1 Successfully started process 'Gradle build daemon' An attempt to start the daemon took 1.147 secs. The client will now receive all logging from the daemon (pid: 15666). The daemon log file: /home/jenkins/.gradle/daemon/6.6.1/daemon-15666.out.log Starting build in new daemon [memory: 24.4 GB] Closing daemon's stdin at end of input. The daemon will no longer process any standard input. Using 16 worker leases. Starting Build Invalidating in-memory cache of /home/jenkins/.gradle/caches/6.6.1/fileHashes/fileHashes.bin Invalidating in-memory cache of /home/jenkins/.gradle/caches/6.6.1/fileHashes/resourceHashesCache.bin Invalidating in-memory cache of /home/jenkins/.gradle/caches/journal-1/file-access.bin Invalidating in-memory cache of /home/jenkins/.gradle/caches/journal-1/file-access.bin Invalidating in-memory cache of /home/jenkins/.gradle/caches/6.6.1/fileHashes/fileHashes.bin Invalidating in-memory cache of /home/jenkins/.gradle/caches/6.6.1/fileHashes/resourceHashesCache.bin Settings evaluated using settings file '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/settings.gradle'.> Using local directory build cache for the root build (location = /home/jenkins/.gradle/caches/build-cache-1, removeUnusedEntriesAfter = 7 days). > Configure project :buildSrc Evaluating project ':buildSrc' using build file '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/buildSrc/build.gradle'.> Invalidating in-memory cache of /home/jenkins/.gradle/caches/6.6.1/fileHashes/fileHashes.bin Invalidating in-memory cache of /home/jenkins/.gradle/caches/6.6.1/fileHashes/resourceHashesCache.bin Invalidating in-memory cache of /home/jenkins/.gradle/caches/journal-1/file-access.bin Selected primary task 'build' from project : :buildSrc:compileJava (Thread[Execution worker for ':buildSrc',5,main]) started. > Task :buildSrc:compileJava NO-SOURCE file or directory '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/buildSrc/src/main/java',> not found Skipping task ':buildSrc:compileJava' as it has no source files and no previous output files. :buildSrc:compileJava (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.068 secs. :buildSrc:compileGroovy (Thread[Execution worker for ':buildSrc',5,main]) started. > Task :buildSrc:compileGroovy FROM-CACHE Invalidating in-memory cache of /home/jenkins/.gradle/caches/journal-1/file-access.bin Invalidating in-memory cache of /home/jenkins/.gradle/caches/6.6.1/fileHashes/fileHashes.bin Invalidating in-memory cache of /home/jenkins/.gradle/caches/6.6.1/fileHashes/resourceHashesCache.bin Build cache key for task ':buildSrc:compileGroovy' is 48794c6a8b25d9f300bfb6c278bf75f2 Task ':buildSrc:compileGroovy' is not up-to-date because: No history is available. Invalidating in-memory cache of /home/jenkins/.gradle/caches/journal-1/file-access.bin Loaded cache entry for task ':buildSrc:compileGroovy' with cache key 48794c6a8b25d9f300bfb6c278bf75f2 :buildSrc:compileGroovy (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.82 secs. :buildSrc:pluginDescriptors (Thread[Execution worker for ':buildSrc',5,main]) started. > Task :buildSrc:pluginDescriptors Caching disabled for task ':buildSrc:pluginDescriptors' because: Caching has not been enabled for the task Task ':buildSrc:pluginDescriptors' is not up-to-date because: No history is available. :buildSrc:pluginDescriptors (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.032 secs. :buildSrc:processResources (Thread[Execution worker for ':buildSrc',5,main]) started. > Task :buildSrc:processResources file or directory '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/buildSrc/src/main/resources',> not found Could not read file path '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/buildSrc/src/main/resources'.> Caching disabled for task ':buildSrc:processResources' because: Caching has not been enabled for the task Task ':buildSrc:processResources' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/buildSrc/src/main/resources',> not found :buildSrc:processResources (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.03 secs. :buildSrc:classes (Thread[Execution worker for ':buildSrc',5,main]) started. > Task :buildSrc:classes Skipping task ':buildSrc:classes' as it has no actions. :buildSrc:classes (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs. :buildSrc:jar (Thread[Execution worker for ':buildSrc',5,main]) started. > Task :buildSrc:jar file or directory '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/buildSrc/build/classes/java/main',> not found Caching disabled for task ':buildSrc:jar' because: Caching has not been enabled for the task Task ':buildSrc:jar' is not up-to-date because: No history is available. file or directory '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/buildSrc/build/classes/java/main',> not found :buildSrc:jar (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.292 secs. :buildSrc:assemble (Thread[Execution worker for ':buildSrc',5,main]) started. > Task :buildSrc:assemble Skipping task ':buildSrc:assemble' as it has no actions. :buildSrc:assemble (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.0 secs. :buildSrc:spotlessGroovy (Thread[Execution worker for ':buildSrc',5,main]) started. > Task :buildSrc:spotlessGroovy FROM-CACHE file or directory '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/buildSrc/src/test/groovy',> not found file or directory '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/buildSrc/src/test/groovy',> not found Invalidating in-memory cache of /home/jenkins/.gradle/caches/journal-1/file-access.bin Build cache key for task ':buildSrc:spotlessGroovy' is 67c01ae5f311f89c20df629e2069821e Task ':buildSrc:spotlessGroovy' is not up-to-date because: No history is available. Loaded cache entry for task ':buildSrc:spotlessGroovy' with cache key 67c01ae5f311f89c20df629e2069821e :buildSrc:spotlessGroovy (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.498 secs. :buildSrc:spotlessGroovyCheck (Thread[Execution worker for ':buildSrc',5,main]) started. > Task :buildSrc:spotlessGroovyCheck FAILED :buildSrc:spotlessGroovyCheck (Thread[Execution worker for ':buildSrc',5,main]) completed. Took 0.005 secs. FAILURE: Build failed with an exception. * What went wrong: A problem was found with the configuration of task ':buildSrc:spotlessGroovyCheck' (type 'SpotlessCheck'). > Directory > '<https://ci-beam.apache.org/job/beam_PostCommit_Py_ValCont/ws/src/buildSrc/build/spotless/spotlessGroovy'> > specified for property 'spotlessOutDirectory' does not exist. * Try: Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. Use '--warning-mode all' to show the individual deprecation warnings. See https://docs.gradle.org/6.6.1/userguide/command_line_interface.html#sec:command_line_warnings BUILD FAILED in 9s Publishing build scan... https://gradle.com/s/g7h7dg6axzvnq Build step 'Execute shell' marked build as failure No JDK named ‘JDK 1.8 (latest)’ found --------------------------------------------------------------------- To unsubscribe, e-mail: builds-unsubscr...@beam.apache.org For additional commands, e-mail: builds-h...@beam.apache.org
