Build: https://ci-builds.apache.org/job/Solr/job/Solr-Smoketest-9.0/39/
Log: Started by timer Running as SYSTEM [EnvInject] - Loading node environment variables. Building remotely on lucene-solr-2 (solr lucene) in workspace /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0 The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir > /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0/.git # > timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://github.com/apache/solr.git # timeout=10 Cleaning workspace > git rev-parse --verify HEAD # timeout=10 Resetting working tree > git reset --hard # timeout=10 > git clean -fdx # timeout=10 Fetching upstream changes from https://github.com/apache/solr.git > git --version # timeout=10 > git --version # 'git version 2.25.1' > git fetch --tags --force --progress -- https://github.com/apache/solr.git > +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse origin/branch_9_0^{commit} # timeout=10 Checking out Revision 4918187cc0aa3299ba6a8addefb388b010ce2603 (origin/branch_9_0) > git config core.sparsecheckout # timeout=10 > git checkout -f 4918187cc0aa3299ba6a8addefb388b010ce2603 # timeout=10 Commit message: "SOLR-16101: Add empty constructor for SolrInputDocument (#746) (#751) (#752)" > git rev-list --no-walk 8c622dbaa901f4b2ea3ffa88e6a7ded93bad367b # timeout=10 No emails were triggered. provisioning config files... copy managed file [gradle.properties] to file:/home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0/gradle.properties [Gradle] - Launching build. [Solr-Smoketest-9.0] $ /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0/gradlew -Dversion.release=9.0.0 -Dgradle.user.home=/home/jenkins/jenkins-slave/workspace/Solr/.gradle -Porg.gradle.daemon=false -Pvalidation.git.failOnModified=false --continue -x signJarsPublication clean assembleRelease Downloading gradle-wrapper.jar from https://github.com/gradle/gradle/raw/v7.2.0/gradle/wrapper/gradle-wrapper.jar To honour the JVM settings for this build a single-use Daemon process will be forked. See https://docs.gradle.org/7.2/userguide/gradle_daemon.html#sec:disabling_the_daemon. Daemon will be stopped at the end of the build > Task :buildSrc:compileJava > Task :buildSrc:compileGroovy NO-SOURCE > Task :buildSrc:processResources NO-SOURCE > Task :buildSrc:classes > Task :buildSrc:jar > Task :buildSrc:assemble > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build > Task :clean > Task :solr:clean UP-TO-DATE > Task :solr:benchmark:clean > Task :solr:core:clean > Task :solr:distribution:clean UP-TO-DATE > Task :solr:docker:clean UP-TO-DATE > Task :solr:documentation:clean UP-TO-DATE > Task :solr:example:clean UP-TO-DATE > Task :solr:modules:clean UP-TO-DATE > Task :solr:packaging:clean UP-TO-DATE > Task :solr:prometheus-exporter:clean > Task :solr:server:clean > Task :solr:solr-ref-guide:clean UP-TO-DATE > Task :solr:solrj:clean > Task :solr:test-framework:clean > Task :solr:webapp:clean > Task :solr:modules:analysis-extras:clean > Task :solr:modules:analytics:clean > Task :solr:modules:clustering:clean > Task :solr:modules:extraction:clean > Task :solr:modules:gcs-repository:clean > Task :solr:modules:hadoop-auth:clean > Task :solr:modules:hdfs:clean > Task :solr:modules:jaegertracer-configurator:clean > Task :solr:modules:jwt-auth:clean > Task :solr:modules:langid:clean > Task :solr:modules:ltr:clean > Task :solr:modules:s3-repository:clean > Task :solr:modules:scripting:clean > Task :solr:modules:sql:clean > Task :mavenLocalClean UP-TO-DATE > Task :solr-missing-doclet:compileJava > Task :solr-missing-doclet:processResources NO-SOURCE > Task :solr-missing-doclet:classes > Task :solr-missing-doclet:jar > Task :gitStatus > Task :solr:server:compileJava NO-SOURCE > Task :solr:solrj:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:core:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:core:processResources > Task :solr:core:classes > Task :solr:core:jar > Task :solr:core:generateMetadataFileForJarsPublication SKIPPED > Task :solr:core:generatePomFileForJarsPublication > Task :solr:server:renderJavadoc SKIPPED > Task :solr:core:sourcesJar > Task :solr:prometheus-exporter:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:prometheus-exporter:processResources NO-SOURCE > Task :solr:prometheus-exporter:classes > Task :solr:prometheus-exporter:jar > Task :solr:prometheus-exporter:generateMetadataFileForJarsPublication SKIPPED > Task :solr:prometheus-exporter:generatePomFileForJarsPublication > Task :solr:prometheus-exporter:sourcesJar > Task :solr:server:processResources NO-SOURCE > Task :solr:server:classes UP-TO-DATE > Task :solr:server:jar > Task :solr:server:generateMetadataFileForJarsPublication SKIPPED > Task :solr:server:generatePomFileForJarsPublication > Task :solr:server:javadoc SKIPPED > Task :solr:server:javadocJar > Task :solr:server:sourcesJar > Task :solr:server:publishJarsPublicationToBuildRepository > Task :solr:solrj:processResources > Task :solr:solrj:classes > Task :solr:solrj:jar > Task :solr:solrj:generateMetadataFileForJarsPublication SKIPPED > Task :solr:solrj:generatePomFileForJarsPublication > Task :solr:solrj:renderJavadoc > Task :solr:core:renderJavadoc > Task :solr:core:javadoc SKIPPED > Task :solr:core:javadocJar > Task :solr:core:publishJarsPublicationToBuildRepository > Task :solr:prometheus-exporter:renderJavadoc > Task :solr:prometheus-exporter:javadoc SKIPPED > Task :solr:prometheus-exporter:javadocJar > Task :solr:prometheus-exporter:publishJarsPublicationToBuildRepository > Task :solr:solrj:javadoc SKIPPED > Task :solr:solrj:javadocJar > Task :solr:solrj:sourcesJar > Task :solr:solrj:publishJarsPublicationToBuildRepository > Task :solr:test-framework:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:test-framework:processResources > Task :solr:test-framework:classes > Task :solr:test-framework:jar > Task :solr:test-framework:generateMetadataFileForJarsPublication SKIPPED > Task :solr:test-framework:generatePomFileForJarsPublication > Task :solr:test-framework:renderJavadoc > Task :solr:test-framework:javadoc SKIPPED > Task :solr:test-framework:javadocJar > Task :solr:test-framework:sourcesJar > Task :solr:test-framework:publishJarsPublicationToBuildRepository > Task :solr:modules:analysis-extras:compileJava Note: /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0/solr/modules/analysis-extras/src/java/org/apache/solr/schema/ICUCollationField.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:analysis-extras:processResources NO-SOURCE > Task :solr:modules:analysis-extras:classes > Task :solr:modules:analysis-extras:jar > Task :solr:modules:analysis-extras:generateMetadataFileForJarsPublication > SKIPPED > Task :solr:modules:analysis-extras:generatePomFileForJarsPublication > Task :solr:modules:analysis-extras:renderJavadoc > Task :solr:modules:analysis-extras:javadoc SKIPPED > Task :solr:modules:analysis-extras:javadocJar > Task :solr:modules:analysis-extras:sourcesJar > Task :solr:modules:analysis-extras:publishJarsPublicationToBuildRepository > Task :solr:modules:analytics:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:analytics:processResources NO-SOURCE > Task :solr:modules:analytics:classes > Task :solr:modules:analytics:jar > Task :solr:modules:analytics:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:analytics:generatePomFileForJarsPublication > Task :solr:modules:analytics:renderJavadoc > Task :solr:modules:analytics:javadoc SKIPPED > Task :solr:modules:analytics:javadocJar > Task :solr:modules:analytics:sourcesJar > Task :solr:modules:analytics:publishJarsPublicationToBuildRepository > Task :solr:modules:clustering:compileJava > Task :solr:modules:clustering:processResources NO-SOURCE > Task :solr:modules:clustering:classes > Task :solr:modules:clustering:jar > Task :solr:modules:clustering:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:clustering:generatePomFileForJarsPublication > Task :solr:modules:clustering:renderJavadoc > Task :solr:modules:clustering:javadoc SKIPPED > Task :solr:modules:clustering:javadocJar > Task :solr:modules:clustering:sourcesJar > Task :solr:modules:clustering:publishJarsPublicationToBuildRepository > Task :solr:modules:extraction:compileJava Note: /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0/solr/modules/extraction/src/java/org/apache/solr/handler/extraction/ExtractingDocumentLoader.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:extraction:processResources > Task :solr:modules:extraction:classes > Task :solr:modules:extraction:jar > Task :solr:modules:extraction:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:extraction:generatePomFileForJarsPublication > Task :solr:modules:extraction:renderJavadoc > Task :solr:modules:extraction:javadoc SKIPPED > Task :solr:modules:extraction:javadocJar > Task :solr:modules:extraction:sourcesJar > Task :solr:modules:extraction:publishJarsPublicationToBuildRepository > Task :solr:modules:gcs-repository:compileJava > Task :solr:modules:gcs-repository:processResources NO-SOURCE > Task :solr:modules:gcs-repository:classes > Task :solr:modules:gcs-repository:jar > Task :solr:modules:gcs-repository:generateMetadataFileForJarsPublication > SKIPPED > Task :solr:modules:gcs-repository:generatePomFileForJarsPublication > Task :solr:modules:gcs-repository:renderJavadoc > Task :solr:modules:gcs-repository:javadoc SKIPPED > Task :solr:modules:gcs-repository:javadocJar > Task :solr:modules:gcs-repository:sourcesJar > Task :solr:modules:gcs-repository:publishJarsPublicationToBuildRepository > Task :solr:modules:jaegertracer-configurator:compileJava > Task :solr:modules:jaegertracer-configurator:processResources NO-SOURCE > Task :solr:modules:jaegertracer-configurator:classes > Task :solr:modules:jaegertracer-configurator:jar > Task > :solr:modules:jaegertracer-configurator:generateMetadataFileForJarsPublication > SKIPPED > Task :solr:modules:jaegertracer-configurator:generatePomFileForJarsPublication > Task :solr:modules:jaegertracer-configurator:renderJavadoc > Task :solr:modules:jaegertracer-configurator:javadoc SKIPPED > Task :solr:modules:jaegertracer-configurator:javadocJar > Task :solr:modules:jaegertracer-configurator:sourcesJar > Task > :solr:modules:jaegertracer-configurator:publishJarsPublicationToBuildRepository > Task :solr:modules:jwt-auth:compileJava > Task :solr:modules:jwt-auth:processResources NO-SOURCE > Task :solr:modules:jwt-auth:classes > Task :solr:modules:jwt-auth:jar > Task :solr:modules:jwt-auth:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:jwt-auth:generatePomFileForJarsPublication > Task :solr:modules:jwt-auth:renderJavadoc > Task :solr:modules:jwt-auth:javadoc SKIPPED > Task :solr:modules:jwt-auth:javadocJar > Task :solr:modules:jwt-auth:sourcesJar > Task :solr:modules:jwt-auth:publishJarsPublicationToBuildRepository > Task :solr:modules:langid:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:langid:processResources > Task :solr:modules:langid:classes > Task :solr:modules:langid:jar > Task :solr:modules:langid:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:langid:generatePomFileForJarsPublication > Task :solr:modules:langid:renderJavadoc > Task :solr:modules:langid:javadoc SKIPPED > Task :solr:modules:langid:javadocJar > Task :solr:modules:langid:sourcesJar > Task :solr:modules:langid:publishJarsPublicationToBuildRepository > Task :solr:modules:ltr:compileJava > Task :solr:modules:ltr:processResources NO-SOURCE > Task :solr:modules:ltr:classes > Task :solr:modules:ltr:jar > Task :solr:modules:ltr:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:ltr:generatePomFileForJarsPublication > Task :solr:modules:ltr:renderJavadoc > Task :solr:modules:ltr:javadoc SKIPPED > Task :solr:modules:ltr:javadocJar > Task :solr:modules:ltr:sourcesJar > Task :solr:modules:ltr:publishJarsPublicationToBuildRepository > Task :solr:modules:s3-repository:compileJava > Task :solr:modules:s3-repository:processResources NO-SOURCE > Task :solr:modules:s3-repository:classes > Task :solr:modules:s3-repository:jar > Task :solr:modules:s3-repository:generateMetadataFileForJarsPublication > SKIPPED > Task :solr:modules:s3-repository:generatePomFileForJarsPublication > Task :solr:modules:s3-repository:renderJavadoc > Task :solr:modules:s3-repository:javadoc SKIPPED > Task :solr:modules:s3-repository:javadocJar > Task :solr:modules:s3-repository:sourcesJar > Task :solr:modules:s3-repository:publishJarsPublicationToBuildRepository > Task :solr:modules:scripting:compileJava > Task :solr:modules:scripting:processResources NO-SOURCE > Task :solr:modules:scripting:classes > Task :solr:modules:scripting:jar > Task :solr:modules:scripting:generateMetadataFileForJarsPublication SKIPPED > Task :solr:modules:scripting:generatePomFileForJarsPublication > Task :solr:modules:scripting:renderJavadoc > Task :solr:modules:scripting:javadoc SKIPPED > Task :solr:modules:scripting:javadocJar > Task :solr:modules:scripting:sourcesJar > Task :solr:modules:scripting:publishJarsPublicationToBuildRepository > Task :mavenToLocalFolder Local maven artifacts (poms, jars) created at: /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0/build/maven-local > Task :checkWorkingCopyClean > Task :solr:distribution:assembleSourceTgz > Task :solr:docker:createBodySnippetDockerfile > Task :solr:docker:createDockerfileLocal > Task :solr:docker:assemblePackaging > Task :solr:documentation:changesToHtml > Task :solr:documentation:copyDocumentationAssets > Task :solr:documentation:markdownToHtml > Task :solr:documentation:copyChangesToHtmlForMiniSite > Task :solr:documentation:copyMiniDocumentationAssets > Task :solr:documentation:createMiniDocumentationIndex > Task :solr:documentation:documentationMinimal > Task :solr:core:assemblePostJar > Task :solr:example:assemblePackaging > Task :solr:prometheus-exporter:assemblePackaging > Task :solr:webapp:compileJava NO-SOURCE > Task :solr:webapp:processResources NO-SOURCE > Task :solr:webapp:classes UP-TO-DATE > Task :solr:webapp:war > Task :solr:server:assemblePackaging > Task :solr:modules:analysis-extras:assemblePackaging > Task :solr:modules:analytics:assemblePackaging > Task :solr:modules:clustering:assemblePackaging > Task :solr:modules:extraction:assemblePackaging > Task :solr:modules:gcs-repository:assemblePackaging > Task :solr:modules:hadoop-auth:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:hadoop-auth:processResources NO-SOURCE > Task :solr:modules:hadoop-auth:classes > Task :solr:modules:hadoop-auth:jar > Task :solr:modules:hadoop-auth:assemblePackaging > Task :solr:modules:hdfs:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:hdfs:processResources NO-SOURCE > Task :solr:modules:hdfs:classes > Task :solr:modules:hdfs:jar > Task :solr:modules:hdfs:assemblePackaging > Task :solr:modules:jaegertracer-configurator:assemblePackaging > Task :solr:modules:jwt-auth:assemblePackaging > Task :solr:modules:langid:assemblePackaging > Task :solr:modules:ltr:assemblePackaging > Task :solr:modules:s3-repository:assemblePackaging > Task :solr:modules:scripting:assemblePackaging > Task :solr:modules:sql:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:sql:processResources NO-SOURCE > Task :solr:modules:sql:classes > Task :solr:modules:sql:jar > Task :solr:modules:sql:assemblePackaging > Task :solr:packaging:distTar > Task :solr:distribution:computeChecksums > Task :solr:distribution:prepareGitRev > Task :solr:distribution:assembleRelease Deprecated Gradle features were used in this build, making it incompatible with Gradle 8.0. You can use '--warning-mode all' to show the individual deprecation warnings and determine if they come from your own scripts or plugins. See https://docs.gradle.org/7.2/userguide/command_line_interface.html#sec:command_line_warnings BUILD SUCCESSFUL in 3m 5s 192 actionable tasks: 183 executed, 9 up-to-date Build step 'Invoke Gradle script' changed build result to SUCCESS Run condition [Always] enabling perform for step [Execute shell] [Solr-Smoketest-9.0] $ /bin/bash /tmp/jenkins4404917886788630730.sh Installing Python script requirements Defaulting to user installation because normal site-packages is not writeable Requirement already satisfied: six>=1.11.0 in /usr/lib/python3/dist-packages (from -r dev-tools/scripts/requirements.txt (line 1)) (1.14.0) Requirement already satisfied: Jinja2>=2.10.1 in /usr/lib/python3/dist-packages (from -r dev-tools/scripts/requirements.txt (line 2)) (2.10.1) Requirement already satisfied: PyYAML>=5.1 in /usr/lib/python3/dist-packages (from -r dev-tools/scripts/requirements.txt (line 3)) (5.3.1) Requirement already satisfied: holidays>=0.9.10 in /home/jenkins/.local/lib/python3.8/site-packages (from -r dev-tools/scripts/requirements.txt (line 4)) (0.13) Requirement already satisfied: ics>=0.4 in /home/jenkins/.local/lib/python3.8/site-packages (from -r dev-tools/scripts/requirements.txt (line 5)) (0.7) Requirement already satisfied: console-menu==0.5.1 in /home/jenkins/.local/lib/python3.8/site-packages (from -r dev-tools/scripts/requirements.txt (line 6)) (0.5.1) Requirement already satisfied: PyGithub in /home/jenkins/.local/lib/python3.8/site-packages (from -r dev-tools/scripts/requirements.txt (line 7)) (1.55) Requirement already satisfied: jira in /home/jenkins/.local/lib/python3.8/site-packages (from -r dev-tools/scripts/requirements.txt (line 8)) (3.1.1) Requirement already satisfied: hijri-converter in /home/jenkins/.local/lib/python3.8/site-packages (from holidays>=0.9.10->-r dev-tools/scripts/requirements.txt (line 4)) (2.2.3) Requirement already satisfied: python-dateutil in /usr/lib/python3/dist-packages (from holidays>=0.9.10->-r dev-tools/scripts/requirements.txt (line 4)) (2.7.3) Requirement already satisfied: korean-lunar-calendar in /home/jenkins/.local/lib/python3.8/site-packages (from holidays>=0.9.10->-r dev-tools/scripts/requirements.txt (line 4)) (0.2.1) Requirement already satisfied: convertdate>=2.3.0 in /home/jenkins/.local/lib/python3.8/site-packages (from holidays>=0.9.10->-r dev-tools/scripts/requirements.txt (line 4)) (2.4.0) Requirement already satisfied: arrow<0.15,>=0.11 in /home/jenkins/.local/lib/python3.8/site-packages (from ics>=0.4->-r dev-tools/scripts/requirements.txt (line 5)) (0.14.7) Requirement already satisfied: tatsu>4.2 in /home/jenkins/.local/lib/python3.8/site-packages (from ics>=0.4->-r dev-tools/scripts/requirements.txt (line 5)) (5.6.1) Requirement already satisfied: pynacl>=1.4.0 in /home/jenkins/.local/lib/python3.8/site-packages (from PyGithub->-r dev-tools/scripts/requirements.txt (line 7)) (1.5.0) Requirement already satisfied: pyjwt>=2.0 in /home/jenkins/.local/lib/python3.8/site-packages (from PyGithub->-r dev-tools/scripts/requirements.txt (line 7)) (2.3.0) Requirement already satisfied: deprecated in /home/jenkins/.local/lib/python3.8/site-packages (from PyGithub->-r dev-tools/scripts/requirements.txt (line 7)) (1.2.13) Requirement already satisfied: requests>=2.14.0 in /usr/lib/python3/dist-packages (from PyGithub->-r dev-tools/scripts/requirements.txt (line 7)) (2.22.0) Requirement already satisfied: requests-oauthlib>=1.1.0 in /home/jenkins/.local/lib/python3.8/site-packages (from jira->-r dev-tools/scripts/requirements.txt (line 8)) (1.3.1) Requirement already satisfied: setuptools>=20.10.1 in /usr/lib/python3/dist-packages (from jira->-r dev-tools/scripts/requirements.txt (line 8)) (45.2.0) Requirement already satisfied: requests-toolbelt in /home/jenkins/.local/lib/python3.8/site-packages (from jira->-r dev-tools/scripts/requirements.txt (line 8)) (0.9.1) Requirement already satisfied: defusedxml in /home/jenkins/.local/lib/python3.8/site-packages (from jira->-r dev-tools/scripts/requirements.txt (line 8)) (0.7.1) Requirement already satisfied: keyring in /usr/lib/python3/dist-packages (from jira->-r dev-tools/scripts/requirements.txt (line 8)) (18.0.1) Requirement already satisfied: pymeeus<=1,>=0.3.13 in /home/jenkins/.local/lib/python3.8/site-packages (from convertdate>=2.3.0->holidays>=0.9.10->-r dev-tools/scripts/requirements.txt (line 4)) (0.5.11) Requirement already satisfied: cffi>=1.4.1 in /usr/local/lib/python3.8/dist-packages (from pynacl>=1.4.0->PyGithub->-r dev-tools/scripts/requirements.txt (line 7)) (1.14.2) Requirement already satisfied: oauthlib>=3.0.0 in /usr/lib/python3/dist-packages (from requests-oauthlib>=1.1.0->jira->-r dev-tools/scripts/requirements.txt (line 8)) (3.1.0) Requirement already satisfied: wrapt<2,>=1.10 in /home/jenkins/.local/lib/python3.8/site-packages (from deprecated->PyGithub->-r dev-tools/scripts/requirements.txt (line 7)) (1.13.3) Requirement already satisfied: secretstorage in /usr/lib/python3/dist-packages (from keyring->jira->-r dev-tools/scripts/requirements.txt (line 8)) (2.3.1) Requirement already satisfied: pycparser in /usr/local/lib/python3.8/dist-packages (from cffi>=1.4.1->pynacl>=1.4.0->PyGithub->-r dev-tools/scripts/requirements.txt (line 7)) (2.20) Starting Smoke tester in folder /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0 Java 11 JAVA_HOME=/home/jenkins/tools/java/latest11 NOTE: output encoding is utf-8 Load release URL "file:///home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0/solr/distribution/build/release"... Get KEYS... Downloading online KEYS file https://archive.apache.org/dist/solr/KEYS Downloading https://archive.apache.org/dist/solr/KEYS 0.3 MB in 1.01 sec (0.3 MB/sec) Test Solr... test basics... check changes HTML... download solr-9.0.0-src.tgz... Downloading file:///home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0/solr/distribution/build/release/solr-9.0.0-src.tgz 84.5 MB in 0.06 sec (1337.4 MB/sec) verify sha512 digest download solr-9.0.0.tgz... Downloading file:///home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0/solr/distribution/build/release/solr-9.0.0.tgz 213.5 MB in 0.16 sec (1351.5 MB/sec) verify sha512 digest unpack solr-9.0.0.tgz... solr-9.0.0.tgz Checking LICENSE Checking NOTICE Checking README Checking CHANGES Checking bin Checking modules Checking docker Checking prometheus-exporter Checking docs Checking example Checking licenses Checking server verify JAR metadata/identity/no javax.* or java.* classes... **WARNING**: skipping check of /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0/modules/extraction/lib/unit-api-1.0.jar: it has javax.* classes **WARNING**: skipping check of /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0/modules/extraction/lib/jakarta.activation-1.2.2.jar: it has javax.* classes **WARNING**: skipping check of /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0/modules/extraction/lib/jakarta.activation-api-1.2.2.jar: it has javax.* classes **WARNING**: skipping check of /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0/modules/extraction/lib/jakarta.annotation-api-1.3.5.jar: it has javax.* classes **WARNING**: skipping check of /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0/modules/extraction/lib/jakarta.xml.bind-api-2.3.3.jar: it has javax.* classes copying unpacked distribution for Java 11 ... test solr example w/ Java 11... start Solr instance (log=/home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0-java11/solr-example.log)... No process found for Solr node running on port 8983 Running techproducts example on port 8983 from /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0-java11 *** [WARN] *** Your open file limit is currently 60000. It should be set to 65000 to avoid operational disruption. If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh *** [WARN] *** Your Max Processes Limit is currently 30000. It should be set to 65000 to avoid operational disruption. If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh Creating Solr home directory /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0-java11/example/techproducts/solr Starting up Solr on port 8983 using command: "bin/solr" start -p 8983 -s "example/techproducts/solr" *** [WARN] *** Your open file limit is currently 60000. It should be set to 65000 to avoid operational disruption. If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh *** [WARN] *** Your Max Processes Limit is currently 30000. It should be set to 65000 to avoid operational disruption. If you no longer wish to see this warning, set SOLR_ULIMIT_CHECKS to false in your profile or solr.in.sh Waiting up to 180 seconds to see Solr running on port 8983 [|] [/] [-] [\] [|] [/] [-] [\] [|] Started Solr server on port 8983 (pid=399477). Happy searching! Created new core 'techproducts' Indexing tech product example docs from /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0-java11/example/exampledocs SimplePostTool version 5.0.0 Posting files to [base] url http://localhost:8983/solr/techproducts/update using content-type application/xml... POSTing file solr.xml to [base] POSTing file sd500.xml to [base] POSTing file hd.xml to [base] POSTing file manufacturers.xml to [base] POSTing file ipod_other.xml to [base] POSTing file gb18030-example.xml to [base] POSTing file mp500.xml to [base] POSTing file vidcard.xml to [base] POSTing file utf8-example.xml to [base] POSTing file monitor2.xml to [base] POSTing file money.xml to [base] POSTing file monitor.xml to [base] POSTing file ipod_video.xml to [base] POSTing file mem.xml to [base] 14 files indexed. COMMITting Solr index changes to http://localhost:8983/solr/techproducts/update... Time spent: 0:00:00.491 Solr techproducts example launched successfully. Direct your Web browser to http://localhost:8983/solr to visit the Solr Admin UI test utf8... run query... stop server using: bin/solr stop -p 8983 Sending stop command to Solr running on port 8983 ... waiting up to 180 seconds to allow Jetty process 399477 to stop gracefully. [|] [/] [-] [\] unpack solr-9.0.0-src.tgz... solr-9.0.0-src.tgz Checking LICENSE Checking NOTICE Checking README Checking CHANGES Checking README Checking buildSrc Checking dev-docs Checking dev-tools Checking gradle Checking help Checking solr Checking build.gradle Checking gradlew Checking gradlew.bat Checking settings.gradle Checking versions.lock Checking versions.props Checking benchmark Checking bin Checking modules Checking core Checking docker Checking documentation Checking example Checking licenses Checking packaging Checking distribution Checking prometheus-exporter Checking server Checking solr-ref-guide Checking solrj Checking test-framework Checking webapp Checking .gitignore Checking .gitattributes Checking build.gradle make sure no JARs/WARs in src dist... run "./gradlew --no-daemon check -p solr/documentation" run tests w/ Java 11 and testArgs='-Dtests.nightly=true -Dtests.badapples=false '... command "export JAVA_HOME="/home/jenkins/tools/java/latest11" PATH="/home/jenkins/tools/java/latest11/bin:$PATH" JAVACMD="/home/jenkins/tools/java/latest11/bin/java"; ./gradlew --no-daemon test -Dtests.nightly=true -Dtests.badapples=false " failed: To honour the JVM settings for this build a single-use Daemon process will be forked. See https://docs.gradle.org/7.2/userguide/gradle_daemon.html#sec:disabling_the_daemon. Daemon will be stopped at the end of the build > Task :buildSrc:compileJava UP-TO-DATE > Task :buildSrc:compileGroovy NO-SOURCE > Task :buildSrc:processResources NO-SOURCE > Task :buildSrc:classes UP-TO-DATE > Task :buildSrc:jar UP-TO-DATE > Task :buildSrc:assemble UP-TO-DATE > Task :buildSrc:compileTestJava NO-SOURCE > Task :buildSrc:compileTestGroovy NO-SOURCE > Task :buildSrc:processTestResources NO-SOURCE > Task :buildSrc:testClasses UP-TO-DATE > Task :buildSrc:test NO-SOURCE > Task :buildSrc:check UP-TO-DATE > Task :buildSrc:build UP-TO-DATE > Task :solr:server:compileJava NO-SOURCE > Task :randomizationInfo Running tests with randomization seed: tests.seed=5B4E80CDC497802A > Task :solr:benchmark:processResources > Task :solr:benchmark:copyTestResources NO-SOURCE > Task :solr:benchmark:processTestResources > Task :solr:solrj:compileJava UP-TO-DATE > Task :gitStatus > Task :solr:server:processResources NO-SOURCE > Task :solr:server:classes UP-TO-DATE > Task :solr:server:jar > Task :solr:solrj:processResources > Task :solr:solrj:classes > Task :solr:core:compileJava UP-TO-DATE > Task :solr:test-framework:compileJava UP-TO-DATE > Task :solr:solrj:jar > Task :solr:core:processResources > Task :solr:core:classes > Task :solr:core:jar > Task :solr:test-framework:processResources > Task :solr:test-framework:classes > Task :solr:test-framework:jar > Task :solr:benchmark:compileJava > Task :solr:benchmark:classes > Task :solr:benchmark:compileTestJava > Task :solr:benchmark:testClasses > Task :solr:core:compileTestJava > Task :solr:benchmark:test :solr:benchmark:test (SUCCESS): 11 test(s) > Task :solr:benchmark:wipeTaskTemp > Task :solr:modules:analysis-extras:compileJava Note: /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0/solr/modules/analysis-extras/src/java/org/apache/solr/schema/ICUCollationField.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:analysis-extras:processResources NO-SOURCE > Task :solr:modules:analysis-extras:classes > Task :solr:modules:analysis-extras:jar > Task :solr:prometheus-exporter:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:prometheus-exporter:processResources NO-SOURCE > Task :solr:prometheus-exporter:classes > Task :solr:prometheus-exporter:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:prometheus-exporter:copyTestResources NO-SOURCE > Task :solr:prometheus-exporter:processTestResources > Task :solr:prometheus-exporter:testClasses > Task :solr:core:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:core:copyTestResources > Task :solr:core:processTestResources > Task :solr:core:testClasses > Task :solr:prometheus-exporter:test :solr:prometheus-exporter:test (SUCCESS): 20 test(s) > Task :solr:core:test WARNING: Test org.apache.solr.handler.component.TestDistributedStatsComponentCardinality wrote 44,130,858 bytes of output. WARNING: Test org.apache.solr.handler.TestReplicationHandler wrote 40,056,591 bytes of output. WARNING: Test org.apache.solr.cloud.ChaosMonkeyNothingIsSafeTest wrote 39,670,225 bytes of output. WARNING: Test org.apache.solr.cloud.CloudExitableDirectoryReaderTest wrote 11,189,869 bytes of output. WARNING: Test org.apache.solr.cloud.TestRandomFlRTGCloud wrote 32,304,196 bytes of output. WARNING: Test org.apache.solr.cloud.RollingRestartTest wrote 17,794,455 bytes of output. org.apache.solr.cloud.TestLeaderElectionZkExpiry > classMethod FAILED com.carrotsearch.randomizedtesting.ThreadLeakError: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestLeaderElectionZkExpiry: 1) Thread[id=26934, name=zkConnectionManagerCallback-16456-thread-1-EventThread, state=BLOCKED, group=TGRP-TestLeaderElectionZkExpiry] at app//org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:427) at app//org.apache.solr.cloud.ZkController$1.command(ZkController.java:355) at app//org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:198) at app//org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:58) at app//org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:178) at app//org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:580) at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:555) 2) Thread[id=26936, name=zkConnectionManagerCallback-16456-thread-1-EventThread, state=BLOCKED, group=TGRP-TestLeaderElectionZkExpiry] at app//org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:427) at app//org.apache.solr.cloud.ZkController$1.command(ZkController.java:355) at app//org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:198) at app//org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:58) at app//org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:178) at app//org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:580) at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:555) at __randomizedtesting.SeedInfo.seed([5B4E80CDC497802A]:0) org.apache.solr.cloud.TestLeaderElectionZkExpiry > test suite's output saved to /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.cloud.TestLeaderElectionZkExpiry.txt, copied below: 2> 1675391 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[5B4E80CDC497802A]-worker) [] o.a.s.SolrTestCase Setting 'solr.default.confdir' system property to test-framework derived value of '/home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0/solr/server/solr/configsets/_default/conf' 2> 1675391 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[5B4E80CDC497802A]-worker) [] o.a.s.SolrTestCaseJ4 SecureRandom sanity checks: test.solr.allowed.securerandom=null & java.security.egd=file:/dev/./urandom 2> 1675392 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[5B4E80CDC497802A]-worker) [] o.a.s.u.ErrorLogMuter Closing ErrorLogMuter-regex-403 after mutting 0 log messages 2> 1675392 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[5B4E80CDC497802A]-worker) [] o.a.s.u.ErrorLogMuter Creating ErrorLogMuter-regex-404 for ERROR logs matching regex: ignore_exception 2> 1675393 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[5B4E80CDC497802A]-worker) [] o.a.s.SolrTestCaseJ4 Created dataDir: /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0/solr/core/build/tmp/tests-tmp/solr.cloud.TestLeaderElectionZkExpiry_5B4E80CDC497802A-001/data-dir-160-001 2> 1675393 WARN (SUITE-TestLeaderElectionZkExpiry-seed#[5B4E80CDC497802A]-worker) [] o.a.s.SolrTestCaseJ4 startTrackingSearchers: numOpens=58 numCloses=58 2> 1675393 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[5B4E80CDC497802A]-worker) [] o.a.s.SolrTestCaseJ4 Using PointFields (NUMERIC_POINTS_SYSPROP=true) w/NUMERIC_DOCVALUES_SYSPROP=false 2> 1675394 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[5B4E80CDC497802A]-worker) [] o.a.s.SolrTestCaseJ4 Randomized ssl (false) and clientAuth (false) via: @org.apache.solr.util.RandomizeSSL(reason="", ssl=0.0/0.0, value=0.0/0.0, clientAuth=0.0/0.0) 2> 1675397 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [] o.a.s.SolrTestCaseJ4 ###Starting testLeaderElectionWithZkExpiry 2> 1675915 WARN (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [] o.a.s.c.CoreContainer Not all security plugins configured! authentication=disabled authorization=disabled. Solr is only as secure as you make it. Consider configuring authentication/authorization before exposing Solr to users internal or external. See https://s.apache.org/solrsecurity for more info 2> 1675934 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [] o.a.s.c.CorePropertiesLocator Found 0 core definitions underneath /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0/solr/core/build/tmp/tests-tmp/solr.cloud.TestLeaderElectionZkExpiry_5B4E80CDC497802A-001/testLeaderElectionWithZkExpiry-solr-001 2> 1675935 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [] o.a.s.c.ZkTestServer STARTING ZK TEST SERVER 2> 1675935 INFO (ZkTestServer Run Thread) [] o.a.s.c.ZkTestServer client port: 0.0.0.0/0.0.0.0:0 2> 1675935 INFO (ZkTestServer Run Thread) [] o.a.s.c.ZkTestServer Starting server 2> 1675936 WARN (ZkTestServer Run Thread) [] o.a.z.s.ServerCnxnFactory maxCnxns is not configured, using default value 0. 2> 1676035 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [] o.a.s.c.ZkTestServer start zk server on port: 43269 2> 1676036 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [] o.a.s.c.ZkTestServer waitForServerUp: 127.0.0.1:43269 2> 1676036 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:43269 2> 1676036 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [] o.a.s.c.ZkTestServer connecting to 127.0.0.1 43269 2> 1676037 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2> 1676039 INFO (zkConnectionManagerCallback-16452-thread-1) [] o.a.s.c.c.ConnectionManager zkClient has connected 2> 1676039 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 1676041 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2> 1676042 INFO (zkConnectionManagerCallback-16454-thread-1) [] o.a.s.c.c.ConnectionManager zkClient has connected 2> 1676042 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 1676042 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2> 1676043 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.c.c.ConnectionManager Waiting up to 15000ms for client to connect to ZooKeeper 2> 1676044 INFO (zkConnectionManagerCallback-16456-thread-1) [] o.a.s.c.c.ConnectionManager zkClient has connected 2> 1676044 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 1676057 WARN (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.c.ZkController Contents of zookeeper /security.json are world-readable; consider setting up ACLs as described in https://solr.apache.org/guide/zookeeper-access-control.html 2> 1676059 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.c.DistributedClusterStateUpdater Creating DistributedClusterStateUpdater with useDistributedStateUpdate=false. Solr will be using Overseer based cluster state updates. 2> 1676061 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.c.OverseerElectionContext I am going to be the leader dummy.host.com:8984_solr 2> 1676062 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.c.Overseer Overseer (id=72059167994019842-dummy.host.com:8984_solr-n_0000000000) starting 2> 1676067 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/dummy.host.com:8984_solr 2> 1676067 INFO (OverseerStateUpdate-72059167994019842-dummy.host.com:8984_solr-n_0000000000) [n:dummy.host.com:8984_solr] o.a.s.c.Overseer Starting to work on the main queue : dummy.host.com:8984_solr 2> 1676068 INFO (OverseerStateUpdate-72059167994019842-dummy.host.com:8984_solr-n_0000000000) [n:dummy.host.com:8984_solr] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) 2> 1676070 WARN (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]-SendThread(127.0.0.1:43269)) [] o.a.z.ClientCnxn Session 0x100016e77180002 for sever localhost/127.0.0.1:43269, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100016e77180002, likely server has closed socket 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100016e77180002, likely server has closed socket 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1280) [zookeeper-3.7.0.jar:3.7.0] 2> 1676170 WARN (zkConnectionManagerCallback-16456-thread-1) [] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2b4a125 name: ZooKeeperConnection Watcher:127.0.0.1:43269/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None 2> 1676170 WARN (zkConnectionManagerCallback-16456-thread-1) [] o.a.s.c.c.ConnectionManager zkClient has disconnected 2> 1677575 WARN (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]-SendThread(127.0.0.1:43269)) [] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x100016e77180002 has expired 2> 1677575 WARN (zkConnectionManagerCallback-16456-thread-1) [] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2b4a125 name: ZooKeeperConnection Watcher:127.0.0.1:43269/solr got event WatchedEvent state:Expired type:None path:null path: null type: None 2> 1677575 WARN (zkConnectionManagerCallback-16456-thread-1) [] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper... 2> 1677575 INFO (zkConnectionManagerCallback-16456-thread-1) [] o.a.s.c.Overseer Overseer (id=72059167994019842-dummy.host.com:8984_solr-n_0000000000) closing 2> 1677575 WARN (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]-SendThread(127.0.0.1:43269)) [] o.a.z.ClientCnxn Session 0x100016e77180002 for sever localhost/127.0.0.1:43269, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. 2> => org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x100016e77180002 has expired 2> at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1424) 2> org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x100016e77180002 has expired 2> at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1424) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocket.readConnectResult(ClientCnxnSocket.java:154) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:86) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1280) [zookeeper-3.7.0.jar:3.7.0] 2> 1677575 WARN (OverseerStateUpdate-72059167994019842-dummy.host.com:8984_solr-n_0000000000) [n:dummy.host.com:8984_solr] o.a.s.c.Overseer Solr cannot talk to ZK, exiting Overseer main queue loop 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer/queue 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:2366) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getChildren$4(SolrZkClient.java:378) ~[solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:72) ~[solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:378) ~[solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.cloud.ZkDistributedQueue.fetchZkChildren(ZkDistributedQueue.java:432) ~[main/:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.cloud.ZkDistributedQueue.firstChild(ZkDistributedQueue.java:411) ~[main/:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.cloud.ZkDistributedQueue.peekElements(ZkDistributedQueue.java:466) ~[main/:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.run(Overseer.java:320) [main/:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at java.lang.Thread.run(Thread.java:834) [?:?] 2> 1677575 INFO (OverseerStateUpdate-72059167994019842-dummy.host.com:8984_solr-n_0000000000) [n:dummy.host.com:8984_solr] o.a.s.c.Overseer Overseer Loop exiting : dummy.host.com:8984_solr 2> 1677576 WARN (zkConnectionManagerCallback-16456-thread-1) [] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one... 2> 1677576 WARN (OverseerExitThread) [] o.a.s.c.Overseer Error communicating with ZooKeeper 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /overseer_elect/leader 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ZooKeeper.getData(ZooKeeper.java:1972) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getData$6(SolrZkClient.java:401) ~[solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:72) ~[solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.common.cloud.SolrZkClient.getData(SolrZkClient.java:401) ~[solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.cloud.Overseer$ClusterStateUpdater.checkIfIamStillLeader(Overseer.java:464) [main/:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at java.lang.Thread.run(Thread.java:834) [?:?] 2> 1677576 INFO (zkConnectionManagerCallback-16456-thread-1) [] o.a.s.c.c.ConnectionManager Waiting up to 9223372036854775807ms for client to connect to ZooKeeper 2> 1677577 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager zkClient has connected 2> 1677577 INFO (zkConnectionManagerCallback-16456-thread-1) [] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 1677577 INFO (zkConnectionManagerCallback-16456-thread-1) [] o.a.s.c.ZkController ZooKeeper session re-connected ... refreshing core states after session expiration. 2> 1677586 WARN (zkConnectionManagerCallback-16456-thread-1-SendThread(127.0.0.1:43269)) [] o.a.z.ClientCnxn Session 0x100016e77180003 for sever localhost/127.0.0.1:43269, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100016e77180003, likely server has closed socket 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100016e77180003, likely server has closed socket 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1280) [zookeeper-3.7.0.jar:3.7.0] 2> 1677686 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2b4a125 name: ZooKeeperConnection Watcher:127.0.0.1:43269/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None 2> 1677686 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager zkClient has disconnected 2> 1678898 WARN (zkConnectionManagerCallback-16456-thread-1-SendThread(127.0.0.1:43269)) [] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x100016e77180003 has expired 2> 1678898 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2b4a125 name: ZooKeeperConnection Watcher:127.0.0.1:43269/solr got event WatchedEvent state:Expired type:None path:null path: null type: None 2> 1678898 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper... 2> 1678898 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.Overseer Overseer (id=72059167994019842-dummy.host.com:8984_solr-n_0000000000) closing 2> 1678898 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one... 2> 1678898 WARN (zkConnectionManagerCallback-16456-thread-1-SendThread(127.0.0.1:43269)) [] o.a.z.ClientCnxn Session 0x100016e77180003 for sever localhost/127.0.0.1:43269, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. 2> => org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x100016e77180003 has expired 2> at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1424) 2> org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x100016e77180003 has expired 2> at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1424) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocket.readConnectResult(ClientCnxnSocket.java:154) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:86) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1280) [zookeeper-3.7.0.jar:3.7.0] 2> 1678899 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Waiting up to 9223372036854775807ms for client to connect to ZooKeeper 2> 1678899 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager zkClient has connected 2> 1678899 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 1678899 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.ZkController ZooKeeper session re-connected ... refreshing core states after session expiration. 2> 1678910 WARN (zkConnectionManagerCallback-16456-thread-1-SendThread(127.0.0.1:43269)) [] o.a.z.ClientCnxn Session 0x100016e77180004 for sever localhost/127.0.0.1:43269, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100016e77180004, likely server has closed socket 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100016e77180004, likely server has closed socket 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1280) [zookeeper-3.7.0.jar:3.7.0] 2> 1679010 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2b4a125 name: ZooKeeperConnection Watcher:127.0.0.1:43269/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None 2> 1679010 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager zkClient has disconnected 2> 1680622 WARN (zkConnectionManagerCallback-16456-thread-1-SendThread(127.0.0.1:43269)) [] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x100016e77180004 has expired 2> 1680622 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2b4a125 name: ZooKeeperConnection Watcher:127.0.0.1:43269/solr got event WatchedEvent state:Expired type:None path:null path: null type: None 2> 1680622 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper... 2> 1680622 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.Overseer Overseer (id=72059167994019842-dummy.host.com:8984_solr-n_0000000000) closing 2> 1680622 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one... 2> 1680622 WARN (zkConnectionManagerCallback-16456-thread-1-SendThread(127.0.0.1:43269)) [] o.a.z.ClientCnxn Session 0x100016e77180004 for sever localhost/127.0.0.1:43269, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. 2> => org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x100016e77180004 has expired 2> at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1424) 2> org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x100016e77180004 has expired 2> at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1424) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocket.readConnectResult(ClientCnxnSocket.java:154) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:86) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1280) [zookeeper-3.7.0.jar:3.7.0] 2> 1680623 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Waiting up to 9223372036854775807ms for client to connect to ZooKeeper 2> 1680623 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager zkClient has connected 2> 1680623 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 1680623 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.ZkController ZooKeeper session re-connected ... refreshing core states after session expiration. 2> 1680627 WARN (zkConnectionManagerCallback-16456-thread-1-SendThread(127.0.0.1:43269)) [] o.a.z.ClientCnxn Session 0x100016e77180005 for sever localhost/127.0.0.1:43269, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100016e77180005, likely server has closed socket 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100016e77180005, likely server has closed socket 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1280) [zookeeper-3.7.0.jar:3.7.0] 2> 1680728 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2b4a125 name: ZooKeeperConnection Watcher:127.0.0.1:43269/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None 2> 1680728 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager zkClient has disconnected 2> 1682327 WARN (zkConnectionManagerCallback-16456-thread-1-SendThread(127.0.0.1:43269)) [] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x100016e77180005 has expired 2> 1682327 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2b4a125 name: ZooKeeperConnection Watcher:127.0.0.1:43269/solr got event WatchedEvent state:Expired type:None path:null path: null type: None 2> 1682327 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper... 2> 1682327 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.Overseer Overseer (id=72059167994019842-dummy.host.com:8984_solr-n_0000000000) closing 2> 1682327 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one... 2> 1682327 WARN (zkConnectionManagerCallback-16456-thread-1-SendThread(127.0.0.1:43269)) [] o.a.z.ClientCnxn Session 0x100016e77180005 for sever localhost/127.0.0.1:43269, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. 2> => org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x100016e77180005 has expired 2> at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1424) 2> org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x100016e77180005 has expired 2> at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1424) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocket.readConnectResult(ClientCnxnSocket.java:154) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:86) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1280) [zookeeper-3.7.0.jar:3.7.0] 2> 1682327 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Waiting up to 9223372036854775807ms for client to connect to ZooKeeper 2> 1682328 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager zkClient has connected 2> 1682328 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 1682328 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.ZkController ZooKeeper session re-connected ... refreshing core states after session expiration. 2> 1682336 WARN (zkConnectionManagerCallback-16456-thread-1-SendThread(127.0.0.1:43269)) [] o.a.z.ClientCnxn Session 0x100016e77180006 for sever localhost/127.0.0.1:43269, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100016e77180006, likely server has closed socket 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100016e77180006, likely server has closed socket 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1280) [zookeeper-3.7.0.jar:3.7.0] 2> 1682436 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2b4a125 name: ZooKeeperConnection Watcher:127.0.0.1:43269/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None 2> 1682436 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager zkClient has disconnected 2> 1684401 WARN (zkConnectionManagerCallback-16456-thread-1-SendThread(127.0.0.1:43269)) [] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x100016e77180006 has expired 2> 1684401 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2b4a125 name: ZooKeeperConnection Watcher:127.0.0.1:43269/solr got event WatchedEvent state:Expired type:None path:null path: null type: None 2> 1684401 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper... 2> 1684401 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.Overseer Overseer (id=72059167994019842-dummy.host.com:8984_solr-n_0000000000) closing 2> 1684401 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one... 2> 1684401 WARN (zkConnectionManagerCallback-16456-thread-1-SendThread(127.0.0.1:43269)) [] o.a.z.ClientCnxn Session 0x100016e77180006 for sever localhost/127.0.0.1:43269, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. 2> => org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x100016e77180006 has expired 2> at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1424) 2> org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x100016e77180006 has expired 2> at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1424) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocket.readConnectResult(ClientCnxnSocket.java:154) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:86) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1280) [zookeeper-3.7.0.jar:3.7.0] 2> 1684402 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Waiting up to 9223372036854775807ms for client to connect to ZooKeeper 2> 1684402 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager zkClient has connected 2> 1684403 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 1684403 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.ZkController ZooKeeper session re-connected ... refreshing core states after session expiration. 2> 1684409 WARN (zkConnectionManagerCallback-16456-thread-1-SendThread(127.0.0.1:43269)) [] o.a.z.ClientCnxn Session 0x100016e77180007 for sever localhost/127.0.0.1:43269, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. 2> => EndOfStreamException: Unable to read additional data from server sessionid 0x100016e77180007, likely server has closed socket 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) 2> org.apache.zookeeper.ClientCnxn$EndOfStreamException: Unable to read additional data from server sessionid 0x100016e77180007, likely server has closed socket 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:77) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1280) [zookeeper-3.7.0.jar:3.7.0] 2> 1684509 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2b4a125 name: ZooKeeperConnection Watcher:127.0.0.1:43269/solr got event WatchedEvent state:Disconnected type:None path:null path: null type: None 2> 1684509 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager zkClient has disconnected 2> 1686070 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.c.c.ConnectionManager Waiting up to 30000ms for client to connect to ZooKeeper 2> 1686071 INFO (zkConnectionManagerCallback-16463-thread-1) [] o.a.s.c.c.ConnectionManager zkClient has connected 2> 1686071 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 1686137 WARN (zkConnectionManagerCallback-16456-thread-1-SendThread(127.0.0.1:43269)) [] o.a.z.ClientCnxn Unable to reconnect to ZooKeeper service, session 0x100016e77180007 has expired 2> 1686137 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Watcher org.apache.solr.common.cloud.ConnectionManager@2b4a125 name: ZooKeeperConnection Watcher:127.0.0.1:43269/solr got event WatchedEvent state:Expired type:None path:null path: null type: None 2> 1686137 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Our previous ZooKeeper session was expired. Attempting to reconnect to recover relationship with ZooKeeper... 2> 1686137 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.Overseer Overseer (id=72059167994019842-dummy.host.com:8984_solr-n_0000000000) closing 2> 1686137 WARN (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.DefaultConnectionStrategy Connection expired - starting a new one... 2> 1686137 WARN (zkConnectionManagerCallback-16456-thread-1-SendThread(127.0.0.1:43269)) [] o.a.z.ClientCnxn Session 0x100016e77180007 for sever localhost/127.0.0.1:43269, Closing socket connection. Attempting reconnect except it is a SessionExpiredException. 2> => org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x100016e77180007 has expired 2> at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1424) 2> org.apache.zookeeper.ClientCnxn$SessionExpiredException: Unable to reconnect to ZooKeeper service, session 0x100016e77180007 has expired 2> at org.apache.zookeeper.ClientCnxn$SendThread.onConnected(ClientCnxn.java:1424) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocket.readConnectResult(ClientCnxnSocket.java:154) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doIO(ClientCnxnSocketNIO.java:86) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:350) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1280) [zookeeper-3.7.0.jar:3.7.0] 2> 1686137 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Waiting up to 9223372036854775807ms for client to connect to ZooKeeper 2> 1686138 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager zkClient has connected 2> 1686138 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ConnectionManager Client is connected to ZooKeeper 2> 1686138 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.ZkController ZooKeeper session re-connected ... refreshing core states after session expiration. 2> 1686237 WARN (zkCallback-16455-thread-1) [] o.a.s.c.c.ZkStateReader ZooKeeper watch triggered, but Solr cannot talk to ZK: 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /live_nodes 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) 2> org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorCode = Session expired for /live_nodes 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:134) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.KeeperException.create(KeeperException.java:54) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:2366) ~[zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.solr.common.cloud.SolrZkClient.lambda$getChildren$4(SolrZkClient.java:378) ~[solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:72) ~[solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:378) ~[solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.common.cloud.ZkStateReader.refreshLiveNodes(ZkStateReader.java:712) ~[solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.refreshAndWatch(ZkStateReader.java:1509) [solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.common.cloud.ZkStateReader$LiveNodeWatcher.process(ZkStateReader.java:1504) [solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.common.cloud.SolrZkClient$ProcessWatchWithExecutor.lambda$process$1(SolrZkClient.java:952) [solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [?:?] 2> at java.util.concurrent.FutureTask.run(FutureTask.java:264) [?:?] 2> at org.apache.solr.common.util.ExecutorUtil$MDCAwareThreadPoolExecutor.lambda$execute$0(ExecutorUtil.java:259) [solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [?:?] 2> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [?:?] 2> at java.lang.Thread.run(Thread.java:834) [?:?] 2> 1686238 INFO (zkConnectionManagerCallback-16456-thread-1) [] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (1) -> (0) 2> 1686241 INFO (zkConnectionManagerCallback-16456-thread-1) [] o.a.s.c.Overseer Overseer (id=72059167994019842-dummy.host.com:8984_solr-n_0000000000) closing 2> 1686241 INFO (zkConnectionManagerCallback-16456-thread-1) [] o.a.s.c.Overseer Overseer (id=72059167994019842-dummy.host.com:8984_solr-n_0000000000) closing 2> 1686241 INFO (zkConnectionManagerCallback-16456-thread-1) [] o.a.s.c.Overseer Overseer (id=72059167994019842-dummy.host.com:8984_solr-n_0000000000) closing 2> 1686242 INFO (zkConnectionManagerCallback-16456-thread-1) [] o.a.s.c.Overseer Overseer (id=72059167994019842-dummy.host.com:8984_solr-n_0000000000) closing 2> 1686242 INFO (zkConnectionManagerCallback-16456-thread-1) [] o.a.s.c.OverseerElectionContext I am going to be the leader dummy.host.com:8984_solr 2> 1686243 INFO (zkConnectionManagerCallback-16456-thread-1) [n:dummy.host.com:8984_solr] o.a.s.c.Overseer Overseer (id=72059167994019849-dummy.host.com:8984_solr-n_0000000001) starting 2> 1686243 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.c.TestLeaderElectionZkExpiry Time=24026970526764 Overseer leader is = dummy.host.com:8984_solr 2> 1686243 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.c.ZkController Remove node as live in ZooKeeper:/live_nodes/dummy.host.com:8984_solr 2> 1686244 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.c.ZkController Publish this node as DOWN... 2> 1686244 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.c.ZkController Publish node=dummy.host.com:8984_solr as DOWN 2> 1686250 INFO (closeThreadPool-16465-thread-1-processing-dummy.host.com:8984_solr) [n:dummy.host.com:8984_solr] o.a.s.c.Overseer Overseer (id=72059167994019849-dummy.host.com:8984_solr-n_0000000001) closing 2> 1686250 INFO (zkConnectionManagerCallback-16456-thread-1) [n:dummy.host.com:8984_solr] o.a.s.c.ZkController Register node as live in ZooKeeper:/live_nodes/dummy.host.com:8984_solr 2> 1686250 INFO (OverseerStateUpdate-72059167994019849-dummy.host.com:8984_solr-n_0000000001) [n:dummy.host.com:8984_solr] o.a.s.c.Overseer According to ZK I (id=72059167994019849-dummy.host.com:8984_solr-n_0000000001) am no longer a leader. propsId=null 2> 1686250 INFO (OverseerStateUpdate-72059167994019849-dummy.host.com:8984_solr-n_0000000001) [n:dummy.host.com:8984_solr] o.a.s.c.Overseer Starting to work on the main queue : dummy.host.com:8984_solr 2> 1686250 INFO (OverseerStateUpdate-72059167994019849-dummy.host.com:8984_solr-n_0000000001) [n:dummy.host.com:8984_solr] o.a.s.c.Overseer Overseer Loop exiting : dummy.host.com:8984_solr 2> 1686250 INFO (OverseerCollectionConfigSetProcessor-72059167994019849-dummy.host.com:8984_solr-n_0000000001) [] o.a.s.c.OverseerTaskProcessor According to ZK I (id=72059167994019849-dummy.host.com:8984_solr-n_0000000001) am no longer a leader. propsId=null 2> 1686250 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ZkStateReader Updated live nodes from ZooKeeper... (0) -> (1) 2> 1686250 INFO (closeThreadPool-16465-thread-2-processing-dummy.host.com:8984_solr) [n:dummy.host.com:8984_solr] o.a.s.c.Overseer Overseer (id=72059167994019849-dummy.host.com:8984_solr-n_0000000001) closing 2> 1686251 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.Overseer Overseer (id=72059167994019849-dummy.host.com:8984_solr-n_0000000001) closing 2> 1686251 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.Overseer Overseer (id=72059167994019849-dummy.host.com:8984_solr-n_0000000001) closing 2> 1686251 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.Overseer Overseer (id=72059167994019849-dummy.host.com:8984_solr-n_0000000001) closing 2> 1686251 INFO (zkConnectionManagerCallback-16456-thread-1) [n:dummy.host.com:8984_solr] o.a.s.c.c.DefaultConnectionStrategy Reconnected to ZooKeeper 2> 1686251 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.Overseer Overseer (id=72059167994019849-dummy.host.com:8984_solr-n_0000000001) closing 2> 1686251 INFO (zkConnectionManagerCallback-16456-thread-1) [n:dummy.host.com:8984_solr] o.a.s.c.c.ConnectionManager zkClient Connected: true 2> 1686251 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.Overseer Overseer (id=72059167994019849-dummy.host.com:8984_solr-n_0000000001) closing 2> 1686251 INFO (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.Overseer Overseer (id=72059167994019849-dummy.host.com:8984_solr-n_0000000001) closing 2> 1686438 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.c.Overseer Overseer (id=72059167994019849-dummy.host.com:8984_solr-n_0000000001) closing 2> 1686438 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1063749861 2> 1686438 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.c.TransientSolrCoreCacheDefault Allocating transient core cache for max 2147483647 cores with initial capacity of 1024 2> 1686438 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null 2> 1686443 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null 2> 1686446 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null 2> 1686548 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.c.ZkTestServer Shutting down ZkTestServer. 2> 1686752 WARN (ZkTestServer Run Thread) [] o.a.s.c.ZkTestServer Watch limit violations: 2> Maximum concurrent create/delete watches above limit: 2> 2> 5 /solr/clusterprops.json 2> 4 /solr/aliases.json 2> 4 /solr/security.json 2> 2> Maximum concurrent children watches above limit: 2> 2> 6 /solr/live_nodes 2> 5 /solr/collections 2> 2> 1686754 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.c.ZkTestServer waitForServerDown: 127.0.0.1:43269 2> 1686754 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.c.ZkTestServer parse host and port list: 127.0.0.1:43269 2> 1686754 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.c.ZkTestServer connecting to 127.0.0.1 43269 2> 1686755 INFO (TEST-TestLeaderElectionZkExpiry.testLeaderElectionWithZkExpiry-seed#[5B4E80CDC497802A]) [n:dummy.host.com:8984_solr] o.a.s.SolrTestCaseJ4 ###Ending testLeaderElectionWithZkExpiry 2> 1686756 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[5B4E80CDC497802A]-worker) [n:dummy.host.com:8984_solr] o.a.s.SolrTestCaseJ4 ###deleteCore 2> 1686756 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[5B4E80CDC497802A]-worker) [n:dummy.host.com:8984_solr] o.a.s.c.CoreContainer Shutting down CoreContainer instance=1063749861 2> 1686756 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[5B4E80CDC497802A]-worker) [n:dummy.host.com:8984_solr] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.node tag=null 2> 1686756 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[5B4E80CDC497802A]-worker) [n:dummy.host.com:8984_solr] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jvm tag=null 2> 1686756 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[5B4E80CDC497802A]-worker) [n:dummy.host.com:8984_solr] o.a.s.m.SolrMetricManager Closing metric reporters for registry=solr.jetty tag=null 2> 1686757 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[5B4E80CDC497802A]-worker) [n:dummy.host.com:8984_solr] o.a.s.u.ErrorLogMuter Closing ErrorLogMuter-regex-404 after mutting 0 log messages 2> 1686757 INFO (SUITE-TestLeaderElectionZkExpiry-seed#[5B4E80CDC497802A]-worker) [n:dummy.host.com:8984_solr] o.a.s.u.ErrorLogMuter Creating ErrorLogMuter-regex-405 for ERROR logs matching regex: ignore_exception 2> Mar 19, 2022 4:20:55 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks 2> WARNING: Will linger awaiting termination of 2 leaked thread(s). 2> Mar 19, 2022 4:20:55 AM com.carrotsearch.randomizedtesting.ThreadLeakControl checkThreadLeaks 2> SEVERE: 2 threads leaked from SUITE scope at org.apache.solr.cloud.TestLeaderElectionZkExpiry: 2> 1) Thread[id=26934, name=zkConnectionManagerCallback-16456-thread-1-EventThread, state=BLOCKED, group=TGRP-TestLeaderElectionZkExpiry] 2> at app//org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:427) 2> at app//org.apache.solr.cloud.ZkController$1.command(ZkController.java:355) 2> at app//org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:198) 2> at app//org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:58) 2> at app//org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:178) 2> at app//org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:580) 2> at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:555) 2> 2) Thread[id=26936, name=zkConnectionManagerCallback-16456-thread-1-EventThread, state=BLOCKED, group=TGRP-TestLeaderElectionZkExpiry] 2> at app//org.apache.solr.common.cloud.ZkStateReader.createClusterStateWatchersAndUpdate(ZkStateReader.java:427) 2> at app//org.apache.solr.cloud.ZkController$1.command(ZkController.java:355) 2> at app//org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:198) 2> at app//org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:58) 2> at app//org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:178) 2> at app//org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:580) 2> at app//org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:555) 2> Mar 19, 2022 4:20:55 AM com.carrotsearch.randomizedtesting.ThreadLeakControl tryToInterruptAll 2> INFO: Starting to interrupt leaked threads: 2> 1) Thread[id=26934, name=zkConnectionManagerCallback-16456-thread-1-EventThread, state=BLOCKED, group=TGRP-TestLeaderElectionZkExpiry] 2> 2) Thread[id=26936, name=zkConnectionManagerCallback-16456-thread-1-EventThread, state=BLOCKED, group=TGRP-TestLeaderElectionZkExpiry] 2> 1687751 ERROR (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.ZkController 2> => org.apache.solr.common.AlreadyClosedException 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70) 2> org.apache.solr.common.AlreadyClosedException: null 2> at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:70) ~[solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.common.cloud.SolrZkClient.getChildren(SolrZkClient.java:378) ~[solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:277) ~[main/:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.cloud.LeaderElector.joinElection(LeaderElector.java:218) ~[main/:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.cloud.ZkController$1.command(ZkController.java:382) [main/:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.common.cloud.ConnectionManager$1.update(ConnectionManager.java:198) [solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.common.cloud.DefaultConnectionStrategy.reconnect(DefaultConnectionStrategy.java:58) [solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.solr.common.cloud.ConnectionManager.process(ConnectionManager.java:178) [solr-solrj-9.0.0-SNAPSHOT.jar:9.0.0-SNAPSHOT (not a git checkout) [snapshot build, details omitted]] 2> at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:580) [zookeeper-3.7.0.jar:3.7.0] 2> at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:555) [zookeeper-3.7.0.jar:3.7.0] 2> 1687751 ERROR (zkConnectionManagerCallback-16456-thread-1-EventThread) [] o.a.s.c.c.ZkStateReader Error reading cluster properties from zookeeper 2> => org.apache.zookeeper.KeeperException$SessionExpiredException: KeeperErrorC [...truncated too long message...] > Task :solr:test-framework:copyTestResources NO-SOURCE > Task :solr:test-framework:processTestResources NO-SOURCE > Task :solr:test-framework:testClasses > Task :solr:test-framework:test :solr:test-framework:test (SUCCESS): 15 test(s) > Task :solr:test-framework:wipeTaskTemp > Task :solr:webapp:compileJava NO-SOURCE > Task :solr:webapp:processResources NO-SOURCE > Task :solr:webapp:classes UP-TO-DATE > Task :solr:webapp:compileTestJava NO-SOURCE > Task :solr:webapp:copyTestResources NO-SOURCE > Task :solr:webapp:processTestResources NO-SOURCE > Task :solr:webapp:testClasses UP-TO-DATE > Task :solr:webapp:test NO-SOURCE > Task :solr:webapp:wipeTaskTemp > Task :solr:modules:analysis-extras:compileTestJava Note: /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0/solr/modules/analysis-extras/src/test/org/apache/solr/schema/TestICUCollationFieldUDVAS.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:analysis-extras:copyTestResources NO-SOURCE > Task :solr:modules:analysis-extras:processTestResources > Task :solr:modules:analysis-extras:testClasses > Task :solr:modules:analysis-extras:test :solr:modules:analysis-extras:test (SUCCESS): 31 test(s) > Task :solr:modules:analysis-extras:wipeTaskTemp > Task :solr:modules:analytics:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:analytics:processResources NO-SOURCE > Task :solr:modules:analytics:classes > Task :solr:modules:analytics:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:analytics:copyTestResources NO-SOURCE > Task :solr:modules:analytics:processTestResources > Task :solr:modules:analytics:testClasses > Task :solr:modules:analytics:test :solr:modules:analytics:test (SUCCESS): 472 test(s) > Task :solr:modules:analytics:wipeTaskTemp > Task :solr:modules:clustering:compileJava > Task :solr:modules:clustering:processResources NO-SOURCE > Task :solr:modules:clustering:classes > Task :solr:modules:clustering:compileTestJava > Task :solr:modules:clustering:copyTestResources NO-SOURCE > Task :solr:modules:clustering:processTestResources > Task :solr:modules:clustering:testClasses > Task :solr:core:test WARNING: Test org.apache.solr.search.TestRangeQuery wrote 20,217,807 bytes of output. > Task :solr:modules:clustering:test :solr:modules:clustering:test (SUCCESS): 15 test(s) > Task :solr:modules:clustering:wipeTaskTemp > Task :solr:modules:extraction:compileJava Note: /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0/solr/modules/extraction/src/java/org/apache/solr/handler/extraction/ExtractingDocumentLoader.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:extraction:processResources > Task :solr:modules:extraction:classes > Task :solr:modules:extraction:compileTestJava Note: /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0/solr/modules/extraction/src/test/org/apache/solr/handler/extraction/ExtractingRequestHandlerTest.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:extraction:copyTestResources NO-SOURCE > Task :solr:modules:extraction:processTestResources > Task :solr:modules:extraction:testClasses > Task :solr:modules:extraction:test :solr:modules:extraction:test (SUCCESS): 20 test(s) > Task :solr:modules:extraction:wipeTaskTemp > Task :solr:modules:gcs-repository:compileJava > Task :solr:modules:gcs-repository:processResources NO-SOURCE > Task :solr:modules:gcs-repository:classes > Task :solr:modules:gcs-repository:compileTestJava Note: /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0/solr/modules/gcs-repository/src/test/org/apache/solr/gcs/ConcurrentDelegatingStorage.java uses or overrides a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:gcs-repository:copyTestResources NO-SOURCE > Task :solr:modules:gcs-repository:processTestResources > Task :solr:modules:gcs-repository:testClasses > Task :solr:modules:gcs-repository:test :solr:modules:gcs-repository:test (SUCCESS): 14 test(s) > Task :solr:modules:gcs-repository:wipeTaskTemp > Task :solr:modules:hadoop-auth:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:hadoop-auth:processResources NO-SOURCE > Task :solr:modules:hadoop-auth:classes > Task :solr:modules:hadoop-auth:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:hadoop-auth:copySolrCoreTestResources > Task :solr:modules:hadoop-auth:copyTestResources NO-SOURCE > Task :solr:modules:hadoop-auth:processTestResources > Task :solr:modules:hadoop-auth:testClasses > Task :solr:modules:hadoop-auth:test :solr:modules:hadoop-auth:test (SUCCESS): 55 test(s), 1 skipped > Task :solr:modules:hadoop-auth:wipeTaskTemp > Task :solr:modules:hdfs:compileJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:hdfs:processResources NO-SOURCE > Task :solr:modules:hdfs:classes > Task :solr:modules:hdfs:compileTestJava Note: Some input files use or override a deprecated API. Note: Recompile with -Xlint:deprecation for details. > Task :solr:modules:hdfs:copySolrCoreTestResources > Task :solr:modules:hdfs:copyTestResources NO-SOURCE > Task :solr:modules:hdfs:processTestResources > Task :solr:modules:hdfs:testClasses > Task :solr:modules:hdfs:test > Task :solr:core:test :solr:core:test (FAILURE): 4626 test(s), 2 failure(s), 132 skipped 4626 tests completed, 2 failed, 132 skipped > Task :solr:core:test FAILED > Task :solr:core:wipeTaskTemp > Task :solr:modules:hdfs:test WARNING: Test org.apache.solr.hdfs.cloud.HdfsChaosMonkeyNothingIsSafeTest wrote 49,107,948 bytes of output. WARNING: Test org.apache.solr.hdfs.cloud.HdfsTlogReplayBufferedWhileIndexingTest wrote 19,114,873 bytes of output. WARNING: Test org.apache.solr.hdfs.cloud.HdfsBasicDistributedZkTest wrote 52,818,622 bytes of output. WARNING: Test org.apache.solr.hdfs.cloud.StressHdfsTest wrote 30,081,490 bytes of output. :solr:modules:hdfs:test (SUCCESS): 101 test(s), 9 skipped > Task :solr:modules:hdfs:wipeTaskTemp ERROR: The following test(s) have failed: - org.apache.solr.cloud.TestLeaderElectionZkExpiry.classMethod (:solr:core) Test output: /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.cloud.TestLeaderElectionZkExpiry.txt Reproduce with: gradlew :solr:core:test --tests "org.apache.solr.cloud.TestLeaderElectionZkExpiry.classMethod" -Ptests.jvms=2 -Ptests.jvmargs=-XX:TieredStopAtLevel=1 -Ptests.seed=5B4E80CDC497802A -Ptests.nightly=true -Ptests.badapples=false -Ptests.file.encoding=ISO-8859-1 - org.apache.solr.search.TestReRankQParserPlugin.testMinExactCount (:solr:core) Test output: /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0/solr/core/build/test-results/test/outputs/OUTPUT-org.apache.solr.search.TestReRankQParserPlugin.txt Reproduce with: gradlew :solr:core:test --tests "org.apache.solr.search.TestReRankQParserPlugin.testMinExactCount" -Ptests.jvms=2 -Ptests.jvmargs=-XX:TieredStopAtLevel=1 -Ptests.seed=5B4E80CDC497802A -Ptests.nightly=true -Ptests.badapples=false -Ptests.file.encoding=ISO-8859-1 FAILURE: Build failed with an exception. * What went wrong: Execution failed for task ':solr:core:test'. > There were failing tests. See the results at: > file:///home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0/solr/core/build/test-results/test/ * Try: Run with --stacktrace option to get the stack trace. Run with --info or --debug option to get more log output. Run with --scan to get full insights. * Get more help at https://help.gradle.org BUILD FAILED in 1h 40m 52s 80 actionable tasks: 75 executed, 5 up-to-date Traceback (most recent call last): File "dev-tools/scripts/smokeTestRelease.py", line 1157, in <module> main() File "dev-tools/scripts/smokeTestRelease.py", line 1086, in main smokeTest(c.java, c.url, c.revision, c.version, c.tmp_dir, c.is_signed, c.local_keys, ' '.join(c.test_args), File "dev-tools/scripts/smokeTestRelease.py", line 1145, in smokeTest unpackAndVerify(java, tmpDir, 'solr-%s-src.tgz' % version, gitRevision, version, testArgs) File "dev-tools/scripts/smokeTestRelease.py", line 540, in unpackAndVerify verifyUnpacked(java, artifact, unpackPath, gitRevision, version, testArgs) File "dev-tools/scripts/smokeTestRelease.py", line 628, in verifyUnpacked java.run_java11('./gradlew --no-daemon test %s' % testArgs, '%s/test.log' % unpackPath) File "dev-tools/scripts/smokeTestRelease.py", line 996, in run_java run('%s; %s' % (cmd_prefix, cmd), logfile) File "dev-tools/scripts/smokeTestRelease.py", line 472, in run raise RuntimeError('command "%s" failed; see log file %s' % (command, logPath)) RuntimeError: command "export JAVA_HOME="/home/jenkins/tools/java/latest11" PATH="/home/jenkins/tools/java/latest11/bin:$PATH" JAVACMD="/home/jenkins/tools/java/latest11/bin/java"; ./gradlew --no-daemon test -Dtests.nightly=true -Dtests.badapples=false " failed; see log file /home/jenkins/jenkins-slave/workspace/Solr/Solr-Smoketest-9.0@tmp/smoke_1647661695/unpack/solr-9.0.0/test.log Build step 'Run with timeout' marked build as failure Email was triggered for: Failure - Any Sending email for trigger: Failure - Any
--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
