Marco - thank you. That's good news.
The plan is to have a Jenkins pipeline that makes a docker container
which gets cached on the ASF Jenkins nodes, not built from scratch each
run, then run the Jena build in that container. We can configure the
container appropriately.
The Dockerfile file will be in the jena code repo.
I don't know what we can do about other systems except document the
situation.
Much reading the Jenkins documentation!
Andy
On 15/07/2024 14:27, Marco Neumann wrote:
Ok, yes very impressive Andy, in a new system it is able to install the
required components automatically.
All you need is the OS and the base system: jdk, maven and git etc
I also had to change the cypress prerequisites for my vm repo a little
from
$apt-get install libgtk2.0-0 libgtk-3-0 libgbm-dev libnotify-dev libnss3
libxss1 libasound2 libxtst6 xauth xvfb
to
$sudo apt-get install libgtk2.0-0 libgtk-3-0 libgbm-dev libnotify-dev
libnss3 libxss1 libasound2t64 libxtst6 xauth xvfb
so I presume that in the production systems we have some of the components
installed that prevent further automatic upgrades in my initial tests.
Thank You,
Marco
[INFO] -------------------< org.apache.jena:jena-fuseki-ui
-------------------
[INFO] Building Apache Jena - Fuseki UI 5.2.0-SNAPSHOT
[25/47]
[INFO] from jena-fuseki2/jena-fuseki-ui/pom.xml
[INFO] --------------------------------[ jar
]---------------------------------
Downloading from central:
https://repo.maven.apache.org/maven2/com/github/eirslett/frontend-maven-plugin/1.15.0/frontend-maven-plugin-1.15.0.pom
Downloaded from central:
https://repo.maven.apache.org/maven2/com/github/eirslett/frontend-maven-plugin/1.15.0/frontend-maven-plugin-1.15.0.pom
(4.9 kB at 41 kB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/com/github/eirslett/frontend-plugins/1.15.0/frontend-plugins-1.15.0.pom
Downloaded from central:
https://repo.maven.apache.org/maven2/com/github/eirslett/frontend-plugins/1.15.0/frontend-plugins-1.15.0.pom
(7.2 kB at 196 kB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/com/github/eirslett/frontend-maven-plugin/1.15.0/frontend-maven-plugin-1.15.0.jar
Downloaded from central:
https://repo.maven.apache.org/maven2/com/github/eirslett/frontend-maven-plugin/1.15.0/frontend-maven-plugin-1.15.0.jar
(46 kB at 1.0 MB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/org/codehaus/mojo/build-helper-maven-plugin/3.6.0/build-helper-maven-plugin-3.6.0.pom
Downloaded from central:
https://repo.maven.apache.org/maven2/org/codehaus/mojo/build-helper-maven-plugin/3.6.0/build-helper-maven-plugin-3.6.0.pom
(8.1 kB at 262 kB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/org/codehaus/mojo/mojo-parent/82/mojo-parent-82.pom
Downloaded from central:
https://repo.maven.apache.org/maven2/org/codehaus/mojo/mojo-parent/82/mojo-parent-82.pom
(36 kB at 1.5 MB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/org/codehaus/mojo/build-helper-maven-plugin/3.6.0/build-helper-maven-plugin-3.6.0.jar
Downloaded from central:
https://repo.maven.apache.org/maven2/org/codehaus/mojo/build-helper-maven-plugin/3.6.0/build-helper-maven-plugin-3.6.0.jar
(72 kB at 2.8 MB/s)
[INFO]
[INFO] --- clean:3.4.0:clean (default-clean) @ jena-fuseki-ui ---
[INFO]
[INFO] --- enforcer:3.5.0:enforce (enforce-maven-version) @ jena-fuseki-ui
---
[INFO]
[INFO] --- enforcer:3.5.0:enforce (enforce-java-version) @ jena-fuseki-ui
---
[INFO]
[INFO] --- enforcer:3.5.0:enforce (enforce) @ jena-fuseki-ui ---
[INFO] Rule 0:
org.apache.maven.enforcer.rules.dependency.DependencyConvergence passed
[INFO] Rule 1: org.apache.maven.enforcer.rules.RequirePluginVersions passed
[INFO] Rule 2:
org.apache.maven.enforcer.rules.dependency.RequireReleaseDeps passed
[INFO]
[INFO] --- remote-resources:3.2.0:process (process-resource-bundles) @
jena-fuseki-ui ---
[INFO] Preparing remote bundle
org.apache.apache.resources:apache-jar-resource-bundle:1.5
[INFO] Copying 3 resources from 1 bundle.
[INFO]
[INFO] --- frontend:1.15.0:install-node-and-yarn (install node and yarn) @
jena-fuseki-ui ---
Downloading from central:
https://repo.maven.apache.org/maven2/com/github/eirslett/frontend-plugin-core/1.15.0/frontend-plugin-core-1.15.0.pom
Downloaded from central:
https://repo.maven.apache.org/maven2/com/github/eirslett/frontend-plugin-core/1.15.0/frontend-plugin-core-1.15.0.pom
(3.2 kB at 154 kB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.13.0/jackson-core-2.13.0.pom
Downloaded from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.13.0/jackson-core-2.13.0.pom
(5.5 kB at 231 kB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-base/2.13.0/jackson-base-2.13.0.pom
Downloaded from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-base/2.13.0/jackson-base-2.13.0.pom
(9.7 kB at 463 kB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-bom/2.13.0/jackson-bom-2.13.0.pom
Downloaded from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-bom/2.13.0/jackson-bom-2.13.0.pom
(17 kB at 613 kB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.13/jackson-parent-2.13.pom
Downloaded from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.13/jackson-parent-2.13.pom
(7.4 kB at 309 kB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/43/oss-parent-43.pom
Downloaded from central:
https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/43/oss-parent-43.pom
(24 kB at 1.0 MB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.13.4.2/jackson-databind-2.13.4.2.pom
Downloaded from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.13.4.2/jackson-databind-2.13.4.2.pom
(17 kB at 752 kB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-base/2.13.4/jackson-base-2.13.4.pom
Downloaded from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-base/2.13.4/jackson-base-2.13.4.pom
(9.9 kB at 520 kB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-bom/2.13.4/jackson-bom-2.13.4.pom
Downloaded from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-bom/2.13.4/jackson-bom-2.13.4.pom
(17 kB at 599 kB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.13.4/jackson-annotations-2.13.4.pom
Downloaded from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.13.4/jackson-annotations-2.13.4.pom
(6.1 kB at 290 kB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.13.4/jackson-core-2.13.4.pom
Downloaded from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.13.4/jackson-core-2.13.4.pom
(5.5 kB at 231 kB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom
Downloaded from central:
https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom
(20 kB at 895 kB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.3/commons-exec-1.3.pom
Downloaded from central:
https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.3/commons-exec-1.3.pom
(11 kB at 550 kB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/35/commons-parent-35.pom
Downloaded from central:
https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/35/commons-parent-35.pom
(58 kB at 2.1 MB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.5/slf4j-api-1.7.5.pom
Downloaded from central:
https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.5/slf4j-api-1.7.5.pom
(2.7 kB at 96 kB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.5/slf4j-parent-1.7.5.pom
Downloaded from central:
https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.5/slf4j-parent-1.7.5.pom
(12 kB at 537 kB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/1.5.8/plexus-utils-1.5.8.pom
Downloaded from central:
https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/1.5.8/plexus-utils-1.5.8.pom
(8.1 kB at 424 kB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/com/github/eirslett/frontend-plugin-core/1.15.0/frontend-plugin-core-1.15.0.jar
Downloaded from central:
https://repo.maven.apache.org/maven2/com/github/eirslett/frontend-plugin-core/1.15.0/frontend-plugin-core-1.15.0.jar
(95 kB at 3.2 MB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.13.0/jackson-core-2.13.0.jar
Downloading from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.13.4.2/jackson-databind-2.13.4.2.jar
Downloading from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.13.4/jackson-annotations-2.13.4.jar
Downloading from central:
https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar
Downloading from central:
https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.3/commons-exec-1.3.jar
Downloaded from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.13.0/jackson-core-2.13.0.jar
(375 kB at 4.4 MB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar
Downloaded from central:
https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar
(329 kB at 2.4 MB/s)
Downloading from central:
https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.5/slf4j-api-1.7.5.jar
Downloaded from central:
https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.5/slf4j-api-1.7.5.jar
(26 kB at 158 kB/s)
Downloaded from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.13.4/jackson-annotations-2.13.4.jar
(76 kB at 445 kB/s)
Downloaded from central:
https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.3/commons-exec-1.3.jar
(54 kB at 322 kB/s)
Downloaded from central:
https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar
(1.0 MB at 2.8 MB/s)
Downloaded from central:
https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.13.4.2/jackson-databind-2.13.4.2.jar
(1.5 MB at 3.2 MB/s)
[INFO] Installing node version v20.11.0
[INFO] Downloading
https://nodejs.org/dist/v20.11.0/node-v20.11.0-linux-x64.tar.gz to
/home/lotico/.m2/repository/com/github/eirslett/node/20.11.0/node-20.11.0-linux-x64.tar.gz
[INFO] No proxies configured
[INFO] No proxy was configured, downloading directly
[INFO] Unpacking
/home/lotico/.m2/repository/com/github/eirslett/node/20.11.0/node-20.11.0-linux-x64.tar.gz
into /home/lotico/git/jena/jena-fuseki2/jena-fuseki-ui/node/tmp
[INFO] Copying node binary from
/home/lotico/git/jena/jena-fuseki2/jena-fuseki-ui/node/tmp/node-v20.11.0-linux-x64/bin/node
to /home/lotico/git/jena/jena-fuseki2/jena-fuseki-ui/node/node
[INFO] Installed node locally.
[INFO] Installing Yarn version v1.22.17
[INFO] Downloading
https://github.com/yarnpkg/yarn/releases/download/v1.22.17/yarn-v1.22.17.tar.gz
to
/home/lotico/.m2/repository/com/github/eirslett/yarn/1.22.17/yarn-1.22.17.tar.gz
[INFO] No proxies configured
[INFO] No proxy was configured, downloading directly
[INFO] Unpacking
/home/lotico/.m2/repository/com/github/eirslett/yarn/1.22.17/yarn-1.22.17.tar.gz
into /home/lotico/git/jena/jena-fuseki2/jena-fuseki-ui/node/yarn
[INFO] Installed Yarn locally.
[INFO]
[INFO] --- frontend:1.15.0:yarn (yarn install) @ jena-fuseki-ui ---
[INFO] Running 'yarn install --frozen-lockfile' in
/home/lotico/git/jena/jena-fuseki2/jena-fuseki-ui
[INFO] yarn install v1.22.17
[INFO] [1/4] Resolving packages...
[INFO] [2/4] Fetching packages...
[INFO] [3/4] Linking dependencies...
[INFO] warning " > @cypress/code-coverage@3.12.41" has unmet peer
dependency "@babel/core@^7.0.1".
[INFO] warning " > @cypress/code-coverage@3.12.41" has unmet peer
dependency "@babel/preset-env@^7.0.0".
[INFO] warning " > @cypress/code-coverage@3.12.41" has unmet peer
dependency "babel-loader@^8.3 || ^9".
[INFO] warning " > @cypress/code-coverage@3.12.41" has unmet peer
dependency "webpack@^4 || ^5".
[INFO] warning "@cypress/code-coverage > @cypress/webpack-preprocessor@6.0.0"
has unmet peer dependency "@babel/core@^7.0.1".
[INFO] warning "@cypress/code-coverage > @cypress/webpack-preprocessor@6.0.0"
has unmet peer dependency "@babel/preset-env@^7.0.0".
[INFO] warning "@cypress/code-coverage > @cypress/webpack-preprocessor@6.0.0"
has unmet peer dependency "babel-loader@^8.3 || ^9".
[INFO] warning "@cypress/code-coverage > @cypress/webpack-preprocessor@6.0.0"
has unmet peer dependency "webpack@^4 || ^5".
[INFO] [4/4] Building fresh packages...
On Sun, Jul 14, 2024 at 4:36 PM Andy Seaborne <a...@apache.org> wrote:
Hi Marco,
The list of prerequisites for Cypress is list at:
https://docs.cypress.io/guides/getting-started/installing-cypress#Linux-Prerequisites
They are all an single "apt install". if you have moment, I'd be
grateful if you could try that.
I installed nodejs with the exact version you have, and the build still
went fine so it isn't looking like node version leakage.
Andy
On 13/07/2024 20:41, Marco Neumann wrote:
Hi Andy,
I don't recall the cypress related error but I had to install quite a few
new packages (cross-env, mocha, run-script-os ) to get the tests over the
line.
Many of the new features go beyond my current use cases for jena so it
will
take a while before I encounter any issues, in particular if they don't
interfere with use of the base system.
Marco
On Sat, Jul 13, 2024 at 4:02 PM Andy Seaborne <a...@apache.org> wrote:
On 13/07/2024 10:56, Marco Neumann wrote:
[X] +1
but not deployed yet
had to install xvfb, pnpm and mocha etc to get it pass the Apache Jena
-
Fuseki UI tests
mvn clean install
Hi Marco - thank you for trying it out.
Did the build output also say "[INFO] [TESTS] Cypress failed to start."
earlier in the log?
"""
[INFO] [TESTS] [STARTED] Task without title.
[INFO] [TESTS] [FAILED] Cypress failed to start.
[INFO] [TESTS] [FAILED]
[INFO] [TESTS] [FAILED] This may be due to a missing library or
dependency. https://on.cypress.io/required-dependencies
[INFO] [TESTS] [FAILED]
"""
The ASF Jenkins instance is experiencing this error and it appears to be
due to dependench related. I this not clear why it has started (the PR
where it started doesn't on the surface seem to a likely looking
change).
> Node v18.19.1
Hmm - the POM file says
<node.version>v20.11.0</node.version>
so that seems to only apply to the build, not running tests.
It could be that the Jena build is now running on older environments -
the ASF Jenkins build fleet has about 30 Ubuntu servers (!!) for general
use and from mixed donations.
The problem is noted in the pre-release thread:
https://lists.apache.org/thread/drfj9lmh65gcj6d609tx52qdb1n4wrxc
and because the build is passing on github actions and local machine, it
seems better to get the release out and come back and fix it.
Jena ought to move to using Jenkins pipeline with a docker image so that
the build to get isolation. We fairly recently had problems with nodejs
versions on older build servers but in that case nodejs was updated.
Andy
[ERROR] Failed to execute goal
com.github.eirslett:frontend-maven-plugin:1.15.0:yarn (yarn run
test:e2e)
on project jena-fuseki-ui: Failed to run task: 'yarn run test:e2e'
failed.
org.apache.commons.exec.ExecuteException: Process exited with an
error: 1
(Exit value: 1) -> [Help 1]
[INFO] Reactor Summary for Apache Jena 5.1.0:
[INFO]
[INFO] Apache Jena ........................................ SUCCESS [
9.543 s]
[INFO] Apache Jena - IRI .................................. SUCCESS [
2.671 s]
[INFO] Apache Jena - Base ................................. SUCCESS [
3.686 s]
[INFO] Apache Jena - Core ................................. SUCCESS [
28.747 s]
[INFO] Apache Jena - ARQ .................................. SUCCESS [
25.787 s]
[INFO] Apache Jena - ONTAPI ............................... SUCCESS [
10.581 s]
[INFO] Apache Jena - SHACL ................................ SUCCESS [
3.326 s]
[INFO] Apache Jena - ShEx ................................. SUCCESS [
3.885 s]
[INFO] Apache Jena - RDF Patch ............................ SUCCESS [
2.371 s]
[INFO] Apache Jena - RDF Connection ....................... SUCCESS [
2.447 s]
[INFO] Apache Jena - DBOE Database Operation Environment .. SUCCESS [
0.066 s]
[INFO] Apache Jena - DBOE Base ............................ SUCCESS [
2.156 s]
[INFO] Apache Jena - DBOE Transactions .................... SUCCESS [
1.825 s]
[INFO] Apache Jena - DBOE Indexes ......................... SUCCESS [
1.079 s]
[INFO] Apache Jena - DBOE Index test suite ................ SUCCESS [
0.320 s]
[INFO] Apache Jena - DBOE Transactional Datastructures .... SUCCESS [
20.250 s]
[INFO] Apache Jena - DBOE Storage ......................... SUCCESS [
1.694 s]
[INFO] Apache Jena - TDB1 (Native Triple Store) ........... SUCCESS [
7.363 s]
[INFO] Apache Jena - TDB2 (Native Triple Store) ........... SUCCESS [
6.352 s]
[INFO] Apache Jena - Libraries POM ........................ SUCCESS [
0.243 s]
[INFO] Apache Jena - Command line tools ................... SUCCESS [
2.839 s]
[INFO] Apache Jena - SPARQL Text Search ................... SUCCESS [
5.312 s]
[INFO] Apache Jena - Fuseki - A SPARQL 1.1 Server ......... SUCCESS [
0.024 s]
[INFO] Apache Jena - Fuseki Core Engine ................... SUCCESS [
5.540 s]
[INFO] Apache Jena - Fuseki UI ............................ FAILURE [
9.412 s]
[INFO] Apache Jena - Fuseki Data Access Control ........... SKIPPED
[INFO] Apache Jena - Fuseki Server Main ................... SKIPPED
[INFO] Apache Jena - Fuseki Server Jar .................... SKIPPED
[INFO] Apache Jena - Fuseki Webapp ........................ SKIPPED
[INFO] Apache Jena - Fuseki WAR File ...................... SKIPPED
[INFO] Apache Jena - Fuseki Server Standalone Jar ......... SKIPPED
[INFO] Apache Jena - Fuseki Docker Tools .................. SKIPPED
[INFO] Apache Jena - Fuseki Binary Distribution ........... SKIPPED
[INFO] Apache Jena - GeoSPARQL Engine ..................... SKIPPED
[INFO] Apache Jena - Fuseki with GeoSPARQL Engine ......... SKIPPED
[INFO] Apache Jena - Integration Testing .................. SKIPPED
[INFO] Apache Jena - Benchmark Suite ...................... SKIPPED
[INFO] Apache Jena - Benchmarks Shaded Jena 4.8.0 ......... SKIPPED
[INFO] Apache Jena - Benchmarks JMH ....................... SKIPPED
[INFO] Apache Jena - Distribution ......................... SKIPPED
[INFO] Apache Jena - Security Permissions ................. SKIPPED
[INFO] Apache Jena - Extras ............................... SKIPPED
[INFO] Apache Jena - Extras - Query Builder ............... SKIPPED
[INFO] Apache Jena - CommonsRDF for Jena .................. SKIPPED
[INFO] Apache Jena - Extras - Service Enhancer ............ SKIPPED
[INFO] Apache Jena - Code Examples ........................ SKIPPED
[INFO] Apache Jena - BOM .................................. SKIPPED
[INFO]
------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO]
------------------------------------------------------------------------
[ERROR] Failed to execute goal
com.github.eirslett:frontend-maven-plugin:1.15.0:yarn (yarn run
test:e2e)
on project jena-fuseki-ui: Failed to run task: 'yarn run test:e2e'
failed.
org.apache.commons.exec.ExecuteException: Process exited with an
error: 1
(Exit value: 1) -> [Help 1]
[ERROR]
[ERROR] To see the full stack trace of the errors, re-run Maven with
the
-e
switch.
[ERROR] Re-run Maven using the -X switch to enable full debug logging.
[ERROR]
[ERROR] For more information about the errors and possible solutions,
please read the following articles:
[ERROR] [Help 1]
http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
Apache Maven 3.9.6
java version "21" 2023-09-19 LTS
Linux
Node v18.19.1
NPM 9.2.0
