Hi guys,
Yep - I made sure the global git settings held before the clone.
I tried running with the options from the .yml file and got a bunch of
errors.
So I started the contributor guide again (from a new clone) and this time
compiled with:
mvn clean package verify.
It ran for a while before dying on this
[INFO] Running
org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest
[ERROR] Tests run: 3, Failures: 0, Errors: 3, Skipped: 0, Time elapsed:
7.754 s <<< FAILURE! - in
org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest
[ERROR]
org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerToken
Time elapsed: 5.561 s <<< ERROR!
java.lang.IllegalArgumentException: Signing Failed for Algorithm [PS512]
Key Identifier [b8e23cf5-e508-4179-808a-83a5c2063a82]
at
org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerToken(StandardBearerTokenProviderTest.java:99)
Caused by: com.nimbusds.jose.JOSEException: Unsupported RSASSA algorithm
(after retry with alternative): SHA512withRSAandMGF1 Signature not available
at
org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerToken(StandardBearerTokenProviderTest.java:99)
Caused by: java.security.NoSuchAlgorithmException: SHA512withRSAandMGF1
Signature not available
at
org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerToken(StandardBearerTokenProviderTest.java:99)
[ERROR]
org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerTokenExpirationMaximum
Time elapsed: 0.327 s <<< ERROR!
java.lang.IllegalArgumentException: Signing Failed for Algorithm [PS512]
Key Identifier [3d301d5b-a81a-4bf8-8808-e144b52df197]
at
org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerTokenExpirationMaximum(StandardBearerTokenProviderTest.java:125)
Caused by: com.nimbusds.jose.JOSEException: Unsupported RSASSA algorithm
(after retry with alternative): SHA512withRSAandMGF1 Signature not available
at
org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerTokenExpirationMaximum(StandardBearerTokenProviderTest.java:125)
Caused by: java.security.NoSuchAlgorithmException: SHA512withRSAandMGF1
Signature not available
at
org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerTokenExpirationMaximum(StandardBearerTokenProviderTest.java:125)
[ERROR]
org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerTokenExpirationMinimum
Time elapsed: 1.859 s <<< ERROR!
java.lang.IllegalArgumentException: Signing Failed for Algorithm [PS512]
Key Identifier [986f3d55-e2e3-4116-a419-8fd2a928af8c]
at
org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerTokenExpirationMinimum(StandardBearerTokenProviderTest.java:144)
Caused by: com.nimbusds.jose.JOSEException: Unsupported RSASSA algorithm
(after retry with alternative): SHA512withRSAandMGF1 Signature not available
at
org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerTokenExpirationMinimum(StandardBearerTokenProviderTest.java:144)
Caused by: java.security.NoSuchAlgorithmException: SHA512withRSAandMGF1
Signature not available
at
org.apache.nifi.web.security.jwt.provider.StandardBearerTokenProviderTest.testGetBearerTokenExpirationMinimum(StandardBearerTokenProviderTest.java:144)
On Wed, Apr 6, 2022 at 7:58 AM Joe Witt <joe.w...@gmail.com> wrote:
> Good point there James. Phil definitely give that a look. Those commands
> need to be run on the repository at the right time as well so it doesn't
> import with the wrong line endings.
>
> From our github automated builds we have at:
> https://github.com/apache/nifi/blob/main/.github/workflows/ci-workflow.yml
>
> Here are key things to execute to run like we do there:
>
> git config --global core.autocrlf false
> git config --global core.longpaths true
> Checkout Code
>
> DEFAULT_MAVEN_OPTS: >-
> -Xmx3g
> -XX:ReservedCodeCacheSize=1g
> -XX:+UseG1GC
> -Dorg.slf4j.simpleLogger.defaultLogLevel=WARN
> -Dhttp.keepAlive=false
> -Dmaven.wagon.http.pool=false
>
> mvn package verify
> -P contrib-check
> -P include-grpc
> -P skip-nifi-bin-assembly
>
> On Tue, Apr 5, 2022 at 2:31 PM James Srinivasan <
> james.sriniva...@gmail.com>
> wrote:
>
> > Possibly not your problem, but did you follow the instructions for
> building
> > on Windows here:
> >
> > https://nifi.apache.org/quickstart.html
> >
> > On Tue, 5 Apr 2022, 12:42 Phil H, <gippyp...@gmail.com> wrote:
> >
> > > Okay, I started over with a completely new local repo. This is the
> exact
> > > sequence of commands I ran:
> > >
> > > $ git clone https://github.com/apache/nifi.git
> > > $ cd nifi
> > > $ git remote add upstream https://github.com/apache/nifi.git
> > > $ git clean -fxd
> > > $ mvn clean package verify -Pcontrib-check,include-grpc
> > >
> > > And after about 12 minutes:
> > >
> > > [ERROR] Failed to execute goal
> > > org.apache.maven.plugins:maven-surefire-plugin:3.0.0-M5:test
> > (default-test)
> > > on project nifi-web-security: There are test failures.
> > > [ERROR]
> > > [ERROR] Please refer to
> > >
> > >
> >
> D:\nifi\nifi-nar-bundles\nifi-framework-bundle\nifi-framework\nifi-web\nifi-web-security\target\surefire-reports
> > > for the individual test results.
> > > [ERROR] Please refer to dump files (if any exist) [date].dump,
> > > [date]-jvmRun[N].dump and [date].dumpstream.
> > >
> > > The contents of the dumpfile at that location is:
> > >
> > > # Created at 2022-04-05T21:05:18.979
> > > Boot Manifest-JAR contains absolute paths in classpath
> > >
> > >
> >
> 'D:\nifi\nifi-nar-bundles\nifi-framework-bundle\nifi-framework\nifi-web\nifi-web-security\target\test-classes'
> > > Hint:
> > > <argLine>-Djdk.net.URLClassPath.disableClassPathURLCheck=true</argLine>
> > >
> > > I'm sure there's some obvious mistake I'm making, or piece of
> > information I
> > > am missing, but I have no idea what they are!
> > >
> > > Thanks
> > > Phil
> > >
> > > On Tue, Apr 5, 2022 at 12:53 AM Joe Witt <joe.w...@gmail.com> wrote:
> > >
> > > > Phil
> > > >
> > > > I think you need to run 'git clean -fxd' from the nifi source root.
> > > >
> > > > Then try the build again. And allow the entire thing to run.
> > > >
> > > > Too many builds in different levels are leaving things around.
> > > >
> > > > Thanks
> > > >
> > > > On Mon, Apr 4, 2022 at 7:46 AM Phil H <gippyp...@gmail.com> wrote:
> > > >
> > > > > So, about that error that flashed past...
> > > > >
> > > > > [INFO]
> > > > >
> > >
> ------------------------------------------------------------------------
> > > > > [INFO] BUILD FAILURE
> > > > > [INFO]
> > > > >
> > >
> ------------------------------------------------------------------------
> > > > > [INFO] Total time: 22:21 min (Wall Clock)
> > > > > [INFO] Finished at: 2022-04-05T00:37:46+10:00
> > > > > [INFO]
> > > > >
> > >
> ------------------------------------------------------------------------
> > > > > [ERROR] Failed to execute goal
> > > > org.apache.rat:apache-rat-plugin:0.13:check
> > > > > (default) on project nifi-poi-processors: Too many files with
> > > unapproved
> > > > > license: 1 See RAT report in:
> > > > >
> > > > >
> > > >
> > >
> >
> D:\nifi.github\nifi\nifi-nar-bundles\nifi-poi-bundle\nifi-poi-processors\target\rat.txt
> > > > > -> [Help 1]
> > > > >
> > > > > The rat file contains the following:
> > > > >
> > > > > *****************************************************
> > > > > Summary
> > > > > -------
> > > > > Generated at: 2022-04-05T00:33:56+10:00
> > > > >
> > > > > Notes: 0
> > > > > Binaries: 4
> > > > > Archives: 0
> > > > > Standards: 7
> > > > >
> > > > > Apache Licensed: 6
> > > > > Generated Documents: 0
> > > > >
> > > > > JavaDocs are generated, thus a license header is optional.
> > > > > Generated files do not require license headers.
> > > > >
> > > > > 1 Unknown Licenses
> > > > >
> > > > > *****************************************************
> > > > >
> > > > > Files with unapproved licenses:
> > > > >
> > > > >
> > > > >
> > > > >
> > > >
> > >
> >
> D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/Unsupported.xls
> > > > >
> > > > > *****************************************************
> > > > >
> > > > > *****************************************************
> > > > > Files with Apache License headers will be marked AL
> > > > > Binary files (which do not require any license headers) will be
> > > marked
> > > > B
> > > > > Compressed archives will be marked A
> > > > > Notices, licenses etc. will be marked N
> > > > > AL
> > > > >
> > > > >
> > > >
> > >
> >
> D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/pom.xml
> > > > > AL
> > > > >
> > > > >
> > > >
> > >
> >
> D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/main/java/org/apache/nifi/processors/poi/ConvertExcelToCSVProcessor.java
> > > > > AL
> > > > >
> > > > >
> > > >
> > >
> >
> D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/main/resources/docs/org.apache.nifi.processors.poi.ConvertExcelToCSVProcessor/additionalDetails.html
> > > > > AL
> > > > >
> > > > >
> > > >
> > >
> >
> D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/main/resources/META-INF/services/org.apache.nifi.processor.Processor
> > > > > AL
> > > > >
> > > > >
> > > >
> > >
> >
> D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/java/org/apache/nifi/processors/poi/ConvertExcelToCSVProcessorTest.java
> > > > > B
> > > > >
> > > > >
> > > >
> > >
> >
> D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/CollegeScorecard.xlsx
> > > > > B
> > > > >
> > > > >
> > > >
> > >
> >
> D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/dataformatting.xlsx
> > > > > AL
> > > > >
> > > > >
> > > >
> > >
> >
> D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/logback-test.xml
> > > > > B
> > > > >
> > > > >
> > > >
> > >
> >
> D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/TwoSheets.xlsx
> > > > > !?????
> > > > >
> > > > >
> > > >
> > >
> >
> D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/Unsupported.xls
> > > > > B
> > > > >
> > > > >
> > > >
> > >
> >
> D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/with-blank-cells.xlsx
> > > > >
> > > > > *****************************************************
> > > > >
> > > > > Printing headers for text files without a valid license header...
> > > > >
> > > > > =====================================================
> > > > > == File:
> > > > >
> > > > >
> > > >
> > >
> >
> D:/nifi.github/nifi/nifi-nar-bundles/nifi-poi-bundle/nifi-poi-processors/src/test/resources/Unsupported.xls
> > > > > =====================================================
> > > > > -- some binary stuff --
> > > > >
> > > > >
> > > > > On Tue, Apr 5, 2022 at 12:30 AM Phil H <gippyp...@gmail.com>
> wrote:
> > > > >
> > > > > > Thanks Joe, it seems to be about half way through now - much
> > further
> > > > than
> > > > > > previously. I thought I saw some red text flash past, but
> nothing
> > > > > > stopped. Does one of those switches you suggested pile all the
> bad
> > > > news
> > > > > up
> > > > > > to deliver at the end, or can maven have "red errors" that aren't
> > > > > terminal?
> > > > > >
> > > > > > TIA,
> > > > > > Phil
> > > > > >
> > > > > > On Mon, Apr 4, 2022 at 11:48 PM Joe Witt <joe.w...@gmail.com>
> > wrote:
> > > > > >
> > > > > >> Phil
> > > > > >>
> > > > > >> Here is a command I commonly run to ensure I have nothing other
> > than
> > > > > >> what the source tree intends.
> > > > > >>
> > > > > >> mvn -T C1 clean package verify -Pcontrib-check,include-grpc
> > > > > >>
> > > > > >> This will do everything - build it all, run contrib check, and
> use
> > > all
> > > > > the
> > > > > >> cores.
> > > > > >>
> > > > > >> Thanks
> > > > > >>
> > > > > >> On Mon, Apr 4, 2022 at 6:38 AM Mike Thomsen <
> > mikerthom...@gmail.com
> > > >
> > > > > >> wrote:
> > > > > >>
> > > > > >> > Did you run "mvn install" from the root of the project before
> > > > > >> > attempting to run a full test of the code base?
> > > > > >> >
> > > > > >> > On Mon, Apr 4, 2022 at 9:36 AM Phil H <gippyp...@gmail.com>
> > > wrote:
> > > > > >> > >
> > > > > >> > > Hi there,
> > > > > >> > >
> > > > > >> > > So I got past this issue by running "mvn test" from the root
> > of
> > > > the
> > > > > >> nifi
> > > > > >> > > tree. After much compiling and testing, I am now getting
> the
> > > > > attached
> > > > > >> > > error. I think I am following the contributor guide in
> having
> > > my
> > > > > >> local
> > > > > >> > > branch track origin/main (currently "4a90334728: NIFI-9846
> > > > Implement
> > > > > >> > > pagination listing for Azure List processors").
> > > > > >> > >
> > > > > >> > > Is this some environmental issue on my machine somehow? Or
> > does
> > > > the
> > > > > >> main
> > > > > >> > > branch contain compilation errors, and I should be tracking
> > > > > something
> > > > > >> > else
> > > > > >> > > for my own branch? As I said in my previous email, I am new
> > to
> > > > > >> github,
> > > > > >> > so
> > > > > >> > > I'm not sure of the conventions there.
> > > > > >> > >
> > > > > >> > > Thanks in advance
> > > > > >> > > Phil
> > > > > >> > >
> > > > > >> > > (PS: this occur whethers I use JDK1.8 or JDK11, the two
> > options
> > > I
> > > > > have
> > > > > >> > > installed)
> > > > > >> > >
> > > > > >> > >
> > > > > >> > >
> > > > > >> > > [ERROR] Failed to execute goal
> > > > > >> > > org.apache.maven.plugins:maven-compiler-plugin:3.9.0:compile
> > > > > >> > > (default-compile) on project nifi-h2-database-migrator:
> > > > Compilation
> > > > > >> > > failure: Compilation failure:
> > > > > >> > > [ERROR]
> > > > > >> > >
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> >
> D:\nifi.github\nifi\nifi-h2\nifi-h2-database-migrator\src\main\java\org\apache\nifi\h2\database\migration\H2DatabaseMigrator.java:[19,35]
> > > > > >> > > error: package org.apache.nifi.org.h2.jdbcx does not exist
> > > > > >> > > [ERROR]
> > > > > >> > >
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> >
> D:\nifi.github\nifi\nifi-h2\nifi-h2-database-migrator\src\main\java\org\apache\nifi\h2\database\migration\H2DatabaseMigrator.java:[37,8]
> > > > > >> > > error: cannot find symbol
> > > > > >> > > [ERROR] symbol: class JdbcDataSource
> > > > > >> > > [ERROR] location: class H2DatabaseMigrator
> > > > > >> > > [ERROR]
> > > > > >> > >
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> >
> D:\nifi.github\nifi\nifi-h2\nifi-h2-database-migrator\src\main\java\org\apache\nifi\h2\database\migration\H2DatabaseMigrator.java:[37,49]
> > > > > >> > > error: cannot find symbol
> > > > > >> > > [ERROR] symbol: class JdbcDataSource
> > > > > >> > > [ERROR] location: class H2DatabaseMigrator
> > > > > >> > >
> > > > > >> > > On Sat, Apr 2, 2022 at 10:20 PM Phil H <gippyp...@gmail.com
> >
> > > > wrote:
> > > > > >> > >
> > > > > >> > > > Hi there,
> > > > > >> > > >
> > > > > >> > > > Trying to build the nifi git repo for the first time and
> I'm
> > > > > getting
> > > > > >> > the
> > > > > >> > > > message below
> > > > > >> > > >
> > > > > >> > > > I'm used to working in offline development environments,
> so
> > > I'm
> > > > a
> > > > > >> bit
> > > > > >> > lost
> > > > > >> > > > with this online dependency stuff. I note that
> > > > > >> > > > https://repository.apache.org/snapshots/org/apache/nifi/
> > > > doesn't
> > > > > >> > contain
> > > > > >> > > > any similar subdirectories to that in the URL.
> > > > > >> > > >
> > > > > >> > > > Help!
> > > > > >> > > >
> > > > > >> > > > Regards,
> > > > > >> > > > Phil
> > > > > >> > > >
> > > > > >> > > > [WARNING] The POM for
> > > > > >> org.apache.nifi:nifi-utils:jar:1.16.0-SNAPSHOT is
> > > > > >> > > > missing, no dependency information available
> > > > > >> > > > Downloading from apache.snapshots:
> > > > > >> > > >
> > > > > >> >
> > > > > >>
> > > > >
> > > >
> > >
> >
> https://repository.apache.org/snapshots/org/apache/nifi/nifi-utils/1.16.0-SNAPSHOT/nifi-utils-1.16.0-SNAPSHOT.jar
> > > > > >> > > > [INFO]
> > > > > >> > > >
> > > > > >> >
> > > > >
> > >
> ------------------------------------------------------------------------
> > > > > >> > > > [INFO] Reactor Summary for nifi-standard-bundle
> > > 1.16.0-SNAPSHOT:
> > > > > >> > > > [INFO]
> > > > > >> > > > [INFO] nifi-standard-bundle
> ...............................
> > > > > SUCCESS
> > > > > >> > [01:07
> > > > > >> > > > min]
> > > > > >> > > > [INFO] nifi-standard-utils
> ................................
> > > > > FAILURE
> > > > > >> [
> > > > > >> > > > 3.218 s]
> > > > > >> > > > [INFO] nifi-standard-processors
> ...........................
> > > > > SKIPPED
> > > > > >> > > > [INFO] nifi-standard-reporting-tasks
> ......................
> > > > > SKIPPED
> > > > > >> > > > [INFO] nifi-standard-content-viewer
> .......................
> > > > > SKIPPED
> > > > > >> > > > [INFO] nifi-jolt-transform-json-ui
> ........................
> > > > > SKIPPED
> > > > > >> > > > [INFO] nifi-standard-nar
> ..................................
> > > > > SKIPPED
> > > > > >> > > > [INFO]
> > > > > >> > > >
> > > > > >> >
> > > > >
> > >
> ------------------------------------------------------------------------
> > > > > >> > > > [INFO] BUILD FAILURE
> > > > > >> > > > [INFO]
> > > > > >> > > >
> > > > > >> >
> > > > >
> > >
> ------------------------------------------------------------------------
> > > > > >> > > > [INFO] Total time: 01:43 min
> > > > > >> > > > [INFO] Finished at: 2022-04-02T21:58:47+10:00
> > > > > >> > > > [INFO]
> > > > > >> > > >
> > > > > >> >
> > > > >
> > >
> ------------------------------------------------------------------------
> > > > > >> > > > [ERROR] Failed to execute goal on project
> > nifi-standard-utils:
> > > > > Could
> > > > > >> > not
> > > > > >> > > > resolve dependencies for project
> > > > > >> > > > org.apache.nifi:nifi-standard-utils:jar:1.16.0-SNAPSHOT:
> > Could
> > > > not
> > > > > >> find
> > > > > >> > > > artifact org.apache.nifi:nifi-utils:jar:1.16.0-SNAPSHOT in
> > > > > >> > apache.snapshots
> > > > > >> > > > (https://repository.apache.org/snapshots) -> [Help 1]
> > > > > >> > > >
> > > > > >> >
> > > > > >>
> > > > > >
> > > > >
> > > >
> > >
> >
>
