On the plus side the patch is running on a cluster and working really well. The issue was really obvious once we dug in.
https://issues.apache.org/jira/browse/NIFI-1557 Thanks Joe On Tue, Feb 23, 2016 at 4:36 PM, Tony Kurc <[email protected]> wrote: > I believe that is enough of the pmc to cancel this vote, so I will do so > On Feb 23, 2016 4:28 PM, "Mark Payne" <[email protected]> wrote: > >> Agreed - I would recommend holding off the 0.5.1 release for this - it can >> be very >> frustrating when this occurs. Will change my vote also to -1. >> >> >> > On Feb 23, 2016, at 4:11 PM, Joe Witt <[email protected]> wrote: >> > >> > -1 (binding). >> > >> > I continued testing to include running on a cluster w/two-way SSL and >> > username/password via LDAP. What I observed has been filed as this >> > JIRA https://issues.apache.org/jira/browse/NIFI-1557 >> > >> > The root of the issue has been identified and am now testing against a >> > patch that has proven to address the problem. Continuing to evaluate >> > behavior around this to ensure it is fully addressed. >> > >> > This issue is believed to have been present ever since we added >> > controller services and reporting tasks through the UI (version 0.1.0) >> > and has been causing confusion for folks for some time and can create >> > difficultly when restarting nodes or upgrading. In my opinion this >> > warrants canceling 0.5.1 RC1 and instead addressing this issue and >> > producing an 0.5.1 RC2. >> > >> > Thanks >> > Joe >> > >> > On Tue, Feb 23, 2016 at 1:35 PM, Mark Payne <[email protected]> >> wrote: >> >> +1 (binding) Release this package as nifi-0.5.1 >> >> >> >> Verified hashes & build w/ unit tests & contrib work. Verified that the >> initial issue that >> >> caused the 0.5.1 release (NIFI-1527) was addressed. >> >> >> >> -Mark >> >> >> >> >> >>> On Feb 23, 2016, at 12:35 PM, Joe Witt <[email protected]> wrote: >> >>> >> >>> +1 (binding) Release this package as nifi-0.5.1 >> >>> >> >>> Ran through all steps outlined for verification and validated numerous >> >>> JIRAs on the release and confirmed the finding Sean had for the >> >>> sources/javadocs has been resolved. >> >>> >> >>> Thanks! >> >>> >> >>> On Tue, Feb 23, 2016 at 7:27 AM, Brian Ghigiarelli < >> [email protected]> wrote: >> >>>> Upgrading to JDK 8 u74 works like a charm - everything builds and >> tests to >> >>>> success. The fan is a lot quieter now too. Thanks for the pointer on >> the >> >>>> JDK version! >> >>>> >> >>>> On Tue, Feb 23, 2016 at 7:08 AM Brian Ghigiarelli < >> [email protected]> >> >>>> wrote: >> >>>> >> >>>>> Thanks, Tony! >> >>>>> >> >>>>> Oracle JDK 8 u45 (1.8.0_45) >> >>>>> >> >>>>> At this point, I've tried the following MAVEN_OPTS for "mvn -T C2.0 >> clean >> >>>>> install" and "mvn -T C4.0 clean install" >> >>>>> >> >>>>> -Xms1024m -Xmx3076m >> >>>>> -Xms128m -Xmx4096m >> >>>>> -Xmx1024m -Xmx4096m -XX:+UseG1GC -XX:+UseStringDeduplication >> >>>>> -Xmx4096m -XX:-UseGCOverheadLimit -XX:+UseG1GC >> >>>>> -Xmx3g -XX:-UseGCOverheadLimit >> >>>>> >> >>>>> All eventually fail in the same spot: >> >>>>> >> >>>>> Tests run: 139, Failures: 1, Errors: 0, Skipped: 1, Time elapsed: >> 154.539 >> >>>>> sec <<< FAILURE! - in TestSuite >> >>>>> testManyFilesOpened on >> >>>>> >> testManyFilesOpened(org.apache.nifi.controller.repository.TestStandardProcessSession)(org.apache.nifi.controller.repository.TestStandardProcessSession) >> >>>>> Time elapsed: 59.672 sec <<< FAILURE! >> >>>>> java.lang.OutOfMemoryError: GC overhead limit exceeded >> >>>>> at >> >>>>> >> org.apache.nifi.stream.io.BufferedOutputStream.<init>(BufferedOutputStream.java:61) >> >>>>> at >> >>>>> >> org.apache.nifi.stream.io.BufferedOutputStream.<init>(BufferedOutputStream.java:46) >> >>>>> at >> >>>>> >> org.apache.nifi.controller.repository.StandardProcessSession.append(StandardProcessSession.java:2009) >> >>>>> at >> >>>>> >> org.apache.nifi.controller.repository.TestStandardProcessSession.testManyFilesOpened(TestStandardProcessSession.java:775) >> >>>>> >> >>>>> This is running on a MacBook Pro OS X 10.11.3 (El Capitan) with a >> 3GHz i7 >> >>>>> processor and 16GB memory. >> >>>>> >> >>>>> On Tue, Feb 23, 2016 at 6:35 AM Tony Kurc <[email protected]> wrote: >> >>>>> >> >>>>>> often that error is because the heap is overcommitted.... What >> version of >> >>>>>> the JDK are you attempting to build with, and what MAVEN_OPTS are >> you >> >>>>>> using? I built successfully with MAVEN_OPTS="-Xms1024m -Xmx3076m". >> >>>>>> >> >>>>>> On Tue, Feb 23, 2016 at 6:04 AM, Brian Ghigiarelli < >> [email protected]> >> >>>>>> wrote: >> >>>>>> >> >>>>>>> Hi Pierre, >> >>>>>>> >> >>>>>>> I'm hitting the same issues on Mac with the master branch >> (specifically >> >>>>>>> while it runs testManyOpenedFiles in nifi-framework-core). Been >> tuning >> >>>>>> Xmx, >> >>>>>>> ulimits, and G1GC to no avail. Perhaps we could continue that >> >>>>>> investigation >> >>>>>>> on a separate non-voting thread. >> >>>>>>> >> >>>>>>> Thanks, >> >>>>>>> Brian >> >>>>>>> >> >>>>>>> On Tue, Feb 23, 2016 at 5:53 AM Pierre Villard < >> >>>>>>> [email protected]> >> >>>>>>> wrote: >> >>>>>>> >> >>>>>>>> Hi all, >> >>>>>>>> >> >>>>>>>> I got some issues when building the version (on Windows): >> >>>>>>>> - with 'mvn clean install -Pcontrib-check', I got GC overhead >> limit >> >>>>>> error >> >>>>>>>> on unit tests in framework-core (I didn't manage to get it >> working by >> >>>>>>>> changing options in Maven but I guess I missed something with my >> own >> >>>>>>> local >> >>>>>>>> environment) >> >>>>>>>> - with 'mvn clean install -Pcontrib-check -DskipTests', I got the >> >>>>>>> following >> >>>>>>>> error : [ERROR] Failed to execute goal >> >>>>>>>> org.apache.rat:apache-rat-plugin:0.11:check (default) on project >> >>>>>>>> nifi-standard-processors: Too many files with unapproved license: >> 1 >> >>>>>> See >> >>>>>>> RAT >> >>>>>>>> report (It comes from >> >>>>>>>> >> >>>>>>>> >> >>>>>>> >> >>>>>> >> nifi-0.5.1/nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/src/test/resources/TestEncryptContent/unsalted_128_raw.enc) >> >>>>>>>> - with 'mvn clean install -DskipTests', it is OK. >> >>>>>>>> >> >>>>>>>> Otherwise, as far as I looked, it seems OK to me. >> >>>>>>>> >> >>>>>>>> >> >>>>>>>> >> >>>>>>>> >> >>>>>>>> 2016-02-23 5:40 GMT+01:00 Tony Kurc <[email protected]>: >> >>>>>>>> >> >>>>>>>>> Hello, >> >>>>>>>>> I am pleased to be calling this vote for the source release of >> >>>>>> Apache >> >>>>>>>> NiFi >> >>>>>>>>> nifi-0.5.1. >> >>>>>>>>> >> >>>>>>>>> The source zip, including signatures, digests, etc. can be found >> at: >> >>>>>>>>> >> >>>>>> >> https://repository.apache.org/content/repositories/orgapachenifi-1075 >> >>>>>>>>> >> >>>>>>>>> The Git tag is nifi-0.5.1-RC1 >> >>>>>>>>> The Git commit ID is 1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63 >> >>>>>>>>> >> >>>>>>>>> >> >>>>>>>> >> >>>>>>> >> >>>>>> >> https://git-wip-us.apache.org/repos/asf?p=nifi.git;a=commit;h=1bc7bdb609606b9aa61cebad3ef2e3c87d34ea63 >> >>>>>>>>> >> >>>>>>>>> This release candidate is a branch off of support/nifi-0.5.x at >> >>>>>>>>> 2a459fe21c708c8316dd255c3dc7f8254e7940f1. >> >>>>>>>>> >> >>>>>>>>> Checksums of nifi-0.5.1-source-release.zip: >> >>>>>>>>> MD5: 02b920f226643412cc9ff5f7103fa156 >> >>>>>>>>> SHA1: 7109ea477559c0c0eadb93e78a8c99e765d26bce >> >>>>>>>>> >> >>>>>>>>> Release artifacts are signed with the following key: >> >>>>>>>>> https://people.apache.org/keys/committer/tkurc.asc >> >>>>>>>>> >> >>>>>>>>> KEYS file available here: >> >>>>>>>>> https://dist.apache.org/repos/dist/release/nifi/KEYS >> >>>>>>>>> >> >>>>>>>>> 11 issues were closed/resolved for this release: >> >>>>>>>>> >> >>>>>>>>> >> >>>>>>>> >> >>>>>>> >> >>>>>> >> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12316020&version=12334887 >> >>>>>>>>> >> >>>>>>>>> Release note highlights can be found here: >> >>>>>>>>> >> >>>>>>>>> >> >>>>>>>> >> >>>>>>> >> >>>>>> >> https://cwiki.apache.org/confluence/display/NIFI/Release+Notes#ReleaseNotes-Version0.5.1 >> >>>>>>>>> >> >>>>>>>>> The vote will be open for 72 hours. >> >>>>>>>>> Please download the release candidate and evaluate the necessary >> >>>>>> items >> >>>>>>>>> including checking hashes, signatures, build from source, and >> test. >> >>>>>>> Then >> >>>>>>>>> please vote: >> >>>>>>>>> >> >>>>>>>>> [ ] +1 Release this package as nifi-0.5.1 >> >>>>>>>>> [ ] +0 no opinion >> >>>>>>>>> [ ] -1 Do not release this package because because... >> >>>>>>>>> >> >>>>>>>>> Thanks again for helping with this release! >> >>>>>>>>> >> >>>>>>>>> Tony >> >>>>>>>>> >> >>>>>>>> >> >>>>>>> >> >>>>>> >> >>>>> >> >> >> >>
