Re: Ambari build

2022-01-07 Thread Nils Breunese 
Marc Hoppins  wrote:

> This is a stock ambari 2.7.6 build attempt on Ubuntu 18.04.  I am not a java 
> entity but I am interested in understanding how these tools operate with a 
> view to getting away from Cloudera. We currently run with CDH 6.3, the 
> free/express version and this leaves us stuck with Centos7, or Ubuntu18, both 
> of which are EOL, or fast approaching.

You won’t be getting any news stuff anymore, but CentOS 7 is scheduled to 
receive maintenance updates until 2024-06-30, so there's almost 2.5 years left: 
https://wiki.centos.org/About/Product 

Nils.

RE: Ambari build

2022-01-07 Thread Marc Hoppins 
Thanks, I was following those but they fail to explain that RAT throws a 
shedload of licence errors, or that some portions of the process fail to 
download as non central repositories have been altered, etc.

-Original Message-
From: Sylwester Lachiewicz  
Sent: Friday, January 7, 2022 4:58 PM
To: Maven Users List 
Subject: Re: Ambari build

EXTERNAL

Also please check instructions
 here

https://cwiki.apache.org/confluence/display/AMBARI/Installation+Guide+for+Ambari+2.7.6

pt., 7 sty 2022, 13:28 użytkownik Delany 
napisał:

> Hi Marc
> -DskipTests is case sensitive. You can also skip compilation of tests 
> with -Dmaven.test.skip Eclipse is probably using a bundled JDK - 
> version 11+ since you're getting javax errors.
> Intellij is using a bundled Maven since its complaining about https repos.
> Check Intellij's Maven configuration page.
> Delany
>
>
> On Fri, 7 Jan 2022 at 14:16, Marc Hoppins  wrote:
>
> > Hi all,
> >
> > This is a stock ambari 2.7.6 build attempt on Ubuntu 18.04.  I am 
> > not a java entity but I am interested in understanding how these 
> > tools operate with a view to getting away from Cloudera. We 
> > currently run with CDH 6.3, the free/express version and this leaves 
> > us stuck with Centos7, or Ubuntu18, both of which are EOL, or fast 
> > approaching.  Given the
> exorbitant
> > pricing per node for ANY version of Cloudera, it is prohibitive to
> justify
> > the cost when making money off data is not a thing we could possibly 
> > contemplate.
> >
> > Aside from the obvious fact that every build produces errors which 
> > seem
> to
> > have been ignored by whoever created this,  I am mystified as to why 
> > the errors are different depending on how I run a build.
> >
> > I have OpenJDK 8 installed, as well as the general pre-requisites 
> > according to the Ambari documentation.
> >
> > Maven 3.6.0
> > Eclipse 2021-12 (4.22.0)
> > IntelliJ IDEA 2021.3.1 (Community)
> >
> > Below are the output errors from OS CLI, Eclipse and IntelliJ. All 
> > three produce DIFFERENT errors and this is confusing as I thought 
> > they all used Maven.  I run an INSTALL build with rat.skip as RAT 
> > seems to produce thousands of licence errors for every item in the 
> > project.  If RAT is so important, why have these errors not been sorted?
> >
> > Also, if I have -Dskiptests, why do tests still get run?
> >
> > I am sure that there are folk who have successfully built Ambari but 
> > useful and successful attempts have not been published for any 
> > recent version.
> >
> > Any information would be helpful.
> >
> > Thanks.
> >
> > Marc
> >
> > ** When run from CLI **
> >
> > mvn install -Drat.skip=true -Dskiptests=true -X [INFO] Running 
> > org.apache.ambari.server.metric.system.impl.MetricsServiceTest
> > [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
> > 0.359 s - in
> org.apache.ambari.server.metric.system.impl.MetricsServiceTest
> > [INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
> > 30.001 s - in
> > org.apache.ambari.server.checks.AmbariMetricsHadoopSinkVersionCheckT
> > est [INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time 
> > elapsed:
> > 6.232 s - in 
> > org.apache.ambari.server.upgrade.SchemaUpgradeHelperTest
> > [WARNING] Tests run: 6, Failures: 0, Errors: 0, Skipped: 1, Time elapsed:
> > 5.677 s - in
> org.apache.ambari.server.metric.system.impl.MetricsSourceTest
> > [INFO]
> > [INFO] Results:
> > [INFO]
> > [ERROR] Failures:
> > [ERROR]   ExecutionCommandWrapperTest.testGetExecutionCommand:247
> > [ERROR]   AmbariErrorHandlerTest.testHandleInternalServerError:119
> Nothing
> > captured yet
> > [ERROR] Errors:
> > [ERROR]
> >
> RootServiceComponentConfigurationResourceProviderTest.shouldUpdatePass
> wordInCredentialStoreIfSecurityPasswordEncryptionIsEnabled:534
> > > ConstructorNotFound
> > [ERROR]
> >
> PasswordUtilsTest.shouldReadPasswordFromCredentialStoreOfAnAlias:67->s
> etupBasicCredentialProviderExpectations:127
> > > ConstructorNotFound
> > [ERROR]
> >
> PasswordUtilsTest.shouldResolveEncryptedPaswordIfWeStoreTheAliasInPass
> wordFile:103->setupBasicCredentialProviderExpectations:127
> > > ConstructorNotFound
> > [INFO]
> > [ERROR] Tests run: 5271, Failures: 2, Errors: 3, Skipped: 60 [INFO] 
> > [INFO]
> > 
> > 
> > [INFO] Reactor Summary:
> > [INFO]
> &

Re: Ambari build

2022-01-07 Thread Sylwester Lachiewicz 
Also please check instructions
 here

https://cwiki.apache.org/confluence/display/AMBARI/Installation+Guide+for+Ambari+2.7.6

pt., 7 sty 2022, 13:28 użytkownik Delany 
napisał:

> Hi Marc
> -DskipTests is case sensitive. You can also skip compilation of tests with
> -Dmaven.test.skip
> Eclipse is probably using a bundled JDK - version 11+ since you're getting
> javax errors.
> Intellij is using a bundled Maven since its complaining about https repos.
> Check Intellij's Maven configuration page.
> Delany
>
>
> On Fri, 7 Jan 2022 at 14:16, Marc Hoppins  wrote:
>
> > Hi all,
> >
> > This is a stock ambari 2.7.6 build attempt on Ubuntu 18.04.  I am not a
> > java entity but I am interested in understanding how these tools operate
> > with a view to getting away from Cloudera. We currently run with CDH 6.3,
> > the free/express version and this leaves us stuck with Centos7, or
> > Ubuntu18, both of which are EOL, or fast approaching.  Given the
> exorbitant
> > pricing per node for ANY version of Cloudera, it is prohibitive to
> justify
> > the cost when making money off data is not a thing we could possibly
> > contemplate.
> >
> > Aside from the obvious fact that every build produces errors which seem
> to
> > have been ignored by whoever created this,  I am mystified as to why the
> > errors are different depending on how I run a build.
> >
> > I have OpenJDK 8 installed, as well as the general pre-requisites
> > according to the Ambari documentation.
> >
> > Maven 3.6.0
> > Eclipse 2021-12 (4.22.0)
> > IntelliJ IDEA 2021.3.1 (Community)
> >
> > Below are the output errors from OS CLI, Eclipse and IntelliJ. All three
> > produce DIFFERENT errors and this is confusing as I thought they all used
> > Maven.  I run an INSTALL build with rat.skip as RAT seems to produce
> > thousands of licence errors for every item in the project.  If RAT is so
> > important, why have these errors not been sorted?
> >
> > Also, if I have -Dskiptests, why do tests still get run?
> >
> > I am sure that there are folk who have successfully built Ambari but
> > useful and successful attempts have not been published for any recent
> > version.
> >
> > Any information would be helpful.
> >
> > Thanks.
> >
> > Marc
> >
> > ** When run from CLI **
> >
> > mvn install -Drat.skip=true -Dskiptests=true -X
> > [INFO] Running
> > org.apache.ambari.server.metric.system.impl.MetricsServiceTest
> > [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
> > 0.359 s - in
> org.apache.ambari.server.metric.system.impl.MetricsServiceTest
> > [INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
> > 30.001 s - in
> > org.apache.ambari.server.checks.AmbariMetricsHadoopSinkVersionCheckTest
> > [INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
> > 6.232 s - in org.apache.ambari.server.upgrade.SchemaUpgradeHelperTest
> > [WARNING] Tests run: 6, Failures: 0, Errors: 0, Skipped: 1, Time elapsed:
> > 5.677 s - in
> org.apache.ambari.server.metric.system.impl.MetricsSourceTest
> > [INFO]
> > [INFO] Results:
> > [INFO]
> > [ERROR] Failures:
> > [ERROR]   ExecutionCommandWrapperTest.testGetExecutionCommand:247
> > [ERROR]   AmbariErrorHandlerTest.testHandleInternalServerError:119
> Nothing
> > captured yet
> > [ERROR] Errors:
> > [ERROR]
> >
> RootServiceComponentConfigurationResourceProviderTest.shouldUpdatePasswordInCredentialStoreIfSecurityPasswordEncryptionIsEnabled:534
> > > ConstructorNotFound
> > [ERROR]
> >
> PasswordUtilsTest.shouldReadPasswordFromCredentialStoreOfAnAlias:67->setupBasicCredentialProviderExpectations:127
> > > ConstructorNotFound
> > [ERROR]
> >
> PasswordUtilsTest.shouldResolveEncryptedPaswordIfWeStoreTheAliasInPasswordFile:103->setupBasicCredentialProviderExpectations:127
> > > ConstructorNotFound
> > [INFO]
> > [ERROR] Tests run: 5271, Failures: 2, Errors: 3, Skipped: 60
> > [INFO]
> > [INFO]
> > 
> > [INFO] Reactor Summary:
> > [INFO]
> > [INFO] Ambari Main 2.7.6.0.0 .. SUCCESS [
> > 0.651 s]
> > [INFO] Apache Ambari Project POM 2.7.6.0.0  SUCCESS [
> > 0.009 s]
> > [INFO] Ambari Web 2.7.6.0.0 ... SUCCESS
> [01:20
> > min]
> > [INFO] Ambari Views 2.7.6.0.0 . SUCCESS [
> > 1.149 s]
> > [INFO] Ambari Admin View 2.7.6.0.0  SUCCESS [
> > 26.216 s]
> > [INFO] ambari-utility 1.0.0.0-SNAPSHOT  SUCCESS [
> > 2.062 s]
> > [INFO] ambari-metrics 2.7.6.0.0 ... SUCCESS [
> > 0.109 s]
> > [INFO] Ambari Metrics Common 2.7.6.0.0  SUCCESS [
> > 37.461 s]
> > [INFO] Ambari Metrics Hadoop Sink 2.7.6.0.0 ... SUCCESS [
> > 6.900 s]
> > [INFO] Ambari Metrics Flume Sink 2.7.6.0.0  SUCCESS [
> > 4.742 s]
> > [INFO] Ambari Metrics Kafka Sink 2.7.6.0.0  SUCCESS [
> > 3.439 s]
> > [INFO] Ambari

Re: Ambari build

2022-01-07 Thread Delany 
Hi Marc
-DskipTests is case sensitive. You can also skip compilation of tests with
-Dmaven.test.skip
Eclipse is probably using a bundled JDK - version 11+ since you're getting
javax errors.
Intellij is using a bundled Maven since its complaining about https repos.
Check Intellij's Maven configuration page.
Delany


On Fri, 7 Jan 2022 at 14:16, Marc Hoppins  wrote:

> Hi all,
>
> This is a stock ambari 2.7.6 build attempt on Ubuntu 18.04.  I am not a
> java entity but I am interested in understanding how these tools operate
> with a view to getting away from Cloudera. We currently run with CDH 6.3,
> the free/express version and this leaves us stuck with Centos7, or
> Ubuntu18, both of which are EOL, or fast approaching.  Given the exorbitant
> pricing per node for ANY version of Cloudera, it is prohibitive to justify
> the cost when making money off data is not a thing we could possibly
> contemplate.
>
> Aside from the obvious fact that every build produces errors which seem to
> have been ignored by whoever created this,  I am mystified as to why the
> errors are different depending on how I run a build.
>
> I have OpenJDK 8 installed, as well as the general pre-requisites
> according to the Ambari documentation.
>
> Maven 3.6.0
> Eclipse 2021-12 (4.22.0)
> IntelliJ IDEA 2021.3.1 (Community)
>
> Below are the output errors from OS CLI, Eclipse and IntelliJ. All three
> produce DIFFERENT errors and this is confusing as I thought they all used
> Maven.  I run an INSTALL build with rat.skip as RAT seems to produce
> thousands of licence errors for every item in the project.  If RAT is so
> important, why have these errors not been sorted?
>
> Also, if I have -Dskiptests, why do tests still get run?
>
> I am sure that there are folk who have successfully built Ambari but
> useful and successful attempts have not been published for any recent
> version.
>
> Any information would be helpful.
>
> Thanks.
>
> Marc
>
> ** When run from CLI **
>
> mvn install -Drat.skip=true -Dskiptests=true -X
> [INFO] Running
> org.apache.ambari.server.metric.system.impl.MetricsServiceTest
> [INFO] Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
> 0.359 s - in org.apache.ambari.server.metric.system.impl.MetricsServiceTest
> [INFO] Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
> 30.001 s - in
> org.apache.ambari.server.checks.AmbariMetricsHadoopSinkVersionCheckTest
> [INFO] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed:
> 6.232 s - in org.apache.ambari.server.upgrade.SchemaUpgradeHelperTest
> [WARNING] Tests run: 6, Failures: 0, Errors: 0, Skipped: 1, Time elapsed:
> 5.677 s - in org.apache.ambari.server.metric.system.impl.MetricsSourceTest
> [INFO]
> [INFO] Results:
> [INFO]
> [ERROR] Failures:
> [ERROR]   ExecutionCommandWrapperTest.testGetExecutionCommand:247
> [ERROR]   AmbariErrorHandlerTest.testHandleInternalServerError:119 Nothing
> captured yet
> [ERROR] Errors:
> [ERROR]
>  
> RootServiceComponentConfigurationResourceProviderTest.shouldUpdatePasswordInCredentialStoreIfSecurityPasswordEncryptionIsEnabled:534
> > ConstructorNotFound
> [ERROR]
>  
> PasswordUtilsTest.shouldReadPasswordFromCredentialStoreOfAnAlias:67->setupBasicCredentialProviderExpectations:127
> > ConstructorNotFound
> [ERROR]
>  
> PasswordUtilsTest.shouldResolveEncryptedPaswordIfWeStoreTheAliasInPasswordFile:103->setupBasicCredentialProviderExpectations:127
> > ConstructorNotFound
> [INFO]
> [ERROR] Tests run: 5271, Failures: 2, Errors: 3, Skipped: 60
> [INFO]
> [INFO]
> 
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Ambari Main 2.7.6.0.0 .. SUCCESS [
> 0.651 s]
> [INFO] Apache Ambari Project POM 2.7.6.0.0  SUCCESS [
> 0.009 s]
> [INFO] Ambari Web 2.7.6.0.0 ... SUCCESS [01:20
> min]
> [INFO] Ambari Views 2.7.6.0.0 . SUCCESS [
> 1.149 s]
> [INFO] Ambari Admin View 2.7.6.0.0  SUCCESS [
> 26.216 s]
> [INFO] ambari-utility 1.0.0.0-SNAPSHOT  SUCCESS [
> 2.062 s]
> [INFO] ambari-metrics 2.7.6.0.0 ... SUCCESS [
> 0.109 s]
> [INFO] Ambari Metrics Common 2.7.6.0.0  SUCCESS [
> 37.461 s]
> [INFO] Ambari Metrics Hadoop Sink 2.7.6.0.0 ... SUCCESS [
> 6.900 s]
> [INFO] Ambari Metrics Flume Sink 2.7.6.0.0  SUCCESS [
> 4.742 s]
> [INFO] Ambari Metrics Kafka Sink 2.7.6.0.0  SUCCESS [
> 3.439 s]
> [INFO] Ambari Metrics Storm Sink 2.7.6.0.0  SUCCESS [
> 1.970 s]
> [INFO] Ambari Metrics Storm Sink (Legacy) 2.7.6.0.0 ... SUCCESS [
> 1.802 s]
> [INFO] Ambari Metrics Collector 2.7.6.0.0 . SUCCESS [02:38
> min]
> [INFO] Ambari Metrics Monitor 2.7.6.0.0 ... SUCCESS [
> 1.998 s]
> [INFO] Ambari Metrics Grafana 2.7.6.0.0 ... SUCCESS [
> 3.006 s]
> [INFO]