Re: RC1 for 14.1

2020-06-30 Thread Andrew Musselman
I'm seeing a couple potential bugs, definitely at least a typo in
`bin/mahout` where there was some commented out nested ifs; when I comment
out the dangling fi on line 257 I still see some problems. Am I missing a
step?

$ ./bin/mahout spark-shell
Adding lib/ to CLASSPATH
./bin/mahout: line 257: syntax error near unexpected token `fi'
./bin/mahout: line 257: `  fi'
$ vi bin/mahout
$ ./bin/mahout spark-shell
Adding lib/ to CLASSPATH
2020-06-30 15:27:39 WARN  Utils:66 - Your hostname, rob resolves to a
loopback address: 127.0.1.1; using 10.0.1.40 instead (on interface wlp60s0)
2020-06-30 15:27:39 WARN  Utils:66 - Set SPARK_LOCAL_IP if you need to bind
to another address
2020-06-30 15:27:40 WARN  NativeCodeLoader:62 - Unable to load
native-hadoop library for your platform... using builtin-java classes where
applicable
Setting default log level to "WARN".
To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use
setLogLevel(newLevel).
Spark context Web UI available at http://10.0.1.40:4040
Spark context available as 'sc' (master = local[*], app id =
local-1593556068798).
Spark session available as 'spark'.
Loading /home/akm/unpack/
repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/apache-mahout-distribution/14.1/bin/load-shell.scala.
..
:40: error: object mahout is not a member of package org.apache
   import org.apache.mahout.math._
 ^
:23: error: object mahout is not a member of package org.apache
   import org.apache.mahout.math.scalabindings._
 ^
:23: error: object mahout is not a member of package org.apache
   import org.apache.mahout.math.drm._
 ^
:23: error: object mahout is not a member of package org.apache
   import org.apache.mahout.math.scalabindings.RLikeOps._
 ^
:23: error: object mahout is not a member of package org.apache
   import org.apache.mahout.math.drm.RLikeDrmOps._
 ^
:23: error: object mahout is not a member of package org.apache
   import org.apache.mahout.sparkbindings._
 ^
:24: error: object mahout is not a member of package org.apache
   implicit val sdc:
org.apache.mahout.sparkbindings.SparkDistributedContext = sc2sdc(sc)
^
:24: error: not found: value sc2sdc
   implicit val sdc:
org.apache.mahout.sparkbindings.SparkDistributedContext = sc2sdc(sc)

   ^

_ _
_ __ ___   __ _| |__   ___  _   _| |_
 '_ ` _ \ / _` | '_ \ / _ \| | | | __|
 | | | | (_| | | | | (_) | |_| | |_
_| |_| |_|\__,_|_| |_|\___/ \__,_|\__|  version 0.14



That file does not exist

Welcome to
    __
 / __/__  ___ _/ /__
_\ \/ _ \/ _ `/ __/  '_/
   /___/ .__/\_,_/_/ /_/\_\   version 2.3.0
  /_/

Using Scala version 2.11.8 (OpenJDK 64-Bit Server VM, Java 1.8.0_252)
Type in expressions to have them evaluated.
Type :help for more information.

scala>
scala> import org.apache.mahout.math._
:23: error: object mahout is not a member of package org.apache
   import org.apache.mahout.math._
 ^

scala> import scalabindings._
:23: error: not found: value scalabindings
   import scalabindings._
  ^

scala> import RLikeOps._
:23: error: not found: value RLikeOps
   import RLikeOps._
  ^

scala>

On Mon, Jun 29, 2020 at 10:10 PM Andrew Musselman  wrote:

> Thanks to some great work by Chris Dutz, RC1 for 14.1 release is out!
> Please go try it out, check signatures and checksums, etc.
>
> Binaries:
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/apache-mahout-distribution/14.1/
>
> Source:
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/mahout/14.1/
>
> Best
> Andrew
>


Re: RC1 for 14.1

2020-06-30 Thread Andrew Musselman
Yeah, I think after voting we add the artifacts to SVN by hand. Happy to
discuss, what are the advantages of the way you're doing it in PLC4X?

On Tue, Jun 30, 2020 at 8:08 AM Christofer Dutz 
wrote:

> Hi all,
>
>
>
> well we setup things in PLC4X the same way most projects have them … so
> for PLC4X we stage releases here:
>
> https://dist.apache.org/repos/dist/dev/plc4x/
>
>
>
> and as soon as they are released, they are SVN-Moved here:
>
> https://dist.apache.org/repos/dist/release/plc4x
>
>
>
> This then automatically makes all the mirror syncing of Apache make the
> artifacts available here:
>
> https://downloads.apache.org/plc4x/
>
> All this SVN staging stuff is manual stuff … for PLC4X too, the
> release:perform uploads the source bundles to Nexus, but we don’t vote on
> that.
>
> We vote on the stuff that’s in SVN.
>
>
>
> Chris
>
>
>
>
>
> *Von: *Andrew Musselman 
> *Datum: *Dienstag, 30. Juni 2020 um 16:57
> *An: *Mahout Dev List , Christofer Dutz <
> christofer.d...@c-ware.de>
> *Betreff: *Re: RC1 for 14.1
>
>
>
> (1) We've always done it through Nexus, not married to the approach
>
> (2) Agreed, https://issues.apache.org/jira/browse/MAHOUT-2109
>
> (3) Agreed, https://issues.apache.org/jira/browse/MAHOUT-2110
>
> (4) Also https://issues.apache.org/jira/browse/MAHOUT-2110
>
> (5) @Christofer Dutz  where are KEYS normally
> kept?
>
>
>
> On Tue, Jun 30, 2020 at 5:47 AM Trevor Grant 
> wrote:
>
> 1. Interesting on the Nexux- who knows who set that up- what are the
> pro/cons of nexus v SVN?
> 2. make sure this gets added to docs
> 3. let's make a jira for this.
> 4. just drop them then.
> 5. https://github.com/apache/mahout/blob/trunk/distribution/KEYS
>
>
>
> On Tue, Jun 30, 2020 at 2:42 AM Christofer Dutz  >
> wrote:
>
> > Hi folks,
> >
> > some things I noticed:
> >
> > 1) You're using the Nexus Staging Repo ... I know most Apache projects
> use
> > the apache SVN for officially staging the release
> > 2) The source-repo is missing the RELEASE_NOTES which usually goes
> > alongside the source bundle.
> > 3) (this might be the most serious issue) you are using SHA1 hashes and
> > Apache wants us to use SHA512 hashes (The build does provide these, but
> > doesn't automatically deploy them) (
> > https://infra.apache.org/release-distribution.html)
> > 4) MD5 are also considered deprecated
> > 5) Where's your KEYS file? I need that to validate the signatures.
> >
> > Chris
> >
> >
> >
> > Am 30.06.20, 07:11 schrieb "Andrew Musselman" :
> >
> > Thanks to some great work by Chris Dutz, RC1 for 14.1 release is out!
> > Please go try it out, check signatures and checksums, etc.
> >
> > Binaries:
> >
> >
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/apache-mahout-distribution/14.1/
> >
> > Source:
> >
> >
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/mahout/14.1/
> >
> > Best
> > Andrew
> >
> >
>
>


Re: RC1 for 14.1

2020-06-30 Thread Christofer Dutz
Hi all,

well we setup things in PLC4X the same way most projects have them … so for 
PLC4X we stage releases here:
https://dist.apache.org/repos/dist/dev/plc4x/

and as soon as they are released, they are SVN-Moved here:
https://dist.apache.org/repos/dist/release/plc4x

This then automatically makes all the mirror syncing of Apache make the 
artifacts available here:
https://downloads.apache.org/plc4x/
All this SVN staging stuff is manual stuff … for PLC4X too, the release:perform 
uploads the source bundles to Nexus, but we don’t vote on that.
We vote on the stuff that’s in SVN.

Chris


Von: Andrew Musselman 
Datum: Dienstag, 30. Juni 2020 um 16:57
An: Mahout Dev List , Christofer Dutz 

Betreff: Re: RC1 for 14.1

(1) We've always done it through Nexus, not married to the approach
(2) Agreed, https://issues.apache.org/jira/browse/MAHOUT-2109
(3) Agreed, https://issues.apache.org/jira/browse/MAHOUT-2110
(4) Also https://issues.apache.org/jira/browse/MAHOUT-2110
(5) @Christofer Dutz<mailto:christofer.d...@c-ware.de> where are KEYS normally 
kept?

On Tue, Jun 30, 2020 at 5:47 AM Trevor Grant 
mailto:trevor.d.gr...@gmail.com>> wrote:
1. Interesting on the Nexux- who knows who set that up- what are the
pro/cons of nexus v SVN?
2. make sure this gets added to docs
3. let's make a jira for this.
4. just drop them then.
5. https://github.com/apache/mahout/blob/trunk/distribution/KEYS



On Tue, Jun 30, 2020 at 2:42 AM Christofer Dutz 
mailto:christofer.d...@c-ware.de>>
wrote:

> Hi folks,
>
> some things I noticed:
>
> 1) You're using the Nexus Staging Repo ... I know most Apache projects use
> the apache SVN for officially staging the release
> 2) The source-repo is missing the RELEASE_NOTES which usually goes
> alongside the source bundle.
> 3) (this might be the most serious issue) you are using SHA1 hashes and
> Apache wants us to use SHA512 hashes (The build does provide these, but
> doesn't automatically deploy them) (
> https://infra.apache.org/release-distribution.html)
> 4) MD5 are also considered deprecated
> 5) Where's your KEYS file? I need that to validate the signatures.
>
> Chris
>
>
>
> Am 30.06.20, 07:11 schrieb "Andrew Musselman" 
> mailto:a...@apache.org>>:
>
> Thanks to some great work by Chris Dutz, RC1 for 14.1 release is out!
> Please go try it out, check signatures and checksums, etc.
>
> Binaries:
>
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/apache-mahout-distribution/14.1/
>
> Source:
>
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/mahout/14.1/
>
> Best
> Andrew
>
>


Re: RC1 for 14.1

2020-06-30 Thread Andrew Musselman
(1) We've always done it through Nexus, not married to the approach
(2) Agreed, https://issues.apache.org/jira/browse/MAHOUT-2109
(3) Agreed, https://issues.apache.org/jira/browse/MAHOUT-2110
(4) Also https://issues.apache.org/jira/browse/MAHOUT-2110
(5) @Christofer Dutz  where are KEYS normally
kept?

On Tue, Jun 30, 2020 at 5:47 AM Trevor Grant 
wrote:

> 1. Interesting on the Nexux- who knows who set that up- what are the
> pro/cons of nexus v SVN?
> 2. make sure this gets added to docs
> 3. let's make a jira for this.
> 4. just drop them then.
> 5. https://github.com/apache/mahout/blob/trunk/distribution/KEYS
>
>
>
> On Tue, Jun 30, 2020 at 2:42 AM Christofer Dutz  >
> wrote:
>
> > Hi folks,
> >
> > some things I noticed:
> >
> > 1) You're using the Nexus Staging Repo ... I know most Apache projects
> use
> > the apache SVN for officially staging the release
> > 2) The source-repo is missing the RELEASE_NOTES which usually goes
> > alongside the source bundle.
> > 3) (this might be the most serious issue) you are using SHA1 hashes and
> > Apache wants us to use SHA512 hashes (The build does provide these, but
> > doesn't automatically deploy them) (
> > https://infra.apache.org/release-distribution.html)
> > 4) MD5 are also considered deprecated
> > 5) Where's your KEYS file? I need that to validate the signatures.
> >
> > Chris
> >
> >
> >
> > Am 30.06.20, 07:11 schrieb "Andrew Musselman" :
> >
> > Thanks to some great work by Chris Dutz, RC1 for 14.1 release is out!
> > Please go try it out, check signatures and checksums, etc.
> >
> > Binaries:
> >
> >
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/apache-mahout-distribution/14.1/
> >
> > Source:
> >
> >
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/mahout/14.1/
> >
> > Best
> > Andrew
> >
> >
>


Re: RC1 for 14.1

2020-06-30 Thread Trevor Grant
1. Interesting on the Nexux- who knows who set that up- what are the
pro/cons of nexus v SVN?
2. make sure this gets added to docs
3. let's make a jira for this.
4. just drop them then.
5. https://github.com/apache/mahout/blob/trunk/distribution/KEYS



On Tue, Jun 30, 2020 at 2:42 AM Christofer Dutz 
wrote:

> Hi folks,
>
> some things I noticed:
>
> 1) You're using the Nexus Staging Repo ... I know most Apache projects use
> the apache SVN for officially staging the release
> 2) The source-repo is missing the RELEASE_NOTES which usually goes
> alongside the source bundle.
> 3) (this might be the most serious issue) you are using SHA1 hashes and
> Apache wants us to use SHA512 hashes (The build does provide these, but
> doesn't automatically deploy them) (
> https://infra.apache.org/release-distribution.html)
> 4) MD5 are also considered deprecated
> 5) Where's your KEYS file? I need that to validate the signatures.
>
> Chris
>
>
>
> Am 30.06.20, 07:11 schrieb "Andrew Musselman" :
>
> Thanks to some great work by Chris Dutz, RC1 for 14.1 release is out!
> Please go try it out, check signatures and checksums, etc.
>
> Binaries:
>
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/apache-mahout-distribution/14.1/
>
> Source:
>
> https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/mahout/14.1/
>
> Best
> Andrew
>
>


Re: RC1 for 14.1

2020-06-30 Thread Christofer Dutz
Hi folks,

some things I noticed:

1) You're using the Nexus Staging Repo ... I know most Apache projects use the 
apache SVN for officially staging the release
2) The source-repo is missing the RELEASE_NOTES which usually goes alongside 
the source bundle.
3) (this might be the most serious issue) you are using SHA1 hashes and Apache 
wants us to use SHA512 hashes (The build does provide these, but doesn't 
automatically deploy them) (https://infra.apache.org/release-distribution.html)
4) MD5 are also considered deprecated
5) Where's your KEYS file? I need that to validate the signatures.

Chris



Am 30.06.20, 07:11 schrieb "Andrew Musselman" :

Thanks to some great work by Chris Dutz, RC1 for 14.1 release is out!
Please go try it out, check signatures and checksums, etc.

Binaries:

https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/apache-mahout-distribution/14.1/

Source:

https://repository.apache.org/content/repositories/orgapachemahout-1062/org/apache/mahout/mahout/14.1/

Best
Andrew