How to reproduce: 1) Add Bigtop 1.2 repository wget -O- http://archive.apache.org/dist/bigtop/bigtop-1.2.0/repos/GPG-KEY-bigtop | sudo apt-key add - wget -O /etc/apt/sources.list.d/bigtop-1.2.0.list https://www.apache.org/dist/bigtop/bigtop-1.2.0/repos/ubuntu16.04/bigtop.list sudo apt-get -y update 2) Query for spark packages by executing command "apt list | grep spark" result: spark-core/stable,now 2.1.0-1 all [installed] spark-datanucleus/stable 2.1.0-1 all spark-external/stable 2.1.0-1 all spark-extras/stable 1.6.2-1 all spark-history-server/stable,now 2.1.0-1 all [installed] spark-master/stable,now 2.1.0-1 all [installed] spark-python/stable 2.1.0-1 all spark-thriftserver/stable 2.1.0-1 all spark-worker/stable,now 2.1.0-1 all [installed] spark-yarn-shuffle/stable 2.1.0-1 all
On Tue, Apr 11, 2017 at 1:29 PM, Evans Ye <[email protected]> wrote: > We still packages spark1 to workaround some components compatibility issue. > I guess that's why you got 1.6.2 available from 1.2 repo. > > How you get these packages installed? > > 2017-04-12 0:53 GMT+08:00 MrAsanjar . <[email protected]>: > > > Hi team, > > Could anyone explain why we have spark-extras , a spark 1.6 package, > > added to the ubuntu-16.04 repository for Bigtop 1.2? It should be all > > spark 2.1 packages and not 1.6. > > > > List of spark packages in Bigtop 1.2 repo: > > > > spark-core/stable,now 2.1.0-1 all [installed] > > spark-datanucleus/stable 2.1.0-1 all > > spark-external/stable 2.1.0-1 all > > spark-extras/stable 1.6.2-1 all <<<<< it should not be there, correct? > > spark-history-server/stable,now 2.1.0-1 all [installed] > > spark-master/stable,now 2.1.0-1 all [installed] > > spark-python/stable 2.1.0-1 all > > spark-thriftserver/stable 2.1.0-1 all > > spark-worker/stable,now 2.1.0-1 all [installed] > > spark-yarn-shuffle/stable 2.1.0-1 all > > >
