Repository: bigtop Updated Branches: refs/heads/master 91e0670db -> da63141dd
BIGTOP-2924. Bring back 1.2.1 changes into master Project: http://git-wip-us.apache.org/repos/asf/bigtop/repo Commit: http://git-wip-us.apache.org/repos/asf/bigtop/commit/da63141d Tree: http://git-wip-us.apache.org/repos/asf/bigtop/tree/da63141d Diff: http://git-wip-us.apache.org/repos/asf/bigtop/diff/da63141d Branch: refs/heads/master Commit: da63141dd80ce5687a85c2135ded9e5af986ccd6 Parents: 91e0670 Author: Evans Ye <[email protected]> Authored: Tue Nov 14 22:38:31 2017 +0800 Committer: Evans Ye <[email protected]> Committed: Tue Nov 14 23:06:04 2017 +0800 ---------------------------------------------------------------------- CHANGES.txt | 102 ++++++++++ bigtop-deploy/puppet/README.md | 2 +- bigtop-deploy/puppet/manifests/bigtop_repo.pp | 4 +- .../pseudo-cluster/config/hieradata/site.yaml | 2 +- docker/sandbox/build.sh | 2 +- docker/sandbox/sandbox-env.sh | 2 +- .../sandbox/site.yaml.template.centos-6_hadoop | 2 +- .../sandbox/site.yaml.template.debian-8_hadoop | 2 +- provisioner/docker/config_centos-6.yaml | 2 +- provisioner/docker/config_centos-7.yaml | 2 +- provisioner/docker/config_debian-8.yaml | 2 +- provisioner/docker/config_ubuntu-16.04.yaml | 2 +- provisioner/vagrant/vagrantconfig.yaml | 2 +- src/site/site.xml | 1 + src/site/xdoc/download.xml | 4 +- src/site/xdoc/index.xml | 2 +- src/site/xdoc/release-notes.xml | 200 +++++++++++++++++++ 17 files changed, 319 insertions(+), 16 deletions(-) ---------------------------------------------------------------------- http://git-wip-us.apache.org/repos/asf/bigtop/blob/da63141d/CHANGES.txt ---------------------------------------------------------------------- diff --git a/CHANGES.txt b/CHANGES.txt index 40eb91a..1c4ecb0 100644 --- a/CHANGES.txt +++ b/CHANGES.txt @@ -15,6 +15,108 @@ Bigtop Changelog +* Release 1.2.1 (2017-10-24) + +Release Notes - Bigtop - Version 1.2.1 + +** Sub-task + * [BIGTOP-2165] - ignite-hadoop service doesn't start + * [BIGTOP-2396] - Create CI jobs for new Docker Provisioner + * [BIGTOP-2758] - [Sandbox] Support dryrun in build script + * [BIGTOP-2760] - [Sandbox] Upgrade to Bigtop 1.2 + * [BIGTOP-2761] - Remove bigtop-deploy image build scripts + * [BIGTOP-2767] - Auto detect repo does not need OS code name since 1.2.0 + * [BIGTOP-2769] - OS_TO_CODE_NAME has been removed in BIGTOP-2767 + * [BIGTOP-2772] - [Sandbox] Add --dryrun mode into helper script and document + * [BIGTOP-2814] - Make provisioner config names be consistent with OS names in CI + * [BIGTOP-2815] - Puppet should be able to generate multiple repo files + * [BIGTOP-2816] - Fix provisioner config name for ubuntu-16.04 + +** Bug + * [BIGTOP-2295] - Docker tests should consume current builds + * [BIGTOP-2679] - Streamline CI Jobs + * [BIGTOP-2716] - Solr build failed when OpenJDK8u_121 is used + * [BIGTOP-2729] - AMBARI-20686: Add ID to allow compilation with recent maven + * [BIGTOP-2737] - Spark charm doesn't handle HA or examples well + * [BIGTOP-2738] - spark-worker fails to start + * [BIGTOP-2740] - hbase 1.1.3 does not work on ppc64le + * [BIGTOP-2743] - hbase shell does not work on ppc64le + * [BIGTOP-2748] - Fix a puppet compatibilty issue + * [BIGTOP-2749] - puppet: use jessie package on jessie, not trusty + * [BIGTOP-2750] - puppet: increase compatibility with future versions + * [BIGTOP-2751] - ambari: Storm 1.1.0-SNAPSHOT is no longer available, use released version + * [BIGTOP-2753] - Initial support for Debian-9 + * [BIGTOP-2754] - Revert BIGTOP-2730: Upgrade Zookeeper to version 3.4.10 + * [BIGTOP-2755] - Gradle needs cacerts file in place on fedora + * [BIGTOP-2756] - Get rid of Permission Denied when creating/destroying Docker Provisioner cluster + * [BIGTOP-2762] - Zeppelin installation failed due to JDK not installed + * [BIGTOP-2763] - Add /user/zeppelin directory for running Spark job on YARN in Zeppelin + * [BIGTOP-2764] - deployment failure when roles include spark::common and spark::yarn* + * [BIGTOP-2765] - fix roles logic for spark/zeppelin charms + * [BIGTOP-2766] - [Puppet] Spark worker startup failed due to default master_url is yarn + * [BIGTOP-2771] - ambari: build failed due to using third-party ConcurrentHashMap instead of the standard one unnecessarily + * [BIGTOP-2774] - gradlew toolchain does not work on Ubuntu 16.04.2/Puppet 3.8.5 + * [BIGTOP-2775] - Make open jdk 8 available on bigtop/puppet:debian-8 + * [BIGTOP-2781] - [Provisioner] 127.0.0.1 does not successfully inserted after BIGTOP-2756 + * [BIGTOP-2788] - Corrects Apex patch for version 3.6.0 + * [BIGTOP-2789] - Ambari: installing ODPi mpack fails due to changing its file name + * [BIGTOP-2790] - Ambari: deploying cluster fails due to ambari-agent version mismatch + * [BIGTOP-2793] - BIGTOP-2790 broke Ambari build on rpm-based system + * [BIGTOP-2796] - Bigtop Zookeeper(3.4.6) package conflict with Ubuntu 16.04 Zookeeper(3.4.8) + * [BIGTOP-2797] - zeppelin charm external role handling + * [BIGTOP-2798] - Apex component has duplicate slf4j binding + * [BIGTOP-2799] - [Puppet] Flink deployment failure on all supported OS + * [BIGTOP-2800] - provisioner fails for kerberos on centos-7 + * [BIGTOP-2801] - charm race condition when gathering metrics + * [BIGTOP-2803] - Minor issues in bigtop.bom + * [BIGTOP-2805] - ycsb: turn of autodetection of dependencies by rpm + * [BIGTOP-2806] - hue is not installable on debian, ubuntu + * [BIGTOP-2808] - Handle deletion of symlinks: update gradle + * [BIGTOP-2826] - Zeppelin RPM is broken: "missing" osgi package deps + * [BIGTOP-2829] - [iTest] build failed during Maven integration test phase + * [BIGTOP-2832] - Toolchain failed to install on Debian 8 + * [BIGTOP-2850] - Not able to build bigtop/slaves image for OpenSuSE 42.1 + * [BIGTOP-2870] - testHCFS should be using USER_NAME for expected output + * [BIGTOP-2871] - Make run_itest report Standard Error from tests to stderr + * [BIGTOP-2873] - A few cosmetic changes to run_itest.sh output + * [BIGTOP-2879] - BIGTOP-2749 breaks deployments on Debian-8 + * [BIGTOP-2890] - Download page must not link to snapshots / nightly builds + * [BIGTOP-2891] - Download page must link to ASF mirrors + * [BIGTOP-2900] - Crunch build failed because of OS OOM killer on OpenJDK 1.8.0-144 + * [BIGTOP-2901] - disable GPDB because of build failure on OpenSuSE 42.1 + * [BIGTOP-2903] - update protobuf rpm links + * [BIGTOP-2908] - giraph charm: release audit failure + +** Improvement + * [BIGTOP-2355] - Update Mahout version to 0.13.0 + * [BIGTOP-2677] - layer-spark: Improve sparkpi action output + * [BIGTOP-2730] - Bump zookeeper to 3.4.10 + * [BIGTOP-2770] - Juju charm/bundle refresh + * [BIGTOP-2777] - make hbase charm more robust + * [BIGTOP-2778] - Delete PermSize / MaxPermsize options, no longer support by Java 8 + * [BIGTOP-2783] - new charm icons for zookeeper and zeppelin + * [BIGTOP-2795] - spark charm: fix sparkpi and rework start/stop logic + * [BIGTOP-2802] - Some packages don't create necessary groups on debian-based system if the users correspond to them already exist + * [BIGTOP-2807] - Upgrade Spark to 2.1.1 + * [BIGTOP-2812] - Upgrade Zeppelin version to 0.7.2 + * [BIGTOP-2819] - Polish the README.md for 1.2.1 release + * [BIGTOP-2821] - expose extra config options for spark + * [BIGTOP-2827] - juju bundle refresh (june 2017) + * [BIGTOP-2828] - Since BIGTOP-2775 JDK version has been specified by Bigtop Puppet + +** New Feature + * [BIGTOP-2253] - Rewrite Bigtop Docker Provisioner to use native solutions and support multi-host cluster deployment + * [BIGTOP-2779] - new hive charm + * [BIGTOP-2822] - spark charm: leverage puppet config, gpu enablement + +** Task + * [BIGTOP-2739] - refresh juju bundles with latest charm revs + * [BIGTOP-2747] - new charm revs for bigtop-1.2 + * [BIGTOP-2776] - Bump Apache Apex version to 3.6.0 + * [BIGTOP-2785] - Define Bigtop 1.2.1 release BOM + * [BIGTOP-2786] - Push Bigtop 1.2.1 Docker build slaves to Docker Hub + * [BIGTOP-2877] - Drop Kite packaging + * Release 1.2.0 (2017-04-04) Release Notes - Bigtop - Version 1.2.0 http://git-wip-us.apache.org/repos/asf/bigtop/blob/da63141d/bigtop-deploy/puppet/README.md ---------------------------------------------------------------------- diff --git a/bigtop-deploy/puppet/README.md b/bigtop-deploy/puppet/README.md index ddb79a5..201e172 100644 --- a/bigtop-deploy/puppet/README.md +++ b/bigtop-deploy/puppet/README.md @@ -136,7 +136,7 @@ hadoop_cluster_node::cluster_components: - spark - yarn - zookeeper -bigtop::bigtop_repo_uri: "http://bigtop-repos.s3.amazonaws.com/releases/1.2.0/ubuntu/16.04/x86_64" +bigtop::bigtop_repo_uri: "http://repos.bigtop.apache.org/releases/1.2.1/ubuntu/16.04/x86_64" ``` And finally execute http://git-wip-us.apache.org/repos/asf/bigtop/blob/da63141d/bigtop-deploy/puppet/manifests/bigtop_repo.pp ---------------------------------------------------------------------- diff --git a/bigtop-deploy/puppet/manifests/bigtop_repo.pp b/bigtop-deploy/puppet/manifests/bigtop_repo.pp index ed22f81..ce17858 100644 --- a/bigtop-deploy/puppet/manifests/bigtop_repo.pp +++ b/bigtop-deploy/puppet/manifests/bigtop_repo.pp @@ -16,7 +16,7 @@ class bigtop_repo { case $::operatingsystem { /(OracleLinux|Amazon|CentOS|Fedora|RedHat)/: { - $default_repo = "http://bigtop-repos.s3.amazonaws.com/releases/1.2.0/centos/7/x86_64" + $default_repo = "http://repos.bigtop.apache.org/releases/1.2.1/centos/7/x86_64" $baseurls_array = any2array(hiera("bigtop::bigtop_repo_uri", $default_repo)) each ($baseurls_array) |$count, $baseurl| { yumrepo { "Bigtop_$count": @@ -36,7 +36,7 @@ class bigtop_repo { $lower_os = downcase($operatingsystem) # We use code name such as trusty for Ubuntu instead of release version in bigtop's binary convenience repos if ($operatingsystem == "Ubuntu") { $release = $lsbdistcodename } else { $release = $operatingsystemmajrelease } - $default_repo = "http://bigtop-repos.s3.amazonaws.com/releases/1.2.0/${lower_os}/${release}/x86_64" + $default_repo = "http://repos.bigtop.apache.org/releases/1.2.1/${lower_os}/${release}/x86_64" $baseurls_array = any2array(hiera("bigtop::bigtop_repo_uri", $default_repo)) # I couldn't enforce the sequence -> anymore because of this http://git-wip-us.apache.org/repos/asf/bigtop/blob/da63141d/docker/pseudo-cluster/config/hieradata/site.yaml ---------------------------------------------------------------------- diff --git a/docker/pseudo-cluster/config/hieradata/site.yaml b/docker/pseudo-cluster/config/hieradata/site.yaml index eb33840..45d6172 100644 --- a/docker/pseudo-cluster/config/hieradata/site.yaml +++ b/docker/pseudo-cluster/config/hieradata/site.yaml @@ -6,5 +6,5 @@ hadoop_cluster_node::cluster_components: - hdfs - yarn - mapreduce -bigtop::bigtop_repo_uri: http://bigtop-repos.s3.amazonaws.com/releases/1.2.0/ubuntu/16.04/x86_64 +bigtop::bigtop_repo_uri: http://repos.bigtop.apache.org/releases/1.2.1/ubuntu/16.04/x86_64 http://git-wip-us.apache.org/repos/asf/bigtop/blob/da63141d/docker/sandbox/build.sh ---------------------------------------------------------------------- diff --git a/docker/sandbox/build.sh b/docker/sandbox/build.sh index c8afdcb..a443b37 100755 --- a/docker/sandbox/build.sh +++ b/docker/sandbox/build.sh @@ -65,7 +65,7 @@ generate_tag() { detect_repo() { OS_SEP_BY_SLASH=${OS/-//} - REPO=${REPO:-"http://bigtop-repos.s3.amazonaws.com/releases/${BIGTOP_VERSION}/${OS_SEP_BY_SLASH}/$HOSTTYPE"} + REPO=${REPO:-"http://repos.bigtop.apache.org/releases/${BIGTOP_VERSION}/${OS_SEP_BY_SLASH}/$HOSTTYPE"} } image_config_validator() { http://git-wip-us.apache.org/repos/asf/bigtop/blob/da63141d/docker/sandbox/sandbox-env.sh ---------------------------------------------------------------------- diff --git a/docker/sandbox/sandbox-env.sh b/docker/sandbox/sandbox-env.sh index 4d10c96..fa15e2a 100644 --- a/docker/sandbox/sandbox-env.sh +++ b/docker/sandbox/sandbox-env.sh @@ -15,7 +15,7 @@ # See the License for the specific language governing permissions and # limitations under the License. -BIGTOP_VERSION=1.2.0 +BIGTOP_VERSION=1.2.1 # REPO="YOUR CUSTOM REPO" RPMS=( \ http://git-wip-us.apache.org/repos/asf/bigtop/blob/da63141d/docker/sandbox/site.yaml.template.centos-6_hadoop ---------------------------------------------------------------------- diff --git a/docker/sandbox/site.yaml.template.centos-6_hadoop b/docker/sandbox/site.yaml.template.centos-6_hadoop index db49e48..6e8caf2 100644 --- a/docker/sandbox/site.yaml.template.centos-6_hadoop +++ b/docker/sandbox/site.yaml.template.centos-6_hadoop @@ -15,5 +15,5 @@ bigtop::hadoop_head_node: "head.node.fqdn" hadoop::hadoop_storage_dirs: [/data/1, /data/2] -bigtop::bigtop_repo_uri: http://bigtop-repos.s3.amazonaws.com/releases/1.2.0/centos/6/x86_64 +bigtop::bigtop_repo_uri: http://repos.bigtop.apache.org/releases/1.2.1/centos/6/x86_64 hadoop_cluster_node::cluster_components: [hdfs, yarn, mapred-app] http://git-wip-us.apache.org/repos/asf/bigtop/blob/da63141d/docker/sandbox/site.yaml.template.debian-8_hadoop ---------------------------------------------------------------------- diff --git a/docker/sandbox/site.yaml.template.debian-8_hadoop b/docker/sandbox/site.yaml.template.debian-8_hadoop index 1bbae6c..3c32a69 100644 --- a/docker/sandbox/site.yaml.template.debian-8_hadoop +++ b/docker/sandbox/site.yaml.template.debian-8_hadoop @@ -15,5 +15,5 @@ bigtop::hadoop_head_node: "head.node.fqdn" hadoop::hadoop_storage_dirs: [/data/1, /data/2] -bigtop::bigtop_repo_uri: http://bigtop-repos.s3.amazonaws.com/releases/1.2.0/debian/8/x86_64 +bigtop::bigtop_repo_uri: http://repos.bigtop.apache.org/releases/1.2.1/debian/8/x86_64 hadoop_cluster_node::cluster_components: [hdfs, yarn, mapred-app] http://git-wip-us.apache.org/repos/asf/bigtop/blob/da63141d/provisioner/docker/config_centos-6.yaml ---------------------------------------------------------------------- diff --git a/provisioner/docker/config_centos-6.yaml b/provisioner/docker/config_centos-6.yaml index 7912aca..5f78986 100644 --- a/provisioner/docker/config_centos-6.yaml +++ b/provisioner/docker/config_centos-6.yaml @@ -17,7 +17,7 @@ docker: memory_limit: "4g" image: "bigtop/puppet:centos-6" -repo: "http://bigtop-repos.s3.amazonaws.com/releases/1.2.0/centos/6/x86_64" +repo: "http://repos.bigtop.apache.org/releases/1.2.1/centos/6/x86_64" distro: centos components: [hdfs, yarn, mapreduce] enable_local_repo: false http://git-wip-us.apache.org/repos/asf/bigtop/blob/da63141d/provisioner/docker/config_centos-7.yaml ---------------------------------------------------------------------- diff --git a/provisioner/docker/config_centos-7.yaml b/provisioner/docker/config_centos-7.yaml index 6cdd7cf..3b1b0e0 100644 --- a/provisioner/docker/config_centos-7.yaml +++ b/provisioner/docker/config_centos-7.yaml @@ -17,7 +17,7 @@ docker: memory_limit: "4g" image: "bigtop/puppet:centos-7" -repo: "http://bigtop-repos.s3.amazonaws.com/releases/1.2.0/centos/7/x86_64" +repo: "http://repos.bigtop.apache.org/releases/1.2.1/centos/7/x86_64" distro: centos components: [hdfs, yarn, mapreduce] enable_local_repo: false http://git-wip-us.apache.org/repos/asf/bigtop/blob/da63141d/provisioner/docker/config_debian-8.yaml ---------------------------------------------------------------------- diff --git a/provisioner/docker/config_debian-8.yaml b/provisioner/docker/config_debian-8.yaml index c1a468a..41a6cbe 100644 --- a/provisioner/docker/config_debian-8.yaml +++ b/provisioner/docker/config_debian-8.yaml @@ -17,7 +17,7 @@ docker: memory_limit: "4g" image: "bigtop/puppet:debian-8" -repo: "http://bigtop-repos.s3.amazonaws.com/releases/1.2.0/debian/8/x86_64" +repo: "http://repos.bigtop.apache.org/releases/1.2.1/debian/8/x86_64" distro: debian components: [hdfs, yarn, mapreduce] enable_local_repo: false http://git-wip-us.apache.org/repos/asf/bigtop/blob/da63141d/provisioner/docker/config_ubuntu-16.04.yaml ---------------------------------------------------------------------- diff --git a/provisioner/docker/config_ubuntu-16.04.yaml b/provisioner/docker/config_ubuntu-16.04.yaml index 54c91f7..2568377 100644 --- a/provisioner/docker/config_ubuntu-16.04.yaml +++ b/provisioner/docker/config_ubuntu-16.04.yaml @@ -17,7 +17,7 @@ docker: memory_limit: "4g" image: "bigtop/puppet:ubuntu-16.04" -repo: "http://bigtop-repos.s3.amazonaws.com/releases/1.2.0/ubuntu/16.04/x86_64" +repo: "http://repos.bigtop.apache.org/releases/1.2.1/ubuntu/16.04/x86_64" distro: debian components: [hdfs, yarn, mapreduce] enable_local_repo: false http://git-wip-us.apache.org/repos/asf/bigtop/blob/da63141d/provisioner/vagrant/vagrantconfig.yaml ---------------------------------------------------------------------- diff --git a/provisioner/vagrant/vagrantconfig.yaml b/provisioner/vagrant/vagrantconfig.yaml index 54604b0..c5dd644 100644 --- a/provisioner/vagrant/vagrantconfig.yaml +++ b/provisioner/vagrant/vagrantconfig.yaml @@ -16,7 +16,7 @@ memory_size: 4096 number_cpus: 1 box: "puppetlabs/centos-7.2-64-nocm" -repo: "http://bigtop-repos.s3.amazonaws.com/releases/1.2.0/centos/7/x86_64" +repo: "http://repos.bigtop.apache.org/releases/1.2.1/centos/7/x86_64" num_instances: 1 distro: centos components: [hdfs, yarn, mapreduce] http://git-wip-us.apache.org/repos/asf/bigtop/blob/da63141d/src/site/site.xml ---------------------------------------------------------------------- diff --git a/src/site/site.xml b/src/site/site.xml index 668da9b..334ccab 100644 --- a/src/site/site.xml +++ b/src/site/site.xml @@ -67,6 +67,7 @@ <item name="Release Notes" href="release-notes.html"/> <item name="1.1.0" href="http://www.apache.org/dyn/closer.lua/bigtop/bigtop-1.1.0/"/> <item name="1.2.0" href="http://www.apache.org/dyn/closer.lua/bigtop/bigtop-1.2.0/"/> + <item name="1.2.1" href="http://www.apache.org/dyn/closer.lua/bigtop/bigtop-1.2.1/"/> </menu> <menu name="Project Information"> http://git-wip-us.apache.org/repos/asf/bigtop/blob/da63141d/src/site/xdoc/download.xml ---------------------------------------------------------------------- diff --git a/src/site/xdoc/download.xml b/src/site/xdoc/download.xml index acf652d..53f111b 100644 --- a/src/site/xdoc/download.xml +++ b/src/site/xdoc/download.xml @@ -35,12 +35,12 @@ <ul> <li> The latest release of Apache Bigtop software framework <br/> - <a href="http://www.apache.org/dyn/closer.lua/bigtop/bigtop-1.2.0/">Bigtop 1.2.0</a> + <a href="http://www.apache.org/dyn/closer.lua/bigtop/bigtop-1.2.1/">Bigtop 1.2.1</a> </li> <li> Repositories of instsallable binary packages built with latest release of the Apache Bitop project <br/> - <a href="https://www.apache.org/dist/bigtop/bigtop-1.2.0/repos/">Installable binary artifacts</a> + <a href="https://www.apache.org/dist/bigtop/bigtop-1.2.1/repos/">Installable binary artifacts</a> </li> </ul> </section> http://git-wip-us.apache.org/repos/asf/bigtop/blob/da63141d/src/site/xdoc/index.xml ---------------------------------------------------------------------- diff --git a/src/site/xdoc/index.xml b/src/site/xdoc/index.xml index 04a6761..bab0787 100644 --- a/src/site/xdoc/index.xml +++ b/src/site/xdoc/index.xml @@ -53,7 +53,7 @@ <br /> <subsection name="Download latest release of Bigtop"></subsection> - <p><a href="download.html#releases">Bigtop-1.2.0</a> </p> + <p><a href="download.html#releases">Bigtop-1.2.1</a> </p> <subsection name="All required tools will be installed by ./gradlew toolchain"></subsection> <p>However place supply a suitable JRE (for instance openjdk7) first</p> http://git-wip-us.apache.org/repos/asf/bigtop/blob/da63141d/src/site/xdoc/release-notes.xml ---------------------------------------------------------------------- diff --git a/src/site/xdoc/release-notes.xml b/src/site/xdoc/release-notes.xml index 638f9c6..efe1f15 100644 --- a/src/site/xdoc/release-notes.xml +++ b/src/site/xdoc/release-notes.xml @@ -17,6 +17,206 @@ <section name="Bigtop Project Release Notes"> <!-- Paste release notes from https://issues.apache.org/jira/browse/BIGTOP here. --> + <h3>Release Notes - Bigtop - Version 1.2.1</h3> + +<h2> Sub-task +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2165'>BIGTOP-2165</a>] - ignite-hadoop service doesn't start +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2396'>BIGTOP-2396</a>] - Create CI jobs for new Docker Provisioner +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2758'>BIGTOP-2758</a>] - [Sandbox] Support dryrun in build script +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2760'>BIGTOP-2760</a>] - [Sandbox] Upgrade to Bigtop 1.2 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2761'>BIGTOP-2761</a>] - Remove bigtop-deploy image build scripts +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2767'>BIGTOP-2767</a>] - Auto detect repo does not need OS code name since 1.2.0 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2769'>BIGTOP-2769</a>] - OS_TO_CODE_NAME has been removed in BIGTOP-2767 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2772'>BIGTOP-2772</a>] - [Sandbox] Add --dryrun mode into helper script and document +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2814'>BIGTOP-2814</a>] - Make provisioner config names be consistent with OS names in CI +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2815'>BIGTOP-2815</a>] - Puppet should be able to generate multiple repo files +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2816'>BIGTOP-2816</a>] - Fix provisioner config name for ubuntu-16.04 +</li> +</ul> +<h2> Bug +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2295'>BIGTOP-2295</a>] - Docker tests should consume current builds +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2679'>BIGTOP-2679</a>] - Streamline CI Jobs +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2716'>BIGTOP-2716</a>] - Solr build failed when OpenJDK8u_121 is used +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2729'>BIGTOP-2729</a>] - AMBARI-20686: Add ID to allow compilation with recent maven +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2737'>BIGTOP-2737</a>] - Spark charm doesn't handle HA or examples well +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2738'>BIGTOP-2738</a>] - spark-worker fails to start +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2740'>BIGTOP-2740</a>] - hbase 1.1.3 does not work on ppc64le +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2743'>BIGTOP-2743</a>] - hbase shell does not work on ppc64le +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2748'>BIGTOP-2748</a>] - Fix a puppet compatibilty issue +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2749'>BIGTOP-2749</a>] - puppet: use jessie package on jessie, not trusty +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2750'>BIGTOP-2750</a>] - puppet: increase compatibility with future versions +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2751'>BIGTOP-2751</a>] - ambari: Storm 1.1.0-SNAPSHOT is no longer available, use released version +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2753'>BIGTOP-2753</a>] - Initial support for Debian-9 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2754'>BIGTOP-2754</a>] - Revert BIGTOP-2730: Upgrade Zookeeper to version 3.4.10 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2755'>BIGTOP-2755</a>] - Gradle needs cacerts file in place on fedora +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2756'>BIGTOP-2756</a>] - Get rid of Permission Denied when creating/destroying Docker Provisioner cluster +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2762'>BIGTOP-2762</a>] - Zeppelin installation failed due to JDK not installed +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2763'>BIGTOP-2763</a>] - Add /user/zeppelin directory for running Spark job on YARN in Zeppelin +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2764'>BIGTOP-2764</a>] - deployment failure when roles include spark::common and spark::yarn* +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2765'>BIGTOP-2765</a>] - fix roles logic for spark/zeppelin charms +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2766'>BIGTOP-2766</a>] - [Puppet] Spark worker startup failed due to default master_url is yarn +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2771'>BIGTOP-2771</a>] - ambari: build failed due to using third-party ConcurrentHashMap instead of the standard one unnecessarily +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2774'>BIGTOP-2774</a>] - gradlew toolchain does not work on Ubuntu 16.04.2/Puppet 3.8.5 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2775'>BIGTOP-2775</a>] - Make open jdk 8 available on bigtop/puppet:debian-8 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2781'>BIGTOP-2781</a>] - [Provisioner] 127.0.0.1 does not successfully inserted after BIGTOP-2756 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2788'>BIGTOP-2788</a>] - Corrects Apex patch for version 3.6.0 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2789'>BIGTOP-2789</a>] - Ambari: installing ODPi mpack fails due to changing its file name +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2790'>BIGTOP-2790</a>] - Ambari: deploying cluster fails due to ambari-agent version mismatch +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2793'>BIGTOP-2793</a>] - BIGTOP-2790 broke Ambari build on rpm-based system +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2796'>BIGTOP-2796</a>] - Bigtop Zookeeper(3.4.6) package conflict with Ubuntu 16.04 Zookeeper(3.4.8) +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2797'>BIGTOP-2797</a>] - zeppelin charm external role handling +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2798'>BIGTOP-2798</a>] - Apex component has duplicate slf4j binding +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2799'>BIGTOP-2799</a>] - [Puppet] Flink deployment failure on all supported OS +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2800'>BIGTOP-2800</a>] - provisioner fails for kerberos on centos-7 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2801'>BIGTOP-2801</a>] - charm race condition when gathering metrics +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2803'>BIGTOP-2803</a>] - Minor issues in bigtop.bom +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2805'>BIGTOP-2805</a>] - ycsb: turn of autodetection of dependencies by rpm +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2806'>BIGTOP-2806</a>] - hue is not installable on debian, ubuntu +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2808'>BIGTOP-2808</a>] - Handle deletion of symlinks: update gradle +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2826'>BIGTOP-2826</a>] - Zeppelin RPM is broken: "missing" osgi package deps +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2829'>BIGTOP-2829</a>] - [iTest] build failed during Maven integration test phase +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2832'>BIGTOP-2832</a>] - Toolchain failed to install on Debian 8 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2850'>BIGTOP-2850</a>] - Not able to build bigtop/slaves image for OpenSuSE 42.1 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2870'>BIGTOP-2870</a>] - testHCFS should be using USER_NAME for expected output +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2871'>BIGTOP-2871</a>] - Make run_itest report Standard Error from tests to stderr +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2873'>BIGTOP-2873</a>] - A few cosmetic changes to run_itest.sh output +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2879'>BIGTOP-2879</a>] - BIGTOP-2749 breaks deployments on Debian-8 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2890'>BIGTOP-2890</a>] - Download page must not link to snapshots / nightly builds +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2891'>BIGTOP-2891</a>] - Download page must link to ASF mirrors +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2900'>BIGTOP-2900</a>] - Crunch build failed because of OS OOM killer on OpenJDK 1.8.0-144 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2901'>BIGTOP-2901</a>] - disable GPDB because of build failure on OpenSuSE 42.1 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2903'>BIGTOP-2903</a>] - update protobuf rpm links +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2908'>BIGTOP-2908</a>] - giraph charm: release audit failure +</li> +</ul> +<h2> Improvement +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2355'>BIGTOP-2355</a>] - Update Mahout version to 0.13.0 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2677'>BIGTOP-2677</a>] - layer-spark: Improve sparkpi action output +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2730'>BIGTOP-2730</a>] - Bump zookeeper to 3.4.10 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2770'>BIGTOP-2770</a>] - Juju charm/bundle refresh +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2777'>BIGTOP-2777</a>] - make hbase charm more robust +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2778'>BIGTOP-2778</a>] - Delete PermSize / MaxPermsize options, no longer support by Java 8 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2783'>BIGTOP-2783</a>] - new charm icons for zookeeper and zeppelin +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2795'>BIGTOP-2795</a>] - spark charm: fix sparkpi and rework start/stop logic +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2802'>BIGTOP-2802</a>] - Some packages don't create necessary groups on debian-based system if the users correspond to them already exist +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2807'>BIGTOP-2807</a>] - Upgrade Spark to 2.1.1 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2812'>BIGTOP-2812</a>] - Upgrade Zeppelin version to 0.7.2 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2819'>BIGTOP-2819</a>] - Polish the README.md for 1.2.1 release +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2821'>BIGTOP-2821</a>] - expose extra config options for spark +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2827'>BIGTOP-2827</a>] - juju bundle refresh (june 2017) +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2828'>BIGTOP-2828</a>] - Since BIGTOP-2775 JDK version has been specified by Bigtop Puppet +</li> +</ul> +<h2> New Feature +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2253'>BIGTOP-2253</a>] - Rewrite Bigtop Docker Provisioner to use native solutions and support multi-host cluster deployment +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2779'>BIGTOP-2779</a>] - new hive charm +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2822'>BIGTOP-2822</a>] - spark charm: leverage puppet config, gpu enablement +</li> +</ul> +<h2> Task +</h2> +<ul> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2739'>BIGTOP-2739</a>] - refresh juju bundles with latest charm revs +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2747'>BIGTOP-2747</a>] - new charm revs for bigtop-1.2 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2776'>BIGTOP-2776</a>] - Bump Apache Apex version to 3.6.0 +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2785'>BIGTOP-2785</a>] - Define Bigtop 1.2.1 release BOM +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2786'>BIGTOP-2786</a>] - Push Bigtop 1.2.1 Docker build slaves to Docker Hub +</li> +<li>[<a href='https://issues.apache.org/jira/browse/BIGTOP-2877'>BIGTOP-2877</a>] - Drop Kite packaging +</li> +</ul> + + <h3>Release Notes - Bigtop - Version 1.2.0</h3> <h2> Sub-task
