http://git-wip-us.apache.org/repos/asf/accumulo-website/blob/c0655661/release/accumulo-1.5.1/index.html ---------------------------------------------------------------------- diff --git a/release/accumulo-1.5.1/index.html b/release/accumulo-1.5.1/index.html new file mode 100644 index 0000000..247b3df --- /dev/null +++ b/release/accumulo-1.5.1/index.html @@ -0,0 +1,408 @@ +<!DOCTYPE html> +<html lang="en"> +<head> +<!-- + Licensed to the Apache Software Foundation (ASF) under one or more + contributor license agreements. See the NOTICE file distributed with + this work for additional information regarding copyright ownership. + The ASF licenses this file to You under the Apache License, Version 2.0 + (the "License"); you may not use this file except in compliance with + the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. +--> +<meta charset="utf-8"> +<meta http-equiv="X-UA-Compatible" content="IE=edge"> +<meta name="viewport" content="width=device-width, initial-scale=1"> +<link href="https://maxcdn.bootstrapcdn.com/bootswatch/3.3.7/paper/bootstrap.min.css"; rel="stylesheet" integrity="sha384-awusxf8AUojygHf2+joICySzB780jVvQaVCAt1clU3QsyAitLGul28Qxb2r1e5g+" crossorigin="anonymous"> +<link href="//netdna.bootstrapcdn.com/font-awesome/4.0.3/css/font-awesome.css" rel="stylesheet"> +<link rel="stylesheet" type="text/css" href="https://cdn.datatables.net/v/bs/jq-2.2.3/dt-1.10.12/datatables.min.css";> +<link href="/css/accumulo.css" rel="stylesheet" type="text/css"> + +<title>Apache Accumulo 1.5.1</title> + +<script src="https://ajax.googleapis.com/ajax/libs/jquery/2.2.4/jquery.min.js";></script> +<script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.7/js/bootstrap.min.js"; integrity="sha384-Tc5IQib027qvyjSMfHjOMaLkfuWVxZxUPnCJA7l2mCWNIpG9mGCD8wGNIcPD7Txa" crossorigin="anonymous"></script> +<script type="text/javascript" src="https://cdn.datatables.net/v/bs/jq-2.2.3/dt-1.10.12/datatables.min.js";></script> +<script> + // show location of canonical site if not currently on the canonical site + $(function() { + var host = window.location.host; + if (typeof host !== 'undefined' && host !== 'accumulo.apache.org') { + $('#non-canonical').show(); + } + }); + + $(function() { + // decorate section headers with anchors + return $("h2, h3, h4, h5, h6").each(function(i, el) { + var $el, icon, id; + $el = $(el); + id = $el.attr('id'); + icon = '<i class="fa fa-link"></i>'; + if (id) { + return $el.append($("<a />").addClass("header-link").attr("href", "#" + id).html(icon)); + } + }); + }); + + // configure Google Analytics + (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){ + (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o), + m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m) + })(window,document,'script','//www.google-analytics.com/analytics.js','ga'); + + if (ga.hasOwnProperty('loaded') && ga.loaded === true) { + ga('create', 'UA-50934829-1', 'apache.org'); + ga('send', 'pageview'); + } +</script> + +</head> +<body style="padding-top: 100px"> + + <nav class="navbar navbar-default navbar-fixed-top"> + <div class="container"> + <div class="navbar-header"> + <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#navbar-items"> + <span class="sr-only">Toggle navigation</span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + </button> + <a href="/"><img id="nav-logo" alt="Apache Accumulo" class="img-responsive" src="/images/accumulo-logo.png" width="200"/></a> + </div> + <div class="collapse navbar-collapse" id="navbar-items"> + <ul class="nav navbar-nav"> + <li class="nav-link"><a href="/downloads">Download</a></li> + <li class="dropdown"> + <a class="dropdown-toggle" data-toggle="dropdown" href="#">Releases<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="/release/accumulo-1.8.0/">1.8.0 (Latest)</a></li> + <li><a href="/release/accumulo-1.7.2/">1.7.2</a></li> + <li><a href="/release/accumulo-1.6.6/">1.6.6</a></li> + <li><a href="/release/">Archive</a></li> + </ul> + </li> + <li class="dropdown"> + <a class="dropdown-toggle" data-toggle="dropdown" href="#">Documentation<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="/user-manual/">User Manuals</a></li> + <li><a href="/javadocs/">Javadocs</a></li> + <li><a href="/examples/">Examples</a></li> + <li><a href="/notable_features">Features</a></li> + <li><a href="/screenshots">Screenshots</a></li> + <li><a href="/papers">Papers & Presentations</a></li> + <li><a href="/glossary">Glossary</a></li> + </ul> + </li> + <li class="dropdown"> + <a class="dropdown-toggle" data-toggle="dropdown" href="#">Community<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="/get_involved">Get Involved</a></li> + <li><a href="/mailing_list">Mailing Lists</a></li> + <li><a href="/people">People</a></li> + <li><a href="/news">News Archive</a></li> + <li><a href="/projects">Community Projects</a></li> + <li><a href="/thanks">Thanks</a></li> + <li class="divider"></li> + <li class="dropdown-header">Governance</li> + <li><a href="/bylaws">Bylaws</a></li> + <li><a href="/governance/consensusBuilding">Consensus Building</a></li> + <li><a href="/governance/lazyConsensus">Lazy Consensus</a></li> + <li><a href="/governance/releasing">Releasing</a></li> + <li><a href="/governance/voting">Voting</a></li> + </ul> + </li> + <li class="dropdown"> + <a class="dropdown-toggle" data-toggle="dropdown" href="#">Development<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO";>Issue Tracker <i class="fa fa-external-link"></i></a></li> + <li><a href="https://github.com/apache/accumulo/pulls";>Pull Requests <i class="fa fa-external-link"></i></a></li> + <li><a href="https://builds.apache.org/view/A/view/Accumulo";>Jenkins Builds <i class="fa fa-external-link"></i></a></li> + <li><a href="https://travis-ci.org/apache/accumulo";>TravisCI Builds <i class="fa fa-external-link"></i></a></li> + <li class="divider"></li> + <li class="dropdown-header">Guides</li> + <li><a href="/source">Source & Guide</a></li> + <li><a href="/git">Git Workflow</a></li> + <li><a href="/versioning">Versioning</a></li> + <li><a href="/contrib">Contrib Projects</a></li> + <li><a href="/rb">Review Board</a></li> + <li><a href="/releasing">Making Releases</a></li> + <li><a href="/verifying_releases">Verifying Releases</a></li> + </ul> + </li> + </ul> + <ul class="nav navbar-nav navbar-right"> + <li class="dropdown"> + <a class="dropdown-toggle" data-toggle="dropdown" href="#">Apache Software Foundation<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="https://www.apache.org";>Apache Homepage <i class="fa fa-external-link"></i></a></li> + <li><a href="https://www.apache.org/licenses/LICENSE-2.0";>License <i class="fa fa-external-link"></i></a></li> + <li><a href="https://www.apache.org/foundation/sponsorship";>Sponsorship <i class="fa fa-external-link"></i></a></li> + <li><a href="https://www.apache.org/security";>Security <i class="fa fa-external-link"></i></a></li> + <li><a href="https://www.apache.org/foundation/thanks";>Thanks <i class="fa fa-external-link"></i></a></li> + <li><a href="https://www.apache.org/foundation/policies/conduct";>Code of Conduct <i class="fa fa-external-link"></i></a></li> + </ul> + </li> + </ul> + </div> + </div> +</nav> + + + <div class="container"> + <div class="row"> + <div class="col-md-12"> + + <div id="non-canonical" style="display: none; background-color: #F0E68C; padding-left: 1em;"> + Visit the official site at: <a href="https://accumulo.apache.org";>https://accumulo.apache.org</a> + </div> + <div id="content"> + + <h1 class="title">Apache Accumulo 1.5.1</h1> + + <p>06 Mar 2014</p> + +<p>Apache Accumulo 1.5.1 is a maintenance release on the 1.5 version branch. +This release contains changes from over 200 issues, comprised of bug fixes +(client side and server side), new test cases, and updated Hadoop support +contributed by over 30 different contributors and committers. +As this is a maintenance release, Apache Accumulo 1.5.1 has no client API +incompatibilities over Apache Accumulo 1.5.0 and requires no manual upgrade +process. Users of 1.5.0 are strongly encouraged to update as soon as possible +to benefit from the improvements.</p> + +<h2 id="notable-improvements">Notable Improvements</h2> + +<p>While new features are typically not added in a bug-fix release as 1.5.1, the +community does create a variety of improvements that are API compatible. Contained +here are some of the more notable improvements.</p> + +<h3 id="permgen-leak-from-client-api">PermGen Leak from Client API</h3> + +<p>Accumuloâs client code creates background threads that users presently cannot +stop through the API. This is quick to cause problems when invoking the Accumulo +API in application containers such as Apache Tomcat or JBoss and repeatedly +redeploying an application. <a href="https://issues.apache.org/jira/browse/ACCUMULO-2128";>ACCUMULO-2128</a> introduces a static utility, +org.apache.accumulo.core.util.CleanUp, that users can invoke as part of a +teardown hook in their container that will stop these threads and avoid +the eventual OutOfMemoryError âPermGen spaceâ.</p> + +<h3 id="prefer-ipv4-when-starting-accumulo-processes">Prefer IPv4 when starting Accumulo processes</h3> + +<p>While Hadoop <a href="https://wiki.apache.org/hadoop/HadoopIPv6";>does not support IPv6 networks</a>, attempting to run on a +system that does not have IPv6 completely disabled can cause strange failures. +<a href="https://issues.apache.org/jira/browse/ACCUMULO-2262";>ACCUMULO-2262</a> invokes the JVM-provided configuration parameter at process +startup to prefer IPv4 over IPv6.</p> + +<h3 id="memory-units-in-configuration">Memory units in configuration</h3> + +<p>In previous versions, units of memory had to be provided as upper-case (e.g. â2Gâ, not â2gâ). +Additionally, a non-intuitive error was printed when a lower-case unit was provided. +<a href="https://issues.apache.org/jira/browse/ACCUMULO-1933";>ACCUMULO-1933</a> allows lower-case memory units in all Accumulo configurations.</p> + +<h3 id="apache-thrift-maximum-frame-size">Apache Thrift maximum frame size</h3> + +<p>Apache Thrift is used as the internal RPC service. <a href="https://issues.apache.org/jira/browse/ACCUMULO-2360";>ACCUMULO-2360</a> allows +users to configure the maximum frame size an Accumulo server will read. This +prevents non Accumulo client from connecting and causing memory exhaustion.</p> + +<h3 id="multitablebatchwriter-concurrency">MultiTableBatchWriter concurrency</h3> + +<p>The MultiTableBatchWriter is a class which allows multiple tables to be written to +from a single object that maintains a single buffer for caching Mutations across all tables. This is desirable +as it greatly simplifies the JVM heap usage from caching Mutations across +many tables. Sadly, in Apache Accumulo 1.5.0, concurrent access to a single MultiTableBatchWriter +heavily suffered from synchronization issues. <a href="https://issues.apache.org/jira/browse/ACCUMULO-1833";>ACCUMULO-1833</a> introduces a fix +which alleviates the blocking and idle-wait that previously occurred when multiple threads accessed +a single MultiTableBatchWriter instance concurrently.</p> + +<h3 id="hadoop-versions">Hadoop Versions</h3> + +<p>Since Apache Accumulo 1.5.0 was released, Apache Hadoop 2.2.0 was also released +as the first generally available (GA) Hadoop 2 release. This was a very exciting release +for a number of reasons, but this also caused additional effort on Accumuloâs part to +ensure that Apache Accumulo continues to work across multiple Hadoop versions. Apache Accumulo 1.5.1 +should function with any recent Hadoop 1 or Hadoop 2 without any special steps, tricks or instructions +required.</p> + +<h2 id="notable-bug-fixes">Notable Bug Fixes</h2> + +<p>As with any Apache Accumulo release, we have numerous bug fixes that have been fixed. Most +are very subtle and wonât affect the common user; however, some notable bugs were resolved +as a part of 1.5.1 that are rather common.</p> + +<h3 id="failure-of-zookeeper-server-in-quorum-kills-connected-accumulo-services">Failure of ZooKeeper server in quorum kills connected Accumulo services</h3> + +<p>Apache ZooKeeper provides a number of wonderful features that Accumulo uses to accomplish +a variety of tasks, most notably a distributed locking service. Typically, multiple ZooKeeper +servers are run to provide resilience against a certain number of node failures. <a href="https://issues.apache.org/jira/browse/ACCUMULO-1572";>ACCUMULO-1572</a> +resolves an issue where Accumulo processes would kill themselves when the ZooKeeper server they +were communicating with died instead of failing over to another ZooKeeper server in the quorum.</p> + +<h3 id="monitor-table-state-isnt-updated">Monitor table state isnât updated</h3> + +<p>The Accumulo Monitor contains a column for the state of each table in the Accumulo instance. +The previous resolution was to restart the Monitor process when it got in this state. +<a href="https://issues.apache.org/jira/browse/ACCUMULO-1920";>ACCUMULO-1920</a> resolves an issue where the Monitor would not see updates from ZooKeeper.</p> + +<h3 id="two-locations-for-the-same-extent">Two locations for the same extent</h3> + +<p>The !METADATA table is the brains behind the data storage for each table, tracking information +like which files comprise a Tablet, and which TabletServers are hosting which Tablets. <a href="https://issues.apache.org/jira/browse/ACCUMULO-2057";>ACCUMULO-2057</a> +fixes an issue where the !METADATA table contained multiple locations (hosting server) for +a single Tablet.</p> + +<h3 id="deadlock-on-metadata-tablet-unload">Deadlock on !METADATA tablet unload</h3> + +<p>Tablets are unloaded, typically, when a shutdown request is issued. <a href="https://issues.apache.org/jira/browse/ACCUMULO-1143";>ACCUMULO-1143</a> resolves +a potential deadlock issue when a merging-minor compaction is issued to flush in-memory data +to disk before unloading a Tablet.</p> + +<h3 id="other-notable-fixes">Other notable fixes</h3> + +<ul> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-1800";>ACCUMULO-1800</a> Fixed deletes made via the Proxy.</li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-1994";>ACCUMULO-1994</a> Fixed ranges in the Proxy.</li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-2234";>ACCUMULO-2234</a> Fixed offline map reduce over non default HDFS location.</li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-1615";>ACCUMULO-1615</a> Fixed <code class="highlighter-rouge">service accumulo-tserver stop</code>.</li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-1876";>ACCUMULO-1876</a> Fixed issues depending on Accumulo using Apache Ivy.</li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-2261";>ACCUMULO-2261</a> Duplicate locations for a Tablet.</li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-2037";>ACCUMULO-2037</a> Tablets assigned to previous location.</li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-1821";>ACCUMULO-1821</a> Avoid recovery on recovering Tablets.</li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-2078";>ACCUMULO-2078</a> Incorrectly computed ACCUMULO_LOG_HOST in example configurations.</li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-1985";>ACCUMULO-1985</a> Configuration to bind Monitor on all network interfaces.</li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-1999";>ACCUMULO-1999</a> Allow â0â to signify random port for the Master.</li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-1630";>ACCUMULO-1630</a> Fixed GC to interpret any IP/hostname.</li> +</ul> + +<h2 id="known-issues">Known Issues</h2> + +<p>When using Accumulo 1.5 and Hadoop 2, Accumulo will call hsync() on HDFS. +Calling hsync improves durability by ensuring data is on disk (where other older +Hadoop versions might lose data in the face of power failure); however, calling +hsync frequently does noticably slow writes. A simple work around is to increase +the value of the tserver.mutation.queue.max configuration parameter via accumulo-site.xml.</p> + +<p>A value of â4Mâ is a better recommendation, and memory consumption will increase by +the number of concurrent writers to that TabletServer. For example, a value of 4M with +50 concurrent writers would equate to approximately 200M of Java heap being used for +mutation queues.</p> + +<p>For more information, see <a href="https://issues.apache.org/jira/browse/ACCUMULO-1950";>ACCUMULO-1950</a> and <a href="https://issues.apache.org/jira/browse/ACCUMULO-1905?focusedCommentId=13915208&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13915208";>this comment</a>.</p> + +<h2 id="documentation">Documentation</h2> + +<p>The following documentation updates were made:</p> + +<ul> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-1956";>ACCUMULO-1956</a></li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-1428";>ACCUMULO-1428</a></li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-1687";>ACCUMULO-1687</a></li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-2141";>ACCUMULO-2141</a></li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-1946";>ACCUMULO-1946</a></li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-2223";>ACCUMULO-2223</a></li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-2226";>ACCUMULO-2226</a></li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-1470";>ACCUMULO-1470</a></li> +</ul> + +<h2 id="testing">Testing</h2> + +<p>Below is a list of all platforms that 1.5.1 was tested against by developers. Each Apache Accumulo release +has a set of tests that must be run before the candidate is capable of becoming an official release. That list includes the following:</p> + +<ol> + <li>Successfully run all unit tests</li> + <li>Successfully run all functional test (test/system/auto)</li> + <li>Successfully complete two 24-hour RandomWalk tests (LongClean module), with and without âagitationâ</li> + <li>Successfully complete two 24-hour Continuous Ingest tests, with and without âagitationâ, with data verification</li> + <li>Successfully complete two 72-hour Continuous Ingest tests, with and without âagitationâ</li> +</ol> + +<p>Each unit and functional test only runs on a single node, while the RandomWalk and Continuous Ingest tests run +on any number of nodes. <em>Agitation</em> refers to randomly restarting Accumulo processes and Hadoop Datanode processes, +and, in HDFS High-Availability instances, forcing NameNode failover.</p> + +<table id="release_notes_testing" class="table"> + <thead> + <tr> + <th>OS</th> + <th>Hadoop</th> + <th>Nodes</th> + <th>ZooKeeper</th> + <th>HDFS High-Availability</th> + <th>Tests</th> + </tr> + </thead> + <tbody> + <tr> + <td>CentOS 6.5</td> + <td>HDP 2.0 (Apache 2.2.0)</td> + <td>6</td> + <td>HDP 2.0 (Apache 3.4.5)</td> + <td>Yes (QJM)</td> + <td>All required tests</td> + </tr> + <tr> + <td>CentOS 6.4</td> + <td>CDH 4.5.0 (2.0.0+cdh4.5.0)</td> + <td>7</td> + <td>CDH 4.5.0 (3.4.5+cdh4.5.0)</td> + <td>Yes (QJM)</td> + <td>Unit, functional and 24hr Randomwalk w/ agitation</td> + </tr> + <tr> + <td>CentOS 6.4</td> + <td>CDH 4.5.0 (2.0.0+cdh4.5.0)</td> + <td>7</td> + <td>CDH 4.5.0 (3.4.5+cdh4.5.0)</td> + <td>Yes (QJM)</td> + <td>2x 24/hr continuous ingest w/ verification</td> + </tr> + <tr> + <td>CentOS 6.3</td> + <td>Apache 1.0.4</td> + <td>1</td> + <td>Apache 3.3.5</td> + <td>No</td> + <td>Local testing, unit and functional tests</td> + </tr> + <tr> + <td>RHEL 6.4</td> + <td>Apache 2.2.0</td> + <td>10</td> + <td>Apache 3.4.5</td> + <td>No</td> + <td>Functional tests</td> + </tr> + </tbody> +</table> + + + +<p><strong>View all releases in the <a href="/release/">archive</a></strong></p> + + </div> + + +<footer> + + <p><a href="https://www.apache.org";><img src="/images/feather-small.gif" alt="Apache Software Foundation" id="asf-logo" height="100" /></a></p> + + <p>Copyright © 2011-2016 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/LICENSE-2.0";>Apache License, Version 2.0</a>.</p> + +</footer> + + + </div> + </div> + </div> +</body> +</html>
http://git-wip-us.apache.org/repos/asf/accumulo-website/blob/c0655661/release/accumulo-1.5.2/index.html ---------------------------------------------------------------------- diff --git a/release/accumulo-1.5.2/index.html b/release/accumulo-1.5.2/index.html new file mode 100644 index 0000000..016ff9e --- /dev/null +++ b/release/accumulo-1.5.2/index.html @@ -0,0 +1,365 @@ +<!DOCTYPE html> +<html lang="en"> +<head> +<!-- + Licensed to the Apache Software Foundation (ASF) under one or more + contributor license agreements. See the NOTICE file distributed with + this work for additional information regarding copyright ownership. + The ASF licenses this file to You under the Apache License, Version 2.0 + (the "License"); you may not use this file except in compliance with + the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. +--> +<meta charset="utf-8"> +<meta http-equiv="X-UA-Compatible" content="IE=edge"> +<meta name="viewport" content="width=device-width, initial-scale=1"> +<link href="https://maxcdn.bootstrapcdn.com/bootswatch/3.3.7/paper/bootstrap.min.css"; rel="stylesheet" integrity="sha384-awusxf8AUojygHf2+joICySzB780jVvQaVCAt1clU3QsyAitLGul28Qxb2r1e5g+" crossorigin="anonymous"> +<link href="//netdna.bootstrapcdn.com/font-awesome/4.0.3/css/font-awesome.css" rel="stylesheet"> +<link rel="stylesheet" type="text/css" href="https://cdn.datatables.net/v/bs/jq-2.2.3/dt-1.10.12/datatables.min.css";> +<link href="/css/accumulo.css" rel="stylesheet" type="text/css"> + +<title>Apache Accumulo 1.5.2</title> + +<script src="https://ajax.googleapis.com/ajax/libs/jquery/2.2.4/jquery.min.js";></script> +<script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.7/js/bootstrap.min.js"; integrity="sha384-Tc5IQib027qvyjSMfHjOMaLkfuWVxZxUPnCJA7l2mCWNIpG9mGCD8wGNIcPD7Txa" crossorigin="anonymous"></script> +<script type="text/javascript" src="https://cdn.datatables.net/v/bs/jq-2.2.3/dt-1.10.12/datatables.min.js";></script> +<script> + // show location of canonical site if not currently on the canonical site + $(function() { + var host = window.location.host; + if (typeof host !== 'undefined' && host !== 'accumulo.apache.org') { + $('#non-canonical').show(); + } + }); + + $(function() { + // decorate section headers with anchors + return $("h2, h3, h4, h5, h6").each(function(i, el) { + var $el, icon, id; + $el = $(el); + id = $el.attr('id'); + icon = '<i class="fa fa-link"></i>'; + if (id) { + return $el.append($("<a />").addClass("header-link").attr("href", "#" + id).html(icon)); + } + }); + }); + + // configure Google Analytics + (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){ + (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o), + m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m) + })(window,document,'script','//www.google-analytics.com/analytics.js','ga'); + + if (ga.hasOwnProperty('loaded') && ga.loaded === true) { + ga('create', 'UA-50934829-1', 'apache.org'); + ga('send', 'pageview'); + } +</script> + +</head> +<body style="padding-top: 100px"> + + <nav class="navbar navbar-default navbar-fixed-top"> + <div class="container"> + <div class="navbar-header"> + <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#navbar-items"> + <span class="sr-only">Toggle navigation</span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + </button> + <a href="/"><img id="nav-logo" alt="Apache Accumulo" class="img-responsive" src="/images/accumulo-logo.png" width="200"/></a> + </div> + <div class="collapse navbar-collapse" id="navbar-items"> + <ul class="nav navbar-nav"> + <li class="nav-link"><a href="/downloads">Download</a></li> + <li class="dropdown"> + <a class="dropdown-toggle" data-toggle="dropdown" href="#">Releases<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="/release/accumulo-1.8.0/">1.8.0 (Latest)</a></li> + <li><a href="/release/accumulo-1.7.2/">1.7.2</a></li> + <li><a href="/release/accumulo-1.6.6/">1.6.6</a></li> + <li><a href="/release/">Archive</a></li> + </ul> + </li> + <li class="dropdown"> + <a class="dropdown-toggle" data-toggle="dropdown" href="#">Documentation<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="/user-manual/">User Manuals</a></li> + <li><a href="/javadocs/">Javadocs</a></li> + <li><a href="/examples/">Examples</a></li> + <li><a href="/notable_features">Features</a></li> + <li><a href="/screenshots">Screenshots</a></li> + <li><a href="/papers">Papers & Presentations</a></li> + <li><a href="/glossary">Glossary</a></li> + </ul> + </li> + <li class="dropdown"> + <a class="dropdown-toggle" data-toggle="dropdown" href="#">Community<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="/get_involved">Get Involved</a></li> + <li><a href="/mailing_list">Mailing Lists</a></li> + <li><a href="/people">People</a></li> + <li><a href="/news">News Archive</a></li> + <li><a href="/projects">Community Projects</a></li> + <li><a href="/thanks">Thanks</a></li> + <li class="divider"></li> + <li class="dropdown-header">Governance</li> + <li><a href="/bylaws">Bylaws</a></li> + <li><a href="/governance/consensusBuilding">Consensus Building</a></li> + <li><a href="/governance/lazyConsensus">Lazy Consensus</a></li> + <li><a href="/governance/releasing">Releasing</a></li> + <li><a href="/governance/voting">Voting</a></li> + </ul> + </li> + <li class="dropdown"> + <a class="dropdown-toggle" data-toggle="dropdown" href="#">Development<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO";>Issue Tracker <i class="fa fa-external-link"></i></a></li> + <li><a href="https://github.com/apache/accumulo/pulls";>Pull Requests <i class="fa fa-external-link"></i></a></li> + <li><a href="https://builds.apache.org/view/A/view/Accumulo";>Jenkins Builds <i class="fa fa-external-link"></i></a></li> + <li><a href="https://travis-ci.org/apache/accumulo";>TravisCI Builds <i class="fa fa-external-link"></i></a></li> + <li class="divider"></li> + <li class="dropdown-header">Guides</li> + <li><a href="/source">Source & Guide</a></li> + <li><a href="/git">Git Workflow</a></li> + <li><a href="/versioning">Versioning</a></li> + <li><a href="/contrib">Contrib Projects</a></li> + <li><a href="/rb">Review Board</a></li> + <li><a href="/releasing">Making Releases</a></li> + <li><a href="/verifying_releases">Verifying Releases</a></li> + </ul> + </li> + </ul> + <ul class="nav navbar-nav navbar-right"> + <li class="dropdown"> + <a class="dropdown-toggle" data-toggle="dropdown" href="#">Apache Software Foundation<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="https://www.apache.org";>Apache Homepage <i class="fa fa-external-link"></i></a></li> + <li><a href="https://www.apache.org/licenses/LICENSE-2.0";>License <i class="fa fa-external-link"></i></a></li> + <li><a href="https://www.apache.org/foundation/sponsorship";>Sponsorship <i class="fa fa-external-link"></i></a></li> + <li><a href="https://www.apache.org/security";>Security <i class="fa fa-external-link"></i></a></li> + <li><a href="https://www.apache.org/foundation/thanks";>Thanks <i class="fa fa-external-link"></i></a></li> + <li><a href="https://www.apache.org/foundation/policies/conduct";>Code of Conduct <i class="fa fa-external-link"></i></a></li> + </ul> + </li> + </ul> + </div> + </div> +</nav> + + + <div class="container"> + <div class="row"> + <div class="col-md-12"> + + <div id="non-canonical" style="display: none; background-color: #F0E68C; padding-left: 1em;"> + Visit the official site at: <a href="https://accumulo.apache.org";>https://accumulo.apache.org</a> + </div> + <div id="content"> + + <h1 class="title">Apache Accumulo 1.5.2</h1> + + <p>19 Sep 2015</p> + +<p>Apache Accumulo 1.5.2 is a maintenance release on the 1.5 version branch. +This release contains changes from over 100 issues, comprised of bug fixes +(client side and server side), new test cases, and updated Hadoop support +contributed by over 30 different contributors and committers. +As this is a maintenance release, Apache Accumulo 1.5.2 has no client API +incompatibilities over Apache Accumulo 1.5.0 and 1.5.1 and requires no manual upgrade +process. Users of 1.5.0 or 1.5.1 are strongly encouraged to update as soon as possible +to benefit from the improvements.</p> + +<p>Users who are new to Accumulo are encouraged to use a 1.6 release as opposed +to the 1.5 line as development has already shifted towards the 1.6 line. For those +who cannot or do not want to upgrade to 1.6, 1.5.2 is still an excellent choice +over earlier versions in the 1.5 line.</p> + +<h2 id="performance-improvements">Performance Improvements</h2> + +<p>Apache Accumulo 1.5.2 includes a number of performance-related fixes over previous versions.</p> + +<h3 id="write-ahead-log-sync-performance">Write-Ahead Log sync performance</h3> + +<p>The Write-Ahead Log (WAL) files are used to ensure durability of updates made to Accumulo. +A sync is called on the file in HDFS to make sure that the changes to the WAL are persisted +to disk, which allows Accumulo to recover in the case of failure. <a href="https://issues.apache.org/jira/browse/ACCUMULO-2766";>ACCUMULO-2766</a> fixed +an issue where an operation against a WAL would unnecessarily wait for multiple syncs, slowing +down the ingest on the system.</p> + +<h3 id="minor-compactions-not-aggressive-enough">Minor-Compactions not aggressive enough</h3> + +<p>On a system with ample memory provided to Accumulo, long hold-times were observed which +blocks the ingest of new updates. Trying to free more server-side memory by running minor +compactions more frequently increased the overall throughput on the node. These changes +were made in <a href="https://issues.apache.org/jira/browse/ACCUMULO-2905";>ACCUMULO-2905</a>.</p> + +<h3 id="heapiterator-optimization">HeapIterator optimization</h3> + +<p>Iterators, a notable feature of Accumulo, are provided to users as a server-side programming +construct, but are also used internally for numerous server operations. One of these system iterator +is the HeapIterator which implements a PriorityQueue of other Iterators. One way this iterator is +used is to merge multiple files in HDFS to present a single, sorted stream of Key-Value pairs. <a href="https://issues.apache.org/jira/browse/ACCUMULO-2827";>ACCUMULO-2827</a> +introduces a performance optimization to the HeapIterator which can improve the speed of the +HeapIterator in common cases.</p> + +<h3 id="write-ahead-log-sync-implementation">Write-Ahead log sync implementation</h3> + +<p>In Hadoop-2, two implementations of sync are provided: hflush and hsync. Both of these +methods provide a way to request that the datanodes write the data to the underlying +medium and not just hold it in memory (the <em>fsync</em> syscall). While both of these methods +inform the Datanodes to sync the relevant block(s), <em>hflush</em> does not wait for acknowledgement +from the Datanodes that the sync finished, where <em>hsync</em> does. To provide the most reliable system +âout of the boxâ, Accumulo defaults to <em>hsync</em> so that your data is as secure as possible in +a variety of situations (notably, unexpected power outages).</p> + +<p>The downside is that performance tends to suffer because waiting for a sync to disk is a very +expensive operation. <a href="https://issues.apache.org/jira/browse/ACCUMULO-2842";>ACCUMULO-2842</a> introduces a new system property, tserver.wal.sync.method, +that lets users to change the HDFS sync implementation from <em>hsync</em> to <em>hflush</em>. Using <em>hflush</em> instead +of <em>hsync</em> may result in about a 30% increase in ingest performance.</p> + +<p>For users upgrading from Hadoop-1 or Hadoop-0.20 releases, <em>hflush</em> is the equivalent of how +sync was implemented in these older versions of Hadoop and should give comparable performance.</p> + +<h3 id="server-side-mutation-queue-size">Server-side mutation queue size</h3> + +<p>When users desire writes to be as durable as possible, using <em>hsync</em>, the ingest performance +of the system can be improved by increasing the tserver.mutation.queue.max property. The cost +of this change is that it will cause TabletServers to use additional memory per writer. In 1.5.1, +the value of this parameter defaulted to a conservative 256K, which resulted in sub-par ingest +performance.</p> + +<p>1.5.2 and <a href="https://issues.apache.org/jira/browse/ACCUMULO-3018";>ACCUMULO-3018</a> increases this buffer to 1M which has a noticeable positive impact on +ingest performance with a minimal increase in TabletServer memory usage.</p> + +<h2 id="notable-bug-fixes">Notable Bug Fixes</h2> + +<h3 id="fixes-mapreduce-package-name-change">Fixes MapReduce package name change</h3> + +<p>1.5.1 inadvertently included a change to RangeInputSplit which created an incompatibility +with 1.5.0. The original class has been restored to ensure that users accessing +the RangeInputSplit class do not have to alter their client code. See <a href="https://issues.apache.org/jira/browse/ACCUMULO-2586";>ACCUMULO-2586</a> for +more information</p> + +<h3 id="add-configurable-maximum-frame-size-to-apache-thrift-proxy">Add configurable maximum frame size to Apache Thrift proxy</h3> + +<p>The Thrift proxy server was subject to memory exhaustion, typically +due to bad input, where the server would attempt to allocate a very large +buffer and die in the process. <a href="https://issues.apache.org/jira/browse/ACCUMULO-2658";>ACCUMULO-2658</a> introduces a configuration +parameter, like <a href="https://issues.apache.org/jira/browse/ACCUMULO-2360";>ACCUMULO-2360</a>, to prevent this error.</p> + +<h3 id="offline-tables-can-prevent-tablet-balancing">Offline tables can prevent tablet balancing</h3> + +<p>Before 1.5.2, when a table with many tablets was created, ingested into, and +taken offline, tablet balancing may have stoppped. This would happen if there +were tablet migrations for the table, because the migrations couldnât occur. +The balancer will not run when there are outstanding migrations; therefore, a +system could become unbalanced. <a href="https://issues.apache.org/jira/browse/ACCUMULO-2694";>ACCUMULO-2694</a> introduces a fix to ensure +that offline tables do not block balancing and improves the server-side +logging.</p> + +<h3 id="miniaccumulocluster-process-management">MiniAccumuloCluster process management</h3> + +<p>MiniAccumuloCluster had a few issues which could cause deadlock or a method that +never returns. Most of these are related to management of the Accumulo processes +(<a href="https://issues.apache.org/jira/browse/ACCUMULO-2764";>ACCUMULO-2764</a>, <a href="https://issues.apache.org/jira/browse/ACCUMULO-2985";>ACCUMULO-2985</a>, and <a href="https://issues.apache.org/jira/browse/ACCUMULO-3055";>ACCUMULO-3055</a>).</p> + +<h3 id="iteratorsettings-not-correctly-serialized-in-rangeinputsplit">IteratorSettings not correctly serialized in RangeInputSplit</h3> + +<p>The Writable interface methods on the RangeInputSplit class accidentally omitted +calls to serialize the IteratorSettings configured for the Job. <a href="https://issues.apache.org/jira/browse/ACCUMULO-2962";>ACCUMULO-2962</a> +fixes the serialization and adds some additional tests.</p> + +<h3 id="constraint-violation-causes-hung-scans">Constraint violation causes hung scans</h3> + +<p>A failed bulk import transaction had the ability to create an infinitely retrying +loop due to a constraint violation. This directly prevents scans from completing, +but will also hang compactions. <a href="https://issues.apache.org/jira/browse/ACCUMULO-3096";>ACCUMULO-3096</a> fixes the issue so that the +constraint no longer hangs the entire system.</p> + +<h2 id="documentation">Documentation</h2> + +<p>The following documentation updates were made:</p> + +<ul> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-2540";>ACCUMULO-2540</a></li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-2767";>ACCUMULO-2767</a></li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-2796";>ACCUMULO-2796</a></li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-2443";>ACCUMULO-2443</a></li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-3008";>ACCUMULO-3008</a></li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-2919";>ACCUMULO-2919</a></li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-2874";>ACCUMULO-2874</a></li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-2653";>ACCUMULO-2653</a></li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-2437";>ACCUMULO-2437</a></li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-3097";>ACCUMULO-3097</a></li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-2499";>ACCUMULO-2499</a></li> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO-1669";>ACCUMULO-1669</a></li> +</ul> + +<h2 id="testing">Testing</h2> + +<p>Each unit and functional test only runs on a single node, while the RandomWalk and Continuous Ingest tests run +on any number of nodes. <em>Agitation</em> refers to randomly restarting Accumulo processes and Hadoop Datanode processes, +and, in HDFS High-Availability instances, forcing NameNode failover.</p> + +<table id="release_notes_testing" class="table"> + <thead> + <tr> + <th>OS</th> + <th>Hadoop</th> + <th>Nodes</th> + <th>ZooKeeper</th> + <th>HDFS High-Availability</th> + <th>Tests</th> + </tr> + </thead> + <tbody> + <tr> + <td>Gentoo</td> + <td>Apache 2.6.0-SNAPSHOT</td> + <td>1</td> + <td>Apache 3.4.5</td> + <td>No</td> + <td>Unit and Functional Tests, ContinuousIngest w/ verification (1B entries)</td> + </tr> + <tr> + <td>CentOS 6</td> + <td>Apache 2.3.0</td> + <td>20</td> + <td>Apache 3.4.5</td> + <td>No</td> + <td>24/hr RandomWalk, 24/hr ContinuousIngest w/ verification w/ and w/o agitation (30B and 23B entries)</td> + </tr> + </tbody> +</table> + + + +<p><strong>View all releases in the <a href="/release/">archive</a></strong></p> + + </div> + + +<footer> + + <p><a href="https://www.apache.org";><img src="/images/feather-small.gif" alt="Apache Software Foundation" id="asf-logo" height="100" /></a></p> + + <p>Copyright © 2011-2016 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/LICENSE-2.0";>Apache License, Version 2.0</a>.</p> + +</footer> + + + </div> + </div> + </div> +</body> +</html> http://git-wip-us.apache.org/repos/asf/accumulo-website/blob/c0655661/release/accumulo-1.5.3/index.html ---------------------------------------------------------------------- diff --git a/release/accumulo-1.5.3/index.html b/release/accumulo-1.5.3/index.html new file mode 100644 index 0000000..583fa4e --- /dev/null +++ b/release/accumulo-1.5.3/index.html @@ -0,0 +1,314 @@ +<!DOCTYPE html> +<html lang="en"> +<head> +<!-- + Licensed to the Apache Software Foundation (ASF) under one or more + contributor license agreements. See the NOTICE file distributed with + this work for additional information regarding copyright ownership. + The ASF licenses this file to You under the Apache License, Version 2.0 + (the "License"); you may not use this file except in compliance with + the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. +--> +<meta charset="utf-8"> +<meta http-equiv="X-UA-Compatible" content="IE=edge"> +<meta name="viewport" content="width=device-width, initial-scale=1"> +<link href="https://maxcdn.bootstrapcdn.com/bootswatch/3.3.7/paper/bootstrap.min.css"; rel="stylesheet" integrity="sha384-awusxf8AUojygHf2+joICySzB780jVvQaVCAt1clU3QsyAitLGul28Qxb2r1e5g+" crossorigin="anonymous"> +<link href="//netdna.bootstrapcdn.com/font-awesome/4.0.3/css/font-awesome.css" rel="stylesheet"> +<link rel="stylesheet" type="text/css" href="https://cdn.datatables.net/v/bs/jq-2.2.3/dt-1.10.12/datatables.min.css";> +<link href="/css/accumulo.css" rel="stylesheet" type="text/css"> + +<title>Apache Accumulo 1.5.3</title> + +<script src="https://ajax.googleapis.com/ajax/libs/jquery/2.2.4/jquery.min.js";></script> +<script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.7/js/bootstrap.min.js"; integrity="sha384-Tc5IQib027qvyjSMfHjOMaLkfuWVxZxUPnCJA7l2mCWNIpG9mGCD8wGNIcPD7Txa" crossorigin="anonymous"></script> +<script type="text/javascript" src="https://cdn.datatables.net/v/bs/jq-2.2.3/dt-1.10.12/datatables.min.js";></script> +<script> + // show location of canonical site if not currently on the canonical site + $(function() { + var host = window.location.host; + if (typeof host !== 'undefined' && host !== 'accumulo.apache.org') { + $('#non-canonical').show(); + } + }); + + $(function() { + // decorate section headers with anchors + return $("h2, h3, h4, h5, h6").each(function(i, el) { + var $el, icon, id; + $el = $(el); + id = $el.attr('id'); + icon = '<i class="fa fa-link"></i>'; + if (id) { + return $el.append($("<a />").addClass("header-link").attr("href", "#" + id).html(icon)); + } + }); + }); + + // configure Google Analytics + (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){ + (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o), + m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m) + })(window,document,'script','//www.google-analytics.com/analytics.js','ga'); + + if (ga.hasOwnProperty('loaded') && ga.loaded === true) { + ga('create', 'UA-50934829-1', 'apache.org'); + ga('send', 'pageview'); + } +</script> + +</head> +<body style="padding-top: 100px"> + + <nav class="navbar navbar-default navbar-fixed-top"> + <div class="container"> + <div class="navbar-header"> + <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#navbar-items"> + <span class="sr-only">Toggle navigation</span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + </button> + <a href="/"><img id="nav-logo" alt="Apache Accumulo" class="img-responsive" src="/images/accumulo-logo.png" width="200"/></a> + </div> + <div class="collapse navbar-collapse" id="navbar-items"> + <ul class="nav navbar-nav"> + <li class="nav-link"><a href="/downloads">Download</a></li> + <li class="dropdown"> + <a class="dropdown-toggle" data-toggle="dropdown" href="#">Releases<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="/release/accumulo-1.8.0/">1.8.0 (Latest)</a></li> + <li><a href="/release/accumulo-1.7.2/">1.7.2</a></li> + <li><a href="/release/accumulo-1.6.6/">1.6.6</a></li> + <li><a href="/release/">Archive</a></li> + </ul> + </li> + <li class="dropdown"> + <a class="dropdown-toggle" data-toggle="dropdown" href="#">Documentation<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="/user-manual/">User Manuals</a></li> + <li><a href="/javadocs/">Javadocs</a></li> + <li><a href="/examples/">Examples</a></li> + <li><a href="/notable_features">Features</a></li> + <li><a href="/screenshots">Screenshots</a></li> + <li><a href="/papers">Papers & Presentations</a></li> + <li><a href="/glossary">Glossary</a></li> + </ul> + </li> + <li class="dropdown"> + <a class="dropdown-toggle" data-toggle="dropdown" href="#">Community<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="/get_involved">Get Involved</a></li> + <li><a href="/mailing_list">Mailing Lists</a></li> + <li><a href="/people">People</a></li> + <li><a href="/news">News Archive</a></li> + <li><a href="/projects">Community Projects</a></li> + <li><a href="/thanks">Thanks</a></li> + <li class="divider"></li> + <li class="dropdown-header">Governance</li> + <li><a href="/bylaws">Bylaws</a></li> + <li><a href="/governance/consensusBuilding">Consensus Building</a></li> + <li><a href="/governance/lazyConsensus">Lazy Consensus</a></li> + <li><a href="/governance/releasing">Releasing</a></li> + <li><a href="/governance/voting">Voting</a></li> + </ul> + </li> + <li class="dropdown"> + <a class="dropdown-toggle" data-toggle="dropdown" href="#">Development<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO";>Issue Tracker <i class="fa fa-external-link"></i></a></li> + <li><a href="https://github.com/apache/accumulo/pulls";>Pull Requests <i class="fa fa-external-link"></i></a></li> + <li><a href="https://builds.apache.org/view/A/view/Accumulo";>Jenkins Builds <i class="fa fa-external-link"></i></a></li> + <li><a href="https://travis-ci.org/apache/accumulo";>TravisCI Builds <i class="fa fa-external-link"></i></a></li> + <li class="divider"></li> + <li class="dropdown-header">Guides</li> + <li><a href="/source">Source & Guide</a></li> + <li><a href="/git">Git Workflow</a></li> + <li><a href="/versioning">Versioning</a></li> + <li><a href="/contrib">Contrib Projects</a></li> + <li><a href="/rb">Review Board</a></li> + <li><a href="/releasing">Making Releases</a></li> + <li><a href="/verifying_releases">Verifying Releases</a></li> + </ul> + </li> + </ul> + <ul class="nav navbar-nav navbar-right"> + <li class="dropdown"> + <a class="dropdown-toggle" data-toggle="dropdown" href="#">Apache Software Foundation<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="https://www.apache.org";>Apache Homepage <i class="fa fa-external-link"></i></a></li> + <li><a href="https://www.apache.org/licenses/LICENSE-2.0";>License <i class="fa fa-external-link"></i></a></li> + <li><a href="https://www.apache.org/foundation/sponsorship";>Sponsorship <i class="fa fa-external-link"></i></a></li> + <li><a href="https://www.apache.org/security";>Security <i class="fa fa-external-link"></i></a></li> + <li><a href="https://www.apache.org/foundation/thanks";>Thanks <i class="fa fa-external-link"></i></a></li> + <li><a href="https://www.apache.org/foundation/policies/conduct";>Code of Conduct <i class="fa fa-external-link"></i></a></li> + </ul> + </li> + </ul> + </div> + </div> +</nav> + + + <div class="container"> + <div class="row"> + <div class="col-md-12"> + + <div id="non-canonical" style="display: none; background-color: #F0E68C; padding-left: 1em;"> + Visit the official site at: <a href="https://accumulo.apache.org";>https://accumulo.apache.org</a> + </div> + <div id="content"> + + <h1 class="title">Apache Accumulo 1.5.3</h1> + + <p>25 Jun 2015</p> + +<p>Apache Accumulo 1.5.3 is a bug-fix release for the 1.5 series. It is likely to be the last +1.5 release, with development shifting towards newer release lines. We recommend upgrading +to a newer version to continue to get bug fixes and new features.</p> + +<p>In the context of Accumuloâs <a href="http://semver.org";>Semantic Versioning</a> <a href="https://github.com/apache/accumulo/blob/1.7.0/README.md#api";>guidelines</a>, +this is a âpatch versionâ. This means that there should be no public API changes. Any +changes which were made were done in a backwards-compatible manner. Code that +runs against 1.5.2 should run against 1.5.3.</p> + +<p>Weâd like to thank all of the committers and contributors which had a part in +making this release, from code contributions to testing. Everyoneâs efforts are +greatly appreciated.</p> + +<h2 id="security-changes">Security Changes</h2> + +<h3 id="sslv3-disabled-poodleaccumulo-3316"><a href="https://issues.apache.org/jira/browse/ACCUMULO-3316";>SSLv3 disabled (POODLE)</a></h3> + +<p>Many Accumulo services were capable of enabling wire encryption using +SSL connectors. To be safe, <a href="https://issues.apache.org/jira/browse/ACCUMULO-3316";>ACCUMULO-3316</a> disables the problematic SSLv3 version by default which was +potentially susceptible to the man-in-the-middle attack. <a href="https://issues.apache.org/jira/browse/ACCUMULO-3317";>ACCUMULO-3317</a> also disables SSLv3 in the monitor, +so it will not accept SSLv3 client connections, when running it with https.</p> + +<h2 id="notable-bug-fixes">Notable Bug Fixes</h2> + +<h3 id="sourceswitchingiterator-deadlockaccumulo-3745"><a href="https://issues.apache.org/jira/browse/ACCUMULO-3745";>SourceSwitchingIterator Deadlock</a></h3> + +<p>An instance of SourceSwitchingIterator, the Accumulo iterator which transparently manages +whether data for a tablet read from memory (the in-memory map) or disk (HDFS after a minor +compaction), was found deadlocked in a production system.</p> + +<p>This deadlock prevented the scan and the minor compaction from ever successfully completing +without restarting the tablet server. <a href="https://issues.apache.org/jira/browse/ACCUMULO-3745";>ACCUMULO-3745</a> fixes the inconsistent synchronization +inside of the SourceSwitchingIterator to prevent this deadlock from happening in the future.</p> + +<p>The only mitigation of this bug was to restart the tablet server that is deadlocked.</p> + +<h3 id="table-flush-blocked-indefinitelyaccumulo-3597"><a href="https://issues.apache.org/jira/browse/ACCUMULO-3597";>Table flush blocked indefinitely</a></h3> + +<p>While running the Accumulo RandomWalk distributed test, it was observed that all activity in +Accumulo had stopped and there was an offline Accumulo metadata table tablet. The system first +tried to flush a user tablet, but the metadata table was not online (likely due to the agitation +process which stops and starts Accumulo processes during the test). After this call, a call to +load the metadata tablet was queued but could not complete until the previous flush call. Thus, +a deadlock occurred.</p> + +<p>This deadlock happened because the synchronous flush call could not complete before the load +tablet call completed, but the load tablet call couldnât run because of connection caching we +perform in Accumuloâs RPC layer to reduce the quantity of sockets we need to create to send data. +<a href="https://issues.apache.org/jira/browse/ACCUMULO-3597";>ACCUMULO-3597</a> prevents this deadlock by forcing the use of a non-cached connection for the RPC +message requesting a metadata tablet to be loaded.</p> + +<p>While this feature does result in additional network resources to be used, the concern is minimal +because the number of metadata tablets is typically very small with respect to the total number of +tablets in the system.</p> + +<p>The only mitigation of this bug was to restart the tablet server that is hung.</p> + +<h3 id="rpc-connections-not-cachedaccumulo-3574"><a href="https://issues.apache.org/jira/browse/ACCUMULO-3574";>RPC Connections not cached</a></h3> + +<p>It was observed that the underlying connection for invoking RPCs were not actually being cached, +despite it being requested that they should be cached. While this did not result in a noticed +performance impact, it was deficiency. <a href="https://issues.apache.org/jira/browse/ACCUMULO-3574";>ACCUMULO-3574</a> ensures that connections are cached when +it is requested that they are.</p> + +<h3 id="deletes-on-apache-thrift-proxy-api-ignoredaccumulo-3474"><a href="https://issues.apache.org/jira/browse/ACCUMULO-3474";>Deletes on Apache Thrift Proxy API ignored</a></h3> + +<p>A user noted that when trying to specify a delete using the Accumulo Thrift Proxy, the delete +was treated as an update. <a href="https://issues.apache.org/jira/browse/ACCUMULO-3474";>ACCUMULO-3474</a> fixes the Proxy server such that deletes are properly +respected as specified by the client.</p> + +<h2 id="other-changes">Other Changes</h2> + +<p>Other changes for this version can be found <a href="https://issues.apache.org/jira/browse/ACCUMULO/fixforversion/12328662";>in JIRA</a>.</p> + +<h2 id="testing">Testing</h2> + +<p>Each unit and functional test only runs on a single node, while the RandomWalk +and Continuous Ingest tests run on any number of nodes. <em>Agitation</em> refers to +randomly restarting Accumulo processes and Hadoop DataNode processes, and, in +HDFS High-Availability instances, forcing NameNode fail-over.</p> + +<p>During testing, multiple Accumulo developers noticed some stability issues +with HDFS using Apache Hadoop 2.6.0 when restarting Accumulo processes and +HDFS datanodes. The developers investigated these issues as a part of the +normal release testing procedures, but were unable to find a definitive cause +of these failures. Users are encouraged to follow +<a href="https://issues.apache.org/jira/browse/ACCUMULO-2388";>ACCUMULO-2388</a> if they wish to follow any future developments. +One possible workaround is to increase the <code class="highlighter-rouge">general.rpc.timeout</code> in the +Accumulo configuration from <code class="highlighter-rouge">120s</code> to <code class="highlighter-rouge">240s</code>.</p> + +<table id="release_notes_testing" class="table"> + <thead> + <tr> + <th>OS</th> + <th>Hadoop</th> + <th>Nodes</th> + <th>ZooKeeper</th> + <th>HDFS High-Availability</th> + <th>Tests</th> + </tr> + </thead> + <tbody> + <tr> + <td>Gentoo</td> + <td>2.6.0</td> + <td>1</td> + <td>3.4.5</td> + <td>No</td> + <td>Unit and Integration Tests</td> + </tr> + <tr> + <td>Centos 6.5</td> + <td>2.7.1</td> + <td>6</td> + <td>3.4.5</td> + <td>No</td> + <td>Continuous Ingest and Verify</td> + </tr> + </tbody> +</table> + + + +<p><strong>View all releases in the <a href="/release/">archive</a></strong></p> + + </div> + + +<footer> + + <p><a href="https://www.apache.org";><img src="/images/feather-small.gif" alt="Apache Software Foundation" id="asf-logo" height="100" /></a></p> + + <p>Copyright © 2011-2016 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/LICENSE-2.0";>Apache License, Version 2.0</a>.</p> + +</footer> + + + </div> + </div> + </div> +</body> +</html> http://git-wip-us.apache.org/repos/asf/accumulo-website/blob/c0655661/release/accumulo-1.5.4/index.html ---------------------------------------------------------------------- diff --git a/release/accumulo-1.5.4/index.html b/release/accumulo-1.5.4/index.html new file mode 100644 index 0000000..7782556 --- /dev/null +++ b/release/accumulo-1.5.4/index.html @@ -0,0 +1,276 @@ +<!DOCTYPE html> +<html lang="en"> +<head> +<!-- + Licensed to the Apache Software Foundation (ASF) under one or more + contributor license agreements. See the NOTICE file distributed with + this work for additional information regarding copyright ownership. + The ASF licenses this file to You under the Apache License, Version 2.0 + (the "License"); you may not use this file except in compliance with + the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. +--> +<meta charset="utf-8"> +<meta http-equiv="X-UA-Compatible" content="IE=edge"> +<meta name="viewport" content="width=device-width, initial-scale=1"> +<link href="https://maxcdn.bootstrapcdn.com/bootswatch/3.3.7/paper/bootstrap.min.css"; rel="stylesheet" integrity="sha384-awusxf8AUojygHf2+joICySzB780jVvQaVCAt1clU3QsyAitLGul28Qxb2r1e5g+" crossorigin="anonymous"> +<link href="//netdna.bootstrapcdn.com/font-awesome/4.0.3/css/font-awesome.css" rel="stylesheet"> +<link rel="stylesheet" type="text/css" href="https://cdn.datatables.net/v/bs/jq-2.2.3/dt-1.10.12/datatables.min.css";> +<link href="/css/accumulo.css" rel="stylesheet" type="text/css"> + +<title>Apache Accumulo 1.5.4</title> + +<script src="https://ajax.googleapis.com/ajax/libs/jquery/2.2.4/jquery.min.js";></script> +<script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.7/js/bootstrap.min.js"; integrity="sha384-Tc5IQib027qvyjSMfHjOMaLkfuWVxZxUPnCJA7l2mCWNIpG9mGCD8wGNIcPD7Txa" crossorigin="anonymous"></script> +<script type="text/javascript" src="https://cdn.datatables.net/v/bs/jq-2.2.3/dt-1.10.12/datatables.min.js";></script> +<script> + // show location of canonical site if not currently on the canonical site + $(function() { + var host = window.location.host; + if (typeof host !== 'undefined' && host !== 'accumulo.apache.org') { + $('#non-canonical').show(); + } + }); + + $(function() { + // decorate section headers with anchors + return $("h2, h3, h4, h5, h6").each(function(i, el) { + var $el, icon, id; + $el = $(el); + id = $el.attr('id'); + icon = '<i class="fa fa-link"></i>'; + if (id) { + return $el.append($("<a />").addClass("header-link").attr("href", "#" + id).html(icon)); + } + }); + }); + + // configure Google Analytics + (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){ + (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o), + m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m) + })(window,document,'script','//www.google-analytics.com/analytics.js','ga'); + + if (ga.hasOwnProperty('loaded') && ga.loaded === true) { + ga('create', 'UA-50934829-1', 'apache.org'); + ga('send', 'pageview'); + } +</script> + +</head> +<body style="padding-top: 100px"> + + <nav class="navbar navbar-default navbar-fixed-top"> + <div class="container"> + <div class="navbar-header"> + <button type="button" class="navbar-toggle" data-toggle="collapse" data-target="#navbar-items"> + <span class="sr-only">Toggle navigation</span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + <span class="icon-bar"></span> + </button> + <a href="/"><img id="nav-logo" alt="Apache Accumulo" class="img-responsive" src="/images/accumulo-logo.png" width="200"/></a> + </div> + <div class="collapse navbar-collapse" id="navbar-items"> + <ul class="nav navbar-nav"> + <li class="nav-link"><a href="/downloads">Download</a></li> + <li class="dropdown"> + <a class="dropdown-toggle" data-toggle="dropdown" href="#">Releases<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="/release/accumulo-1.8.0/">1.8.0 (Latest)</a></li> + <li><a href="/release/accumulo-1.7.2/">1.7.2</a></li> + <li><a href="/release/accumulo-1.6.6/">1.6.6</a></li> + <li><a href="/release/">Archive</a></li> + </ul> + </li> + <li class="dropdown"> + <a class="dropdown-toggle" data-toggle="dropdown" href="#">Documentation<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="/user-manual/">User Manuals</a></li> + <li><a href="/javadocs/">Javadocs</a></li> + <li><a href="/examples/">Examples</a></li> + <li><a href="/notable_features">Features</a></li> + <li><a href="/screenshots">Screenshots</a></li> + <li><a href="/papers">Papers & Presentations</a></li> + <li><a href="/glossary">Glossary</a></li> + </ul> + </li> + <li class="dropdown"> + <a class="dropdown-toggle" data-toggle="dropdown" href="#">Community<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="/get_involved">Get Involved</a></li> + <li><a href="/mailing_list">Mailing Lists</a></li> + <li><a href="/people">People</a></li> + <li><a href="/news">News Archive</a></li> + <li><a href="/projects">Community Projects</a></li> + <li><a href="/thanks">Thanks</a></li> + <li class="divider"></li> + <li class="dropdown-header">Governance</li> + <li><a href="/bylaws">Bylaws</a></li> + <li><a href="/governance/consensusBuilding">Consensus Building</a></li> + <li><a href="/governance/lazyConsensus">Lazy Consensus</a></li> + <li><a href="/governance/releasing">Releasing</a></li> + <li><a href="/governance/voting">Voting</a></li> + </ul> + </li> + <li class="dropdown"> + <a class="dropdown-toggle" data-toggle="dropdown" href="#">Development<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="https://issues.apache.org/jira/browse/ACCUMULO";>Issue Tracker <i class="fa fa-external-link"></i></a></li> + <li><a href="https://github.com/apache/accumulo/pulls";>Pull Requests <i class="fa fa-external-link"></i></a></li> + <li><a href="https://builds.apache.org/view/A/view/Accumulo";>Jenkins Builds <i class="fa fa-external-link"></i></a></li> + <li><a href="https://travis-ci.org/apache/accumulo";>TravisCI Builds <i class="fa fa-external-link"></i></a></li> + <li class="divider"></li> + <li class="dropdown-header">Guides</li> + <li><a href="/source">Source & Guide</a></li> + <li><a href="/git">Git Workflow</a></li> + <li><a href="/versioning">Versioning</a></li> + <li><a href="/contrib">Contrib Projects</a></li> + <li><a href="/rb">Review Board</a></li> + <li><a href="/releasing">Making Releases</a></li> + <li><a href="/verifying_releases">Verifying Releases</a></li> + </ul> + </li> + </ul> + <ul class="nav navbar-nav navbar-right"> + <li class="dropdown"> + <a class="dropdown-toggle" data-toggle="dropdown" href="#">Apache Software Foundation<span class="caret"></span></a> + <ul class="dropdown-menu"> + <li><a href="https://www.apache.org";>Apache Homepage <i class="fa fa-external-link"></i></a></li> + <li><a href="https://www.apache.org/licenses/LICENSE-2.0";>License <i class="fa fa-external-link"></i></a></li> + <li><a href="https://www.apache.org/foundation/sponsorship";>Sponsorship <i class="fa fa-external-link"></i></a></li> + <li><a href="https://www.apache.org/security";>Security <i class="fa fa-external-link"></i></a></li> + <li><a href="https://www.apache.org/foundation/thanks";>Thanks <i class="fa fa-external-link"></i></a></li> + <li><a href="https://www.apache.org/foundation/policies/conduct";>Code of Conduct <i class="fa fa-external-link"></i></a></li> + </ul> + </li> + </ul> + </div> + </div> +</nav> + + + <div class="container"> + <div class="row"> + <div class="col-md-12"> + + <div id="non-canonical" style="display: none; background-color: #F0E68C; padding-left: 1em;"> + Visit the official site at: <a href="https://accumulo.apache.org";>https://accumulo.apache.org</a> + </div> + <div id="content"> + + <h1 class="title">Apache Accumulo 1.5.4</h1> + + <p>21 Sep 2015</p> + +<p>Apache Accumulo 1.5.4 is one more bug-fix release for the 1.5 series. Like 1.5.3 before it, this release contains a +very small changeset when considering the normal size of changes in a release.</p> + +<p>This release contains no changes to the <a href="https://github.com/apache/accumulo/blob/1.7.0/README.md#api";>public API</a>. As such, there are no concerns +for the compatibility of user code running against 1.5.3. All users are encourage to upgrade +immediately without concern of stability and compatibility.</p> + +<p>A full list of changes is available via <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12312121&version=12333106";>CHANGES</a>.</p> + +<p>Weâd like to thank all of the committers and contributors which had a part in +making this release, from code contributions to testing. Everyoneâs efforts are +greatly appreciated.</p> + +<h2 id="correctness-bugs">Correctness Bugs</h2> + +<h3 id="silent-data-loss-via-bulk-imported-files">Silent data-loss via bulk imported files</h3> + +<p>A user recently reported that a simple bulk-import application would occasionally lose some records. Through investigation, +it was found that when bulk imports into a table failed the initial assignment, the logic that automatically retries +the imports was incorrectly choosing the tablets to import the files into. <a href="https://issues.apache.org/jira/browse/ACCUMULO-3967";>ACCUMULO-3967</a> contains +more information on the cause and identification of the bug. The data-loss condition would only affect entire files. +If records from a file exist in Accumulo, it is still guaranteed that all records within that imported file were +successful.</p> + +<p>As such, users who have bulk import applications using previous versions of Accumulo should verify that all of their +data was correctly ingested into Accumulo and immediately update to Accumulo 1.5.4.</p> + +<p>Thanks to Edward Seidl for reporting this bug to us!</p> + +<h2 id="server-side-auditing-changes">Server-side auditing changes</h2> + +<p>Thanks to James Mello for reporting and providing the fixes to the following server-side auditing issues.</p> + +<h3 id="incorrect-audit-initialization">Incorrect audit initialization</h3> + +<p>It was observed that the implementation used to audit user API requests on Accumulo server processes +was not being correctly initialized which caused audit messages to never be generated. This was rectified +in <a href="https://issues.apache.org/jira/browse/ACCUMULO-3939";>ACCUMULO-3939</a>.</p> + +<h3 id="missing-audit-implementations">Missing audit implementations</h3> + +<p>It was also observed that some server-side API implementations did not include audit messages which resulted +in an incomplete historical picture on what operations a user might have invoked. The missing audits (and those +that were added) are described in <a href="https://issues.apache.org/jira/browse/ACCUMULO-3946";>ACCUMULO-3946</a>.</p> + +<h2 id="testing">Testing</h2> + +<p>Each unit and functional test only runs on a single node, while the RandomWalk +and Continuous Ingest tests run on any number of nodes. <em>Agitation</em> refers to +randomly restarting Accumulo processes and Hadoop DataNode processes, and, in +HDFS High-Availability instances, forcing NameNode fail-over.</p> + +<table id="release_notes_testing" class="table"> + <thead> + <tr> + <th>OS</th> + <th>Hadoop</th> + <th>Nodes</th> + <th>ZooKeeper</th> + <th>HDFS High-Availability</th> + <th>Tests</th> + </tr> + </thead> + <tbody> + <tr> + <td>OSX</td> + <td>2.6.0</td> + <td>1</td> + <td>3.4.5</td> + <td>No</td> + <td>Unit and Functional Tests</td> + </tr> + <tr> + <td>Centos 6.5</td> + <td>2.7.1</td> + <td>6</td> + <td>3.4.5</td> + <td>No</td> + <td>Continuous Ingest and Verify (10B entries), Randomwalk (24hrs)</td> + </tr> + </tbody> +</table> + + + +<p><strong>View all releases in the <a href="/release/">archive</a></strong></p> + + </div> + + +<footer> + + <p><a href="https://www.apache.org";><img src="/images/feather-small.gif" alt="Apache Software Foundation" id="asf-logo" height="100" /></a></p> + + <p>Copyright © 2011-2016 The Apache Software Foundation. Licensed under the <a href="https://www.apache.org/licenses/LICENSE-2.0";>Apache License, Version 2.0</a>.</p> + +</footer> + + + </div> + </div> + </div> +</body> +</html>
