Modified: websites/staging/bigtop/trunk/content/release-notes.html ============================================================================== --- websites/staging/bigtop/trunk/content/release-notes.html (original) +++ websites/staging/bigtop/trunk/content/release-notes.html Sun Oct 5 22:32:09 2014 @@ -1,15 +1,15 @@ <!DOCTYPE html> <!-- - | Generated by Apache Maven Doxia at Jul 28, 2014 + | Generated by Apache Maven Doxia at 2014-09-27 | Rendered using Apache Maven Fluido Skin 1.3.0 --> <html xmlns="http://www.w3.org/1999/xhtml" xml:lang="en" lang="en"> <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20140728" /> + <meta name="Date-Revision-yyyymmdd" content="20140927" /> <meta http-equiv="Content-Language" content="en" /> - <title> + <title>Bigtop - Bigtop Project Release Notes</title> <link rel="stylesheet" href="./css/apache-maven-fluido-1.3.0.min.css" /> <link rel="stylesheet" href="./css/site.css" /> @@ -159,8 +159,8 @@ - <li id="publishDate" class="pull-right">Last Published: 2014-07-28</li> <li class="divider pull-right">|</li> - <li id="projectVersion" class="pull-right">Version: 0.7.0</li> + <li id="publishDate" class="pull-right">Last Published: 2014-09-27</li> <li class="divider pull-right">|</li> + <li id="projectVersion" class="pull-right">Version: 0.8.0</li> </ul> </div> @@ -178,1268 +178,2161 @@ the License. --> - <div class="section"><h2>Bigtop Project Release Notes<a name="Bigtop_Project_Release_Notes"></a></h2> + <div class="section"> +<h2>Bigtop Project Release Notes<a name="Bigtop_Project_Release_Notes"></a></h2> <!-- Paste release notes from https://issues.apache.org/jira/browse/BIGTOP here. --> - <div class="section"><h3>Release Notes - Bigtop - Version 0.7.0<a name="Release_Notes_-_Bigtop_-_Version_0.7.0"></a></h3> - <div class="section"><h4>Sub-task<a name="Sub-task"></a></h4> - <ul> - <li> + +<div class="section"> +<h3>Release Notes - Bigtop - Version 0.8.0<a name="Release_Notes_-_Bigtop_-_Version_0.8.0"></a></h3> + + +<div class="section"> +<h4>Sub-task<a name="Sub-task"></a></h4> + +<ul> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1111">BIGTOP-1111</a>] - Bump version of Hadoop to 2.2.0 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1165">BIGTOP-1165</a>] - Ivy config for hive metastore looks incorrect, which breaks build on JDK 7 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1166">BIGTOP-1166</a>] - Hive-jdbc doesn't compile on JDK 7, which breaks build +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1183">BIGTOP-1183</a>] - Rename spark package to spark-core +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1184">BIGTOP-1184</a>] - bump hadoop version to 2.3.0 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1202">BIGTOP-1202</a>] - One-button-click way for installing all needed bits of testing framework +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1203">BIGTOP-1203</a>] - Update toolchaing to automatically install Gradle into dev env. +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1208">BIGTOP-1208</a>] - Add DFSIO test into longevity suite +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1209">BIGTOP-1209</a>] - Add SLive test into longevity suite +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1242">BIGTOP-1242</a>] - bump jsvc to 1.0.15 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1244">BIGTOP-1244</a>] - bump flume to 1.5.0.1 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1278">BIGTOP-1278</a>] - bump pig version to 0.12.1 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1279">BIGTOP-1279</a>] - bump hive version to 0.12.0 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1280">BIGTOP-1280</a>] - bump Oozie version to 4.0.1 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1281">BIGTOP-1281</a>] - bump hbase version to 0.98.2 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1282">BIGTOP-1282</a>] - bump Mahout version to 0.9 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1283">BIGTOP-1283</a>] - bump Solr version to 4.6.0 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1284">BIGTOP-1284</a>] - bump Spark version to 0.9.1 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1285">BIGTOP-1285</a>] - Bump version of Phoenix to 4.0 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1291">BIGTOP-1291</a>] - On a clean ~/.m2 hbase mvn install site will fail as install is executed first +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1293">BIGTOP-1293</a>] - Include Hive 0.13 into the stack +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1302">BIGTOP-1302</a>] - Update hbase smoke tests to escape Hbase's "event horizon" +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1330">BIGTOP-1330</a>] - bump Giraph version to 1.1.0 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1331">BIGTOP-1331</a>] - bump Hue version to 3.6.0 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1340">BIGTOP-1340</a>] - Hbase build has to use hadoop-two.version sys. prop +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1350">BIGTOP-1350</a>] - Bump version of Crunch to 0.10.0 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1354">BIGTOP-1354</a>] - bump version of Solr to 4.9.0 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1426">BIGTOP-1426</a>] - Bump version of Hadoop to 2.4.1 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1432">BIGTOP-1432</a>] - Update HBase version to 0.98.5 in the BOM +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1433">BIGTOP-1433</a>] - Fix Hive build after BIGTOP-1429 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1434">BIGTOP-1434</a>] - Maven build failing with NoClassDefFoundError at maven-site-plugin:3.0-beta-3:site (packaging-documentation) @ sqoop-docs +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1435">BIGTOP-1435</a>] - Fix Crunch build after BIGTOP-1429 +</li> +</ul> + +</div> +<div class="section"> +<h4>Bug<a name="Bug"></a></h4> + +<ul> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-282">BIGTOP-282</a>] - the licensing status of the MovieLens data files needs to be cleared up +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-831">BIGTOP-831</a>] - Hadoop branch-2 (and trunk?) are failing when built with JDK7u11 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-922">BIGTOP-922</a>] - Existing Puppet recipes are failing to initialize HDFS dictories on the first run +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-986">BIGTOP-986</a>] - install-flume.sh uses -x instead of -e +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-996">BIGTOP-996</a>] - Document steps needed to run BT tests on a fresh host +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-997">BIGTOP-997</a>] - TestCLI fails test id 5: comparator fails +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1042">BIGTOP-1042</a>] - Add support for Hadoop 2.1.x-beta +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1048">BIGTOP-1048</a>] - ZooKeeper installation use "zookeeper-server.pid" as default while ZooKeeper expects zookeeper_server.pid +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1072">BIGTOP-1072</a>] - Vagrant scripts for spinning up and "hydrating" bigtop vms +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1092">BIGTOP-1092</a>] - Add Hue documentation package +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1097">BIGTOP-1097</a>] - introduce bigtop-groovy package +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1124">BIGTOP-1124</a>] - solrctl should be able to auto-detect JAVA_HOME +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1125">BIGTOP-1125</a>] - Return value does not reflect status checks +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1128">BIGTOP-1128</a>] - FIX and modularize mahout sample data sets +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1132">BIGTOP-1132</a>] - Phoenix RPM specfile does not create symlinks +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1141">BIGTOP-1141</a>] - Add TestYarnNode to test yarn node +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1143">BIGTOP-1143</a>] - Oozie configuration file is incomplete +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1146">BIGTOP-1146</a>] - Flume NG package is broken because of org.hbase.asynchbase deps. mismanagement +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1150">BIGTOP-1150</a>] - update Spark debian packaging to the latest format +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1153">BIGTOP-1153</a>] - Crunch package doesn't depend on anything +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1164">BIGTOP-1164</a>] - Get whole Bigtop stack building on JDK 7 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1167">BIGTOP-1167</a>] - got "Permission denied" when creating vagrant home folder in provision.sh +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1168">BIGTOP-1168</a>] - hue build fails (unresolvable maven dependencies) +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1169">BIGTOP-1169</a>] - Hue rpm build fails +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1174">BIGTOP-1174</a>] - missing dependency setting on init-hdfs.sh in puppet recipes +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1181">BIGTOP-1181</a>] - Add pyspark to spark package +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1187">BIGTOP-1187</a>] - Spark service packages have extraneous core in the name +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1191">BIGTOP-1191</a>] - master pom.xml file formatting is out of whack +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1197">BIGTOP-1197</a>] - iTest PackageManagerTests are failing +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1199">BIGTOP-1199</a>] - Makefile for deb packing needs to support zip archives +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1205">BIGTOP-1205</a>] - GRADLE_OPTS missing closing " in toolchain jenkins.sh.* +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1217">BIGTOP-1217</a>] - Spark test-artifact missing repository for install +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1218">BIGTOP-1218</a>] - Add JDK7 to Bigtop toolchain +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1220">BIGTOP-1220</a>] - Gradle task order isn't enforced properly with dependsOn +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1221">BIGTOP-1221</a>] - Expand and updated FUSE tests +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1223">BIGTOP-1223</a>] - TestSlive does not fully remove root directory after an iteration +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1225">BIGTOP-1225</a>] - TestHDFSQuota can fail if tests are run out of order +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1226">BIGTOP-1226</a>] - TestSLive setup() already being used, need to rename +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1232">BIGTOP-1232</a>] - test artifact build fails in io-longevity +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1234">BIGTOP-1234</a>] - TestFileAppend shouldn't reuse client during testMultipleOutputStreamFailure() +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1236">BIGTOP-1236</a>] - TestCLI expecting permissions incorrectly +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1238">BIGTOP-1238</a>] - TestCLI has misspelled 'NAMNEODE' that is used without protocol name +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1239">BIGTOP-1239</a>] - TestCLI: make ports optional in regex comparators +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1246">BIGTOP-1246</a>] - Fix the shell-object bug in HttpFs smoke tests +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1250">BIGTOP-1250</a>] - TestTextSnappy fails +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1252">BIGTOP-1252</a>] - Update ant from 1.9.2 to 1.9.3 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1253">BIGTOP-1253</a>] - TestSLive calling setpDir() instead of setupDir() +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1254">BIGTOP-1254</a>] - add gradle specific files to .gitignore +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1255">BIGTOP-1255</a>] - init-hcfs.json needs to encode privileges as strings, not numbers. +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1256">BIGTOP-1256</a>] - Spark package deployment should reflect BIGTOP-1183 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1258">BIGTOP-1258</a>] - Spark puppet deploy might fail as /etc/spark can not be created +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1259">BIGTOP-1259</a>] - spark-worker service should be started after spark-master if ran on the same node +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1260">BIGTOP-1260</a>] - Puppet deployment should reflect on the new name of spark package +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1268">BIGTOP-1268</a>] - Jenkins Job Bigtop-trunk-Hadoop failed from 3/15/2014 due to protoc version +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1274">BIGTOP-1274</a>] - yarn ResourceManager should be started before starting NodeManagers +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1290">BIGTOP-1290</a>] - Zookeeper build is failing on Ant 1.9.3 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1294">BIGTOP-1294</a>] - asciidoc is missed from centos and sles environments of bigtop_toolchain +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1295">BIGTOP-1295</a>] - package.mk misteriously missing mkdir for RPMS that leads to SUSE build to fail +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1300">BIGTOP-1300</a>] - need to bump ant version to 1.9.4 in bigtop_toolchain +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1303">BIGTOP-1303</a>] - Pig 0.12.1 build is broken at the site target. Stack build can't proceed +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1304">BIGTOP-1304</a>] - bigtop_toolchain needs to install Scala 2.10 to support Spark build +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1306">BIGTOP-1306</a>] - RPM licensing metadata is inconsistent and wrong +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1313">BIGTOP-1313</a>] - Ant 1.9.4 update is missed from ant.pp recipe. +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1319">BIGTOP-1319</a>] - hive-rpm target is broken +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1322">BIGTOP-1322</a>] - hbase_install.sh shall be called with bash +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1324">BIGTOP-1324</a>] - Fix typo in testHDFSConf.xml of TestCLI +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1336">BIGTOP-1336</a>] - Puppet recipes failed to deploy kerberos enabled hadoop cluster +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1337">BIGTOP-1337</a>] - Logging success messages in service startup and shutdown only after verification. +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1345">BIGTOP-1345</a>] - remove bigtop-packages/src/[email protected] +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1346">BIGTOP-1346</a>] - Generalize evaluation regexp in packages.gradle +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1355">BIGTOP-1355</a>] - Hive 0.13 deb build is broken +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1358">BIGTOP-1358</a>] - adjust toolchain to use JDK7 by default +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1359">BIGTOP-1359</a>] - fix a few issues with our puppet_toolchain code +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1371">BIGTOP-1371</a>] - Spark-master service fails to start due to missing /usr/lib/spark/work +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1380">BIGTOP-1380</a>] - Pig might run out of memory during site construction +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1382">BIGTOP-1382</a>] - Hadoop site.csv components additions: yarn & mapred-app +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1390">BIGTOP-1390</a>] - JDK Woes +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1394">BIGTOP-1394</a>] - package test manifest got out of date +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1396">BIGTOP-1396</a>] - update metadata for bigtop-groovy and phoenix +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1397">BIGTOP-1397</a>] - hive-hbase package is missing after move to the latest Hive +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1398">BIGTOP-1398</a>] - hadoop-hdfs-fuse can't be installed on Ubuntu 14.04 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1399">BIGTOP-1399</a>] - add --help to alternative invocation to support newer Ubuntus +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1400">BIGTOP-1400</a>] - Whirr is failing with PermGen error: needs to be bumped up +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1401">BIGTOP-1401</a>] - Create man pages for YARN, HDFS and MAPRED. +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1402">BIGTOP-1402</a>] - Update bigtop gradle to 2.x +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1405">BIGTOP-1405</a>] - Gradle 2.0 installation from toolchain is broken +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1415">BIGTOP-1415</a>] - Remove redundant jars from spark package. +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1418">BIGTOP-1418</a>] - [BigPetStore] build.gradle - wrong variable name (hadoopClusterRuntime instead of runtime) +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1420">BIGTOP-1420</a>] - Update Phoenix version to 4.1.0 in the BOM +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1421">BIGTOP-1421</a>] - Phoenix build is missing some variables +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1425">BIGTOP-1425</a>] - gradle build can fail with NPE in an obscure way +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1427">BIGTOP-1427</a>] - HBase build should build hbase-***-hadoop2 by default +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1428">BIGTOP-1428</a>] - update tests to reflect new home for hbase user +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1429">BIGTOP-1429</a>] - Apache build of Bigtop test artifacts fails to find correct Hbase jars +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1430">BIGTOP-1430</a>] - incorrect version of spark-core prevents test artifacts from compiling +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1438">BIGTOP-1438</a>] - asciidoc is no longer needed by Sqoop +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1439">BIGTOP-1439</a>] - split jdk7 and jdk6 in Bigtop toolchain +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1440">BIGTOP-1440</a>] - a few usability updates to bigtop_toolchain +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1441">BIGTOP-1441</a>] - bigtop_toolchain fails on Ubuntu +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1442">BIGTOP-1442</a>] - need to add proper clean up for the toolchain puppet code +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1444">BIGTOP-1444</a>] - Phoenix RPM build is broken after BIGTOP-1421 +</li> +</ul> + +</div> +<div class="section"> +<h4>Improvement<a name="Improvement"></a></h4> + +<ul> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-840">BIGTOP-840</a>] - Refactor Bigtop puppet code for better integration with newer Puppet and Whirr +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-848">BIGTOP-848</a>] - Allow to build stack on top of an arbitrary Hadoop SHA +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-952">BIGTOP-952</a>] - init-hdfs.sh is dog slow. Let's replace it with a direct HDFS API calls and better layout management +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-992">BIGTOP-992</a>] - Create HowToContribute wiki page +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1019">BIGTOP-1019</a>] - Remove mysql requirement constraint from sqoop tests +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1026">BIGTOP-1026</a>] - Big Top Mapred/Itest assertions should report specific commands which fail +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1029">BIGTOP-1029</a>] - Add support for HBase 0.96+ +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1085">BIGTOP-1085</a>] - spark packages needs to be split +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1110">BIGTOP-1110</a>] - Define BOM for 0.8.0 release of Bigtop +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1130">BIGTOP-1130</a>] - Update Build Requirements on our web pages +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1137">BIGTOP-1137</a>] - provide a way to request a major version of JDK +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1138">BIGTOP-1138</a>] - hadoop-conf-pseudo package uses the deprecated fs.default.name parameter +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1139">BIGTOP-1139</a>] - bigtop-tomcat and bigtop-jsvc don't depend on bigtop-utils +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1144">BIGTOP-1144</a>] - Need to update command 'puppet apply' in file bigtop-deploy/puppet/README.md +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1147">BIGTOP-1147</a>] - README.md improvments +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1152">BIGTOP-1152</a>] - speed up spark build +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1155">BIGTOP-1155</a>] - New logo ! +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1161">BIGTOP-1161</a>] - Have a way to dynamically select components to be deployed by Puppet recipes. +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1163">BIGTOP-1163</a>] - puppet apply shows db init error if the oozie server is already running +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1171">BIGTOP-1171</a>] - Puppetize the Vagrant deployer +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1178">BIGTOP-1178</a>] - Clusterize the puppetized vagrant deployer. +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1195">BIGTOP-1195</a>] - Higher level interface to smokes. +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1200">BIGTOP-1200</a>] - Implement Generic Text File to define HCFS filesystem semantics +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1201">BIGTOP-1201</a>] - Enhance (gradleize) the build to ease development, deployment; abstract implementation +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1207">BIGTOP-1207</a>] - Create a foundation layer to build longevity and performance tests for the stack +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1210">BIGTOP-1210</a>] - integrate BIGTOP-952 with plain text HCFS FS definition from BIGTOP-1200 +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1213">BIGTOP-1213</a>] - TestHadoopExamples smokes: orderering of tests; other improvements +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1222">BIGTOP-1222</a>] - Simplify and gradleize a subset of the bigtop smokes +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1224">BIGTOP-1224</a>] - Provide a simple order for tests +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1241">BIGTOP-1241</a>] - BIGTOP should update protobuf to 2.5 from 2.4.x +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1257">BIGTOP-1257</a>] - Make TestHadoopExamples modular enough to support longevity tests. +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1269">BIGTOP-1269</a>] - BigPetStore: Create build w/ gradle +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1289">BIGTOP-1289</a>] - Update component versions in the pom.xml (including hadoop) +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1296">BIGTOP-1296</a>] - Fix permission and Update README for vagrant-puppet recipe +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1311">BIGTOP-1311</a>] - allow easy site publishing +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1312">BIGTOP-1312</a>] - Add dynamic menus, update, links, modern CSS to bigtop site. +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1314">BIGTOP-1314</a>] - Deprecate make build +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1316">BIGTOP-1316</a>] - enhance Shell for better checking of return code & output logging +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1321">BIGTOP-1321</a>] - TestCLI: check assumptions before the test run +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1342">BIGTOP-1342</a>] - Make TestCLI usable for both HDFS and HCFS +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1347">BIGTOP-1347</a>] - Support better entropy performance on vagrant VMs +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1348">BIGTOP-1348</a>] - vagrant-puppet provisioning is too slow on installing packages +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1372">BIGTOP-1372</a>] - Bigtop needs feature that takes in multiple arguments to build specific components at command line +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1374">BIGTOP-1374</a>] - Add dynamic override of BOM variables into Gradle build +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1391">BIGTOP-1391</a>] - Improve README.md so that the markdown rendering is pretty and easy to read +</li> +</ul> + +</div> +<div class="section"> +<h4>New Feature<a name="New_Feature"></a></h4> + +<ul> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1039">BIGTOP-1039</a>] - Add packaging for Shark analytics +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1089">BIGTOP-1089</a>] - BigPetStore: A polyglot big data processing blueprint +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1188">BIGTOP-1188</a>] - Smoke tests for HttpFs +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1192">BIGTOP-1192</a>] - Add utilities to facilitate cluster failure testing into bigtop-test-framework +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1212">BIGTOP-1212</a>] - Pick or build a framework for building fake data sets +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1272">BIGTOP-1272</a>] - BigPetStore: Productionize the Mahout recommender +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1351">BIGTOP-1351</a>] - Init script for HBase Thrift2 server is missing +</li> +</ul> + +</div> +<div class="section"> +<h4>Task<a name="Task"></a></h4> + +<ul> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-236">BIGTOP-236</a>] - The user installed by hbase gets an incorrect home directory +</li> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1240">BIGTOP-1240</a>] - Formatting Guidelines +</li> +</ul> + +</div> +<div class="section"> +<h4>Test<a name="Test"></a></h4> + +<ul> + +<li>[<a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1040">BIGTOP-1040</a>] - Add integration tests for Shark component +</li> +</ul> + + </div></div> +<div class="section"> +<h3>Release Notes - Bigtop - Version 0.7.0<a name="Release_Notes_-_Bigtop_-_Version_0.7.0"></a></h3> + +<div class="section"> +<h4>Sub-task<a name="Sub-task"></a></h4> + +<ul> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-932">BIGTOP-932</a> ] - Allow puppet recipes to automatically pull in needed files from web </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-964">BIGTOP-964</a> ] - Bump hive version to 0.11 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-993">BIGTOP-993</a> ] - Add packaging for Phoenix </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1053">BIGTOP-1053</a> ] - Bump version of Hadoop to 2.0.6-alpha </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1073">BIGTOP-1073</a> ] - Bump version of HBase to 0.94.11 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1074">BIGTOP-1074</a> ] - Bump version of Hue to 2.5.0 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1075">BIGTOP-1075</a> ] - bump version of Flume to 1.4.0 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1076">BIGTOP-1076</a> ] - bump version of Crunch to 0.7.0 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1077">BIGTOP-1077</a> ] - Bump version of Hive to 0.11.0 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1078">BIGTOP-1078</a> ] - bump version of Datafu to 1.0.0 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1079">BIGTOP-1079</a> ] - bump version of Solr to 4.5.0 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1083">BIGTOP-1083</a> ] - Spark version was changed with incubating process. </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1101">BIGTOP-1101</a> ] - Bump version of HBase to 0.94.12 </li> </ul> - </div><div class="section"><h4>Bug<a name="Bug"></a></h4> - <ul> - <li> + </div> +<div class="section"> +<h4>Bug<a name="Bug"></a></h4> + +<ul> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-990">BIGTOP-990</a> ] - /usr/lib/bigtop-utils/ should be owned by bigtop-utils package </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-998">BIGTOP-998</a> ] - Consolidate Hue packages </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1005">BIGTOP-1005</a> ] - Create versionless symlinks in hadoop client directory </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1006">BIGTOP-1006</a> ] - Explicitly state the working directory to be used in init scripts instead of relying on user's home directories </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1008">BIGTOP-1008</a> ] - /usr/lib/bigtop-utils directory is not owned by bigtop-utils package in RPMs </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1010">BIGTOP-1010</a> ] - libsnappy not included in the final hadoop RPM </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1011">BIGTOP-1011</a> ] - bigtop-detect-javahome has a quirky search order </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1017">BIGTOP-1017</a> ] - Revert a commit that introduces some unneeded dependencies </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1027">BIGTOP-1027</a> ] - 'bigtop-detect-classpath' helper script missing from bigtop-utils </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1033">BIGTOP-1033</a> ] - itest-common: fix debian install to avoid conffile prompt </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1034">BIGTOP-1034</a> ] - Custom user's home directory's creation fails in init-hdfs.sh </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1036">BIGTOP-1036</a> ] - Hue's oozie app package should depend on hue jobsub package </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1037">BIGTOP-1037</a> ] - Provide a mechanism to control the sourcing of defaults files </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1044">BIGTOP-1044</a> ] - hive and hive-jdbc versions should be kept in sync </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1045">BIGTOP-1045</a> ] - Be consistent with shells, bigtop-detect-javahome, and bigtop-utils versions </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1046">BIGTOP-1046</a> ] - Pig's use of BIGTOP_DEFAULTS_DIR is evaluated at the wrong time </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1051">BIGTOP-1051</a> ] - Spark archive should come in tar.gz format </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1052">BIGTOP-1052</a> ] - Increase environment configurability/debugging of Mahout Tests </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1055">BIGTOP-1055</a> ] - Spark package doesn't create PREFIX/bin directory and sets wrong permissions </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1059">BIGTOP-1059</a> ] - Add path option for pig.jar to pig smoke pom.xml </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1070">BIGTOP-1070</a> ] - Add BIGTOP_CLASSPATH functionality to tomcat deployment </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1071">BIGTOP-1071</a> ] - bigtop-detect-javahome should select the first possible candidate in the list </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1081">BIGTOP-1081</a> ] - deb spark packing needs to set SOURCE_DIR </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1082">BIGTOP-1082</a> ] - spark package tests are missing </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1084">BIGTOP-1084</a> ] - spark build on CentOS 5 and SLES11 is broken </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1086">BIGTOP-1086</a> ] - fix miscellaneous failures in package tests </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1087">BIGTOP-1087</a> ] - flume rpm package needs to own /usr/lib/flume/tools </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1088">BIGTOP-1088</a> ] - oozie packages need to own /etc/oozie/conf.dist/tomcat-deployment.{default,secure} </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1090">BIGTOP-1090</a> ] - hue packaging needs to handle mutable bits (app.reg and hue.pth) </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1094">BIGTOP-1094</a> ] - spark SPEC mistakenly re-defines alternatives command on SLES/OpenSUSE </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1095">BIGTOP-1095</a> ] - oozie packaging doesn't remove tomcat alternatives </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1096">BIGTOP-1096</a> ] - alternatives within the alternatives-managed sub-directory could be harmful </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1098">BIGTOP-1098</a> ] - now that Spark has had its first incubator release we have to adjust bigtop accordingly </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1099">BIGTOP-1099</a> ] - sync up the versions used for smoke tests with the BOM versions </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1100">BIGTOP-1100</a> ] - the new Tomcat deployment style would benefit from a few usability tweaks </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1103">BIGTOP-1103</a> ] - Remaining fixes of BIGTOP_DEFAULTS_DIR evaluation </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1107">BIGTOP-1107</a> ] - Update to the official Hue 2.5.1 release </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1108">BIGTOP-1108</a> ] - Solr 4.5.0 has been formally released and we should start using the official release bits </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1112">BIGTOP-1112</a> ] - sqoop-client should require bigtop-utils </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1114">BIGTOP-1114</a> ] - Hue metastore app is missing from core registration and Debian packages </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1115">BIGTOP-1115</a> ] - update package test manifest for Bigtop 0.7.0 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1117">BIGTOP-1117</a> ] - hive-hcatalog integration has a few issues </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1119">BIGTOP-1119</a> ] - phoenix DEB packages differ in a few ways from RPM counterparts </li> </ul> - </div><div class="section"><h4>Improvement<a name="Improvement"></a></h4> - <ul> - <li> + </div> +<div class="section"> +<h4>Improvement<a name="Improvement"></a></h4> + +<ul> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-927">BIGTOP-927</a> ] - Update puppet recipes to support Ubuntu </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-938">BIGTOP-938</a> ] - Upgrade to Junit 4.11 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-955">BIGTOP-955</a> ] - HBase installation should advertise its location and configuration </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1004">BIGTOP-1004</a> ] - Hadoop packages do not include version independent symlinks </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1021">BIGTOP-1021</a> ] - Update HBase version to 0.94.9 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1031">BIGTOP-1031</a> ] - README has outdated/ambiguous information </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1041">BIGTOP-1041</a> ] - Add Puppet support for Spark cluster deployment </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1056">BIGTOP-1056</a> ] - some changes are introduced into Spark build: needs to be updated here </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1063">BIGTOP-1063</a> ] - Add Scala 2.9.3 to bigtop-toolchain </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1069">BIGTOP-1069</a> ] - Remove descriptions about JDK5 dependency </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1080">BIGTOP-1080</a> ] - Change /usr/bin scripts to be alternatives instead of flat files </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1106">BIGTOP-1106</a> ] - update our puppet deployment topology </li> </ul> - </div><div class="section"><h4>New Feature<a name="New_Feature"></a></h4> - <ul> - <li> + </div> +<div class="section"> +<h4>New Feature<a name="New_Feature"></a></h4> + +<ul> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-811">BIGTOP-811</a> ] - Add /var/lib/bigtop as a location to install SQL connectors and other plug-ins </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1023">BIGTOP-1023</a> ] - Define BOM for 0.7.0 release of Bigtop </li> </ul> - </div><div class="section"><h4>Task<a name="Task"></a></h4> - <ul> - <li> + </div> +<div class="section"> +<h4>Task<a name="Task"></a></h4> + +<ul> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-715">BIGTOP-715</a> ] - Add Spark packaging </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-939">BIGTOP-939</a> ] - Make usage of bigtop-tomcat more dynamic </li> </ul> - </div><div class="section"><h4>Test<a name="Test"></a></h4> - <ul> - <li> + </div> +<div class="section"> +<h4>Test<a name="Test"></a></h4> + +<ul> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-719">BIGTOP-719</a> ] - Add TestTextSnappy to test hadoop fs -text with snappy compressed files </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1030">BIGTOP-1030</a> ] - Develop integration tests for new Spark component </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1057">BIGTOP-1057</a> ] - Add TeraGen / TeraSort Benchmakring </li> </ul> - </div></div><div class="section"><h3>Release Notes - Bigtop - Version 0.6.0<a name="Release_Notes_-_Bigtop_-_Version_0.6.0"></a></h3> - - <div class="section"><h4>Sub-task<a name="Sub-task"></a></h4> - <ul> - <li> + </div></div> +<div class="section"> +<h3>Release Notes - Bigtop - Version 0.6.0<a name="Release_Notes_-_Bigtop_-_Version_0.6.0"></a></h3> + + +<div class="section"> +<h4>Sub-task<a name="Sub-task"></a></h4> + +<ul> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-239">BIGTOP-239</a> ] - HBase init scripts are shut down in the wrong order </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-812">BIGTOP-812</a> ] - HttpFS is using Tomcat 6.0.32 which has numerous vulnerabilities </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-813">BIGTOP-813</a> ] - add integration test for HCatlog </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-814">BIGTOP-814</a> ] - add packaging test for HCatlog </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-822">BIGTOP-822</a> ] - Bump version of Hadoop to 2.0.5 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-824">BIGTOP-824</a> ] - Bump version of Hive to 0.10 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-832">BIGTOP-832</a> ] - Bump version of Hue to 2.3.0 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-833">BIGTOP-833</a> ] - Update HCatalog packaging for Bigtop 0.6.0 integration </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-839">BIGTOP-839</a> ] - add packaging test for Sqoop 2 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-852">BIGTOP-852</a> ] - Improve HDFS helper script </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-854">BIGTOP-854</a> ] - add package testing manifest for HCatalog </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-855">BIGTOP-855</a> ] - add integration tests for HCatalog </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-861">BIGTOP-861</a> ] - init-hdfs.sh does not work from init scripts </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-862">BIGTOP-862</a> ] - All the Apache Hadoop services ought to start nicely and in order </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-863">BIGTOP-863</a> ] - verify the existence of the initscripts with typo </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-864">BIGTOP-864</a> ] - update the appliance for the location of the init-hdfs.sh script </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-880">BIGTOP-880</a> ] - Bump version of Datafu to 0.0.6 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-891">BIGTOP-891</a> ] - TestPigTest doesn't run against YARN cluster </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-915">BIGTOP-915</a> ] - bump version of Oozie to 3.3.2 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-916">BIGTOP-916</a> ] - Bump version of Pig to 0.11.1 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-917">BIGTOP-917</a> ] - Bump version of Solr to 4.2.1 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-926">BIGTOP-926</a> ] - Bump version of Giraph to 1.0 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-933">BIGTOP-933</a> ] - Need to add ASF license text to bigtop-toolchain files </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-962">BIGTOP-962</a> ] - Bump Sqoop version to 1.99.2 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-963">BIGTOP-963</a> ] - bump version of Whirr to 0.8.2 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-980">BIGTOP-980</a> ] - bigtop-toolchaing user module can't create 'jenkins' user </li> </ul> - </div><div class="section"><h4>Bug<a name="Bug"></a></h4> - <ul> - <li> + </div> +<div class="section"> +<h4>Bug<a name="Bug"></a></h4> + +<ul> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-275">BIGTOP-275</a> ] - scoping of variable in puppet code is incorrect </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-379">BIGTOP-379</a> ] - Package testing for Bigtop 0.5.0 release </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-445">BIGTOP-445</a> ] - yarn default file has the wrong name </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-463">BIGTOP-463</a> ] - should we reconsider /usr/lib vs. /usr/libexec decision? </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-483">BIGTOP-483</a> ] - Smoke test of Hadoop fails with clitest missing testConf.xml file </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-489">BIGTOP-489</a> ] - TestCLI with two test cases fails ID - 146 and 147 related to refreshServiceAcl </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-504">BIGTOP-504</a> ] - provide a functionality for detecting libjvm.so in bigtop-utils </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-545">BIGTOP-545</a> ] - package testing manifest in trunk needs to be updated </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-553">BIGTOP-553</a> ] - Metadata for packages needs to be harmonized between RPM and Debain </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-584">BIGTOP-584</a> ] - Fix hive smoke test failures in trunk </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-624">BIGTOP-624</a> ] - running start on a service already running should return success </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-637">BIGTOP-637</a> ] - Update boxgrinder appliance for the coming release </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-786">BIGTOP-786</a> ] - Not able to find wiki link on Bigtop homepage </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-804">BIGTOP-804</a> ] - org.apache.bigtop.itest.pmanager.PackageManagerTest.testLookupGcc fails on some systems </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-808">BIGTOP-808</a> ] - hadoop-conf-pseudo package breaks hadoop-conf alternatives during upgrades </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-809">BIGTOP-809</a> ] - Remove harmless scary message from solr build </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-815">BIGTOP-815</a> ] - Move the trunk forward now that 0.5.0 is released </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-818">BIGTOP-818</a> ] - Updated list of supported platforms on Bigtop's homepage and readme file </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-823">BIGTOP-823</a> ] - Remove obsolete slf4j removal in hive packaging </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-826">BIGTOP-826</a> ] - Wrong return code returned when stopping Hue on RHEL/SUSE </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-827">BIGTOP-827</a> ] - Ubuntu Install Instructutions Fail with a 404 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-829">BIGTOP-829</a> ] - Hue status returned wrong information on SLES </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-830">BIGTOP-830</a> ] - Add $(APACHE_MIRROR) for bigtop-tomcat </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-834">BIGTOP-834</a> ] - Remove workaround for MAPREDUCE-4814 in historyserver </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-835">BIGTOP-835</a> ] - The shell exec method must have variants which have timeout and can run in background </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-836">BIGTOP-836</a> ] - Hue status on SuSE doesn't work when run from outside of /usr/bin </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-837">BIGTOP-837</a> ] - Oozie 3.3.0 can't be build against Hadoop 2.0.3 or later </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-841">BIGTOP-841</a> ] - hadoop-conf-pseudo missed configuration for capacity scheduler and historyserver </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-842">BIGTOP-842</a> ] - hadoop-mapreduce-historyserver service dumps some output to the console instead of its .out file </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-844">BIGTOP-844</a> ] - hadoop rpm upgrade sequence is broken </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-846">BIGTOP-846</a> ] - The helper script introduced in BIGTOP-547 doesn't create /user/$USER directories on HDFS </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-850">BIGTOP-850</a> ] - Remove non-ASF repositories and infrastructure references from the project files </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-851">BIGTOP-851</a> ] - Typo breaks detection of multiple libraries in bigtop-utils in some JVMs </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-853">BIGTOP-853</a> ] - HBase test, TestLoadAndVerify does not work on secure clusters </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-857">BIGTOP-857</a> ] - Inconsistent group ownership of /var/run/hadoop-hdfs between .deb and .rpm installs </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-858">BIGTOP-858</a> ] - HBase tests are no longer compile with HBase 0.94 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-859">BIGTOP-859</a> ] - fix the Bigtop trunk package test </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-869">BIGTOP-869</a> ] - hadoop preun should not stop services itself on behalf of its subpackages </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-870">BIGTOP-870</a> ] - Bump version of Pig to 0.11 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-873">BIGTOP-873</a> ] - Hive needs Ivy cache cleared </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-874">BIGTOP-874</a> ] - make test contracts show up in javadoc </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-875">BIGTOP-875</a> ] - hadoop-smoke is broken because of missed dependency </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-876">BIGTOP-876</a> ] - TestDFSAdmin in hadoop-smoke is outdated and still relies on presence of -upgradeProgress </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-877">BIGTOP-877</a> ] - TestDFSAdmin in hadoop-smoke has to ensure its own environment, e.g. create HDFS paths, etc. </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-878">BIGTOP-878</a> ] - Bump version of Oozie to 3.3.1 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-879">BIGTOP-879</a> ] - Bump version of Solr to 4.2.0 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-883">BIGTOP-883</a> ] - Add support for Oracle RPM Java 1.7 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-884">BIGTOP-884</a> ] - hive smoke tests can't be executed as a jar file isn't present anymore </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-885">BIGTOP-885</a> ] - TestHiveSmokeBulk fails on Hive 0.9 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-886">BIGTOP-886</a> ] - Non-fatal errors when starting Hive daemons in EL5 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-887">BIGTOP-887</a> ] - Sqoop 2 should be consistent with Oozie / Bigtop for server plugins directory </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-888">BIGTOP-888</a> ] - Oozie losing value of JAVA_HOME when spawning sub-shell </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-889">BIGTOP-889</a> ] - pig smoke tests are no longer running </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-890">BIGTOP-890</a> ] - Remove workaround for distributed cache problem from Oozie package </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-892">BIGTOP-892</a> ] - hadoop packages misses capacity-scheduler configuration </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-894">BIGTOP-894</a> ] - Pig compilation fails on RPM systems on Bigtop trunk </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-895">BIGTOP-895</a> ] - A number of testcases in TestCLI are failing with (at least) Hadoop 2.0.3 and later </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-896">BIGTOP-896</a> ] - Solr rpm requires redhat-lsb to run </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-899">BIGTOP-899</a> ] - enabled deployment topology with 3 nodes </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-900">BIGTOP-900</a> ] - update deployment configs for Kerberized installations </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-901">BIGTOP-901</a> ] - Oozie smoke tests mightn't be able to obtain the jobtracker or namenode hostnames, using old config. names </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-902">BIGTOP-902</a> ] - Hive uses same file for log4j and standard output </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-903">BIGTOP-903</a> ] - crunch integration tests need to clean up output directory before each individual subtask is run </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-904">BIGTOP-904</a> ] - mahout tests should default to /tmp as a temp location </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-905">BIGTOP-905</a> ] - bump versions of test execution poms to match the BOM </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-906">BIGTOP-906</a> ] - a few tests need artifacts compiled against Hadoop 2.X </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-907">BIGTOP-907</a> ] - hadoop-mapreduce-historyserver should require hadoop-hdfs </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-910">BIGTOP-910</a> ] - datanode init script cannot stop the process bcause it cannot find the pid file </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-912">BIGTOP-912</a> ] - update HBase tests for 0.6.0 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-914">BIGTOP-914</a> ] - puppet needs to provision test users </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-918">BIGTOP-918</a> ] - Move BOM version info to the root pom file </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-920">BIGTOP-920</a> ] - Add HCatalog tests </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-923">BIGTOP-923</a>] - Packages that depend on bigtop-utils needs to specify >= 0.6 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-928">BIGTOP-928</a> ] - Hive can't be build against non-published Hadoop artifacts </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-929">BIGTOP-929</a> ] - Pig component build needs to use internal resolvers </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-930">BIGTOP-930</a> ] - init-hdfs.sh fails on execution </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-934">BIGTOP-934</a> ] - Hidden cookie is being set by wiki.cloudera.org via http://blogs.apache.org/bigtop top page </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-935">BIGTOP-935</a> ] - Use init script templates for hive </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-936">BIGTOP-936</a> ] - Use init script templates for hbase </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-937">BIGTOP-937</a> ] - Hive does not restart on Ubuntu </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-940">BIGTOP-940</a> ] - fix issues with Hive package </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-945">BIGTOP-945</a> ] - Service lock files need to match init script name </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-946">BIGTOP-946</a> ] - solr-server runlevels are wrong in debian </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-947">BIGTOP-947</a> ] - oozie init script does not use JAVA_HOME in /etc/default/bigtop-utils </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-948">BIGTOP-948</a> ] - TestFileAppend and TestHDFSQuota tests need to be updated </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-949">BIGTOP-949</a> ] - Add Sqoop tests </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-950">BIGTOP-950</a> ] - race condition for output consumption in Shell code </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-951">BIGTOP-951</a> ] - Hive Smoke's TestJdbcDriver fails </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-953">BIGTOP-953</a> ] - Revert BIGTOP-835 and BIGTOP-950 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-954">BIGTOP-954</a> ] - metadada and user data for sqoop and hcatalog packages are wrong </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-956">BIGTOP-956</a> ] - fix small issues with mahout, hue and oozie tests </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-957">BIGTOP-957</a> ] - update deployment code for Sqoop2 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-958">BIGTOP-958</a> ] - update deployment code for HCatalog </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-959">BIGTOP-959</a> ] - get rid of hadoop specific init.d.tmpl </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-960">BIGTOP-960</a> ] - Remove workaround for HBASE-6263 in hbase-thrift start </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-968">BIGTOP-968</a> ] - oozie is now part of the core hue </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-969">BIGTOP-969</a> ] - a few files belong to more than one package </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-970">BIGTOP-970</a> ] - update package test manifest and fix small issues in package metadata for Bigtop 0.6.0 </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-971">BIGTOP-971</a> ] - take care of the rat licensing complaints </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-974">BIGTOP-974</a> ] - Crunch download location is no longer /incubator </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-975">BIGTOP-975</a>] - HBase regionserver init script does not implement "condrestart" command </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-981">BIGTOP-981</a> ] - Provide minimal documentation for puppet deploy config file </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-982">BIGTOP-982</a> ] - hcatalog needs to be given HCAT_HOME and HIVE_HOME </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-983">BIGTOP-983</a> ] - Oozie-client package ships its docs twice </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-984">BIGTOP-984</a> ] - bigtop-utils doesn't detect JAVA_HOME for Oracle JDK 7 when package by Debian's tool </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-985">BIGTOP-985</a> ] - Create Hive JDBC package </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-988">BIGTOP-988</a> ] - HCatalog does not launch daemon process in a known directory </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-991">BIGTOP-991</a> ] - crunch archive is incorrect </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-994">BIGTOP-994</a> ] - hdfs-init missed a few permissions on the sub-directories </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-997">BIGTOP-997</a> ] - TestCLI fails test id 5: comparator fails </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1001">BIGTOP-1001</a> ] - need package tests for hive-jdbc package </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1002">BIGTOP-1002</a> ] - Complete porting Sqoop import tests to Sqoop 2 </li> </ul> - </div><div class="section"><h4>Improvement<a name="Improvement"></a></h4> - <ul> - <li> + </div> +<div class="section"> +<h4>Improvement<a name="Improvement"></a></h4> + +<ul> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-12">BIGTOP-12</a> ] - Add HCatalog to Bigtop </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-547">BIGTOP-547</a> ] - create an HDFS setup helper script </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-712">BIGTOP-712</a> ] - Bigtop 0.5.0 release </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-713">BIGTOP-713</a> ] - use newer debhelper and source format 3.0 (quilt) for Debian and Ubuntu packaging </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-756">BIGTOP-756</a> ] - Provide the thrift API interface file in the HBase packages </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-763">BIGTOP-763</a> ] - Add hdfs-journalnode to hadoop.spec </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-817">BIGTOP-817</a> ] - Wiki breadcrumb still shows Bigtop(incubating) </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-821">BIGTOP-821</a> ] - Puppet README's Usage section cuts off because of angle bracket delimiter </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-838">BIGTOP-838</a> ] - Both conf.empty and conf.pseudo packages don't seem to include a sample hadoop-env.sh file </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-843">BIGTOP-843</a> ] - It would be really cool if bigtop-detect-javahome were smarter and didn't pick a 32-bit JVM, or a 1.7 JVM set with default </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-882">BIGTOP-882</a> ] - Upload content of Oozie sharelib to HDFS </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-893">BIGTOP-893</a> ] - migrate puppet code to use init-hdfs.sh </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-931">BIGTOP-931</a> ] - a few improvements to secure puppet deployment code </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-961">BIGTOP-961</a> ] - hcatalog should be re-using hive user when running </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-967">BIGTOP-967</a> ] - package removal is currently missing from our package tests </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-973">BIGTOP-973</a> ] - Improve error diagnostics when sed'ing Hadoop version in Oozie package </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-995">BIGTOP-995</a> ] - JDK bug 6979329 requires a redundant kinit -R </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-1000">BIGTOP-1000</a> ] - Remove remaining references to the Incubator </li> </ul> - </div><div class="section"><h4>New Feature<a name="New_Feature"></a></h4> - <ul> - <li> + </div> +<div class="section"> +<h4>New Feature<a name="New_Feature"></a></h4> + +<ul> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-732">BIGTOP-732</a> ] - Support running multiple HBase region servers </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-881">BIGTOP-881</a> ] - Add support for Oozie to be configured with SSL (HTTPS) </li> </ul> - </div><div class="section"><h4> Task + </div> +<div class="section"> +<h4> Task <a name="Task"></a></h4> - <ul> - <li> + +<ul> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-118">BIGTOP-118</a> ] - Check to ensure our build system requirements are actually declared properly in the packaging. </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-681">BIGTOP-681</a> ] - Package tests needed for new DataFu package </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-720">BIGTOP-720</a> ] - Build environment automation </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-760">BIGTOP-760</a> ] - Push artifacts from non-Maven projects into local Maven cache </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-805">BIGTOP-805</a> ] - Add Sqoop 2 to bigtop </li> </ul> - </div><div class="section"><h4>Test<a name="Test"></a></h4> - <ul> - <li> + </div> +<div class="section"> +<h4>Test<a name="Test"></a></h4> + +<ul> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-621">BIGTOP-621</a> ] - Add test for distcp - intra cluster </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-625">BIGTOP-625</a> ] - Add HDFS Append Test </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-693">BIGTOP-693</a> ] - Add hadoop-fuse-dfs test </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-728">BIGTOP-728</a> ] - add datafu integration test @@ -1447,1252 +2340,1519 @@ </ul> - </div></div><div class="section"><h3>Release Notes - Bigtop - Version 0.5.0<a name="Release_Notes_-_Bigtop_-_Version_0.5.0"></a></h3> - <div class="section"><h4>Sub-task<a name="Sub-task"></a></h4> - <ul> - <li> + </div></div> +<div class="section"> +<h3>Release Notes - Bigtop - Version 0.5.0<a name="Release_Notes_-_Bigtop_-_Version_0.5.0"></a></h3> + +<div class="section"> +<h4>Sub-task<a name="Sub-task"></a></h4> + +<ul> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-39">BIGTOP-39</a> ] - Include Apache Avro in Bigtop </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-41">BIGTOP-41</a> ] - Add Apache Thrift to Bigtop </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-65">BIGTOP-65</a> ] - Package Apache Forrest </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-225">BIGTOP-225</a> ] - Exit consistently in init scripts for stop on stopped service </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-232">BIGTOP-232</a> ] - create an example .ks file for Bigtop </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-237">BIGTOP-237</a> ] - Oozie init scripts are way too verbose </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-239">BIGTOP-239</a> ] - HBase init scripts are shut down in the wrong order </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-240">BIGTOP-240</a> ] - hbase initscripts should be more explicit </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-302">BIGTOP-302</a>] - 1. Start a separate Wiki page on Installing Bigtop in VMs (VirtualBox) (make sure to record the fact that one needs >> 2GB of RAM) 2. Record the experience with 32bit OSes </li> - <li> + +<li> [ <a class="externalLink" href="https://issues.apache.org/jira/browse/BIGTOP-380">BIGTOP-380</a> ] - Initscripts have misleading messages </li> - <li> + +<li> [
[... 4586 lines stripped ...]
