http://git-wip-us.apache.org/repos/asf/incubator-trafodion-site/blob/b2c61852/docs/2.0.0/provisioning_guide/index.html ---------------------------------------------------------------------- diff --git a/docs/2.0.0/provisioning_guide/index.html b/docs/2.0.0/provisioning_guide/index.html index 01b4275..b9535df 100644 --- a/docs/2.0.0/provisioning_guide/index.html +++ b/docs/2.0.0/provisioning_guide/index.html @@ -550,158 +550,148 @@ table.CodeRay td.code>pre{padding:0} <li><a href="#_comments_encouraged">1.4. Comments Encouraged</a></li> </ul> </li> -<li><a href="#quickstart">2. Quick Start</a> +<li><a href="#introduction">2. Introduction</a> <ul class="sectlevel2"> -<li><a href="#_download_binaries">2.1. Download Binaries</a></li> -<li><a href="#quickstart-unpack-installer">2.2. Unpack Installer</a></li> -<li><a href="#quickstart-collect-information">2.3. Collect Information</a> +<li><a href="#introduction-security-considerations">2.1. Security Considerations</a></li> +<li><a href="#introduction-provisioning-options">2.2. Provisioning Options</a></li> +<li><a href="#introduction-provisioning-activities">2.3. Provisioning Activities</a></li> +<li><a href="#introduction-provisioning-master-node">2.4. Provisioning Master Node</a></li> +<li><a href="#introduction-trafodion-installer">2.5. Trafodion Installer</a> <ul class="sectlevel3"> -<li><a href="#_location_of_trafodion_server_side_binary">2.3.1. Location of Trafodion Server-Side Binary</a></li> -<li><a href="#_java_location">2.3.2. Java Location</a></li> -<li><a href="#_data_nodes">2.3.3. Data Nodes</a></li> -<li><a href="#_trafodion_runtime_user_home_directory">2.3.4. Trafodion Runtime User Home Directory</a></li> -<li><a href="#_distribution_manager_url">2.3.5. Distribution Manager URL</a></li> +<li><a href="#introduction-trafodion-installer-usage">2.5.1. Usage</a></li> +<li><a href="#introduction-trafodion-installer-install-vs-upgrade">2.5.2. Install vs. Upgrade</a></li> +<li><a href="#introduction-trafodion-installer-guided-setup">2.5.3. Guided Setup</a></li> +<li><a href="#introduction-trafodion-installer-automated-setup">2.5.4. Automated Setup</a></li> </ul> </li> -<li><a href="#quickstart-run-installer">2.4. Run Installer</a></li> +<li><a href="#introduction-trafodion-provisioning-directories">2.6. Trafodion Provisioning Directories</a></li> </ul> </li> -<li><a href="#introduction">3. Introduction</a> +<li><a href="#requirements">3. Requirements</a> <ul class="sectlevel2"> -<li><a href="#introduction-security-considerations">3.1. Security Considerations</a></li> -<li><a href="#introduction-provisioning-options">3.2. Provisioning Options</a></li> -<li><a href="#introduction-provisioning-activities">3.3. Provisioning Activities</a></li> -<li><a href="#introduction-provisioning-master-node">3.4. Provisioning Master Node</a></li> -<li><a href="#introduction-trafodion-installer">3.5. Trafodion Installer</a> +<li><a href="#requirements-general-cluster-and-os-requirements-and-recommendations">3.1. General Cluster and OS Requirements and Recommendations</a> <ul class="sectlevel3"> -<li><a href="#introduction-trafodion-installer-usage">3.5.1. Usage</a></li> -<li><a href="#introduction-trafodion-installer-install-vs-upgrade">3.5.2. Install vs. Upgrade</a></li> -<li><a href="#introduction-trafodion-installer-guided-setup">3.5.3. Guided Setup</a></li> -<li><a href="#introduction-trafodion-installer-automated-setup">3.5.4. Automated Setup</a></li> +<li><a href="#requirements-cluster-requirements-and-recommendations">3.1.1. Hardware Requirements and Recommendations</a></li> +<li><a href="#requirements-os-requirements-and-recommendations">3.1.2. OS Requirements and Recommendations</a></li> +<li><a href="#requirements-ip-ports">3.1.3. IP Ports</a></li> </ul> </li> -<li><a href="#introduction-trafodion-provisioning-directories">3.6. Trafodion Provisioning Directories</a></li> -</ul> -</li> -<li><a href="#requirements">4. Requirements</a> -<ul class="sectlevel2"> -<li><a href="#requirements-general-cluster-and-os-requirements-and-recommendations">4.1. General Cluster and OS Requirements and Recommendations</a> -<ul class="sectlevel3"> -<li><a href="#requirements-cluster-requirements-and-recommendations">4.1.1. Hardware Requirements and Recommendations</a></li> -<li><a href="#requirements-os-requirements-and-recommendations">4.1.2. OS Requirements and Recommendations</a></li> -<li><a href="#requirements-ip-ports">4.1.3. IP Ports</a></li> -</ul> -</li> -<li><a href="#requirements-prerequisite-software">4.2. Prerequisite Software</a> +<li><a href="#requirements-prerequisite-software">3.2. Prerequisite Software</a> <ul class="sectlevel3"> -<li><a href="#requirements-hadoop-software">4.2.1. Hadoop Software</a></li> -<li><a href="#requirements-software-packages">4.2.2. Software Packages</a></li> +<li><a href="#requirements-hadoop-software">3.2.1. Hadoop Software</a></li> +<li><a href="#requirements-software-packages">3.2.2. Software Packages</a></li> </ul> </li> -<li><a href="#requirements-trafodion-user-ids-and-their-privileges">4.3. Trafodion User IDs and Their Privileges</a> +<li><a href="#requirements-trafodion-user-ids-and-their-privileges">3.3. Trafodion User IDs and Their Privileges</a> <ul class="sectlevel3"> -<li><a href="#requirements-trafodion-runtime-user">4.3.1. Trafodion Runtime User</a></li> -<li><a href="#requirements-trafodion-provisioning-user">4.3.2. Trafodion Provisioning User</a></li> +<li><a href="#requirements-trafodion-runtime-user">3.3.1. Trafodion Runtime User</a></li> +<li><a href="#requirements-trafodion-provisioning-user">3.3.2. Trafodion Provisioning User</a></li> </ul> </li> -<li><a href="#requirements-required-configuration-changes">4.4. Required Configuration Changes</a> +<li><a href="#requirements-required-configuration-changes">3.4. Required Configuration Changes</a> <ul class="sectlevel3"> -<li><a href="#requirements-operating-system-changes">4.4.1. Operating System Changes</a></li> -<li><a href="#requirements-zookeeper-changes">4.4.2. ZooKeeper Changes</a></li> -<li><a href="#requirements-hdfs-changes">4.4.3. HDFS Changes</a></li> -<li><a href="#requirements-hbase-changes">4.4.4. HBase Changes</a></li> +<li><a href="#requirements-operating-system-changes">3.4.1. Operating System Changes</a></li> +<li><a href="#requirements-zookeeper-changes">3.4.2. ZooKeeper Changes</a></li> +<li><a href="#requirements-hdfs-changes">3.4.3. HDFS Changes</a></li> +<li><a href="#requirements-hbase-changes">3.4.4. HBase Changes</a></li> </ul> </li> -<li><a href="#requirements-recommended-configuration-changes">4.5. Recommended Configuration Changes</a> +<li><a href="#requirements-recommended-configuration-changes">3.5. Recommended Configuration Changes</a> <ul class="sectlevel3"> -<li><a href="#requirements-recommended-security-changes">4.5.1. Recommended Security Changes</a></li> -<li><a href="#requirements-recommended-hdfs-configuration-changes">4.5.2. Recommended HDFS Configuration Changes</a></li> -<li><a href="#requirements-recommended-hbase-configuration-changes">4.5.3. Recommended HBase Configuration Changes</a></li> +<li><a href="#requirements-recommended-security-changes">3.5.1. Recommended Security Changes</a></li> +<li><a href="#requirements-recommended-hdfs-configuration-changes">3.5.2. Recommended HDFS Configuration Changes</a></li> +<li><a href="#requirements-recommended-hbase-configuration-changes">3.5.3. Recommended HBase Configuration Changes</a></li> </ul> </li> </ul> </li> -<li><a href="#prepare">5. Prepare</a> +<li><a href="#prepare">4. Prepare</a> <ul class="sectlevel2"> -<li><a href="#prepare-install-optional-workstation-software">5.1. Install Optional Workstation Software</a></li> -<li><a href="#configure-installation-user-id">5.2. Configure Installation User ID</a></li> -<li><a href="#prepare-disable-requiretty">5.3. Disable requiretty</a></li> -<li><a href="#prepare-verify-os-requirements-and-recommendations">5.4. Verify OS Requirements and Recommendations</a></li> -<li><a href="#prepare-configure-kerberos">5.5. Configure Kerberos</a></li> -<li><a href="#prepare-configure-ldap-identity-store">5.6. Configure LDAP Identity Store</a></li> -<li><a href="#prepare-gather-configuration-information">5.7. Gather Configuration Information</a></li> -<li><a href="#prepare-install-required-software-packages">5.8. Install Required Software Packages</a> +<li><a href="#prepare-install-optional-workstation-software">4.1. Install Optional Workstation Software</a></li> +<li><a href="#configure-installation-user-id">4.2. Configure Installation User ID</a></li> +<li><a href="#prepare-disable-requiretty">4.3. Disable requiretty</a></li> +<li><a href="#prepare-verify-os-requirements-and-recommendations">4.4. Verify OS Requirements and Recommendations</a></li> +<li><a href="#prepare-configure-ldap-identity-store">4.5. Configure LDAP Identity Store</a></li> +<li><a href="#prepare-gather-configuration-information">4.6. Gather Configuration Information</a></li> +<li><a href="#prepare-install-required-software-packages">4.7. Install Required Software Packages</a> <ul class="sectlevel3"> -<li><a href="#prepare-download-and-install-packages">5.8.1. Download and Install Packages</a></li> +<li><a href="#prepare-download-and-install-packages">4.7.1. Download and Install Packages</a></li> +<li><a href="#prepare-install-log4cplusplus">4.7.2. Install log4c++</a></li> </ul> </li> -<li><a href="#prepare-download-trafodion-binaries">5.9. Download Trafodion Binaries</a></li> -<li><a href="#prepare-preparation-for-recipe-based-provisioning">5.10. Preparation for Recipe-Based Provisioning</a> +<li><a href="#prepare-download-trafodion-binaries">4.8. Download Trafodion Binaries</a></li> +<li><a href="#prepare-preparation-for-recipe-based-provisioning">4.9. Preparation for Recipe-Based Provisioning</a> <ul class="sectlevel3"> -<li><a href="#prepare-modify-os-settings">5.10.1. Modify OS Settings</a></li> -<li><a href="#prepare-modify-zookeeper-configuration">5.10.2. Modify ZooKeeper Configuration</a></li> -<li><a href="#prepare-modify-hdfs-configuration">5.10.3. Modify HDFS Configuration</a></li> -<li><a href="#prepare-modify-hbase-configuration">5.10.4. Modify HBase Configuration</a></li> +<li><a href="#prepare-modify-os-settings">4.9.1. Modify OS Settings</a></li> +<li><a href="#prepare-modify-zookeeper-configuration">4.9.2. Modify ZooKeeper Configuration</a></li> +<li><a href="#prepare-modify-hdfs-configuration">4.9.3. Modify HDFS Configuration</a></li> +<li><a href="#prepare-modify-hbase-configuration">4.9.4. Modify HBase Configuration</a></li> </ul> </li> </ul> </li> -<li><a href="#install">6. Install</a> +<li><a href="#install">5. Install</a> <ul class="sectlevel2"> -<li><a href="#install-unpack-installer">6.1. Unpack Installer</a></li> -<li><a href="#install-guided-install">6.2. Guided Install</a></li> -<li><a href="#install-automated-install">6.3. Automated Install</a></li> +<li><a href="#install-unpack-installer">5.1. Unpack Installer</a></li> +<li><a href="#install-automated-install">5.2. Automated Install</a></li> +<li><a href="#install-guided-install">5.3. Guided Install</a></li> </ul> </li> -<li><a href="#upgrade">7. Upgrade</a> +<li><a href="#upgrade">6. Upgrade</a> <ul class="sectlevel2"> -<li><a href="#upgraded-download-updated-trafodion-binaries">7.1. Download Updated Trafodion Binaries</a></li> -<li><a href="#upgrade-unpack-installer">7.2. Unpack Installer</a></li> -<li><a href="#upgrade-stop-tradodion">7.3. Stop Trafodion</a></li> -<li><a href="#upgrade-guided-upgrade">7.4. Guided Upgrade</a></li> -<li><a href="#upgrade-automated-upgrade">7.5. Automated Upgrade</a></li> +<li><a href="#upgraded-download-updated-trafodion-binaries">6.1. Download Updated Trafodion Binaries</a></li> +<li><a href="#upgrade-unpack-installer">6.2. Unpack Installer</a></li> +<li><a href="#upgrade-stop-tradodion">6.3. Stop Trafodion</a></li> +<li><a href="#upgrade-automated-upgrade">6.4. Automated Upgrade</a></li> +<li><a href="#upgrade-guided-upgrade">6.5. Guided Upgrade</a></li> </ul> </li> -<li><a href="#activate">8. Activate</a> +<li><a href="#activate">7. Activate</a> <ul class="sectlevel2"> -<li><a href="#activate-manage-trafodion">8.1. Manage Trafodion</a></li> -<li><a href="#activate-validate-trafodion-installation">8.2. Validate Trafodion Installation</a> +<li><a href="#activate-manage-trafodion">7.1. Manage Trafodion</a></li> +<li><a href="#activate-validate-trafodion-installation">7.2. Validate Trafodion Installation</a> <ul class="sectlevel3"> -<li><a href="#_smoke_test">8.2.1. Smoke Test</a></li> +<li><a href="#_smoke_test">7.2.1. Smoke Test</a></li> </ul> </li> -<li><a href="#activate-troubleshooting-tips">8.3. Troubleshooting Tips</a></li> +<li><a href="#activate-troubleshooting-tips">7.3. Troubleshooting Tips</a></li> </ul> </li> -<li><a href="#remove">9. Remove</a> +<li><a href="#remove">8. Remove</a> <ul class="sectlevel2"> -<li><a href="#_stop_trafodion">9.1. Stop Trafodion</a></li> -<li><a href="#_run_code_trafodion_uninstaller_code">9.2. Run <code>trafodion_uninstaller</code></a></li> +<li><a href="#_stop_trafodion">8.1. Stop Trafodion</a></li> +<li><a href="#_run_code_trafodion_uninstaller_code">8.2. Run <code>trafodion_uninstaller</code></a></li> </ul> </li> -<li><a href="#enable-security">10. Enable Security</a> +<li><a href="#enable-security">9. Enable Security</a> <ul class="sectlevel2"> -<li><a href="#enable-security-kerberos">10.1. Configuring Trafodion for Kerberos</a> +<li><a href="#enable-security-configuring-ldap-servers">9.1. Configuring LDAP Servers</a></li> +<li><a href="#enable-security-generate-trafodion-certificate">9.2. Generate Trafodion Certificate</a></li> +<li><a href="#enable-security-authentication-setup-script">9.3. Authentication Setup Script</a></li> +<li><a href="#enable-security-manage-users">9.4. Manage Users</a></li> +<li><a href="#enable-security-traf-authentication-config">9.5. .traf_authentication_config</a> +<ul class="sectlevel3"> +<li><a href="#_file_location">9.5.1. File Location</a></li> +<li><a href="#enable-security-template">9.5.2. Template</a></li> +<li><a href="#enable-security-configuration-attributes">9.5.3. Configuration Attributes</a></li> +</ul> +</li> +<li><a href="#enable-security-ldapcheck">9.6. ldapcheck</a> <ul class="sectlevel3"> -<li><a href="#_kerberos_configuration_file">10.1.1. Kerberos configuration file</a></li> -<li><a href="#_ticket_management">10.1.2. Ticket Management</a></li> -<li><a href="#_kerberos_installation">10.1.3. Kerberos installation</a></li> +<li><a href="#_usage">9.6.1. Usage</a></li> +<li><a href="#_considerations">9.6.2. Considerations</a></li> </ul> </li> -<li><a href="#enable-security-ldap">10.2. Configuring LDAP</a> +<li><a href="#enable-security-ldapconfigcheck">9.7. ldapconfigcheck</a> <ul class="sectlevel3"> -<li><a href="#enable-security-configuring-ldap-servers">10.2.1. Configuring LDAP Servers</a></li> -<li><a href="#enable-security-generate-trafodion-certificate">10.2.2. Generate Trafodion Certificate</a></li> -<li><a href="#enable-security-traf-authentication-config">10.2.3. Creating the LDAP configuration file</a></li> -<li><a href="#enable-security-ldapcheck">10.2.4. Verifying configuration and users through ldapcheck</a></li> -<li><a href="#enable-security-ldapconfigcheck">10.2.5. Verifying contents of configuration file through ldapconfigcheck</a></li> +<li><a href="#enable-security-ldapconfigcheck-considerations">9.7.1. Considerations</a></li> +<li><a href="#enable-security-ldapconfigcheck-errors">9.7.2. Errors</a></li> </ul> </li> -<li><a href="#enable-security-manage-users">10.3. Manage Users</a></li> </ul> </li> -<li><a href="#install-recipe">11. Install Recipe</a></li> -<li><a href="#upgrade-recipe">12. Upgrade Recipe</a></li> +<li><a href="#install-recipe">10. Install Recipe</a></li> +<li><a href="#upgrade-recipe">11. Upgrade Recipe</a></li> </ul> </div> </div> @@ -722,14 +712,7 @@ the License. You may obtain a copy of the License at <a href="http://www.apache "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.</p> </div> -<div class="paragraph"> -<p><strong>Disclaimer:</strong> <em>Apache Trafodion is an effort undergoing incubation at the Apache Software Foundation (ASF), sponsored by -the Apache Incubator PMC. Incubation is required of all newly accepted projects until a further review indicates that -the infrastructure, communications, and decision making process have stabilized in a manner consistent with other -successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, -it does indicate that the project has yet to be fully endorsed by the ASF.</em> -<<<</p> -</div> +<div style="page-break-after: always;"></div> <div class="paragraph"> <p><strong>Revision History</strong></p> </div> @@ -746,12 +729,8 @@ it does indicate that the project has yet to be fully endorsed by the ASF.</em> </thead> <tbody> <tr> -<td class="tableblock halign-left valign-top"><p class="tableblock">2.0.1</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">July 7, 2016</p></td> -</tr> -<tr> <td class="tableblock halign-left valign-top"><p class="tableblock">2.0.0</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">June 6, 2016</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">To be announced.</p></td> </tr> <tr> <td class="tableblock halign-left valign-top"><p class="tableblock">1.3.0</p></td> @@ -766,11 +745,11 @@ it does indicate that the project has yet to be fully endorsed by the ASF.</em> <div class="sectionbody"> <div class="paragraph"> <p>This guide describes how to provision the end-user Trafodion binaries on top of an existing Hadoop environment. This install allows you to store and query data using Trafodion, either via Trafodion clients -(see <a href="http://trafodion.incubator.apache.org/docs/client_install/index.html";>Trafodion Client Installation Guide</a>) or via application code you write.</p> +(see <a href="http://trafodion.incubator.apache.org/docs/client_install/index.html";>Trafodion Client Installation Guide</a> or via application code you write.</p> </div> <div class="paragraph"> <p>If you want to install a Trafodion developer-build environment, then please refer to the -<a href="http://trafodion.incubator.apache.org/contributing-redirect.html";>Trafodion Contributor Guide</a> for instructions.</p> +<a href="http://trafodion.incubator.apache.org/contributing_redirect.html";>Trafodion Contributor Guide</a> for instructions.</p> </div> <div class="sect2"> <h3 id="_intended_audience">1.1. Intended Audience</h3> @@ -838,7 +817,7 @@ regardless of platform type. <div class="sect2"> <h3 id="_new_and_changed_information">1.2. New and Changed Information</h3> <div class="paragraph"> -<p>This guide has been updated to include provisioning for LDAP and Kerberos.</p> +<p>This is a new guide.</p> </div> <div style="page-break-after: always;"></div> </div> @@ -1036,113 +1015,155 @@ needs. Send any errors found, suggestions for improvement, or compliments to <a </div> </div> <div class="sect1"> -<h2 id="quickstart">2. Quick Start</h2> +<h2 id="introduction">2. Introduction</h2> <div class="sectionbody"> <div class="paragraph"> -<p>This chapter provides a quick start for how to use the Trafodion Installer to install Trafodion.</p> +<p>Trafodion is a Hadoop add-on service that provides transactional SQL on top of HBase. Typically, you +use Trafodion as the database for applications that require Online Transaction Processing (OLTP), +Operational Data Store (ODS), and/or strong reporting capabilities. You access Trafodion using +standard JDBC and ODBC APIs.</p> +</div> +<div class="paragraph"> +<p>You may choose whether to add Trafodion to an existing Hadoop environment or to create a standalone +Hadoop environment specifically for Hadoop.</p> +</div> +<div class="paragraph"> +<p>This guide assumes that a Hadoop environment exists upon which your provisioning Trafodion. Refer to +<a href="#requirements-hadoop-software">Hadoop Software</a> for information about what Hadoop software is required +Trafodion.</p> </div> +<div class="sect2"> +<h3 id="introduction-security-considerations">2.1. Security Considerations</h3> <div class="paragraph"> -<p>You need the following before using the information herein:</p> +<p>The following users need be considered for Trafodion:</p> </div> <div class="ulist"> <ul> <li> -<p>A supported and running Hadoop enviroment with HDFS, HBase, and Hive. Refer to the -<a href="http://trafodion.apache.org/release-notes.html";>Release Notes</a> for information about supported versions.</p> +<p><strong>Provisioning User</strong>: A Linux-level user that performs the Trafodion provisioning tasks. This user ID +requires <code>sudo</code> access and passwordless ssh among the nodes where Trafodion is installed. In addition, +this user ID requires access to Hadoop distribution, HDFS, and HBase administrative users to change +respective environment’s configuration settings per Trafodion requirements. Refer to +<a href="#requirements-trafodion-provisioning-user">Trafodion Provisioning User</a> for more information +about the requirements and usage associated with this user ID.</p> +</li> +<li> +<p><strong>Runtime User</strong>: A Linux-level user under which the Trafodion software runs. This user ID must be registered +as a user in the Hadoop Distributed File System (HDFS) to store and access objects in HDFS, HBase, and Hive. +In addition, this user ID requires passwordless access among the nodes where Trafodion is installed. +Refer to <a href="#requirements-trafodion-runtime-user">Trafodion Runtime User</a> for more information about this user ID.</p> </li> <li> -<p>A user ID with passwordless SSH among all the nodes in the cluster. This user ID must have sudo access.</p> +<p><strong>Trafodion Database Users</strong>: Trafodion users are managed by the Trafodion security features (grant, revoke, etc.), +which can be integrated with LDAP if so desired. These users are referred to as <strong>database users</strong> and +do not have direct access to the operating system. Refer to +<a href="http://trafodion.incubator.apache.org/docs/sql_reference/index.html#register_user_statement";>Register User</a>, +<a href="http://trafodion.incubator.apache.org/docs/sql_reference/index.html#grant_statement";>Grant</a>, and other SQL statements +in the <a href="http://trafodion.incubator.apache.org/docs/sql_reference/index.html";>Trafodion SQL Reference Manual</a> for +more information about managing Trafodion Database Users. +<br> +<br> +Optionally, you can enable Trafodion Security. If you do not enable security in Trafodion, then a client interface +to Trafodion may request a user name and password, but Trafodion ignores the user name and password entered in the +client interface, and the session runs as the database <strong>root</strong> user, <code>DB__ROOT</code>, without restrictions. If you want +to restrict users, restrict access to certain users only, or restrict access to an object or operation, then you must +enable security, which enforces authentication and authorization. Refer to +<a href="#enable-security">Enable Security</a> for more information about this option.</p> </li> </ul> </div> -<div class="admonitionblock note"> -<table> -<tr> -<td class="icon"> -<i class="fa icon-note" title="Note"></i> -</td> -<td class="content"> -The Trafodion Installer modifies and restarts your Hadoop environment. -</td> -</tr> -</table> </div> <div class="sect2"> -<h3 id="_download_binaries">2.1. Download Binaries</h3> +<h3 id="introduction-provisioning-options">2.2. Provisioning Options</h3> <div class="paragraph"> -<p>You download the Trafodion binaries from the Trafodion <a href="http://trafodion.incubator.apache.org/download.html";>Download</a> page. -Download the following packages:</p> +<p>Trafodion ships with a set of scripts (the Trafodion Installer) that takes care of many of the installation and upgrade +tasks associated with the Trafodion software and its requirements. There is a separate set of scripts to remove Trafodion, +if needed.</p> +</div> +<div class="paragraph"> +<p>Currently, the Trafodion Installer is able to install Trafodion on select Cloudera and Hortonworks Hadoop distributions only. +The Trafodion Installer limitations are noted as they apply in the different chapters below. For example, the Trafodion Installer +is less capable on SUSE than it is on RedHat/CentOS; you have to install the prerequisite software packages outside the Trafodion Installer.</p> +</div> +<div class="paragraph"> +<p>The Trafodion Installer automates many of the tasks required to install/upgrade Trafodion, spanning from downloading and +installing required software packages and making required changes to your Hadoop environment via creating +the Trafodion runtime user ID to installing and starting Trafodion. It is, therefore, highly recommend that +you use the Trafodion Installer for initial installation and upgrades of Trafodion. These steps are referred to as +"Script-Based Provisioning" in this guide. Refer to <a href="#introduction-trafodion-installer">Trafodion Installer</a> provides +usage information.</p> +</div> +<div class="paragraph"> +<p>If, for any reason, you choose not to use the Trafodion Installer, then separate chapters provide +step-by-step recipes for the tasks required to install/upgrade Trafodion. These steps are referred to as +<strong>Recipe-Based Provisioning</strong> in this guide. It is assumed that you are well-versed in Linux and Hadoop +administrative tasks if using Recipe-Based Provisioning.</p> +</div> +</div> +<div class="sect2"> +<h3 id="introduction-provisioning-activities">2.3. Provisioning Activities</h3> +<div class="paragraph"> +<p>Trafodion provisioning is divided into the following main activities:</p> </div> <div class="ulist"> <ul> <li> -<p>Trafodion Installer (if planning to use the Trafodion Installer)</p> +<p><strong><a href="#requirements">Requirements</a></strong>: Activities and documentation required to install the Trafodion software. +These activities include tasks such as understanding hardware and operating system requirements, +Hadoop requirements, what software packages that need to be downloaded, configuration settings that need to be changed, +user IDs requirements, and so on.</p> </li> <li> -<p>Trafodion Server</p> +<p><strong><a href="#prepare">Prepare</a></strong>: Activities to prepare the operating system and the Hadoop ecosystem to run +Trafodion. These activities include tasks such as installing required software packages, configure +the Trafodion Installation User, gather information about the Hadoop environment, modify configuration +for different Hadoop services, and so forth.</p> +</li> +<li> +<p><strong><a href="#install">Install</a></strong>: Activities related to installing the Trafodion software. These activities +include tasks such as unpacking the Trafodion tar files, creating the Trafodion Runtime User, +creating Trafodion HDFS directories, installing the Trafodion software, and so forth.</p> </li> </ul> </div> -<div class="admonitionblock note"> -<table> -<tr> -<td class="icon"> -<i class="fa icon-note" title="Note"></i> -</td> -<td class="content"> -You can download and install the Trafodion Clients once you’ve installed and activated Trafodion. Refer to the -<a href="http://trafodion.incubator.apache.org/docs/client_install/index.html";>Trafodion Client Install Guide</a> for instructions. -</td> -</tr> -</table> -</div> -<div class="paragraph"> -<p><strong>Example</strong></p> -</div> -<div class="listingblock"> -<div class="content"> -<pre class="CodeRay highlight"><code data-lang="text">$ mkdir $HOME/trafodion-download -$ cd $HOME/trafodion-download -$ # Download the Trafodion Installer binaries -$ wget http://apache.cs.utah.edu/incubator/trafodion/trafodion-1.3.0.incubating/apache-trafodion-installer-1.3.0-incubating-bin.tar.gz -Resolving http://apache.cs.utah.edu... 192.168.1.56 -Connecting to http://apache.cs.utah.edu|192.168.1.56|:80... connected. -HTTP request sent, awaiting response... 200 OK -Length: 68813 (67K) [application/x-gzip] -Saving to: "apache-trafodion-installer-1.3.0-incubating-bin.tar.gz" - -100%[=====================================================================================================================>] 68,813 124K/s in 0.5s - -2016-02-14 04:19:42 (124 KB/s) - "apache-trafodion-installer-1.3.0-incubating-bin.tar.gz" saved [68813/68813]</code></pre> +<div style="page-break-after: always;"></div> +<div class="ulist"> +<ul> +<li> +<p><strong><a href="#upgrade">Upgrade</a></strong>: Activities related to the upgrading the Trafodion software. These activities +include tasks such as shutting down Trafodion, installing a new version of the Trafodion software, +and so on. The upgrade tasks vary depending on the differences between the current and new release of +Trafodion. For example, an upgrade may or may not include an upgrade of the Trafodion metadata.</p> +</li> +<li> +<p><strong><a href="#activate">Activate</a></strong>: Activities related to starting the Trafodion software. These actives +include basic management tasks such as starting and checking the status of the Trafodion components, +performing basic smoke tests, and so forth.</p> +</li> +<li> +<p><strong><a href="#remove">Remove</a></strong>: Activities related to removing Trafodion from your Hadoop cluster.</p> +</li> +</ul> </div> </div> -<div style="page-break-after: always;"></div> -<div class="listingblock"> -<div class="content"> -<pre class="CodeRay highlight"><code data-lang="text">$ # Download the Trafodion Server binaries -$ wget http://apache.cs.utah.edu/incubator/trafodion/trafodion-1.3.0.incubating/apache-trafodion-1.3.0-incubating-bin.tar.gz -Resolving http://apache.cs.utah.edu... 192.168.1.56 -Connecting to http://apache.cs.utah.edu|192.168.1.56|:80... connected. -HTTP request sent, awaiting response... 200 OK -Length: 214508243 (205M) [application/x-gzip] -Saving to: "apache-trafodion-1.3.0-incubating-bin.tar.gz" - -100%[=====================================================================================================================>] 214,508,243 3.90M/s in 55s - -2016-02-14 04:22:14 (3.72 MB/s) - "apache-trafodion-1.3.0-incubating-bin.tar.gz" saved [214508243/214508243] - -$ ls -l -total 209552 --rw-rw-r-- 1 centos centos 214508243 Jan 12 20:10 apache-trafodion-1.3.0-incubating-bin.tar.gz --rw-rw-r-- 1 centos centos 68813 Jan 12 20:10 apache-trafodion-installer-1.3.0-incubating-bin.tar.gz -$</code></pre> +<div class="sect2"> +<h3 id="introduction-provisioning-master-node">2.4. Provisioning Master Node</h3> +<div class="paragraph"> +<p>All provisioning tasks are performed from a single node in the cluster, which must be part +of the Hadoop environment you’re adding Trafodion to. This node is referred to as the +"<strong>Provisioning Master Node</strong>" in this guide.</p> </div> +<div class="paragraph"> +<p>The Trafodion Provisioning User must have access to all other nodes from the Provisioning +Master Node in order to perform provisioning tasks on the cluster.</p> </div> </div> <div class="sect2"> -<h3 id="quickstart-unpack-installer">2.2. Unpack Installer</h3> +<h3 id="introduction-trafodion-installer">2.5. Trafodion Installer</h3> <div class="paragraph"> -<p>The first step in the installation process is to unpack the Trafodion Installer tar file.</p> +<p>The Trafodion Installer is a set of scripts automates most of the tasks requires to install/upgrade Trafodion. +You download the Trafodion Installer tar file from the Trafodion <a href="http://trafodion.incubator.apache.org/download.html";>download</a> page. +Next, you unpack the tar file.</p> </div> <div class="paragraph"> <p><strong>Example</strong></p> @@ -1161,844 +1182,105 @@ setup_known_hosts.exp traf_cloudera_mods98 traf_hortonworks_mods $</code></pre> </div> </div> -</div> -<div class="sect2"> -<h3 id="quickstart-collect-information">2.3. Collect Information</h3> +<div style="page-break-after: always;"></div> <div class="paragraph"> -<p>Collect/decide the following information:</p> +<p>The Trafodion Installer supports two different modes:</p> </div> -<div class="sect3"> -<h4 id="_location_of_trafodion_server_side_binary">2.3.1. Location of Trafodion Server-Side Binary</h4> +<div class="olist arabic"> +<ol class="arabic"> +<li> +<p><strong>Guided Setup</strong>: Prompts for information as it works through the installation/upgrade process. This mode is recommended for new users.</p> +</li> +<li> +<p><strong>Automated Setup</strong>: Required information is provided in a pre-formatted bash-script configuration file, which is provided +via a command argument when running the Trafodion Installer thereby suppressing all prompts.</p> <div class="paragraph"> -<p>You need the fully-qualified name of the Trafodion server-side binary.</p> +<p>A template of the configuration file is available here within the installer directory: <code>trafodion_config_default</code>. +Make a copy of the file in your directory and populate the needed information.</p> </div> <div class="paragraph"> -<p><strong>Example</strong></p> -</div> -<div class="listingblock"> -<div class="content"> -<pre class="CodeRay highlight"><code data-lang="text">/home/trafodion-downloads/apache-trafodion-installer-1.3.0-incubating-bin.tar.gz</code></pre> -</div> +<p>Automated Setup is recommended since it allows you to record the required provisioning information information ahead of time. +Refer to <a href="#introduction-trafodion-automated-setup">Automated Setup</a> for information about how to +populate this file.</p> </div> +</li> +</ol> </div> <div class="sect3"> -<h4 id="_java_location">2.3.2. Java Location</h4> -<div class="paragraph"> -<p>You need to record the location of the Java. For example, use <code>ps -ef | grep java | grep hadoop | grep hbase</code> to determine what version HBase is running.</p> -</div> +<h4 id="introduction-trafodion-installer-usage">2.5.1. Usage</h4> <div class="paragraph"> -<p><strong>Example</strong></p> +<p>The following shows help for the Trafodion Installer.</p> </div> <div class="listingblock"> <div class="content"> -<pre class="CodeRay highlight"><code data-lang="text">ps -ef | grep java | grep hadoop | grep hbase -hbase 17302 17288 1 20:35 ? 00:00:10 /usr/jdk64/jdk1.7.0_67/bin/java -Dproc_master -XX:OnOutOfMemoryError=kill -9 %p -Dhdp.version=2.3.6.0-3796 -XX:+UseConcMarkSweepGC -XX:ErrorFile=/var/log/hbase/hs_err_pid%p.log -Djava.io.tmpdir=/tmp -verbose:gc -XX:+PrintGCDetails -XX:+PrintGCDateStamps -Xloggc:/var/log/hbase/gc.log-201606302035 -Xmx1024m -XX:PermSize=128m -XX:MaxPermSize=128m -Dhbase.log.dir=/var/log/hbase -Dhbase.log.file=hbase-hbase-master-ip-172-31-56-238.log -Dhbase.home.dir=/usr/hdp/current/hbase-master/bin/.. -Dhbase.id.str=hbase -Dhbase.root.logger=INFO,RFA -Djava.library.path=:/usr/hdp/2.3.6.0-3796/hadoop/lib/native/Linux-amd64-64:/usr/hdp/2.3.6.0-3796/hadoop/lib/native -Dhbase.security.logger=INFO,RFAS org.apache.hadoop.hbase.master.HMaster start</code></pre> -</div> +<pre class="CodeRay highlight"><code data-lang="text">./trafodion_install --help + +This script will install Trafodion. It will create a configuration +file (if one has not been created), setup of the environment needed +for Trafodion, configure HBase with Hbase-trx and co-processors needed, +and install a specified Trafodion build. + +Options: + --help Print this message and exit + --accept_license If provided, the user agrees to accept all the + provisions in the Trafodion license. This allows + for automation by skipping the display and prompt of + the Trafodion license. + --config_file If provided, all install prompts will be + taken from this file and not prompted for.</code></pre> </div> -<div class="paragraph"> -<p>The Java location is: <code>/usr/jdk64/jdk1.7.0_67</code></p> </div> <div style="page-break-after: always;"></div> </div> <div class="sect3"> -<h4 id="_data_nodes">2.3.3. Data Nodes</h4> +<h4 id="introduction-trafodion-installer-install-vs-upgrade">2.5.2. Install vs. Upgrade</h4> <div class="paragraph"> -<p>{projet-name} is installed on all data nodes in your Hadoop cluster. You need to record the fully-qualified domain name node for each node. -For example, refer to <code>/etc/hosts</code>.</p> -</div> -<div class="paragraph"> -<p><strong>Example</strong></p> +<p>The Trafodion Installer automatically detects whether you’re performing an install +or an upgrade by looking for the Trafodion Runtime User in the <code>/etc/passwd</code> file.</p> </div> -<div class="listingblock"> -<div class="content"> -<pre class="CodeRay highlight"><code data-lang="text">$ cat /etc/hosts -127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4 -::1 localhost localhost.localdomain localhost6 localhost6.localdomain6 - -172.31.56.238 ip-172-31-56-238.ec2.internal node01 -172.31.61.110 ip-172-31-61-110.ec2.internal node02 -172.31.57.143 ip-172-31-57-143.ec2.internal node03</code></pre> +<div class="ulist"> +<ul> +<li> +<p>If the user ID doesn’t exist, then the Trafodion Installer runs in install mode.</p> +</li> +<li> +<p>If the user ID exists, then the Trafodion Installer runs in upgrade mode.</p> +</li> +</ul> </div> </div> +<div class="sect3"> +<h4 id="introduction-trafodion-installer-guided-setup">2.5.3. Guided Setup</h4> <div class="paragraph"> -<p>Record the node names in a space-separated list.</p> +<p>By default, the Trafodion Installer runs in Guided Setup mode, which means +that it prompts you for information during the install/upgrade process.</p> </div> <div class="paragraph"> -<p><strong>Example</strong></p> -</div> -<div class="listingblock"> -<div class="content"> -<pre class="CodeRay highlight"><code data-lang="text">ip-172-31-56-238.ec2.internal ip-172-31-61-110.ec2.internal ip-172-31-57-143.ec2.internal</code></pre> +<p>Refer to the following sections for examples:</p> </div> +<div class="ulist"> +<ul> +<li> +<p><a href="#install-guided-install">Guided Install</a></p> +</li> +<li> +<p><a href="#upgrade-guided-upgrade">Guided Upgrade</a></p> +</li> +</ul> </div> </div> <div class="sect3"> -<h4 id="_trafodion_runtime_user_home_directory">2.3.4. Trafodion Runtime User Home Directory</h4> -<div class="paragraph"> -<p>The Installer creates the <code>trafodion</code> user ID. You need to decide the home directory for this user.</p> -</div> +<h4 id="introduction-trafodion-installer-automated-setup">2.5.4. Automated Setup</h4> <div class="paragraph"> -<p>The default is: <code>/home</code></p> -</div> +<p>The <code>--config_file</code> option runs the Trafodion in Automated Setup mode.</p> </div> -<div class="sect3"> -<h4 id="_distribution_manager_url">2.3.5. Distribution Manager URL</h4> <div class="paragraph"> -<p>The Installer interacts with the Distribution Manager (for example, Apache Ambari or Cloudera Manager) to modify the -Hadoop configuration.</p> +<p>Before running the Trafodion Installer with this option, you do the following:</p> </div> -<div class="paragraph"> -<p><strong>Example</strong></p> -</div> -<div class="paragraph"> -<p>Apache Ambari URL</p> -</div> -<div class="listingblock"> -<div class="content"> -<pre class="CodeRay highlight"><code data-lang="text">http://myhost.com:8080</code></pre> -</div> -</div> -<div style="page-break-after: always;"></div> -</div> -</div> -<div class="sect2"> -<h3 id="quickstart-run-installer">2.4. Run Installer</h3> -<div class="paragraph"> -<p>You run the Installer once you’ve collected the base information as described in -<a href="#quickstart-collect-information">Collect Information</a> above.</p> -</div> -<div class="paragraph"> -<p>The following example shows a guided install of Trafodion on a three-node Hortonworks Hadoop cluster.</p> -</div> -<div class="admonitionblock note"> -<table> -<tr> -<td class="icon"> -<i class="fa icon-note" title="Note"></i> -</td> -<td class="content"> -By default, the Trafodion Installer invokes <code>sqlci</code> so that you can enter the <code>initialize trafodion;</code> command. -This is shown in the example below. -</td> -</tr> -</table> -</div> -<div class="paragraph"> -<p><strong>Example</strong></p> -</div> -<div class="olist arabic"> -<ol class="arabic"> -<li> -<p>Run the Trafodion Installer in guided mode.</p> -<div class="listingblock"> -<div class="content"> -<pre class="CodeRay highlight"><code data-lang="text">$ cd $HOME/trafodion-installer/installer -$ ./trafodion_install 2>&1 | tee install.log -****************************** - TRAFODION INSTALLATION START -****************************** - -***INFO: testing sudo access -***INFO: Log file located at /var/log/trafodion/trafodion_install_2016-06-30-21-02-38.log -***INFO: Config directory: /etc/trafodion -***INFO: Working directory: /usr/lib/trafodion - -************************************ - Trafodion Configuration File Setup -************************************ - -***INFO: Please press [Enter] to select defaults. - -Is this a cloud environment (Y/N), default is [N]: N -Enter trafodion password, default is [traf123]: -Enter list of data nodes (blank separated), default []: ip-172-31-56-238.ec2.internal ip-172-31-61-110.ec2.internal ip-172-31-57-143.ec2.internal -Do you h ave a set of management nodes (Y/N), default is N: N -Enter Trafodion userid's home directory prefix, default is [/home]: /opt -Specify location of Java 1.7.0_65 or higher (JDK), default is []: /usr/jdk64/jdk1.7.0_67 -Enter full path (including .tar or .tar.gz) of trafodion tar file []: /home/trafodion-downloads/apache-trafodion_server-2.0.1-incubating.tar.gz -Enter Backup/Restore username (can be Trafodion), default is [trafodion]: -Specify the Hadoop distribut ion installed (1: Cloudera, 2: Hortonworks, 3: Other): 2 -Enter Hadoop admin username, default is [admin]: Enter Hadoop admin pas sword, default is [admin]: -Enter full Hadoop external network URL:port (include 'http://' or 'https://), default is []: http://ip-172-31-56-238.ec2.internal:8080 -Enter HDFS username or username running HDFS, default is [hdfs]: -Enter HBase username or username running HBase, default is [hbase]: -Enter HBase group, default is [hbase]: -Enter Zookeeper username or username running Zookeeper, default is [zookeeper]: -Enter directory to install trafodion to, default is [/opt/trafodion/apache-trafodion_server-2.0.1-incubating]: -Start Trafodion after install (Y/N), default is Y: -Total number of client connections per cluster, default [24]: 96 -Enter the node of primary DcsMaste r, default [ip-172-31-56-238.ec2.internal]: -Enable High Availability (Y/N), default is N: -Enable simple LDAP security (Y/N), d efault is N: -***INFO: Trafodion configuration setup complete -***INFO: Trafodion Configuration File Check -***INFO: Testing sudo access on node ip-172-31-56-238 -***INFO: Testing sudo access on node ip-172-31-61-110 -***INFO: Testing sudo access on node ip-172-31-57-143 -***INFO: Testing ssh on ip-172-31-56-238 -***INFO: Testing ssh on ip-172-31-61-110 -***INFO: Testing ssh on ip-172-31-57-143 -#!/bin/bash -# -# @@@ START COPYRIGHT @@@ -# -# Licensed to the Apache Software Foundation (ASF) under one -# or more contributor license agreements. See the NOTICE file -# distributed with this work for additional information -# regarding copyright ownership. The ASF licenses this file -# to you under the Apache License, Version 2.0 (the -# "License"); you may not use this file except in compliance -# with the License. You may obtain a copy of the License at -# -# http://www.apache.org/licenses/LICENSE-2.0 -# -# Unless required by applicable law or agreed to in writing, -# software distributed under the License is distributed on an -# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY -# KIND, either express or implied. See the License for the -# specific language governing permissions and limitations -# under the License. -# -. -. -. -9. Accepting Warranty or Additional Liability. While redistributing -the Work or Derivative Works thereof, You may choose to offer, and -charge a fee for, acceptance of support, warranty, indemnity, or -other liability obligations and/or rights consistent with this -License. However, in accepting such obligations, You may act only -on Your own behalf and on Your sole responsibility, not on behalf -of any other Contributor, and only if You agree to indemnify, defend, -and hold each Contributor harmless for any liability incurred by, -or claims asserted against, such Contributor by reason of your -accepting any such warranty or additional liability. - -END OF TERMS AND CONDITIONS - -BY TYPING "ACCEPT" YOU AGREE TO THE TERMS OF THIS AGREEMENT: ***INFO: testing sudo access -***INFO: Starting Trafodion Package Setup (2016-06-30-21-06-40) -***INFO: Installing required packages -***INFO: Log file located in /var/log/trafodion -***INFO: ... pdsh on node ip-172-31-56-238 -***INFO: ... pdsh on node ip-172-31-61-110 -***INFO: ... pdsh on node ip-172-31-57-143 -***INFO: Checking if apr is installed ... -***INFO: Checking if apr-util is installed ... -***INFO: Checking if sqlite is installed ... -***INFO: Checking if expect is installed ... -***INFO: Checking if perl-DBD-SQLite* is installed ... -***INFO: Checking if protobuf is installed ... -***INFO: Checking if xerces-c is installed ... -***INFO: Checking if perl-Params-Validate is installed ... -***INFO: Checking if perl-Time-HiRes is installed ... -***INFO: Checking if gzip is installed ... -***INFO: Checking if lzo is installed ... -***INFO: Checking if lzop is installed ... -***INFO: Checking if unzip is installed ... -***INFO: modifying limits in /usr/lib/trafodion/trafodion.conf on all nodes -***INFO: create Trafodion userid "trafodion" -***INFO: Trafodion userid's (trafodion) home directory: /opt/trafodion -***INFO: testing sudo access -Generating public/private rsa key pair. -Created directory '/opt/trafodion/.ssh'. -Your identification has been saved in /opt/trafodion/.ssh/id_rsa. -Your public key has been saved in /opt/trafodion/.ssh/id_rsa.pub. -The key fingerprint is: -12:59:ab:d7:59:a2:0e:e8:38:1c:e9:e1:86:f6:18:23 trafodion@ip-172-31-56-238 -The key's randomart image is: -+--[ RSA 2048]----+ -| . | -| o . | -| o . . . | -| . . o o + | -| + . + S o | -| = = = | -|E+B . . | -|o.=. | -| . . | -+-----------------+ -***INFO: creating .bashrc file -***INFO: Setting up userid trafodion on all other nodes in cluster -***INFO: Creating known_hosts file for all nodes -ip-172-31-56-238 -ip-172-31-56-238 ip-172-31-61-110 ip-172-31-57-143 -ip-172-31-61-110 -ip-172-31-56-238 ip-172-31-61-110 ip-172-31-57-143 -ip-172-31-57-143 -ip-172-31-56-238 ip-172-31-61-110 ip-172-31-57-143 -***INFO: trafodion user added successfully -***INFO: Trafodion environment setup completed -***INFO: creating sqconfig file -***INFO: Reserving DCS ports - -***INFO: Creating trafodion sudo access file - - -****************************** - TRAFODION MODS -****************************** - -***INFO: Hortonworks installed will run traf_hortonworks_mods -***INFO: copying hbase-trx-hdp2_3-*.jar to all nodes -***INFO: hbase-trx-hdp2_3-*.jar copied correctly! Huzzah. -USERID=admin -PASSWORD=admin -PORT=:8080 -########## Performing 'set' hbase.master.distributed.log.splitting:true on (Site:hbase-site, Tag:version1) -########## PUTting json into: doSet_version1467320863286001262.json - % Total % Received % Xferd Average Speed Time Time Time Current - Dload Upload Total Spent Left Speed -101 5757 102 3588 103 2169 98k 60930 --:--:-- --:--:-- --:--:-- 100k -{ - "resources" : [ - { - "href" : "http://ip-172-31-56-238.ec2.internal:8080/api/v1/clusters/trafodion/configurations/service_config_versions?ser -vice_name=HBASE&service_config_version=2", -. -. -. - { - "href" : "http://ip-172-31-56-238.ec2.internal:8080/api/v1/clusters/trafodion/requests/12/tasks/128", - "Tasks" : { - "cluster_name" : "trafodion", - "id" : 128, - "request_id" : 12, - "stage_id" : 2 - } - }, - { - "href" : "http://ip-172-31-56-238.ec2.internal:8080/api/v1/clusters/trafodion/requests/12/tasks/129", - "Tasks" : { - "cluster_name" : "trafodion", - "id" : 129, - "request_id" : 12, - "stage_id" : 2 - } - }, - { - "href" : "http://ip-172-31-56-238.ec2.internal:8080/api/v1/clusters/trafodion/requests/12/tasks/130", - "Tasks" : { - "cluster_name" : "trafodion", - "id" : 130, - "request_id" : 12, - "stage_id" : 2 - } - } - ], - "stages" : [ - { - "href" : "http://ip-172-31-56-238.ec2.internal:8080/api/v1/clusters/trafodion/requests/12/stages/0", - "Stage" : { - "cluster_name" : "trafodion", - "request_id" : 12, - "stage_id" : 0 - } - }, - { - "href" : "http://ip-172-31-56-238.ec2.internal:8080/api/v1/clusters/trafodion/requests/12/stages/1", - "Stage" : { - "cluster_name" : "trafodion", - "request_id" : 12, - "stage_id" : 1 - } - }, - { - "href" : "http://ip-172-31-56-238.ec2.internal:8080/api/v1/clusters/trafodion/requests/12/stages/2", - "Stage" : { - "cluster_name" : "trafodion", - "request_id" : 12, - "stage_id" : 2 - } - } - ] -}***INFO: ...polling every 30 seconds until HBase start is completed. -***INFO: HBase restart completed -***INFO: Setting HDFS ACLs for snapshot scan support -cp: `trafodion_config' and `/home/trafinstall/trafodion-2.0.1/installer/trafodion_config' are the same file -***INFO: Trafodion Mods ran successfully. - -****************************** - TRAFODION CONFIGURATION -****************************** - -/usr/lib/trafodion/installer/.. -/opt/trafodion/apache-trafodion_server-2.0.1-incubating -***INFO: untarring file to /opt/trafodion/apache-trafodion_server-2.0.1-incubating -***INFO: modifying .bashrc to set Trafodion environment variables -***INFO: copying .bashrc file to all nodes -***INFO: copying sqconfig file (/opt/trafodion/sqconfig) to /opt/trafodion/apache-trafodion_server-2.0.1-incubating/sql/script -s/sqconfig -***INFO: Creating /opt/trafodion/apache-trafodion_server-2.0.1-incubating directory on all nodes -***INFO: Start of DCS install -***INFO: DCS Install Directory: /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1 -***INFO: modifying /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1/conf/dcs-env.sh -***INFO: modifying /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1/conf/dcs-site.xml -***INFO: creating /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1/conf/servers file -***INFO: End of DCS install. -***INFO: Start of REST Server install -***INFO: Rest Install Directory: /opt/trafodion/apache-trafodion_server-2.0.1-incubating/rest-2.0.1 -***INFO: modifying /opt/trafodion/apache-trafodion_server-2.0.1-incubating/rest-2.0.1/conf/rest-site.xml -***INFO: End of REST Server install. -***INFO: starting sqgen -ip-172-31-56-238,ip-172-31-57-143,ip-172-31-61-110 - -Creating directories on cluster nodes -/usr/bin/pdsh -R exec -w ip-172-31-56-238,ip-172-31-57-143,ip-172-31-61-110 -x ip-172-31-56-238 ssh -q -n %h mkdir -p /opt/tra -fodion/apache-trafodion_server-2.0.1-incubating/etc -/usr/bin/pdsh -R exec -w ip-172-31-56-238,ip-172-31-57-143,ip-172-31-61-110 -x ip-172-31-56-238 ssh -q -n %h mkdir -p /opt/tra -fodion/apache-trafodion_server-2.0.1-incubating/logs -/usr/bin/pdsh -R exec -w ip-172-31-56-238,ip-172-31-57-143,ip-172-31-61-110 -x ip-172-31-56-238 ssh -q -n %h mkdir -p /opt/tra -fodion/apache-trafodion_server-2.0.1-incubating/tmp -/usr/bin/pdsh -R exec -w ip-172-31-56-238,ip-172-31-57-143,ip-172-31-61-110 -x ip-172-31-56-238 ssh -q -n %h mkdir -p /opt/tra -fodion/apache-trafodion_server-2.0.1-incubating/sql/scripts - -Generating SQ environment variable file: /opt/trafodion/apache-trafodion_server-2.0.1-incubating/etc/ms.env - -Note: Using cluster.conf format type 2. - -Generating SeaMonster environment variable file: /opt/trafodion/apache-trafodion_server-2.0.1-incubating/etc/seamonster.env - - -Generated SQ startup script file: ./gomon.cold -Generated SQ startup script file: ./gomon.warm -Generated SQ cluster config file: /opt/trafodion/apache-trafodion_server-2.0.1-incubating/tmp/cluster.conf -Generated SQ Shell file: sqshell -Generated RMS Startup file: rmsstart -Generated RMS Stop file: rmsstop -Generated RMS Check file: rmscheck.sql -Generated SSMP Startup file: ssmpstart -Generated SSMP Stop file: ssmpstop -Generated SSCP Startup file: sscpstart -Generated SSCP Stop file: sscpstop - - -Copying the generated files to all the nodes in the cluster -. -. -. -SQ Startup script (/opt/trafodion/apache-trafodion_server-2.0.1-incubating/sql/scripts/gomon.cold) ran successfully. Performin -g further checks... -Checking if processes are up. -Checking attempt: 1; user specified max: 2. Execution time in seconds: 0. - -The SQ environment is up! - - -Process Configured Actual Down -------- ---------- ------ ---- -DTM 3 3 -RMS 6 6 -DcsMaster 1 0 1 -DcsServer 3 0 3 -mxosrvr 96 0 96 - -Thu Jun 30 21:15:29 UTC 2016 -Checking if processes are up. -Checking attempt: 1; user specified max: 1. Execution time in seconds: 0. - -The SQ environment is up! - - -Process Configured Actual Down -------- ---------- ------ ---- -DTM 3 3 -RMS 6 6 -DcsMaster 1 0 1 -DcsServer 3 0 3 -mxosrvr 96 0 96 - -Starting the DCS environment now -starting master, logging to /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1/bin/../logs/dcs-trafodion-1-mast -er-ip-172-31-56-238.out -ip-172-31-56-238: starting server, logging to /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1/bin/../logs/dc -s-trafodion-1-server-ip-172-31-56-238.out -ip-172-31-57-143: starting server, logging to /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1/bin/../logs/dc -s-trafodion-3-server-ip-172-31-57-143.out -ip-172-31-61-110: starting server, logging to /opt/trafodion/apache-trafodion_server-2.0.1-incubating/dcs-2.0.1/bin/../logs/dc -s-trafodion-2-server-ip-172-31-61-110.out -Checking if processes are up. -Checking attempt: 1; user specified max: 2. Execution time in seconds: 1. - -The SQ environment is up! - - -Process Configured Actual Down -------- ---------- ------ ---- -DTM 3 3 -RMS 6 6 -DcsMaster 1 1 -DcsServer 3 3 -mxosrvr 96 7 89 - -Starting the REST environment now -starting rest, logging to /opt/trafodion/apache-trafodion_server-2.0.1-incubating/rest-2.0.1/bin/../logs/rest-trafodion-1-rest --ip-172-31-56-238.out - - - -Zookeeper listen port: 2181 -DcsMaster listen port: 23400 - -Configured Primary DcsMaster: "ip-172-31-56-238.ec2.internal" -Active DcsMaster : "ip-172-31-56-238" - -Process Configured Actual Down ---------- ---------- ------ ---- -DcsMaster 1 1 -DcsServer 3 3 -mxosrvr 96 94 2 - - -You can monitor the SQ shell log file : /opt/trafodion/apache-trafodion_server-2.0.1-incubating/logs/sqmon.log - - -Startup time 0 hour(s) 2 minute(s) 19 second(s) -Apache Trafodion Conversational Interface 2.0.1 -Copyright (c) 2015-2016 Apache Software Foundation ->> ---- SQL operation complete. ->> - -End of MXCI Session - -***INFO: Installation setup completed successfully. - -****************************** - TRAFODION INSTALLATION END -******************************</code></pre> -</div> -</div> -</li> -<li> -<p>Switch to the Trafodion Runtime User and check the status of Trafodion.</p> -<div class="listingblock"> -<div class="content"> -<pre class="CodeRay highlight"><code data-lang="text">$ sudo su - trafodion -$ sqcheck -Checking if processes are up. -Checking attempt: 1; user specified max: 2. Execution time in seconds: 0. - -The SQ environment is up! - - -Process Configured Actual Down -------- ---------- ------ ---- -DTM 3 3 -RMS 6 6 -DcsMaster 1 1 -DcsServer 3 3 -mxosrvr 96 96 -$</code></pre> -</div> -</div> -</li> -</ol> -</div> -<div class="paragraph"> -<p>Trafodion is now running on your Hadoop cluster. Please refer to the <a href="#activate">Activate</a> chapter for -basic instructions on how to verify the Trafodion management and how to perform basic management -operations.</p> -</div> -</div> -</div> -</div> -<div class="sect1"> -<h2 id="introduction">3. Introduction</h2> -<div class="sectionbody"> -<div class="paragraph"> -<p>Trafodion is a Hadoop add-on service that provides transactional SQL on top of HBase. Typically, you -use Trafodion as the database for applications that require Online Transaction Processing (OLTP), -Operational Data Store (ODS), and/or strong reporting capabilities. You access Trafodion using -standard JDBC and ODBC APIs.</p> -</div> -<div class="paragraph"> -<p>You may choose whether to add Trafodion to an existing Hadoop environment or to create a standalone -Hadoop environment specifically for Hadoop.</p> -</div> -<div class="paragraph"> -<p>This guide assumes that a Hadoop environment exists upon which your provisioning Trafodion. Refer to -<a href="#requirements-hadoop-software">Hadoop Software</a> for information about what Hadoop software is required -Trafodion.</p> -</div> -<div class="sect2"> -<h3 id="introduction-security-considerations">3.1. Security Considerations</h3> -<div class="paragraph"> -<p>The following users and principals need be considered for Trafodion:</p> -</div> -<div class="ulist"> -<ul> -<li> -<p><strong>Provisioning User</strong>: A Linux-level user that performs the Trafodion provisioning tasks. This user ID -requires <code>sudo</code> access and passwordless ssh among the nodes where Trafodion is installed. In addition, -this user ID requires access to Hadoop distribution, HDFS, and HBase administrative users to change -respective environment’s configuration settings per Trafodion requirements. Refer to -<a href="#requirements-trafodion-provisioning-user">Trafodion Provisioning User</a> for more information -about the requirements and usage associated with this user ID.</p> -</li> -<li> -<p><strong>Runtime User</strong>: A Linux-level user under which the Trafodion software runs. This user ID must be registered -as a user in the Hadoop Distributed File System (HDFS) to store and access objects in HDFS, HBase, and Hive. -In addition, this user ID requires passwordless access among the nodes where Trafodion is installed. -Refer to <a href="#requirements-trafodion-runtime-user">Trafodion Runtime User</a> for more information about this user ID.</p> -</li> -<li> -<p><strong>Trafodion Database Users</strong>: Trafodion users are managed by Trafodion security features (grant, revoke, etc.), -which can be integrated with LDAP if so desired. These users are referred to as <strong>database users</strong> and -do not have direct access to the operating system. Refer to <a href="#enable-security-ldap">LDAP</a> for -details on enabling LDAP for authenticating database users. -Refer to <a href="http://trafodion.incubator.apache.org/docs/sql_reference/index.html#register_user_statement";>Register User</a>, -<a href="http://trafodion.incubator.apache.org/docs/sql_reference/index.html#grant_statement";>Grant</a>, and other SQL statements -in the <a href="http://trafodion.incubator.apache.org/docs/sql_reference/index.html";>Trafodion SQL Reference Manual</a> for -more information about managing Trafodion Database Users. -<br> -<br> -If your environment has been provisioned with Kerberos, then the following additional information is required.</p> -</li> -<li> -<p><strong>KDC admin principal</strong>: Trafodion requires administrator access to Kerberos to create principals -and keytabs for the <code>trafodion</code> user, and to look-up principal names for HDFS and HBase keytabs. Refer to -<a href="#enable-security-kerberos">Kerberos</a> for more information about the requirements and usage associated with this principal.</p> -</li> -<li> -<p><strong>HBase keytab location</strong>: Trafodion requires administrator access to HBase to grant required privileges to the <code>trafodion</code> user. Refer to -<a href="#enable-security-kerberos">Kerberos</a> for more information about the requirements and usage associated with this keytab.</p> -</li> -<li> -<p><strong>HDFS keytab location</strong>: Trafodion requires administrator access to HDFS to create directories that store files needed to perform SQL requests -such as data loads and backups. Refer to -<a href="#enable-security-kerberos">Kerberos</a> for more information about the requirements and usage associated with this keytab. -<br> -<br> -If your environment is using LDAP for authentication, then the following additional information is required.</p> -</li> -<li> -<p><strong>LDAP username for database root access</strong>: When Trafodion is installed, it creates a predefined database user referred to as the DB__ROOT user. -In order to connect to the database as database root, there must be a mapping between the database user DB__ROOT and an LDAP user. Refer to -<a href="#enable-security-ldap">LDAP</a> for more information about this option.</p> -</li> -<li> -<p><strong>LDAP search user name</strong>: Trafodion optionally requests an LDAP username and password in order to perform LDAP operations -such as LDAP search. Refer to -<a href="#enable-security-ldap">LDAP</a> for more information about this option.</p> -</li> -</ul> -</div> -</div> -<div class="sect2"> -<h3 id="introduction-provisioning-options">3.2. Provisioning Options</h3> -<div class="paragraph"> -<p>Trafodion ships with a set of scripts that takes care of many of the installation and upgrade -tasks associated with the Trafodion software and its requirements. The main features include:</p> -</div> -<div class="ulist"> -<ul> -<li> -<p><strong>Trafodion installer</strong>: Performs installation and upgrade for Trafodion</p> -</li> -<li> -<p><strong>Trafodion uninstaller</strong>: Uninstalls Trafodion</p> -</li> -<li> -<p><strong>Trafodion security installer</strong>: Enables security features including Kerberos and LDAP for an existing Trafodion installation</p> -</li> -</ul> -</div> -<div class="paragraph"> -<p>Currently, the Trafodion Installer is able to install Trafodion on select Cloudera and Hortonworks Hadoop distributions, and for select vanilla Hadoop installations. -The Trafodion Installer limitations are noted as they apply in the different chapters below. For example, the Trafodion Installer -is less capable on SUSE than it is on RedHat/CentOS; you have to install the prerequisite software packages outside the Trafodion Installer.</p> -</div> -<div class="paragraph"> -<p>The Trafodion Installer automates many of the tasks required to install/upgrade Trafodion, spanning from downloading and -installing required software packages and making required changes to your Hadoop environment via creating -the Trafodion runtime user ID to installing and starting Trafodion. It is, therefore, highly recommend that -you use the Trafodion Installer for initial installation and upgrades of Trafodion. These steps are referred to as -"Script-Based Provisioning" in this guide. Refer to <a href="#introduction-trafodion-installer">Trafodion Installer</a> that provides -usage information.</p> -</div> -<div class="paragraph"> -<p>If, for any reason, you choose not to use the Trafodion Installer, then separate chapters provide -step-by-step recipes for the tasks required to install/upgrade Trafodion. These steps are referred to as -<strong>Recipe-Based Provisioning</strong> in this guide. It is assumed that you are well-versed in Linux and Hadoop -administrative tasks if using Recipe-Based Provisioning.</p> -</div> -</div> -<div class="sect2"> -<h3 id="introduction-provisioning-activities">3.3. Provisioning Activities</h3> -<div class="paragraph"> -<p>Trafodion provisioning is divided into the following main activities:</p> -</div> -<div class="ulist"> -<ul> -<li> -<p><strong><a href="#requirements">Requirements</a></strong>: Activities and documentation required to install the Trafodion software. -These activities include tasks such as understanding hardware and operating system requirements, -Hadoop requirements, what software packages that need to be downloaded, configuration settings that need to be changed, -and user ID requirements.</p> -</li> -<li> -<p><strong><a href="#prepare">Prepare</a></strong>: Activities to prepare the operating system and the Hadoop ecosystem to run -Trafodion. These activities include tasks such as installing required software packages, configure -the Trafodion Installation User, gather information about the Hadoop environment, and the modify configuration -for different Hadoop services.</p> -</li> -<li> -<p><strong><a href="#install">Install</a></strong>: Activities related to installing the Trafodion software. These activities -include tasks such as unpacking the Trafodion tar files, creating the Trafodion Runtime User, -creating Trafodion HDFS directories, installing the Trafodion software, and enabling security features.</p> -</li> -<li> -<p><strong><a href="#upgrade">Upgrade</a></strong>: Activities related to the upgrading the Trafodion software. These activities -include tasks such as shutting down Trafodion and installing a new version of the Trafodion software. -The upgrade tasks vary depending on the differences between the current and new release of -Trafodion. For example, an upgrade may or may not include an upgrade of the Trafodion metadata.</p> -</li> -<li> -<p><strong><a href="#activate">Activate</a></strong>: Activities related to starting the Trafodion software. These actives -include basic management tasks such as starting and checking the status of the Trafodion components and performing basic smoke tests.</p> -</li> -<li> -<p><strong><a href="#remove">Remove</a></strong>: Activities related to removing Trafodion from your Hadoop cluster.</p> -</li> -<li> -<p><strong><a href="#enable-security">Enable Security</a></strong>: Activities related to enabling security features on an already installed -Trafodion installation. These activities include tasks such as adding Kerberos principals and keytabs, -and setting up the LDAP configuration files.</p> -</li> -</ul> -</div> -</div> -<div class="sect2"> -<h3 id="introduction-provisioning-master-node">3.4. Provisioning Master Node</h3> -<div class="paragraph"> -<p>All provisioning tasks are performed from a single node in the cluster, which must be part -of the Hadoop environment you’re adding Trafodion to. This node is referred to as the -"<strong>Provisioning Master Node</strong>" in this guide.</p> -</div> -<div class="paragraph"> -<p>The Trafodion Provisioning User must have access to all other nodes from the Provisioning -Master Node in order to perform provisioning tasks on the cluster.</p> -</div> -</div> -<div class="sect2"> -<h3 id="introduction-trafodion-installer">3.5. Trafodion Installer</h3> -<div class="paragraph"> -<p>The Trafodion Installer is a set of scripts automates most of the tasks requires to install/upgrade Trafodion. -You download the Trafodion Installer tar file from the Trafodion <a href="http://trafodion.incubator.apache.org/download.html";>download</a> page. -Next, you unpack the tar file.</p> -</div> -<div class="paragraph"> -<p><strong>Example</strong></p> -</div> -<div class="listingblock"> -<div class="content"> -<pre class="CodeRay highlight"><code data-lang="text">$ mkdir $HOME/trafodion-installer -$ cd $HOME/trafodion-downloads -$ tar -zxf apache-trafodion-installer-1.3.0-incubating-bin.tar.gz -C $HOME/trafodion-installer -$</code></pre> -</div> -</div> -<div style="page-break-after: always;"></div> -<div class="paragraph"> -<p>The Trafodion Installer supports two different modes:</p> -</div> -<div class="olist arabic"> -<ol class="arabic"> -<li> -<p><strong>Guided Setup</strong>: Prompts for information as it works through the installation/upgrade process. This mode is recommended for new users.</p> -</li> -<li> -<p><strong>Automated Setup</strong>: Required information is provided in a pre-formatted bash-script configuration file, which is provided -via a command argument when running the Trafodion Installer thereby suppressing all prompts. There is one exception, -if Kerberos is enabled on the cluster, then you will always be prompted for the KDC admin password. We do not store the -KDC admin password as part of installation anywhere.</p> -<div class="paragraph"> -<p>A template of the configuration file is available here within the installer directory: <code>trafodion_config_default</code>. -Make a copy of the file in your directory and populate the needed information.</p> -</div> -<div class="paragraph"> -<p>Automated Setup is recommended since it allows you to record the required provisioning information ahead of time. -Refer to <a href="#introduction-trafodion-automated-setup">Automated Setup</a> for information about how to -populate this file.</p> -</div> -</li> -</ol> -</div> -<div class="sect3"> -<h4 id="introduction-trafodion-installer-usage">3.5.1. Usage</h4> -<div class="paragraph"> -<p>The following shows help for the Trafodion Installer.</p> -</div> -<div class="listingblock"> -<div class="content"> -<pre class="CodeRay highlight"><code data-lang="text">./trafodion_install --help - -This script will install Trafodion. It will create a configuration -file (if one has not been created), setup of the environment needed -for Trafodion, configure HBase with Hbase-trx and co-processors needed, -and install a specified Trafodion build. - -Options: - --help Print this message and exit - --accept_license If provided, the user agrees to accept all the - provisions in the Trafodion license. This allows - for automation by skipping the display and prompt of - the Trafodion license. - --config_file If provided, all install prompts will be - taken from this file and not prompted for.</code></pre> -</div> -</div> -<div style="page-break-after: always;"></div> -</div> -<div class="sect3"> -<h4 id="introduction-trafodion-installer-install-vs-upgrade">3.5.2. Install vs. Upgrade</h4> -<div class="paragraph"> -<p>The Trafodion Installer automatically detects whether you’re performing an install -or an upgrade by looking for the Trafodion Runtime User in the <code>/etc/passwd</code> file.</p> -</div> -<div class="ulist"> -<ul> -<li> -<p>If the user ID doesn’t exist, then the Trafodion Installer runs in install mode.</p> -</li> -<li> -<p>If the user ID exists, then the Trafodion Installer runs in upgrade mode.</p> -</li> -</ul> -</div> -</div> -<div class="sect3"> -<h4 id="introduction-trafodion-installer-guided-setup">3.5.3. Guided Setup</h4> -<div class="paragraph"> -<p>By default, the Trafodion Installer runs in Guided Setup mode, which means -that it prompts you for information during the install/upgrade process.</p> -</div> -<div class="paragraph"> -<p>Refer to the following sections for examples:</p> -</div> -<div class="ulist"> -<ul> -<li> -<p><a href="#install-guided-install">Guided Install</a></p> -</li> -<li> -<p><a href="#upgrade-guided-upgrade">Guided Upgrade</a></p> -</li> -</ul> -</div> -</div> -<div class="sect3"> -<h4 id="introduction-trafodion-installer-automated-setup">3.5.4. Automated Setup</h4> -<div class="paragraph"> -<p>The <code>--config_file</code> option runs the Trafodion in Automated Setup mode.</p> -</div> -<div class="paragraph"> -<p>Before running the Trafodion Installer with this option, you do the following:</p> -</div> -<div class="olist arabic"> -<ol class="arabic"> -<li> -<p>Copy the <code>trafodion_config_default</code> file.</p> +<div class="olist arabic"> +<ol class="arabic"> +<li> +<p>Copy the <code>trafodion_config_default</code> file.</p> <div class="paragraph"> <p><strong>Example</strong></p> </div> @@ -2040,19 +1322,6 @@ that matches the security policies of your organization. </tr> </table> </div> -<div class="admonitionblock note"> -<table> -<tr> -<td class="icon"> -<i class="fa icon-note" title="Note"></i> -</td> -<td class="content"> -If you are installing Trafodion on a version of Hadoop that has been instrumented with Kerberos, -you will be asked for a password associated with a Kerberos administrator. -</td> -</tr> -</table> -</div> <div class="sect4"> <h5 id="_example_creating_a_trafodion_configuration_file">Example: Creating a Trafodion Configuration File</h5> <div class="paragraph"> @@ -2079,11 +1348,6 @@ in the <a href="#prepare">Prepare</a> chapter, you record the following informat <td class="tableblock halign-left valign-top"><p class="tableblock">admin</p></td> </tr> <tr> -<td class="tableblock halign-left valign-top"><div class="literal"><pre>ADMIN_PRINCIPAL</pre></div></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">Kerberos principal for the KDC admin user including the realm.</p></td> -<td class="tableblock halign-left valign-top"></td> -</tr> -<tr> <td class="tableblock halign-left valign-top"><div class="literal"><pre>BACKUP_DCS_NODES</pre></div></td> <td class="tableblock halign-left valign-top"><p class="tableblock">List of nodes where to start the backup DCS Master components.</p></td> <td class="tableblock halign-left valign-top"></td> @@ -2104,11 +1368,6 @@ in the <a href="#prepare">Prepare</a> chapter, you record the following informat <td class="tableblock halign-left valign-top"><p class="tableblock">Cluster 1</p></td> </tr> <tr> -<td class="tableblock halign-left valign-top"><div class="literal"><pre>DB_ROOT_NAME</pre></div></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">LDAP name used to connect as database root user</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">trafodion</p></td> -</tr> -<tr> <td class="tableblock halign-left valign-top"><div class="literal"><pre>DCS_BUILD</pre></div></td> <td class="tableblock halign-left valign-top"><p class="tableblock">Tar file containing the DCS component.</p></td> <td class="tableblock halign-left valign-top"></td> @@ -2149,21 +1408,11 @@ in the <a href="#prepare">Prepare</a> chapter, you record the following informat <td class="tableblock halign-left valign-top"><p class="tableblock">hbase</p></td> </tr> <tr> -<td class="tableblock halign-left valign-top"><div class="literal"><pre>HBASE_KEYTAB</pre></div></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">Kerberos service keytab for HBase admin principal.</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">Default based on distribution</p></td> -</tr> -<tr> <td class="tableblock halign-left valign-top"><div class="literal"><pre>HBASE_USER</pre></div></td> <td class="tableblock halign-left valign-top"><p class="tableblock">Linux user name for the HBASE administrative user.</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">hbase</p></td> </tr> <tr> -<td class="tableblock halign-left valign-top"><div class="literal"><pre>HDFS_KEYTAB</pre></div></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">Kerberos service keytab for HDFS admin principal.</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">Default based on distribution</p></td> -</tr> -<tr> <td class="tableblock halign-left valign-top"><div class="literal"><pre>HDFS_USER</pre></div></td> <td class="tableblock halign-left valign-top"><p class="tableblock">Linux user name for the HDFS administrative user.</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">hdfs</p></td> @@ -2189,11 +1438,6 @@ in the <a href="#prepare">Prepare</a> chapter, you record the following informat <td class="tableblock halign-left valign-top"><p class="tableblock">/usr/java/jdk1.7.0_67-cloudera</p></td> </tr> <tr> -<td class="tableblock halign-left valign-top"><div class="literal"><pre>KDC_SERVER</pre></div></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">Location of Kerberos server for admin access</p></td> -<td class="tableblock halign-left valign-top"></td> -</tr> -<tr> <td class="tableblock halign-left valign-top"><div class="literal"><pre>LDAP_CERT</pre></div></td> <td class="tableblock halign-left valign-top"><p class="tableblock">Full path to TLS certificate.</p></td> <td class="tableblock halign-left valign-top"></td> @@ -2225,7 +1469,7 @@ in the <a href="#prepare">Prepare</a> chapter, you record the following informat </tr> <tr> <td class="tableblock halign-left valign-top"><div class="literal"><pre>LDAP_SECURITY</pre></div></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">Whether to enable LDAP authentication.</p></td> +<td class="tableblock halign-left valign-top"><p class="tableblock">Whether to enable simple LDAP authentication.</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">N</p></td> </tr> <tr> @@ -2249,11 +1493,6 @@ in the <a href="#prepare">Prepare</a> chapter, you record the following informat <td class="tableblock halign-left valign-top"></td> </tr> <tr> -<td class="tableblock halign-left valign-top"><div class="literal"><pre>MAX_LIFETIME</pre></div></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">Kerberos ticket lifetime for Trafodion principal</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">24hours</p></td> -</tr> -<tr> <td class="tableblock halign-left valign-top"><div class="literal"><pre>NODE_LIST</pre></div></td> <td class="tableblock halign-left valign-top"><p class="tableblock">The FQDN names of the nodes where Trafodion will be installed.</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">trafodion-1 trafodion-2</p></td> @@ -2264,21 +1503,11 @@ in the <a href="#prepare">Prepare</a> chapter, you record the following informat <td class="tableblock halign-left valign-top"><p class="tableblock">admin</p></td> </tr> <tr> -<td class="tableblock halign-left valign-top"><div class="literal"><pre>RENEW_LIFETIME</pre></div></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">Kerberos ticket renewal lifetime for Trafodion principal</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">7days</p></td> -</tr> -<tr> <td class="tableblock halign-left valign-top"><div class="literal"><pre>REST_BUILD</pre></div></td> <td class="tableblock halign-left valign-top"><p class="tableblock">Tar file containing the REST component.</p></td> <td class="tableblock halign-left valign-top"></td> </tr> <tr> -<td class="tableblock halign-left valign-top"><div class="literal"><pre>SECURE_HADOOP</pre></div></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">Indicates whether Hadoop has Kerberos enabled</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">Based on whether Kerberos is enabled for your Hadoop installation</p></td> -</tr> -<tr> <td class="tableblock halign-left valign-top"><div class="literal"><pre>SQ_ROOT</pre></div></td> <td class="tableblock halign-left valign-top"><p class="tableblock">Target directory for the Trafodion software.</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">/home/trafodion/apache-trafodion-1.3.0-incubating-bin</p></td> @@ -2299,16 +1528,6 @@ in the <a href="#prepare">Prepare</a> chapter, you record the following informat <td class="tableblock halign-left valign-top"><p class="tableblock">/home/centos/trafodion-download/apache-trafodion-1.3.0-incubating-bin.tar.gz</p></td> </tr> <tr> -<td class="tableblock halign-left valign-top"><div class="literal"><pre>TRAF_KEYTAB</pre></div></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">Kerberos keytab for <code>trafodion</code> principal.</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">Default keytab based on distribution</p></td> -</tr> -<tr> -<td class="tableblock halign-left valign-top"><div class="literal"><pre>TRAF_KEYTAB_DIR</pre></div></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">Location of Kerberos keytab for the <code>trafodion</code> principal.</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">Default location based on distribution</p></td> -</tr> -<tr> <td class="tableblock halign-left valign-top"><div class="literal"><pre>TRAF_USER</pre></div></td> <td class="tableblock halign-left valign-top"><p class="tableblock">The Trafodion runtime user ID. Must be <code>trafodion</code> in this release.</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">trafodion</p></td> @@ -2467,45 +1686,13 @@ export INIT_TRAFODION="Y" # Default is to leave as is and this file will be created. export SQCONFIG="" -#----------------- security configuration information ----------------- -#Enter in Kerberos details if Kerberos is enabled on your cluster - -#Indicate Kerberos is enabled -export SECURE_HADOOP="N" - -#Location of Kerberos server for admin access -export KDC_SERVER="" +export CONFIG_COMPLETE="true" -#Kerberos Admin principal used to create Trafodion principals and keytabs -#Please include realm, for example: trafadmin/[email protected] -export ADMIN_PRINCIPAL="" - -#Keytab for HBase admin user, used to grant Trafodion user CRWE privilege -export HBASE_KEYTAB="" - -#Keytab for HDFS admin user, used to create data directories for Trafodion -export HDFS_KEYTAB="" - -#Kerberos ticket defaults for the Trafodion user -export MAX_LIFETIME="24hours" -export RENEW_LIFETIME="7days" - -#Trafodion keytab information -export TRAF_KEYTAB="" -export TRAF_KEYTAB_DIR="" - -#Enter in LDAP configuration information -#Turn on authentication - MUST have existing LDAP configured. -export LDAP_SECURITY="Y" +#Turn on simple security. MUST have existing LDAP configured. +export LDAP_SECURITY="N" #Name of LDAP Config file -export LDAP_AUTH_FILE="traf_authentication_config_`hostname -s`" - -#LDAP name to map to database user DB__ROOT -DB_ROOT_NAME="trafodion" -#----------------- end security configuration ----------------- - -export CONFIG_COMPLETE="true"</code></pre> +export LDAP_AUTH_FILE="traf_authentication_config_${HOSTNAME}"</code></pre> </div> </div> <div class="paragraph"> @@ -2528,17 +1715,17 @@ export CONFIG_COMPLETE="true"</code></pre> </div> </div> <div class="sect2"> -<h3 id="introduction-trafodion-provisioning-directories">3.6. Trafodion Provisioning Directories</h3> +<h3 id="introduction-trafodion-provisioning-directories">2.6. Trafodion Provisioning Directories</h3> <div class="paragraph"> <p>Trafodion stores its provisioning information in the following directories on each node in the cluster:</p> </div> <div class="ulist"> <ul> <li> -<p><code>/etc/trafodion</code>: Configuration information.</p> +<p><code>/etc/trafodion</code>: Configurtion information.</p> </li> <li> -<p><code>/usr/lib/trafodion</code>: Copies of the files required by the installer.</p> +<p><code>/usr/lib/trafodion</code>: Copies of the installer files.</p> </li> </ul> </div> @@ -2546,7 +1733,7 @@ export CONFIG_COMPLETE="true"</code></pre> </div> </div> <div class="sect1"> -<h2 id="requirements">4. Requirements</h2> +<h2 id="requirements">3. Requirements</h2> <div class="sectionbody"> <div class="paragraph"> <p>Trafodion requires an x86 version of Linux.</p> @@ -2560,24 +1747,30 @@ export CONFIG_COMPLETE="true"</code></pre> <p>64-bit Red Hat Enterprise Linux (RHEL) or CentOS 6.5, 6.6, and 6.7</p> </li> <li> -<p>Cloudera CDH 5.4</p> +<p>SUSE SLES 11.3</p> +</li> +<li> +<p>Cloudera CDH 5.2</p> +</li> +<li> +<p>Cloudera CDH 5.3</p> </li> <li> -<p>Hortonworks HDP 2.3</p> +<p>Hortonworks HDP 2.2</p> </li> </ul> </div> <div class="paragraph"> -<p>Other OS releases may work, too. The Trafodion project is currently working on better support for more distribution and non-distribution versions of Hadoop.</p> +<p>Other OS releases may work, too. The Trafodion project is currently working on better support for non-distribution version of Hadoop.</p> </div> <div class="sect2"> -<h3 id="requirements-general-cluster-and-os-requirements-and-recommendations">4.1. General Cluster and OS Requirements and Recommendations</h3> +<h3 id="requirements-general-cluster-and-os-requirements-and-recommendations">3.1. General Cluster and OS Requirements and Recommendations</h3> <div class="paragraph"> <p>64-bit x86 instruction set running a Linux distribution is required. Further, Trafodion assumes an environment based on the requirements of the tested Hadoop distributions/services.</p> </div> <div class="sect3"> -<h4 id="requirements-cluster-requirements-and-recommendations">4.1.1. Hardware Requirements and Recommendations</h4> +<h4 id="requirements-cluster-requirements-and-recommendations">3.1.1. Hardware Requirements and Recommendations</h4> <div class="sect4"> <h5 id="requirements-single-node-cluster">Single-Node Cluster</h5> <div class="paragraph"> @@ -2638,7 +1831,7 @@ A minimum of two cores is required regardless of whether you’re deploying </div> </div> <div class="sect3"> -<h4 id="requirements-os-requirements-and-recommendations">4.1.2. OS Requirements and Recommendations</h4> +<h4 id="requirements-os-requirements-and-recommendations">3.1.2. OS Requirements and Recommendations</h4> <div class="paragraph"> <p>Please verify these requirements on each node you will install Trafodion on:</p> </div> @@ -2864,7 +2057,7 @@ the port is <strong>not</strong> open.</p> </table> </div> <div class="sect3"> -<h4 id="requirements-ip-ports">4.1.3. IP Ports</h4> +<h4 id="requirements-ip-ports">3.1.3. IP Ports</h4> <div class="paragraph"> <p>The following table lists the default ports used by the different Trafodion components plus the configuration file and configuration attribute associated with each port setting.</p> </div> @@ -3019,18 +2212,15 @@ enough to cover all the servers per node that are listed in the "servers" file i </ul> </div> <div class="paragraph"> -<p>If you have Kerberos or LDAP enabled, then ports required by these products need to be opened as well.</p> -</div> -<div class="paragraph"> <p>Although not all the ports will be used on every node of the cluster, you need to open most of them for all the nodes in the cluster that have Trafodion, HBase, or HDFS servers on them.</p> </div> </div> </div> <div class="sect2"> -<h3 id="requirements-prerequisite-software">4.2. Prerequisite Software</h3> +<h3 id="requirements-prerequisite-software">3.2. Prerequisite Software</h3> <div class="sect3"> -<h4 id="requirements-hadoop-software">4.2.1. Hadoop Software</h4> +<h4 id="req
<TRUNCATED>
