[GitHub] incubator-trafodion pull request #888: [TRAFODION-2417] Installer pre-work f...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/888#discussion_r93659688 --- Diff: install/installer/dcs_installer --- @@ -130,34 +130,12 @@ fi mkdir -p $DCS_INSTALL_PATH cd $DCS_INSTALL_PATH -if [[ "$ONE_TAR_INSTALL" == "Y" ]]; then - DCS_DIR=$(ls $TRAF_HOME | grep dcs) - DCS_DIR=$TRAF_HOME/$DCS_DIR - echo "***INFO: DCS Install Directory: $DCS_DIR" -else - # untar DCS build into install directory - echo "***INFO: untarring build file $DCS_BUILD_FILE" - tar -xzf $DCS_BUILD_FILE - - # get the dcs install directory name which is imbedded in the tar file - DCS_DIR=$(tar -tf $DCS_BUILD_FILE | grep --max-count=1 bin | sed -e "s@\(^.*\)/bin/@\1@") - - DCS_DIR=$DCS_INSTALL_PATH/$DCS_DIR -fi - -# set env var in sqenvcom.sh for DCS install directory -grep --invert-match "DCS_INSTALL_DIR=" $TRAF_HOME/sqenvcom.sh > $TRAF_HOME/sqenvcom.temp -echo "export DCS_INSTALL_DIR=$DCS_DIR" >> $TRAF_HOME/sqenvcom.temp -mv $TRAF_HOME/sqenvcom.temp $TRAF_HOME/sqenvcom.sh +DCS_DIR=$(ls $TRAF_HOME | grep dcs) --- End diff -- So happy to see $ONE_TAR_INSTALL being removed. +1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request #724: [TRAFODION-2235] Added sync thread ep...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/724#discussion_r80758276 --- Diff: core/sqf/monitor/linux/monitor.cxx --- @@ -1294,7 +1441,31 @@ int main (int argc, char *argv[]) } } +if ( IsRealCluster ) --- End diff -- How is "IsRealCluster" set? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request #696: [[TRAFODION 2217]] Error during traf_...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/696 [[TRAFODION 2217]] Error during traf_add_sudoAccess You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion TRAFODION-2034 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/696.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #696 commit bd2d6b9f3368e45d3c44da1d74c327b3d8ca6245 Author: Amanda Moran <ama...@apache.com> Date: 2016-09-12T21:25:28Z Error during traf_add_sudoAccess --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request #691: Fixing a few small bugs
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/691 Fixing a few small bugs You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion TRAFODION-2034 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/691.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #691 commit 4fe01b8622cc6a3f28f3dc31187c950e9774916e Author: Amanda Moran <ama...@apache.com> Date: 2016-09-08T22:24:27Z Fixing a few small bugs --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request #675: Trafodion 2034 Adding extra lines to ...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/675 Trafodion 2034 Adding extra lines to DCS sever file You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion TRAFODION-2034 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/675.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #675 commit dc1884a5d09c9729a1238b8e74b5ea1a3ace1c1f Author: Amanda Moran <ama...@apache.com> Date: 2016-08-23T21:59:21Z Merge branch 'master' of github.com:apache/incubator-trafodion into TRAFODION-2034 commit d9a4fb698d4b7e2f6fd646bd6d6e6a1a0812171a Author: Amanda Moran <ama...@apache.com> Date: 2016-08-24T20:45:01Z Merge branch 'master' of github.com:apache/incubator-trafodion into TRAFODION-2034 commit 085502b249fca390b0fbcad378723fb7e84bf3d0 Author: Amanda Moran <ama...@apache.com> Date: 2016-08-26T22:52:18Z Merge branch 'master' of github.com:apache/incubator-trafodion into TRAFODION-2034 commit 48d5dcf78a56fa766a378b30821188dcfaaae927 Author: Amanda Moran <ama...@apache.com> Date: 2016-08-26T22:57:26Z TRAFODION 2191 addNode_step2 adding extra lines to DCS server --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request #669: TRAFODION ELASTICITY support and othe...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/669 TRAFODION ELASTICITY support and other changes TRAFODION 1908 Checking that traf user and group are created TRAFODION 2001 Elasticity enhancement TRAFODION 2123 Java check fix TRAFODION 1951 Java check fix TRAFODION 1565 Remove pdsh check for single node TRAFODION 1470 Add Trafodion to hbase user group You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion TRAFODION-2034 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/669.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #669 commit edddff23c61aebadece45a8b0c0fd46bac8942ce Author: Amanda Moran <ama...@apache.com> Date: 2016-08-23T21:26:35Z TRAFODION ELASTICITY support and other changes TRAFODION 1908 Checking that traf user and group are created TRAFODION 2001 Elasticity enhancement TRAFODION 2123 Java check fix TRAFODION 1951 Java check fix TRAFODION 1565 Remove pdsh check for single node TRAFODION 1470 Add Trafodion to hbase user group --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request #662: TRAFODION 2168 CDH VERSION set to 5.5...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/662 TRAFODION 2168 CDH VERSION set to 5.5 when on 5.7 system This causes Trafodion not to start but with no other warning. HBase will also come down since the wrong hbase-trx* file get copied. You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion TRAFODION-2034 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/662.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #662 commit dc338b7ccd4fee0075fd6f13d3990707aae09056 Author: Amanda Moran <ama...@apache.com> Date: 2016-08-01T20:48:23Z Merge branch 'master' of github.com:apache/incubator-trafodion into TRAFODION-2034 commit fa389f8d23f75eb61c876abf56d84f3441cc9db1 Author: Amanda Moran <ama...@apache.com> Date: 2016-08-01T20:55:56Z Merge branch 'master' of github.com:apache/incubator-trafodion into TRAFODION-2034 commit 62f70aa92ee434b7e9ec1aad619cfdce51d81e41 Author: Amanda Moran <ama...@apache.com> Date: 2016-08-04T22:53:43Z Merge branch 'master' of github.com:apache/incubator-trafodion into TRAFODION-2034 commit d5aec754584aa4613cbd60b11fee08233093db70 Author: Amanda Moran <ama...@apache.com> Date: 2016-08-08T17:12:52Z Merge branch 'master' of github.com:apache/incubator-trafodion into TRAFODION-2034 commit 020cc7519de757488dc81667dcc48179971e1379 Author: Amanda Moran <ama...@apache.com> Date: 2016-08-15T20:17:55Z Merge branch 'master' of github.com:apache/incubator-trafodion into TRAFODION-2034 commit f5520bc917231a9906073e9041997d51aca11503 Author: Amanda Moran <ama...@apache.com> Date: 2016-08-16T18:25:25Z Merge branch 'master' of github.com:apache/incubator-trafodion into TRAFODION-2034 commit f4575e4d2c374196ba5edaf30d8f9dd893d4a519 Author: Amanda Moran <ama...@apache.com> Date: 2016-08-18T19:08:54Z Merge branch 'master' of github.com:apache/incubator-trafodion into TRAFODION-2034 commit 0a2284e73ad4152380574da20e72ee5009cf09a9 Author: Amanda Moran <ama...@apache.com> Date: 2016-08-18T19:12:57Z TRAFODION 2168 CDH VERSION set to 5.5 when on 5.7 system Can not use "." in variable names in shell. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request #625: Additional install changes to support...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/625 Additional install changes to support TRAFODION-2067 You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion TRAFODION-2034 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/625.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #625 commit 57c992c96ee8b2bc954e7e6f911ae73ba16c727d Author: Amanda Moran <ama...@apache.com> Date: 2016-07-28T21:05:37Z Additional install changes to support TRAFODION-2067 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request #566: TRAFODION 2034
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/566#discussion_r69345678 --- Diff: install/installer/traf_cloudera_mods --- @@ -367,27 +370,37 @@ ssh -q -n $HDFS_NODE 'sudo su hdfs --command "' "$HADOOP_BIN_PATH"'/hdfs dfsadmi # enabled and HDFS has been restarted echo "***INFO: Setting HDFS ACLs for snapshot scan support" ssh -q -n $HDFS_NODE 'sudo su hdfs --command "' "$HADOOP_BIN_PATH"'/hdfs dfs -mkdir -p /hbase/archive"' -if [ $? != 0 ]; then +errorFound=$? +echo "ERROR Code: $errorFound" --- End diff -- Fixed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request #566: TRAFODION 2034
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/566 TRAFODION 2034 You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion TRAFODION-2034 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/566.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #566 commit c7482b00b4a680dc2f8e7a42936620340af24070 Author: Amanda Moran <ama...@apache.com> Date: 2016-06-29T18:19:30Z Trafodion HDFS access issue needs to be solved by changing umask --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request #534: DO NOT MERGE **TESTING TEST18 failure...
Github user amandamoran closed the pull request at: https://github.com/apache/incubator-trafodion/pull/534 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request #527: Need to add traf user to hbase group ...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/527 Need to add traf user to hbase group on all nodes You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion installbugfixes Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/527.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #527 commit 442a414ad7b57b2f5e74539245ff41855944d383 Author: Amanda Moran <ama...@apache.com> Date: 2016-06-07T17:21:36Z Need to add traf user to hbase group on all nodes --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request #520: Testing if adding Trafodion user id t...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/520 Testing if adding Trafodion user id to HBase group will fix tests You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion installbugfixes Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/520.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #520 commit 30a408f8c5d6908868d0b533bfe211ca3bd3b39d Author: Amanda Moran <ama...@apache.com> Date: 2016-06-02T22:57:35Z Testing if adding Trafodion user id to HBase group will fix tests --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Trafodion 1993
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/482#discussion_r63559880 --- Diff: install/installer/traf_config_check --- @@ -702,7 +702,7 @@ function checkClouderaVersion { if [[ $CDH_5_3_HDP_2_2_SUPPORT == "N" ]]; then #Check that Cloudera 5.2 or 5.3 are not installed. if [[ "$CDH_5_4_SUPPORT" == "Y" ]] || [[ "$CDH_5_5_SUPPORT" == "Y" ]]; then - nameOfVersion=$(ssh -q -n $node grep "Version" $HOME/hbaseVersion.txt | sed 's/,.*//' | sed 's/.*\-//' | grep cdh5.[4-6].*) + nameOfVersion=$(ssh -q -n $node grep "Version" $HOME/hbaseVersion.txt | sed 's/,.*//' | sed 's/.*\-//' | grep cdh5.4.*) --- End diff -- @DaveBirdsall you are right. This still works as is... but doesn't "make sense". Let me fix and check it in. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Trafodion 1993
Github user amandamoran closed the pull request at: https://github.com/apache/incubator-trafodion/pull/481 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Trafodion 1993
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/481 Trafodion 1993 You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion TRAFODION-1985 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/481.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #481 commit 78cb6b85c9b87c1dc17fb18e60edbb8be72e35c6 Author: Anoop Sharma <ansharma@edev06.esgyn.local> Date: 2016-04-26T21:37:55Z Merge PR-451 ddl_transactions turned on by default commit 5dc67545748a9f43d3982e0a975ac1ed51b7ffb4 Author: Dave Birdsall <dbirds...@apache.org> Date: 2016-04-27T15:20:19Z Merge [TRAFODION-1916] PR 449 dcscheck CDH5.4.4 HBase 1.0.0 fix commit 67d3e197f4be877a5206e06326009a0f4681a5a8 Author: Venkat Muthuswamy <venkat.muthusw...@esgyn.com> Date: 2016-04-28T04:47:22Z Fix for JIRA 1953 commit 6e674c65c2a9ebd05c53f8a88b4464601a24808f Author: Prashant Vasudev <prashanth.vasu...@esgyn.com> Date: 2016-04-28T21:12:17Z Fix for TRAFODION-1948 Drop schema cascade internally selects against objects table. The fix is to use a distinct clause in the internal select query. commit ccafdcfca6d54af14971f935eed6efb8f9e36e36 Author: Sandhya Sundaresan <sand...@apache.org> Date: 2016-04-29T05:38:08Z Merge remote branch 'origin/pr/456/head' into merge456 commit 29fb212ddb52fb58a2d6d14087b80834a1eb19c3 Author: Dave Birdsall <dbirds...@apache.org> Date: 2016-04-29T15:40:59Z Merge [TRAFODION-1953] PR 454 Add jetty-security jar to REST server packaging commit ac298d39e93c221fd18ab7377fc830d31dba2659 Author: Prashant Vasudev <prashanth.vasu...@esgyn.com> Date: 2016-05-04T00:15:51Z Fix for TRAFODION-1923 commit af67497157cc5fa0123b63ec499a79640cc4d0f7 Author: selvaganesang <se...@apache.org> Date: 2016-05-04T14:38:26Z Merge Fix for [TRAFODION-1923] PR-463 commit d9890d6eda94d6e2f061e3e0794f28fbea4063b4 Author: Steve Varnau <steve.var...@esgyn.com> Date: 2016-05-04T23:22:50Z [TRAFODION-1972] Remove docs directories from exclude list This will allow these directories to be included in source package, and hence in the official released code. Note that it also includes the website pages, which provides a snapshot in time of the project site, for whatever that is worth. commit dee95868a932834ded7f07ad61cba2e767a4ae13 Author: Steve Varnau <steve.var...@esgyn.com> Date: 2016-05-05T00:58:43Z [TRAFODION-1973] Fix unpacking of hadoop dependencies Issue found while testing build environment setup for release 2.0. Simple fix. commit 84620dffb7dbf5e6df95c0dbb8914e80574572ce Author: Dave Birdsall <dbirds...@apache.org> Date: 2016-05-05T15:29:53Z Merge [TRAFODION-1972] PR 466 Remove docs directories from exclude list commit b3f7856f5e63690f51ded33f11bd87103c8d4e51 Author: Dave Birdsall <dbirds...@apache.org> Date: 2016-05-05T15:34:43Z Merge [TRAFODION-1973] PR 467 Fix unpacking of hadoop dependencies commit e208598d88caab04e14db1dbb38ac5f4378e8826 Author: Amanda Moran <ama...@apache.com> Date: 2016-05-05T17:11:48Z [[TRAFODION-1951]] Fix for JAVA checking commit 7b5e5ea010789a063e40dcb8d7fdcc8d3f6fc704 Author: Steve Varnau <steve.var...@esgyn.com> Date: 2016-05-05T23:20:05Z Merge [TRAFODION-1951] Fix for JAVA checking commit c8ef96457e45441f4853a187237b4149d9058bd5 Author: Steve Varnau <steve.var...@esgyn.com> Date: 2016-05-10T18:03:23Z [TRAFODION-1982] Combine server components into single tar file Now bundle DCS and REST components into server binary tar file. The license & notice file info for REST and DCS are subsumed into server license files. Fix naming of server and client tar files to meet Apache artifact naming practices. commit f716c3f6bc6e04aa9af233e1d6c27dcc0ba65caf Author: Venkat Muthuswamy <venkat.muthusw...@esgyn.com> Date: 2016-05-10T21:29:36Z Merge library management fix from master to R2.0 commit 10adf4b56251543ac73705e3ecc61e1646e37ead Author: Amanda Moran <ama...@apache.com> Date: 2016-05-10T22:49:36Z Fixes for TRAFODION-1985 commit c861ea9e8f34a48056d74ee28a87791168af9c3f Author: Steve Varnau <steve.var...@esgyn.com> Date: 2016-05-10T23:00:52Z Merge remote branch 'amanda/TRAFODION-1985' into pkg1982 commit e3f4cc2667c14b7bc141587d262b1e59f2da3ced Author: Steve Varnau <steve.var...@esgyn.com> Date: 2016-05-10T23:28:58Z [TRAFODION-1982] Tell RAT exclusions about file rename That's what I get for renaming file for clarity from "not-" to "note-" commit 28f
[GitHub] incubator-trafodion pull request: [[TRAFODION-1951]] Fix for JAVA ...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/468 [[TRAFODION-1951]] Fix for JAVA checking Adding fix for JAVA checking if JAVA 7 has an update 100 or greater. Also deleting two files that are no longer used (and should have been deleted when the Vanilla Apache support was checked in). You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion TRAFODION-1951 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/468.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #468 commit e208598d88caab04e14db1dbb38ac5f4378e8826 Author: Amanda Moran <ama...@apache.com> Date: 2016-05-05T17:11:48Z [[TRAFODION-1951]] Fix for JAVA checking --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Vanilla Apache HBase support and...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/440#discussion_r60458634 --- Diff: install/installer/traf_config_check --- @@ -652,15 +685,16 @@ function checkRoleGroups { } + function checkClouderaVersion { if [[ $CDH_5_3_HDP_2_2_SUPPORT == "N" ]]; then #Check that Cloudera 5.2 or 5.3 are not installed. if [[ "$CDH_5_4_SUPPORT" == "Y" ]] || [[ "$CDH_5_5_SUPPORT" == "Y" ]]; then - nameOfVersion=$(ssh -q -n $node grep "Version" $HOME/hbaseVersion.txt | sed 's/,.*//' | sed 's/.*\-//' | grep cdh5.[4-5].*) + nameOfVersion=$(ssh -q -n $node grep "Version" $HOME/hbaseVersion.txt | sed 's/,.*//' | sed 's/.*\-//' | grep cdh5.[4-6].*) #Check that Cloudera 5.[n>4].* is not installed. if [[ -z $nameOfVersion ]]; then - versionInstalled=$(ssh -q -n $node grep "Version" $HOME/hbaseVersion.txt | sed 's/,.*//' | sed 's/.*\-//' | grep cdh[6-9].[0-9].* | wc -l) + versionInstalled=$(ssh -q -n $node grep "Version" $HOME/hbaseVersion.txt | sed 's/,.*//' | sed 's/.*\-//' | grep cdh[5-9].[7-9].* | wc -l) if [[ $versionInstalled -gt "0" ]]; then --- End diff -- https://issues.apache.org/jira/browse/TRAFODION-1945 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Vanilla Apache HBase support and...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/440#discussion_r60456998 --- Diff: install/installer/trafodion_install --- @@ -539,7 +543,9 @@ source $TRAF_CONFIG # #Check to make sure HBase Version is the correct version -checkHBaseVersion +if [[ $HADOOP_TYPE != "apache" ]]; then + checkHBaseVersion +fi #== --- End diff -- The instructions will provide the version you need, so I didn't include a check at this time. I will write a JIRA to add that improvement. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Vanilla Apache HBase support and...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/440#discussion_r60456457 --- Diff: install/installer/traf_config_check --- @@ -595,10 +598,40 @@ else fi } +function setPath { + +export PATH=$PATH:$HADOOP_PREFIX/bin:$HADOOP_PREFIX/sbin:$HBASE_HOME/bin + +sudo chmod 777 $TRAF_CONFIG +sed -i '/PATH\=/d' $TRAF_CONFIG +echo "export PATH=\"$PATH\"" >> $TRAF_CONFIG +sudo chmod 777 $TRAF_CONFIG +source $TRAF_CONFIG + +} + +function setHBaseDistro { + +export HBASE_DISTRO="APACHE" + --- End diff -- I agree. This variable is only used with Hadoop version is Apache in sqenvcom.sh. A JIRA to improve sqnencom.sh to be more standard and use more of the current variables would be a good idea. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Vanilla Apache HBase support and...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/440#discussion_r60456262 --- Diff: install/installer/traf_config_check --- @@ -545,7 +545,7 @@ else hadoopVersion=$(curl -k -su $ADMIN:$PASSWORD $URL/api/v1/clusters | grep version | grep -c CDH) - if [[ $hadoopVersion -ne "1" ]]; then + if [[ $hadoopVersion -lt "1" ]]; then hadoopVersion=$(curl -k -su $ADMIN:$PASSWORD $URL/api/v1/clusters | grep version | grep -c HDP) --- End diff -- That a good question. I only tested on a multi-cluster setup with 2 clusters. I think it would, but I will test this in the future. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Vanilla Apache HBase support and...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/440#discussion_r60455673 --- Diff: install/installer/traf_apache_mods --- @@ -0,0 +1,267 @@ +#!/bin/bash +# @@@ START COPYRIGHT @@@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# +# @@@ END COPYRIGHT @@@ +# +# This script will configure HBase with HBase-trx +# and co-processors needed for Trafodion. It uses +# Ambari's configs.sh script to do this. +# +# NOTE: Only for Ambari installations + +TRAF_CONFIG=/etc/trafodion/trafodion_config +source $TRAF_CONFIG + +export PDSH="pdsh -R exec" +export PDSH_SSH_CMD="ssh -q -n %h" +export PDCP="pdcp -R ssh" + +export PDSH_HADOOP_NODES="$PDSH $MY_HBASE_NODES $PDSH_SSH_CMD" +export PDCP_HADOOP_NODES="$PDCP $MY_HBASE_NODES" +#= +# copy Trafodion hbase trx jar to /usr/lib/hbase/lib + +cd $UNTAR_DIR + +HDFS_NODE=$(echo $HDFS_NODES | head -n1 | awk '{print $1;}') +HBASE_NODE=$(echo $HBASE_NODES | head -n1 | awk '{print $1;}') +echo "export HDFS_NODE=\"$HDFS_NODE\"" >> $TRAF_CONFIG +echo "export HBASE_NODE=\"$HBASE_NODE\"" >> $TRAF_CONFIG +sudo chmod 777 $TRAF_CONFIG +source $TRAF_CONFIG + + +hbase_trx_jar="hbase-trx-apache1_0_2-2.0.0.jar" + +traf_util_jar="trafodion-utility-*.jar" + + +# The permissions the Trafodion build process creates on the hbase-trx jar +# files does not work well with the installation process so we change them +sudo chmod -R 777 $UNTAR_DIR/export/lib + +if [ ! -f $UNTAR_DIR/export/lib/$hbase_trx_jar ]; then +echo "***ERROR: unable to find $UNTAR_DIR/export/lib/$hbase_trx_jar" +exit -1 +fi + +# if more than one node then copy to all nodes +echo "***INFO: copying $hbase_trx_jar to all nodes" +if [ $node_count -ne 1 ]; then +$PDSH_HADOOP_NODES sudo rm -rf $HBASE_HOME/lib/hbase-trx* 2>/dev/null +$TRAF_PDSH mkdir -p $LOCAL_WORKDIR 2>/dev/null +$PDSH_HADOOP_NODES mkdir -p $LOCAL_WORKDIR 2>/dev/null +cp $UNTAR_DIR/export/lib/$hbase_trx_jar $LOCAL_WORKDIR +cp $UNTAR_DIR/export/lib/$traf_util_jar $LOCAL_WORKDIR +$PDCP_HADOOP_NODES $LOCAL_WORKDIR/$hbase_trx_jar $LOCAL_WORKDIR +$PDCP_HADOOP_NODES $LOCAL_WORKDIR/$traf_util_jar $LOCAL_WORKDIR +$PDSH_HADOOP_NODES sudo cp $LOCAL_WORKDIR/$traf_util_jar $HBASE_HOME/lib +$PDSH_HADOOP_NODES sudo cp $LOCAL_WORKDIR/$hbase_trx_jar $HBASE_HOME/lib +$PDSH_HADOOP_NODES sudo chmod 644 $HBASE_HOME/lib/$hbase_trx_jar +$PDSH_HADOOP_NODES sudo chmod 644 $HBASE_HOME/lib/$traf_util_jar + +$PDSH_HADOOP_NODES rm $LOCAL_WORKDIR/$hbase_trx_jar 2>/dev/null +$PDSH_HADOOP_NODES rm $LOCAL_WORKDIR/$traf_util_jar 2>/dev/null +else +for node in $HBASE_NODES +do +ssh -q -n $node sudo rm -rf $HBASE_HOME/lib/hbase-trx* 2>/dev/null +ssh -q -n $node sudo mkdir -p $TRAF_WORKDIR 2>/dev/null +ssh -q -n $node sudo chmod 777 $TRAF_WORKDIR +scp -q $UNTAR_DIR/export/lib/$hbase_trx_jar $(whoami)@$node:$TRAF_WORKDIR +scp -q $UNTAR_DIR/export/lib/$traf_util_jar $(whoami)@$node:$TRAF_WORKDIR +ssh -q -n $node sudo cp $TRAF_WORKDIR/$hbase_trx_jar $HBASE_HOME/lib +ssh -q -n $node sudo cp $TRAF_WORKDIR/$traf_util_jar $HBASE_HOME/lib +ssh -q -n $node sudo chmod 644 $HADOOP_PATH/$hbase_trx_jar +ssh -q -n $node sudo chmod 644 $HADOOP_PATH/$traf_util_jar +done +fi + +#=== +#Check that HBase-trx copied to all nodes + +for node in $HBASE_NODES +do + copiedOver=$(ssh -q -n $node sudo ls $HBASE_HOME/lib/hbase-trx* | wc -l) + if [[ $copiedOver -ne "1" ]]; then + echo "***ERROR: $hbase_trx_ja
[GitHub] incubator-trafodion pull request: TRAFODION-1706
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/418#discussion_r59632384 --- Diff: core/sqf/sqenvcom.sh --- @@ -505,23 +505,6 @@ EOF APACHE_HIVE_HOME=$HIVE_HOME export HIVE_CNF_DIR=$HIVE_HOME/conf --- End diff -- @zellerh Hans- Could you comment on removing this bit of code? I just want to make sure it isn't something thats needed for install_local_hadoop. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: [[TRAFODION 1932]] Fixing sqnode...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/432 [[TRAFODION 1932]] Fixing sqnodestatus Removing tools directory for installer makefile (tools should only be used for dev) Adding new acceptKeys script to easily create known_host file You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion installbugfixes Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/432.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #432 commit 0034b3bafe19ed6363a13ba70ccd50642ea670ae Author: Amanda Moran <ama...@apache.com> Date: 2016-04-13T19:24:19Z [[TRAFODION 1932]] Fixing sqnodestart Removing tools directory for installer makefile (tools should only be used for dev) Adding new acceptKeys script to easily create known_host file --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Fixing merge error
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/412 Fixing merge error You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion installbugfixes Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/412.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #412 commit ddd5fa0c8b60699a0957cd1cfa40129a0bee90a9 Author: Amanda Moran <ama...@apache.com> Date: 2016-04-04T17:17:22Z Fixing merge error --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Changed permissions on bulkloadi...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/404#discussion_r57792074 --- Diff: install/installer/rest_installer --- @@ -76,7 +76,9 @@ while [[ $# -gt 0 ]]; do shift done +source echo "***INFO: Start of REST Server install" +source $TRAF_CONFIG --- End diff -- Yes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Changed permissions on bulkloadi...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/404 Changed permissions on bulkloading folder You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion installbugfixes Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/404.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #404 commit 0846d41a47f772e95b365281ff97bd5bdd820429 Author: Amanda Moran <ama...@apache.com> Date: 2016-03-23T22:12:36Z Merge branch 'master' of github.com:apache/incubator-trafodion into installbugfixes commit f3f0179bb3739027267e206a818997ccdd0764bd Author: Amanda Moran <ama...@apache.com> Date: 2016-03-29T17:47:12Z Changed permissions for bulkloading folder --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: [[TRAFODION 1903 ]] Removing TRA...
GitHub user amandamoran reopened a pull request: https://github.com/apache/incubator-trafodion/pull/399 [[TRAFODION 1903 ]] Removing TRAFODION VERSION and other clean up You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion installbugfixes Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/399.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #399 commit 93728159a11e7a0e274740b41dd38a823fd50e10 Author: Amanda Moran <ama...@apache.com> Date: 2016-03-22T00:31:45Z [[TRAFODION 1903 ]] Removing TRAFODION VERSION and other clean up commit cf700b93b328d349fe3c42025034d91524d189e5 Author: Amanda Moran <ama...@apache.com> Date: 2016-03-22T00:37:18Z Removing debugging flags commit 3159f4c6dc1c232c18c5b23014855578fd625e29 Author: Amanda Moran <ama...@apache.com> Date: 2016-03-23T21:55:24Z Fix for HDP commit cb4367b3b98a0a8c568cd6037ce8ab6daf54f557 Author: Amanda Moran <ama...@apache.com> Date: 2016-03-23T22:02:11Z Sourcing in config file --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: [[TRAFODION 1903 ]] Removing TRA...
Github user amandamoran closed the pull request at: https://github.com/apache/incubator-trafodion/pull/399 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: [[TRAFODION 1903 ]] Removing TRA...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/399#discussion_r57246433 --- Diff: install/installer/rest_installer --- @@ -108,13 +108,6 @@ mv $MY_SQROOT/sqenvcom.temp $MY_SQROOT/sqenvcom.sh cd $REST_DIR/conf echo "***INFO: modifying $REST_DIR/conf/rest-site.xml" -# get zookeeper quorum - -lineNumber=$(grep -n "zookeeper\.quorum" /etc/hbase/conf/hbase-site.xml | sed 's/\:.*//') -lineNumber=$((lineNumber+1)) - -ZOOKEEPER_NODES=`sed "$lineNumber!d" /etc/hbase/conf/hbase-site.xml | sed 's/\/value.*//' | sed 's/.*>//' | sed 's/.$//'` - # add zookeeper quorum property to end of configuration rm rest-site.temp 2>/dev/null cat rest-site.xml | sed -e "s@@ \n rest.zookeeper.quorum\n$ZOOKEEPER_NODES\n \n @" > rest-site.temp --- End diff -- Added this! Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: [[TRAFODION 1903 ]] Removing TRA...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/399 [[TRAFODION 1903 ]] Removing TRAFODION VERSION and other clean up You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion installbugfixes Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/399.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #399 commit 93728159a11e7a0e274740b41dd38a823fd50e10 Author: Amanda Moran <ama...@apache.com> Date: 2016-03-22T00:31:45Z [[TRAFODION 1903 ]] Removing TRAFODION VERSION and other clean up --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: [[TRAFODION 1884 ]] CDH 5.5 and ...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/378 [[TRAFODION 1884 ]] CDH 5.5 and HDP 2.4 install support Added check to make sure hbase-trx*.jar is copied to all nodes. Installer support only for CDH 5.5 and HDP 2.4. You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion installbugfixes Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/378.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #378 commit feeb3502cbc5f6f3c626645935495a5b9a0d4303 Author: Amanda Moran <ama...@apache.com> Date: 2016-03-11T23:07:21Z [[TRAFODION 1884 ]] CDH 5.5 and HDP 2.4 install support Added check to make sure hbase-trx*.jar is copied to all nodes. Installer support only for CDH 5.5 and HDP 2.4. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: JIRA TRAFODION 1001 1478 1691 18...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/360 JIRA TRAFODION 1001 1478 1691 1800 1821 1001 Finding zookeeper nodes 1478 Removing /hbase/archive/data/default from traf_hortonworks_mods98 1821 ldapconfigcheck changes 1691 Increase subscripts 1800 Backup resttore changes You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion installbugfixes Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/360.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #360 commit 3c45de7c32cd8542e46a19c4d1390929a1f12363 Author: Amanda Moran <ama...@apache.com> Date: 2016-03-03T21:21:01Z JIRA TRAFODION 1001 1478 1691 1800 1821 1001 Finding zookeeper nodes 1478 Removing /hbase/archive/data/default from traf_hortonworks_mods98 1821 ldapconfigcheck changes 1691 Increase subscripts 1800 Backup resttore changes --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: TRAFODION-1706
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/348#discussion_r54935909 --- Diff: core/sqf/sqenvcom.sh --- @@ -284,6 +297,8 @@ elif [[ -d /opt/cloudera/parcels/CDH ]]; then export CURL_INC_DIR=/usr/include export CURL_LIB_DIR=/usr/lib64 + lv_hbase_cp=`hbase classpath` --- End diff -- This will need to be set for Cloudera packages install as well. Add lv_hbase_cp=`hbase classpath` after elif [[ -n "$(ls /usr/lib/hadoop/hadoop-*cdh*.jar 2>/dev/null)" ]]; then (around line 340). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: [{ TRAFODION 1815 ]]
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/328#discussion_r53385842 --- Diff: install/installer/traf_add_sudoAccess --- @@ -24,17 +24,28 @@ TRAF_CONFIG=/etc/trafodion/trafodion_config source $TRAF_CONFIG sudoFile="trafodion" -echo "***INFO: Creating $TRAF_USER sudo access file" echo +function haSudoAdd { + echo "## Trafodion Floating IP commands" > $sudoFile echo "Cmnd_Alias IP = /sbin/ip" >> $sudoFile echo "Cmnd_Alias ARP = /sbin/arping" >> $sudoFile echo "## Allow Trafodion id to run commands needed to configure floating IP" >> $sudoFile echo "%trafodion ALL = NOPASSWD: IP, ARP" >> $sudoFile +} + +function backupRestore { + +echo "## Allow $BACKUP_USER id to run commands needed for backup and restore" >> $BACKUP_USER +echo "%$BACKUP_USER ALL =(hbase) NOPASSWD: /usr/bin/hbase" >> $BACKUP_USER + +} +function copyTrafFile { + if [[ $all_node_count -gt "1" ]]; then --- End diff -- No it doesnt --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: [ TRAFODION 1815 ]]
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/328 [ TRAFODION 1815 ]] You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion installbugfixes Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/328.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #328 commit 7b65d957d9a453226c438f785c74d1421064bd3a Author: Amanda Moran <ama...@apache.com> Date: 2016-02-08T18:34:33Z [[TRAFODION-1815]] Bug in sqgen commit 9cdd07b83fc1d534f4574a1aeb364faed5b054b9 Author: Amanda Moran <ama...@apache.com> Date: 2016-02-08T18:35:37Z Merge branch 'master' of github.com:apache/incubator-trafodion into installbugfixes commit f54a60d509ff7d45432f5bf4b644628477f37ca6 Author: Amanda Moran <ama...@apache.com> Date: 2016-02-18T19:44:32Z Merge branch 'master' of github.com:apache/incubator-trafodion into installbugfixes commit 062dbf2d7e2242f1a3a634e049abd63485965ddb Author: Amanda Moran <ama...@apache.com> Date: 2016-02-18T19:46:31Z [[TRAFODION 1815]] --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: [[ TRAFODION 1800 ]] Changes for...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/302 [[ TRAFODION 1800 ]] Changes for Backup/Restore You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion installbugfixes Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/302.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #302 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Many bug fixes for Installer. Al...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/274#discussion_r51036587 --- Diff: install/installer/traf_config_setup --- @@ -211,7 +215,7 @@ fi #== # List of Nodes -echo -n "Enter list of nodes (blank separated), default [$NODE_LIST]: " +echo -n "Enter list of Trafodion nodes (blank separated), default [$NODE_LIST]: " --- End diff -- Changed in next check in. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Many bug fixes for Installer. Al...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/274#discussion_r51036637 --- Diff: install/installer/traf_config_setup --- @@ -226,6 +230,33 @@ echo "export NODE_LIST=\"$NODE_LIST\"" >> $LOCAL_TRAF_CONFIG node_count=$(echo $NODE_LIST | wc -w) #== +echo -n "Are management nodes enabled (Y/N), default is N: " --- End diff -- Changed in next check in. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Many bug fixes for Installer. Al...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/274#discussion_r51039567 --- Diff: install/installer/traf_config_setup --- @@ -226,6 +230,33 @@ echo "export NODE_LIST=\"$NODE_LIST\"" >> $LOCAL_TRAF_CONFIG node_count=$(echo $NODE_LIST | wc -w) #== +echo -n "Are management nodes enabled (Y/N), default is N: " +read answer + +if [ -z $answer ]; then + echo "export MANAGE_ENABLED=\"N\"" >> $LOCAL_TRAF_CONFIG +else + if [[ "${answer}" =~ ^[Yy]$ ]]; then + echo "export MANAGE_ENABLED=\"Y\"" >> $LOCAL_TRAF_CONFIG + #List of Management Nodes + echo -n "Enter list management nodes (blank separated), default [$MANAGE_NODES]: " + read answer + if [[ -z "$answer" ]]; then +if [ -z "$MANAGE_NODES" ]; then + echo "***ERROR: Must enter list of management nodes." + exit -1 +fi + else +MANAGE_NODES="$answer" --- End diff -- Fixed everywhere. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Many bug fixes for Installer. Al...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/274#discussion_r51039863 --- Diff: install/installer/traf_config_setup --- @@ -678,7 +708,7 @@ if [[ $SCANNER_MODE == "N" ]]; then read answer4 if [[ -z "$answer4" ]]; then if [ -z "$LDAP_LEVEL" ]; then -echo "***ERROR: Must enter LDAP Encryption level." +echo "***ERROR: Much enter LDAP Encryption level." --- End diff -- Done for next check in. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Many bug fixes for Installer. Al...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/274#discussion_r51040041 --- Diff: install/installer/traf_getHadoopNodes --- @@ -31,20 +29,22 @@ echo "***INFO: Getting list of all $HADOOP_TYPE nodes" curlRC=0 if [[ $HADOOP_TYPE == "cloudera" ]]; then - curl -su $ADMIN:$PASSWORD http://$URL/api/v6/cm/deployment > tempFile + curl -k -su $ADMIN:$PASSWORD $URL/api/v10/hosts > tempFile curlRC=$? --- End diff -- It is being used a few lines down. if [ $curlRC != 0 ]; then echo "***ERROR: Unable to get list of hosts from $HADOOP_TYPE (RC=$curlRC)" echo "***ERROR: curl command failed." exit -1 fi --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Many bug fixes for Installer. Al...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/274#discussion_r51039231 --- Diff: install/installer/traf_config_setup --- @@ -226,6 +230,33 @@ echo "export NODE_LIST=\"$NODE_LIST\"" >> $LOCAL_TRAF_CONFIG node_count=$(echo $NODE_LIST | wc -w) #== +echo -n "Are management nodes enabled (Y/N), default is N: " +read answer + +if [ -z $answer ]; then + echo "export MANAGE_ENABLED=\"N\"" >> $LOCAL_TRAF_CONFIG +else + if [[ "${answer}" =~ ^[Yy]$ ]]; then + echo "export MANAGE_ENABLED=\"Y\"" >> $LOCAL_TRAF_CONFIG + #List of Management Nodes + echo -n "Enter list management nodes (blank separated), default [$MANAGE_NODES]: " + read answer + if [[ -z "$answer" ]]; then +if [ -z "$MANAGE_NODES" ]; then + echo "***ERROR: Must enter list of management nodes." --- End diff -- Done for next check in. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Many bug fixes for Installer. Al...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/274#discussion_r51039497 --- Diff: install/installer/traf_config_setup --- @@ -226,6 +230,33 @@ echo "export NODE_LIST=\"$NODE_LIST\"" >> $LOCAL_TRAF_CONFIG node_count=$(echo $NODE_LIST | wc -w) #== +echo -n "Are management nodes enabled (Y/N), default is N: " +read answer + +if [ -z $answer ]; then + echo "export MANAGE_ENABLED=\"N\"" >> $LOCAL_TRAF_CONFIG +else + if [[ "${answer}" =~ ^[Yy]$ ]]; then + echo "export MANAGE_ENABLED=\"Y\"" >> $LOCAL_TRAF_CONFIG + #List of Management Nodes + echo -n "Enter list management nodes (blank separated), default [$MANAGE_NODES]: " + read answer + if [[ -z "$answer" ]]; then +if [ -z "$MANAGE_NODES" ]; then + echo "***ERROR: Must enter list of management nodes." + exit -1 +fi + else +MANAGE_NODES="$answer" + fi + + echo "export MANAGE_NODES=\"$MANAGE_NODES\"" >> $LOCAL_TRAF_CONFIG + else + echo "export MANAGE_ENABLED=\"N\"" >> $LOCAL_TRAF_CONFIG --- End diff -- Done for next check in. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Many bug fixes for Installer. Al...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/274#discussion_r50915415 --- Diff: install/installer/traf_sqgen --- @@ -0,0 +1,96 @@ +#!/bin/bash +# @@@ START COPYRIGHT @@@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# +# @@@ END COPYRIGHT @@@ + +export TRAF_CONFIG=/etc/trafodion/trafodion_config + +source $TRAF_CONFIG + +STARTING_NODE=$(hostname) + +#== +echo "***INFO: starting sqgen" | tee -a $INSTALL_LOG +cd $SQ_ROOT/sql/scripts +$SQ_ROOT/sql/scripts/sqgen +SQGEN_RC=$? +if [ "$SQGEN_RC" != "0" ]; then +echo "***ERROR: sqgen failed with RC=$SQGEN_RC. Check install log file for details." | tee -a $INSTALL_LOG +exit -1; +fi +#== + +if [ "$node_count" -ne "1" ]; then +echo "***INFO: copying $HOME/sqcert directory to all nodes" | tee -a $INSTALL_LOG +$PDCP $ALL_NODES -x $HOSTNAME -r $HOME/sqcert $HOME +fi + +#== + +if [ "$all_node_count" -ne "1" ]; then + echo "***INFO: copying install to all nodes" | tee -a $INSTALL_LOG + $PDCP $ALL_NODES -x $HOSTNAME -r $SQ_ROOT $SQ_ROOT/.. + + if [ "$?" != "0" ]; then + echo "***ERROR: Unable to copy Trafodion install to all machines in this cluster. Check install log files for details." | tee -a $INSTALL_LOG + exit -1; + fi +fi + +#= +#Copying traf_authentication_conf to scripts directory +if [[ "$LDAP_SECURITY" == "Y" ]]; then + if [ "$all_node_count" -ne "1" ]; then + echo "***INFO: Copying $LDAP_AUTH_FILE to all nodes" | tee -a $INSTALL_LOG + $PDCP $ALL_NODES -r $HOME/$LDAP_AUTH_FILE $SQ_ROOT/sql/scripts/traf_authentication_config + if [ "$?" != "0" ]; then +echo "***ERROR: Unable to copy $LDAP_AUTH_FILE to all machines in this cluster. Check install log files for details." | tee -a $INSTALL_LOG + exit -1; + fi + else + echo "***INFO: Copying $LDAP_AUTH_FILE to scripts directory." | tee -a $INSTALL_LOG + cp -rf $HOME_DIR/$TRAF_USER/$LDAP_AUTH_FILE $SQ_ROOT/sql/scripts/traf_authentication_config + fi + + #Check traf_authentication_config for errors + echo "***INFO: Checking LDAP Configuration file for errors." + ldapconfigcheck -file $SQ_ROOT/sql/scripts/traf_authentication_config + if [ "$?" != "0" ]; then + echo "***ERROR: traf_authentication_config not configured correctly." + echo "***ERROR: Install will continue WITHOUT simple security turned on." + echo "***ERROR: Please review wiki for manual steps to setup simple security." + else + if [[ $LDAP_LEVEL == "1" ]]; then + echo "TLS_CACERT $HOME/$LDAP_CERT_BASE" > $HOME_DIR/$TRAF_USER/.ldaprc + echo "TLS_REQCERT demand" >> $HOME_DIR/$TRAF_USER/.ldaprc + fi + echo "***INFO: Enabling security. Running traf_authentication_setup" + ssh $STARTING_NODE "cd $MY_SQROOT/sql/scripts; traf_authentication_setup --setup --file traf_authentication_config" + + if [[ $? != "0" ]]; then + echo "***WARNING: Error during script traf_authentication_setup" + echo "***WARNING: Install will continue WITHOUT simple security turned on." + echo "***WARNING: Please review wiki for manual steps to setup simple security." --- End diff -- Because security can be enabled after the installation, the install should continue. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Many bug fixes for Installer. Al...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/274#discussion_r50915377 --- Diff: install/installer/traf_sqgen --- @@ -0,0 +1,96 @@ +#!/bin/bash +# @@@ START COPYRIGHT @@@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# +# @@@ END COPYRIGHT @@@ + +export TRAF_CONFIG=/etc/trafodion/trafodion_config + +source $TRAF_CONFIG + +STARTING_NODE=$(hostname) + +#== +echo "***INFO: starting sqgen" | tee -a $INSTALL_LOG +cd $SQ_ROOT/sql/scripts +$SQ_ROOT/sql/scripts/sqgen +SQGEN_RC=$? +if [ "$SQGEN_RC" != "0" ]; then +echo "***ERROR: sqgen failed with RC=$SQGEN_RC. Check install log file for details." | tee -a $INSTALL_LOG +exit -1; +fi +#== + +if [ "$node_count" -ne "1" ]; then +echo "***INFO: copying $HOME/sqcert directory to all nodes" | tee -a $INSTALL_LOG +$PDCP $ALL_NODES -x $HOSTNAME -r $HOME/sqcert $HOME +fi + +#== + +if [ "$all_node_count" -ne "1" ]; then + echo "***INFO: copying install to all nodes" | tee -a $INSTALL_LOG + $PDCP $ALL_NODES -x $HOSTNAME -r $SQ_ROOT $SQ_ROOT/.. + + if [ "$?" != "0" ]; then + echo "***ERROR: Unable to copy Trafodion install to all machines in this cluster. Check install log files for details." | tee -a $INSTALL_LOG + exit -1; + fi +fi + +#= +#Copying traf_authentication_conf to scripts directory +if [[ "$LDAP_SECURITY" == "Y" ]]; then + if [ "$all_node_count" -ne "1" ]; then + echo "***INFO: Copying $LDAP_AUTH_FILE to all nodes" | tee -a $INSTALL_LOG + $PDCP $ALL_NODES -r $HOME/$LDAP_AUTH_FILE $SQ_ROOT/sql/scripts/traf_authentication_config + if [ "$?" != "0" ]; then +echo "***ERROR: Unable to copy $LDAP_AUTH_FILE to all machines in this cluster. Check install log files for details." | tee -a $INSTALL_LOG + exit -1; + fi + else + echo "***INFO: Copying $LDAP_AUTH_FILE to scripts directory." | tee -a $INSTALL_LOG + cp -rf $HOME_DIR/$TRAF_USER/$LDAP_AUTH_FILE $SQ_ROOT/sql/scripts/traf_authentication_config + fi + + #Check traf_authentication_config for errors + echo "***INFO: Checking LDAP Configuration file for errors." + ldapconfigcheck -file $SQ_ROOT/sql/scripts/traf_authentication_config + if [ "$?" != "0" ]; then + echo "***ERROR: traf_authentication_config not configured correctly." + echo "***ERROR: Install will continue WITHOUT simple security turned on." + echo "***ERROR: Please review wiki for manual steps to setup simple security." --- End diff -- Because security can be enabled after the installation, the install should continue. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Many bug fixes for Installer. Al...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/274#discussion_r50924204 --- Diff: install/installer/traf_sqgen --- @@ -0,0 +1,96 @@ +#!/bin/bash +# @@@ START COPYRIGHT @@@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# +# @@@ END COPYRIGHT @@@ + +export TRAF_CONFIG=/etc/trafodion/trafodion_config + +source $TRAF_CONFIG + +STARTING_NODE=$(hostname) + +#== +echo "***INFO: starting sqgen" | tee -a $INSTALL_LOG +cd $SQ_ROOT/sql/scripts +$SQ_ROOT/sql/scripts/sqgen +SQGEN_RC=$? +if [ "$SQGEN_RC" != "0" ]; then +echo "***ERROR: sqgen failed with RC=$SQGEN_RC. Check install log file for details." | tee -a $INSTALL_LOG +exit -1; +fi +#== + +if [ "$node_count" -ne "1" ]; then +echo "***INFO: copying $HOME/sqcert directory to all nodes" | tee -a $INSTALL_LOG +$PDCP $ALL_NODES -x $HOSTNAME -r $HOME/sqcert $HOME +fi + +#== + +if [ "$all_node_count" -ne "1" ]; then --- End diff -- No it can't. I tested it out. See comment above. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Many bug fixes for Installer. Al...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/274 Many bug fixes for Installer. All JIRA's listed. TRAFODION-1545 Adding Management nodes TRAFODION-1691 Smaller subscripts Trafodion-1681 need full HADOOP path for hdfs Trafodion-1689 DCS HA Trafodion-1756 kernel.pid_max persistent on reboot Trafodion-1694 kernel.pid_max full path Trafodion-1693 CLUSTERNAME being set Trafodion-1574 increasing maintainability of scripts Trafodion-1711 curl commands should accept http/https Trafodion-1478 Create /hbase/archive/data/default You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion installbugfixes Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/274.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #274 commit ee4c25397f647805c112ffdec55bd9c24a30a432 Author: Amanda Moran <ama...@apache.com> Date: 2016-01-20T23:54:05Z Many bug fixes. All JIRAs listed below. TRAFODION-1545 Adding Management nodes TRAFODION-1691 Smaller subscripts Trafodion-1681 Need full HADOOP path for hdfs Trafodion-1689 DCS HA Trafodion-1756 kernel.pid_max persistent on reboot Trafodion-1694 kernel.pid_max full path Trafodion-1693 CLUSTERNAME being set Trafodion-1574 Increasing maintainability of scripts Trafodion-1711 curl commands should accept http/https Trafodion-1478 Create /hbase/archive/data/default --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request:
Github user amandamoran commented on the pull request: https://github.com/apache/incubator-trafodion/commit/dd1b373c588353d97d62c165f54c7fdb942594bd#commitcomment-15025812 Hi there Arvind- No, problem. Will do. Thanks! On Wed, Dec 16, 2015 at 12:23 PM, arvind-narain <notificati...@github.com> wrote: > @amandamoran <https://github.com/amandamoran> Hi Amanda - May have been a > merge issue - we will need the following change in trafodion_installer for > DCS HA (sysctl is not part of it - though that change would also be good). > > if [[ $ENABLE_HA == "true" ]]; then > $LOCAL_WORKDIR/traf_add_sudoAccess > fi > > #Set Max kernel pid > > $TRAF_PDSH sudo /sbin/sysctl -w kernel.pid_max=65535 2>&1 > /dev/null > > â > Reply to this email directly or view it on GitHub > <https://github.com/apache/incubator-trafodion/commit/dd1b373c588353d97d62c165f54c7fdb942594bd#commitcomment-15024971> > . > -- Thanks, Amanda Moran --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: [[TRAFODION 1694]] [[ TRAFODION ...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/230 [[TRAFODION 1694]] [[ TRAFODION 1689]] Adding full path for kernel.pid_max. Adding call for traf_sudoAccess for DCS HA. You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion installbugfixes Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/230.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #230 commit 093e6fcb9ce9c1d0476e8ee4f2628e50b7fff7d3 Author: Amanda Moran <ama...@apache.com> Date: 2015-12-16T20:50:09Z [[TRAFODION 1694]] [[ TRAFODION 1694]] Adding full path for kernel.pid_max. Adding call for traf_sudoAccess for DCS HA. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request:
Github user amandamoran commented on the pull request: https://github.com/apache/incubator-trafodion/commit/dd1b373c588353d97d62c165f54c7fdb942594bd#commitcomment-15026032 https://github.com/apache/incubator-trafodion/pull/230 On Wed, Dec 16, 2015 at 12:42 PM, Amanda Moran <amanda.mo...@esgyn.com> wrote: > Hi there Arvind- > > No, problem. Will do. > > Thanks! > > On Wed, Dec 16, 2015 at 12:23 PM, arvind-narain <notificati...@github.com> > wrote: > >> @amandamoran <https://github.com/amandamoran> Hi Amanda - May have been >> a merge issue - we will need the following change in trafodion_installer >> for DCS HA (sysctl is not part of it - though that change would also be >> good). >> >> if [[ $ENABLE_HA == "true" ]]; then >> $LOCAL_WORKDIR/traf_add_sudoAccess >> fi >> >> #Set Max kernel pid >> >> $TRAF_PDSH sudo /sbin/sysctl -w kernel.pid_max=65535 2>&1 > /dev/null >> >> â >> Reply to this email directly or view it on GitHub >> <https://github.com/apache/incubator-trafodion/commit/dd1b373c588353d97d62c165f54c7fdb942594bd#commitcomment-15024971> >> . >> > > > > -- > Thanks, > > Amanda Moran > -- Thanks, Amanda Moran --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: TRAFODION 1547 and TRAFODION 147...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/217#discussion_r47133790 --- Diff: install/installer/traf_add_user --- @@ -208,15 +208,26 @@ fi #= # Cycle through all nodes to create known_hosts file, even if only one node echo "***INFO: Creating known_hosts file for all nodes" +NODES_SHORT="" for node in $NODE_LIST -do -sudo su $TRAF_USER --command "ssh -q -oStrictHostKeyChecking=no $node hostname" -if [ $? -ne 0 ]; then -echo "***ERROR: Unable to ssh to node $node" -exit -1 -fi +do + newNode=$(ssh -q -n $node hostname -s) --- End diff -- Yes, the user needs to set up passwordless ssh and there is a check for that earlier in traf_config_check --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: TRAFODION 1547 and TRAFODION 147...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/217 TRAFODION 1547 and TRAFODION 1476 You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion installbugfixes Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/217.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #217 commit 9f0a61bab4478c18c91259aedad19ebe310598d2 Author: Amanda Moran <ama...@apache.com> Date: 2015-12-09T00:20:08Z Fix for passwordless ssh and EPEL issue --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: [[ TRAFODION 1563 ]] Fix of INST...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/154 [[ TRAFODION 1563 ]] Fix of INSTALL_LOG file with current date On an upgrade, INSTALL_LOG was getting the old installer name (because the config file had already been sourced). Added new variable to "remember" the new installer log. You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion bugfixesInstall Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/154.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #154 commit 2e1e1a79e9b79ec69776fe81ff7c1b4483e245c3 Author: Amanda Moran <ama...@apache.com> Date: 2015-10-30T21:09:57Z [[ TRAFODION 1563 ]] Fix INSTALL_LOG name --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: [TRAFODION 1539] HADOOP_PATH wil...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/131 [TRAFODION 1539] HADOOP_PATH will now be set HADOOP_PATH was not being set in config file. You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion oneClickSupport Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/131.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #131 commit dc47dd195a41fb674b5442a648ea042973bfdf98 Author: Amanda Moran <ama...@apache.com> Date: 2015-10-16T21:18:12Z [TRAFODION 1539] HADOOP_PATH now will be set. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: [[ TRAFODION-1434 ]] Allows for ...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/95 [[ TRAFODION-1434 ]] Allows for oneclick installs and HDP 2.3 install support You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion oneClickSupport Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/95.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #95 commit 78200ab1031ef0d9987fd40bf14610bb9874d086 Author: Amanda Moran <ama...@apache.com> Date: 2015-09-29T21:37:38Z TRAFODION-1434 fix --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: [[Trafodion 1133]] [[Trafodion 1...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/84 [[Trafodion 1133]] [[Trafodion 1088]] [[Trafodion 1481]] Trafodion 1133 and Trafodion 1088 now installer can add a node Trafodion 1481 rpms are now installed in their own script traf_package_setup to allow for new packages to be installed on upgrade. You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion bugFixes Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/84.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #84 commit 268f855c5b233b6683c113af811c6241b906628a Author: Amanda Moran <ama...@apache.com> Date: 2015-09-17T19:03:32Z Adding small change to allow Cloudera to install from local repo --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: [[Trafodion 1133]] [[Trafodion 1...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/76#discussion_r39092032 --- Diff: install/installer/traf_config_setup --- @@ -550,10 +562,10 @@ else exit -1 fi -hadoopVersion=$(curl -su $username:$password http://$URL/api/v1/clusters | grep version | grep -c CDH) +hadoopVersion=$(curl -su admin:admin http://$URL/api/v1/clusters | grep version | grep -c CDH) --- End diff -- Sorry, I guess the merge didn't happened as I thought it would. Let me fix and check in. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: [[Trafodion 1133]] [[Trafodion 1...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/76#discussion_r39092287 --- Diff: install/installer/traf_package_setup --- @@ -0,0 +1,224 @@ +#!/bin/bash + +# @@@ START COPYRIGHT @@@ +# +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NOTICE file +# distributed with this work for additional information +# regarding copyright ownership. The ASF licenses this file +# to you under the Apache License, Version 2.0 (the +# "License"); you may not use this file except in compliance +# with the License. You may obtain a copy of the License at +# +# http://www.apache.org/licenses/LICENSE-2.0 +# +# Unless required by applicable law or agreed to in writing, +# software distributed under the License is distributed on an +# "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY +# KIND, either express or implied. See the License for the +# specific language governing permissions and limitations +# under the License. +# +# @@@ END COPYRIGHT @@@ + +# Setup Trafodion environment on a Cluster System + +#== + +timestamp=$(date +%F-%H-%M-%S) +source /etc/trafodion/trafodion_config + +cd $LOCAL_WORKDIR + +echo "***Log File: traf_package_setup script***" >> $INSTALL_LOG +echo >> $INSTALL_LOG +echo "Username: $TRAF_USER" >> $INSTALL_LOG +echo "Nodes: $NODE_LIST" >> $INSTALL_LOG +echo "Home directory: $HOME_DIR" >> $INSTALL_LOG +echo >> $INSTALL_LOG + +echo "***INFO: Starting Trafodion Package Setup ($timestamp)" +# +#Setting up pdsh variables +if [ $node_count -eq 1 ]; then +TRAF_PDSH="" +TRAF_PDCP="" +else +# use the -S option to cause pdsh to return largest of +# the remote command return values so we can tell if one +# or more of the remote commands failed +TRAF_PDSH="pdsh -R exec $MY_NODES ssh -q -n %h" +TRAF_PDCP="pdcp -R ssh $MY_NODES" +fi +#== +echo "***INFO: Installing required packages" +echo "***INFO: Log file located in /var/log/trafodion" +YUM_LOG=/var/log/trafodion/trafodion_yum_$timestamp.log +ZYPP_LOG=/var/log/trafodion/trafodion_zypp_$timestamp.log + +#=== +#Set internet access +internetAccess="true" + +# +#Checking to see if epel package is installed. +if [[ $SUSE_LINUX == "false" ]]; then + for node in $NODE_LIST; + do + EPEL_INSTALLED=$(ssh -q -n $node rpm -qa | grep epel | wc -l) + if [[ $EPEL_INSTALLED == 0 ]]; then +break; + fi + done + + if [[ $EPEL_INSTALLED == 0 ]]; then + echo "***INFO: ... EPEL rpm" + if [[ "$EPEL_RPM" != "" ]]; then + if [ $node_count -ne 1 ]; then +for node in $NODE_LIST +do + scp -q $EPEL_RPM $(whoami)@$node:$HOME +done + else +cp -rf $EPEL_RPM $HOME + fi + else + if [[ $internetAccess == "true" ]]; then +epel_rpm="epel-release-6-8.noarch.rpm" +wget http://download.fedoraproject.org/pub/epel/6/x86_64/$epel_rpm +if [ $node_count -ne 1 ]; then + for node in $NODE_LIST + do + scp -q $LOCAL_WORKDIR/$epel_rpm $(whoami)@$node:$HOME + done +else + cp -rf $epel_rpm $HOME +fi + +if [ $? != 0 ]; then --- End diff -- Ah! Good thinking! Let me put in error checking! Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: [[Trafodion 1133]] [[Trafodion 1...
Github user amandamoran commented on a diff in the pull request: https://github.com/apache/incubator-trafodion/pull/76#discussion_r39092192 --- Diff: install/installer/trafodion_config_default --- @@ -125,6 +125,9 @@ export PASSWORD="admin" # hadoop cluster name export CLUSTER_NAME="" +#Trafodion Cluster name, normally the same as Cloudera cluster name +export CLUSTERNAME="" --- End diff -- CLUSTERNAME is used through out Trafodion and it can not be changed. It was deleted awhile back, since it was believed to not being used and had some bad consequences. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: [[Trafodion-1218]] Fix new hosts...
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/64 [[Trafodion-1218]] Fix new hosts names, adding a node to instatllation, and cloudera bug You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion newHosts Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/64.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #64 commit f5eccb9bb05b888f53e585e27d4487d6bac711ba Author: Amanda Moran ama...@apache.com Date: 2015-08-21T22:29:55Z Adding hostname change fix and cloudera start node fix When hostnames change on restart will now generate a new sqconfig file, and modify the trafodion .bashrc file. Also can add a node and trafodion user id will be added on that node. Cloudera start node wasn't being found because was missing variable. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---
[GitHub] incubator-trafodion pull request: Testing with small change
GitHub user amandamoran opened a pull request: https://github.com/apache/incubator-trafodion/pull/20 Testing with small change Removed a package we no longer need to install, mostly for testing purposes. You can merge this pull request into a Git repository by running: $ git pull https://github.com/amandamoran/incubator-trafodion install_0707 Alternatively you can review and apply these changes as the patch at: https://github.com/apache/incubator-trafodion/pull/20.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #20 commit cfb0ba82cb779a9e2b7b4f55662101f4679a14ac Author: Amanda Moran ama...@apache.com Date: 2015-07-07T23:43:47Z Testing with small change Removed a package we no longer need to install, mostly for testing purposes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. ---