Hi Amanda, I know the topic that I brought up is a little bit different :-).
But the objectives of both thoughts are pretty much in line with the improvement of install experiences. Thank you. --Qifan On Tue, Feb 9, 2016 at 10:36 AM, Amanda Moran <[email protected]> wrote: > Thanks for the response Qifan... but I am not sure we are talking about > the same thing. > > I am talking about the traf_<hadoop distro>_mods98 script that is run as > apart of the Trafodion Installation scripts. It is used to setup HBase > settings, copy hbase-trx*.jar file, and restart HBase, HDFS, and Zookeeper. > > I would like to know what are the smallest number of settings that need to > be set in advance for Trafodion to install/start. > > Examples of things set: > hbase-site hbase.master.distributed.log.splitting false > > hbase-site hbase.coprocessor.region.classes > "org.apache.hadoop.hbase.coprocessor.transactional.TrxRegionObserver,org.apache.hadoop.hbase.coprocessor.transactional.TrxRegionEndpoint,org.apache.hadoop.hbase.coprocessor.AggregateImplementation" > > hbase-site hbase.hregion.impl > org.apache.hadoop.hbase.regionserver.transactional.TransactionalRegion > > hbase-site hbase.regionserver.region.split.policy > org.apache.hadoop.hbase.regionserver.ConstantSizeRegionSplitPolicy > > hbase-site hbase.snapshot.enabled true > > hbase-site hbase.bulkload.staging.dir /hbase-staging > > hbase-site hbase.regionserver.region.transactional.tlog true > > hbase-site hbase.snapshot.master.timeoutMillis 600000 > > hbase-site hbase.snapshot.region.timeout 600000 > > hdfs-site dfs.namenode.acls.enabled true > > hbase-site hbase.client.scanner.timeout.period 600000 > > Thanks all! > > On Thu, Feb 4, 2016 at 5:40 AM, Qifan Chen <[email protected]> wrote: > >> Hi Amanda, >> >> I like your idea. >> >> On Trafodion's modification of config files for HBase, HDFS, and >> Zookeeper, I wonder if it is possible to re-difine the port range for an >> install, without going through all the install steps. This has the >> practical value that due to port conflict, an install could not start >> successfully, and one can easily switch to a different port range to retry >> with this capability. >> >> In addition, some of the install steps, such as TPCDS data set >> generation, and conversion to UTF8, could be made parallel to shorten the >> install duration. They are done one table at a time in serial mode now. >> >> TPCDS table data is generated through the command "dsdgen -scale ..." >> which could take the option "-parallel". >> Data conversion to UTF8 is done through the iconv utility. >> >> Regards, --Qifan >> >> >> >> >> >> >> >> On Wed, Feb 3, 2016 at 10:34 PM, Amanda Moran <[email protected]> >> wrote: >> >>> HI there All- >>> >>> The traf_*_mods scripts are used during installation to set HBase, HDFS, >>> and Zookeeper settings needed by Trafodion. >>> >>> The script takes a long time to run (slowing down installation by a lot) >>> because it needs to restart all these services for the changes to be picked >>> up. >>> >>> My question is: What if I wanted to set the settings in advance of >>> running the installer. What would be the absolute minimum set of settings >>> that I need to get installed? I could set other settings later with a >>> script or by hand. >>> >>> Thanks! >>> -- >>> Thanks, >>> >>> Amanda Moran >>> >> >> >> >> -- >> Regards, --Qifan >> >> > > > -- > Thanks, > > Amanda Moran > -- Regards, --Qifan
