Thanks for the response Qifan... but I am not sure we are talking about the
same thing.

I am talking about the traf_<hadoop distro>_mods98 script that is run as
apart of the Trafodion Installation scripts. It is used to setup HBase
settings, copy hbase-trx*.jar file, and restart HBase, HDFS, and Zookeeper.

I would like to know what are the smallest number of settings that need to
be set in advance for Trafodion to install/start.

Examples of things set:
hbase-site hbase.master.distributed.log.splitting false

hbase-site hbase.coprocessor.region.classes
"org.apache.hadoop.hbase.coprocessor.transactional.TrxRegionObserver,org.apache.hadoop.hbase.coprocessor.transactional.TrxRegionEndpoint,org.apache.hadoop.hbase.coprocessor.AggregateImplementation"

hbase-site hbase.hregion.impl
org.apache.hadoop.hbase.regionserver.transactional.TransactionalRegion

hbase-site hbase.regionserver.region.split.policy
org.apache.hadoop.hbase.regionserver.ConstantSizeRegionSplitPolicy

hbase-site hbase.snapshot.enabled true

hbase-site hbase.bulkload.staging.dir /hbase-staging

hbase-site hbase.regionserver.region.transactional.tlog true

hbase-site hbase.snapshot.master.timeoutMillis 600000

hbase-site hbase.snapshot.region.timeout 600000

hdfs-site dfs.namenode.acls.enabled true

hbase-site hbase.client.scanner.timeout.period 600000

Thanks all!

On Thu, Feb 4, 2016 at 5:40 AM, Qifan Chen <[email protected]> wrote:

> Hi Amanda,
>
> I like your idea.
>
> On Trafodion's modification of config files for HBase, HDFS, and
> Zookeeper, I wonder if it is possible to re-difine the port range for an
> install, without going through all the install steps. This has the
> practical value that due to port conflict, an install could not start
> successfully, and one can easily switch to a different port range to retry
> with this capability.
>
> In addition, some of the install steps, such as TPCDS data set generation,
> and conversion to UTF8, could be made parallel to shorten the install
> duration. They are done one table at a time in serial mode now.
>
> TPCDS table data is generated through the command "dsdgen -scale ..."
> which could take the option "-parallel".
> Data conversion to UTF8 is done through the iconv utility.
>
> Regards, --Qifan
>
>
>
>
>
>
>
> On Wed, Feb 3, 2016 at 10:34 PM, Amanda Moran <[email protected]>
> wrote:
>
>> HI there All-
>>
>> The traf_*_mods scripts are used during installation to set HBase, HDFS,
>> and Zookeeper settings needed by Trafodion.
>>
>> The script takes a long time to run (slowing down installation by a lot)
>> because it needs to restart all these services for the changes to be picked
>> up.
>>
>> My question is: What if I wanted to set the settings in advance of
>> running the installer. What would be the absolute minimum set of settings
>> that I need to get installed? I could set other settings later with a
>> script or by hand.
>>
>> Thanks!
>> --
>> Thanks,
>>
>> Amanda Moran
>>
>
>
>
> --
> Regards, --Qifan
>
>


-- 
Thanks,

Amanda Moran

Reply via email to