The base directories will only exist after compaction has run. When you
say you set hive.compactor.initiator.on (=true I hope) and
hive.compactor.worker.threads, did you did that in your metastore
process? If so, did you restart the metastore after changing the config
values?
Alan.
vic0777 <mailto:vic0...@163.com>
December 1, 2014 at 23:12
Hi All,
I am trying to use the new transaction feature in Hive-0.14. According
to its document, every transaction table have a base directory and one
delta directory for each transaction in HDFS for data storage. But I
can not find where the base directory is in HDFS, there is only delta
directories. Following is the commands I used.
create table test_txn (id int,name string ) clustered by (id) into
2buckets stored as orc TBLPROPERTIES('transactional'='true');
insert into table test_txn select * from test_text;
update test_txn set name="liu" where id = 10;
P.S. I have configured the parameters required by the transaction
feature:
hive.support.concurrency,
hive.enforce.bucketing,
hive.exec.dynamic.partition.mode,
hive.txn.manager,
hive.compactor.initiator.on
hive.compactor.worker.threads.
Although I cannot find the base directory in HDFS, all SELECT, UPDATE
and DELETE statements works fine and the data in the table is correct.
I am wondering where the base directory is.
Any help is appreciated.
Thanks,
Wantao
--
Sent with Postbox <http://www.getpostbox.com>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.
