[
https://issues.apache.org/jira/browse/HBASE-1413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12708698#action_12708698
]
stack commented on HBASE-1413:
------------------------------
Yeah, append doesn't work in hadoop, even if I set:
{code}
<property>
<name>dfs.support.append</name>
<value>true</value>
<description>Does HDFS allow appends to files?
This is currently set to false because there are bugs in the
"append code" and is not supported in any prodction cluster.
</description>
</property>
{code}
I set it in hadoop and in hbase-site, just in case.
Here is what happens on recovery (I have hbase default of 1MB blocks):
{code}
2009-05-13 00:11:58,432 [HMaster] DEBUG
org.apache.hadoop.hbase.regionserver.HLog: Splitting 7 of 8:
hdfs://aa0-000-12.u.powerset.com:9000/hbasetrunk2/.logs/aa0-000-13.u.powerset.com_1242172854122_60021/hlog.dat.1242173414309
2009-05-13 00:11:58,479 [HMaster] DEBUG
org.apache.hadoop.hbase.regionserver.HLog: Creating new log file writer for
path
hdfs://aa0-000-12.u.powerset.com:9000/hbasetrunk2/TestTable/1990997262/oldlogfile.log
and region TestTable,0452208868,1242173387637
2009-05-13 00:12:03,302 [HMaster] DEBUG
org.apache.hadoop.hbase.regionserver.HLog: Applied 104414 total edits from
hdfs://aa0-000-12.u.powerset.com:9000/hbasetrunk2/.logs/aa0-000-13.u.powerset.com_1242172854122_60021/hlog.dat.1242173414309
2009-05-13 00:12:03,370 [HMaster] DEBUG
org.apache.hadoop.hbase.regionserver.HLog: Splitting 8 of 8:
hdfs://aa0-000-12.u.powerset.com:9000/hbasetrunk2/.logs/aa0-000-13.u.powerset.com_1242172854122_60021/hlog.dat.1242173448263
2009-05-13 00:12:10,717 [HMaster] INFO
org.apache.hadoop.hbase.regionserver.HLog: log file splitting completed for
hdfs://aa0-000-12.u.powerset.com:9000/hbasetrunk2/.logs/aa0-000-13.u.powerset.com_1242172854122_60021
{code}
Nothing is recovered from eight file.....
Let me try printing out log file sizes...
> fall back to filesystem block size default if
> hbase.regionserver.hlog.blocksize is not specified
> ------------------------------------------------------------------------------------------------
>
> Key: HBASE-1413
> URL: https://issues.apache.org/jira/browse/HBASE-1413
> Project: Hadoop HBase
> Issue Type: Task
> Reporter: Andrew Purtell
> Assignee: Andrew Purtell
> Priority: Minor
> Fix For: 0.19.2, 0.20.0
>
> Attachments: hbase-1413.patch
>
>
> Fall back to filesystem block size default if
> hbase.regionserver.hlog.blocksize is not specified.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
