[
https://issues.apache.org/jira/browse/HBASE-1138?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12665462#action_12665462
]
Jim Kellerman commented on HBASE-1138:
--------------------------------------
We can mitigate this in the short term by making HLog block size configurable
as there is a (new to me) createWriter method:
{code}
/**
* Construct the preferred type of SequenceFile Writer.
* @param fs The configured filesystem.
* @param conf The configuration.
* @param name The name of the file.
* @param keyClass The 'key' type.
* @param valClass The 'value' type.
* @param bufferSize buffer size for the underlaying outputstream.
* @param replication replication factor for the file.
* @param blockSize block size for the file.
* @param compressionType The compression type.
* @param codec The compression codec.
* @param progress The Progressable object to track progress.
* @param metadata The metadata of the file.
* @return Returns the handle to the constructed SequenceFile Writer.
* @throws IOException
*/
public static Writer
createWriter(FileSystem fs, Configuration conf, Path name,
Class keyClass, Class valClass, int bufferSize,
short replication, long blockSize,
CompressionType compressionType, CompressionCodec codec,
Progressable progress, Metadata metadata) throws IOException {
{code}
If we did make HLog block size configurable, we'd have to provide guidelines
for setting it based on
average key and value length, and the sync interval.
> Test that readers opened after a sync can see all data up to the sync
> ---------------------------------------------------------------------
>
> Key: HBASE-1138
> URL: https://issues.apache.org/jira/browse/HBASE-1138
> Project: Hadoop HBase
> Issue Type: Test
> Components: regionserver, test
> Affects Versions: 0.19.0
> Reporter: Jim Kellerman
> Fix For: 0.19.1, 0.20.0
>
>
> Test that readers opened on a file after it has been synced can see all the
> records prior to the sync.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
