[
https://issues.apache.org/jira/browse/HBASE-12419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrew Purtell updated HBASE-12419:
-----------------------------------
Description:
We are seeing exceptions like these on the replication sources when replication
is active:
{noformat}
2014-11-04 01:20:19,738 ERROR
[regionserver8120-EventThread.replicationSource,1] codec.BaseDecoder:
Partial cell read caused by EOF: java.io.IOException: Premature EOF from
inputStream
{noformat}
HBase 0.98.8-SNAPSHOT, Hadoop 2.4.1.
Happens both with and without short circuit reads on the source cluster.
I'm able to reproduce this reliably:
# Set up two clusters. Can be single slave.
# Enable replication in configuration
# Use LoadTestTool -init_only on both clusters
# On source cluster via shell: alter
'cluster_test',{NAME=>'test_cf',REPLICATION_SCOPE=>1}
# On source cluster via shell: add_peer 'remote:port:/hbase'
# On source cluster, LoadTestTool -skip_init -write 1:1024:10 -num_keys 1000000
# Wait for LoadTestTool to complete
# Use the shell to verify 1M rows are in 'cluster_test' on the target cluster.
All 1M rows will replicate without data loss, but I'll see 5-15 instances of
"Partial cell read caused by EOF" messages logged from codec.BaseDecoder at
ERROR level on the replication source.
was:
We are seeing exceptions like these on the replication sources when replication
is active:
{noformat}
2014-11-04 01:20:19,738 ERROR
[regionserver8120-EventThread.replicationSource,1] codec.BaseDecoder: Partial
cell read caused by EOF: java.io.IOException: Premature EOF from inputStream
{noformat}
HBase 0.98.8-SNAPSHOT, Hadoop 2.4.1.
Happens both with and without short circuit reads on the source cluster.
I'm able to reproduce this reliably:
# Set up two clusters. Can be single slave.
# Enable replication in configuration
# Use LoadTestTool -init_only on both clusters
# On source cluster via shell: alter
'cluster_test',{NAME=>'test_cf',REPLICATION_SCOPE=>1}
# On source cluster via shell: add_peer 'remote:port:/hbase'
# On source cluster, LoadTestTool -skip_init -write 1:1024:10 -num_keys 1000000
# Wait for LoadTestTool to complete
# Use the shell to verify 1M rows are in 'cluster_test' on the target cluster.
All 1M rows will replicate without data loss, but I'll see 5-15 instances of
"Partial cell read caused by EOF" messages logged from codec.BaseDecoder at
ERROR level on the replication source.
> "Partial cell read caused by EOF" ERRORs on replication source during
> replication
> ---------------------------------------------------------------------------------
>
> Key: HBASE-12419
> URL: https://issues.apache.org/jira/browse/HBASE-12419
> Project: HBase
> Issue Type: Bug
> Affects Versions: 0.98.7
> Reporter: Andrew Purtell
> Fix For: 2.0.0, 0.98.8, 0.99.2
>
>
> We are seeing exceptions like these on the replication sources when
> replication is active:
> {noformat}
> 2014-11-04 01:20:19,738 ERROR
> [regionserver8120-EventThread.replicationSource,1] codec.BaseDecoder:
> Partial cell read caused by EOF: java.io.IOException: Premature EOF from
> inputStream
> {noformat}
> HBase 0.98.8-SNAPSHOT, Hadoop 2.4.1.
> Happens both with and without short circuit reads on the source cluster.
> I'm able to reproduce this reliably:
> # Set up two clusters. Can be single slave.
> # Enable replication in configuration
> # Use LoadTestTool -init_only on both clusters
> # On source cluster via shell: alter
> 'cluster_test',{NAME=>'test_cf',REPLICATION_SCOPE=>1}
> # On source cluster via shell: add_peer 'remote:port:/hbase'
> # On source cluster, LoadTestTool -skip_init -write 1:1024:10 -num_keys
> 1000000
> # Wait for LoadTestTool to complete
> # Use the shell to verify 1M rows are in 'cluster_test' on the target cluster.
> All 1M rows will replicate without data loss, but I'll see 5-15 instances of
> "Partial cell read caused by EOF" messages logged from codec.BaseDecoder at
> ERROR level on the replication source.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
