[jira] [Updated] (HBASE-13181) TestHRegionReplayEvents.testReplayBulkLoadEvent fails frequently.

2015-03-10 Thread Matteo Bertozzi (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-13181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matteo Bertozzi updated HBASE-13181:

Status: Patch Available  (was: Reopened)

 TestHRegionReplayEvents.testReplayBulkLoadEvent fails frequently.
 -

 Key: HBASE-13181
 URL: https://issues.apache.org/jira/browse/HBASE-13181
 Project: HBase
  Issue Type: Bug
Reporter: Srikanth Srungarapu
Assignee: Matteo Bertozzi
Priority: Minor
 Attachments: HBASE-13181-v0.patch


 Noticing the test failures frequently on internal test rig:
 {code}
 FAILED:  
 org.apache.hadoop.hbase.regionserver.TestHRegionReplayEvents.testReplayBulkLoadEvent
 Error Message:
 3 exceptions [org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem 
 reading HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/15e393f3-1a5c-45e4-b048-fd647956f1f7,
  org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/9bdfbfb1-8a72-4907-9f91-5570d5accfcd,
  org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/fe63364b-906a-4085-85b6-605aee4d41c2]
 Stack Trace:
 org.apache.hadoop.io.MultipleIOException: 3 exceptions 
 [org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/15e393f3-1a5c-45e4-b048-fd647956f1f7,
  org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/9bdfbfb1-8a72-4907-9f91-5570d5accfcd,
  org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/fe63364b-906a-4085-85b6-605aee4d41c2]
 at 
 org.apache.hadoop.io.MultipleIOException.createIOException(MultipleIOException.java:52)
 at 
 org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:4910)
 at 
 org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:4855)
 at 
 org.apache.hadoop.hbase.regionserver.TestHRegionReplayEvents.testReplayBulkLoadEvent(TestHRegionReplayEvents.java:1159)
 {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-13181) TestHRegionReplayEvents.testReplayBulkLoadEvent fails frequently.

2015-03-10 Thread Matteo Bertozzi (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-13181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matteo Bertozzi updated HBASE-13181:

Attachment: HBASE-13181-v0.patch

The problem is a missing close() of the Output stream.

we are running with hfile.format = v2 by default
and since the size of the v2 file is small (700bytes vs the 4.5k of v3) the 
file doesn't get flushed, so we end up with a 0 byte file that throws the 
corrupted file exception.

 TestHRegionReplayEvents.testReplayBulkLoadEvent fails frequently.
 -

 Key: HBASE-13181
 URL: https://issues.apache.org/jira/browse/HBASE-13181
 Project: HBase
  Issue Type: Bug
Reporter: Srikanth Srungarapu
Assignee: Matteo Bertozzi
Priority: Minor
 Attachments: HBASE-13181-v0.patch


 Noticing the test failures frequently on internal test rig:
 {code}
 FAILED:  
 org.apache.hadoop.hbase.regionserver.TestHRegionReplayEvents.testReplayBulkLoadEvent
 Error Message:
 3 exceptions [org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem 
 reading HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/15e393f3-1a5c-45e4-b048-fd647956f1f7,
  org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/9bdfbfb1-8a72-4907-9f91-5570d5accfcd,
  org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/fe63364b-906a-4085-85b6-605aee4d41c2]
 Stack Trace:
 org.apache.hadoop.io.MultipleIOException: 3 exceptions 
 [org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/15e393f3-1a5c-45e4-b048-fd647956f1f7,
  org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/9bdfbfb1-8a72-4907-9f91-5570d5accfcd,
  org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/fe63364b-906a-4085-85b6-605aee4d41c2]
 at 
 org.apache.hadoop.io.MultipleIOException.createIOException(MultipleIOException.java:52)
 at 
 org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:4910)
 at 
 org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:4855)
 at 
 org.apache.hadoop.hbase.regionserver.TestHRegionReplayEvents.testReplayBulkLoadEvent(TestHRegionReplayEvents.java:1159)
 {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-13181) TestHRegionReplayEvents.testReplayBulkLoadEvent fails frequently.

2015-03-10 Thread Sean Busbey (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-13181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sean Busbey updated HBASE-13181:

   Resolution: Fixed
Fix Version/s: 1.1.0
   2.0.0
   Status: Resolved  (was: Patch Available)

 TestHRegionReplayEvents.testReplayBulkLoadEvent fails frequently.
 -

 Key: HBASE-13181
 URL: https://issues.apache.org/jira/browse/HBASE-13181
 Project: HBase
  Issue Type: Bug
Reporter: Srikanth Srungarapu
Assignee: Matteo Bertozzi
Priority: Minor
 Fix For: 2.0.0, 1.1.0

 Attachments: HBASE-13181-v0.patch, HBASE-13181-v1.patch


 Noticing the test failures frequently on internal test rig:
 {code}
 FAILED:  
 org.apache.hadoop.hbase.regionserver.TestHRegionReplayEvents.testReplayBulkLoadEvent
 Error Message:
 3 exceptions [org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem 
 reading HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/15e393f3-1a5c-45e4-b048-fd647956f1f7,
  org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/9bdfbfb1-8a72-4907-9f91-5570d5accfcd,
  org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/fe63364b-906a-4085-85b6-605aee4d41c2]
 Stack Trace:
 org.apache.hadoop.io.MultipleIOException: 3 exceptions 
 [org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/15e393f3-1a5c-45e4-b048-fd647956f1f7,
  org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/9bdfbfb1-8a72-4907-9f91-5570d5accfcd,
  org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/fe63364b-906a-4085-85b6-605aee4d41c2]
 at 
 org.apache.hadoop.io.MultipleIOException.createIOException(MultipleIOException.java:52)
 at 
 org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:4910)
 at 
 org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:4855)
 at 
 org.apache.hadoop.hbase.regionserver.TestHRegionReplayEvents.testReplayBulkLoadEvent(TestHRegionReplayEvents.java:1159)
 {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-13181) TestHRegionReplayEvents.testReplayBulkLoadEvent fails frequently.

2015-03-10 Thread Sean Busbey (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-13181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Sean Busbey updated HBASE-13181:

Assignee: Matteo Bertozzi  (was: Sean Busbey)

 TestHRegionReplayEvents.testReplayBulkLoadEvent fails frequently.
 -

 Key: HBASE-13181
 URL: https://issues.apache.org/jira/browse/HBASE-13181
 Project: HBase
  Issue Type: Bug
Reporter: Srikanth Srungarapu
Assignee: Matteo Bertozzi
Priority: Minor
 Attachments: HBASE-13181-v0.patch


 Noticing the test failures frequently on internal test rig:
 {code}
 FAILED:  
 org.apache.hadoop.hbase.regionserver.TestHRegionReplayEvents.testReplayBulkLoadEvent
 Error Message:
 3 exceptions [org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem 
 reading HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/15e393f3-1a5c-45e4-b048-fd647956f1f7,
  org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/9bdfbfb1-8a72-4907-9f91-5570d5accfcd,
  org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/fe63364b-906a-4085-85b6-605aee4d41c2]
 Stack Trace:
 org.apache.hadoop.io.MultipleIOException: 3 exceptions 
 [org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/15e393f3-1a5c-45e4-b048-fd647956f1f7,
  org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/9bdfbfb1-8a72-4907-9f91-5570d5accfcd,
  org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/fe63364b-906a-4085-85b6-605aee4d41c2]
 at 
 org.apache.hadoop.io.MultipleIOException.createIOException(MultipleIOException.java:52)
 at 
 org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:4910)
 at 
 org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:4855)
 at 
 org.apache.hadoop.hbase.regionserver.TestHRegionReplayEvents.testReplayBulkLoadEvent(TestHRegionReplayEvents.java:1159)
 {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HBASE-13181) TestHRegionReplayEvents.testReplayBulkLoadEvent fails frequently.

2015-03-10 Thread Matteo Bertozzi (JIRA)

 [ 
https://issues.apache.org/jira/browse/HBASE-13181?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Matteo Bertozzi updated HBASE-13181:

Attachment: HBASE-13181-v1.patch

 TestHRegionReplayEvents.testReplayBulkLoadEvent fails frequently.
 -

 Key: HBASE-13181
 URL: https://issues.apache.org/jira/browse/HBASE-13181
 Project: HBase
  Issue Type: Bug
Reporter: Srikanth Srungarapu
Assignee: Matteo Bertozzi
Priority: Minor
 Attachments: HBASE-13181-v0.patch, HBASE-13181-v1.patch


 Noticing the test failures frequently on internal test rig:
 {code}
 FAILED:  
 org.apache.hadoop.hbase.regionserver.TestHRegionReplayEvents.testReplayBulkLoadEvent
 Error Message:
 3 exceptions [org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem 
 reading HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/15e393f3-1a5c-45e4-b048-fd647956f1f7,
  org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/9bdfbfb1-8a72-4907-9f91-5570d5accfcd,
  org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/fe63364b-906a-4085-85b6-605aee4d41c2]
 Stack Trace:
 org.apache.hadoop.io.MultipleIOException: 3 exceptions 
 [org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/15e393f3-1a5c-45e4-b048-fd647956f1f7,
  org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/9bdfbfb1-8a72-4907-9f91-5570d5accfcd,
  org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading 
 HFile Trailer from file 
 /var/lib/jenkins/workspace/CDH5-HBase-1.0.0/hbase-server/target/test-data/a68c6f22-f578-44d2-b17b-6314ea7f6b97/fe63364b-906a-4085-85b6-605aee4d41c2]
 at 
 org.apache.hadoop.io.MultipleIOException.createIOException(MultipleIOException.java:52)
 at 
 org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:4910)
 at 
 org.apache.hadoop.hbase.regionserver.HRegion.bulkLoadHFiles(HRegion.java:4855)
 at 
 org.apache.hadoop.hbase.regionserver.TestHRegionReplayEvents.testReplayBulkLoadEvent(TestHRegionReplayEvents.java:1159)
 {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)