I 'd say this is the suspect. I'll roll it back. In the apache jenkins these did not happen before this.
-- Lars ________________________________ From: Andrew Purtell <apurt...@apache.org> To: "dev@hbase.apache.org" <dev@hbase.apache.org>; Lars Hofhansl <lhofha...@yahoo.com> Cc: bui...@hbase.apache.org Sent: Sunday, September 8, 2013 2:54 PM Subject: Re: "Column family prefix used twice" (was Re: Build failed in Jenkins: HBase-0.94 #443) A bisect confirmed with a test Jenkins job points to 2b6e4e62b6a1e110b8219e4bf20ee4e20e226b17 is the first bad commit commit 2b6e4e62b6a1e110b8219e4bf20ee4e20e226b17 Author: Lars Hofhansl <la...@apache.org> Date: Wed Sep 4 23:23:51 2013 +0000 HBASE-8930 Filter evaluates KVs outside requested columns (Vasu Mariyala) git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/0.94@152017113f79535-47bb-0310-9956-ffa450edef68 On Sat, Sep 7, 2013 at 12:10 PM, Andrew Purtell <apurt...@apache.org> wrote: > I'm looking into several recent failed 0.94 builds on EC2 Jenkins. Several > of the failures look like this: > > Error Message > > > Column family prefix used twice: cf.cf.bt.Data.fsReadnumops > > > > > > Stacktrace > > > java.lang.AssertionError: Column family prefix used twice: > cf.cf.bt.Data.fsReadnumops > > at > org.apache.hadoop.hbase.regionserver.metrics.SchemaMetrics.validateMetricChanges(SchemaMetrics.java:885) > > at > org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingKeyRange.testScannerSelection(TestScannerSelectionUsingKeyRange.java:125) > > > Running the failing tests locally 100 times in a loop does not reproduce, > I'm only seeing this on the EC2 test slaves. > > At this point I don't know enough to implicate any particular recent > change. Could also be some kind of formerly latent bug. Going to try test > reverts of recent changes. > > I've also increased the build frequency for the EC2 HBase-0.94 job to on > every checkin plus every 4 hours. > > > On Sat, Sep 7, 2013 at 9:20 AM, <apurt...@apache.org> wrote: > >> See <http://jenkins-public.iridiant.net/job/HBase-0.94/443/> >> >> ------------------------------------------ >> [...truncated 7739 lines...] >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.152 sec >> Running >> org.apache.hadoop.hbase.regionserver.TestBatchHRegionLockingAndWrites >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.34 sec >> Running org.apache.hadoop.hbase.regionserver.TestColumnSeeking >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.941 sec >> Running >> org.apache.hadoop.hbase.regionserver.TestMiniBatchOperationInProgress >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.106 sec >> Running org.apache.hadoop.hbase.regionserver.TestCompaction >> Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 52.15 sec >> Running org.apache.hadoop.hbase.regionserver.metrics.TestSchemaConfigured >> Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.084 sec >> Running org.apache.hadoop.hbase.regionserver.TestCompoundBloomFilter >> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.302 sec >> Running org.apache.hadoop.hbase.regionserver.TestCompactSelection >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.063 sec >> Running org.apache.hadoop.hbase.regionserver.TestScanner >> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.683 sec >> Running >> org.apache.hadoop.hbase.regionserver.TestMultiVersionConsistencyControl >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.009 sec >> Running org.apache.hadoop.hbase.regionserver.TestMemStore >> Tests run: 24, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 18.905 >> sec >> Running org.apache.hadoop.hbase.TestHDFSBlocksDistribution >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec >> Running org.apache.hadoop.hbase.TestSerialization >> Tests run: 19, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.072 sec >> Running org.apache.hadoop.hbase.metrics.TestExponentiallyDecayingSample >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec >> Running org.apache.hadoop.hbase.metrics.TestMetricsHistogram >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.023 sec >> Running org.apache.hadoop.hbase.metrics.TestExactCounterMetric >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec >> Running >> org.apache.hadoop.hbase.metrics.file.TestTimeStampingMetricsContext >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.015 sec >> Running org.apache.hadoop.hbase.TestNodeHealthCheckChore >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.054 sec >> Running org.apache.hadoop.hbase.coprocessor.TestRegionObserverStacking >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.062 sec >> Running >> org.apache.hadoop.hbase.coprocessor.TestRegionObserverScannerOpenHook >> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 11.409 sec >> Running org.apache.hadoop.hbase.coprocessor.TestCoprocessorInterface >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.786 sec >> Running org.apache.hadoop.hbase.filter.TestColumnPrefixFilter >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.754 sec >> Running org.apache.hadoop.hbase.filter.TestFuzzyRowFilter >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec >> Running org.apache.hadoop.hbase.filter.TestInclusiveStopFilter >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec >> Running org.apache.hadoop.hbase.filter.TestBitComparator >> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec >> Running org.apache.hadoop.hbase.filter.TestPageFilter >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec >> Running org.apache.hadoop.hbase.filter.TestSingleColumnValueExcludeFilter >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec >> Running org.apache.hadoop.hbase.filter.TestColumnPaginationFilter >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec >> Running org.apache.hadoop.hbase.filter.TestFilterList >> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec >> Running org.apache.hadoop.hbase.filter.TestColumnCountGetFilter >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.077 sec >> Running org.apache.hadoop.hbase.filter.TestRandomRowFilter >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.289 sec >> Running org.apache.hadoop.hbase.filter.TestDependentColumnFilter >> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.142 sec >> Running org.apache.hadoop.hbase.filter.TestParseFilter >> Tests run: 34, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.169 sec >> Running org.apache.hadoop.hbase.filter.TestInvocationRecordFilter >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.03 sec >> Running org.apache.hadoop.hbase.filter.TestMultipleColumnPrefixFilter >> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.082 sec >> Running org.apache.hadoop.hbase.filter.TestFilter >> Tests run: 20, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.305 sec >> Running org.apache.hadoop.hbase.filter.TestSingleColumnValueFilter >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.03 sec >> Running org.apache.hadoop.hbase.filter.TestPrefixFilter >> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0 sec >> Running org.apache.hadoop.hbase.util.TestDynamicClassLoader >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.93 sec >> Running org.apache.hadoop.hbase.util.TestKeying >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec >> Running org.apache.hadoop.hbase.util.TestBytes >> Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.389 sec >> Running org.apache.hadoop.hbase.util.TestByteBufferUtils >> Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.04 sec >> Running org.apache.hadoop.hbase.util.TestThreads >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.008 sec >> Running org.apache.hadoop.hbase.util.TestRegionSplitCalculator >> Tests run: 15, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.085 sec >> Running org.apache.hadoop.hbase.util.TestLoadTestKVGenerator >> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.488 sec >> Running org.apache.hadoop.hbase.util.TestBase64 >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec >> Running org.apache.hadoop.hbase.util.TestByteBloomFilter >> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.717 sec >> Running org.apache.hadoop.hbase.util.TestCompressionTest >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.042 sec >> Running org.apache.hadoop.hbase.util.TestHBaseFsckComparator >> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.029 sec >> Running org.apache.hadoop.hbase.util.TestIncrementingEnvironmentEdge >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec >> Running org.apache.hadoop.hbase.util.TestSortedCopyOnWriteSet >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec >> Running org.apache.hadoop.hbase.util.TestRootPath >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec >> Running org.apache.hadoop.hbase.util.TestHFileArchiveUtil >> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec >> Running org.apache.hadoop.hbase.TestServerName >> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.019 sec >> Running org.apache.hadoop.hbase.io.TestHbaseObjectWritable >> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.062 sec >> Running org.apache.hadoop.hbase.io.TestHalfStoreFileReader >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.065 sec >> Running org.apache.hadoop.hbase.io.TestImmutableBytesWritable >> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec >> Running org.apache.hadoop.hbase.io.TestHeapSize >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec >> Running org.apache.hadoop.hbase.io.encoding.TestBufferedDataBlockEncoder >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 21.544 sec >> Running org.apache.hadoop.hbase.io.encoding.TestEncodedSeekers >> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.483 sec >> Running org.apache.hadoop.hbase.io.hfile.TestCachedBlockQueue >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec >> Running org.apache.hadoop.hbase.io.hfile.TestReseekTo >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.026 sec >> Running org.apache.hadoop.hbase.io.hfile.TestBlockCacheColumnFamilySummary >> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.023 sec >> Running org.apache.hadoop.hbase.io.hfile.TestHFileDataBlockEncoder >> Tests run: 42, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.028 sec >> Running >> org.apache.hadoop.hbase.io.hfile.TestHFileInlineToRootChunkConversion >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 sec >> Running org.apache.hadoop.hbase.io.hfile.slab.TestSlab >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.017 sec >> Running org.apache.hadoop.hbase.io.hfile.TestHFile >> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.114 sec >> Running org.apache.hadoop.hbase.io.hfile.TestSeekTo >> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.052 sec >> Running org.apache.hadoop.hbase.io.hfile.TestHFileWriterV2 >> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.557 sec >> Running org.apache.hadoop.hbase.security.TestUser >> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.049 sec >> Running org.apache.hadoop.hbase.TestHTableDescriptor >> Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec >> Running org.apache.hadoop.hbase.master.TestCatalogJanitor >> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 9.564 sec >> Running org.apache.hadoop.hbase.master.snapshot.TestSnapshotManager >> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.084 sec >> Running org.apache.hadoop.hbase.master.snapshot.TestSnapshotHFileCleaner >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec >> Running org.apache.hadoop.hbase.master.snapshot.TestSnapshotLogCleaner >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec >> Running org.apache.hadoop.hbase.master.cleaner.TestCleanerChore >> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.054 sec >> Running org.apache.hadoop.hbase.master.cleaner.TestHFileLinkCleaner >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 10.015 sec >> Running org.apache.hadoop.hbase.TestHServerAddress >> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.055 sec >> Running org.apache.hadoop.hbase.TestClassFinder >> Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.864 sec >> Running org.apache.hadoop.hbase.mapreduce.hadoopbackport.TestJarFinder >> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.085 sec >> Running org.apache.hadoop.hbase.mapreduce.TestSimpleTotalOrderPartitioner >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec >> Running org.apache.hadoop.hbase.mapreduce.TestTableSplit >> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.011 sec >> Running org.apache.hadoop.hbase.TestHRegionLocation >> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 270.276 >> sec >> Running org.apache.hadoop.hbase.io.hfile.TestHFileReaderV1 >> Tests run: 1, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 270.276 >> sec <<< FAILURE! >> Running org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingKeyRange >> Tests run: 3, Failures: 3, Errors: 0, Skipped: 0, Time elapsed: 270.276 >> sec <<< FAILURE! >> Running org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingTTL >> Tests run: 6, Failures: 6, Errors: 0, Skipped: 0, Time elapsed: 270.276 >> sec <<< FAILURE! >> >> Results : >> >> Failed tests: >> testReadingExistingVersion1HFile(org.apache.hadoop.hbase.io.hfile.TestHFileReaderV1): >> Column family prefix used twice: cf.cf.bt.Data.fsReadnumops >> >> testScannerSelection[0](org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingKeyRange): >> Column family prefix used twice: cf.cf.bt.Data.fsReadnumops >> >> testScannerSelection[1](org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingKeyRange): >> Column family prefix used twice: cf.cf.bt.Data.fsReadnumops >> >> testScannerSelection[2](org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingKeyRange): >> Column family prefix used twice: cf.cf.bt.Data.fsReadnumops >> >> testScannerSelection[0](org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingTTL): >> Column family prefix used twice: cf.cf.bt.Data.fsReadnumops >> >> testScannerSelection[1](org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingTTL): >> Column family prefix used twice: cf.cf.bt.Data.fsReadnumops >> >> testScannerSelection[2](org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingTTL): >> Column family prefix used twice: cf.cf.bt.Data.fsReadnumops >> >> testScannerSelection[3](org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingTTL): >> Column family prefix used twice: cf.cf.bt.Data.fsReadnumops >> >> testScannerSelection[4](org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingTTL): >> Column family prefix used twice: cf.cf.bt.Data.fsReadnumops >> >> testScannerSelection[5](org.apache.hadoop.hbase.io.hfile.TestScannerSelectionUsingTTL): >> Column family prefix used twice: cf.cf.bt.Data.fsReadnumops >> >> Tests run: 693, Failures: 10, Errors: 0, Skipped: 0 >> > -- Best regards, - Andy Problems worthy of attack prove their worth by hitting back. - Piet Hein (via Tom White)
