+1, against both regular and -security:
- verified md5
- compiles
- started/stopped in local mode
- created, inserted into, scanned, dropped table in shell
- compiled and tested against Phoenix master
-------------------
Jesse Yates
@jesse_yates
jyates.github.com
On Sun, Dec 22, 2013 at 7:35 PM, Anoop John <anoop.hb...@gmail.com> wrote:
> +1
> Downloaded and verified the signature.
> Created one table put some data and read back..
> Some random commands executed from shell...
> Run PE in sequential write and read modes ...
> All look good.
>
> -Anoop-
>
> On Fri, Dec 20, 2013 at 5:53 PM, Jean-Marc Spaggiari <
> jean-m...@spaggiari.org> wrote:
>
> > I agree. Nothing new with this release.
> >
> > For the disks space, I have 370GB on the drive where the test is running
> > and 20GB in the tmp folder. I monitored that over the process and it used
> > only 1GB on both disks. So I don't think it's space related. That's
> strange
> > because I tried on 2 deferent config (hardware, os, etc.) and both times
> > got the same result. I will retry on a 3rd computer to validate.
> >
> >
> > 2013/12/19 lars hofhansl <la...@apache.org>
> >
> > > Thanks again, JM.
> > >
> > >
> > > Yep, both IntegrationTestLoadAndVerify and IntegrationTestBigLinkedList
> > > pass for me in local install every time I run it (many times by now).
> JDK
> > > 1.6.0_34-b04.
> > >
> > > One thing I found is that they do not clean up their data and fill up
> the
> > > disk, once the disk is full the tests simply time out for me, but they
> > > could fail in more "interesting ways" too when that happens... Maybe
> > that's
> > > what you see?
> > >
> > >
> > > In any case nothing new with this release, right? Need to double-check
> > the
> > > tests.
> > >
> > > -- Lars
> > >
> > >
> > >
> > > ----- Original Message -----
> > > From: Jean-Marc Spaggiari <jean-m...@spaggiari.org>
> > > To: lars hofhansl <la...@apache.org>; dev <dev@hbase.apache.org>
> > > Cc:
> > > Sent: Thursday, December 19, 2013 10:45 AM
> > > Subject: Re: [VOTE] The 1st hbase 0.94.15 release candidate is
> available
> > > for download
> > >
> > > For the version, issue is the alter command I used. Sorry about that.
> > > Forget it.
> > >
> > > For IntegrationTestLoadAndVerify I have already reported the issue with
> > > 0.94.10 on July 23rd.
> > >
> > > Just retried with 0.94.14 and 0.94.13 and failed on both too. By
> failed I
> > > mean they give me REFERENCES_CHECKED=9855773 instead of a 100000000.
> Are
> > > you getting 100000000?
> > >
> > > Single node it a local install on my laptop. No other HBase instances
> > > configured, using local file system. For the 7 node cluster it's using
> > > Hadoop 1.0.4
> > >
> > > In local mode I'm running with jdk 1.6.0_45. On the 7 nodes I'm running
> > > 1.7.0_5
> > >
> > > What's strange with the abstract issue is that IntegrationTestsDriver
> is
> > > not the only one using ToolRunner, but is the only one to fail.
> Strange.
> > >
> > > JM
> > >
> > >
> > >
> > > 2013/12/19 lars hofhansl <la...@apache.org>
> > >
> > > > The single node cluster was just a local install, right? I.e. using
> the
> > > > local file system, rather than HDFS...?
> > > > On the 7 node cluster, which version of HDFS did you use? If not
> 1.0.4
> > I
> > > > assume you recompiled HBase :)
> > > >
> > > > I definitely do not see the AbstractMethodError issue. That very
> looks
> > > > like a classpath setup issue.
> > > >
> > > > Ran IntegrationTestLoadAndVerify and IntegrationTestBigLinkedList in
> a
> > > > loop in local mode. Didn't fail once.
> > > >
> > > > Let's chat offline and figure out if/where your setup is different
> from
> > > > mine.
> > > >
> > > > -- Lars
> > > >
> > > > ________________________________
> > > > From: lars hofhansl <la...@apache.org>
> > > > To: Jean-Marc Spaggiari <jean-m...@spaggiari.org>; dev <
> > > > dev@hbase.apache.org>
> > > > Sent: Thursday, December 19, 2013 8:53 AM
> > > > Subject: Re: [VOTE] The 1st hbase 0.94.15 release candidate is
> > available
> > > > for download
> > > >
> > > >
> > > > Thanks JM.
> > > >
> > > >
> > > > You did a "raw" scan below. It'll return to you exactly what is
> there,
> > so
> > > > you'll see the 3 versions before you compact, that is by design.
> > > > java.lang.AbstractMethodError looks like an issue local to your
> > install.
> > > > I'll check.
> > > >
> > > >
> > > > IntegrationTestLoadAndVerify is interesting. Did that pass reliably
> in
> > > > older releases of 0.94 (0.94.14 or 0.94.13)?
> > > >
> > > > -- Lars
> > > >
> > > >
> > > > ________________________________
> > > >
> > > > From: Jean-Marc Spaggiari <jean-m...@spaggiari.org>
> > > > To: dev <dev@hbase.apache.org>; lars hofhansl <la...@apache.org>
> > > > Sent: Thursday, December 19, 2013 7:01 AM
> > > > Subject: Re: [VOTE] The 1st hbase 0.94.15 release candidate is
> > available
> > > > for download
> > > >
> > > >
> > > >
> > > > tl;tr see arrow below.
> > > >
> > > >
> > > >
> > > > Downloaded and checked signature for bother vanilla and secured.
> > Passed.
> > > > Random checked documentation and CHANGES.txt. Passed
> > > >
> > > >
> > > > On a single node cluster:
> > > > Ran the tests. All passed.
> > > > Ran IntegrationTestLoadAndVerify. Got REFERENCES_CHECKED=9855424,
> > > > expected 10000000? Failed?
> > > > Ran IntegrationTestBigLinkedList. Passed.
> > > > Ran HBCK after those tests and got many errors about
> > _original-evil-name
> > > > and clone tables.
> > > > Cleared everything, restarted HBase. Re-ran
> > IntegrationTestBigLinkedList,
> > > > HBCK ok. Re-ran IntegrationTestLoadAndVerify, failed again:
> > > > 13/12/18 21:24:24 ERROR test.IntegrationTestBigLinkedList$Verify:
> > > Expected
> > > > referenced count does not match with actual referenced count.
> expected
> > > > referenced=3000000 ,actual=9000000
> > > > Exception in thread "main" java.lang.RuntimeException: Verify.verify
> > > failed
> > > > at
> > > >
> > >
> >
> org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList$Loop.runVerify(IntegrationTestBigLinkedList.java:724)
> > > > at
> > > >
> > >
> >
> org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList$Loop.run(IntegrationTestBigLinkedList.java:757)
> > > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> > > > at
> > > >
> > >
> >
> org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList.run(IntegrationTestBigLinkedList.java:1069)
> > > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> > > > at
> > > >
> > >
> >
> org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList.main(IntegrationTestBigLinkedList.java:1073)
> > > >
> > > > But now HBCK is clean. Figured that HBCK issue is because of some
> > > leftover
> > > > from org.apache.hadoop.hbase.regionserver.TestStoreFile who is
> writting
> > > in
> > > > the same directory as the default standalone HBase.
> > > >
> > > > From the shell, create a table 15 regions, put, compact, scan, etc.
> > Table
> > > > definition is VERSIONS => 2. However, scan 't1', {RAW => true,
> VERSIONS
> > > =>
> > > > 10} still return 3 versions even after flush/compact/major_compact:
> > > > hbase(main):034:0> scan 't1', {RAW => true, VERSIONS => 10}
> > > > ROW
> > > > COLUMN+CELL
> > > > rowkey
> column=f1:c1,
> > > > timestamp=1387421969489,
> > > > value=value
> > > > rowkey
> column=f1:c1,
> > > > timestamp=1387421969337,
> > > > value=value
> > > > rowkey
> column=f1:c1,
> > > > timestamp=1387421969162,
> > > > value=value
> > > > 1 row(s) in 0.0570 seconds
> > > >
> > > > Will have expected only 2 to be return.
> > > >
> > > >
> > > >
> > > > Stopped HBase, checked the log, everything is fine.
> > > >
> > > >
> > > > Now on a 7 nodes cluster:
> > > >
> > > > Deployed jars and did rolling restart on a 0.94.14 cluster. Passed.
> > > >
> > > > Configured default balancer, merged a 60 region table to a single
> > region,
> > > > restarted the cluster, all fine.
> > > >
> > > > major_compact the table to get it split into 60 regions, balancer,
> all
> > > > fine except that balancer need to be run twice to get correct
> > balancing.
> > > >
> > > > Some "No serialized HRegionInfo in keyvalues" in the logs not related
> > to
> > > > the tables I'm "playing" with.
> > > >
> > > > Restored customized balancer, restarted, rebalanced, all fine.
> > > > Ran IntegrationTestLoadAndVerify. Got REFERENCES_CHECKED=9855645,
> > > > expected 10000000? Failed?
> > > >
> > > > Ran IntegrationTestBigLinkedList. Passed.
> > > >
> > > >
> > > > Last, I tried to run IntegrationTestsDriver but it failed. I need to
> > look
> > > > at that.
> > > >
> > > > hbase@node3:~/hbase-0.94.3$ bin/hbase
> > > > org.apache.hadoop.hbase.IntegrationTestsDriver
> > > > Exception in thread "main" java.lang.AbstractMethodError:
> > > > org.apache.hadoop.hbase.util.AbstractHBaseTool.doWork()V
> > > > at
> > > >
> > >
> >
> org.apache.hadoop.hbase.util.AbstractHBaseTool.run(AbstractHBaseTool.java:103)
> > > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> > > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> > > > at
> > > >
> > >
> >
> org.apache.hadoop.hbase.IntegrationTestsDriver.main(IntegrationTestsDriver.java:47)
> > > >
> > > >
> > > >
> > > >
> > > > =====> tl;tr:
> > > >
> > > > - Small issue with balancer when 60 regions assigned to a single
> > server.
> > > > Need to run twice to get that correctly balanced;
> > > >
> > > > - Leftover in the wrong place from
> > > > org.apache.hadoop.hbase.regionserver.TestStoreFile;
> > > > - Table with VERSIONS => 2 returns 3 versions instead of 2;
> > > > - IntegrationTestsDriver not running.
> > > >
> > > >
> > > > I don't think there is anything here to stop the release but there is
> > > > still few things that need to be looked at.
> > > >
> > > >
> > > > JM
> > > >
> > > >
> > > >
> > > >
> > > > 2013/12/18 lars hofhansl <la...@apache.org>
> > > >
> > > > The 1st 0.94.15 RC is available for download at
> > > > http://people.apache.org/~larsh/hbase-0.94.15-rc0/
> > > > >Signed with my code signing key: C7CFE328
> > > > >
> > > > >HBase 0.94.15 is a bug fix release along with some performance
> > > > improvements:
> > > > > [HBASE-7886] - [replication] hlog zk node will not be deleted if
> > > > client roll hlog
> > > > > [HBASE-9485] - TableOutputCommitter should implement recovery if
> > we
> > > > don't want jobs to start from 0 on RM restart
> > > > > [HBASE-9995] - Not stopping ReplicationSink when using custom
> > > > implementation for the ReplicationSink
> > > > > [HBASE-10014] - HRegion#doMiniBatchMutation rollbacks the
> memstore
> > > > even if there is nothing to rollback.
> > > > > [HBASE-10015] - Replace intrinsic locking with explicit locks in
> > > > StoreScanner
> > > > > [HBASE-10026] - HBaseAdmin#createTable could fail if region
> splits
> > > > too fast
> > > > > [HBASE-10046] - Unmonitored HBase service could accumulate
> Status
> > > > objects and OOM
> > > > > [HBASE-10057] - TestRestoreFlushSnapshotFromClient and
> > > > TestRestoreSnapshotFromClient fail to finish occasionally
> > > > > [HBASE-10061] - TableMapReduceUtil.findOrCreateJar calls
> > > > updateMap(null, ) resulting in thrown NPE
> > > > > [HBASE-10064] - AggregateClient.validateParameters can throw NPE
> > > > > [HBASE-10089] - Metrics intern table names cause eventual
> permgen
> > > OOM
> > > > in 0.94
> > > > > [HBASE-10111] - Verify that a snapshot is not corrupted before
> > > > restoring it
> > > > > [HBASE-10112] - Hbase rest query params for maxVersions and
> > > maxValues
> > > > are not parsed
> > > > > [HBASE-10117] - Avoid synchronization in
> > > > HRegionScannerImpl.isFilterDone
> > > > > [HBASE-10120] - start-hbase.sh doesn't respect --config in
> > > > non-distributed mode
> > > > > [HBASE-10179] - HRegionServer underreports readRequestCounts by
> 1
> > > > under certain conditions
> > > > > [HBASE-10181] - HBaseObjectWritable.readObject catches
> > > > DoNotRetryIOException and wraps it back in a regular IOException
> > > > > [HBASE-9931] - Optional setBatch for CopyTable to copy large
> rows
> > in
> > > > batches
> > > > > [HBASE-10001] - Add a coprocessor to help testing the
> performances
> > > > without taking into account the i/o
> > > > > [HBASE-10007] - PerformanceEvaluation: Add sampling and latency
> > > > collection to randomRead test
> > > > > [HBASE-10010] - eliminate the put latency spike on the new log
> > file
> > > > beginning
> > > > > [HBASE-10048] - Add hlog number metric in regionserver
> > > > > [HBASE-10049] - Small improvments in region_mover.rb
> > > > > [HBASE-10093] - Unregister ReplicationSource metric bean when
> the
> > > > replication source thread is terminated
> > > > > [HBASE-9047] - Tool to handle finishing replication when the
> > cluster
> > > > is offline
> > > > > [HBASE-10119] - Allow HBase coprocessors to clean up when they
> > fail
> > > > > [HBASE-9927] - ReplicationLogCleaner#stop() calls
> > > > HConnectionManager#deleteConnection() unnecessarily
> > > > > [HBASE-9986] - Incorporate HTTPS support for HBase (0.94 port)
> > > > > [HBASE-10058] - Test for HBASE-9915 (avoid reading index blocks)
> > > > > [HBASE-10189] - Intermittent TestReplicationSyncUpTool failure
> > > > >
> > > > >The list of changes is also available here:
> > > >
> > >
> >
> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325559
> > > > >
> > > > >Here're the jenkins runs for this RC:
> > > > https://builds.apache.org/job/HBase-0.94.15/2/ and
> > > > https://builds.apache.org/job/HBase-0.94.15-security/1/
> > > > >
> > > > >Please try out the RC, check out the doc, take it for a spin, etc,
> and
> > > > vote +1/-1 by EOD December 27th on whether we should release this as
> > > > 0.94.15. (9 days because of the holidays)
> > > > >
> > > > >Thanks.
> > > > >
> > > > >-- Lars
> > > > >
> > > >
> > >
> > >
> >
>
