I looked a bit closer to the numbers. Just for FilteredScanTest for now. Here are the results for the few last versions. Is it possible that something went into 0.98.5 but not into 0.99?
0.98.30.98.40.98.50.98.60.99.00,250,2567,3467,490,63 I will re-run for 0.98.4 and 0.98.6. Numbers for 0.99.0 are already from my 2nd run. JM 2014-09-20 14:28 GMT-04:00 Jean-Marc Spaggiari <[email protected]>: > Sure. I will. I will also update the numbers as soon as I have the new > one. Will also run some other perfs tests to compare with 0.98. > > JM > > 2014-09-20 14:02 GMT-04:00 Enis Söztutar <[email protected]>: > > Agreed. Will be good to fix it in 0.99.1. >> >> On Saturday, September 20, 2014, Stack <[email protected]> wrote: >> >> > JMS file blocker against 0.99.1? >> > Good work boss >> > Stack >> > On Sep 19, 2014 7:00 PM, "Jean-Marc Spaggiari" <[email protected] >> > <javascript:;>> >> > wrote: >> > >> > > Sorry, here is the destination: >> > > >> > > >> > > >> > >> https://docs.google.com/spreadsheets/d/1yo-A-f4tjchdT9R-hkh6CkcXrbBHG_K2Y_ptF9QPT1Q/edit?usp=sharing >> > > >> > > 2014-09-19 21:55 GMT-04:00 Andrew Purtell <[email protected] >> > <javascript:;>>: >> > > >> > > > On Fri, Sep 19, 2014 at 6:44 PM, Jean-Marc Spaggiari >> > > > <[email protected] <javascript:;>> wrote: >> > > > > Results are there: http://tiny.cloudera.com/sjeyn >> > > > >> > > > I get "Access not possible" >> > > > >> > > > On Fri, Sep 19, 2014 at 6:44 PM, Jean-Marc Spaggiari >> > > > <[email protected] <javascript:;>> wrote: >> > > > > UniformRandomReadBenchmark is not working anymore: >> > > > > >> > > > > 2014-09-19 05:18:54,719 INFO [0] >> hbase.HFilePerformanceEvaluation: >> > > > Running >> > > > > UniformRandomReadBenchmark for 1000000 rows. >> > > > > 2014-09-19 05:18:54,719 INFO [0] hfile.CacheConfig: >> > > CacheConfig:disabled >> > > > > Exception in thread "0" java.lang.AssertionError: Expected >> 0000472128 >> > > but >> > > > > got 0000472127 >> > > > > at >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.PerformanceEvaluationCommons.assertKey(PerformanceEvaluationCommons.java:50) >> > > > > at >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.PerformanceEvaluationCommons.assertKey(PerformanceEvaluationCommons.java:45) >> > > > > at >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.HFilePerformanceEvaluation$UniformRandomReadBenchmark.doRow(HFilePerformanceEvaluation.java:295) >> > > > > at >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.HFilePerformanceEvaluation$RowOrientedBenchmark.run(HFilePerformanceEvaluation.java:169) >> > > > > at >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.HFilePerformanceEvaluation.runBenchmark(HFilePerformanceEvaluation.java:121) >> > > > > at >> > > > > >> > > > >> > > >> > >> org.apache.hadoop.hbase.HFilePerformanceEvaluation$2.run(HFilePerformanceEvaluation.java:87) >> > > > > at java.lang.Thread.run(Thread.java:744) >> > > > > >> > > > > Also, on the performance side, I got very strange results. >> > > > > >> > > > > Some tests are as fast as 0.98.6, some are WAY slower... >> > > > > >> > > > > Results are there: http://tiny.cloudera.com/sjeyn I will restart >> the >> > > > tests >> > > > > tomorrow and get new numbers by mid next week. >> > > > > >> > > > > Appart from that, it works. And since it's a dev release, I'm +1 >> with >> > > it. >> > > > > >> > > > > JM >> > > > > >> > > > > 2014-09-19 21:28 GMT-04:00 Andrew Purtell <[email protected] >> > <javascript:;>>: >> > > > > >> > > > >> +1 >> > > > >> >> > > > >> Checked file sums and signature >> > > > >> Unpacked tarball, looked at directory layout >> > > > >> Started up a minicluster in tree, did a quick ingest test, it >> > > succeeded >> > > > >> >> > > > >> >> > > > >> On Tue, Sep 16, 2014 at 1:52 PM, Enis Söztutar <[email protected] >> > <javascript:;>> >> > > wrote: >> > > > >> > I am very happy to say that the second HBase 0.99.0 release >> > > candidate >> > > > >> (RC1) >> > > > >> > is >> > > > >> > available for download at >> > > > >> https://people.apache.org/~enis/hbase-0.99.0RC1/ >> > > > >> > >> > > > >> > Maven artifacts are also available in the temporary repository >> > > > >> > >> > > > >> > https://repository.apache.org/content/repositories/orgapachehbase-1039/ >> > > > >> > >> > > > >> > Signed with my code signing key E964B5FF. Can be found here: >> > > > >> > https://people.apache.org/keys/committer/enis.asc >> > > > >> > >> > > > >> > Signed tag in the repository can be found here: >> > > > >> > >> > > > >> >> > > > >> > > >> > >> https://git-wip-us.apache.org/repos/asf?p=hbase.git;a=tag;h=336a63b5f58bb1c4859e3c2b6a2f5c0d68a7d9e1 >> > > > >> > >> > > > >> > NOTE IN GIGANTIC LETTERS THAT THIS IS A DEVELOPER RELEASE. >> > > > >> > DO NOT USE THIS RELEASE IN PRODUCTION. >> > > > >> > >> > > > >> > HBase 0.99.0 is a "developer preview" release, and an >> odd-numbered >> > > > >> release >> > > > >> > as >> > > > >> > defined in >> > > > >> https://hbase.apache.org/book/upgrading.html#hbase.versioning. >> > > > >> > This release IS NOT intended for production use, and does not >> > > contain >> > > > any >> > > > >> > backwards or forwards compatibility guarantees (even within >> minor >> > > > >> versions >> > > > >> > 0.99.x). Please refrain from deploying this over important >> data. >> > > > >> > >> > > > >> > 0.99.0 release is provided from branch-1, which will be the >> basis >> > > for >> > > > >> > HBase-1.0 >> > > > >> > release. A few 0.99.x releases are planned before 1.0. The >> reason >> > > for >> > > > >> > doing a developer preview release is to get more testing for >> the >> > > > branch-1 >> > > > >> > code >> > > > >> > that will be released soon as HBase-1.0.0. Thus, all >> contribution >> > in >> > > > >> terms >> > > > >> > of >> > > > >> > testing, benchmarking, checking API / source /wire >> compatibility, >> > > > >> checking >> > > > >> > out >> > > > >> > documentation and further code contribution is highly >> appreciated. >> > > 1.0 >> > > > >> will >> > > > >> > be >> > > > >> > the first series in the 1.x line of releases which are >> expected to >> > > > keep >> > > > >> > compatibility with previous 1.x releases. Thus it is very >> > important >> > > to >> > > > >> > check >> > > > >> > the client side and server side APIs for compatibility and >> > > > >> maintainability >> > > > >> > concerns for future releases. >> > > > >> > >> > > > >> > 0.99.0 contains slightly more than 1K issues resolved with many >> > > > >> > improvements >> > > > >> > and bug fixes. The theme of (eventual) 1.0 release is to >> become a >> > > > stable >> > > > >> > base >> > > > >> > for future 1.x series of releases. 1.0 release will aim to >> achieve >> > > at >> > > > >> least >> > > > >> > the same level of stability of 0.98 releases without >> introducing >> > too >> > > > many >> > > > >> > new >> > > > >> > features. >> > > > >> > >> > > > >> > Some work has been under way to clearly mark and differentiate >> > > client >> > > > >> > facing >> > > > >> > APIs, and redefine some of the client interfaces for improving >> > > > semantics, >> > > > >> > easy >> > > > >> > of use and maintainability. 0.99.0 contains some of the >> completed >> > > > items, >> > > > >> > and >> > > > >> > the rest can be found HBASE-10602. Marking/remarking of >> interfaces >> > > > with >> > > > >> > InterfaceAudience has also been going on, which will identify >> > areas >> > > > for >> > > > >> > compatibility (with clients, coprocessors and dependent >> projects >> > > like >> > > > >> > Phoenix) >> > > > >> > for future releases. >> > > > >> > >> > > > >> > Starting with 0.99.0, the HBase master server and backup master >> > > > servers >> > > > >> > will >> > > > >> > also act as a region server. RPC port and info port for web UI >> is >> > > > shared >> > > > >> > for >> > > > >> > the master and region server roles. Active master and backup >> > masters >> > > > by >> > > > >> > default >> > > > >> > will NOT be hosting any regions unless configured otherwise. >> See >> > > > >> > HBASE-10569 >> > > > >> > and HBASE-11604 for more details. >> > > > >> > >> > > > >> > This release contains Phase 1 items for experimental "Read >> > > > availability >> > > > >> > using >> > > > >> > timeline consistent region replicas" feature. A region can be >> > hosted >> > > > in >> > > > >> > multiple region servers in read-only mode. One of the replicas >> for >> > > the >> > > > >> > region >> > > > >> > will be primary, accepting writes, and other replicas will be >> > > sharing >> > > > the >> > > > >> > same >> > > > >> > data files. Read requests can be done against any replica for >> the >> > > > region >> > > > >> > with >> > > > >> > backup RPCs for high availability with timeline consistency >> > > > guarantees. >> > > > >> > More >> > > > >> > information can be found at HBASE-10070. >> > > > >> > >> > > > >> > Other notable improvements in this release are >> > > > >> > - Automatic tuning of global memstore and block cache sizes >> > > > >> > - Various security, tags and visibility labels improvements >> > > > >> > - Bucket cache improvements (usability and compressed data >> > blocks) >> > > > >> > - A new pluggable replication endpoint to plug in to HBase's >> > > > >> inter-cluster >> > > > >> > replication to replicate to a custom data store >> > > > >> > - A Dockerfile to easily build and run HBase from source >> > > > >> > - Internal refactoring for abstracting away zookeeper usage >> > > > >> > - Truncate table command >> > > > >> > - Region assignment to use hbase:meta table instead of >> zookeeper >> > > for >> > > > >> faster >> > > > >> > region assignment (disabled by default) >> > > > >> > - Better support for Cell interface internally in read and >> write >> > > > paths >> > > > >> for >> > > > >> > better performance and flexibility >> > > > >> > - Combining internal mvcc and seqId infrastructure >> > > > >> > - Extensive documentation improvements >> > > > >> > - Numerous improvements in other areas and bug fixes. >> > > > >> > >> > > > >> > The release has these changes in default behaviour: >> > > > >> > - hfile version 3 has been enabled by default >> > > > >> > - Distributed log replay has been enabled by default >> > > > >> > - Slab cache has been removed (use bucket cache instead) >> > > > >> > - Some client facing APIs (HTableInterface, etc) has been >> > > deprecated >> > > > and >> > > > >> > replaced. >> > > > >> > >> > > > >> > We have also adopted an orca as the mascot for Apache HBase. >> See >> > it >> > > at >> > > > >> > https://hbase.apache.org/ >> > > > >> > >> > > > >> > Thanks for everybody who have contributed to this release. Full >> > list >> > > > of >> > > > >> the >> > > > >> > issues >> > > > >> > can be found here: >> > > > >> > >> > > > >> >> > > > >> > > >> > >> https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12310753&version=12325675 >> > > > >> > >> > > > >> > >> > > > >> > Compatibility >> > > > >> > ------------- >> > > > >> > 0.99.x series of releases are preview of upcoming 1.0 release. >> > > > HBase-1.0 >> > > > >> is >> > > > >> > planned to be wire compatible with 0.98.x and 0.96.x releases. >> > > Clients >> > > > >> and >> > > > >> > servers running in different versions as long as new features >> are >> > > not >> > > > >> used >> > > > >> > should be possible. >> > > > >> > A rolling upgrade from 0.98.x clusters to 0.99.0 is supported >> as >> > > well. >> > > > >> > 0.99.0 >> > > > >> > introduces a new file format (hfile v3) that is enabled by >> default >> > > > that >> > > > >> > 0.96.x code cannot read. Rolling upgrade from 0.96 directly to >> > 0.99 >> > > is >> > > > >> not >> > > > >> > tested. >> > > > >> > >> > > > >> > Direct migration from 0.94.x is also supported but it IS NOT >> > tested. >> > > > >> Before >> > > > >> > HBase-1.0 we expect to complete the test. >> > > > >> > >> > > > >> > Binary compatibility at the Java API layer with earlier >> versions >> > > > (0.98.x, >> > > > >> > 0.96.x and 0.94.x) is not supported. You may have to recompile >> > your >> > > > >> client >> > > > >> > code and any server side code (coprocessors, filters etc) >> > referring >> > > to >> > > > >> > hbase jars. >> > > > >> > >> > > > >> > 0.99.0 release introduces new APIs, and deprecates some of >> > > > commonly-used >> > > > >> > client side APIs (HTableInterface, etc). However, client side >> code >> > > is >> > > > >> > expected >> > > > >> > to be source compatible with earlier versions. However we >> advise >> > to >> > > > >> update >> > > > >> > your application to use the new style of APIs, since deprecated >> > APIs >> > > > >> might >> > > > >> > be removed in future releases (2.x). >> > > > >> > >> > > > >> > >> > > > >> > Supported Hadoop versions >> > > > >> > ------------------------- >> > > > >> > 0.99.0 release drops support for Hadoop-1.x releases. Only >> > > Hadoop-2.x >> > > > >> > releases are supported. Hadoop-2.4.x and Hadoop-2.5.x releases >> are >> > > the >> > > > >> > most tested hadoop releases and we recommend running with those >> > > > versions. >> > > > >> > Earlier Hadoop-2 based releases (hadoop-2.2.x and 2.3.x) are >> not >> > > > tested >> > > > >> to >> > > > >> > the full >> > > > >> > extend. More information can be found here: >> > > > >> > https://hbase.apache.org/book/configuration.html#hadoop >> > > > >> > >> > > > >> > >> > > > >> > Supported Java versions >> > > > >> > ------------------------- >> > > > >> > 0.99.0 release drops support for JDK6. Only JDK7 is supported. >> > JDK8 >> > > > >> support >> > > > >> > is experimental. More information can be found here: >> > > > >> > https://hbase.apache.org/book/configuration.html#java >> > > > >> > >> > > > >> > >> > > > >> > Voting >> > > > >> > ------ >> > > > >> > Please try to test and vote on this release by 09/19/2014 >> 11:59PM >> > > PDT. >> > > > >> > This is a developer (beta) release, so we have a shorter vote >> > time. >> > > > >> > >> > > > >> > [] +1 Release the artifacts as 0.99.0 >> > > > >> > [] -1 DO NOT release the artifacts as 0.99.0, because... >> > > > >> > >> > > > >> > Thanks for helping to get a stable release out! >> > > > >> > >> > > > >> > Enis >> > > > >> >> > > > >> >> > > > >> >> > > > >> -- >> > > > >> Best regards, >> > > > >> >> > > > >> - Andy >> > > > >> >> > > > >> Problems worthy of attack prove their worth by hitting back. - >> Piet >> > > > >> Hein (via Tom White) >> > > > >> >> > > > >> > > > >> > > > >> > > > -- >> > > > Best regards, >> > > > >> > > > - Andy >> > > > >> > > > Problems worthy of attack prove their worth by hitting back. - Piet >> > > > Hein (via Tom White) >> > > > >> > > >> > >> > >
