Re: Testing and CI -- Apache Jenkins Builds

2015-08-19 Thread Stack
https://issues.apache.org/jira/browse/BUILDS-109 St.Ack On Wed, Aug 19, 2015 at 5:38 PM, Stack wrote: > On Wed, Aug 19, 2015 at 5:24 PM, Stack wrote: > >> On Wed, Aug 19, 2015 at 5:08 PM, Sean Busbey wrote: >> >>> I don't recall anything, but I'll go dig t

Re: Testing and CI -- Apache Jenkins Builds

2015-08-20 Thread Stack
On Wed, Aug 19, 2015 at 6:18 PM, Stack wrote: > https://issues.apache.org/jira/browse/BUILDS-109 > This became https://issues.apache.org/jira/browse/INFRA-10150 which becomes BUILDS-111. Errant left-over java processes sucking up resources. Trunk is particularly susceptible because we s

Re: DISCUSSION: lets do a developer workshop on near-term work

2015-08-20 Thread Stack
ng here on this thread and to the meetup page just before the meeting starts. St.Ack > On Wed, Aug 12, 2015 at 3:29 PM, Stack wrote: > > > I posted this meetup notice: > > http://www.meetup.com/hackathon/events/224589819/ > > St.Ack > > > > On Wed, Aug 12, 2015

Re: [DISCUSS] retiring current DLR code

2015-08-21 Thread Stack
DLR is a good idea. We need it. It helps with our MTTR. +1 though on pulling the current DLR. Perhaps the current set of issues could be fixed with some concentrated dev but even then, I'd be wary turning it on. It is hard to track, distributed all over the code base, and it extends a foundation t

Re: Testing and CI -- Apache Jenkins Builds

2015-08-21 Thread Stack
. St.Ack On Thu, Aug 20, 2015 at 9:44 AM, Stack wrote: > On Wed, Aug 19, 2015 at 6:18 PM, Stack wrote: > >> https://issues.apache.org/jira/browse/BUILDS-109 >> > > This became https://issues.apache.org/jira/browse/INFRA-10150 which > becomes BUILDS-111. > >

Re: Question on hbase.client.scanner.timeout.period

2015-08-24 Thread Stack
On Mon, Aug 24, 2015 at 4:48 PM, Eric Owhadi wrote: > Hello everyone, > We have been facing a situation on trafodion, where we are hitting the > hbase.client.scanner.timeout.period scenario: > basically, when doing queries that require spilling to disk because of high > complexity of what is invo

Notes from last nights HBase Dev Workshop

2015-08-27 Thread Stack
See here for notes on what we discussed last night at the dev workshop: https://docs.google.com/document/d/12ck4lXR1NYzNr2EN2-6l2MbLuGOejv8gyVG96SQ5Zq4/edit?usp=sharing Thanks to all those who showed up, St.Ack

Proposal: Matteo for 2.0.0 RM

2015-08-27 Thread Stack
Last night at the HBase dev workshop, during discussion of 2.0.0 (what will be in it, when will it come out), it was noted that there is as yet no RM for hbase-2.0.0. A bunch of us suggested Matteo and he was up for it. Folks good with that? Anyone else interested in being RM? +1 on Matteo from

Re: Question on hbase.client.scanner.timeout.period

2015-08-27 Thread Stack
on is still open? > > Best regards, > Eric Owhadi > > > > -Original Message- > From: saint@gmail.com [mailto:saint@gmail.com] On Behalf Of Stack > Sent: Monday, August 24, 2015 11:07 PM > To: HBase Dev List > Subject: Re: Question on hbase.client.scanner

Re: Question on hbase.client.scanner.timeout.period

2015-08-27 Thread Stack
gt; Eric > > > > -Original Message- > From: saint@gmail.com [mailto:saint@gmail.com] On Behalf Of Stack > Sent: Thursday, August 27, 2015 3:23 PM > To: HBase Dev List > Subject: Re: Question on hbase.client.scanner.timeout.period > > On Tue, Aug 25, 2015

Re: Notes from last nights HBase Dev Workshop

2015-08-27 Thread Stack
EXTRA! EXTRA! Ram and Anoop sent in this status on offheaping/cellify-ing the read-path: https://drive.google.com/file/d/0B4a3E58mCyOfc2s1MUg0eTlTeWxXOWVCZ25pcVN5R3lJZzl3/view?usp=sharing On Thu, Aug 27, 2015 at 10:19 AM, Stack wrote: > See here for notes on what we discussed last night at

Re: Question on hbase.client.scanner.timeout.period

2015-08-28 Thread Stack
. Is is easy to insert your T*ClientScanner? St.Ack > Regards, > Eric > > -Original Message- > From: saint@gmail.com [mailto:saint@gmail.com] On Behalf Of Stack > Sent: Thursday, August 27, 2015 3:55 PM > To: HBase Dev List > Subject: Re: Question on hbase.cl

Re: Testing and CI -- Apache Jenkins Builds

2015-08-31 Thread Stack
ds (rather than the > shared > > one with the jenkins user). > > > > submitted patches are still applied and run against their branch (default > > master). > > > > Once I have a coherent patch I'll post it to HBASE-14337 and we can stop > &

Re: Testing and CI -- Apache Jenkins Builds

2015-09-04 Thread Stack
y is pulled down each time and shows us its contents in the event > that things fail. > > On Mon, Aug 31, 2015 at 11:17 AM, Stack wrote: > > > Thanks Sean. That seems to get us going again. I pushed Anoops > HBASE-13158 > > and its running. > > St.Ack > > > &g

Re: Question on hbase.client.scanner.timeout.period

2015-09-05 Thread Stack
Smile. Excellent. You have a patch for us then Eric? Sounds like the interjection of your new Scanner would be for pre-2.0. For 2.0 we should just turn on this behavior as the default. Thanks, St.Ack > Eric Owhadi > > -Original Message- > From: saint@gmail.com [mailto:s

Re: Performance degradation between CDH5.3.1(HBase0.98.6) and CDH5.4.5(HBase1.0.0)

2015-09-08 Thread Stack
On Tue, Sep 8, 2015 at 10:22 PM, 鈴木俊裕 wrote: > Ted, > > Thank you for your response. > > I uploaded the complete stack trace to Gist. > > https://gist.github.com/brfrn169/cb4f2c157129330cd932 > > > I think that increment operation works as fo

Re: Question on hbase.client.scanner.timeout.period

2015-09-10 Thread Stack
d of case Your proposal > sounds like a good alternative approach as well. > We should add that JIRA to the blog link Stack mentioned. > > Jerry > > On Sat, Sep 5, 2015 at 9:07 AM, Stack wrote: > > > On Fri, Sep 4, 2015 at 5:06 PM, Eric Owhadi > wrote: > > > &

Re: Testing and CI -- Apache Jenkins Builds

2015-09-10 Thread Stack
I removed H5 and H6 from rotation. They can't find mvn. St.Ack On Fri, Sep 4, 2015 at 10:42 AM, Stack wrote: > You the man Sean! > > For those following along, this fail looks like this in the logs: > > "Error invoking method 'get(java.lang.Integer)' i

Re: Question on hbase.client.scanner.timeout.period

2015-09-10 Thread Stack
la jira as you suggested. > Except if you think I should rush on 2.0 to make sure it makes it to any > future official Hbase distro shipping with 2.0? > > Eric > > > -Original Message- > From: saint@gmail.com [mailto:saint@gmail.com] On Behalf Of Stack > Sent:

Re: Question on hbase.client.scanner.timeout.period

2015-09-10 Thread Stack
rry. Wasn't implying you'd do distro fixes. Didn't mean to confuse. Above sounds good. St.Ack > Eric > > -Original Message- > From: saint@gmail.com [mailto:saint@gmail.com] On Behalf Of Stack > Sent: Thursday, September 10, 2015 5:49 PM > To: HBas

Re: Performance degradation between CDH5.3.1(HBase0.98.6) and CDH5.4.5(HBase1.0.0)

2015-09-12 Thread Stack
gt; possible that all these threads are trying to get to the same row to > update > > it? Could the app behavior have changed? Or are you thinking increment > > itself has slowed significantly? > We have just upgraded HBase, not changed the app behavior. We are thinking > in

Re: Testing and CI -- Apache Jenkins Builds

2015-09-14 Thread Stack
Removed H4. It's forgotten where mvn is. Will try to talk to infra about getting this fixed on !H0 && !H10 && !H2 && !H6 && !H5 && !H4 St.Ack On Thu, Sep 10, 2015 at 3:09 PM, Stack wrote: > I removed H5 and H6 from rotation. They can't f

Re: Testing and CI -- Apache Jenkins Builds

2015-09-15 Thread Stack
Filed https://issues.apache.org/jira/browse/INFRA-10429 on missing mvn. St.Ack On Mon, Sep 14, 2015 at 7:42 PM, Stack wrote: > Removed H4. It's forgotten where mvn is. > > Will try to talk to infra about getting this fixed on !H0 && !H10 && !H2 > && !H6

Re: Testing and CI -- Apache Jenkins Builds

2015-09-15 Thread Stack
or H10 > or H11 at the moment. > > (I also fixed a bug where we wouldn't fail the build if test-patch failed > but we were then able to properly list the problematic javax-inject > dependency files in our local repo.) > > On Tue, Sep 15, 2015 at 7:31 AM, Stack wrote: > &g

Re: formatter.rb not respect width > 2 columns

2015-09-16 Thread Stack
On Wed, Sep 16, 2015 at 9:50 AM, Stephen Jiang wrote: > It is interesting that in formatter.rb, if more than 2 columns, it would > not respect the width passed in. Why is that? I am thinking about change > it, but I'd like to know the reason behind it. > > Or is it ok to keep this way, even the

Re: Performance degradation between CDH5.3.1(HBase0.98.6) and CDH5.4.5(HBase1.0.0)

2015-09-21 Thread Stack
would work. > > > You need to read back the increment and have it be 'correct' at increment > > time? > Yes, we need it. > > I would like to help if there is anything I can do. > > Thanks, > Toshihiro Suzuki > > > 2015-09-13 14:11 GMT+09:00 Stack

Re: [DISCUSS] getting postcommit tests back to green.

2015-09-30 Thread Stack
On Tue, Sep 29, 2015 at 8:06 PM, Sean Busbey wrote: > Hi Folks! > > Recently our postcommit tests have been in the pits. Essentially we've > been broken since mid to late August[1]. While Stack's been fighting > the good fight, I think things are far enough gone that we need to > consider more dr

Re: Testing and CI -- Apache Jenkins Builds

2015-10-15 Thread Stack
changed the patch build to use this branch doing jenkins build (added comments in the script up in jenkins so hopefully it is a bit plain what is going on). Good on you Sean, St.Ack > On Fri, Aug 21, 2015 at 2:17 PM, Stack wrote: > > > A deadlock was causing TestDistributedLogS

Re: Upgrading Apache HTrace integration to 4.x branch

2015-10-22 Thread Stack
What Dave said. The posted patch will put us up on htrace 4. Lacking is the work to make it so traces tell a good story, that all the previous trace points are properly connected and perhaps adding more. Should get to it soon. Thanks for asking, St.Ack On Thu, Oct 22, 2015 at 8:49 AM, Dave Latham

Re: Could all tests run MR without MiniMapReduceCluster?

2015-10-22 Thread Stack
On Wed, Oct 21, 2015 at 10:01 PM, 陈恒 wrote: > When i dig in HBASE-14659, i found in testcase TestHFileOutputFormat, > some tests run MR job > without MiniMRCluster and some run with it. > > > The ones with no MiniMRCluster run much faster! > Do we need to 'test' clustered MR especially in a unit

Re: Opinions wanted: new site skin

2015-10-22 Thread Stack
I think it looks pretty amazing. Fresh! I like the menu of menu reports. It shines light on mess we've shoved under the carpet for ages now (dependencies, being public w/ what the licensing of our depenencies are...). Can we change the google search to be search-hadoop.com setup for hbase searche

Re: Could all tests run MR without MiniMapReduceCluster?

2015-10-22 Thread Stack
What Elliott said. St.Ack On Thu, Oct 22, 2015 at 10:09 PM, Elliott Clark wrote: > On Thu, Oct 22, 2015 at 7:41 PM, Heng Chen > wrote: > > > IMO we can remove them firstly, and see what QA says. > > > > +1 >

On our unit tests...

2015-10-23 Thread Stack
A few of us have been doing cleanup over the last month or so (see HBASE-14420). As a project, we had let our unit test suite go to seed. It was an anthology of mysterious crashes, zombies and flakes. We are not done yet but tests are mostly stable again with patch builds passing close to 100% of

Re: MOB in branch-1? (Re: [RESULT][VOTE] Merge branch hbase-11339 HBase MOB to trunk)

2015-10-27 Thread Stack
IMO, MOB is still not settled in Master. It has a bunch of flakey tests that are getting fixed by Jingcheng or I've disabled them till someone has time to look at them. There is also a load of duplicated code that is being cleaned up (Matteo). Its not ready to go back to branch-1 IMO. Are there u

Re: remove accidental branch1.2?

2015-10-27 Thread stack
Thanks S On Oct 27, 2015 5:13 PM, "Enis Söztutar" wrote: > I've also removed a branch named "1.0". Most likely another typo. > > Enis > > On Tue, Oct 27, 2015 at 4:52 PM, Enis Söztutar wrote: > > > I've removed the branch after checking that recent commits are already in > > branch-1.2. > > > >

Re: Opinions wanted: new site skin

2015-10-28 Thread Stack
> > > If you go to > > > > http://mstanleyjones.github.io/hbase/reflow_update/dependency-info.html > > > and a few other parts of the site, you will notice the built-in syntax > > > highlighting. > > > > > > This version does not

Re: [DISCUSS] reducing our load on builds.a.o

2015-10-28 Thread Stack
Sounds good to me Sean. St.Ack On Tue, Oct 27, 2015 at 8:47 PM, Sean Busbey wrote: > Heya Folks, > > Right now our post-commit unit tests for our various branches take 1-2 > hours to run per config (that's 6x0.94, 4x0.98, 1.0, 1.1, 2x1.2, > 2x1.3, master) > > https://builds.apache.org/view/H-L/v

Re: HBase 1.2.0 RC status

2015-10-30 Thread Stack
On Fri, Oct 30, 2015 at 7:54 AM, Sean Busbey wrote: > Thanks Ted. > > Any idea if the balancer has been reenabled? > > If you mean the balancer tests, no. They have been undone as part of the HBASE-14678 'experiment'. They need looking into before being reenabled. St.Ack > On Fri, Oct 30, 201

Re: Opinions wanted: new site skin

2015-10-30 Thread Stack
ay > around. > > [0] has the site search, which is rather nice, but I have no idea how to > modify it to use the Hadoop search site that Stack lines instead of Google. > I have zero clue how to get a site search in [1] at all. > > I've re-staged [0] with a few tweaks to ho

Re: Successful: hbase.apache.org HTML Checker

2015-11-02 Thread Stack
This is great. Thanks Misty. The mail to the list will always have this text w/ links on what to do if failed? St.Ack On Mon, Nov 2, 2015 at 4:29 PM, Misty Stanley-Jones < mstanleyjo...@cloudera.com> wrote: > FYI, this report will run weekly and let us know if we have broken links, > missing file

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2015-11-02 Thread Stack
>>>>>> > > much different from HBase-TRUNK unless it runs ~30% slower(the > >>>>>>> > > overhead > >>>>>>> > of > >>>>>>> > > collecting information for code coverage). >

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2015-11-03 Thread Stack
hould get rid of the former now? St.Ack On Mon, Nov 2, 2015 at 11:03 PM, Stack wrote: > I just did an edit of all of our jenkins configuration. I changed the > post-build zombie section. The surefire-killer was hanging out here it > seems (For detail, see HBASE-14589 Looking for the s

Re: Successful: HBase Generate Website

2015-11-03 Thread Stack
Excellent. On Mon, Nov 2, 2015 at 9:52 PM, Misty Stanley-Jones < mstanleyjo...@cloudera.com> wrote: > I set up a Jenkins job to do the heavy lifting of building and publishing > the website. All you need to do is paste the commands from the email from > Jenkins. You don't even need to worry about

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2015-11-03 Thread Stack
ete once we're confident in the matrix version > > On Tue, Nov 3, 2015 at 8:44 AM, Stack wrote: > > Stuff seems to be basically working. I just committed a fix for this > > message so it should be gone now: > > > > grep: unknown devices method > > grep: wr

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2015-11-04 Thread Stack
: An error has occurred in Checkstyle report generation. Failed during checkstyle execution: Unable to process suppressions file location: hbase/checkstyle-suppressions.xml: Cannot create file-based resource:invalid block type -> [Help 1] Thanks, St.Ack On Tue, Nov 3, 2015 at 10:31 AM,

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2015-11-04 Thread Stack
gt; NOTICE aggregations in debug mode will print out clues as to what > specifically is missing. See defines in the POMs for doing so. (I'm not at > the computer yet so can't pull up the specifics.) > > > > On Nov 4, 2015, at 6:23 AM, Stack wrote: > > > > [ERR

Re: On our unit tests...

2015-11-04 Thread Stack
at 2:54 PM, Stack wrote: > A few of us have been doing cleanup over the last month or so (see > HBASE-14420). As a project, we had let our unit test suite go to seed. It > was an anthology of mysterious crashes, zombies and flakes. > > We are not done yet but tests are mostly stabl

Re: Has anyone tried profiling trunk recently?

2015-11-05 Thread Stack
I see 60% of all allocation pressure in TLABs coming from > ProcedureExecutors, allocating 16 GB of > java.util.AbstractMap$SimpleImmutableEntry in this code: > > Stack Trace TLABs Total TLAB Size(bytes) Pressure(%) > java.util.concurrent.ConcurrentSkipListMap$Node.createSnapsh

Re: On our unit tests...

2015-11-05 Thread Stack
d? > > Makes sense (and still work to do on zombie detector). Let me work on it. St.Ack > > > > > On Oct 23, 2015, at 2:54 PM, Stack wrote: > > > > A few of us have been doing cleanup over the last month or so (see > > HBASE-14420). As a project, we had

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2015-11-06 Thread Stack
substitute in a placeholder pom that doesn't have e.g. license > information. That can result in a local repo that fails this way until > the refresh timeout hits for grabbing a pom again. > > On Wed, Nov 4, 2015 at 5:33 PM, Stack wrote: > > Thanks Andrew. Weird is that it is spora

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2015-11-07 Thread Stack
er pom that doesn't have e.g. license > information. That can result in a local repo that fails this way until > the refresh timeout hits for grabbing a pom again. > > On Wed, Nov 4, 2015 at 5:33 PM, Stack wrote: > > Thanks Andrew. Weird is that it is sporadic. Will keep an eye on

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2015-11-08 Thread Stack
uilds using same checked-in script rather than running script out of jenkins configuration. St.Ack On Sat, Nov 7, 2015 at 11:41 AM, Stack wrote: > Is this an example Sean, > https://builds.apache.org/job/HBase-Trunk_matrix/442/jdk=latest1.7,label=Hadoop/consoleText > ? > Thanks, &g

Re: (无主题)

2015-11-10 Thread Stack
On Mon, Nov 9, 2015 at 10:52 PM, WangYQ wrote: > guys, i have some problems on seq_id > > 1. what is the motivation of adding seq_id as part of the bulkload files > > Bulk loaded files either get no sequence id -- and so they are considered AFTER all current edits in the Store -- or the bulk load

Re: Build failed in Jenkins: HBase-Trunk_matrix » latest1.7,Hadoop #458

2015-11-11 Thread Stack
.. SKIPPED > [INFO] Apache HBase - Rest ... SKIPPED > [INFO] Apache HBase - External Block Cache ... SKIPPED > [INFO] Apache HBase - Assembly ... SKIPPED > [INFO] Apache HBase - Shaded .

Re: Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #457

2015-11-11 Thread Stack
FO] Apache HBase - Integration Tests .. SKIPPED > [INFO] Apache HBase - Examples ... SKIPPED > [INFO] Apache HBase - Rest ... SKIPPED > [INFO] Apache HBase - External Block Cache ... SKIPPED > [INFO]

Re: Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #463

2015-11-14 Thread Stack
abel=Hadoop/463/changes > > > > Changes: > > [stack] HBASE-14802 Replaying server crash recovery procedure after a > failover > > [stack] HBASE-14807 TestWALLockup is flakey > > ---

Re: Build failed in Jenkins: HBase-1.2 » latest1.8,Hadoop #370

2015-11-14 Thread Stack
ote: > See < > https://builds.apache.org/job/HBase-1.2/jdk=latest1.8,label=Hadoop/370/changes > > > > Changes: > > [stack] HBASE-14798 NPE reporting server load causes regionserver abort; > causes > > -

Re: Build failed in Jenkins: HBase-Trunk_matrix » latest1.7,Hadoop #458

2015-11-14 Thread Stack
eport/org.apache.hadoop.hbase.regionserver/TestRegionReplicaFailover/testPrimaryRegionKill_0_/history/ On Wed, Nov 11, 2015 at 10:33 AM, Stack wrote: > Here we fail on TestRegionReplicaFailover. It timed out. > > org.junit.runners.model.TestTimedOutException: test timed out after 12 > millis

Re: Meetup for tackling JIRA backlog?

2015-11-15 Thread Stack
Good idea. I'd be game. St.Ack On Sun, Nov 15, 2015 at 2:30 PM, Andrew Purtell wrote: > Hey HBase developers and committers, > > By any chance, would there be interest out there for a meetup > (physical+virtual or just virtual via hangout) in the next couple of weeks > with the aim to review JIR

Re: Two backport issues pending for 0.98.16

2015-11-16 Thread Stack
And mine. Ask for a review if patch has to change significantly from what is upstream I'd say. Otherwise, commit. St.Ack On Mon, Nov 16, 2015 at 9:25 AM, Nick Dimiduk wrote: > You have my consent for auto-commit backports :) > > On Fri, Nov 6, 2015 at 10:35 PM, Andrew Purtell > wrote: > > > W

Re: Better code quality with more checkstyles

2015-11-17 Thread Stack
Want to make a patch Appy? Will up our violations count but the set looks reasonable to me. St.Ack On Tue, Nov 17, 2015 at 4:54 PM, Apekshit Sharma wrote: > I agree. Sorry if I my message was lost in the boring sunday story, but > the proposal is only to enable new checkstyles which are listed i

Re: Changing resolution in JIRA

2015-11-19 Thread Stack
Try now. Made you an administrator Lars. St.Ack On Thu, Nov 19, 2015 at 5:07 AM, Lars Francke wrote: > That was quick: I'm not allowed to close issues. > > Would you consider giving me more permissions for JIRA also as per my other > previous mail? > > On Thu, Nov 19, 2015 at 2:04 PM, Lars Franc

TestTableLockManager.testReapAllTableLocks => Re: Build failed in Jenkins: HBase-1.3 » latest1.8,Hadoop #385

2015-11-20 Thread Stack
. SKIPPED > [INFO] Apache HBase - Shaded - Server SKIPPED > [INFO] > > [INFO] BUILD FAILURE > [INFO] > > [IN

Re: Build failed in Jenkins: HBase-1.3 » latest1.7,Hadoop #385

2015-11-20 Thread Stack
ecutionException: > java.lang.RuntimeException: There was an error in the forked process > [ERROR] java.lang.ArrayIndexOutOfBoundsException: 1 > [ERROR] at > org.apache.maven.surefire.common.junit4.JUnit4ProviderUtil.generateFailingTests(JUnit4ProviderUtil.java:64) > [ERROR] at > o

Re: Build failed in Jenkins: HBase-Trunk_matrix » latest1.7,Hadoop #486

2015-11-21 Thread Stack
at org.apache.velocity.Template.merge(Template.java:260) On Fri, Nov 20, 2015 at 1:50 PM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See < > https://builds.apache.org/job/HBase-Trunk_matrix/jdk=latest1.7,label=Hadoop/486/changes > > > > Changes: > > [stack] Revert &q

Re: Build failed in Jenkins: HBase-1.3 » latest1.7,Hadoop #388

2015-11-22 Thread Stack
tegmark:hbase.git stack$ python ./dev-support/findHangingTests.py https://builds.apache.org/view/H-L/view/HBase/job/HBase-1.3/388/jdk=latest1.7,label=Hadoop/consoleText Fetching https://builds.apache.org/view/H-L/view/HBase/job/HBase-1.3/388/jdk=latest1.7,label=Hadoop/consoleText Building remotely

Re: Build failed in Jenkins: HBase-1.2 » latest1.7,Hadoop #397

2015-11-24 Thread Stack
This is interesting fail. We seem to be super slow downloading artifacts and then when we run, we fail in thrift... the zombie detector finds a bunch of tests that have been running for a while but we are not clean in our reporting... might be hard to be clean in the reporting here. This 1.7 suite

Re: Build failed in Jenkins: HBase-1.2 » latest1.8,Hadoop #399

2015-11-24 Thread Stack
-- > [INFO] BUILD FAILURE > [INFO] > > [INFO] Total time: 1:32:31.389s > [INFO] Finished at: Wed Nov 25 02:11:47 UTC 2015 > [INFO] Final Memory: 94M/621M > [INFO] > > [ERROR] Failed to

Re: Build failed in Jenkins: HBase-1.2 » latest1.7,Hadoop #401

2015-11-25 Thread Stack
n Wed, Nov 25, 2015 at 2:34 PM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See < > https://builds.apache.org/job/HBase-1.2/jdk=latest1.7,label=Hadoop/401/changes > > > > Changes: > > [stack] HBASE-14883 TestSplitTrans

Re: Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #502

2015-11-25 Thread Stack
p"): error=2, No such file or directory Let me try it again. St.Ack On Wed, Nov 25, 2015 at 3:13 PM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See < > https://builds.apache.org/job/HBase-Trunk_matrix/jdk=latest1.8,label=Hadoop/502/changes > &

Re: [VOTE] The 1st HBase 0.98.16.1 patch release candidate (RC0) is available

2015-11-25 Thread Stack
+1 Verified hash and signature. Built from src including site. Checks out. Doc looks good and for right version. Started her up and loaded 10M. Verified it there. Shut it down. Checked logs. St.Ack On Fri, Nov 20, 2015 at 7:27 PM, Andrew Purtell wrote: > The 1st HBase 0.98.16.1 patch releas

Re: Build failed in Jenkins: HBase-1.3 » latest1.8,Hadoop #400

2015-11-26 Thread Stack
-14777 second addendum, better fix using CompletionService. > > [stack] HBASE-14355 Scan different TimeRange for each column family - > fixing > > -- > [...truncated 45552 lines...] > T

Re: Build failed in Jenkins: HBase-1.3 » latest1.8,Hadoop #401

2015-11-27 Thread Stack
gt; [INFO] Apache HBase - Shaded - Server .... SKIPPED > [INFO] > > [INFO] BUILD FAILURE > [INFO] > > [INFO] Total time: 1:

Re: Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #509

2015-11-28 Thread Stack
... SKIPPED > [INFO] Apache HBase - External Block Cache ... SKIPPED > [INFO] Apache HBase - Assembly ... SKIPPED > [INFO] Apache HBase - Shaded . SKIPPED > [INFO] Apache HBase - Shaded - Client

Re: Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #512

2015-11-29 Thread Stack
. SKIPPED > [INFO] Apache HBase - Integration Tests .. SKIPPED > [INFO] Apache HBase - Examples ... SKIPPED > [INFO] Apache HBase - Rest ... SKIPPED > [INFO] Apache HBase - External Block Cache ... SKIP

Re: Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #513

2015-11-29 Thread Stack
Block Cache ... SKIPPED > [INFO] Apache HBase - Assembly ... SKIPPED > [INFO] Apache HBase - Shaded . SKIPPED > [INFO] Apache HBase - Shaded - Client SKIPPED > [INFO] Apache HBase - Shaded - Se

Re: Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #513

2015-11-30 Thread Stack
> > at > org.apache.hadoop.hbase.procedure2.ProcedureExecutor.executeRollback(ProcedureExecut > > > > > > Regards > > > > Ram > > > > > > On Mon, Nov 30, 2015 at 12:22 PM, Stack wrote: > > > >> Seems like a basic

Re: Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #513

2015-11-30 Thread Stack
It looks like the latch is not yet set. Can we keep going if no latch to use rather than NPE? St.Ack On Mon, Nov 30, 2015 at 9:08 AM, Stack wrote: > If you look at the logs for the above fail run, does anything pop out? > Thanks. > St.Ack > > On Sun, Nov 29, 2015 at 11:33

Re: Performance degradation between CDH5.3.1(HBase0.98.6) and CDH5.4.5(HBase1.0.0)

2015-11-30 Thread Stack
ard to CDH5.5 to fix? Or is our only hope to roll back to > CDH 5.3.1 (if that is possible)? > > > On Thu, Sep 24, 2015 at 5:06 AM 鈴木俊裕 wrote: > > > Thank you St.Ack! > > > > I would like to follow the ticket. > > > > Toshihiro Suzuki > > > >

Re: Performance degradation between CDH5.3.1(HBase0.98.6) and CDH5.4.5(HBase1.0.0)

2015-11-30 Thread Stack
back, and aside from > a > > few NoSuchMethodErrors due to API changes (Put#add vs Put#addColumn), it > > seems to be working and fixing our problem. > > > > On Mon, Nov 30, 2015 at 3:47 PM Stack wrote: > > > >> Rollback is untested. No fix in 5.5. I was goin

Re: Performance degradation between CDH5.3.1(HBase0.98.6) and CDH5.4.5(HBase1.0.0)

2015-11-30 Thread Stack
: 1635.23998 > > > Any ideas if there are other changes that may be causing a performance > regression for increments between CDH4.7.1 and CDH5.3.8? > > > No. Post a thread dump Bryan and it might prompt something. St.Ack > > On Mon, Nov 30, 2015 at 4:13 PM Stack

Re: Performance degradation between CDH5.3.1(HBase0.98.6) and CDH5.4.5(HBase1.0.0)

2015-11-30 Thread Stack
gt; >>> > >>> An active handler: > >>> > https://gist.github.com/bbeaudreault/2994a748da83d9f75085#file-gistfile1-txt-L286 > >>> One that is locked: > >>> > https://git.hubteam.com/gist/jwilliams/80f37999bfdf55119588#file-gistfile1-

Re: Performance degradation between CDH5.3.1(HBase0.98.6) and CDH5.4.5(HBase1.0.0)

2015-11-30 Thread Stack
Looking at that stack trace, nothing showing as blocked or slowed by another operation. You have others I could look at Bryan? St.Ack On Mon, Nov 30, 2015 at 8:40 PM, Bryan Beaudreault wrote: > Yea sorry if I was misleading. The nonce loglines we saw only happened on > full cluster resta

Re: Performance degradation between CDH5.3.1(HBase0.98.6) and CDH5.4.5(HBase1.0.0)

2015-11-30 Thread Stack
pattern, of 1 active handler in the upsert and > the rest blocked waiting for it. > > On Mon, Nov 30, 2015 at 6:05 PM Stack wrote: > > > On Mon, Nov 30, 2015 at 2:31 PM, Bryan Beaudreault < > > bbeaudrea...@hubspot.com > > > wrote: > > > > > The roll

Re: Performance degradation between CDH5.3.1(HBase0.98.6) and CDH5.4.5(HBase1.0.0)

2015-11-30 Thread Stack
On Mon, Nov 30, 2015 at 9:16 PM, Bryan Beaudreault wrote: > I'll try to get another one. We are currently not seeing the issue due to > lack of contention (it is off hours for our customers). > > Note that the stack trace I gave you was taken with a tool we have which > aggr

Re: Would ROWCOL Bloom filter help in Scan

2015-11-30 Thread Stack
On Mon, Nov 30, 2015 at 9:56 AM, Jerry He wrote: > Hi, experts > > HBASE supports ROWCOL bloom filter. ROW+COL would be the bloom key. > In most of the documentations, it says only GET would benefit. For > multi-column as well. > > If I do scan with StartRow and EndRow, and also specify columns.

Re: [DISCUSS] Moving the HBase site to use a stand-alone git repo

2015-12-02 Thread Stack
Good by me. Interested in the answers to Nicks questions too. St.Ack On Wed, Dec 2, 2015 at 11:07 AM, Nick Dimiduk wrote: > +1 in theory. How will this work with integration of javadoc into the site? > How will RM's manage integrating site docs into their releases? > > On Wed, Dec 2, 2015 at 8:5

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2015-12-02 Thread Stack
make sure you get a clean build out of hadoopqa before committing anything, and lets all work together to try and keep our builds blue: it'll save us all work in the long run. St.Ack On Tue, Nov 4, 2014 at 9:38 AM, Stack wrote: > Branch-1 and master have stabilized and now run mo

Re: Consesus on removing a public method from IA.Private class whose instance is returned from IA.public class.

2015-12-02 Thread Stack
Appy makes a pretty good argument. What in particular are we discussing Ashish? Thanks, St.Ack On Wed, Dec 2, 2015 at 3:49 PM, Apekshit Sharma wrote: > I think it should be okay to remove them. When I imagine myself on other > side, a dev using client api of Foo project, and I see a class retu

Re: Build failed in Jenkins: HBase-Trunk_matrix » latest1.8,Hadoop #527

2015-12-03 Thread Stack
, 2015 at 2:16 AM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See < > https://builds.apache.org/job/HBase-Trunk_matrix/jdk=latest1.8,label=Hadoop/527/changes > > > > Changes: > > [stack] HBASE-14772 Improve zombie de

Re: Would ROWCOL Bloom filter help in Scan

2015-12-03 Thread Stack
ke for a nice speedup for scans of many explicit columns traversing a dataset that is sparsely populated.. St.Ack > Jerry > > On Mon, Nov 30, 2015 at 10:55 PM, Stack wrote: > > > On Mon, Nov 30, 2015 at 9:56 AM, Jerry He wrote: > > > > > Hi, experts > >

Re: -1 overall but +1 in individual tests

2015-12-03 Thread Stack
Sorry Appy. Probably my fault or at least my hackery is making it harder to figure what is going on at the moment. I've been messing with test-patch to try and get better reporting on zombies. I committed changes yesterday. See HBASE-14772. I say there "Here is some more cleanup in zombie detector.

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2015-12-03 Thread Stack
Notice: I'm messing with test-patch.sh reporting trying to improve the zombie section. I'll likely break things for a while (I already have -- the hadoopqa report section is curtailed at mo). Will flag when done. St.Ack On Wed, Dec 2, 2015 at 1:22 PM, Stack wrote: > As part of

Re: [DISCUSS] Moving the HBase site to use a stand-alone git repo

2015-12-03 Thread Stack
branch of the hbase-site repo (or whetever it > is called) and commit the newly-generated target/stage/* to it and push. > Does that make sense? > > Yes. St.Ack > On Thu, Dec 3, 2015 at 6:33 AM, Stack wrote: > > > Good by me. Interested in the answers to Nicks questions t

Re: Would ROWCOL Bloom filter help in Scan

2015-12-03 Thread Stack
On Thu, Dec 3, 2015 at 12:54 PM, Jerry He wrote: > Thanks. Stack. > I will look into the code more as well. > Do you think Column only Bloom Filter will help more with this SCAN + > explicit columns case and with space saving? > > Come again Jerry. Column-only? (It has to have

TestVisibilityLabelsWithACL is flakey, fails frequently

2015-12-04 Thread Stack
Anyone up for taking a look at this flakey test? See here for example: https://builds.apache.org/view/H-L/view/HBase/job/HBase-1.2/419/jdk=latest1.7,label=Hadoop/testReport/junit/org.apache.hadoop.hbase.security.visibility/TestVisibilityLabelsWithACL/org_apache_hadoop_hbase_security_visibility_Tes

Re: TestVisibilityLabelsWithACL is flakey, fails frequently

2015-12-04 Thread Stack
;ve got some kind of test shutdown hang bug. > > > > On Fri, Dec 4, 2015 at 9:29 AM, Stack wrote: > > > Anyone up for taking a look at this flakey test? > > > > See here for example: > > > > > https://builds.apach

TestRegionReplicaReplicationEndpoint flakey

2015-12-04 Thread Stack
This one fails pretty regularly. The fail is ugly because it spews megabytes when it goes wrong (almost 1G on fail). Here is an example: https://builds.apache.org/view/H-L/view/HBase/job/HBase-1.2/jdk=latest1.8,label=Hadoop/419/artifact/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.

Re: TestVisibilityLabelsWithACL is flakey, fails frequently

2015-12-04 Thread Stack
by porting the notification to ProcV2. Otherwise, we hack > around the edges (like HBASE-14209). > > On Fri, Dec 4, 2015 at 9:47 AM, Stack wrote: > > > It shuts down fine. It just fails too often in scheme of things. I could > > just disable it. > > St.Ack > >

Re: Testing and CI -- Apache Jenkins Builds (WAS -> Re: Testing)

2015-12-05 Thread Stack
tests (for once). Let me ask INFRA. St.Ack On Thu, Dec 3, 2015 at 9:27 AM, Stack wrote: > Notice: I'm messing with test-patch.sh reporting trying to improve the > zombie section. I'll likely break things for a while (I already have -- the > hadoopqa report section is curtaile

<    3   4   5   6   7   8   9   10   11   12   >