Re: Building HBase trunk on windows using cygwin

2011-10-05 Thread Mayuresh
Got this to work with the hack of replace the original code in pom.xml with the following lines: echo file=${project.build.directory}/copynativelibs.sh pp=`echo /cygdrive/${project.build.directory}|sed -e 's/://g'|sed -e 's//\\//g'`

Build failed in Jenkins: HBase-0.92 #44

2011-10-05 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-0.92/44/changes Changes: [ramkrishna] HBASE-4479 TestMasterFailover failure in Hbase-0.92#17 (Ram) [stack] HBASE-4494 AvroServer:: get fails with NPE on a non-existent row -- [...truncated 6065 lines...] Forking

Build failed in Jenkins: HBase-TRUNK #2295

2011-10-05 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-TRUNK/2295/changes Changes: [ramkrishna] HBASE-4479 TestMasterFailover failure in Hbase-0.92#17(Ram) [stack] HBASE-4494 AvroServer:: get fails with NPE on a non-existent row -- [...truncated 1675 lines...] Tests

Build failed in Jenkins: HBase-TRUNK #2296

2011-10-05 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-TRUNK/2296/ -- [...truncated 1657 lines...] Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.126 sec Running org.apache.hadoop.hbase.regionserver.TestKeyValueScanFixture Tests run: 1, Failures: 0,

Re: backporting HBASE-3777 to 0.90

2011-10-05 Thread Ted Yu
Unit test suite passed for patch v4. Cheers On Tue, Oct 4, 2011 at 8:44 PM, Ted Yu yuzhih...@gmail.com wrote: Bright will upload patch v4 which would disable TestHCM.testManyNewConnectionsDoesnotOOME (disabled in TRUNK) Otherwise patch v3 is ready for wider validation effort. Thanks in

TestHLog hanging in trunk

2011-10-05 Thread Gary Helmling
I've noticed that TestHLog is currently hanging in trunk (haven't checked other branches). Oddly the tests actually complete, but then the test hangs in teardown. Seems to be something in the server shutdown hooks. git bisect tracks down the hang to this commit: commit

Re: TestHLog hanging in trunk

2011-10-05 Thread Gary Helmling
Somehow TestHLog was never actually shutting down the mini-cluster? The following change lets the test exit successfully: diff --git a/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestHLog.java b/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestHLog.java index

Re: TestHLog hanging in trunk

2011-10-05 Thread Jesse Yates
Nice catch! Hadn't had a chance to look into that test yet, but I feel this kind of 'dirty' testing is (unfortunately) going to be pretty prevalent. Going to work on a deep dive on a bunch of tests soon though. -Jesse Yates On Wed, Oct 5, 2011 at 11:55 AM, Gary Helmling ghelml...@gmail.com

Re: TestHLog hanging in trunk

2011-10-05 Thread Todd Lipcon
+CC Roman who worked on the patch identified by the bisect. Roman, does Gary's analysis make sense to you? -Todd On Wed, Oct 5, 2011 at 11:55 AM, Gary Helmling ghelml...@gmail.com wrote: Somehow TestHLog was never actually shutting down the mini-cluster? The following change lets the test

Re: TestHLog hanging in trunk

2011-10-05 Thread Gary Helmling
Something else seems to be going on. With the call to shutdownMiniCluster() the first run of TestHLog passes. But when I try running in a loop, the second run always seems to hang. Thread dump here: http://pastebin.com/f18Wfa3T On Wed, Oct 5, 2011 at 12:00 PM, Todd Lipcon t...@cloudera.com

Build failed in Jenkins: HBase-0.92 #45

2011-10-05 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-0.92/45/changes Changes: [stack] HBASE-4481 TestMergeTool failed in 0.92 build 20 -- [...truncated 6058 lines...] Running org.apache.hadoop.hbase.filter.TestParseFilter Tests run: 33, Failures: 0, Errors: 0,

Build failed in Jenkins: HBase-TRUNK #2297

2011-10-05 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-TRUNK/2297/changes Changes: [jdcryans] HBASE-4501 [replication] Shutting down a stream leaves recovered sources running [dmeil] HBASE-4541 clarifying versions in Schema Design [stack] HBASE-4481 TestMergeTool failed in 0.92 build 20

Re: TestHLog hanging in trunk

2011-10-05 Thread Stack
Easy to repro Gary? I just add in your above patch and then loop? The first run completely goes down? The regionserver is waiting on all regions to close before it can go down (and then the master go down). St.Ack On Wed, Oct 5, 2011 at 12:13 PM, Gary Helmling ghelml...@gmail.com wrote:

Re: TestHLog hanging in trunk

2011-10-05 Thread Gary Helmling
On Wed, Oct 5, 2011 at 3:05 PM, Stack st...@duboce.net wrote: Easy to repro Gary? I just add in your above patch and then loop? The first run completely goes down? The regionserver is waiting on all regions to close before it can go down (and then the master go down). St.Ack This patch

Re: TestHLog hanging in trunk

2011-10-05 Thread Roman Shaposhnik
On Wed, Oct 5, 2011 at 12:00 PM, Todd Lipcon t...@cloudera.com wrote: +CC Roman who worked on the patch identified by the bisect. Thanks for the CC. I've just subscribed myself to the list. Roman, does Gary's analysis make sense to you? Hm. I need to look into it. There *could* be some issues

Build failed in Jenkins: HBase-0.92 #46

2011-10-05 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-0.92/46/changes Changes: [jdcryans] HBASE-4501 [replication] Shutting down a stream leaves recovered sources running [stack] Add debugging around failing TestServerCustomProtocol testSingleMethod test

Build failed in Jenkins: HBase-0.92 #47

2011-10-05 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-0.92/47/changes Changes: [todd] HBASE-4386 Fix a potential NPE in TaskMonitor -- [...truncated 6066 lines...] Running org.apache.hadoop.hbase.rest.TestMultiRowResource Tests run: 3, Failures: 0, Errors: 0, Skipped:

Re: TestHLog hanging in trunk

2011-10-05 Thread Gary Helmling
I created HBASE-4545 to clean up TestHLog. Among other things, it didn't even need to spin up a MiniHBaseCluster, only a MiniDFSCluster. Several of the tests were also leaking unclosed HLog instances. Will post a patch shortly. On Wed, Oct 5, 2011 at 5:52 PM, Gary Helmling ghelml...@gmail.com

Re: TestHLog hanging in trunk

2011-10-05 Thread Stack
Good stuff G. St.Ack On Wed, Oct 5, 2011 at 8:44 PM, Gary Helmling ghelml...@gmail.com wrote: I created HBASE-4545 to clean up TestHLog. Among other things, it didn't even need to spin up a MiniHBaseCluster, only a MiniDFSCluster.  Several of the tests were also leaking unclosed HLog

Build failed in Jenkins: HBase-TRUNK #2299

2011-10-05 Thread Apache Jenkins Server
See https://builds.apache.org/job/HBase-TRUNK/2299/ -- [...truncated 1654 lines...] Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.117 sec Running org.apache.hadoop.hbase.regionserver.TestScanner Tests run: 6, Failures: 0, Errors: 0,