[
https://issues.apache.org/jira/browse/HBASE-6581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13869120#comment-13869120
]
Eric Charles commented on HBASE-6581:
-------------------------------------
Thx Ted for the tip about Maven output logs processing.
On my laptop:
A/
git checkout trunk
mvn clean test -Dtest=TestReplicationHLogReaderManager
SUCCESS 3:19.245s
B/
git checkout HBASE-6581-hadoop3
mvn clean test -Dtest=TestReplicationHLogReaderManager
... hangs for a long time. Not patient enough, CTRL^C...
C/
and with profile 3.0
git checkout HBASE-6581-hadoop3
mvn clean test -Dtest=TestReplicationHLogReaderManager -Dhadoop.profile=3.0
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-surefire-plugin:2.12-TRUNK-HBASE-2:test
(default-test) on project hbase-server: Failure or timeout -> [Help 1]
more
hbase-server/target/surefire-reports/org.apache.hadoop.hbase.replication.regionserver.TestReplicationHLogReaderManager.txt
The
2014-01-12 19:59:09,942 INFO [IPC Server handler 6 on 38555]
blockmanagement.BlockManager(2293): BLOCK* addStoredBlock: blockMap updated:
127.0.0.1:43180 is added to
blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, re
plicas=[ReplicaUnderConstruction[[DISK]DS-f41c8aca-a032-4865-8fa9-2367efc6ae03:NORMAL|RBW],
ReplicaUnderConstruction[[DISK]DS-2b59d0b7-f913-45c7-9927-12a6d619c054:NORMAL|RBW],
ReplicaUnderConstruction[[DISK]DS-fd05c8d9-a047-4a77-bce9-b1899c1dc
823:NORMAL|RBW]]} size 7
2014-01-12 19:59:09,945 INFO [IPC Server handler 7 on 38555]
blockmanagement.BlockManager(2293): BLOCK* addStoredBlock: blockMap updated:
127.0.0.1:45050 is added to
blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, re
plicas=[ReplicaUnderConstruction[[DISK]DS-f41c8aca-a032-4865-8fa9-2367efc6ae03:NORMAL|RBW],
ReplicaUnderConstruction[[DISK]DS-2b59d0b7-f913-45c7-9927-12a6d619c054:NORMAL|RBW],
ReplicaUnderConstruction[[DISK]DS-fd05c8d9-a047-4a77-bce9-b1899c1dc
823:NORMAL|RBW]]} size 7
2014-01-12 19:59:09,945 INFO [IPC Server handler 8 on 38555]
blockmanagement.BlockManager(2293): BLOCK* addStoredBlock: blockMap updated:
127.0.0.1:48792 is added to
blk_1073741828_1004{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, re
plicas=[ReplicaUnderConstruction[[DISK]DS-f41c8aca-a032-4865-8fa9-2367efc6ae03:NORMAL|RBW],
ReplicaUnderConstruction[[DISK]DS-2b59d0b7-f913-45c7-9927-12a6d619c054:NORMAL|RBW],
ReplicaUnderConstruction[[DISK]DS-fd05c8d9-a047-4a77-bce9-b1899c1dc
823:NORMAL|RBW]]} size 7
2014-01-12 19:59:09,976 DEBUG [main] wal.FSHLog(883): Moved 3 WAL file(s) to
/user/eric/hbase/oldWALs
2014-01-12 19:59:10,016 INFO [main] hbase.ResourceChecker(171): after:
replication.regionserver.TestReplicationHLogReaderManager#test[0] Thread=113
(was 111)
Potentially hanging thread: org.apache.hadoop.hdfs.PeerCache@25242963
java.lang.Thread.sleep(Native Method)
org.apache.hadoop.hdfs.PeerCache.run(PeerCache.java:252)
org.apache.hadoop.hdfs.PeerCache.access$000(PeerCache.java:39)
org.apache.hadoop.hdfs.PeerCache$1.run(PeerCache.java:135)
java.lang.Thread.run(Thread.java:724)
Potentially hanging thread: DataXceiver for client
DFSClient_NONMAPREDUCE_-590648032_1 at /127.0.0.1:56548 [Waiting for operation
#3]
sun.nio.ch.EPollArrayWrapper.epollWait(Native Method)
sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:228)
sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:81)
sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:87)
sun.nio.ch.SelectorImpl.select(SelectorImpl.java:98)
org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335)
org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157)
org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161)
org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131)
java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
java.io.BufferedInputStream.read(BufferedInputStream.java:254)
java.io.DataInputStream.readShort(DataInputStream.java:312)
org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:52)
org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:198)
java.lang.Thread.run(Thread.java:724)
- Thread LEAK? -, OpenFileDescriptor=233 (was 212) - OpenFileDescriptor LEAK?
-, MaxFileDescriptor=4096 (was 4096), SystemLoadAverage=307 (was 290) -
SystemLoadAverage LEAK? -, ProcessCount=263 (was 263), AvailableMemoryMB=2163
(was 2222), Co
nnectionCount=0 (was 0)
2014-01-12 19:59:10,036 INFO [main] hbase.ResourceChecker(147): before:
replication.regionserver.TestReplicationHLogReaderManager#test[1] Thread=113,
OpenFileDescriptor=233, MaxFileDescriptor=4096, SystemLoadAverage=307,
ProcessCount=263, Ava
ilableMemoryMB=2163, ConnectionCount=0
2014-01-12 19:59:10,036 INFO [main] wal.FSHLog(396): WAL/HLog configuration:
blocksize=128 MB, rollsize=121.60 MB, enabled=true
2014-01-12 19:59:10,078 INFO [main] wal.FSHLog(575): New WAL
/user/eric/hbase/test/some+server.1389553150040
2014-01-12 19:59:10,260 INFO [IPC Server handler 1 on 38555]
blockmanagement.BlockManager(2293): BLOCK* addStoredBlock: blockMap updated:
127.0.0.1:43180 is added to
blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, re
plicas=[ReplicaUnderConstruction[[DISK]DS-3c6d935d-9ed2-4d21-be0b-60165402737b:NORMAL|RBW],
ReplicaUnderConstruction[[DISK]DS-9bd0dd0d-e3ba-4fcc-8ba5-c37b1463c262:NORMAL|RBW],
ReplicaUnderConstruction[[DISK]DS-0c960596-2901-4baf-8a50-a66be764b
376:NORMAL|RBW]]} size 7
2014-01-12 19:59:10,262 INFO [IPC Server handler 0 on 38555]
blockmanagement.BlockManager(2293): BLOCK* addStoredBlock: blockMap updated:
127.0.0.1:48792 is added to
blk_1073741829_1005{blockUCState=UNDER_CONSTRUCTION, primaryNodeIndex=-1, re
plicas=[ReplicaUnderConstruction[[DISK]DS-3c6d935d-9ed2-4d21-be0b-60165402737b:NORMAL|RBW],
ReplicaUnderConstruction[[DISK]DS-9bd0dd0d-e3ba-4fcc-8ba5-c37b1463c262:NORMAL|RBW],
ReplicaUnderConstruction[[DISK]DS-0c960596-2901-4baf-8a50-a66be764b
> Build with hadoop.profile=3.0
> -----------------------------
>
> Key: HBASE-6581
> URL: https://issues.apache.org/jira/browse/HBASE-6581
> Project: HBase
> Issue Type: Bug
> Reporter: Eric Charles
> Assignee: Eric Charles
> Fix For: 0.98.1
>
> Attachments: HBASE-6581-1.patch, HBASE-6581-2.patch,
> HBASE-6581-20130821.patch, HBASE-6581-3.patch, HBASE-6581-4.patch,
> HBASE-6581-5.patch, HBASE-6581-6.patch, HBASE-6581-7.patch, HBASE-6581.diff,
> HBASE-6581.diff
>
>
> Building trunk with hadoop.profile=3.0 gives exceptions (see [1]) due to
> change in the hadoop maven modules naming (and also usage of 3.0-SNAPSHOT
> instead of 3.0.0-SNAPSHOT in hbase-common).
> I can provide a patch that would move most of hadoop dependencies in their
> respective profiles and will define the correct hadoop deps in the 3.0
> profile.
> Please tell me if that's ok to go this way.
> Thx, Eric
> [1]
> $ mvn clean install -Dhadoop.profile=3.0
> [INFO] Scanning for projects...
> [ERROR] The build could not read 3 projects -> [Help 1]
> [ERROR]
> [ERROR] The project org.apache.hbase:hbase-server:0.95-SNAPSHOT
> (/d/hbase.svn/hbase-server/pom.xml) has 3 errors
> [ERROR] 'dependencies.dependency.version' for
> org.apache.hadoop:hadoop-common:jar is missing. @ line 655, column 21
> [ERROR] 'dependencies.dependency.version' for
> org.apache.hadoop:hadoop-annotations:jar is missing. @ line 659, column 21
> [ERROR] 'dependencies.dependency.version' for
> org.apache.hadoop:hadoop-minicluster:jar is missing. @ line 663, column 21
> [ERROR]
> [ERROR] The project org.apache.hbase:hbase-common:0.95-SNAPSHOT
> (/d/hbase.svn/hbase-common/pom.xml) has 3 errors
> [ERROR] 'dependencies.dependency.version' for
> org.apache.hadoop:hadoop-common:jar is missing. @ line 170, column 21
> [ERROR] 'dependencies.dependency.version' for
> org.apache.hadoop:hadoop-annotations:jar is missing. @ line 174, column 21
> [ERROR] 'dependencies.dependency.version' for
> org.apache.hadoop:hadoop-minicluster:jar is missing. @ line 178, column 21
> [ERROR]
> [ERROR] The project org.apache.hbase:hbase-it:0.95-SNAPSHOT
> (/d/hbase.svn/hbase-it/pom.xml) has 3 errors
> [ERROR] 'dependencies.dependency.version' for
> org.apache.hadoop:hadoop-common:jar is missing. @ line 220, column 18
> [ERROR] 'dependencies.dependency.version' for
> org.apache.hadoop:hadoop-annotations:jar is missing. @ line 224, column 21
> [ERROR] 'dependencies.dependency.version' for
> org.apache.hadoop:hadoop-minicluster:jar is missing. @ line 228, column 21
> [ERROR]
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)
