Re: Excpetion when combining Hadoop MapReduce with HBase

[Holger Stenzhorn]

Hi,

Thanks a lot for the hint! So I did download the Hadoop build #296 
(07-Nov-2007 11:01:48) from the Apache Hudson site.
...and the test class now goes much further with the large files but 
still stops to work after some time as you can from the master log below.
This happens even after upping the heap space for both the test class as 
well as for Hadoop to 10GB each...
(Both the log of the test class as well as the region server show no 
error. The former just shows: INFO mapred.JobClient:  map 100% reduce 
83%,  INFO mapred.LocalJobRunner: reduce > reduce, INFO 
mapred.LocalJobRunner: reduce > reduce, ... and so on).
Is the problem sitting in from of the screen again? ;-)
Cheers,
Holger

2007-11-08 21:30:07,585 INFO org.apache.hadoop.hbase.HMaster: Root 
region dir: /home/holger/tmp/hbase/hregion_-70236052
2007-11-08 21:30:07,586 INFO org.apache.hadoop.hbase.HMaster: bootstrap: 
creating ROOT and first META regions
2007-11-08 21:30:07,631 WARN org.apache.hadoop.util.NativeCodeLoader: 
Unable to load native-hadoop library for your platform... using 
builtin-java classes where applicable
2007-11-08 21:30:07,634 INFO org.apache.hadoop.hbase.HLog: new log 
writer created at /home/holger/tmp/hbase/hregion_-70236052/log/hlog.dat.000
2007-11-08 21:30:07,670 INFO org.apache.hadoop.hbase.HRegion: region 
-ROOT-,,0 available
2007-11-08 21:30:07,676 INFO org.apache.hadoop.hbase.HLog: new log 
writer created at /home/holger/tmp/hbase/hregion_1028785192/log/hlog.dat.000
2007-11-08 21:30:07,705 INFO org.apache.hadoop.hbase.HRegion: region 
.META.,,1 available
2007-11-08 21:30:07,782 INFO org.apache.hadoop.hbase.HRegion: closed 
-ROOT-,,0
2007-11-08 21:30:07,785 INFO org.apache.hadoop.hbase.HRegion: closed 
.META.,,1
2007-11-08 21:30:07,814 INFO org.apache.hadoop.hbase.HMaster: HMaster 
initialized on 127.0.0.1:60000
2007-11-08 21:30:07,928 INFO org.mortbay.util.Credential: Checking 
Resource aliases
2007-11-08 21:30:08,121 INFO org.mortbay.http.HttpServer: Version 
Jetty/5.1.4
2007-11-08 21:30:08,122 INFO org.mortbay.util.Container: Started 
HttpContext[/static,/static]
2007-11-08 21:30:08,122 INFO org.mortbay.util.Container: Started 
HttpContext[/logs,/logs]
2007-11-08 21:30:08,979 INFO org.mortbay.util.Container: Started 
[EMAIL PROTECTED]
2007-11-08 21:30:09,081 INFO org.mortbay.util.Container: Started 
WebApplicationContext[/,/]
2007-11-08 21:30:09,084 INFO org.mortbay.http.SocketListener: Started 
SocketListener on 0.0.0.0:60010
2007-11-08 21:30:09,084 INFO org.mortbay.util.Container: Started 
[EMAIL PROTECTED]
2007-11-08 21:30:09,085 INFO org.apache.hadoop.ipc.Server: IPC Server 
listener on 60000: starting
2007-11-08 21:30:09,093 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 0 on 60000: starting
2007-11-08 21:30:09,093 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 1 on 60000: starting
2007-11-08 21:30:09,093 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 2 on 60000: starting
2007-11-08 21:30:09,099 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 4 on 60000: starting
2007-11-08 21:30:09,100 INFO org.apache.hadoop.hbase.HMaster: received 
start message from: 127.0.1.1:41699
2007-11-08 21:30:09,122 INFO org.apache.hadoop.hbase.HRegionServer: Root 
dir: /home/holger/tmp/hbase
2007-11-08 21:30:09,125 INFO org.apache.hadoop.hbase.HLog: new log 
writer created at 
/home/holger/tmp/hbase/log_127.0.1.1_3647403239347086513_41699/hlog.dat.000
2007-11-08 21:30:09,126 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 5 on 60000: starting
2007-11-08 21:30:09,128 INFO org.mortbay.http.HttpServer: Version 
Jetty/5.1.4
2007-11-08 21:30:09,129 INFO org.mortbay.util.Container: Started 
HttpContext[/static,/static]
2007-11-08 21:30:09,129 INFO org.mortbay.util.Container: Started 
HttpContext[/logs,/logs]
2007-11-08 21:30:09,172 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 7 on 60000: starting
2007-11-08 21:30:09,415 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 6 on 60000: starting
2007-11-08 21:30:09,416 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 8 on 60000: starting
2007-11-08 21:30:09,499 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 3 on 60000: starting
2007-11-08 21:30:09,512 INFO org.mortbay.util.Container: Started 
[EMAIL PROTECTED]
2007-11-08 21:30:09,513 INFO org.mortbay.util.Container: Started 
WebApplicationContext[/,/]
2007-11-08 21:30:09,514 INFO org.mortbay.http.SocketListener: Started 
SocketListener on 0.0.0.0:60030
2007-11-08 21:30:09,514 INFO org.mortbay.util.Container: Started 
[EMAIL PROTECTED]
2007-11-08 21:30:09,514 INFO org.apache.hadoop.ipc.Server: IPC Server 
listener on 41699: starting
2007-11-08 21:30:09,514 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 0 on 41699: starting
2007-11-08 21:30:09,515 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 1 on 41699: starting
2007-11-08 21:30:09,515 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 2 on 41699: starting
2007-11-08 21:30:09,515 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 3 on 41699: starting
2007-11-08 21:30:09,515 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 4 on 41699: starting
2007-11-08 21:30:09,515 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 5 on 41699: starting
2007-11-08 21:30:09,515 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 6 on 41699: starting
2007-11-08 21:30:09,515 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 7 on 41699: starting
2007-11-08 21:30:09,516 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 8 on 41699: starting
2007-11-08 21:30:09,516 INFO org.apache.hadoop.hbase.HRegionServer: 
HRegionServer started at: 127.0.1.1:41699
2007-11-08 21:30:09,517 INFO org.apache.hadoop.hbase.HMaster: assigning 
region -ROOT-,,0 to the only server 127.0.1.1:41699
2007-11-08 21:30:09,518 INFO org.apache.hadoop.hbase.HRegionServer: 
MSG_REGION_OPEN : regionname: -ROOT-,,0, startKey: <>, tableDesc: {name: 
-ROOT-, families: {info:={name: info, max versions: 1, compression: 
NONE, in memory: false, max length: 2147483647, bloom filter: none}}}
2007-11-08 21:30:09,527 INFO org.apache.hadoop.hbase.HRegion: region 
-ROOT-,,0 available
2007-11-08 21:30:09,528 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 9 on 41699: starting
2007-11-08 21:30:09,528 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 9 on 60000: starting
2007-11-08 21:30:12,530 INFO org.apache.hadoop.hbase.HMaster: 
127.0.1.1:41699 serving -ROOT-,,0
2007-11-08 21:30:12,532 INFO org.apache.hadoop.hbase.HMaster: 
HMaster.rootScanner scanning meta region regionname: -ROOT-,,0, 
startKey: <>, server: 127.0.1.1:41699}
2007-11-08 21:30:12,560 INFO org.apache.hadoop.hbase.HMaster: 
HMaster.rootScanner scan of meta region regionname: -ROOT-,,0, startKey: 
<>, server: 127.0.1.1:41699} complete
2007-11-08 21:30:15,565 INFO org.apache.hadoop.hbase.HMaster: assigning 
region .META.,,1 to the only server 127.0.1.1:41699
2007-11-08 21:30:15,566 INFO org.apache.hadoop.hbase.HRegionServer: 
MSG_REGION_OPEN : regionname: .META.,,1, startKey: <>, tableDesc: {name: 
.META., families: {info:={name: info, max versions: 1, compression: 
NONE, in memory: false, max length: 2147483647, bloom filter: none}}}
2007-11-08 21:30:15,569 INFO org.apache.hadoop.hbase.HRegion: region 
.META.,,1 available
2007-11-08 21:30:18,580 INFO org.apache.hadoop.hbase.HMaster: 
127.0.1.1:41699 serving .META.,,1
2007-11-08 21:30:18,582 INFO org.apache.hadoop.hbase.HMaster: 
regionname: .META.,,1, startKey: <>, tableDesc: {name: .META., families: 
{info:={name: info, max versions: 1, compression: NONE, in memory: 
false, max length: 2147483647, bloom filter: none}}} open on 127.0.1.1:41699
2007-11-08 21:30:18,582 INFO org.apache.hadoop.hbase.HMaster: updating 
row .META.,,1 in table -ROOT-,,0 with startcode 3647403239347086513 and 
server 127.0.1.1:41699
2007-11-08 21:30:18,587 INFO org.apache.hadoop.hbase.HMaster: 
HMaster.metaScanner scanning meta region regionname: .META.,,1, 
startKey: <>, server: 127.0.1.1:41699}
2007-11-08 21:30:18,595 INFO org.apache.hadoop.hbase.HMaster: 
HMaster.metaScanner scan of meta region regionname: .META.,,1, startKey: 
<>, server: 127.0.1.1:41699} complete
2007-11-08 21:30:20,872 INFO org.apache.hadoop.hbase.HLog: new log 
writer created at /home/holger/tmp/hbase/hregion_414071395/log/hlog.dat.000
2007-11-08 21:30:20,875 INFO org.apache.hadoop.hbase.HRegion: region 
triples,,1194557420863 available
2007-11-08 21:30:20,876 INFO org.apache.hadoop.hbase.HRegion: closed 
triples,,1194557420863
2007-11-08 21:30:20,877 INFO org.apache.hadoop.hbase.HMaster: created 
table triples
2007-11-08 21:30:21,600 INFO org.apache.hadoop.hbase.HMaster: assigning 
region triples,,1194557420863 to the only server 127.0.1.1:41699
2007-11-08 21:30:21,601 INFO org.apache.hadoop.hbase.HRegionServer: 
MSG_REGION_OPEN : regionname: triples,,1194557420863, startKey: <>, 
tableDesc: {name: triples, families: {triples:={name: triples, max 
versions: 3, compression: NONE, in memory: false, max length: 
2147483647, bloom filter: none}}}
2007-11-08 21:30:21,604 INFO org.apache.hadoop.hbase.HRegion: region 
triples,,1194557420863 available
2007-11-08 21:30:24,610 INFO org.apache.hadoop.hbase.HMaster: 
127.0.1.1:41699 serving triples,,1194557420863
2007-11-08 21:30:24,611 INFO org.apache.hadoop.hbase.HMaster: 
regionname: triples,,1194557420863, startKey: <>, tableDesc: {name: 
triples, families: {triples:={name: triples, max versions: 3, 
compression: NONE, in memory: false, max length: 2147483647, bloom 
filter: none}}} open on 127.0.1.1:41699
2007-11-08 21:30:24,611 INFO org.apache.hadoop.hbase.HMaster: updating 
row triples,,1194557420863 in table .META.,,1 with startcode 
3647403239347086513 and server 127.0.1.1:41699
2007-11-08 21:31:12,569 INFO org.apache.hadoop.hbase.HMaster: 
HMaster.rootScanner scanning meta region regionname: -ROOT-,,0, 
startKey: <>, server: 127.0.1.1:41699}
2007-11-08 21:31:12,578 INFO org.apache.hadoop.hbase.HMaster: 
HMaster.rootScanner scan of meta region regionname: -ROOT-,,0, startKey: 
<>, server: 127.0.1.1:41699} complete
2007-11-08 21:31:18,609 INFO org.apache.hadoop.hbase.HMaster: 
HMaster.metaScanner scanning meta region regionname: .META.,,1, 
startKey: <>, server: 127.0.1.1:41699}
2007-11-08 21:31:18,616 INFO org.apache.hadoop.hbase.HMaster: 
HMaster.metaScanner scan of meta region regionname: .META.,,1, startKey: 
<>, server: 127.0.1.1:41699} complete
2007-11-08 21:31:18,616 INFO org.apache.hadoop.hbase.HMaster: all meta 
regions scanned
2007-11-08 21:31:59,240 INFO org.apache.hadoop.hbase.HRegion: Optional 
flush called 10 times when data present without flushing.  Forcing one.
2007-11-08 21:31:59,250 INFO org.apache.hadoop.hbase.HRegionServer: 
Rolling hlog. Number of entries: 61891
2007-11-08 21:31:59,979 INFO org.apache.hadoop.hbase.HLog: new log 
writer created at 
/home/holger/tmp/hbase/log_127.0.1.1_3647403239347086513_41699/hlog.dat.001
2007-11-08 21:32:09,250 INFO org.apache.hadoop.hbase.HRegion: Optional 
flush called 10 times when data present without flushing.  Forcing one.
2007-11-08 21:32:09,270 INFO org.apache.hadoop.hbase.HRegionServer: 
Rolling hlog. Number of entries: 35889
2007-11-08 21:32:09,299 INFO org.apache.hadoop.hbase.HLog: new log 
writer created at 
/home/holger/tmp/hbase/log_127.0.1.1_3647403239347086513_41699/hlog.dat.002
2007-11-08 21:32:09,299 INFO org.apache.hadoop.hbase.HLog: removing old 
log file 
/home/holger/tmp/hbase/log_127.0.1.1_3647403239347086513_41699/hlog.dat.000 
whose highest sequence/edit id is 61894
2007-11-08 21:32:12,580 INFO org.apache.hadoop.hbase.HMaster: 
HMaster.rootScanner scanning meta region regionname: -ROOT-,,0, 
startKey: <>, server: 127.0.1.1:41699}
2007-11-08 21:32:12,832 INFO org.apache.hadoop.hbase.HMaster: 
HMaster.rootScanner scan of meta region regionname: -ROOT-,,0, startKey: 
<>, server: 127.0.1.1:41699} complete
2007-11-08 21:32:18,620 INFO org.apache.hadoop.hbase.HMaster: 
HMaster.metaScanner scanning meta region regionname: .META.,,1, 
startKey: <>, server: 127.0.1.1:41699}
2007-11-08 21:32:18,631 INFO org.apache.hadoop.hbase.HMaster: 
HMaster.metaScanner scan of meta region regionname: .META.,,1, startKey: 
<>, server: 127.0.1.1:41699} complete
2007-11-08 21:32:18,631 INFO org.apache.hadoop.hbase.HMaster: all meta 
regions scanned
2007-11-08 21:32:19,280 INFO org.apache.hadoop.hbase.HRegionServer: 
Rolling hlog. Number of entries: 37596
2007-11-08 21:32:19,564 INFO org.apache.hadoop.hbase.HLog: new log 
writer created at 
/home/holger/tmp/hbase/log_127.0.1.1_3647403239347086513_41699/hlog.dat.003
2007-11-08 21:32:19,564 INFO org.apache.hadoop.hbase.HLog: removing old 
log file 
/home/holger/tmp/hbase/log_127.0.1.1_3647403239347086513_41699/hlog.dat.001 
whose highest sequence/edit id is 97784
2007-11-08 21:32:19,569 INFO org.apache.hadoop.hbase.HLog: removing old 
log file 
/home/holger/tmp/hbase/log_127.0.1.1_3647403239347086513_41699/hlog.dat.002 
whose highest sequence/edit id is 135381
2007-11-08 21:32:24,223 INFO org.apache.hadoop.hbase.HRegion: starting 
compaction on region triples,,1194557420863
2007-11-08 21:32:29,290 INFO org.apache.hadoop.hbase.HRegionServer: 
Rolling hlog. Number of entries: 32824
2007-11-08 21:32:29,536 INFO org.apache.hadoop.hbase.HLog: new log 
writer created at 
/home/holger/tmp/hbase/log_127.0.1.1_3647403239347086513_41699/hlog.dat.004
2007-11-08 21:32:29,536 INFO org.apache.hadoop.hbase.HLog: removing old 
log file 
/home/holger/tmp/hbase/log_127.0.1.1_3647403239347086513_41699/hlog.dat.003 
whose highest sequence/edit id is 168206
2007-11-08 21:32:38,033 INFO org.apache.hadoop.hbase.HRegion: compaction 
completed on region triples,,1194557420863. Took 13sec
2007-11-08 21:32:39,300 INFO org.apache.hadoop.hbase.HRegionServer: 
Rolling hlog. Number of entries: 33651
2007-11-08 21:32:39,556 INFO org.apache.hadoop.hbase.HLog: new log 
writer created at 
/home/holger/tmp/hbase/log_127.0.1.1_3647403239347086513_41699/hlog.dat.005
2007-11-08 21:32:39,556 INFO org.apache.hadoop.hbase.HLog: removing old 
log file 
/home/holger/tmp/hbase/log_127.0.1.1_3647403239347086513_41699/hlog.dat.004 
whose highest sequence/edit id is 201858
2007-11-08 21:32:49,311 INFO org.apache.hadoop.hbase.HRegionServer: 
Rolling hlog. Number of entries: 39000
2007-11-08 21:32:49,598 INFO org.apache.hadoop.hbase.HLog: new log 
writer created at 
/home/holger/tmp/hbase/log_127.0.1.1_3647403239347086513_41699/hlog.dat.006
2007-11-08 21:32:49,598 INFO org.apache.hadoop.hbase.HLog: removing old 
log file 
/home/holger/tmp/hbase/log_127.0.1.1_3647403239347086513_41699/hlog.dat.005 
whose highest sequence/edit id is 240859
2007-11-08 21:32:54,244 INFO org.apache.hadoop.hbase.HRegion: starting 
compaction on region triples,,1194557420863
2007-11-08 21:32:59,321 INFO org.apache.hadoop.hbase.HRegionServer: 
Rolling hlog. Number of entries: 32594
2007-11-08 21:32:59,582 INFO org.apache.hadoop.hbase.HLog: new log 
writer created at 
/home/holger/tmp/hbase/log_127.0.1.1_3647403239347086513_41699/hlog.dat.007
2007-11-08 21:32:59,582 INFO org.apache.hadoop.hbase.HLog: removing old 
log file 
/home/holger/tmp/hbase/log_127.0.1.1_3647403239347086513_41699/hlog.dat.006 
whose highest sequence/edit id is 273454
2007-11-08 21:33:09,331 INFO org.apache.hadoop.hbase.HRegionServer: 
Rolling hlog. Number of entries: 31786
2007-11-08 21:33:09,570 INFO org.apache.hadoop.hbase.HLog: new log 
writer created at 
/home/holger/tmp/hbase/log_127.0.1.1_3647403239347086513_41699/hlog.dat.008
2007-11-08 21:33:09,570 INFO org.apache.hadoop.hbase.HLog: removing old 
log file 
/home/holger/tmp/hbase/log_127.0.1.1_3647403239347086513_41699/hlog.dat.007 
whose highest sequence/edit id is 305242
2007-11-08 21:33:12,591 INFO org.apache.hadoop.hbase.HMaster: 
HMaster.rootScanner scanning meta region regionname: -ROOT-,,0, 
startKey: <>, server: 127.0.1.1:41699}
2007-11-08 21:33:12,620 INFO org.apache.hadoop.hbase.HMaster: 
HMaster.rootScanner scan of meta region regionname: -ROOT-,,0, startKey: 
<>, server: 127.0.1.1:41699} complete
2007-11-08 21:33:18,631 INFO org.apache.hadoop.hbase.HMaster: 
HMaster.metaScanner scanning meta region regionname: .META.,,1, 
startKey: <>, server: 127.0.1.1:41699}
2007-11-08 21:33:18,637 INFO org.apache.hadoop.hbase.HMaster: 
HMaster.metaScanner scan of meta region regionname: .META.,,1, startKey: 
<>, server: 127.0.1.1:41699} complete
2007-11-08 21:33:18,637 INFO org.apache.hadoop.hbase.HMaster: all meta 
regions scanned
2007-11-08 21:33:19,341 INFO org.apache.hadoop.hbase.HRegionServer: 
Rolling hlog. Number of entries: 35120
2007-11-08 21:33:19,343 INFO org.apache.hadoop.hbase.HLog: new log 
writer created at 
/home/holger/tmp/hbase/log_127.0.1.1_3647403239347086513_41699/hlog.dat.009
2007-11-08 21:33:19,885 INFO org.apache.hadoop.hbase.HRegion: compaction 
completed on region triples,,1194557420863. Took 25sec
2007-11-08 21:33:19,909 INFO org.apache.hadoop.hbase.HRegion: Splitting 
triples,,1194557420863 because largest aggregate size is 179.1m and 
desired size is 64.0m
2007-11-08 21:33:19,921 INFO org.apache.hadoop.hbase.HRegion: closed 
triples,,1194557420863
2007-11-08 21:33:19,974 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 8 on 41699, call batchUpdate(triples,,1194557420863, 
9223372036854775807, [EMAIL PROTECTED]) 
from 127.0.1.1:41372: error: 
org.apache.hadoop.hbase.NotServingRegionException: triples,,1194557420863
org.apache.hadoop.hbase.NotServingRegionException: triples,,1194557420863
   at 
org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1325)
   at 
org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1297)
   at 
org.apache.hadoop.hbase.HRegionServer.startUpdate(HRegionServer.java:1238)
   at 
org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1113)
   at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
   at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:379)
   at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)
2007-11-08 21:33:19,997 INFO org.apache.hadoop.hbase.HRegion: region 
triples,,1194557599909 available
2007-11-08 21:33:20,038 INFO org.apache.hadoop.hbase.HRegion: region 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557599909 
available
2007-11-08 21:33:20,038 INFO org.apache.hadoop.hbase.HRegion: Region 
split of triples,,1194557420863 complete; new regions: 
triples,,1194557599909, 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557599909. 
Split took 0sec
2007-11-08 21:33:20,066 INFO org.apache.hadoop.hbase.HRegionServer: 
Updating .META. with region split info
2007-11-08 21:33:20,070 INFO org.apache.hadoop.hbase.HRegionServer: 
region split, META update, and report to master all successful. Old 
region=triples,,1194557420863, new regions: triples,,1194557599909, 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557599909
2007-11-08 21:33:22,922 INFO org.apache.hadoop.hbase.HMaster: region 
triples,,1194557420863 split. New regions are: triples,,1194557599909, 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557599909
2007-11-08 21:33:22,922 INFO org.apache.hadoop.hbase.HMaster: assigning 
region triples,,1194557599909 to the only server 127.0.1.1:41699
2007-11-08 21:33:22,922 INFO org.apache.hadoop.hbase.HMaster: assigning 
region 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557599909 
to the only server 127.0.1.1:41699
2007-11-08 21:33:22,923 INFO org.apache.hadoop.hbase.HRegionServer: 
MSG_REGION_OPEN : regionname: triples,,1194557599909, startKey: <>, 
tableDesc: {name: triples, families: {triples:={name: triples, max 
versions: 3, compression: NONE, in memory: false, max length: 
2147483647, bloom filter: none}}}
2007-11-08 21:33:23,044 INFO org.apache.hadoop.hbase.HRegion: region 
triples,,1194557599909 available
2007-11-08 21:33:23,044 INFO org.apache.hadoop.hbase.HRegionServer: 
MSG_REGION_OPEN : regionname: 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557599909, 
startKey: 
<http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98>, 
tableDesc: {name: triples, families: {triples:={name: triples, max 
versions: 3, compression: NONE, in memory: false, max length: 
2147483647, bloom filter: none}}}
2007-11-08 21:33:23,081 INFO org.apache.hadoop.hbase.HRegion: region 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557599909 
available
2007-11-08 21:33:25,932 INFO org.apache.hadoop.hbase.HMaster: 
127.0.1.1:41699 serving triples,,1194557599909
2007-11-08 21:33:25,932 INFO org.apache.hadoop.hbase.HMaster: 
127.0.1.1:41699 serving 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557599909
2007-11-08 21:33:25,933 INFO org.apache.hadoop.hbase.HMaster: 
regionname: triples,,1194557599909, startKey: <>, tableDesc: {name: 
triples, families: {triples:={name: triples, max versions: 3, 
compression: NONE, in memory: false, max length: 2147483647, bloom 
filter: none}}} open on 127.0.1.1:41699
2007-11-08 21:33:25,933 INFO org.apache.hadoop.hbase.HMaster: updating 
row triples,,1194557599909 in table .META.,,1 with startcode 
3647403239347086513 and server 127.0.1.1:41699
2007-11-08 21:33:25,934 INFO org.apache.hadoop.hbase.HMaster: 
regionname: 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557599909, 
startKey: 
<http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98>, 
tableDesc: {name: triples, families: {triples:={name: triples, max 
versions: 3, compression: NONE, in memory: false, max length: 
2147483647, bloom filter: none}}} open on 127.0.1.1:41699
2007-11-08 21:33:25,934 INFO org.apache.hadoop.hbase.HMaster: updating 
row 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557599909 
in table .META.,,1 with startcode 3647403239347086513 and server 
127.0.1.1:41699
2007-11-08 21:33:35,082 INFO org.apache.hadoop.hbase.HRegion: starting 
compaction on region triples,,1194557599909
2007-11-08 21:33:37,306 INFO org.apache.hadoop.hbase.HRegion: compaction 
completed on region triples,,1194557599909. Took 2sec
2007-11-08 21:33:37,315 INFO org.apache.hadoop.hbase.HRegion: starting 
compaction on region 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557599909
2007-11-08 21:33:54,852 INFO org.apache.hadoop.hbase.HRegion: compaction 
completed on region 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557599909. 
Took 17sec
2007-11-08 21:33:55,054 INFO org.apache.hadoop.hbase.HRegion: Splitting 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557599909 
because largest aggregate size is 140.2m and desired size is 64.0m
2007-11-08 21:33:55,060 INFO org.apache.hadoop.hbase.HRegion: closed 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557599909
2007-11-08 21:33:55,120 INFO org.apache.hadoop.hbase.HRegion: region 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557635054 
available
2007-11-08 21:33:55,137 INFO org.apache.hadoop.hbase.HRegion: region 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/icalt/ZavaletaCGL05,1194557635054 
available
2007-11-08 21:33:55,152 INFO org.apache.hadoop.hbase.HRegion: Region 
split of 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557599909 
complete; new regions: 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557635054, 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/icalt/ZavaletaCGL05,1194557635054. 
Split took 0sec
2007-11-08 21:33:57,095 INFO org.apache.hadoop.hbase.HRegionServer: 
Updating .META. with region split info
2007-11-08 21:33:57,101 INFO org.apache.hadoop.hbase.HRegionServer: 
region split, META update, and report to master all successful. Old 
region=triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557599909, 
new regions: 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557635054, 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/icalt/ZavaletaCGL05,1194557635054
2007-11-08 21:33:57,393 INFO org.apache.hadoop.hbase.HMaster: region 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557599909 
split. New regions are: 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557635054, 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/icalt/ZavaletaCGL05,1194557635054
2007-11-08 21:33:57,393 INFO org.apache.hadoop.hbase.HMaster: assigning 
region 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557635054 
to the only server 127.0.1.1:41699
2007-11-08 21:33:57,393 INFO org.apache.hadoop.hbase.HMaster: assigning 
region 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/icalt/ZavaletaCGL05,1194557635054 
to the only server 127.0.1.1:41699
2007-11-08 21:33:57,394 INFO org.apache.hadoop.hbase.HRegionServer: 
MSG_REGION_OPEN : regionname: 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557635054, 
startKey: 
<http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98>, 
tableDesc: {name: triples, families: {triples:={name: triples, max 
versions: 3, compression: NONE, in memory: false, max length: 
2147483647, bloom filter: none}}}
2007-11-08 21:33:57,402 INFO org.apache.hadoop.hbase.HRegion: region 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557635054 
available
2007-11-08 21:33:57,402 INFO org.apache.hadoop.hbase.HRegionServer: 
MSG_REGION_OPEN : regionname: 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/icalt/ZavaletaCGL05,1194557635054, 
startKey: 
<http://dblp.l3s.de/d2r/resource/publications/conf/icalt/ZavaletaCGL05>, 
tableDesc: {name: triples, families: {triples:={name: triples, max 
versions: 3, compression: NONE, in memory: false, max length: 
2147483647, bloom filter: none}}}
2007-11-08 21:33:57,409 INFO org.apache.hadoop.hbase.HRegion: region 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/icalt/ZavaletaCGL05,1194557635054 
available
2007-11-08 21:33:59,382 INFO org.apache.hadoop.hbase.HRegionServer: 
Rolling hlog. Number of entries: 42792
2007-11-08 21:33:59,383 INFO org.apache.hadoop.hbase.HLog: new log 
writer created at 
/home/holger/tmp/hbase/log_127.0.1.1_3647403239347086513_41699/hlog.dat.010
2007-11-08 21:33:59,383 INFO org.apache.hadoop.hbase.HLog: removing old 
log file 
/home/holger/tmp/hbase/log_127.0.1.1_3647403239347086513_41699/hlog.dat.008 
whose highest sequence/edit id is 340362
2007-11-08 21:34:00,403 INFO org.apache.hadoop.hbase.HMaster: 
127.0.1.1:41699 serving 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557635054
2007-11-08 21:34:00,403 INFO org.apache.hadoop.hbase.HMaster: 
127.0.1.1:41699 serving 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/icalt/ZavaletaCGL05,1194557635054
2007-11-08 21:34:00,404 INFO org.apache.hadoop.hbase.HMaster: 
regionname: 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557635054, 
startKey: 
<http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98>, 
tableDesc: {name: triples, families: {triples:={name: triples, max 
versions: 3, compression: NONE, in memory: false, max length: 
2147483647, bloom filter: none}}} open on 127.0.1.1:41699
2007-11-08 21:34:00,404 INFO org.apache.hadoop.hbase.HMaster: updating 
row 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557635054 
in table .META.,,1 with startcode 3647403239347086513 and server 
127.0.1.1:41699
2007-11-08 21:34:00,412 INFO org.apache.hadoop.hbase.HMaster: 
regionname: 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/icalt/ZavaletaCGL05,1194557635054, 
startKey: 
<http://dblp.l3s.de/d2r/resource/publications/conf/icalt/ZavaletaCGL05>, 
tableDesc: {name: triples, families: {triples:={name: triples, max 
versions: 3, compression: NONE, in memory: false, max length: 
2147483647, bloom filter: none}}} open on 127.0.1.1:41699
2007-11-08 21:34:00,412 INFO org.apache.hadoop.hbase.HMaster: updating 
row 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/icalt/ZavaletaCGL05,1194557635054 
in table .META.,,1 with startcode 3647403239347086513 and server 
127.0.1.1:41699
2007-11-08 21:34:07,150 INFO org.apache.hadoop.ipc.Server: IPC Server 
handler 4 on 41699, call 
batchUpdate(triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557599909, 
9223372036854775807, [EMAIL PROTECTED]) 
from 127.0.1.1:42386: error: 
org.apache.hadoop.hbase.NotServingRegionException: 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557599909
org.apache.hadoop.hbase.NotServingRegionException: 
triples,http://dblp.l3s.de/d2r/resource/publications/conf/date/MalyNOHKS98,1194557599909
   at 
org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1325)
   at 
org.apache.hadoop.hbase.HRegionServer.getRegion(HRegionServer.java:1297)
   at 
org.apache.hadoop.hbase.HRegionServer.startUpdate(HRegionServer.java:1238)
   at 
org.apache.hadoop.hbase.HRegionServer.batchUpdate(HRegionServer.java:1113)
   at sun.reflect.GeneratedMethodAccessor4.invoke(Unknown Source)
   at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
   at java.lang.reflect.Method.invoke(Method.java:597)
   at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:379)
   at org.apache.hadoop.ipc.Server$Handler.run(Server.java:596)

michael stack wrote:
Looks like an hbase issue Holger.

'java.lang.IllegalArgumentException: java.net.URISyntaxException:
Illegal character in scheme name at index 7:
hregion_triples,http://dblp.l3s.de/d2r/resource/publications/conf/dac/ObermeierK88,5315976128113435400
'

Hbase is writing a file to HDFS named 'hregion_triples....'.
Filenames are treated as URIs in HDFS -- as you've learned (painfully)
-- but the filename is not legal; it has a '_' in the scheme name.

Either encode your row names or your update your hbase to TRUNK so you
get the fix for this issue (HADOOP-2056).

Good luck Holger,
St.Ack