On Sat, Jun 11, 2011 at 5:33 PM, Stack <[email protected]> wrote:
> On Sat, Jun 11, 2011 at 6:57 AM, James Hammerton
> <[email protected]> wrote:
> > We've now come up against another problem, namely that on our cluster
> > attempts to merge regions don't seem to do anything. I tested my merging
> > script on a single node pseudo distributed instance where it did merge
> > regions, so I'm not sure what the problem is. On Monday I'll try and get
> > more info about the messages that were appearing when the merges were
> > attempted.
> >
>
>
Hi Stack,
In /var/log/hbase/hbase.log when we try to do a merge we get the following
message:
2011-06-10 17:43:54,911 ERROR util.Merge (Merge.java:main(384)) - exiting
due to error
java.lang.IllegalArgumentException: Wrong FS: hdfs://hdfs-namenode:8020/hbase,
expected: file:///
at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:352)
at org.apache.hadoop.fs.FileSystem.makeQualified(FileSystem.java:264
)
at org.apache.hadoop.fs.FilterFileSystem.makeQualified(
FilterFileSystem.java:79)
at org.apache.hadoop.hbase.util.FSUtils.getRootDir(FSUtils.java:299)
at org.apache.hadoop.hbase.util.MetaUtils.initialize(MetaUtils.java:
89)
at org.apache.hadoop.hbase.util.MetaUtils.<init>(MetaUtils.java:79)
at org.apache.hadoop.hbase.util.Merge.run(Merge.java:102)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
at org.apache.hadoop.hbase.util.Merge.main(Merge.java:382)
We're not quite sure what it means, but it explains why nothing happened.
> I wonder if you made a single region to span N of your troublesome
> regions and then just dumped all the storefiles into, enabled it, and
> then let hbase figure it?
How would I do that?
> It should open all the storefiles. A bunch
> of heavy-duty compactions and some splits should ensue. Could you try
> it over in your test pseudo-distributed setup?
>
St.Ack
>
Regards,
James
--
James Hammerton | Senior Data Mining Engineer
www.mendeley.com/profiles/james-hammerton
Mendeley Limited | London, UK | www.mendeley.com
Registered in England and Wales | Company Number 6419015
