[jira] [Resolved] (HBASE-11622) completebulkload/loadIncrementalHFiles cannot specify table with namespace
[
https://issues.apache.org/jira/browse/HBASE-11622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chia-Ping Tsai resolved HBASE-11622.
Resolution: Duplicate
> completebulkload/loadIncrementalHFiles cannot specify table with namespace
> --
>
> Key: HBASE-11622
> URL: https://issues.apache.org/jira/browse/HBASE-11622
> Project: HBase
> Issue Type: Bug
>Affects Versions: 0.98.0
>Reporter: Jianshi Huang
>Priority: Major
>
> I'm using completebulkload to load 500GB of data to a table (presplitted).
> However, it reports the following errors:
> Looks like completebulkload didn't recognize the namespace part
> (namespace:table).
> Caused by: java.net.URISyntaxException: Relative path in absolute URI:
> grapple:vertices,37.bottom
> at java.net.URI.checkPath(URI.java:1804)
> at java.net.URI.(URI.java:752)
> at org.apache.hadoop.fs.Path.initialize(Path.java:203)
> By looking at the source code of LoadIncrementalHFiles.java, it seems the
> temporary path created for splitting will contain ':',
> The error part should be this:
> String uniqueName = getUniqueName(table.getName());
> HColumnDescriptor familyDesc =
> table.getTableDescriptor().getFamily(item.family);
> Path botOut = new Path(tmpDir, uniqueName + ".bottom");
> Path topOut = new Path(tmpDir, uniqueName + ".top");
> splitStoreFile(getConf(), hfilePath, familyDesc, splitKey,
> botOut, topOut);
> uniqueName will be "namespce:table" so "new Path(...)" will fail.
> A bug?
> P.S.
> Comment from Matteo Bertozzi:
> we don't need the name to be related to the table name.
> We can replace the getUniqueName() using something like this
> String getUniqueName(TableName tableName) {
> String name = UUID.randomUUID().toString().replaceAll("-", "") +
> "," + regionCount.incrementAndGet();
> return name;
> }
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Resolved] (HBASE-11622) completebulkload/loadIncrementalHFiles cannot specify table with namespace
[
https://issues.apache.org/jira/browse/HBASE-11622?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jianshi Huang resolved HBASE-11622.
---
Resolution: Fixed
Release Note: Already fixed by HBASE-11609
completebulkload/loadIncrementalHFiles cannot specify table with namespace
--
Key: HBASE-11622
URL: https://issues.apache.org/jira/browse/HBASE-11622
Project: HBase
Issue Type: Bug
Affects Versions: 0.98.0
Reporter: Jianshi Huang
I'm using completebulkload to load 500GB of data to a table (presplitted).
However, it reports the following errors:
Looks like completebulkload didn't recognize the namespace part
(namespace:table).
Caused by: java.net.URISyntaxException: Relative path in absolute URI:
grapple:vertices,37.bottom
at java.net.URI.checkPath(URI.java:1804)
at java.net.URI.init(URI.java:752)
at org.apache.hadoop.fs.Path.initialize(Path.java:203)
By looking at the source code of LoadIncrementalHFiles.java, it seems the
temporary path created for splitting will contain ':',
The error part should be this:
String uniqueName = getUniqueName(table.getName());
HColumnDescriptor familyDesc =
table.getTableDescriptor().getFamily(item.family);
Path botOut = new Path(tmpDir, uniqueName + .bottom);
Path topOut = new Path(tmpDir, uniqueName + .top);
splitStoreFile(getConf(), hfilePath, familyDesc, splitKey,
botOut, topOut);
uniqueName will be namespce:table so new Path(...) will fail.
A bug?
P.S.
Comment from Matteo Bertozzi:
we don't need the name to be related to the table name.
We can replace the getUniqueName() using something like this
String getUniqueName(TableName tableName) {
String name = UUID.randomUUID().toString().replaceAll(-, ) +
, + regionCount.incrementAndGet();
return name;
}
--
This message was sent by Atlassian JIRA
(v6.2#6252)
