[
https://issues.apache.org/jira/browse/PIG-2886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13443636#comment-13443636
]
Cheolsoo Park commented on PIG-2886:
------------------------------------
Hi Ted,
Regarding TestHBaseStorage, does it hang in hadoop 20 or 23? I assume that
you're not setting "-Dhadoopversion" so using hadoop 20 by default. In hadoop
20, TestHBaseStorage passes for me with your patch. I.e. "ant clean test
-Dtestcase=TestHBaseStorage -Dhadoopversion=20" passes.
{code}
[junit] Running org.apache.pig.test.TestHBaseStorage
[junit] Tests run: 23, Failures: 0, Errors: 0, Time elapsed: 131.728 sec
{code}
If it doesn't pass for you, it should be some environment issue. (e.g. did you
set umask 0022?)
However, it does time out in hadoop 23, and I believe that it's expected since
hbase jar from the maven repository is not binary compatible with hadoop 23.
I.e. "ant clean test -Dtestcase=TestHBaseStorage -Dhadoopversion=23" fails with
time out error, and the following error can be found in the test log
(build/test/logs/TEST-org.apache.pig.test.TestHBaseStorage.txt):
{code}
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hdfs.protocol.FSConstants$SafeModeAction
at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
... 7 more
{code}
I ran into the same issue while bumping hbase to 0.94, but it seem applied to
0.90 (current version in trunk) as well. Please see HBASE-5680 for more details.
Please anyone corrects me if I am wrong about TestHBaseStorage in hadoop 23.
Thanks!
> Add Scan TimeRange to HBaseStorage
> -----------------------------------
>
> Key: PIG-2886
> URL: https://issues.apache.org/jira/browse/PIG-2886
> Project: Pig
> Issue Type: Bug
> Reporter: Ted Malaska
> Priority: Minor
> Attachments: PIG-2886-0.patch, PIG-2886-1.patch
>
>
> I have a client that wants to use pig. They are using MR now. They can't
> use PIG right now because they only want to fetch the last day's worth of
> data in HBase. A filter with time range would require reading all the HStore
> files. If we hold major compaction until after the fetch and use Scan Time
> Range we only need to read very little in compression.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
