Josh Elser commented on HBASE-18882:

Good news here, things are actually looking pretty good.
 * 2.7.3-ish Hadoop installation and 3.4.5-ish ZooKeeper installation
 * Latest from 1.2.7 and 2.0.0-beta-2 as of 2018/02/27 or so
 * 5 RegionServers of each. The platform barfed, though, and I ended up with 3 
RS for the 2.0.0 cluster by the end (yay filesystems flipping to R/O)
 * I used {{hbase pe}} to load 500M rows into each. Didn't quite get there on 
the 2.0 cluster for the aforementioned nodes locking up, but got ~470M rows 
 * Then, enabled Kerberos on each with separate KDCs (no cross-trust setup 
 * By copying krb5.conf and the HDFS, YARN, and HBase configuration from teh 
2.0 cluster to the 1.2.7 cluster, I was successfully able to run RowCounter, 
ExportSnapshot, and Export over the large table I had created.
 * Setting {{-Djava.security.krb5.conf}} was the biggest thing. The rest was 
just making sure I picked up the correct configuration directory

$ HBASE_OPTS="-Djava.security.krb5.conf=/etc/krb5-2.conf"  ./bin/hbase --config 
/home/hbase/hbase2-conf/ org.apache.hadoop.hbase.mapreduce.Export TestTable 
$ HBASE_OPTS="-Djava.security.krb5.conf=/etc/krb5-2.conf"  ./bin/hbase --config 
/home/hbase/hbase2-conf/ org.apache.hadoop.hbase.snapshot.ExportSnapshot 
-snapshot tt1 -copy-to /user/hbase/tt1-data -mappers 9
$ HBASE_OPTS="-Djava.security.krb5.conf=/etc/krb5-2.conf"  ./bin/hbase --config 
/home/hbase/hbase2-conf/ org.apache.hadoop.hbase.mapreduce.RowCounter 
Also briefly used the shell with the same trick.

Please holler if there are more tests people can think about. The clusters are 
finite, but I can extend their lifetime for a little bit more if there are more 

> [TEST] Run MR branch-1 jobs against hbase2 cluster
> --------------------------------------------------
>                 Key: HBASE-18882
>                 URL: https://issues.apache.org/jira/browse/HBASE-18882
>             Project: HBase
>          Issue Type: Task
>          Components: mapreduce, test
>            Reporter: stack
>            Assignee: Josh Elser
>            Priority: Major
>             Fix For: 2.0.0
> Ensure this works still. Run all our bundled MR tools at least. Find some 
> custom if time.

This message was sent by Atlassian JIRA

Reply via email to