Theoretically I dont think what you are trying to do is correct. I mean the incoming keys are fully ignored and new one is been made at CP layers. When CP is been contacted already the mutations has reached upto that Region. The new RK might be outside the boundary of this region. (As the split happens). Dont know your use case. But I feel like you should handle this conversion of RKs and create new Put in a client tier not at CP.
-Anoop- On Mon, Jan 29, 2018 at 9:44 PM, Ted Yu <[email protected]> wrote: > w.r.t. region split, do you verify that the new rowkey is in the same > region as the rowkey from incoming Put ? > > If not, there is a chance that the new rowkey is in different region which > is going thru split. > > FYI > > On Mon, Jan 29, 2018 at 6:40 AM, Yang Zhang <[email protected]> wrote: > >> Both are the same question. >> I want to prevent the incoming puts and then copy it as one or more new >> puts with different rowkey. >> So when there is only one region, my rowkey will belong to it. But when >> region splited, some rowkeys may not belong to the new region. >> I used to thought HBase will stop new coming puts, finish all of the puts >> in the batch, and then try to split. >> But this maybe not right according to the exception that I got. >> >> BTY , It seems that I can't add put >> to MiniBatchOperationInProgress<Mutation> miniBatchOp. There are only some >> functions for get. >> >> Thank you very much for your help >> >> 2018-01-29 18:46 GMT+08:00 Anoop John <[email protected]>: >> >> > Another related Q was also there.. Can you tell the actual >> > requirement? So the incoming puts you want to change the RKs of that? >> > Or you want to insert those as well as some new cells with a changed >> > RK? >> > >> > -Anoop- >> > >> > On Mon, Jan 29, 2018 at 3:49 PM, Yang Zhang <[email protected]> >> > wrote: >> > > Hello Everyone >> > > >> > > I am using coprocesser to prevent the normal put and replace it >> > > with another rowkey, The method is HRegion.put(). It works fine, but >> when >> > > the region splited, There will be an WrongRegionException. >> > > >> > > 2018-01-28 09:32:51,528 WARN >> > > [B.DefaultRpcServer.handler=21,queue=3,port=60020] >> regionserver.HRegion: >> > > Failed getting lock in batch put, >> > > row=\xF0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x0F\x10\xC5r >> > > org.apache.hadoop.hbase.regionserver.WrongRegionException: Requested >> row >> > > out of range for row lock on HRegion >> > > GISdoop_GeoKey,,1517085124215.341534e84727245f1c67f345c3e467ac., >> > > startKey='', getEndKey()='\xE6G8\x00\x00\x00\x00\x00\x00\x00\x00\x00', >> > > row='\xF0\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x0F\x10\xC5r' >> > > at org.apache.hadoop.hbase.regionserver.HRegion.checkRow( >> > HRegion.java:4677) >> > > at >> > > org.apache.hadoop.hbase.regionserver.HRegion. >> > getRowLock(HRegion.java:4695) >> > > at >> > > org.apache.hadoop.hbase.regionserver.HRegion. >> > doMiniBatchMutation(HRegion.java:2786) >> > > at >> > > org.apache.hadoop.hbase.regionserver.HRegion. >> > batchMutate(HRegion.java:2653) >> > > at >> > > org.apache.hadoop.hbase.regionserver.HRegion. >> > batchMutate(HRegion.java:2589) >> > > at >> > > org.apache.hadoop.hbase.regionserver.HRegion. >> doBatchMutate(HRegion.java: >> > 3192) >> > > at org.apache.hadoop.hbase.regionserver.HRegion.put(HRegion.java:2459) >> > > at site.luoyu.Core.Index.JavaTreeMap.insertPoint(JavaTreeMap.java:287) >> > > at site.luoyu.Core.Index.JavaTreeMap.insertRecord( >> JavaTreeMap.java:256) >> > > at site.luoyu.Core.Observer.IndexCopressor.prePut( >> > IndexCopressor.java:130) >> > > at >> > > org.apache.hadoop.hbase.regionserver.RegionCoprocessorHost.prePut( >> > RegionCoprocessorHost.java:1122) >> > > at >> > > org.apache.hadoop.hbase.regionserver.HRegion. >> doPreMutationHook(HRegion. >> > java:2674) >> > > at >> > > org.apache.hadoop.hbase.regionserver.HRegion. >> > batchMutate(HRegion.java:2649) >> > > at >> > > org.apache.hadoop.hbase.regionserver.HRegion. >> > batchMutate(HRegion.java:2589) >> > > at >> > > org.apache.hadoop.hbase.regionserver.HRegion. >> > batchMutate(HRegion.java:2593) >> > > at >> > > org.apache.hadoop.hbase.regionserver.HRegionServer. >> > doBatchOp(HRegionServer.java:4402) >> > > at >> > > org.apache.hadoop.hbase.regionserver.HRegionServer. >> > doNonAtomicRegionMutation(HRegionServer.java:3584) >> > > at >> > > org.apache.hadoop.hbase.regionserver.HRegionServer. >> > multi(HRegionServer.java:3474) >> > > at >> > > org.apache.hadoop.hbase.protobuf.generated. >> ClientProtos$ClientService$2. >> > callBlockingMethod(ClientProtos.java:30000) >> > > at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:2078) >> > > at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:108) >> > > at >> > > org.apache.hadoop.hbase.ipc.RpcExecutor.consumerLoop( >> > RpcExecutor.java:114) >> > > at org.apache.hadoop.hbase.ipc.RpcExecutor$1.run(RpcExecutor.java:94) >> > > at java.lang.Thread.run(Thread.java:745) >> > > >> > > It is said rowkey is out of region's bound. This Exception is logged >> in >> > > regionserver's log as an warning , I can't catch and handle it. >> > > >> > > According the source code, >> > > RowLock rowLock = null; >> > > try { >> > > rowLock = getRowLock(mutation.getRow(), shouldBlock); >> > > } catch (IOException ioe) { >> > > LOG.warn("Failed getting lock in batch put, row=" >> > > + Bytes.toStringBinary(mutation.getRow()), ioe); >> > > } >> > > >> > > HBase just cache and log this exception , I guess it even didn't remove >> > it >> > > from the batch. So I got so many Exception log and can't put data >> > anymore. >> > > >> > > Why HBase handle this WrongRegionException like this? Anyone can help? >> > > Thanks verymuch. >> > >>
