[jira] [Created] (HBASE-19925) Delete an unreachable peer will triggers all regionservers abort
Yun Zhao created HBASE-19925:
Summary: Delete an unreachable peer will triggers all
regionservers abort
Key: HBASE-19925
URL: https://issues.apache.org/jira/browse/HBASE-19925
Project: HBase
Issue Type: Bug
Reporter: Yun Zhao
Add an unreachable peer
{code:java}
add_peer '4', CLUSTER_KEY => "server1.cie.com:2181:/hbase"{code}
After a while to delete it,Regionserver will appear in the following log and
stop.
{code:java}
2018-02-02 20:04:25,959 INFO [main-EventThread.replicationSource,4]
regionserver.ReplicationSource: Replicating
5467de52-dc46-45be-902c-110dd7a83e06 -> null
2018-02-02 20:04:25,960 ERROR
[main-EventThread.replicationSource,4.replicationSource..com%2C16020%2C1515498473547.default,4]
regionserver.ReplicationSource: Unexpected exception in
ReplicationSourceWorkerThread, currentPath=null
java.lang.IllegalArgumentException: Peer with id= 4 is not connected
at
org.apache.hadoop.hbase.replication.ReplicationPeersZKImpl.getStatusOfPeer(ReplicationPeersZKImpl.java:207)
at
org.apache.hadoop.hbase.replication.regionserver.ReplicationSource.isPeerEnabled(ReplicationSource.java:327)
at
org.apache.hadoop.hbase.replication.regionserver.ReplicationSource$ReplicationSourceWorkerThread.run(ReplicationSource.java:512)
2018-02-02 20:04:25,960 INFO
[main-EventThread.replicationSource,4.replicationSource..com%2C16020%2C1515498473547.default,4]
regionserver.HRegionServer: STOPPED: Unexpected exception in
ReplicationSourceWorkerThread{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Created] (HBASE-19226) Limit the reduce tasks number of incremental load
Yun Zhao created HBASE-19226: Summary: Limit the reduce tasks number of incremental load Key: HBASE-19226 URL: https://issues.apache.org/jira/browse/HBASE-19226 Project: HBase Issue Type: Improvement Reporter: Yun Zhao Priority: Minor When using MapReduce job to perform an incremental load into a table,the number of reduce tasks is the current number of regions. If there are too many regions, will lead to network+disk I/O is too large, affecting the real-time request. Need to use a configuration to set a number or ratio? Limit running reduce tasks since [https://issues.apache.org/jira/browse/MAPREDUCE-5583], the old version can only be set reduce number. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (HBASE-19051) Add new split algorithm for num string
Yun Zhao created HBASE-19051:
Summary: Add new split algorithm for num string
Key: HBASE-19051
URL: https://issues.apache.org/jira/browse/HBASE-19051
Project: HBase
Issue Type: Improvement
Reporter: Yun Zhao
Priority: Minor
We will use the reversed sequential number or phone number as the first part of
rowkey, there is no split algorithm to create a pre-split table, only by
specify the split points.
{code}
create 't1','f', SPLITS => ['1','2','3','4','5','6','7','8','9']
{code}
Add new split algorithm DecStringSplit.
{code}
create 't2','f', { NUMREGIONS => 10 , SPLITALGO => 'DecStringSplit' }
{code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (HBASE-18662) The default values for many configuration items in the code are not consistent with hbase-default.xml
Yun Zhao created HBASE-18662:
Summary: The default values for many configuration items in the
code are not consistent with hbase-default.xml
Key: HBASE-18662
URL: https://issues.apache.org/jira/browse/HBASE-18662
Project: HBase
Issue Type: Improvement
Reporter: Yun Zhao
Priority: Minor
Such as
{code}
hbase.ipc.server.callqueue.handler.factor
hbase.regionserver.logroll.errors.tolerated
hbase.regionserver.region.split.policy
zookeeper.session.timeout
hbase.client.retries.number
hbase.client.max.perserver.tasks
hbase.client.keyvalue.maxsize
hbase.normalizer.period
hbase.hstore.blockingStoreFiles
hbase.snapshot.restore.take.failsafe.snapshot
hbase.lease.recovery.dfs.timeout
hbase.rest.filter.classes
hbase.http.max.threads
{code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (HBASE-18660) Remove duplicate code from the checkAndPut method in HTable
Yun Zhao created HBASE-18660: Summary: Remove duplicate code from the checkAndPut method in HTable Key: HBASE-18660 URL: https://issues.apache.org/jira/browse/HBASE-18660 Project: HBase Issue Type: Task Reporter: Yun Zhao Priority: Trivial -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (HBASE-18529) Do not delete the tmp jars dir when load the coprocessor jar
Yun Zhao created HBASE-18529:
Summary: Do not delete the tmp jars dir when load the coprocessor
jar
Key: HBASE-18529
URL: https://issues.apache.org/jira/browse/HBASE-18529
Project: HBase
Issue Type: Bug
Reporter: Yun Zhao
When multi regionserver is deployed on a single server, used default
hbase.local.dir . The tmp jars dir will deleted when one of them is restarted.
Also when multi regionserver start at the same time, the jar in the
copyToLocalFile process may be deleted, causing the coprocessor load failed.
{code}
2017-08-06 20:02:15,326 ERROR [RS_OPEN_REGION--2]
regionserver.RegionCoprocessorHost: Failed to load coprocessor
ENOENT: No such file or directory
at org.apache.hadoop.io.nativeio.NativeIO$POSIX.chmodImpl(Native Method)
at org.apache.hadoop.io.nativeio.NativeIO$POSIX.chmod(NativeIO.java:226)
at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:629)
at
org.apache.hadoop.fs.FilterFileSystem.setPermission(FilterFileSystem.java:467)
at
org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:456)
at
org.apache.hadoop.fs.ChecksumFileSystem.create(ChecksumFileSystem.java:424)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:906)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:887)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:784)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:365)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:338)
at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:289)
at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1968)
at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1937)
at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:1913)
at
org.apache.hadoop.hbase.util.CoprocessorClassLoader.init(CoprocessorClassLoader.java:168)
at
org.apache.hadoop.hbase.util.CoprocessorClassLoader.getClassLoader(CoprocessorClassLoader.java:250)
{code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
[jira] [Created] (HBASE-18436) Add client-side hedged read metrics
Yun Zhao created HBASE-18436: Summary: Add client-side hedged read metrics Key: HBASE-18436 URL: https://issues.apache.org/jira/browse/HBASE-18436 Project: HBase Issue Type: Improvement Reporter: Yun Zhao Priority: Minor Need some metrics to represent indicate read high-availability. +hedgedReadOps -- the number of hedged read that have occurred. +hedgedReadWin -- the number of hedged read returned faster than the original read. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (HBASE-18412) [Shell] Support unset of a list of table configuration
Yun Zhao created HBASE-18412: Summary: [Shell] Support unset of a list of table configuration Key: HBASE-18412 URL: https://issues.apache.org/jira/browse/HBASE-18412 Project: HBase Issue Type: Improvement Reporter: Yun Zhao Assignee: Yun Zhao Priority: Minor Add a method 'table_conf_unset' in admin.rb to reset the configuration as the system default. -- This message was sent by Atlassian JIRA (v6.4.14#64029)
[jira] [Created] (HBASE-18403) [Shell]Truncate permission required
Yun Zhao created HBASE-18403: Summary: [Shell]Truncate permission required Key: HBASE-18403 URL: https://issues.apache.org/jira/browse/HBASE-18403 Project: HBase Issue Type: Improvement Components: shell Reporter: Yun Zhao Priority: Trivial When a user has only (Create) permission to execute truncate, the table will be deleted and not re-created -- This message was sent by Atlassian JIRA (v6.4.14#64029)
