Re: Does HBase master process need to do listSnapshots

2019-05-30 Thread Abhishek Gupta
Hi Esteban, Thank you so much for the response, it was indeed the problem. Had a followup question of this, why is this RPC call not respecting the HBase RPC time-out set for 90 seconds by us. Thanks On Thu, May 30, 2019 at 10:59 PM Esteban Gutierrez wrote: > Hello Abhishek, > > The HBase mas

Re: SplitNormalizationPlan SplitPoint

2019-05-30 Thread Austin Heyne
Gladly, thanks for the sanity check. -Austin On 5/30/19 12:45 AM, Stack wrote: Austin: Looks like oversight to me. As you suggest, you'd think the split point -- if present -- would be passed to the admin split call. Mind putting up a patch sir? Thanks, S On Mon, May 27, 2019 at 2:36 PM ahe

Re: [DISCUSS] Publishing hbase binaries with different hadoop release lines

2019-05-30 Thread Andrew Purtell
The separate compatibility modules repo idea is appealing, especially if it can provide a single jar that also shades and includes Hadoop classes and their specific dependencies. This would simplify version specific deployment: Unpack HBase tarball, remove included hbase-hadoop-*.jar, download appr

Re: Does HBase master process need to do listSnapshots

2019-05-30 Thread Esteban Gutierrez
Hello Abhishek, The HBase master UI will try to list the snapshots if there are available. Since GetCompletedSnapshots goes to the filesystem to scan for all the possible snapshots that can take some time depending on the number of snapshots or the load of the NN. thanks, esteban. -- Cloudera,

Does HBase master process need to do listSnapshots

2019-05-30 Thread Abhishek Gupta
Hi, We are trying to debug an issue where multiple listSnapshots calls seem to be running extremely slow RPC calls on HBase Master. These calls appear to be happening from Master node itself. I wanted to understand if there is any Master chore service that needs to periodically do an operation whi

RE: [DISCUSS] Publishing hbase binaries with different hadoop release lines

2019-05-30 Thread Raymond Lau
The idea of a separate repo with compatibility modules sounds appealing. This refinement has several advantages esp if we separate out the "compatibility API" from the actual compatibility module implementation: 1. We can choose certain major release lines of Hadoop and provide modules for tho

Re: [DISCUSS] Publishing hbase binaries with different hadoop release lines

2019-05-30 Thread Sean Busbey
What about moving back to having a per-major-version-of-hadoop compatibility module again that builds against one needed major version all the time? (Presumably with some shell script magic to pick the right one?) that would be preferable imho to e.g. producing main project binary tarballs per Hado