pankaj72981 commented on issue #1223: HBASE-23739 BoundedRecoveredHFilesOutputSink should read the table de… URL: https://github.com/apache/hbase/pull/1223#issuecomment-594321870 > > Reading table descriptor always from FS wont be good actually, it will cause many RPC to Namenode for same operation from all RS. (Please correct me if wrong) > > Read from master still need rpc to master? Pankaj: Yes, but it wont overload NN. In a large cluster scenario, there will be huge NN RPC if each RS read the table descriptor from FS indivdually. IMHO, we should reduce redundant RPC call to NN. > > > Currently HMaster already load the table decriptors during startup and RS retrieve it. IMO RS should read table descriptor from FS directly only when it fails to retrieve from HM due to incomplete initialization. > > Master use FSTableDesctriptors but not use cache now. It need to retrieve from NN too. Pankaj: Master enable the cache during init.
---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected] With regards, Apache Git Services
