Thanks Andrew. 

+1 for the second option, I will create a jira for this change.

Huaxiang

> On Feb 7, 2018, at 9:25 AM, Huaxiang Sun <h...@cloudera.com> wrote:
> 
> Hi Mike,
> 
>    You are right. For rpc throttling, definitely it is retryable. For storage 
> quota, I think it will be fail faster (non-retryable).
>    We probably need to separate these two types of exceptions, I will do some 
> more research and follow up.
> 
>    Thanks,
>    Huaxiang
> 
>> On Feb 7, 2018, at 9:16 AM, Mike Drob <md...@apache.org> wrote:
>> 
>> I think, philosophically, there can be two kinds of QEE -
>> 
>> For throttling, we can retry. The quota is a temporal quota - you have done
>> too many operations this minute, please try again next minute and
>> everything will work.
>> For storage, we shouldn't retry. The quota is a fixed quote - you have
>> exceeded your allotted disk space, please do not try again until you have
>> remedied the situation.
>> 
>> Our current usage conflates the two, sometimes it is correct, sometimes not.
>> 
>> On Wed, Feb 7, 2018 at 11:00 AM, Huaxiang Sun <h...@cloudera.com> wrote:
>> 
>>> Hi Stack,
>>> 
>>>   I run into a case that a mapreduce job in hive cannot finish because
>>> it runs into a QEE.
>>> I need to look into the hive mr task to see if QEE is not handled
>>> correctly in hbase code or in hive code.
>>> 
>>>  I am thinking that if  QEE is a retryable exception, then it should be
>>> taken care of by the hbase code.
>>>  I will check more and report back.
>>> 
>>>  Thanks,
>>>  Huaxiang
>>> 
>>>> On Feb 7, 2018, at 8:23 AM, Stack <st...@duboce.net> wrote:
>>>> 
>>>> QEE being a DNRIOE seems right on the face of it.
>>>> 
>>>> But if throttling, a DNRIOE is inappropriate. Where you seeing a QEE in a
>>>> throttling scenario Huaxiang?
>>>> 
>>>> Thanks,
>>>> S
>>>> 
>>>> 
>>>> On Tue, Feb 6, 2018 at 4:56 PM, Huaxiang Sun <h...@cloudera.com> wrote:
>>>> 
>>>>> Hi HBase devs,
>>>>> 
>>>>>  I found that QuotaExceededException  is a DoNotRetryIOException,
>>> which
>>>>> is a bit strange from user’s point of view.
>>>>>  For rpc throttling, the exception is retryable and it tells app to
>>>>> slow down and retry later.
>>>>> 
>>>>>  Any thoughts?
>>>>> 
>>>>>  Thanks,
>>>>>  Huaxiang
>>> 
>>> 
> 

Reply via email to