Jeffrey created USERGRID-471: --------------------------------- Summary: Long Pauses and Errors from ES on deleteByQuery Key: USERGRID-471 URL: https://issues.apache.org/jira/browse/USERGRID-471 Project: Usergrid Issue Type: Bug Components: Stack Reporter: Jeffrey Priority: Blocker
When a single thread is doing PUTs against Usergrid, one after the other, ES can time out on deleteByQuery and block the caller. The response time from Usergrid goes from 200ms to ~60s during this time. Note that the error in ES logs indicates a 1 minute timeout. [2015-03-10 17:37:42,947][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:42,947][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:42,948][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:42,948][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:42,949][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:42,949][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:43,007][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:43,008][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:43,008][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:43,008][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:43,008][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:43,008][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:43,008][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:43,012][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:43,013][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:43,013][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:43,013][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:43,013][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:43,013][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:43,013][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:43,072][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:43,073][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:43,073][DEBUG][action.deletebyquery ] [res003sy] observer: timeout notification from cluster service. timeout setting [1m], time since start [1m] [2015-03-10 17:37:43,073][DEBUG][action.deletebyquery -- This message was sent by Atlassian JIRA (v6.3.4#6332)