Benoit Tellier created JAMES-3453:
-------------------------------------
Summary: event-dead-letters-redeliver-all task blew up Cassandra
Key: JAMES-3453
URL: https://issues.apache.org/jira/browse/JAMES-3453
Project: James Server
Issue Type: Bug
Components: cassandra
Reporter: Benoit Tellier
{code:java}
$ curl -XGET http://127.0.0.1:8000/tasks/d6481452-0868-400c-bc7c-0a5e48350fbc |
jq
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 547 0 547 0 0 6702 0 --:--:-- --:--:-- --:--:-- 6753
{
"additionalInformation": {
"type": "event-dead-letters-redeliver-all",
"successfulRedeliveriesCount": 0,
"failedRedeliveriesCount": 0,
"group": null,
"insertionId": null,
"timestamp": "2020-11-24T05:07:12.243412Z"
},
"status": "canceledRequested",
"taskId": "d6481452-0868-400c-bc7c-0a5e48350fbc",
"startedDate": "2020-11-24T05:07:12.275+0000",
"canceledDate": "2020-11-24T05:45:16.069+0000",
"submitDate": "2020-11-24T05:07:12.183+0000",
"submittedFrom": "linagora.com",
"executedOn": "linagora.com",
"cancelledFrom": "linagora.com",
"type": "event-dead-letters-redeliver-all"
}
{code}
Manually aborted.
There was a failure, that did NOT marked the task as canceled:
{code:java}
[ERROR] o.a.j.t.SerialTaskManagerWorker - Error while running task
TaskId{value=d6481452-0868-400c-bc7c-0a5e48350fbc}
=> com.datastax.driver.core.exceptions.NoHostAvailableException
{code}
All subsequent tasks failed (cassandra driver pool, and Cassandra server did
not recover yet).
{code:java}
[ERROR] o.a.j.t.e.d.RabbitMQWorkQueue - Unable to process taskId
Optional[b74d18c5-de25-404e-aabf-45dffa505318]
[ERROR] o.a.j.t.e.d.RabbitMQWorkQueue - Unable to deserialize submitted Task
b74d18c5-de25-404e-aabf-45dffa505318
{code}
The usual suspect: 3 nested reactor flatMaps calls overwhelming the Cassandra
driver.
We should use lower defaults for Reactor flatmaps, and move away from the
implicit query parameters...
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
