This is an automated email from the ASF dual-hosted git repository.
btellier pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/james-project.git.
from d0f4a63 MAILBOX-380 Bind CassandraEventsDeadLetters inside
cassandra-guice
new 4c234aa Fix typo in cassandra-rabbitmq Dockerfile conf
new c9434d0 Rename instanciate to instantiate
new e29ce6b JAMES-2910 TikaModule should fallback to JsoupTextExtractor
when disabled
new 927e500 JAMES-2910 Extract text from HTML upon ElasticSearch
indexation
new b91c2e1 JAMES-2910 Tika should delegate text extraction to Jsoup
new fba29fa JAMES-2910 Jsoup should also handle all text mediaTypes
new cb8f588 JAMES-2910 Jsoup is more efficient handling inputStream
new 33ecf02 JAMES-2910 Use return early code style within
JsoupTextExtractor
new 96c21ae JAMES-2910 TikaTextExtractorTest shouldn't assert strongly
line breaks
new 06c1702 JAMES-2079 Indexing MimePart header is functionally not
required
new fe6cf8b JAMES-2079 Remove all non-queried IndexableMessage fields
new a5974e6 JAMES-2078 Headers should indexed using nested objects
new 9aa3ef8 JAMES-2080 Explicitly specify attachment mapping in
ElasticSearch
new d5038d3 JAMES-2080 Enable strict mapping for mailbox indexing
new 4707ca9 JAMES-2078
headerSearchShouldIncludeMessageWhenDifferentTypesOnAnIndexedField is fixed
new 68237a8 JAMES-2813 create a task for testing the serialization of
additional information
new bab0ed5 JAMES-2813 add tests to validate that the additional
informations are updated
new 6b473f8 JAMES-2813 add additional information in cassandra task
execution details projection
new 35aeb01 JAMES-2813 handle additional information in event sourcing
task manager
new 0a1a2bf JAMES-2813 add test to validate sequential execution in
RabbitMQWorkqueue
new df998a9 JAMES-2813 serialize error message and exception in Failed
event
new 0155645 JAMES-2813 handle additional information in event sourcing
task manager
new a50aa20 JAMES-2813 add tests to validate that the additional
informations are updated
new 214afec JAMES-2813 add javadoc to MemoryreferenceTask and
MemoryReferenceWithCounterTask
new e569ee9 JAMES-2813 rename InitialisationOperation to
InitializationOperation
new 56f3616 JAMES-2813 move DistributedTaskManagerModule to modules
package
new bbcd66a JAMES-2813 Make it possible to define an
InitilizationOperation without creating a new type
new 9731491 JAMES-2813 bind DistributedTaskManager first tasks for
Webadmin serialization integration tests
new b4dac47 JAMES-2813 Serialization binding for
DeleteMailsFromMailQueueTask
new dfe2cef JAMES-2813 Serialization binding for ReprocessingAllMailsTask
new a0c8a2a JAMES-2813 Serialization binding for ReprocessingOneMailTask
new 86e4891 JAMES-2813 Serialization binding for
SingleMessageReindexingTask
new 7022676 JAMES-2813 Serialization binding for MessageIdReIndexingTask
new 51b1361 JAMES-2813 Serialization binding for UserReindexingTask
new 6b82bbb JAMES-2813 Serialization binding for
DeletedMessagesVaultRestoreTask
new 52cab78 JAMES-2813 Serialization binding for
DeletedMessagesVaultExportTask
new 3e1e93a JAMES-2813 Serialization binding for
ErrorRecoveryIndexationTask
new 7ee5d5e JAMES-2813 Serialization binding for ClearMailQueueTask
new 505ace5 JAMES-2813 Serialization binding for
BlobStoreVaultGarbageCollectionTask
new f2ceccc JAMES-2813 Serialization binding for ClearMailRepositoryTask
new ca4de2c JAMES-2813 Serialization binding for MailboxMergingTask
new f762816 JAMES-2813 Serialization binding for
SingleMailboxReindexingTask
new 6c5f0fc JAMES-2813 Serialization binding for
DeletedMessagesVaultDeleteTask
new 9557ef9 JAMES-2813 Split EventDeadLettersRedeliverTask into 3 tasks +
serialization binding for theses tasks
new ec2cea0 JAMES-2813 plug Schedulers leaks
new 077bf85 JAMES-2886 Test route overriding behavior
new dfb481e JAMES-2886 guice.extension.module should be optional
new f5f2809 JAMES-2886 Swagger routes should be public
new da8d74a JAMES-2886 Allow a user to define custom routes
new a7ee2e5 JAMES-2886 Document extensions.routes in webadmin.properties
new 33ef204 JAMES-2886 Clear documentation for all guice extensions
new c82deaa JAMES-2813 Typo fixes for some javadoc of memory testing tasks
The 52 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../MigrationTaskAdditionalInformationsDTO.java | 5 +-
.../cassandra/migration/MigrationTaskDTO.java | 9 +-
.../migration/MigrationTaskSerializationTest.java | 4 +-
.../destination/conf/extensions.properties | 2 +-
.../destination/conf/webadmin.properties | 7 +-
.../destination/conf/extensions.properties | 2 +-
.../destination/conf/webadmin.properties | 7 +-
.../destination/conf/extensions.properties | 2 +-
.../destination/conf/webadmin.properties | 7 +-
.../destination/conf/extensions.properties | 2 +-
.../cassandra/destination/conf/webadmin.properties | 7 +-
.../destination/conf/extensions.properties | 2 +-
.../jpa/destination/conf/extensions.properties | 2 +-
.../memory/destination/conf/extensions.properties | 2 +-
.../memory/destination/conf/webadmin.properties | 8 +-
.../org/apache/james/mailbox/events/Group.java | 4 +-
mailbox/cassandra/README.txt | 2 +-
...MailboxMergingTaskAdditionalInformationDTO.java | 2 +-
.../cassandra/mail/task/MailboxMergingTaskDTO.java | 9 +-
.../mail/task/MailboxMergingTaskTest.java | 2 +-
.../elasticsearch/MailboxMappingFactory.java | 57 +++-
.../ElasticSearchListeningMessageSearchIndex.java | 1 +
.../elasticsearch/json/HeaderCollection.java | 106 ++++---
.../elasticsearch/json/IndexableMessage.java | 115 +++----
.../elasticsearch/json/JsonMessageConstants.java | 11 +-
.../json/MessageToElasticSearchJson.java | 2 -
.../james/mailbox/elasticsearch/json/MimePart.java | 28 +-
.../elasticsearch/query/CriterionConverter.java | 13 +-
.../ElasticSearchIntegrationTest.java | 2 -
.../elasticsearch/json/HeaderCollectionTest.java | 15 +-
.../elasticsearch/json/IndexableMessageTest.java | 34 +--
.../json/MessageToElasticSearchJsonTest.java | 52 ++--
.../src/test/resources/eml/htmlContent.txt | 26 ++
mailbox/memory/pom.xml | 5 -
.../BlobStoreVaultGarbageCollectionTaskDTO.java | 7 +-
...aultGarbageCollectionTaskSerializationTest.java | 2 +-
mailbox/store/pom.xml | 5 +
.../store/extractor}/JsoupTextExtractor.java | 38 ++-
.../store/extractor}/JsoupTextExtractorTest.java | 35 ++-
.../src/test/resources/documents/html.txt | 0
...ithNonIndexableAttachmentWithoutAttachment.json | 84 ++----
mailbox/store/src/test/resources/eml/htmlMail.json | 201 ++++++-------
mailbox/store/src/test/resources/eml/mail.json | 256 ++++++++--------
.../store/src/test/resources/eml/nonTextual.json | 67 +++--
.../src/test/resources/eml/pgpSignedMail.json | 266 ++++++++---------
.../src/test/resources/eml/recursiveMail.json | 196 ++++--------
.../eml/recursiveMailWithoutAttachments.json | 115 +++----
mailbox/store/src/test/resources/eml/spamMail.json | 233 ++++++---------
mailbox/tika/pom.xml | 4 +
.../james/mailbox/tika/TikaTextExtractor.java | 6 +
.../james/mailbox/tika/TikaTextExtractorTest.java | 65 ++--
.../mailbox/tools/copier/MailboxCopierTest.java | 56 ++--
.../tools/indexer/ErrorRecoveryIndexationTask.java | 2 +-
.../indexer/ErrorRecoveryIndexationTaskDTO.java | 5 +-
.../mailbox/tools/indexer/FullReindexingTask.java | 24 +-
.../tools/indexer/MessageIdReIndexingTask.java | 1 +
...geIdReindexingTaskAdditionalInformationDTO.java | 18 +-
.../tools/indexer/MessageIdReindexingTaskDTO.java | 7 +-
.../indexer/ReprocessingContextInformation.java | 10 +-
.../indexer/ReprocessingContextInformationDTO.java | 33 ++-
...lboxReindexingTaskAdditionalInformationDTO.java | 25 +-
.../indexer/SingleMailboxReindexingTaskDTO.java | 7 +-
...sageReindexingTaskAdditionalInformationDTO.java | 18 +-
.../indexer/SingleMessageReindexingTaskDTO.java | 7 +-
...UserReindexingTaskAdditionalInformationDTO.java | 25 +-
.../tools/indexer/UserReindexingTaskDTO.java | 7 +-
...rorRecoveryIndexationTaskSerializationTest.java | 11 +-
.../FullReindexingTaskSerializationTest.java | 12 +-
.../MessageIdReindexingTaskSerializationTest.java | 6 +-
...ngleMailboxReindexingTaskSerializationTest.java | 6 +-
...ngleMessageReindexingTaskSerializationTest.java | 6 +-
.../UserReindexingTaskSerializationTest.java | 6 +-
.../org/apache/james/CassandraJamesServerMain.java | 8 +-
.../modules/data/CassandraDomainListModule.java | 8 +-
.../data/CassandraRecipientRewriteTableModule.java | 6 +-
.../data/CassandraUsersRepositoryModule.java | 8 +-
.../mailbox/ElasticSearchMailboxModule.java | 6 +-
.../mailbox/ElasticSearchQuotaSearcherModule.java | 6 +-
.../james/modules/mailbox/TikaMailboxModule.java | 6 +-
.../modules/metrics/CassandraMetricsModule.java | 6 +-
.../CassandraMessageIdManagerInjectionTest.java | 6 +-
.../james/data/LdapUsersRepositoryModule.java | 8 +-
.../james/CassandraRabbitMQJamesServerMain.java | 10 +-
.../DistributedTaskManagerModule.java | 28 +-
.../james/modules/TaskSerializationModule.java | 330 +++++++++++++++++++++
.../modules/event/RabbitMQEventBusModule.java | 6 +-
...Operation.java => InitializationOperation.java} | 4 +-
.../utils/InitilizationOperationBuilder.java} | 42 ++-
.../server/ElasticSearchMetricReporterModule.java | 6 +-
.../apache/james/modules/CommonServicesModule.java | 2 -
.../james/modules/server/DNSServiceModule.java | 8 +-
.../modules/server/DropWizardMetricsModule.java | 10 +-
.../modules/server/GuiceMailRepositoryLoader.java | 2 +-
.../modules/server/MailStoreRepositoryModule.java | 8 +-
.../james/utils/GuiceProtocolHandlerLoader.java | 2 +-
.../james/utils/InitializationOperations.java | 22 +-
.../modules/InitializationOperationsTest.java | 14 +-
.../apache/james/utils/ExtensionConfiguration.java | 5 +-
.../org/apache/james/utils/GuiceGenericLoader.java | 12 +-
.../james/modules/server/JMXServerModule.java | 10 +-
.../james/modules/data/JPADomainListModule.java | 8 +-
.../data/JPARecipientRewriteTableModule.java | 6 +-
.../modules/data/JPAUsersRepositoryModule.java | 8 +-
.../java/org/apache/james/JPAJamesServerMain.java | 2 +
.../java/org/apache/james/JPAJamesServerMain.java | 4 +-
.../james/modules/mailbox/DefaultEventModule.java | 6 +-
.../modules/mailbox/MailboxListenerFactory.java | 2 +-
.../modules/mailbox/PreDeletionHookLoaderImpl.java | 2 +-
.../modules/server/CamelMailetContainerModule.java | 18 +-
.../org/apache/james/utils/GuiceMailetLoader.java | 2 +-
.../org/apache/james/utils/GuiceMatcherLoader.java | 2 +-
server/container/guice/memory-guice/pom.xml | 6 +
.../org/apache/james/MemoryJamesServerMain.java | 4 +-
.../james/modules/data/MemoryDataJmapModule.java | 2 +-
.../james/modules/data/MemoryDataModule.java | 16 +-
.../james/modules/mailbox/MemoryMailboxModule.java | 2 +-
.../org/apache/james/GuiceJamesServerTest.java | 8 +-
.../src/test/java/org/apache/james/MyRoute.java} | 17 +-
...rTest.java => WebAdminRoutesExtensionTest.java} | 39 ++-
.../james/modules/protocols/IMAPServerModule.java | 8 +-
.../modules/protocols/JMAPDraftServerModule.java | 8 +-
.../james/modules/protocols/LMTPServerModule.java | 8 +-
.../modules/protocols/ManageSieveServerModule.java | 8 +-
.../james/modules/protocols/POP3ServerModule.java | 8 +-
.../james/modules/protocols/SMTPServerModule.java | 8 +-
server/container/guice/protocols/webadmin/pom.xml | 4 +
.../modules/server/HealthCheckRoutesModule.java | 4 +-
.../james/modules/server/WebAdminServerModule.java | 42 ++-
...urcesMigrationTaskAdditionalInformationDTO.java | 8 +-
...pingsSourcesMigrationTaskSerializationTest.java | 3 +-
.../api/filtering/FilteringManagementContract.java | 22 +-
.../rrt/lib/AbstractRecipientRewriteTableTest.java | 2 +-
.../mailets/remote/delivery/DeliveryRunnable.java | 4 +-
.../integration/AuthorizedEndpointsTest.java | 9 +
...dminServerTaskSerializationIntegrationTest.java | 11 +-
.../CassandraMappingsSolveInconsistenciesTask.java | 7 +-
...sandraMappingsSolveInconsistenciesTaskTest.java | 2 +-
.../james/webadmin/WebAdminConfiguration.java | 31 +-
.../org/apache/james/webadmin/WebAdminServer.java | 34 ++-
.../apache/james/webadmin/WebAdminServerTest.java | 102 +++++++
.../org/apache/james/webadmin/WebAdminUtils.java | 19 +-
.../routes/DeletedMessagesVaultDeleteTask.java | 2 +-
...gesVaultDeleteTaskAdditionalInformationDTO.java | 18 +-
.../routes/DeletedMessagesVaultDeleteTaskDTO.java | 7 +-
.../routes/DeletedMessagesVaultExportTaskDTO.java | 7 +-
.../routes/DeletedMessagesVaultRestoreTaskDTO.java | 8 +-
...edMessagesVaultDeleteTaskSerializationTest.java | 4 +-
...edMessagesVaultExportTaskSerializationTest.java | 2 +-
...dMessagesVaultRestoreTaskSerializationTest.java | 2 +-
.../WebadminApiQuerySerializationContractTest.java | 2 +-
....java => EventDeadLettersRedeliverAllTask.java} | 58 +---
...va => EventDeadLettersRedeliverAllTaskDTO.java} | 21 +-
...ava => EventDeadLettersRedeliverGroupTask.java} | 62 ++--
... => EventDeadLettersRedeliverGroupTaskDTO.java} | 36 ++-
....java => EventDeadLettersRedeliverOneTask.java} | 64 ++--
...va => EventDeadLettersRedeliverOneTaskDTO.java} | 43 ++-
...LettersRedeliveryTaskAdditionalInformation.java | 60 ++++
...tersRedeliveryTaskAdditionalInformationDTO.java | 74 ++++-
.../webadmin/service/EventDeadLettersService.java | 6 +-
.../routes/EventDeadLettersRoutesTest.java | 10 +-
.../service/EventDeadLettersRedeliverTaskTest.java | 110 ++++---
...ClearMailQueueTaskAdditionalInformationDTO.java | 2 +-
.../webadmin/service/ClearMailQueueTaskDTO.java | 9 +-
.../service/DeleteMailsFromMailQueueTaskDTO.java | 6 +-
.../webadmin/service/ClearMailQueueTaskTest.java | 6 +-
.../service/DeleteMailsFromMailQueueTaskTest.java | 8 +-
.../webadmin/service/ClearMailRepositoryTask.java | 18 ++
...MailRepositoryTaskAdditionalInformationDTO.java | 2 +-
.../service/ClearMailRepositoryTaskDTO.java | 15 +-
.../service/ReprocessingAllMailsTaskDTO.java | 8 +-
...cessingOneMailTaskAdditionalInformationDTO.java | 2 +-
.../service/ReprocessingOneMailTaskDTO.java | 8 +-
.../service/ClearMailRepositoryTaskTest.java | 9 +-
.../service/ReprocessingAllMailsTaskTest.java | 6 +-
.../service/ReprocessingOneMailTaskTest.java | 6 +-
.../queue/rabbitmq/RabbitMQMailQueueFactory.java | 8 +-
.../apache/james/task/TaskExecutionDetails.scala | 35 +--
.../org/apache/james/task/MemoryReferenceTask.java | 6 +
.../james/task/MemoryReferenceWithCounterTask.java | 92 ++++++
.../org/apache/james/task/TaskManagerContract.java | 61 ++++
.../distributed/RabbitMQExclusiveConsumer.java | 6 +-
.../distributed/RabbitMQWorkQueue.java | 39 ++-
.../distributed/TasksSerializationModule.java | 37 ++-
.../CassandraTaskExecutionDetailsProjection.scala | 3 +-
...assandraTaskExecutionDetailsProjectionDAO.scala | 53 ++--
.../distributed/RabbitMQWorkQueueSupplier.scala | 3 +-
.../eventsourcing/distributed/TaskEventDTO.scala | 50 +++-
...andraTaskExecutionDetailsProjectionDAOTest.java | 4 +-
...assandraTaskExecutionDetailsProjectionTest.java | 9 +-
.../distributed/DistributedTaskManagerTest.java | 14 +-
.../RabbitMQTerminationSubscriberTest.java | 4 +-
.../distributed/RabbitMQWorkQueueTest.java | 31 +-
.../distributed/TaskEventsSerializationTest.java | 26 +-
.../JsonTaskAdditionalInformationsSerializer.java | 3 +-
.../james/server/task/json/JsonTaskSerializer.java | 3 +-
...nceWithCounterTaskAdditionalInformationDTO.java | 40 +--
...java => MemoryReferenceWithCounterTaskDTO.java} | 8 +-
...va => MemoryReferenceWithCounterTaskStore.java} | 12 +-
.../server/task/json/dto/TestTaskDTOModules.java | 12 +-
.../org/apache/james/task/MemoryTaskManager.java | 21 +-
.../apache/james/task/SerialTaskManagerWorker.java | 20 +-
.../org/apache/james/task/TaskManagerWorker.java | 13 +-
.../james/task/eventsourcing/CommandHandlers.scala | 6 +-
.../eventsourcing/EventSourcingTaskManager.scala | 4 +-
.../apache/james/task/eventsourcing/Events.scala | 17 +-
.../james/task/eventsourcing/TaskAggregate.scala | 13 +-
.../james/task/eventsourcing/TaskCommand.scala | 43 +--
.../TaskExecutionDetailsProjection.scala | 7 +-
.../task/eventsourcing/WorkerStatusListener.scala | 23 +-
.../james/task/SerialTaskManagerWorkerTest.java | 9 +-
.../TerminationSubscriberContract.java | 8 +-
.../james/task/TaskExecutionDetailsFixture.scala | 12 +-
src/site/xdoc/server/config-webadmin.xml | 3 +
src/site/xdoc/server/dev-extend-mailet.xml | 96 +++---
src/site/xdoc/server/dev-extend.xml | 55 ++++
215 files changed, 3056 insertions(+), 2075 deletions(-)
create mode 100644 mailbox/elasticsearch/src/test/resources/eml/htmlContent.txt
rename mailbox/{memory/src/main/java/org/apache/james/mailbox/inmemory =>
store/src/main/java/org/apache/james/mailbox/store/extractor}/JsoupTextExtractor.java
(60%)
rename mailbox/{memory/src/test/java/org/apache/james/mailbox/inmemory =>
store/src/test/java/org/apache/james/mailbox/store/extractor}/JsoupTextExtractorTest.java
(58%)
rename mailbox/{memory => store}/src/test/resources/documents/html.txt (100%)
rename
server/container/guice/cassandra-rabbitmq-guice/src/main/java/org/apache/james/{
=> modules}/DistributedTaskManagerModule.java (65%)
create mode 100644
server/container/guice/cassandra-rabbitmq-guice/src/main/java/org/apache/james/modules/TaskSerializationModule.java
rename
server/container/guice/configuration/src/main/java/org/apache/james/utils/{InitialisationOperation.java
=> InitializationOperation.java} (93%)
copy
server/container/guice/{guice-common/src/main/java/org/apache/james/utils/Startables.java
=>
configuration/src/main/java/org/apache/james/utils/InitilizationOperationBuilder.java}
(59%)
copy
server/container/guice/{jpa-guice/src/test/java/org/apache/james/JPAJamesServerWithSqlValidationTest.java
=> memory-guice/src/test/java/org/apache/james/MyRoute.java} (76%)
copy
server/container/guice/memory-guice/src/test/java/org/apache/james/{DefaultMemoryJamesServerTest.java
=> WebAdminRoutesExtensionTest.java} (61%)
copy
server/protocols/webadmin/webadmin-mailbox/src/main/java/org/apache/james/webadmin/service/{EventDeadLettersRedeliverTask.java
=> EventDeadLettersRedeliverAllTask.java} (59%)
copy
server/protocols/webadmin/webadmin-mailbox/src/main/java/org/apache/james/webadmin/service/{EventDeadLettersRedeliverTaskDTO.java
=> EventDeadLettersRedeliverAllTaskDTO.java} (72%)
copy
server/protocols/webadmin/webadmin-mailbox/src/main/java/org/apache/james/webadmin/service/{EventDeadLettersRedeliverTask.java
=> EventDeadLettersRedeliverGroupTask.java} (61%)
copy
server/protocols/webadmin/webadmin-mailbox/src/main/java/org/apache/james/webadmin/service/{EventDeadLettersRedeliverTaskDTO.java
=> EventDeadLettersRedeliverGroupTaskDTO.java} (57%)
rename
server/protocols/webadmin/webadmin-mailbox/src/main/java/org/apache/james/webadmin/service/{EventDeadLettersRedeliverTask.java
=> EventDeadLettersRedeliverOneTask.java} (64%)
rename
server/protocols/webadmin/webadmin-mailbox/src/main/java/org/apache/james/webadmin/service/{EventDeadLettersRedeliverTaskDTO.java
=> EventDeadLettersRedeliverOneTaskDTO.java} (51%)
create mode 100644
server/protocols/webadmin/webadmin-mailbox/src/main/java/org/apache/james/webadmin/service/EventDeadLettersRedeliveryTaskAdditionalInformation.java
create mode 100644
server/task/task-api/src/test/java/org/apache/james/task/MemoryReferenceWithCounterTask.java
copy
backends-common/cassandra/src/main/java/org/apache/james/backends/cassandra/migration/MigrationTaskAdditionalInformationsDTO.java
=>
server/task/task-json/src/test/java/org/apache/james/server/task/json/dto/MemoryReferenceWithCounterTaskAdditionalInformationDTO.java
(54%)
copy
server/task/task-json/src/test/java/org/apache/james/server/task/json/dto/{MemoryReferenceTaskDTO.java
=> MemoryReferenceWithCounterTaskDTO.java} (85%)
copy
server/task/task-json/src/test/java/org/apache/james/server/task/json/dto/{MemoryReferenceTaskStore.java
=> MemoryReferenceWithCounterTaskStore.java} (82%)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]