[jira] [Created] (JAMES-2861) [Webadmin] corresponding routes for JMX IMPORTEML command

2019-08-19 Thread Jira
Trần Tiến Đức created JAMES-2861:


 Summary: [Webadmin] corresponding routes for JMX IMPORTEML command
 Key: JAMES-2861
 URL: https://issues.apache.org/jira/browse/JAMES-2861
 Project: James Server
  Issue Type: Improvement
Reporter: Trần Tiến Đức


New Routes for importing EML file into a mailbox:

 
{code:java}
POST /mailboxes/mailbox-id-in-string/messages
 
POST /mailboxes/78585-96969-686568/messages
BODY: eml  
{code}
 

 



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

-
To unsubscribe, e-mail: server-dev-unsubscr...@james.apache.org
For additional commands, e-mail: server-dev-h...@james.apache.org



[jira] [Updated] (JAMES-2860) Read partial blob issue with Scality

2019-08-19 Thread Rene Cordier (Jira)


 [ 
https://issues.apache.org/jira/browse/JAMES-2860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rene Cordier updated JAMES-2860:

Description: 
For some reasons, the test 
readShouldNotReadPartiallyWhenDeletingConcurrentlyBigBlob in DeleteBlobContract 
fails sometimes randomly with the Scality S3 object storage implementation.

It seems sometimes it manages to read partially a blob while deleting it 
concurrently.
 The issue doesn't seem to happen with Swift though...

---

So after having a meeting with people from Scality, this is what we concluded:
 * When there is a delete operation, the blob gets marked as deleted first then 
gets deleted, to avoid an other thread to try to read it same time. So it is a 
bug.
 * this bug was known and seemed to be happening with big blobs in old 
versions. It seems S3 is partitioning blobs when they get bigger than 10MB, and 
that bug was happening then
 * we use an old version of Scality, and since the bug has been fixed on newer 
versions
 * however it seems Scality doesn't maintain anymore docker images on docker 
hub, but the Dockerfile is present on their github

Solution: we need to generate ourselves our own scality docker image with the 
latest changes (v8) and use it instead of the one we actually use (v6)

  was:
For some reasons, the test 
readShouldNotReadPartiallyWhenDeletingConcurrentlyBigBlob in DeleteBlobContract 
fails sometimes randomly with the Scality S3 object storage implementation.


It seems sometimes it manages to read partially a blob while deleting it 
concurrently.
The issue doesn't seem to happen with Swift though...


> Read partial blob issue with Scality
> 
>
> Key: JAMES-2860
> URL: https://issues.apache.org/jira/browse/JAMES-2860
> Project: James Server
>  Issue Type: Bug
>Reporter: Rene Cordier
>Priority: Major
>
> For some reasons, the test 
> readShouldNotReadPartiallyWhenDeletingConcurrentlyBigBlob in 
> DeleteBlobContract fails sometimes randomly with the Scality S3 object 
> storage implementation.
> It seems sometimes it manages to read partially a blob while deleting it 
> concurrently.
>  The issue doesn't seem to happen with Swift though...
> ---
> So after having a meeting with people from Scality, this is what we concluded:
>  * When there is a delete operation, the blob gets marked as deleted first 
> then gets deleted, to avoid an other thread to try to read it same time. So 
> it is a bug.
>  * this bug was known and seemed to be happening with big blobs in old 
> versions. It seems S3 is partitioning blobs when they get bigger than 10MB, 
> and that bug was happening then
>  * we use an old version of Scality, and since the bug has been fixed on 
> newer versions
>  * however it seems Scality doesn't maintain anymore docker images on docker 
> hub, but the Dockerfile is present on their github
> Solution: we need to generate ourselves our own scality docker image with the 
> latest changes (v8) and use it instead of the one we actually use (v6)



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

-
To unsubscribe, e-mail: server-dev-unsubscr...@james.apache.org
For additional commands, e-mail: server-dev-h...@james.apache.org



[jira] [Created] (JAMES-2860) Read partial blob issue with Scality

2019-08-19 Thread Rene Cordier (Jira)
Rene Cordier created JAMES-2860:
---

 Summary: Read partial blob issue with Scality
 Key: JAMES-2860
 URL: https://issues.apache.org/jira/browse/JAMES-2860
 Project: James Server
  Issue Type: Bug
Reporter: Rene Cordier


For some reasons, the test 
readShouldNotReadPartiallyWhenDeletingConcurrentlyBigBlob in DeleteBlobContract 
fails sometimes randomly with the Scality S3 object storage implementation.


It seems sometimes it manages to read partially a blob while deleting it 
concurrently.
The issue doesn't seem to happen with Swift though...



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

-
To unsubscribe, e-mail: server-dev-unsubscr...@james.apache.org
For additional commands, e-mail: server-dev-h...@james.apache.org



[jira] [Commented] (JAMES-2855) James dependencies upgrade 08/2019

2019-08-19 Thread Tellier Benoit (Jira)


[ 
https://issues.apache.org/jira/browse/JAMES-2855?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16910946#comment-16910946
 ] 

Tellier Benoit commented on JAMES-2855:
---

These PR are merged:

 - https://github.com/linagora/james-project/pull/2597 `JAMES-2855 TLD 
Dependency management cleanup`
 - https://github.com/linagora/james-project/pull/2596 `Refactor and reorder 
some dependencies in some submodules pom files`
 - https://github.com/linagora/james-project/pull/2595 `JAMES-2855 Miscaleneous 
library updates`
 - https://github.com/linagora/james-project/pull/2594 `JAMES-8255 rest-assured 
lib upgrade`
 - https://github.com/linagora/james-project/pull/2593 `JAMES-2855 Upgrade 
assertj libs`
 - https://github.com/linagora/james-project/pull/2592 `JAMES-2855 diverses 
testing libs upgrade`
 - https://github.com/linagora/james-project/pull/2590 `JAMES-2855 Remove 
Hadoop & JackRabbit dependencies`
 - https://github.com/linagora/james-project/pull/2589 `JAMES-2855 testing 
containers libs upgrade`
 - https://github.com/linagora/james-project/pull/2588 `JAMES-2855 crypto libs 
upgrade`
 - https://github.com/linagora/james-project/pull/2586 `JAMES-2855 Upgrade 
rabbitmq client, openjpa`
 - https://github.com/linagora/james-project/pull/2585 `JAMES-2855 upgrade some 
maven plugins, and some small dependencies`
 - https://github.com/linagora/james-project/pull/2584 `JAMES-2855 Upgrade 
objectstorage dependencies`
 - https://github.com/linagora/james-project/pull/2583 `JAMES-2855 upgrade 
diverses http related libs`
 - https://github.com/linagora/james-project/pull/2582 `JAMES-2855 Some other 
(performance?) related upgrades`
 - https://github.com/linagora/james-project/pull/2581 `JAMES-2855 Upgrade 
Apache commons libs`
 - https://github.com/linagora/james-project/pull/2579 `JAMES-2855 Upgrade 
Junit`
 - https://github.com/linagora/james-project/pull/2577 `JAMES-2855 Guice and 
Icu4j libs upgrade`
 - https://github.com/linagora/james-project/pull/2576 `JAMES-2855 Upgrade 
reactor, feign`

> James dependencies upgrade 08/2019
> --
>
> Key: JAMES-2855
> URL: https://issues.apache.org/jira/browse/JAMES-2855
> Project: James Server
>  Issue Type: Improvement
>Reporter: Trần Tiến Đức
>Priority: Major
>
> List of the dependencies
> {code:java}
> From: mvn versions:display-dependency-updates | grep -- '->' | sort | uniq -c
>       1 [INFO]        
> net.javacrumbs.future-converter:future-converter-java8-guava    0.3.0 -> 1.2.0
>     223 [INFO]      
> org.apache.karaf.tooling.exam:org.apache.karaf.tooling.exam.container 
> ...2.3.0 -> 3.0.0.RC1
>     223 [INFO]       org.apache.maven.plugin-tools:maven-plugin-annotations 
> ... 3.4 -> 3.6.0
>     223 [INFO]   ch.qos.logback:logback-classic . 1.2.3 -> 
> 1.3.0-alpha4
>     223 [INFO]   ch.qos.logback:logback-core  1.2.3 -> 
> 1.3.0-alpha4
>       1 [INFO]   com.amazonaws:aws-java-sdk-s3 ... 1.11.532 
> -> 1.11.602
>       1 [INFO]   com.datastax.cassandra:cassandra-driver-core .. 
> 3.7.0 -> 4.0.0
>     223 [INFO]   com.fasterxml.jackson.core:jackson-annotations ... 2.9.6 -> 
> 2.10.0.pr1
>     223 [INFO]   com.fasterxml.jackson.core:jackson-core .. 2.9.6 -> 
> 2.10.0.pr1
>     223 [INFO]   com.fasterxml.jackson.core:jackson-databind .. 2.9.6 -> 
> 2.10.0.pr1
> [INFO]   com.fasterxml.jackson.core:jackson-annotations  2.9.6 -> 
> 2.10.0.pr1
> [INFO]   com.fasterxml.jackson.core:jackson-core ... 2.9.6 -> 
> 2.10.0.pr1
> [INFO]   com.fasterxml.jackson.core:jackson-databind ... 2.9.6 -> 
> 2.10.0.pr1
> [INFO]   com.fasterxml.jackson.dataformat:jackson-dataformat-cbor ... 2.9.6 
> -> 2.10.0.pr1
> [INFO]   com.fasterxml.jackson.dataformat:jackson-dataformat-smile ... 2.9.6 
> -> 2.10.0.pr1
> [INFO]   com.fasterxml.jackson.dataformat:jackson-dataformat-xml ... 2.9.6 -> 
> 2.10.0.pr1
> [INFO]   com.fasterxml.jackson.dataformat:jackson-dataformat-yaml ... 2.9.6 
> -> 2.10.0.pr1
> [INFO]   com.fasterxml.jackson.datatype:jackson-datatype-guava ... 2.9.6 -> 
> 2.10.0.pr1
> [INFO]   com.fasterxml.jackson.datatype:jackson-datatype-jdk8 ... 2.9.6 -> 
> 2.10.0.pr1
> [INFO]   com.fasterxml.jackson.datatype:jackson-datatype-joda ... 2.9.6 
> ->2.10.0.pr1
> [INFO]   com.fasterxml.jackson.datatype:jackson-datatype-jsr310 ... 2.9.6 -> 
> 2.10.0.pr1
> [INFO]   com.fasterxml.jackson.jaxrs:jackson-jaxrs-json-provider ... 2.9.6 -> 
> 2.10.0.pr1
> [INFO]   com.fasterxml.jackson.module:jackson-module-afterburner ... 2.9.6 -> 
> 2.10.0.pr1
>     223 [INFO]   org.codehaus.jackson:jackson-core-asl  1.9.2 
> -> 1.9.11
>     223 [INFO]   org.codehaus.jackson:jackson-jaxrs ... 1.9.2 
> -> 1.9.11
>     223 [INFO]   org.codehaus.jackson:jackson-mapper-asl .. 1.9.2 
> -> 

[jira] [Closed] (JAMES-2847) Remove MailRepositoryDeletedMessageVault related code

2019-08-19 Thread Tellier Benoit (Jira)


 [ 
https://issues.apache.org/jira/browse/JAMES-2847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tellier Benoit closed JAMES-2847.
-
Fix Version/s: 3.4.0
   Resolution: Fixed

> Remove MailRepositoryDeletedMessageVault related code
> -
>
> Key: JAMES-2847
> URL: https://issues.apache.org/jira/browse/JAMES-2847
> Project: James Server
>  Issue Type: Improvement
>Reporter: Trần Tiến Đức
>Priority: Major
> Fix For: 3.4.0
>
>
> replace it by the BlobStoreDeletedMessageVault



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

-
To unsubscribe, e-mail: server-dev-unsubscr...@james.apache.org
For additional commands, e-mail: server-dev-h...@james.apache.org



[jira] [Closed] (JAMES-2844) [Webadmin] corresponding routes for JMX REMOVEREGEXMAPPING command

2019-08-19 Thread Tellier Benoit (Jira)


 [ 
https://issues.apache.org/jira/browse/JAMES-2844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tellier Benoit closed JAMES-2844.
-
Resolution: Fixed

https://github.com/linagora/james-project/pull/2549 solved this

> [Webadmin] corresponding routes for JMX REMOVEREGEXMAPPING command
> --
>
> Key: JAMES-2844
> URL: https://issues.apache.org/jira/browse/JAMES-2844
> Project: James Server
>  Issue Type: Improvement
>Reporter: Trần Tiến Đức
>Priority: Minor
>
> you will implement an other route to remove a regex mapping, with the 
> following syntax:
> {code:java}
> DELETE /mappings/regex/{mappingSource}/targets/{regex}{code}
> where:
> {code:java}
> * mappingSource : the source of the mapping
> * regex : the regex that we want to remove the mapping from the source{code}
> * Returns 204, no body on deleted
> * Returns 400 on invalid parameters
> * Returns 500 on server error



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

-
To unsubscribe, e-mail: server-dev-unsubscr...@james.apache.org
For additional commands, e-mail: server-dev-h...@james.apache.org



[jira] [Closed] (JAMES-2831) [Webadmin] corresponding routes for JMX LISTUSERDOMAINMAPPINGS command

2019-08-19 Thread Tellier Benoit (Jira)


 [ 
https://issues.apache.org/jira/browse/JAMES-2831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Tellier Benoit closed JAMES-2831.
-
Fix Version/s: 3.4.0
   Resolution: Fixed

https://github.com/linagora/james-project/pull/2550 solved this

> [Webadmin] corresponding routes for JMX LISTUSERDOMAINMAPPINGS command
> --
>
> Key: JAMES-2831
> URL: https://issues.apache.org/jira/browse/JAMES-2831
> Project: James Server
>  Issue Type: Improvement
>Reporter: Trần Tiến Đức
>Priority: Minor
> Fix For: 3.4.0
>
>
> you will implement the **UserMappingRoutes** which does
>  
> {code:java}
> GET /mappings/user/{username}
> eg.
> GET /mappings/user/b...@james.org
> {code}
>  
> Return 200 status code with a json body represent for a list of 
> **MappingValueDTO**
> {code:java}
> [
>  {
>"type": "alias",
>"mapping": "destination12@address1.domain"
>  },
>  {
>"type": "group",
>"mapping": "destination12@address2.domain"
>  }
> ]{code}
> - Returns 400 status code with invalid parameter values
>  - Returns 500 status code for server error



--
This message was sent by Atlassian Jira
(v8.3.2#803003)

-
To unsubscribe, e-mail: server-dev-unsubscr...@james.apache.org
For additional commands, e-mail: server-dev-h...@james.apache.org



[james-project] branch master updated (68dcf80 -> 5926fe8)

2019-08-19 Thread btellier
This is an automated email from the ASF dual-hosted git repository.

btellier pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/james-project.git.


from 68dcf80  JAMES-2832 RegexMappingRoutes implementation and documentation
 new 15277cd  JAMES-2844 Remove Regex Mapping Implementation + Documentation
 new 4709c6b  JAMES-2844 RemoveRegexMapping correct syntax in documentation
 new dc910d0  JAMES-2831 Implement a new route in MappingRoutes for getting 
all mappings of an user + tests
 new 51606ef  JAMES-2831 Site documentation
 new 938f5b1  JAMES-2847 Remove MailRepository based Deleted Message Vault
 new 17ce441  JAMES-2847 Remove Memory based Deleted Message Vault
 new 4be39d4  JAMES-2847 Remove MailRepository from a log related to the 
vault
 new 1093bbb  JAMES-2847 Split mail processing component initialization
 new fd25a64  JAMES-2855 Upgrade reactor-bom Californium-SR9 -> 
Californium-SR10
 new f2f5aa6  JAMES-2855 Upgrade feign 10.2.0 -> 10.2.3
 new b202bfd  JAMES-2855 Upgrade Guice from 4.2.0 to 4.2.2
 new 4bc73f2  JAMES-2855 Upgrade icu4j from 62.1 to 64.2
 new ec8e49a  JAMES-2855 Upgrade junit 5 dependencies
 new b0aede1  JAMES-2855 Remove unused commons-logging.version variable
 new c026d49  JAMES-2855 Remove commons-logging from dependency management 
POM section
 new a03c737  JAMES-2855 Upgrade commons-daemon 1.1.0 -> 1.2.0
 new 25910a0  JAMES-2855 Upgrade commons-lang3 from 3.7 to 3.9
 new 4cc87ed  JAMES-2855 Upgrade commons-pool2 from 2.6.2 to 2.7.0
 new 9ffe7b0  JAMES-2855 Upgrade commons-text from 1.4 to 1.7
 new af3f12e  JAMES-2855 Upgrade common-collections4 4.2 -> 4.4
 new 24083bc  JAMES-2855 Upgrade common-collections4 4.2 -> 4.4
 new e1c43ea  JAMES-2855 Upgrade jsoup from 1.11.3 to 1.12.1
 new c892c08  JAMES-2855 Upgrade future-converter-java8-guava from 0.3.0 to 
1.2.0
 new 261b566  JAMES-2855 Upgrade Jackson parsing from 2.9.6 to 2.9.9
 new aec2de4  JAMES-2855 Upgrade DNSJava2.1.8 to 2.1.9
 new 7afd415  JAMES-2855 Upgrade Apache Camel from 2.22.1 to 2.24.1
 new 9dbd214  JAMES-2855 Upgrade Cassandra driver to 3.7.2
 new eaee346  JAMES-2855 upgrade jetty 9.4.7.v20170914 -> 9.4.19.v20190610
 new 3cf891c  JAMES-2855 Upgrade spark java 2.8.0 -> 2.9.1
 new cfa0484  JAMES-2855 upgrade logbook 1.9.0 -> 1.13.0
 new ae30494  JAMES-2855 javax.servlet.api upgrade 3.1.0 -> 4.0.1
 new b555ce7  JAMES-2855 remove javax.servlet:servlet-api
 new 76cec6b  JAMES-2855 upgrade javax.ws.rs-api 2.0.1 -> 2.1.1
 new 6726a00  JAMES-2855 upgrade jaxb 2.2.11 -> 2.3.1 and jaxb-core 2.2.11 
-> 2.3.0.1
 new 6a1fb37  JAMES-2855 upgrade apache.httpcomponents 4.5.6 -> 4.5.9
 new aae965f  JAMES-2855 Upgrade aws-java-sdk-s3 1.11.532 -> 1.11.608
 new 9725a26  JAMES-2855 Upgrade google tink 1.2.0 -> 1.2.2
 new 8acb91a  JAMES-2855 Upgrade maven-plugin-annotations 3.4 -> 3.6.0
 new acf9fcc  JAMES-2855 Upgrade swagger-maven-plugin 3.1.7 -> 3.1.8
 new afce97e  JAMES-2855 Upgrade swagger-jaxrs 1.5.21 -> 1.5.22
 new 4ad507d  JAMES-2855 Upgrade maven-plugin-api 3.2.5 -> 3.6.1
 new 0b8019d  JAMES-2855 Upgrade maven-reporting-impl 2.2 -> 3.0.0
 new 50cbcaf  JAMES-2855 Upgrade mustache java compiler 0.9.5 -> 0.9.6
 new 3dd3c3b  JAMES-2855 Upgrade system-rules 1.18.0 -> 1.19.0
 new 6b431c0  JAMES-2855 Upgrade rabbitmq amqp client 5.6.0 -> 5.7.3
 new bd30704  JAMES-2855 Upgrade openjpa 3.0.0 -> 3.1.0
 new 1d8cc9a  JAMES-2855 upgrade jgrapht-core 1.2.0 -> 1.3.1
 new f1df50d  JAMES-2855 upgrade jasypt 1.9.2 -> 1.9.3
 new 36894da  JAMES-2855 bouncycastle upgrade 1.60 -> 1.62
 new 0cafeda  JAMES-2855 Upgrade testcontainers 1.11.1 -> 1.12.0
 new 8d80f71  JAMES-2855 Upgrade mariadb 2.2.6 -> 2.4.3
 new 6ce2850  JAMES-2855 Upgrade docker-client 8.11.7 to 8.16.0
 new 41c9b1c  JAMES-2855 Remove unused hadoop dependency
 new 087e8e1  JAMES-2855 Remove unused JackRabbit dependency
 new 801fb50  JAMES-2855 Upgrade json-unit-assertj 2.0.0.RC1 -> 2.8.0
 new aad3d99  JAMES-2855 Upgrade equalsverifier 2.5.1 -> 3.1.9
 new e40d0a0  JAMES-2855 Upgrade mockito-core 2.21.0 -> 3.0.0
 new 4f61536  JAMES-2855 Upgrade org.awaitility 3.1.2 -> 3.1.6
 new b3ccd4e  JAMES-2855 Remove com.jayway.awaitility in preference for 
org.awaitility
 new cdfba98  JAMES-2855 Upgrade assertj-guava 3.2.0 -> 3.2.1
 new 7ed589d  JAMES-2855 Upgrade assertj-core 3.10.0 -> 3.12.2
 new 6485b7f  JAMES-2855 Fix assertj-core lib upgrade breaking changes
 new 0f60afa  JAMES-2855 Fix issue with attributes field comparison on Mail 
with the upgrade of assertj lib
 new 0cb2f78  JAMES-2855 Upgrade rest-assured 3.1.0 -> 4.0.0
 new cdc5b61  JAMES-2855 Force reset the base path of every new created 
Request with rest-assured
 new 8e0dbfb  JAMES-2855 Upgrade SLF4J to 1.7.27
 new c50bb01  JAMES-285