Re: Syncope and Hikari

2021-01-11 Thread utpal kas
 Thank you Francesco  for the explanation.
Utpal.
On Monday, January 11, 2021, 03:49:09 AM EST, Francesco Chicchiriccò 
 wrote:  
 
  On 07/01/21 19:04, utpal kas wrote:
  
 
 Hello, 
  We are facing an unique situation,  
  The Master.properties file kept under 
(/apache_home/webapps/syncope/WEB-INF/classes/domains) folder has following 
connection properties defined. 
Master.pool.maxActive=20 Master.pool.minIdle=4  
  We enabled the debug log for hikari, and during the provision process we 
observed the syncope/hikari is using only 8 active connections, not sure from 
where this number is coming (MasterDomain.xml's default maxConnection value 
updated to 20 as well).   We are getting timeout failures when the load is 
around 20K users or so and the processing sometimes totally stops midway after 
throwing connection not available exception or sometimes continue (may be due 
to remediation check box is true in pull task), dont know why. We tried both 
Full and Incremental mode. 
  Anything wrongly set interms of connection setting? We are using 2.1.5 v. 
Your guidance is appreciated.   
Hi Utpal,
 nothing unexpected is happening here.
 
When you did build your Maven Syncope-based project to generate WAR artifacts 
for deploy, you should have passed some arguments to mvn, then copied the 
relevant configuration files to the chose deployment directories, as indicated 
by [1], e.g.
 
 $ mvn clean verify \
    -Dconf.directory=/opt/syncope/conf \
    -Dbundles.directory=/opt/syncope/bundles \
    -Dlog.directory=/opt/syncope/log
 $ cp core/target/classes/*properties /opt/syncope/conf
 $ cp console/target/classes/*properties /opt/syncope/conf
 $ cp enduser/target/classes/*properties /opt/syncope/conf
 $ cp enduser/target/classes/customFormAttributes.json /opt/syncope/conf
 $ cp enduser/target/classes/customTemplate.json /opt/syncope/conf
 
 
This means that the relevant Master.properties file (where the Hikari pool 
parameters are set) is *not* the one inside the WAR but rather the one under 
the configured conf.directory - /opt/syncope/conf in the sample above.
 
Same applies to all other files.
 
 
Hope this clarifies.
 Regards.

 
 
[1]http://syncope.apache.org/docs/2.1/reference-guide.html#deployment-directories
 -- 
Francesco Chicchiriccò

Tirasa - Open Source Excellence
http://www.tirasa.net/

Member at The Apache Software Foundation
Syncope, Cocoon, Olingo, CXF, OpenJPA, PonyMail
http://home.apache.org/~ilgrosso/   

Re: Syncope and Hikari

2021-01-11 Thread Francesco Chicchiriccò
On 07/01/21 19:04, utpal kas wrote:
> Hello,
>
> We are facing an unique situation, 
>
> The Master.properties file kept under 
> (/apache_home/webapps/syncope/WEB-INF/classes/domains) folder has following 
> connection properties defined.
>
> Master.pool.maxActive=20
> Master.pool.minIdle=4
>
> We enabled the debug log for hikari, and during the provision process we 
> observed the syncope/hikari is using only 8 active connections, not sure from 
> where this number is coming (MasterDomain.xml's default maxConnection value 
> updated to 20 as well).  
> We are getting timeout failures when the load is around 20K users or so and 
> the processing sometimes totally stops midway after throwing connection not 
> available exception or sometimes continue (may be due to remediation check 
> box is true in pull task), dont know why. We tried both Full and Incremental 
> mode.
>
> Anything wrongly set interms of connection setting? We are using 2.1.5 v. 
> Your guidance is appreciated.

Hi Utpal,
nothing unexpected is happening here.

When you did build your Maven Syncope-based project to generate WAR artifacts 
for deploy, you should have passed some arguments to mvn, then copied the 
relevant configuration files to the chose deployment directories, as indicated 
by [1], e.g.

$ mvn clean verify \
   -Dconf.directory=/opt/syncope/conf \
   -Dbundles.directory=/opt/syncope/bundles \
   -Dlog.directory=/opt/syncope/log
$ cp core/target/classes/*properties /opt/syncope/conf
$ cp console/target/classes/*properties /opt/syncope/conf
$ cp enduser/target/classes/*properties /opt/syncope/conf
$ cp enduser/target/classes/customFormAttributes.json /opt/syncope/conf
$ cp enduser/target/classes/customTemplate.json /opt/syncope/conf

This means that the relevant Master.properties file (where the Hikari pool 
parameters are set) is *not* the one inside the WAR but rather the one under 
the configured conf.directory - /opt/syncope/conf in the sample above.

Same applies to all other files.

Hope this clarifies.
Regards.

[1] 
http://syncope.apache.org/docs/2.1/reference-guide.html#deployment-directories

-- 
Francesco Chicchiriccò

Tirasa - Open Source Excellence
http://www.tirasa.net/

Member at The Apache Software Foundation
Syncope, Cocoon, Olingo, CXF, OpenJPA, PonyMail
http://home.apache.org/~ilgrosso/