Re: [cas-user] Server load w/ 4.2.6

2016-10-17 Thread Tom Poage 

> On Oct 15, 2016, at 11:23 AM, Tom Poage  wrote:
> 
> This email I sent looks like it got stuck in Google yesterday for nearly 
> 2-1/2 hours before delivery (cf. Received lines in mail header). List 
> maintainers: Two followup emails I sent yesterday mid-day on this topic still 
> have not been delivered.

Example of email hold up: Friday 2347Z to Monday 0812Z. The Received trace 
suggests servers in network 10. belong to Google:

> X-Received: by 10.157.0.4 with SMTP id 4mr6139581ota.80.1476691968295;
> Mon, 17 Oct 2016 01:12:48 -0700 (PDT)
> X-BeenThere: cas-user@apereo.org
> Received: by 10.157.15.174 with SMTP id d43ls12332979otd.11.gmail; Mon, 17 Oct
>  2016 01:12:47 -0700 (PDT)
> X-Received: by 10.157.50.165 with SMTP id u34mr6693969otb.45.1476691967039;
> Mon, 17 Oct 2016 01:12:47 -0700 (PDT)
> Received: by 10.202.244.67 with SMTP id s64msoih;
> Fri, 14 Oct 2016 16:51:47 -0700 (PDT)
> X-Received: by 10.99.113.25 with SMTP id m25mr18200910pgc.173.1476489107284;
> Fri, 14 Oct 2016 16:51:47 -0700 (PDT)
> Received: from smtp3.ucdavis.edu (smtp3.ucdavis.edu. [128.120.32.129])
> by mx.google.com with ESMTPS id 
> i84si20253377pfi.299.2016.10.14.16.51.47
> for 
> (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128);
> Fri, 14 Oct 2016 16:51:47 -0700 (PDT)


-- 
CAS gitter chatroom: https://gitter.im/apereo/cas
CAS mailing list guidelines: https://apereo.github.io/cas/Mailing-Lists.html
CAS documentation website: https://apereo.github.io/cas
CAS project website: https://github.com/apereo/cas
--- 
You received this message because you are subscribed to the Google Groups "CAS 
Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to cas-user+unsubscr...@apereo.org.
To post to this group, send email to cas-user@apereo.org.
Visit this group at https://groups.google.com/a/apereo.org/group/cas-user/.
To view this discussion on the web visit 
https://groups.google.com/a/apereo.org/d/msgid/cas-user/42904D95-8B68-48D2-A450-C330DD9AF3C6%40gmail.com.
For more options, visit https://groups.google.com/a/apereo.org/d/optout.

Re: [cas-user] Server load w/ 4.2.6

2016-10-14 Thread Misagh Moayyed 
You can exclude the hazelcast dependency from the relevant module, and provide 
your own exact version. 

-- 
Misagh

From: Tom Poage <tfpo...@ucdavis.edu>
Reply: Tom Poage <tfpo...@ucdavis.edu>
Date: October 14, 2016 at 8:44:49 PM
To: CAS Community <cas-user@apereo.org>
Subject:  Re: [cas-user] Server load w/ 4.2.6  

Disabling the fourth node doesn't change anything.  

Profiling shows the highest CPU/time is spent in Hazelcast. Whether this is a 
result of the updated Hazelcast version or the new synchronous CAS code remains 
to be seen.  

Is it oossible to downgrade Hazelcast version (say, to 3.6) on CAS 4.2.6, i.e. 
were any new Hazelcast version-specific changes made between roughly 4.2.[12] 
and 4.2.6?  

Thanks.  
Tom.  

> On Oct 13, 2016, at 2:18 PM, Tom Poage <tfpo...@ucdavis.edu> wrote:  
>  
> Afternoon,  
>  
> On moving from 4.2.1 to 4.2.6, our apparent system load increased 
> dramatically.  
>  
> Run queue went from as high as 4 to nearly 30, with (Linux) load average 
> jumping from a max of 0.2 to about 15 for a user base (TGT count) of 46k.  
>  
> A code diff doesn’t seem to show much, except perhaps for the addition of a 
> synchronous ticketTransactionManager. The only other likely candidate is 
> either the bump in Hazelcast version, or that we went from 3 to 4 (single 
> CPU) VMs in the cluster (point-to-point instead of multicast). CPU increased 
> from a high of about 20% (usually 5-8%) to the 50% range. This is on all 
> nodes. Ironically, response time doesn’t seem all that bad, though is a bit 
> sluggish.  
>  
> Anyone else experience something similar?  
>  
> Thanks!  
> Tom.  
>  
> --  
> CAS gitter chatroom: https://gitter.im/apereo/cas  
> CAS mailing list guidelines: https://apereo.github.io/cas/Mailing-Lists.html  
> CAS documentation website: https://apereo.github.io/cas  
> CAS project website: https://github.com/apereo/cas  
> ---  
> You received this message because you are subscribed to the Google Groups 
> "CAS Community" group.  
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to cas-user+unsubscr...@apereo.org.  
> To post to this group, send email to cas-user@apereo.org.  
> Visit this group at https://groups.google.com/a/apereo.org/group/cas-user/.  
> To view this discussion on the web visit 
> https://groups.google.com/a/apereo.org/d/msgid/cas-user/F67D31AA-2CFC-4DDA-8C5D-922E0B87798F%40ucdavis.edu.
>   
> For more options, visit https://groups.google.com/a/apereo.org/d/optout.  

--  
CAS gitter chatroom: https://gitter.im/apereo/cas  
CAS mailing list guidelines: https://apereo.github.io/cas/Mailing-Lists.html  
CAS documentation website: https://apereo.github.io/cas  
CAS project website: https://github.com/apereo/cas  
---  
You received this message because you are subscribed to the Google Groups "CAS 
Community" group.  
To unsubscribe from this group and stop receiving emails from it, send an email 
to cas-user+unsubscr...@apereo.org.  
To post to this group, send email to cas-user@apereo.org.  
Visit this group at https://groups.google.com/a/apereo.org/group/cas-user/.  
To view this discussion on the web visit 
https://groups.google.com/a/apereo.org/d/msgid/cas-user/4FAA8E69-3C2E-46E4-9BB5-9C48E5D40A31%40ucdavis.edu.
  
For more options, visit https://groups.google.com/a/apereo.org/d/optout.  

-- 
CAS gitter chatroom: https://gitter.im/apereo/cas
CAS mailing list guidelines: https://apereo.github.io/cas/Mailing-Lists.html
CAS documentation website: https://apereo.github.io/cas
CAS project website: https://github.com/apereo/cas
--- 
You received this message because you are subscribed to the Google Groups "CAS 
Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to cas-user+unsubscr...@apereo.org.
To post to this group, send email to cas-user@apereo.org.
Visit this group at https://groups.google.com/a/apereo.org/group/cas-user/.
To view this discussion on the web visit 
https://groups.google.com/a/apereo.org/d/msgid/cas-user/etPan.5801198c.5a84c4be.2a59%40unicon.net.
For more options, visit https://groups.google.com/a/apereo.org/d/optout.

Re: [cas-user] Server load w/ 4.2.6

2016-10-14 Thread Tom Poage 
Disabling the fourth node doesn't change anything.

Profiling shows the highest CPU/time is spent in Hazelcast. Whether this is a 
result of the updated Hazelcast version or the new synchronous CAS code remains 
to be seen.

Is it oossible to downgrade Hazelcast version (say, to 3.6) on CAS 4.2.6, i.e. 
were any new Hazelcast version-specific changes made between roughly 4.2.[12] 
and 4.2.6?

Thanks.
Tom.

> On Oct 13, 2016, at 2:18 PM, Tom Poage  wrote:
> 
> Afternoon,
> 
> On moving from 4.2.1 to 4.2.6, our apparent system load increased 
> dramatically.
> 
> Run queue went from as high as 4 to nearly 30, with (Linux) load average 
> jumping from a max of 0.2 to about 15 for a user base (TGT count) of 46k.
> 
> A code diff doesn’t seem to show much, except perhaps for the addition of a 
> synchronous ticketTransactionManager. The only other likely candidate is 
> either the bump in Hazelcast version, or that we went from 3 to 4 (single 
> CPU) VMs in the cluster (point-to-point instead of multicast). CPU increased 
> from a high of about 20% (usually 5-8%) to the 50% range. This is on all 
> nodes. Ironically, response time doesn’t seem all that bad, though is a bit 
> sluggish.
> 
> Anyone else experience something similar?
> 
> Thanks!
> Tom.
> 
> -- 
> CAS gitter chatroom: https://gitter.im/apereo/cas
> CAS mailing list guidelines: https://apereo.github.io/cas/Mailing-Lists.html
> CAS documentation website: https://apereo.github.io/cas
> CAS project website: https://github.com/apereo/cas
> --- 
> You received this message because you are subscribed to the Google Groups 
> "CAS Community" group.
> To unsubscribe from this group and stop receiving emails from it, send an 
> email to cas-user+unsubscr...@apereo.org.
> To post to this group, send email to cas-user@apereo.org.
> Visit this group at https://groups.google.com/a/apereo.org/group/cas-user/.
> To view this discussion on the web visit 
> https://groups.google.com/a/apereo.org/d/msgid/cas-user/F67D31AA-2CFC-4DDA-8C5D-922E0B87798F%40ucdavis.edu.
> For more options, visit https://groups.google.com/a/apereo.org/d/optout.

-- 
CAS gitter chatroom: https://gitter.im/apereo/cas
CAS mailing list guidelines: https://apereo.github.io/cas/Mailing-Lists.html
CAS documentation website: https://apereo.github.io/cas
CAS project website: https://github.com/apereo/cas
--- 
You received this message because you are subscribed to the Google Groups "CAS 
Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to cas-user+unsubscr...@apereo.org.
To post to this group, send email to cas-user@apereo.org.
Visit this group at https://groups.google.com/a/apereo.org/group/cas-user/.
To view this discussion on the web visit 
https://groups.google.com/a/apereo.org/d/msgid/cas-user/4FAA8E69-3C2E-46E4-9BB5-9C48E5D40A31%40ucdavis.edu.
For more options, visit https://groups.google.com/a/apereo.org/d/optout.

[cas-user] Server load w/ 4.2.6

2016-10-13 Thread Tom Poage 
Afternoon,

On moving from 4.2.1 to 4.2.6, our apparent system load increased dramatically.

Run queue went from as high as 4 to nearly 30, with (Linux) load average 
jumping from a max of 0.2 to about 15 for a user base (TGT count) of 46k.

A code diff doesn’t seem to show much, except perhaps for the addition of a 
synchronous ticketTransactionManager. The only other likely candidate is either 
the bump in Hazelcast version, or that we went from 3 to 4 (single CPU) VMs in 
the cluster (point-to-point instead of multicast). CPU increased from a high of 
about 20% (usually 5-8%) to the 50% range. This is on all nodes. Ironically, 
response time doesn’t seem all that bad, though is a bit sluggish.

Anyone else experience something similar?

Thanks!
Tom.

-- 
CAS gitter chatroom: https://gitter.im/apereo/cas
CAS mailing list guidelines: https://apereo.github.io/cas/Mailing-Lists.html
CAS documentation website: https://apereo.github.io/cas
CAS project website: https://github.com/apereo/cas
--- 
You received this message because you are subscribed to the Google Groups "CAS 
Community" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to cas-user+unsubscr...@apereo.org.
To post to this group, send email to cas-user@apereo.org.
Visit this group at https://groups.google.com/a/apereo.org/group/cas-user/.
To view this discussion on the web visit 
https://groups.google.com/a/apereo.org/d/msgid/cas-user/F67D31AA-2CFC-4DDA-8C5D-922E0B87798F%40ucdavis.edu.
For more options, visit https://groups.google.com/a/apereo.org/d/optout.