Ah.. since the ELB is also part of the cluster, cache is getting replicated to that as well. I'll take a look and see how this can be fixed. Providing all relevant information would have saved a lot of time. All this while the discussion was revolving around the issue showing up on the IS node which was misleading.
Azeez On Mon, May 19, 2014 at 10:35 AM, Prabath Siriwardena <[email protected]>wrote: > Any solution for this...? > > > On Mon, May 19, 2014 at 10:34 AM, Pavithra Madurangi <[email protected]>wrote: > >> >> >> >> On Mon, May 19, 2014 at 10:32 AM, Kishanthan Thangarajah < >> [email protected]> wrote: >> >>> Yes, we observed a similar error on ELB, when there was a cache cleanup >>> on an IS node. Is the issue here is coming from one of the IS node or from >>> ELB? >>> >> >> Just checked the ELB logs and yes issue is there.. Error occurs in ELB >> and one IS node. >> >>> >>> >>> On Mon, May 19, 2014 at 10:30 AM, Pradeep Fernando <[email protected]>wrote: >>> >>>> So i had a discussion with kishanthan. We saw the same issue sometime >>>> back. The exception was in ELB side. >>>> >>>> >>>> On Mon, May 19, 2014 at 10:22 AM, Pavithra Madurangi <[email protected] >>>> > wrote: >>>> >>>>> No didn't observe this in single node..Anyway most of the testing were >>>>> done in cluster.. So I'm not sure whether this is reproducible in single >>>>> node... >>>>> >>>>> Thanks, >>>>> Pavithra >>>>> >>>>> >>>>> On Mon, May 19, 2014 at 10:18 AM, Afkham Azeez <[email protected]> wrote: >>>>> >>>>>> So this happens when there is more than one node only, or are you >>>>>> seeing it with even a single node? >>>>>> >>>>>> >>>>>> On Mon, May 19, 2014 at 10:08 AM, Pavithra Madurangi < >>>>>> [email protected]> wrote: >>>>>> >>>>>>> Yes this was reproduced in a homogeneous cluster. I'll again check >>>>>>> this with today's pack as well. >>>>>>> >>>>>>> Regards, >>>>>>> Pavithra >>>>>>> >>>>>>> >>>>>>> On Mon, May 19, 2014 at 7:10 AM, Prabath Siriwardena < >>>>>>> [email protected]> wrote: >>>>>>> >>>>>>>> Yes its a homogeneous cluster.. Asela is looking into the issue... >>>>>>>> >>>>>>>> Thanks & regards, >>>>>>>> -Prabath >>>>>>>> >>>>>>>> >>>>>>>> On Mon, May 19, 2014 at 5:52 AM, Pradeep Fernando < >>>>>>>> [email protected]> wrote: >>>>>>>> >>>>>>>>> I think this is a homogeneous cluster... if not, then it is the >>>>>>>>> root cause. I remember sometime ago, chamath and kishanthan working >>>>>>>>> on a >>>>>>>>> similar kind of issue. >>>>>>>>> >>>>>>>>> >>>>>>>>> On Mon, May 19, 2014 at 1:09 AM, Afkham Azeez <[email protected]>wrote: >>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> On Mon, May 19, 2014 at 1:05 AM, Prabath Siriwardena < >>>>>>>>>> [email protected]> wrote: >>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> On Mon, May 19, 2014 at 12:59 AM, Afkham Azeez >>>>>>>>>>> <[email protected]>wrote: >>>>>>>>>>> >>>>>>>>>>>> That could be one reason, and another way this can happen is >>>>>>>>>>>> this cache entry getting replicated on to another node that cannot >>>>>>>>>>>> see this >>>>>>>>>>>> class, and the first time it tries to access the entry is when it >>>>>>>>>>>> tries to >>>>>>>>>>>> do a cleanup, and at that point, tries to load the class, and then >>>>>>>>>>>> this >>>>>>>>>>>> failure happens. >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> If this is the case.. do we have a solution for it..? >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> All nodes in a single cluster should be homogenous; which means, >>>>>>>>>> all nodes should see the same bundles/classes. Then this error will >>>>>>>>>> never >>>>>>>>>> happen. >>>>>>>>>> >>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> On Mon, May 19, 2014 at 12:55 AM, Pradeep Fernando < >>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>> >>>>>>>>>>>>> The class, >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> org.wso2.carbon.identity.provisioning.cache.ProvisioningEntityCacheKey >>>>>>>>>>>>> >>>>>>>>>>>>> properly exported ? i know its a dumb question. just >>>>>>>>>>>>> checking... :) >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> On Mon, May 19, 2014 at 12:43 AM, Prabath Siriwardena < >>>>>>>>>>>>> [email protected]> wrote: >>>>>>>>>>>>> >>>>>>>>>>>>>> Appreciate a lot any clue on this...? >>>>>>>>>>>>>> >>>>>>>>>>>>>> https://wso2.org/jira/browse/IDENTITY-2454 >>>>>>>>>>>>>> >>>>>>>>>>>>>> - Error occurred while running CacheCleanupTask >>>>>>>>>>>>>> com.hazelcast.nio.serialization.HazelcastSerializationException: >>>>>>>>>>>>>> java.lang.ClassNotFoundException: >>>>>>>>>>>>>> org.wso2.carbon.identity.provisioning.cache.ProvisioningEntityCacheKey >>>>>>>>>>>>>> at >>>>>>>>>>>>>> com.hazelcast.nio.serialization.DefaultSerializers$ObjectSerializer.read(DefaultSerializers.java:190) >>>>>>>>>>>>>> at >>>>>>>>>>>>>> com.hazelcast.nio.serialization.StreamSerializerAdapter.read(StreamSerializerAdapter.java:59) >>>>>>>>>>>>>> >>>>>>>>>>>>>> -- >>>>>>>>>>>>>> Thanks & Regards, >>>>>>>>>>>>>> Prabath >>>>>>>>>>>>>> >>>>>>>>>>>>>> -- >>>>>>>>>>>>>> Thanks & Regards, >>>>>>>>>>>>>> Prabath >>>>>>>>>>>>>> >>>>>>>>>>>>>> Twitter : @prabath >>>>>>>>>>>>>> LinkedIn : http://www.linkedin.com/in/prabathsiriwardena >>>>>>>>>>>>>> >>>>>>>>>>>>>> Mobile : +94 71 809 6732 >>>>>>>>>>>>>> >>>>>>>>>>>>>> http://blog.facilelogin.com >>>>>>>>>>>>>> http://blog.api-security.org >>>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> >>>>>>>>>>>>> -- >>>>>>>>>>>>> *Pradeep Fernando* >>>>>>>>>>>>> Associate Technical Lead;WSO2 Inc.; http://wso2.com >>>>>>>>>>>>> >>>>>>>>>>>>> blog: http://pradeepfernando.blogspot.com >>>>>>>>>>>>> m: +94776603662 >>>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> >>>>>>>>>>>> -- >>>>>>>>>>>> *Afkham Azeez* >>>>>>>>>>>> Director of Architecture; WSO2, Inc.; http://wso2.com >>>>>>>>>>>> Member; Apache Software Foundation; http://www.apache.org/ >>>>>>>>>>>> * <http://www.apache.org/>* >>>>>>>>>>>> *email: **[email protected]* <[email protected]> >>>>>>>>>>>> * cell: +94 77 3320919 <%2B94%2077%203320919> blog: * >>>>>>>>>>>> *http://blog.afkham.org* <http://blog.afkham.org> >>>>>>>>>>>> *twitter: >>>>>>>>>>>> **http://twitter.com/afkham_azeez*<http://twitter.com/afkham_azeez> >>>>>>>>>>>> * linked-in: **http://lk.linkedin.com/in/afkhamazeez >>>>>>>>>>>> <http://lk.linkedin.com/in/afkhamazeez>* >>>>>>>>>>>> >>>>>>>>>>>> *Lean . Enterprise . Middleware* >>>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> >>>>>>>>>>> -- >>>>>>>>>>> Thanks & Regards, >>>>>>>>>>> Prabath >>>>>>>>>>> >>>>>>>>>>> Twitter : @prabath >>>>>>>>>>> LinkedIn : http://www.linkedin.com/in/prabathsiriwardena >>>>>>>>>>> >>>>>>>>>>> Mobile : +94 71 809 6732 >>>>>>>>>>> >>>>>>>>>>> http://blog.facilelogin.com >>>>>>>>>>> http://blog.api-security.org >>>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> >>>>>>>>>> -- >>>>>>>>>> *Afkham Azeez* >>>>>>>>>> Director of Architecture; WSO2, Inc.; http://wso2.com >>>>>>>>>> Member; Apache Software Foundation; http://www.apache.org/ >>>>>>>>>> * <http://www.apache.org/>* >>>>>>>>>> *email: **[email protected]* <[email protected]> >>>>>>>>>> * cell: +94 77 3320919 <%2B94%2077%203320919> blog: * >>>>>>>>>> *http://blog.afkham.org* <http://blog.afkham.org> >>>>>>>>>> *twitter: >>>>>>>>>> **http://twitter.com/afkham_azeez*<http://twitter.com/afkham_azeez> >>>>>>>>>> * linked-in: **http://lk.linkedin.com/in/afkhamazeez >>>>>>>>>> <http://lk.linkedin.com/in/afkhamazeez>* >>>>>>>>>> >>>>>>>>>> *Lean . Enterprise . Middleware* >>>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> >>>>>>>>> -- >>>>>>>>> *Pradeep Fernando* >>>>>>>>> Associate Technical Lead;WSO2 Inc.; http://wso2.com >>>>>>>>> >>>>>>>>> blog: http://pradeepfernando.blogspot.com >>>>>>>>> m: +94776603662 >>>>>>>>> >>>>>>>>> _______________________________________________ >>>>>>>>> Dev mailing list >>>>>>>>> [email protected] >>>>>>>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>>>>>>> >>>>>>>>> >>>>>>>> >>>>>>>> >>>>>>>> -- >>>>>>>> Thanks & Regards, >>>>>>>> Prabath >>>>>>>> >>>>>>>> Twitter : @prabath >>>>>>>> LinkedIn : http://www.linkedin.com/in/prabathsiriwardena >>>>>>>> >>>>>>>> Mobile : +94 71 809 6732 >>>>>>>> >>>>>>>> http://blog.facilelogin.com >>>>>>>> http://blog.api-security.org >>>>>>>> >>>>>>> >>>>>>> >>>>>>> >>>>>>> -- >>>>>>> *Pavithra Madurangi* >>>>>>> Associate Technical Lead - QA. >>>>>>> WSO2 Inc.: http://wso2.com/ >>>>>>> Mobile: +94777207357 >>>>>>> >>>>>> >>>>>> >>>>>> >>>>>> -- >>>>>> *Afkham Azeez* >>>>>> Director of Architecture; WSO2, Inc.; http://wso2.com >>>>>> Member; Apache Software Foundation; http://www.apache.org/ >>>>>> * <http://www.apache.org/>* >>>>>> *email: **[email protected]* <[email protected]> >>>>>> * cell: +94 77 3320919 <%2B94%2077%203320919> blog: * >>>>>> *http://blog.afkham.org* <http://blog.afkham.org> >>>>>> *twitter: >>>>>> **http://twitter.com/afkham_azeez*<http://twitter.com/afkham_azeez> >>>>>> * linked-in: **http://lk.linkedin.com/in/afkhamazeez >>>>>> <http://lk.linkedin.com/in/afkhamazeez>* >>>>>> >>>>>> *Lean . Enterprise . Middleware* >>>>>> >>>>> >>>>> >>>>> >>>>> -- >>>>> *Pavithra Madurangi* >>>>> Associate Technical Lead - QA. >>>>> WSO2 Inc.: http://wso2.com/ >>>>> Mobile: +94777207357 >>>>> >>>> >>>> >>>> >>>> -- >>>> *Pradeep Fernando* >>>> Associate Technical Lead;WSO2 Inc.; http://wso2.com >>>> >>>> blog: http://pradeepfernando.blogspot.com >>>> m: +94776603662 >>>> >>>> _______________________________________________ >>>> Dev mailing list >>>> [email protected] >>>> http://wso2.org/cgi-bin/mailman/listinfo/dev >>>> >>>> >>> >>> >>> -- >>> *Kishanthan Thangarajah* >>> Senior Software Engineer, >>> Platform Technologies Team, >>> WSO2, Inc. >>> lean.enterprise.middleware >>> >>> Mobile - +94773426635 >>> Blog - *http://kishanthan.wordpress.com >>> <http://kishanthan.wordpress.com>* >>> Twitter - *http://twitter.com/kishanthan >>> <http://twitter.com/kishanthan>* >>> >> >> >> >> -- >> *Pavithra Madurangi* >> Associate Technical Lead - QA. >> WSO2 Inc.: http://wso2.com/ >> Mobile: +94777207357 >> >> _______________________________________________ >> Dev mailing list >> [email protected] >> http://wso2.org/cgi-bin/mailman/listinfo/dev >> >> > > > -- > Thanks & Regards, > Prabath > > Twitter : @prabath > LinkedIn : http://www.linkedin.com/in/prabathsiriwardena > > Mobile : +94 71 809 6732 > > http://blog.facilelogin.com > http://blog.api-security.org > > _______________________________________________ > Dev mailing list > [email protected] > http://wso2.org/cgi-bin/mailman/listinfo/dev > > -- *Afkham Azeez* Director of Architecture; WSO2, Inc.; http://wso2.com Member; Apache Software Foundation; http://www.apache.org/ * <http://www.apache.org/>* *email: **[email protected]* <[email protected]> * cell: +94 77 3320919 <%2B94%2077%203320919> blog: * *http://blog.afkham.org* <http://blog.afkham.org> *twitter: **http://twitter.com/afkham_azeez*<http://twitter.com/afkham_azeez> * linked-in: **http://lk.linkedin.com/in/afkhamazeez <http://lk.linkedin.com/in/afkhamazeez>* *Lean . Enterprise . Middleware*
_______________________________________________ Dev mailing list [email protected] http://wso2.org/cgi-bin/mailman/listinfo/dev
