[jira] [Updated] (IGNITE-11023) Processing data bag on GridMarshallerMappingProcessor consume many time
[ https://issues.apache.org/jira/browse/IGNITE-11023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Goncharuk updated IGNITE-11023: -- Ignite Flags: (was: Docs Required) > Processing data bag on GridMarshallerMappingProcessor consume many time > --- > > Key: IGNITE-11023 > URL: https://issues.apache.org/jira/browse/IGNITE-11023 > Project: Ignite > Issue Type: Improvement >Reporter: Vladislav Pyatkov >Assignee: Vladislav Pyatkov >Priority: Major > Time Spent: 0.5h > Remaining Estimate: 0h > > I have measure a processing data bag time on each join node and discovered > what GridMarshallerMappingProcessor consume more time then others. > It slow down on collecting topology, in particular case if joining some > nodes. > {noformat} > 2019-01-11 20:35:01.207 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Starting processing discovery data bag > 2019-01-11 20:35:01.207 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component ClusterProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:01.207 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component IgnitePluginProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:01.208 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component CacheObjectBinaryProcessorImpl processed joining node data bag in > 0ms > 2019-01-11 20:35:01.208 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component IgniteAuthenticationProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:01.219 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component GridCacheProcessor processed joining node data bag in 10ms > 2019-01-11 20:35:01.219 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component GridQueryProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:01.219 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component GridContinuousProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:01.463 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component GridMarshallerMappingProcessor processed joining node data bag in > 242ms > 2019-01-11 20:35:01.463 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Total > time of processing discovery data bag: 252ms > 2019-01-11 20:35:01.780 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Starting processing discovery data bag > 2019-01-11 20:35:01.781 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component ClusterProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:01.781 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component IgnitePluginProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:01.781 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component CacheObjectBinaryProcessorImpl processed joining node data bag in > 0ms > 2019-01-11 20:35:01.781 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component IgniteAuthenticationProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:01.791 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component GridCacheProcessor processed joining node data bag in 10ms > 2019-01-11 20:35:01.792 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component GridQueryProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:01.792 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component GridContinuousProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:02.134 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component GridMarshallerMappingProcessor processed joining node data bag in > 338ms > 2019-01-11 20:35:02.134 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Total > time of processing discovery data bag: 348ms > 2019-01-11 20:35:02.326 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Starting processing discovery data bag > 2019-01-11 20:35:02.326 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component ClusterProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:02.326 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component
[jira] [Updated] (IGNITE-11023) Processing data bag on GridMarshallerMappingProcessor consume many time
[ https://issues.apache.org/jira/browse/IGNITE-11023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Goncharuk updated IGNITE-11023: -- Fix Version/s: 2.8 > Processing data bag on GridMarshallerMappingProcessor consume many time > --- > > Key: IGNITE-11023 > URL: https://issues.apache.org/jira/browse/IGNITE-11023 > Project: Ignite > Issue Type: Improvement >Reporter: Vladislav Pyatkov >Assignee: Vladislav Pyatkov >Priority: Major > Fix For: 2.8 > > Time Spent: 0.5h > Remaining Estimate: 0h > > I have measure a processing data bag time on each join node and discovered > what GridMarshallerMappingProcessor consume more time then others. > It slow down on collecting topology, in particular case if joining some > nodes. > {noformat} > 2019-01-11 20:35:01.207 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Starting processing discovery data bag > 2019-01-11 20:35:01.207 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component ClusterProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:01.207 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component IgnitePluginProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:01.208 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component CacheObjectBinaryProcessorImpl processed joining node data bag in > 0ms > 2019-01-11 20:35:01.208 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component IgniteAuthenticationProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:01.219 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component GridCacheProcessor processed joining node data bag in 10ms > 2019-01-11 20:35:01.219 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component GridQueryProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:01.219 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component GridContinuousProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:01.463 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component GridMarshallerMappingProcessor processed joining node data bag in > 242ms > 2019-01-11 20:35:01.463 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Total > time of processing discovery data bag: 252ms > 2019-01-11 20:35:01.780 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Starting processing discovery data bag > 2019-01-11 20:35:01.781 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component ClusterProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:01.781 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component IgnitePluginProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:01.781 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component CacheObjectBinaryProcessorImpl processed joining node data bag in > 0ms > 2019-01-11 20:35:01.781 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component IgniteAuthenticationProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:01.791 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component GridCacheProcessor processed joining node data bag in 10ms > 2019-01-11 20:35:01.792 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component GridQueryProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:01.792 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component GridContinuousProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:02.134 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component GridMarshallerMappingProcessor processed joining node data bag in > 338ms > 2019-01-11 20:35:02.134 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Total > time of processing discovery data bag: 348ms > 2019-01-11 20:35:02.326 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Starting processing discovery data bag > 2019-01-11 20:35:02.326 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component ClusterProcessor processed joining node data bag in 0ms > 2019-01-11 20:35:02.326 [INFO > ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] > Component
[jira] [Updated] (IGNITE-11023) Processing data bag on GridMarshallerMappingProcessor consume many time
[ https://issues.apache.org/jira/browse/IGNITE-11023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladislav Pyatkov updated IGNITE-11023: --- Description: I have measure a processing data bag time on each join node and discovered what GridMarshallerMappingProcessor consume more time then others. It slow down on collecting topology, in particular case if joining some nodes. {noformat} 2019-01-11 20:35:01.207 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Starting processing discovery data bag 2019-01-11 20:35:01.207 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component ClusterProcessor processed joining node data bag in 0ms 2019-01-11 20:35:01.207 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component IgnitePluginProcessor processed joining node data bag in 0ms 2019-01-11 20:35:01.208 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component CacheObjectBinaryProcessorImpl processed joining node data bag in 0ms 2019-01-11 20:35:01.208 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component IgniteAuthenticationProcessor processed joining node data bag in 0ms 2019-01-11 20:35:01.219 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridCacheProcessor processed joining node data bag in 10ms 2019-01-11 20:35:01.219 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridQueryProcessor processed joining node data bag in 0ms 2019-01-11 20:35:01.219 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridContinuousProcessor processed joining node data bag in 0ms 2019-01-11 20:35:01.463 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridMarshallerMappingProcessor processed joining node data bag in 242ms 2019-01-11 20:35:01.463 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Total time of processing discovery data bag: 252ms 2019-01-11 20:35:01.780 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Starting processing discovery data bag 2019-01-11 20:35:01.781 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component ClusterProcessor processed joining node data bag in 0ms 2019-01-11 20:35:01.781 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component IgnitePluginProcessor processed joining node data bag in 0ms 2019-01-11 20:35:01.781 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component CacheObjectBinaryProcessorImpl processed joining node data bag in 0ms 2019-01-11 20:35:01.781 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component IgniteAuthenticationProcessor processed joining node data bag in 0ms 2019-01-11 20:35:01.791 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridCacheProcessor processed joining node data bag in 10ms 2019-01-11 20:35:01.792 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridQueryProcessor processed joining node data bag in 0ms 2019-01-11 20:35:01.792 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridContinuousProcessor processed joining node data bag in 0ms 2019-01-11 20:35:02.134 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridMarshallerMappingProcessor processed joining node data bag in 338ms 2019-01-11 20:35:02.134 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Total time of processing discovery data bag: 348ms 2019-01-11 20:35:02.326 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Starting processing discovery data bag 2019-01-11 20:35:02.326 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component ClusterProcessor processed joining node data bag in 0ms 2019-01-11 20:35:02.326 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component IgnitePluginProcessor processed joining node data bag in 0ms 2019-01-11 20:35:02.326 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component CacheObjectBinaryProcessorImpl processed joining node data bag in 0ms 2019-01-11 20:35:02.326 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component IgniteAuthenticationProcessor processed joining node data bag in 0ms 2019-01-11 20:35:02.337 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridCacheProcessor processed joining node data bag in 10ms 2019-01-11 20:35:02.337 [INFO
[jira] [Updated] (IGNITE-11023) Processing data bag on GridMarshallerMappingProcessor consume many time
[ https://issues.apache.org/jira/browse/IGNITE-11023?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vladislav Pyatkov updated IGNITE-11023: --- Description: I have measure a processing data bag time on each join node and discovered what GridMarshallerMappingProcessor consume more time then others. It slow down on collecting topology, in particular case if joining some nodes. {noformat} 2019-01-11 20:35:01.207 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Starting processing discovery data bag 2019-01-11 20:35:01.207 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component ClusterProcessor processed joining node data bag in 0ms 2019-01-11 20:35:01.207 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component IgnitePluginProcessor processed joining node data bag in 0ms 2019-01-11 20:35:01.208 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component CacheObjectBinaryProcessorImpl processed joining node data bag in 0ms 2019-01-11 20:35:01.208 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component IgniteAuthenticationProcessor processed joining node data bag in 0ms 2019-01-11 20:35:01.219 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridCacheProcessor processed joining node data bag in 10ms 2019-01-11 20:35:01.219 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridQueryProcessor processed joining node data bag in 0ms 2019-01-11 20:35:01.219 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridContinuousProcessor processed joining node data bag in 0ms 2019-01-11 20:35:01.463 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridMarshallerMappingProcessor processed joining node data bag in 242ms 2019-01-11 20:35:01.463 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Total time of processing discovery data bag: 252ms 2019-01-11 20:35:01.780 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Starting processing discovery data bag 2019-01-11 20:35:01.781 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component ClusterProcessor processed joining node data bag in 0ms 2019-01-11 20:35:01.781 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component IgnitePluginProcessor processed joining node data bag in 0ms 2019-01-11 20:35:01.781 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component CacheObjectBinaryProcessorImpl processed joining node data bag in 0ms 2019-01-11 20:35:01.781 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component IgniteAuthenticationProcessor processed joining node data bag in 0ms 2019-01-11 20:35:01.791 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridCacheProcessor processed joining node data bag in 10ms 2019-01-11 20:35:01.792 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridQueryProcessor processed joining node data bag in 0ms 2019-01-11 20:35:01.792 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridContinuousProcessor processed joining node data bag in 0ms 2019-01-11 20:35:02.134 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridMarshallerMappingProcessor processed joining node data bag in 338ms 2019-01-11 20:35:02.134 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Total time of processing discovery data bag: 348ms 2019-01-11 20:35:02.326 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Starting processing discovery data bag 2019-01-11 20:35:02.326 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component ClusterProcessor processed joining node data bag in 0ms 2019-01-11 20:35:02.326 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component IgnitePluginProcessor processed joining node data bag in 0ms 2019-01-11 20:35:02.326 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component CacheObjectBinaryProcessorImpl processed joining node data bag in 0ms 2019-01-11 20:35:02.326 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component IgniteAuthenticationProcessor processed joining node data bag in 0ms 2019-01-11 20:35:02.337 [INFO ][tcp-disco-msg-worker-#2%NodeName%][o.a.i.i.m.d.GridDiscoveryManager] Component GridCacheProcessor processed joining node data bag in 10ms 2019-01-11 20:35:02.337 [INFO