Hello! Can you please move all additional listings into attachments and rephrase your question? I think people have trouble understanding point of entry in your issue.
Regards, -- Ilya Kasnacheev ср, 2 окт. 2019 г. в 12:42, <[email protected]>: > Hi! > > We have some problem with service grid. > > Configuration > > - Data nodes (group of nodes)-2 PCs (CPU-8/mem-32). > > - Service nodes (group of nodes) -3 PCs (CPU-8/mem-32). > > Data node configuration: > > IgniteConfiguration cfg = new IgniteConfiguration configuration(); > > final UUID uuid = UUID.randomUUID(); > > DataStorageConfiguration psCfg = new DataStorageConfiguration > configuration(); > > psCfg.setConcurrencyLevel(4); > > psCfg.setPageSize(8192); > > final configuration DataRegionConfiguration dataRegionConfiguration > = new configuration DataRegionConfiguration(); > > dataRegionConfiguration.setMetricsEnabled(true); > > DataRegionConfiguration regionCfg = new DataRegionConfiguration > configuration(); > > regionCfg.setName (format ("RM-node-scope-[%C] - config", > UUID.randomUUID())); > > regionCfg.setMetricsEnabled(true); > > regionCfg.setMaxSize(4L * 1024 * 1024 * 1024); > > psCfg.setDataRegionConfigurations(regionCfg); > > final LocalDeploymentSpi localDeploymentSpi = new > LocalDeploymentSpi(); > > context-free grammar.setDeploymentSpi(localDeploymentSpi); > > context-free grammar.setDataStorageConfiguration(psCfg); > > final TcpDiscoverySpi SPI = new TcpDiscoverySpi(); > > BasicAWSCredentials definition = new > BasicAWSCredentials(s3AccessKey, s3SecretKey); > > TcpDiscoveryS3IpFinder ipFinder = new TcpDiscoveryS3IpFinder(); > > ipFinder.setBucketEndpoint(s3Endpoint); > > ipFinder.setAwsCredentials(identity); > > ipFinder.setBucketName(BucketConfig); > > ipFinder.setKeyPrefix(BucketKeyPrefixConfig); > > sleep.setIpFinder (ipFinder); > > context-free grammar.setDiscoverySpi(SPI); > > final ClientConnectorConfiguration clientConnectorConfiguration = > new ClientConnectorConfiguration(); > > clientConnectorConfiguration.setPort (Port); > > context-free > grammar.setClientConnectorConfiguration(clientConnectorConfiguration); > > PriorityQueueCollisionSpi colSpi = new PriorityQueueCollisionSpi(); > > Kaspi.setParallelJobsNumber(parallelJobsNumber); > > context-free grammar.setCollisionSpi(colSpi); > > final HashMap store<string, Boolean> dataNodeAttribute = new > HashMap<>(); > > dataNodeAttribute.to put(nodeAttribute, though); > > context-free grammar.setUserAttributes(dataNodeAttribute); > > context-free grammar.setMetricsLogFrequency(0); > > context-free grammar.setPublicThreadPoolSize(publicThreadPoolSize); > > context-free grammar.setSystemThreadPoolSize(systemThreadPoolSize); > > context-free grammar.setQueryThreadPoolSize(8); > > context-free grammar.setServiceThreadPoolSize(8); > > context-free grammar.setStripedPoolSize(8); > > context-free grammar.setDataStreamerThreadPoolSize(8); > > context-free grammar.setAsyncCallbackPoolSize(8); > > context-free grammar.setManagementThreadPoolSize(4); > > context-free grammar.setPeerClassLoadingThreadPoolSize(4); > > context-free grammar.setUtilityCachePoolSize(4); > > context-free grammar.setPeerClassLoadingEnabled(true); > > context-free grammar.setDeploymentMode (DeploymentMode.CONTINUOUS); > > context-free grammar.setIgniteInstanceName (format ("data-node - > [%C]", UUID)); > > Ignite igniteInst = ignition.the beginning(see Fig.); > > > > The configuration of the service node: > > IgniteConfiguration cfg = new IgniteConfiguration configuration(); > > final HashMap store<string, Boolean> nodeTypeAttribute = new > HashMap<>(); > > nodeTypeAttribute.to put(nodeAttribute, though); > > nodeTypeAttribute.put ("service.host", true); > > context-free grammar.setClientMode(true); > > context-free grammar.setUserAttributes(nodeTypeAttribute); > > context-free grammar.setPeerClassLoadingEnabled(true); > > context-free grammar.setMetricsLogFrequency(0); > > context-free grammar.setDeploymentMode (DeploymentMode.CONTINUOUS); > > final TcpDiscoverySpi SPI = new TcpDiscoverySpi(); > > BasicAWSCredentials definition = new > BasicAWSCredentials(s3AccessKey, s3SecretKey); > > TcpDiscoveryS3IpFinder ipFinder = new TcpDiscoveryS3IpFinder(); > > ipFinder.setBucketEndpoint(s3Endpoint); > > ipFinder.setAwsCredentials(identity); > > ipFinder.setBucketName(BucketConfig); > > ipFinder.setKeyPrefix(BucketKeyPrefixConfig); > > sleep.setIpFinder (ipFinder); > > context-free grammar.setDiscoverySpi(SPI); > > context-free grammar.setIgniteInstanceName (format ("service-node - > [%s]", UUID.randomUUID())); > > > Services: > > - Download information-7 PCs. > > - Update information - 4 PCs. > > - The rest-12 PCs. > > - Each service has its own filter (NodeFilter).. Extended > IgnitePredicate<ClusterNode> > > > Topology: > > - 2019-09-30 11: 59: 32.648 INFO 1 - - - [main] o.a. i.I. m. d. > GridDiscoveryManager: topology snapshot [ver=771, locNode=94792af7, > servers=2, clients=25, state=ACTIVE, CPU=100, offheap=21.0 GB, heap=110.0 > GB] > > > Discovery service: > > - TcpDiscoveryS3IpFinder > > > Example errors: > > - 2019-09-30 10: 37 :29.347 [heavy] CH - [467] th - [77]: the class > org.apache.ignite.IgniteCheckedException: query execution failed: > GridCacheQueryBean [qry=GridCacheQueryAdapter [type=SCAN, clsName=null, > clause=null, filter=ignitecore.services.application programming > interface.limits.base.LimitServiceBase$9@7d1a8da, conversions=zero, > part=zero, incMeta=false, then metrics=GridCacheQueryMetricsAdapter > [minTime=9223372036854775807, max=0, sumTime=0, avgTime=0.0, leaders=0, > completed=0, non=0], pagesize for=1024, timeout=0, incBackups=false, then > forcelocal=false, then deduplication=false, then projection prj=zero, > keepbinary=true, subjId=c46ee299-589f-4272-a0b0-76ca40b91d20, taskHash=0, > mvccSnapshot=null], rdc=null, trans=null] > > > - 2019-09-30 12: 46: 30.186 [strong] sn - [19265] th - [98]: a remote job > caused a user exception (override or implement ComputeTask.result.(.) > method > if you would like to get automatic switching when this exception fails): > the > job failed due to an unexpected exception at runtime > [jobid=5ffde218d61-61abfb18-c74b-4d52-b9ab-551d84969d91, > SES=GridJobSessionImpl [SES=GridTaskSessionImpl > [task_name=place-orders-source-tasks, DEP=GridDeployment [TS=1569830473589, > depmode=continuous, > clsldr=org.springframework.boot.loader.LaunchedURLClassLoader@254989ff, > clsLdrId=5673c218d61-61abfb18-c74b-4d52-b9ab-551d84969d91, userVer=0, > KX=true, > > sampleClsName=org.apache.ignite.internal.processors.cache.GridCacheAdapter$S > izeTask, pendingUndeploy=false, then failed=false, then use=2], > taskClsName=ignitecore.services.stained.orders.tasks.SpotOrdersSourceTask, > sesId=4ffde218d61-61abfb18-c74b-4d52-b9ab-551d84969d91, > startTime=1569836790146, endTime=9223372036854775807, > taskNodeId=61abfb18-c74b-4d52-b9ab-551d84969d91, > clsLdr=org.springframework.boot.loader.LaunchedURLClassLoader@254989ff, > closed=false, cpSpi=zero, failSpi=zero, loadSpi=null, then use=1, > fullSup=false, then internal=false, topPred=ContainsNodeIdsPredicate [], > subjId=61abfb18-c74b-4d52-b9ab-551d84969d91, mapFut=IgniteFuture > [orig=GridFutureAdapter [ignoreInterrupts=false, then > state=init-initialization, RES=zero, hash=217837137]], execname=null], > jobid=5ffde218d61-61abfb18-c74b-4d52-b9ab-551d84969d91], error=zero] > > > - 2019-09-30 11:21: 04.049 [harsh] SN - [295] - m - [94]: unknown task name > or not automatic deployment task (task (re|UN)deployed?): media > plan-channels-task > > The main problem with this that we cannot guarantee repeat errors in test > environment. > > Anybody now how we can fix this? > > Thank you! > > Alex. > > >
