not in, not exists sql result is not correct
Hi, We are using ignite 2.8.1, with this sql statement, SELECT * FROM orders p WHERE NOT exists (SELECT accountid FROM account b WHERE b.accountid = p.accountid); Retured result accountid actually exists in table account, change to NOT IN also is not correct. But I have another table result is correct. Is there any suggestions? thanks. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Remote Cluster ServiceGrid debug
Hi, I have a cluster running on the cloud server, now met some issues, is it possible that I can connect with client in local to debug the service? If ok, how do that, thanks. Thanks. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Ignite NPE when try to loadCache from persistent mysql database
Hi Experts, When try to loadCache from 3rd party mysql database, (this.balanceCache.loadCache(null);) met ignite NullPointerException, thanks a lot for some clues, 10:21:15,376 [mgmt-#66] ERROR org.apache.ignite.internal.processors.task.GridTaskWorker - Failed to obtain remote job result policy for result from ComputeTask.result(..) method (will fail the whole task): GridJobResultImpl [job=C2 [c=LoadCacheJobV2 [keepBinary=false]], sib=GridJobSiblingImpl [sesId=c7a1b632471-7916f296-11f5-4bea-ad6e-429a133422ec, jobId=d7a1b632471-7916f296-11f5-4bea-ad6e-429a133422ec, nodeId=47cedd02-1693-4331-8de3-235735e9d2a6, isJobDone=false], jobCtx=GridJobContextImpl [jobId=d7a1b632471-7916f296-11f5-4bea-ad6e-429a133422ec, timeoutObj=null, attrs=HashMap {}], node=TcpDiscoveryNode [id=47cedd02-1693-4331-8de3-235735e9d2a6, consistentId=0:0:0:0:0:0:0:1%lo0,127.0.0.1,172.19.2.53,192.168.42.10:47500, addrs=ArrayList [0:0:0:0:0:0:0:1%lo0, 127.0.0.1, 172.19.2.53, 192.168.42.10], sockAddrs=HashSet [/172.19.2.53:47500, /0:0:0:0:0:0:0:1%lo0:47500, /127.0.0.1:47500, /192.168.42.10:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1598322068214, loc=false, ver=2.8.1#20200521-sha1:86422096, isClient=false], ex=class o.a.i.IgniteException: java.lang.NullPointerException, hasRes=true, isCancelled=false, isOccupied=true] class org.apache.ignite.IgniteException: Remote job threw user exception (override or implement ComputeTask.result(..) method if you would like to have automatic failover for this exception): java.lang.NullPointerException at org.apache.ignite.compute.ComputeTaskAdapter.result(ComputeTaskAdapter.java:102) at org.apache.ignite.internal.processors.task.GridTaskWorker$5.apply(GridTaskWorker.java:1062) at org.apache.ignite.internal.processors.task.GridTaskWorker$5.apply(GridTaskWorker.java:1055) at org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:7037) at org.apache.ignite.internal.processors.task.GridTaskWorker.result(GridTaskWorker.java:1055) at org.apache.ignite.internal.processors.task.GridTaskWorker.onResponse(GridTaskWorker.java:862) at ignite.internal.processors.task.GridTaskProcessor.processJobExecuteResponse(GridTaskProcessor.java:1146) at ignite.internal.processors.task.GridTaskProcessor$JobMessageListener.onMessage(GridTaskProcessor.java:1370) at ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1847) at ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:1472) at ignite.internal.managers.communication.GridIoManager.access$5200(GridIoManager.java:229) at org.apache.ignite.internal.managers.communication.GridIoManager$9.run(GridIoManager.java:1367) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Ignite 3rd party persistency DataSourceBean Config in Java
More Exceptions here, thanks 06:29:58,723 [mgmt-#66] ERROR org.apache.ignite.internal.processors.task.GridTaskWorker - Failed to obtain remote job result policy for result from ComputeTask.result(..) method (will fail the whole task): GridJobResultImpl [job=C2 [c=LoadCacheJobV2 [keepBinary=false]], sib=GridJobSiblingImpl [sesId=04564002471-a65841ce-1b5c-43a2-af82-ff14f930c049, jobId=14564002471-a65841ce-1b5c-43a2-af82-ff14f930c049, nodeId=43aaf007-81a1-4ade-b2b2-d3ba2d57b962, isJobDone=false], jobCtx=GridJobContextImpl [jobId=14564002471-a65841ce-1b5c-43a2-af82-ff14f930c049, timeoutObj=null, attrs=HashMap {}], node=TcpDiscoveryNode [id=43aaf007-81a1-4ade-b2b2-d3ba2d57b962, consistentId=0:0:0:0:0:0:0:1%lo0,127.0.0.1,192.168.50.115:47500, addrs=ArrayList [0:0:0:0:0:0:0:1%lo0, 127.0.0.1, 192.168.50.115], sockAddrs=HashSet [/0:0:0:0:0:0:0:1%lo0:47500, /127.0.0.1:47500, Marbles-MBP.lan/192.168.50.115:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1598264995506, loc=false, ver=2.8.1#20200521-sha1:86422096, isClient=false], ex=class o.a.i.IgniteException: java.lang.NullPointerException, hasRes=true, isCancelled=false, isOccupied=true] class org.apache.ignite.IgniteException: Remote job threw user exception (override or implement ComputeTask.result(..) method if you would like to have automatic failover for this exception): java.lang.NullPointerException at org.apache.ignite.compute.ComputeTaskAdapter.result(ComputeTaskAdapter.java:102) at org.apache.ignite.internal.processors.task.GridTaskWorker$5.apply(GridTaskWorker.java:1062) at org.apache.ignite.internal.processors.task.GridTaskWorker$5.apply(GridTaskWorker.java:1055) at org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:7037) at org.apache.ignite.internal.processors.task.GridTaskWorker.result(GridTaskWorker.java:1055) at org.apache.ignite.internal.processors.task.GridTaskWorker.onResponse(GridTaskWorker.java:862) at org.apache.ignite.internal.processors.task.GridTaskProcessor.processJobExecuteResponse(GridTaskProcessor.java:1146) at org.apache.ignite.internal.processors.task.GridTaskProcessor$JobMessageListener.onMessage(GridTaskProcessor.java:1370) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1847) at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:1472) at org.apache.ignite.internal.managers.communication.GridIoManager.access$5200(GridIoManager.java:229) at org.apache.ignite.internal.managers.communication.GridIoManager$9.run(GridIoManager.java:1367) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Ignite 3rd party persistency DataSourceBean Config in Java
hi Thanks a lot. Correct the setDataSourceFactory, met ignite nullPointerException below, appreciate for the suggestions, thanks. javax.cache.integration.CacheLoaderException: java.lang.NullPointerException at org.apache.ignite.internal.processors.cache.store.GridCacheStoreManagerAdapter.loadCache(GridCacheStoreManagerAdapter.java:545) at org.apache.ignite.internal.processors.cache.distributed.dht.GridDhtCacheAdapter.localLoadCache(GridDhtCacheAdapter.java:636) at org.apache.ignite.internal.processors.cache.GridCacheProxyImpl.localLoadCache(GridCacheProxyImpl.java:226) at org.apache.ignite.internal.processors.cache.GridCacheAdapter$LoadCacheJob.localExecute(GridCacheAdapter.java:6052) at org.apache.ignite.internal.processors.cache.GridCacheAdapter$LoadCacheJobV2.localExecute(GridCacheAdapter.java:6101) at org.apache.ignite.internal.processors.cache.GridCacheAdapter$TopologyVersionAwareJob.execute(GridCacheAdapter.java:6735) at org.apache.ignite.compute.ComputeJobAdapter.call(ComputeJobAdapter.java:131) at org.apache.ignite.internal.processors.closure.GridClosureProcessor$C2.execute(GridClosureProcessor.java:1855) at org.apache.ignite.internal.processors.job.GridJobWorker$2.call(GridJobWorker.java:596) at org.apache.ignite.internal.util.IgniteUtils.wrapThreadLoader(IgniteUtils.java:7005) at org.apache.ignite.internal.processors.job.GridJobWorker.execute0(GridJobWorker.java:590) at org.apache.ignite.internal.processors.job.GridJobWorker.body(GridJobWorker.java:519) at org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:120) at org.apache.ignite.internal.processors.job.GridJobProcessor.processJobExecuteRequest(GridJobProcessor.java:1293) at org.apache.ignite.internal.processors.job.GridJobProcessor$JobExecutionListener.onMessage(GridJobProcessor.java:2121) at org.apache.ignite.internal.managers.communication.GridIoManager.invokeListener(GridIoManager.java:1847) at org.apache.ignite.internal.managers.communication.GridIoManager.processRegularMessage0(GridIoManager.java:1472) at org.apache.ignite.internal.managers.communication.GridIoManager.access$5200(GridIoManager.java:229) at org.apache.ignite.internal.managers.communication.GridIoManager$9.run(GridIoManager.java:1367) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) at java.lang.Thread.run(Thread.java:748) -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Ignite 3rd party persistency DataSourceBean Config in Java
Thanks a lot Kasnacheev, I have used the below mysqlDataSource, but still met the exception, any ideas? thanks a lot. 'org.apache.ignite.IgniteException: Failed to initialize cache store (data source is not provided).' public void setJdbcStoreConfig(CacheConfiguration config) { System.out.println("start to connect to mysql ..."); CacheJdbcPojoStoreFactory cacheJdbcPojoStoreFactory = new CacheJdbcPojoStoreFactory<>(); MysqlDataSource mysqlDataSource = new MysqlDataSource(); mysqlDataSource.setUrl("jdbc:mysql://127.0.0.1:3306/userdb?useUnicode=true=utf8"); mysqlDataSource.setUser("user-a"); mysqlDataSource.setPassword("admin"); cacheJdbcPojoStoreFactory.setDialect(new MySQLDialect()); cacheJdbcPojoStoreFactory.setDataSource(mysqlDataSource); JdbcType jdbcType = new JdbcType(); jdbcType.setCacheName(Balance.class.getSimpleName()); jdbcType.setDatabaseTable("balance"); cacheJdbcPojoStoreFactory.setTypes(jdbcType); config.setCacheStoreFactory(cacheJdbcPojoStoreFactory); config.setWriteThrough(true); config.setReadThrough(true); QueryEntity queryEntity = new QueryEntity(); queryEntity.setKeyType("java.lang.String"); queryEntity.setValueType("com.marble.common.ignite.entity.Balance"); queryEntity.setKeyFieldName("id"); LinkedHashMap map = new LinkedHashMap<>(); map.put("account_id", "java.lang.Long"); map.put("instrument_id", "java.lang.String"); map.put("quantity", "java.math.BigDecimal"); map.put("reserved", "java.math.BigDecimal"); map.put("last_updated", "java.sql.Timestamp"); map.put("last_Updated_Event", "java.lang.String"); map.put("trade_type", "java.lang.String"); queryEntity.setFields(map); Collection queryEntities = new ArrayList(); queryEntities.add(queryEntity); config.setQueryEntities(queryEntities); } -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Ignite 3rd party persistency DataSourceBean Config in Java
Thanks Srikanta, I'm using below code, with CacheJdbcPojoStoreFactory, for the dsMySQL_Test dataSourceBean, I try configured in the default-config.xml, but it will show 'IgniteException: Failed to load bean in application context [beanName=dsMySQL_Test, ', so I am seeking which object can use to config the DataSourceBean, CacheJdbcPojoStoreFactory cacheJdbcPojoStoreFactory = new CacheJdbcPojoStoreFactory<>(); cacheJdbcPojoStoreFactory.setDataSourceBean("dsMySQL_Test"); cacheJdbcPojoStoreFactory.setDialect(new MySQLDialect()); JdbcType jdbcType = new JdbcType(); jdbcType.setCacheName(Student.class.getSimpleName()); thanks. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Ignite 3rd party persistency DataSourceBean Config in Java
Need suggestions, thanks a lot. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Ignite 3rd party persistency DataSourceBean Config in Java
Hi Experts, >From the ignite 3rd party rdbms persistency doc, it shows the example with xml config, like below, Can help an example how to do at the java code? Use which bean? thanks, And btw, as currently, ignite dialet not support the postgresql, how can we use the postgresql to do the 3rd party persistency? thanks a lot. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
IgniteTxOptimisticCheckedException
Hi Guru, We met below two kinds of Optimistic exceptions when doing the transactions, we use OPTIMISTIC and SERIALIZABLE isolation, do you have any suggestions, or if we change to PESSIMISTIC, any risks on that, such as performance or other exceptions? thanks. {"log":"Caused by: org.apache.ignite.internal.transactions.IgniteTxOptimisticCheckedException: Failed to prepare transaction, read/write conflict [key=92-USD, keyCls=java.lang.String, val=Balance(accountId=92, instrumentId=USD, quantity=2307.812920282500, reserved=0, lastUpdated=2020-07-31 03:10:36.889, lastUpdatedEvent=TRANSFER, tradeType=null), valCls=ignite.entity.Balance, cache=Balance, thread=IgniteThread [compositeRwLockIdx=7, stripe=4, plc=-1, holdsTopLock=false, forbiddenToRequestBinaryMetadata=false, name=sys-stripe-4-#5]]\n","stream":"stderr","time":"2020-07-31T03:10:36.953698541Z"} {"log":"Caused by: org.apache.ignite.internal.transactions.IgniteTxOptimisticCheckedException: Failed to prepare transaction (lock conflict): GridDhtTxLocal [nearNodeId=7e3589a0-c829-42a2-8fb4-115c57ba64f5, nearFutId=3077cc2a371-7364caca-357e-49f2-840e-a101e7c64fa8, nearMiniId=1, nearFinFutId=null, nearFinMiniId=0, nearXidVer=GridCacheVersion [topVer=207644034, order=1596164732765, nodeOrder=2], lb=null, super=GridDhtTxLocalAdapter [nearOnOriginatingNode=false, nearNodes=KeySetView [], dhtNodes=KeySetView [], explicitLock=false, super=IgniteTxLocalAdapter [completedBase=null, sndTransformedVals=false, depEnabled=false, txState=IgniteTxStateImpl [activeCacheIds=[1325467324], recovery=false, mvccEnabled=false, mvccCachingCacheIds=[], txMap=ArrayList [IgniteTxEntry [txKey=IgniteTxKey [key=KeyCacheObjectImpl [part=45, val=92-USD, hasValBytes=true], cacheId=1325467324], val=[op=UPDATE, val=ignite.entity.Balance [idHash=1055847466, hash=-1577210704, accountId=92, lastUpdated=2020-07-31 03:10:36.943, quantity=1204.259920282500, reserved=null, instrumentId=USD, tradeType=null, lastUpdatedEvent=TRANSFER]], prevVal=[op=NOOP, val=null], oldVal=[op=NOOP, val=null], entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=CacheEntryPredicate[] [], filtersPassed=false, filtersSet=false, entry=GridDhtCacheEntry [rdrs=ReaderId[] [], part=45, super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl [part=45, val=92-USD, hasValBytes=true], val=null, ver=GridCacheVersion [topVer=207644034, order=1596164732830, nodeOrder=1], hash=-148923086, extras=GridCacheObsoleteEntryExtras [obsoleteVer=GridCacheVersion [topVer=2147483647, order=0, nodeOrder=0]], flags=2]]], prepared=1, locked=false, nodeId=null, locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=0, serReadVer=GridCacheVersion [topVer=207644034, order=1596164732670, nodeOrder=1], xidVer=null], IgniteTxEntry [txKey=IgniteTxKey [key=KeyCacheObjectImpl [part=504, val=1380978-USD, hasValBytes=true], cacheId=1325467324], val=[op=UPDATE, val=ignite.entity.Balance [idHash=577969755, hash=-2001853349, accountId=1380978, lastUpdated=2020-07-31 03:10:36.95, quantity=13614077.57624000, reserved=null, instrumentId=USD, tradeType=null, lastUpdatedEvent=TRANSFER]], prevVal=[op=NOOP, val=null], oldVal=[op=NOOP, val=null], entryProcessorsCol=null, ttl=-1, conflictExpireTime=-1, conflictVer=null, explicitVer=null, dhtVer=null, filters=CacheEntryPredicate[] [], filtersPassed=false, filtersSet=false, entry=GridDhtCacheEntry [rdrs=ReaderId[] [], part=504, super=GridDistributedCacheEntry [super=GridCacheMapEntry [key=KeyCacheObjectImpl [part=504, val=1380978-USD, hasValBytes=true], val=null, ver=GridCacheVersion [topVer=0, order=0, nodeOrder=0], hash=1004605465, extras=null, flags=0]]], prepared=0, locked=false, nodeId=null, locMapped=false, expiryPlc=null, transferExpiryPlc=false, flags=0, partUpdateCntr=0, serReadVer=GridCacheVersion [topVer=207644034, order=1596164732670, nodeOrder=1], xidVer=null]]], super=IgniteTxAdapter [xidVer=GridCacheVersion [topVer=207644034, order=1596164732835, nodeOrder=1], writeVer=null, implicit=false, loc=true, threadId=146, startTime=1596165036958, nodeId=990fbcf8-4105-4aee-b03f-bef9141f5533, startVer=GridCacheVersion [topVer=207644034, order=1596164732835, nodeOrder=1], endVer=null, isolation=SERIALIZABLE, concurrency=OPTIMISTIC, timeout=0, sysInvalidate=false, sys=false, plc=2, commitVer=null, finalizing=NONE, invalidParts=null, state=MARKED_ROLLBACK, timedOut=false, topVer=AffinityTopologyVersion [topVer=4, minorTopVer=1], mvccSnapshot=null, skipCompletedVers=false, parentTx=null, duration=0ms, onePhaseCommit=false], size=2]]]\n","stream":"stderr","time":"2020-07-31T03:10:37.002484848Z"} -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: First 10 long running cache futures [total=1]
thanks, are there any hints that can find/locate the operations that impact the server? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
First 10 long running cache futures [total=1]
Hi Guru, we met an exception on below, it impacts system no responses, any suggestions how to identify the case? 12:18:10,035 [grid-timeout-worker-#39] WARN org.apache.ignite.internal.diagnostic - First 10 long running cache futures [total=1] 12:18:10,035 [grid-timeout-worker-#39] WARN org.apache.ignite.internal.diagnostic - >>> Future [startTime=00:16:20.109, curTime=00:18:10.030, fut=GridNearAtomicSingleUpdateFuture [reqState=Primary [id=06dc8f4f-b33a-45c1-8c0d-c6a62527fae1, opRes=true, expCnt=4, rcvdCnt=3, primaryRes=false, done=false, waitFor=[1e36906c-fae5-49a3-b67a-9eed6ada7e4e], rcvd=[de1a8ef5-f0ca-41b1-87f5-dfe9f4517fab, 48cc4679-c256-4666-a39d-76fbd915ac02, f0f38fba-4963-42dd-a64e-774057a61044]], super=GridNearAtomicAbstractUpdateFuture [remapCnt=100, topVer=AffinityTopologyVersion [topVer=7, minorTopVer=0], remapTopVer=null, err=null, futId=1, super=GridFutureAdapter [ignoreInterrupts=false, state=INIT, res=null, hash=316835640 thanks a lot. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Ignite Backup and Restore
Hi, any suggestions? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Ignite Backup and Restore
And yes, btw, is there a tools that help export data and import data, for logical backup and restore like the traditional database? Thanks. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Ignite Backup and Restore
Hello Anton, Not met this data lost yet, just want to make data backup/restore policy. Or, actually, in ignite there is no this kind of concept, as already in cluster? And will auto restore data? As our ignite instance data is very critical, we need care about the data safety. Thanks. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Ignite Backup and Restore
Hi Guru, Any docs about the Ignite backup and restore mechanism, how to recover the data if data lost from cache. Now, we separate the WAL and DB to different folders, once met the data lost, how do I recover data from the wal? Thanks. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Ignite authenticationEnabled queries
thanks a lot, with statement works. Btw, created a new user , but cannot connect to the instance, anything else need settle done? thanks -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Ignite authenticationEnabled queries
not works, still show error, ALTER USER "ignite" SET password 'abcdefg' ; SQL Error [1001] [42000]: Failed to parse query. User "ignite" not found; SQL statement: ALTER USER "ignite" SET password 'abcdefg' [90032-197] -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Ignite Cache exists but table lost
Hi Guru, We found a problem that, caches exists, we can get/set successfully, and file also exists in the work folder, but cannot see the related table by jdbc thin access, the cache was created by java code, not by sql scripts. sometimes can see it, but sometimes not, really surprise, not sure if bug or not, thanks. We use below code to initialize the cache, CacheConfiguration cacheConfiguration = new CacheConfiguration<>(Market.class.getSimpleName()); cacheConfiguration.setIndexedTypes(Long.class, Market.class); cacheConfiguration.setSqlIndexMaxInlineSize(100); cacheConfiguration.setSqlSchema("PUBLIC"); cacheConfiguration.setAtomicityMode(CacheAtomicityMode.ATOMIC); cacheConfiguration.setCacheMode(CacheMode.REPLICATED); -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Ignite authenticationEnabled queries
Hi Guru, Enabled the authentication with below configuration, it is ok for jdbc thin client with ignite/ignite to connect to server, but found cannot change ignite's password, will say no this user. And created new user cannot access, and no where to grant priviledges, how can we go? thanks a lot. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Ignite SSL security
Hi Guru, I am try to implement the SSL security, default-config.xml like below, I have generated the server.jks and trust.jks with command 'keytool -genkey -alias ignite -keystore server.jks -keyalg RSA' and put the file server.jks to the $IGNITE_HOME folder, but when restart ignite, met below exception: Failed to start grid: Failed to initialize key store (key store file was not found): [path=server.jks, msg=server.jks (No such file or directory)] please advice where this file to put in? or any suggestions for the ssl? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Ignite Spring Integration
For more clear, i am using the bin/ignite.sh to start the ignite server, and using the uri hot deployment, my business logic is in the igniteSerivce, and need spring annotation/configuration support. case 1, we deploy our package jar into the ./libs folder, all works fine, but this way cannot hot deploy; case 2, we deploy our package jar into the uri deployment folder, it will show cannot find the application configuration file. thanks. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: Ignite Spring Integration
Thanks, we are not building spring boot application with ignite support, we are trying this scenario, build up the service with Spring Annotation involve, and package into the urideployment folder for service hot deployment. If we put this package into the ignite $IGNITE_HOME/libs folder, then all works fine, include the spring configuration, annotation, autowired, all works fine. But this method cannot achieve the hot deployment, only for one time deployment. But if put this package into urideployment folder, ignite cannot find the spring configuration(dev/local/test/prod) file, which make the spring integration not work as expect. Thanks a lot for suggestions. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Ignite Spring Integration
Hi Guru, I am integrating the Spring into the Ignite, when deploying service, with metho deployNodeSingleton, met no bean found exception, show as below, which lead the Suppressed: class org.apache.ignite.IgniteCheckedException: Error occured during service initialization: [locId=13760585-1342-47d0-b30f-30f62b23df12, name=WebSocketGridService] Caused by: org.springframework.beans.factory.NoSuchBeanDefinitionException: No bean named 'marketDao' available Need helpful, thanks a lot. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: UriDeployment Exception
Finally get works for this approach, it due to my maven package issue, thanks a lot. 1. copy the dependency libs to ignite ./libs; 2. copy the package classes into the urideployment folder. No need the ignite.xml, and no need to restart the server, it will use the latest code. thanks again. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: UriDeployment Exception
hi Evgenii, After serveral tried, seems in the Jar package, need META-INF/ignite.xml descriptor, my one like is, -> http://www.springframework.org/schema/beans; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance; xmlns:util="http://www.springframework.org/schema/util; xsi:schemaLocation=" http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans.xsd http://www.springframework.org/schema/util http://www.springframework.org/schema/util/spring-util.xsd;> Ignite Spring configuration file in gar-file. com.marble.ignite.trade.igniteservice.SimpleMapServiceImpl but when deploy, found Caused by: java.lang.ClassCastException: com.marble.ignite.trade.igniteservice.SimpleMapServiceImpl cannot be cast to org.apache.ignite.services.Service -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: UriDeployment Question
complete exception is like below, Exception in thread "grid-uri-scanner-#2" java.lang.NoClassDefFoundError: org/osgi/service/jdbc/DataSourceFactory at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:756) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:468) at java.net.URLClassLoader.access$100(URLClassLoader.java:74) at java.net.URLClassLoader$1.run(URLClassLoader.java:369) at java.net.URLClassLoader$1.run(URLClassLoader.java:363) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:362) at org.apache.ignite.spi.deployment.uri.GridUriDeploymentClassLoader.loadClass(GridUriDeploymentClassLoader.java:56) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at org.apache.ignite.spi.deployment.uri.GridUriDeploymentFileResourceLoader.createResource(GridUriDeploymentFileResourceLoader.java:72) at org.apache.ignite.spi.deployment.uri.GridUriDeploymentDiscovery.findResourcesInDirectory(GridUriDeploymentDiscovery.java:109) at org.apache.ignite.spi.deployment.uri.GridUriDeploymentDiscovery.findResourcesInDirectory(GridUriDeploymentDiscovery.java:103) at org.apache.ignite.spi.deployment.uri.GridUriDeploymentDiscovery.findResourcesInDirectory(GridUriDeploymentDiscovery.java:103) at org.apache.ignite.spi.deployment.uri.GridUriDeploymentDiscovery.findResourcesInDirectory(GridUriDeploymentDiscovery.java:103) at org.apache.ignite.spi.deployment.uri.GridUriDeploymentDiscovery.getClasses(GridUriDeploymentDiscovery.java:71) at org.apache.ignite.spi.deployment.uri.GridUriDeploymentFileProcessor.processNoDescriptorFile(GridUriDeploymentFileProcessor.java:388) at org.apache.ignite.spi.deployment.uri.GridUriDeploymentFileProcessor.processFile(GridUriDeploymentFileProcessor.java:108) at org.apache.ignite.spi.deployment.uri.UriDeploymentSpi$2.onNewOrUpdatedFile(UriDeploymentSpi.java:587) at org.apache.ignite.spi.deployment.uri.scanners.file.UriDeploymentFileScanner$URIContext.handleFile(UriDeploymentFileScanner.java:268) at org.apache.ignite.spi.deployment.uri.scanners.file.UriDeploymentFileScanner$URIContext.access$200(UriDeploymentFileScanner.java:135) at org.apache.ignite.spi.deployment.uri.scanners.file.UriDeploymentFileScanner$URIContext$1.handle(UriDeploymentFileScanner.java:178) at org.apache.ignite.spi.deployment.uri.scanners.GridDeploymentFolderScannerHelper.scanFolder(GridDeploymentFolderScannerHelper.java:49) at org.apache.ignite.spi.deployment.uri.scanners.GridDeploymentFolderScannerHelper.scanFolder(GridDeploymentFolderScannerHelper.java:52) at org.apache.ignite.spi.deployment.uri.scanners.file.UriDeploymentFileScanner$URIContext.scan(UriDeploymentFileScanner.java:183) at org.apache.ignite.spi.deployment.uri.scanners.file.UriDeploymentFileScanner$URIContext.access$000(UriDeploymentFileScanner.java:135) at org.apache.ignite.spi.deployment.uri.scanners.file.UriDeploymentFileScanner.scan(UriDeploymentFileScanner.java:73) at org.apache.ignite.spi.deployment.uri.scanners.UriDeploymentScannerManager$1.body(UriDeploymentScannerManager.java:115) at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:61) Caused by: java.lang.ClassNotFoundException: org.osgi.service.jdbc.DataSourceFactory at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at org.apache.ignite.spi.deployment.uri.GridUriDeploymentClassLoader.loadClass(GridUriDeploymentClassLoader.java:61) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: UriDeployment Question
I tried even with the 2.8.1, but exception still there, I have already copied the ignite-osgi and ignite-osgi-paxlogging libs to the ./libs folder, java.lang.NoClassDefFoundError: org/osgi/service/jdbc/DataSourceFactory at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:756) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:468) at java.net.URLClassLoader.access$100(URLClassLoader.java:74) at java.net.URLClassLoader$1.run(URLClassLoader.java:369) at java.net.URLClassLoader$1.run(URLClassLoader.java:363) at java.security.AccessController.doPrivileged(Native Method) at java.net.URLClassLoader.findClass(URLClassLoader.java:362) at org.apache.ignite.spi.deployment.uri.GridUriDeploymentClassLoader.loadClass(GridUriDeploymentClassLoader.java:56) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at org.apache.ignite.spi.deployment.uri.GridUriDeploymentFileResourceLoader.createResource(GridUriDeploymentFileResourceLoader.java:72) at org.apache.ignite.spi.deployment.uri.GridUriDeploymentDiscovery.findResourcesInDirectory(GridUriDeploymentDiscovery.java:109) at org.apache.ignite.spi.deployment.uri.GridUriDeploymentDiscovery.findResourcesInDirectory(GridUriDeploymentDiscovery.java:103) at org.apache.ignite.spi.deployment.uri.GridUriDeploymentDiscovery.findResourcesInDirectory(GridUriDeploymentDiscovery.java:103) at org.apache.ignite.spi.deployment.uri.GridUriDeploymentDiscovery.findResourcesInDirectory(GridUriDeploymentDiscovery.java:103) at org.apache.ignite.spi.deployment.uri.GridUriDeploymentDiscovery.getClasses(GridUriDeploymentDiscovery.java:71) at org.apache.ignite.spi.deployment.uri.GridUriDeploymentFileProcessor.processNoDescriptorFile(GridUriDeploymentFileProcessor.java:388) at org.apache.ignite.spi.deployment.uri.GridUriDeploymentFileProcessor.processFile(GridUriDeploymentFileProcessor.java:108) at org.apache.ignite.spi.deployment.uri.UriDeploymentSpi$2.onNewOrUpdatedFile(UriDeploymentSpi.java:587) at org.apache.ignite.spi.deployment.uri.scanners.file.UriDeploymentFileScanner$URIContext.handleFile(UriDeploymentFileScanner.java:268) at org.apache.ignite.spi.deployment.uri.scanners.file.UriDeploymentFileScanner$URIContext.access$200(UriDeploymentFileScanner.java:135) at org.apache.ignite.spi.deployment.uri.scanners.file.UriDeploymentFileScanner$URIContext$1.handle(UriDeploymentFileScanner.java:178) at org.apache.ignite.spi.deployment.uri.scanners.GridDeploymentFolderScannerHelper.scanFolder(GridDeploymentFolderScannerHelper.java:49) at org.apache.ignite.spi.deployment.uri.scanners.GridDeploymentFolderScannerHelper.scanFolder(GridDeploymentFolderScannerHelper.java:52) at org.apache.ignite.spi.deployment.uri.scanners.file.UriDeploymentFileScanner$URIContext.scan(UriDeploymentFileScanner.java:183) at org.apache.ignite.spi.deployment.uri.scanners.file.UriDeploymentFileScanner$URIContext.access$000(UriDeploymentFileScanner.java:135) at org.apache.ignite.spi.deployment.uri.scanners.file.UriDeploymentFileScanner.scan(UriDeploymentFileScanner.java:73) at org.apache.ignite.spi.deployment.uri.scanners.UriDeploymentScannerManager$1.body(UriDeploymentScannerManager.java:115) at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:61) Caused by: java.lang.ClassNotFoundException: org.osgi.service.jdbc.DataSourceFactory at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at org.apache.ignite.spi.deployment.uri.GridUriDeploymentClassLoader.loadClass(GridUriDeploymentClassLoader.java:61) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: UriDeployment Question
thanks, i am using 2.8.0 version. btw, when start the server, met below exception, I am not sure if due to this issue, Caused by: java.lang.ClassNotFoundException: org.osgi.framework.BundleActivator at java.net.URLClassLoader.findClass(URLClassLoader.java:382) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at org.apache.ignite.spi.deployment.uri.GridUriDeploymentClassLoader.loadClass(GridUriDeploymentClassLoader.java:61) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) ... 30 more Exception in thread "grid-uri-scanner-#2" java.lang.NoClassDefFoundError: org/osgi/framework/BundleActivator at java.lang.ClassLoader.defineClass1(Native Method) at java.lang.ClassLoader.defineClass(ClassLoader.java:756) at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142) at java.net.URLClassLoader.defineClass(URLClassLoader.java:468) at java.net.URLClassLoader.access$100(URLClassLoader.java:74) at java.net.URLClassLoader$1.run(URLClassLoader.java:369) at java.net.URLClassLoader$1.run(URLClassLoader.java:363) -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
UriDeployment Question
Hi Expert, I am trying the UriDeployment, the xml setting is, file:///home/myProjects/price-processor-ignite/target/ When ignite startup, I can find the something generated in the deployment folder, but when I try to launch the client to execute methods in my jar, but it shows class not found, I am not sure if something I missed. And btw, if we redeploy the jar into the ./target, we cancel/start the service in the jar, ignite will reload the new jar, right? If so, I no need to restart the ignite instance. Thanks again. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
How to close/cancel a running tasks?
Hi Experts, Say I have a while (true) task, which help monitoring/handling the MQ messages. Once I need change the logic, how I redeploy the task? how I cancel this task and let the cluster using the new logic jar? Do I need restart all cluster nodes? But my cluster nodes have other tasks running. Thanks a lot. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: How Ignite launch the ./libs Jar
thanks Ilya, lifecyclebean just verified works. Can you share the "configure Ignite to automatically register service" related links? thanks. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: How Ignite launch the ./libs Jar
Thanks a lot Ilya. My confusion is, where to fire the task, does Ignite will help launch this task when startup the ignite instance? I have tried, but not found any logs output. If ignite cannot help launch, only load the class into memory, then where to fire/trigger this tasks? need a separate client to launch it? If ignite can help start the task, how to, can help review my ignite.xml and point out the incorrect settings? Thanks a lot. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: How Ignite launch the ./libs Jar
Can I understand the task deployment like this: package jar to ./libs, Ignite only will load this class into instance, but will not trigger that, task will only trigger by outside the ignite client or jdbc or jmx? In this case, outside programmer only need to know the taskName, and call this task directly? But if so, how to pass the parameter to this task? Best if with samples, thanks a lot. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: How to create a compute tasks which uses Cache and transaction?
Hi Denis, "use the REST API shared by Dmtriy to trigger the task." How to do that? can you share more details, now I have the task deployed to the ./libs, but don't know how to trigger, or ignite will help auto trigger, as task already describe in the META-INF/ignite.xml? And btw, does it must the task implement the computeTask, is it ok also implement the ComputeTaskSplitAdapter or ComputeTaskAdapter? thanks. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Re: How Ignite launch the ./libs Jar
thanks a lot Alex. I saw my jar from the java process. But cannot see the logs I print out from the ignite console, I am not sure whether the task run or not run, My META-INF/ignite.xml defined as below, http://www.springframework.org/schema/beans; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance; xmlns:util="http://www.springframework.org/schema/util; xsi:schemaLocation=" http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans.xsd http://www.springframework.org/schema/util http://www.springframework.org/schema/util/spring-util.xsd;> Ignite Spring configuration file in gar-file. com.coinflex.ComputeTaskDeployment And the task ComputeTaskDeployment is simple as below, public class ComputeTaskDeployment extends ComputeTaskSplitAdapter { @IgniteInstanceResource Ignite ignite; public ComputeTaskDeployment() { System.out.println("starting the ComputeTaskDeployment sample"); } @Override protected Collection split(int clusterSize, String arg) { Collection jobs = new LinkedList<>(); arg = "how many words there."; for (final String word : arg.split(" ")) { jobs.add(new ComputeJobAdapter() { @Nullable @Override public Object execute() { // Return number of letters in the word. int len = word.length(); System.out.println(">>> Printing '" + word + "' length is:" + len + " on this nodeID " + ignite.cluster().localNode().id() + " from ignite job."); return len; } }); } return jobs; } /** {@inheritDoc} */ @Nullable @Override public Integer reduce(List results) { int sum = 0; System.out.println("reduce start..."); for (ComputeJobResult res : results) sum += res.getData(); return sum; } } thanks again Alex -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
How Ignite launch the ./libs Jar
Hi , need your help, or give a link, or give a hint on this deployment, Ignite Jar deployment case, Say I have a jar package with the main-class defined, and put it into the ./libs folder, what will the ignite do, ignite how to launch this Jar? Which is the endpoint for Ignite launch this Jar? Any specification for the Jar to the ./libs, btw , is there a full example of the userversion xml of ignite.xml, if put below content into the ignite.xml, ignite shows cannot recognize the userVersion tag, my problem is don't know what ignite launch this Jar, I expect ignite can help launch the Jar main-class, and monitoring the cache put event, and it will fire the compute/tasks. And which is a loop forever. Thanks a lot. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/