Ignite Transaction and Cache Events

2018-07-13 Thread xero
Hi, Do you know if there is mechanism to subscribe for to transaction events (pre or post commit)? My scenario is the following: I have 2 caches (A and B) that are modified in the same transaction. On the other hand, I have a third C cache whose entries are calculated based on A and B values. I

Re: Does event listener keep the order of events as they occur on the cluster?

2018-07-13 Thread vkulichenko
You should use continuous queries for this: https://apacheignite.readme.io/docs/continuous-queries. They provide exactly once notification semantics with ordering guarantees. -Val -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Nodes distribution/nodes in parallel on one host using Yarn

2018-07-13 Thread Renan Pinzon
Hi Ilya, First of all thanks for your response! I thought about increasing the resources to prevent more than one node on a host but I believe that in this case it will be better to keep the cluster running in standalone mode. Firstly because I won't make use of affinity between Ignite and

Re: Thin client doesn't support Expiry Policies.

2018-07-13 Thread Igor Sapego
You understand it correctly. Currently you can not dynamically start cache from thin client with expiry policy. Still, you can configure static cache with whatever expiry policy you want, using Spring Config and then get it from the thin client. Would that do for you? Best Regards, Igor On Thu,

spark ignite - how to set ignite client jvm memory options?

2018-07-13 Thread wt
the console is warning on heap memory and i want to increase it but doing so in sparks config doesn't have an affect. How can i set it for the client in spark? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: 3rd party persistence with Hive

2018-07-13 Thread engrdean
Thanks Ivan for confirming my suspicions around the query support for Hive. I did attempt the SQLServerDialect as well but had the same results. I did get a success message for the load but no data was actually loaded into the cache so it appears that was a false positive. -- Sent from:

Ignite AWS cluster setup

2018-07-13 Thread Kia Rahmani
Hello all, I recently started using Ignite for benchmarking a research project on a local multi-node cluster. Now I need to deploy the cluster on geographically distributed nodes, but I am stuck at setting up the connection on EC2 machines. I have closely followed the TCP-based discovery

Exception while running sql inside ignite transaction

2018-07-13 Thread akash shinde
Hi, I am facing below exception while executing query on cache. This exception is not consistent. I am starting transaction in optimistic mode. Could someone please advice. try (Transaction transaction = igniteTx .txStart(TransactionConcurrency.OPTIMISTIC, TransactionIsolation.SERIALIZABLE))

RE: How long Ignite retries upon NODE_FAILED events

2018-07-13 Thread HEWA WIDANA GAMAGE, SUBASH
I tried unfortunately I could not reproduce it again to save the logs. All I remember is, step4 done immediately reproduced the issue. Anyways, if I see anything again, will let know. Thanks. From: Evgenii Zhuravlev [mailto:e.zhuravlev...@gmail.com] Sent: Tuesday, July 03, 2018 2:43 AM To:

Re: odbc / cursor is in open state allready

2018-07-13 Thread Igor Sapego
Hi, You can use nightly builds [1] as an option. [1] - https://ci.ignite.apache.org/project.html?projectId=Releases_NightlyRelease Best Regards, Igor On Fri, Jul 13, 2018 at 11:58 AM Som Som <2av10...@gmail.com> wrote: > hi. yes, that's it. > > when is the new release with the fix planned?

Re: Spring application context resource is not injected

2018-07-13 Thread wt
this is all i am running val df = spark.read.format(FORMAT_IGNITE).option(OPTION_TABLE,"ComplianceSummaryCache.ComplianceSummary").option(OPTION_CONFIG_FILE,"stoxx-server.xml").load() the intellij project hosting the server was downloaded from the web console. I haven't changed anything there.

Re: Spring application context resource is not injected

2018-07-13 Thread Prasad Bhalerao
Can you please share the code? On Fri, Jul 13, 2018 at 4:32 PM wt wrote: > Hi > > I switched to spark 2.2 and now i am getting a different error: > > *on the server (intellij running) i have the following output:* > > > [18:50:49]__ > [18:50:49] / _/ ___/ |/ /

Spring application context resource is not injected

2018-07-13 Thread wt
Hi I switched to spark 2.2 and now i am getting a different error: *on the server (intellij running) i have the following output:* [18:50:49]__ [18:50:49] / _/ ___/ |/ / _/_ __/ __/ [18:50:49] _/ // (7 7// / / / / _/ [18:50:49] /___/\___/_/|_/___/

Re: Nodes distribution/nodes in parallel on one host using Yarn

2018-07-13 Thread Ilya Kasnacheev
Hello! I'm afraid you will have to debug it and fill and issue since there's not much expertise in YARN deployments here. One thing I see in the source that additional nodes might be brought up on the same host if it has extra resources (as determined by YARN resource management) I suggest

Re: odbc / cursor is in open state allready

2018-07-13 Thread Som Som
hi. yes, that's it. when is the new release with the fix planned? or how can get a fixed version of driver? 13 июл. 2018 г. 10:20 ДП пользователь "Pavel Vinokurov" < vinokurov.pa...@gmail.com> написал: Hi, Probably this issue relates to https://issues.apache.org/jira/browse/IGNITE-8838

Re: Possible starvation in striped pool

2018-07-13 Thread Ilya Kasnacheev
Hello! I can see here that you are trying to destroy a cache: at org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:177) at org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:140) at

Re: spark ignite - Failed to instantiate Spring XML application context

2018-07-13 Thread Ray
Please refer to this ticket for more information. https://issues.apache.org/jira/browse/IGNITE-8534 -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: odbc / cursor is in open state allready

2018-07-13 Thread Pavel Vinokurov
Hi, Probably this issue relates to https://issues.apache.org/jira/browse/IGNITE-8838 Thanks, Pavel 2018-07-12 15:36 GMT+03:00 Som Som <2av10...@gmail.com>: > 2.5.0 > > чт, 12 июл. 2018 г., 12:47 Igor Sapego : > >> Hello, >> >> What is the Ignite version you are using? >> >> Best Regards, >>

Re: spark ignite - Failed to instantiate Spring XML application context

2018-07-13 Thread wt
thanks a million for that nugget. I tried to find that info and couldn't find it, do you perhaps have a link to a resource i can digest as there seems to be little documentation around the technicals. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: spark ignite - Failed to instantiate Spring XML application context

2018-07-13 Thread Ray
Currently, Ignite can only works with Spark 2.2. When Ignite 2.6 releases, it will be able to work with Spark 2.3. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

spark ignite - Failed to instantiate Spring XML application context

2018-07-13 Thread wt
i have ignite running out of intellij and all is okay, i can connect to it using dbbeaver and create and query tables. Trying to get spark working with it and all imports are okay however when i try read from ignite i get this error that i am struggling to find any information about on the web.

Re: Can't write to Ignite cluster

2018-07-13 Thread Ray
Here's the full log and thread dump for three nodes and client to ingest data. node1.zip node2.zip node3.zip

Re: 3rd party persistence with Hive

2018-07-13 Thread Павлухин Иван
Hi engrdean, I see 2 points here: 1. Log says that load was failed in multi-threaded mode. But then it says that loading was finished, which means that it succeeded in single-threaded mode. 2. Indeed Ignite generates query which is not supported by Hive. And not supported thing is 'mod' operator,