Re: Index not getting created

2017-11-30 Thread Naveen Kumar
Hi Here is the node logs captured with -v option. [22:56:41,291][SEVERE][client-connector-#618%IgnitePOC%][JdbcRequestHandler] Failed to execute SQL query [reqId=0, req=JdbcQueryExecuteRequest [schemaName=PUBLIC, pageSize=1024, maxRows=0, sqlQry=CREATE INDEX idx_customer_accountId ON

Re: sql insert with composite primary key

2017-11-30 Thread vkulichenko
Then the insert syntax I provided should work. -Val -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: MarshallerContextImpl: Failed to write class name to file

2017-11-30 Thread jpmoore40
Thanks Ilya! -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re:Re: Re: Re: Re: JdbcQueryExecuteResult cast error

2017-11-30 Thread Lucky
Denis, add additional synchronization? But how? Thanks. At 2017-11-30 14:52:05, "Denis Mekhanikov" wrote: Lucky, If it's possible, that this code is executed cuncurrently, then you need to add additional synchronization. Otherwise correct work of JDBC

Re: Retrieving keys very slow from a partitioned, no backup, no replicated cache

2017-11-30 Thread Alexey Popov
Hi Anand, Ignite will collect a batch of updates for multiple operations if you enable write-behind. So, it will be done for entry.setvalue() within Cache.invoke for your case. And then Ignite will make a writeall() call for the batch. If your own CacheStore implementation does not override

Re:Re: Re:Poor performance select query with jdbc thin mode

2017-11-30 Thread Lucky
Denis, It's worse! There just have several sql can be faster, the other took more time. Thanks. 在 2017-11-29 21:31:05,"Denis Mekhanikov" 写道: Lucky, Try enabling enforceJoinOrder parameter in JDBC connection string and let us know the result. Your JDBC

Re: Re: Re: Re: Re: JdbcQueryExecuteResult cast error

2017-11-30 Thread Denis Mekhanikov
> add additional synchronization? > But how? You should make sure, that one JDBC connections is not used from multiple threads simultaneously. You can, for example, acquire some lock before using it. > Another thing, the JDBC connection can be closed automatically? Do you mean closing by

Re: Error running ignite in YARN

2017-11-30 Thread ilya.kasnacheev
Hello Juan! We are looking into the Yarn portion of this case. Meanwhile, could you tell us what happens if tou fix launch_container.sh script? I believe it should be export BASH_FUNC_run_prestart="() { su -s /bin/bash $SVC_USER -c "cd $WORKING_DIR && $EXEC_PATH --config '$CONF_DIR' start

Re: MarshallerContextImpl: Failed to write class name to file

2017-11-30 Thread jpmoore40
Having done a bit more digging it seems the best option is to not set IGNITE_HOME at all but use IgniteConfiguration.setWorkDirectory(). I'm potentially going to be running multiple nodes on the same server and would prefer not to create individual start-up scripts for each (as I may want to add

Re: Local node and remote node have different version numbers

2017-11-30 Thread Evgenii Zhuravlev
Are you sure that you are using not Multicast IP finder? Please share configuration for all nodes that find each other and log files 2017-11-30 9:32 GMT+03:00 Rajarshi Pain : > Hi Evgenii, > > We both tried to specify the port, but still we rae getting same error if > we

Web Console on Kubernetes Cluster

2017-11-30 Thread lukaszbyjos
Hi. Quick question. How to connect web console with my kubernetes cluster pods (server and client). I have cluster with one pod as server node and few clients. I thought that I need to just deploy webconsole image and it will connect to nodes. But later I found that I need some web agent. How to

Re: SQL Count(*) returns incorrect count

2017-11-30 Thread vkulichenko
Hi, Your assumptions are correct. There is also an issue [1] that likely is causing this behavior. As a workaround you can try to force IgniteContext to start everything in client mode. In order to achieve this, use setClientMode(true) in the closure that created IgniteConfiguration:

Does the Ignite C# client support distributed queues?

2017-11-30 Thread Raymond Wilson
I’ve been reading up on the distributed queue support in Ignite which may be a good fit for a use case we have. Looking at the Ignite C# client this does not seem to be supported. Is this supported in the C# client? If not, when is it planned to be included? Thanks, Raymond.

Re: get api takes more time when adding more nodes to cluster

2017-11-30 Thread vkulichenko
Biren, I meant that you can have a standalone cluster and embed client node into the application instead of server node. Making these caches replicated can be also an option - in this case all reads will be local and fast. -Val -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: SQL Count(*) returns incorrect count

2017-11-30 Thread soroka21
Thank you for suggestions. I have 5 node standalone ignite cluster and the main goal is to load data into it and store it for long time for future use. I can't keep Spark workers in memory and assume what my data is ending up in cache distributed inside 5 standalone ignite nodes. Spark process is

RE: Does the Ignite C# client support distributed queues?

2017-11-30 Thread vkulichenko
Oops, I read wrong! This is not supported. There is a ticket, but it doesn't seem to be active at the moment: https://issues.apache.org/jira/browse/IGNITE-1417 -Val -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Facing issue Ignite 2.3 and Vertex-ignite 3.5.0

2017-11-30 Thread Denis Magda
Automatic cluster activation with the persistence enabled will become possible once we release the baseline topology: https://cwiki.apache.org/confluence/display/IGNITE/IEP-4+Baseline+topology+for+caches It

Re: Ignite DataStream vs cache putAll

2017-11-30 Thread Denis Magda
I would suggest the data streamer for initial data preloading or when you stream data continuously into the cluster. Personally, I’ve never seen putAll to beat the data streamer. Check that you have allowOverwrite set to true. Plus you can tweak another parameters. — Denis > On Nov 28, 2017,

Re: Ignite DataStream vs cache putAll

2017-11-30 Thread daniels
Thank you dear Denis,I will follow to your suggestions. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Number of open file handles keeps on increasing on Ignite node on adding a new cache

2017-11-30 Thread Denis Magda
Hi, You can leverage from Cache Groups if a total number of opened files is an issue for your environment: https://apacheignite.readme.io/docs/cache-groups — Denis > On Nov 28, 2017, at 11:34 PM, aMark wrote: > > Hi, >

Re: Does the Ignite C# client support distributed queues?

2017-11-30 Thread vkulichenko
Ryamond, It is supported, see here: https://apacheignite-sql.readme.io/docs/net-sql-api -Val -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

RE: Does the Ignite C# client support distributed queues?

2017-11-30 Thread Raymond Wilson
Hi Val, This seems to be related to queries, not queues as described here: https://apacheignite.readme.io/docs/queue-and-set Thanks, Raymond. -Original Message- From: vkulichenko [mailto:valentin.kuliche...@gmail.com] Sent: Friday, December 1, 2017 11:49 AM To: user@ignite.apache.org

Did the default page size change between Ignite 2.2 and 2.3

2017-11-30 Thread Raymond Wilson
I am upgrading from Ignite 2.2 to 2.3. I use persistent storage and have an existing data store. When activating the cluster I get the following error in the C# client: class org.apache.ignite.IgniteCheckedException: Failed to verify store file (invalid page size) [expectedPageSize=4096,

RE: Does the Ignite C# client support distributed queues?

2017-11-30 Thread Raymond Wilson
Looking at it I see it's blocked by 2701 (which has additional dependencies, all of which say they are blocked by 2701). I understand there is an intention to bring the C# client up to par with the Java client. Is there a ticket/schedule yet for this? Raymond. -Original Message- From:

Re: Did the default page size change between Ignite 2.2 and 2.3

2017-11-30 Thread Denis Magda
The page default size was changed to 4KB in 2.3 because of performance considerations: https://apacheignite.readme.io/docs/durable-memory-tuning#section-page-size Roll the size back to 2KB manually in your cluster

RE: Did the default page size change between Ignite 2.2 and 2.3

2017-11-30 Thread Raymond Wilson
Thanks Denis. I did give that a try in the meantime and it sorted it out. Do you know how much of a performance delta it made? Thanks, Raymond. *From:* Denis Magda [mailto:dma...@apache.org] *Sent:* Friday, December 1, 2017 4:15 PM *To:* user@ignite.apache.org *Subject:* Re: Did the

Re:Re: Re: Re: Re: JdbcQueryExecuteResult cast error

2017-11-30 Thread Lucky
Denis, Another thing, the JDBC connection can be closed automatically?

Re: Java's DelayQueue as distributed data structure?

2017-11-30 Thread slava.koptilin
Hi Teun, Apache Ignite provides support for the following data structures: - distributed blocking queue (IgniteQueue) and distributed set (IgniteSet) - atomic types (IgniteAtomicLong, IgniteAtomicReference) - syncronization objects (CountDownLatch, Semaphore) - distributed atomic sequence

Re: Two persistent data stores for a single Ignite cluster - RDBMS and Ignite native

2017-11-30 Thread slava.koptilin
Hi Naveen, At the first glance, you can try using Continuous Query in order to listen all modifications (an entry is inserted, updated or deleted) of a cache. Please see the following page for the detailed information [1] Another approach that may be used here is using two caches. The first one

Re: Number of open file handles keeps on increasing on Ignite node on adding a new cache

2017-11-30 Thread afedotov
Hi, Do you use Ignite Persistent Store? If that's the case, then for each cache partition there is a corresponding file created. Kind regards, Alex -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Sorting or ranking TextQuery?

2017-11-30 Thread Andrey Mashenkov
Hi, 1. Ignite (from 2.1 version) has dependencies to Lucene 5.5.2 verison. So, documentation you reference to may be out dated, 2. Ignite doesn't support configuration for underlying Lucene. Feel free to create a ticket if you need smth. 3. Ignite has separate dependencies of H2 and Lucene

Re: Local node and remote node have different version numbers

2017-11-30 Thread Rajarshi Pain
The code is in client machine so can not share the code, config is there in this mail chain. Yes we are not using multi cast ip. But as we couldn't fix it so my colleague is using the multicast ip that given in ignite website. On Thu 30 Nov, 2017, 15:44 Evgenii Zhuravlev,

Re: Ignite node crashes after one query fetches many entries from cache

2017-11-30 Thread Igor Sapego
Ray, In upcoming version you can do it a standard way for ODBC - using SQL_ATTR_QUERY_TIMEOUT. It will only be available starting with version 2.4 though [1], but it is already in master and you can try it out using nightly build [2] or if you are willing to build driver by yourself from the

Deploy Cluster Singleton blocks and never returns

2017-11-30 Thread jeansafar
Hi, I am deploying a few Cluster Singletons in my prototype. The first one is deployed successfully yet the second one blocks and never return due to a lock in GridFutureAdapter: private R get0(boolean ignoreInterrupts) throws IgniteCheckedException { if (isDone() ||

Re: Ignite node crashes after one query fetches many entries from cache

2017-11-30 Thread Ray
Anton, thanks for the heads up. Any idea on how to set the timeout if I'm using ODBC to do the query? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Index not getting created

2017-11-30 Thread Alexey Kukushkin
Naveen, Your "CREATE INDEX" syntax seems valid to me. Can you start server nodes with debugging enabled, reproduce the problem and share the debug log output from the servers?

Re: Error running ignite in YARN

2017-11-30 Thread ilya.kasnacheev
Hello again! After a close examination I have discovered a problem between Ignite YARN and Hadoop code: Ignite YARN collects all existing environment variables to pass them to container, including variables with incorrect names, such as Bash functions, which have extra characters at the end, and

Java's DelayQueue as distributed data structure?

2017-11-30 Thread th76
Hi, Is it possible to use java.util.concurrent.DelayQueue (https://docs.oracle.com/javase/8/docs/api/java/util/concurrent/DelayQueue.html) as distributed data structure? Thanks! Teun Hoogendoorn -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Local node and remote node have different version numbers

2017-11-30 Thread Evgenii Zhuravlev
Also, as you saw, example ignite xml has MulticastIpFinder configured, so, I think it's the root cause. Please make sure that you really started Ignite with config file, that doesn't have configured MulticastIpFinder, it's possible that you run node with default example xml config file Evgenii

Re: Lucene query syntaxt support in TextQuery ?

2017-11-30 Thread Andrey Mashenkov
Hi, Have you tries to use lowercase or uppercase for field name, AFAIK field name character's case may be a reason. Would you please, let us know if it help you or not? On Wed, Nov 29, 2017 at 3:24 PM, zbyszek wrote: > Val, thank you for confirmation. > > zbyszek > > > > --

Re: MarshallerContextImpl: Failed to write class name to file

2017-11-30 Thread ilya.kasnacheev
Hello! Yes, specifying workDirectory should work OK. For log files, it would depend on which logger you are using (e.g. Log4j2), and it should be configured using that logger's configuration. Regards, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Local node and remote node have different version numbers

2017-11-30 Thread Evgenii Zhuravlev
So, don't use multi cast ip finder at all. 2017-11-30 15:27 GMT+03:00 Rajarshi Pain : > The code is in client machine so can not share the code, config is there > in this mail chain. Yes we are not using multi cast ip. But as we couldn't > fix it so my colleague is using

Re: Java's DelayQueue as distributed data structure?

2017-11-30 Thread th76
Hi Slava, Thanks for your response. Hopefully the DelayQueue is added in the future. Can I make a feature request for the DelayQueue somewhere? Greetings, Teun Hoogendoorn -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Index not getting created

2017-11-30 Thread Taras Ledkov
Hi, I cannot reproduce the issue with described steps. Please check that the cache wasn't destroyed on the server. i.e. please execute SELECT query again after failed CREATE INDEX. On 30.11.2017 11:45, Naveen wrote: Has anyone got a chance to look into into this issue where I am trying to

Re: Lucene query syntaxt support in TextQuery ?

2017-11-30 Thread zbyszek
Hi Andrew, Indeed, this is related to field names: 1. In ver. 2.3 the solution is to use uppercase names for query to work, although my all fields are lowercase (as you can see in attached example). I would still consider this as a bug though 2. In ver. 2.0 it works as expected - it works for

Re: Number of open file handles keeps on increasing on Ignite node on adding a new cache

2017-11-30 Thread aMark
Thanks for reply. Yes I use persistent store. For each cache there are close to 1.2 million entries and it creates close to 500 files(part*.bin) of 1 MB in Persistent store directory but questions is why Ignite keeps file handles opens even after there is no active reader/writer to that cache.

read/persist a huge cache by its affinity key

2017-11-30 Thread Marco
Hi, I'm currently working on a traffic project, a traffic cache has been assigned to incrementally save user cookie, now I'm thinking about how to persist it to disk and then restart the cluster. but I would like to know how to do this manually and continuously. Ignite version: 2.1 Cluster: 6

the balance between read and write.

2017-11-30 Thread Marco
this use case is about using ignite for instant sales analytics. The data size is less then 1M, but data state changes frequently, on the other hand, query processor initiates parallel financial aggregations and publish outputs to dashboard. Months ago, we tried partition cache (v1.7, 4 nodes,

Re: Number of open file handles keeps on increasing on Ignite node on adding a new cache

2017-11-30 Thread aMark
Thanks Denis. In my case there is only one type of cache. If I put all the cache in single group, will it help ? Thanks, -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: read/persist a huge cache by its affinity key

2017-11-30 Thread Marco
is there straight forward API to identify row entries? for example: batch 1: from table1 where id>0 and id<100 batch 2: from table1 where id>=100 and id<200 batch 3: from table1 where id>=200 and id<300 .. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Out of memory error

2017-11-30 Thread consultant_dmitry
Hi Ignite team, My cluster is a windows server with 32 gb RAM (24 free). I built project in gridgain.console and use default properties for my project (only change Query parallelism parameter). When I run my project in IDEA I have next error log: [18:13:20] Ignite node started OK (id=7598c95e,

Can Ignite native persistence used with 3rd party persistence?

2017-11-30 Thread Ray
Ignite native persistence provides on-disk sql query and quick cluster startup without data loading, so we definitely want to use it. But we have a legacy hbase served as persistence layer and there are some business rely on it. So can Ignite native persistence used with 3rd party persistence?