Re: why I can't join node?(Error msg : Some error in join process)

2018-05-09 Thread aealexsandrov
Hi, Looks like you have some problems in your classpath: java.lang.NoSuchMethodError: com.google.common.util.concurrent.MoreExecutors.sameThreadExecutor()Lcom/google/common/util/concurrent/ListeningExecutorService; Could you please check that all plugins versions in your pom.xml is up to

Re: BinaryObjectBuilder - setField - Boolean Type - Problem

2018-05-08 Thread aealexsandrov
Hi Jonathan, I tested your example with last changes from ignite apache repository. Everything looks ok. My steps: 1)Start server node 2)Connect to server node using sqlline tool: sqlline.bat --color=true --verbose=true -u jdbc:ignite:thin://127.0.0.1:10800 3)Create new table: 0:

Re: What is the most efficient way to scan all data partitions?

2018-05-09 Thread aealexsandrov
Hi, It's normal that writing to disk is causing the degradation. You can do several optimizations to speed up writting to disk: https://apacheignite.readme.io/docs/durable-memory-tuning https://apacheignite.readme.io/docs/performance-tips However you can try to test your example with next

Re: What is the most efficient way to scan all data partitions?

2018-05-09 Thread aealexsandrov
Sorry I meant in configuration. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Inconsistency reading cache from code and via REST?

2018-05-09 Thread aealexsandrov
Hi, qryexe doesn't work correct. At some reason it ignores _key and _value in 2.4. You can use qryfldexe as it was describe here: http://apache-ignite-users.70518.x6.nabble.com/Example-of-SQL-query-td21427.html BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Example of SQL query

2018-05-09 Thread aealexsandrov
Hi again, We already discussed about it recently. At the moment some things works incorrect in 2.4: 1)Rest API only support String as key and value. And looks like you can't use affinity key on strings for the same issue. But if you can setup it using AffinityKeyMapper anotation: public

Re: Backup and Restore of Ignite Persistence

2018-05-09 Thread aealexsandrov
Hi, Yes Ignite store the data into files. For every cache entity could exist some primiry node and optionally several backups node. It could be configured in CacheConfiguration. Read about it you can here: https://apacheignite.readme.io/v1.1/docs/primary-and-backup-copies For example you have

Re: Ignite user create/modify trouble

2018-06-08 Thread aealexsandrov
Hi, Documentation should be updated as for me to describe how it designed in SQL. I will file the issue. When you use SQL and require to create the user like TesT then just use quotes. Without quotes, you will create TEST. In case if you are going to change the password for TesT user via SQL

Re: Ignite user create/modify trouble

2018-06-08 Thread aealexsandrov
https://issues.apache.org/jira/browse/IGNITE-8756 -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite user create/modify trouble

2018-06-07 Thread aealexsandrov
Hi, When you create the user in quotes ("test") using SQL as next: CREATE USER "test" WITH PASSWORD 'test' It will be created as it was set (in this case it will be test) If you create the user without quotes (test) using SQL as next: CREATE USER test WITH PASSWORD 'test' then username will

Re: IgniteCheckedException: Error while creating file page store caused by NullPointerException

2018-06-19 Thread aealexsandrov
As a workaround, you can try to add execution rights (like in your example) to all files under work directory. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Clarification regarding nodeFilter

2018-05-29 Thread aealexsandrov
Hi, I checked next code: Ignite ignite = IgnitionEx.start("examples/config/example-ignite.xml", "ignite-1"); Ignite ignite2 = IgnitionEx.start("examples/config/example-ignite.xml", "ignite-2"); ClusterGroup cg = ignite2.cluster().forPredicate(new IgnitePredicate() {

Re: Clarification regarding nodeFilter

2018-05-29 Thread aealexsandrov
Hi, I think that it could work. But I think you in case if you see that you should change the list of nodes where your server should be run, you should first cancel your service on all nodes and only then delete the files and redeploy the service. BR, Andrei -- Sent from:

Re: Clarification regarding nodeFilter

2018-05-28 Thread aealexsandrov
Hi, Please take a look at my answers below: 1)Yes. Node filter should be run only on coordinator node after reassignment process. It could be executed several times and possible that Ignite instance can be uninjected. All this behavior should be documented as well as for me. 2) Node filter

Re: Need clarification on redeploy behavior

2018-05-28 Thread aealexsandrov
Hi, There is no force deploying/undeploying possibility as I know. As was mentioned in another your question: http://apache-ignite-users.70518.x6.nabble.com/Clarification-regarding-nodeFilter-td21671.html Node filter predicate should be stateless and should always return the same value for the

Re: Clarification regarding nodeFilter

2018-05-28 Thread aealexsandrov
Hi, Indeed there is some unexpected behavior of the how it documented and how it works. I filed next issues related to service/cache deploying with node filters: https://issues.apache.org/jira/browse/IGNITE-8629 - There is no documentation about what on which node Ignite Predicate will be

Re: Question on Ignite and Spark Structured Streaming Integration.

2018-06-27 Thread aealexsandrov
Hi, As I know there is no any special sink function for streaming to Ignite. Also, I don't see "jdbc" format in official documentation of spark (only file, kafka, console, memory and foreach): https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#output-sinks However,

Re: Apache Ignite Rest API JOIN with multiple Caches

2018-06-27 Thread aealexsandrov
Hi, Try to use qryfldexe: For example, I create next caches: ss1.java It creates two caches with the same structure. Now I am going to execute next command: SELECT * FROM "mycache1".Value V1 join "mycache2".Value V2 on

Re: ClassCastException in Hibernate QueryCache

2018-06-27 Thread aealexsandrov
Hi, I think that the problem is that next code doesn't work in java: public static class SerializableObject implements Serializable {} and Object[] array = new Object[1]; array[0] = new SerializableObject(); Serializable[] serializableArr = (Serializable[])

Re: Distributed Closures Apply method/c#

2018-06-25 Thread aealexsandrov
Very strange. By default, there is no any timeout. I will take a look more carefully. Also is it possible that you cancel the closure somehow? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Distributed Closures Apply method/c#

2018-06-25 Thread aealexsandrov
Hi, Could you please provide the exception? As I see from the code if you didn't set some timeout manual using writeTimeout method then Long.MAX_VALUE should be used. Long timeout = (Long)map.get(TC_TIMEOUT); long timeout0 = timeout == null || timeout == 0 ? Long.MAX_VALUE :

Re: ClassCastException in Hibernate QueryCache

2018-06-25 Thread aealexsandrov
Hi, Could you please provide some more details: cache configuration, an example of code that was failed and logs? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Running Node removal from baseline

2018-06-25 Thread aealexsandrov
Hi, Now in case of the node was left the BLT cluster will wait for it. In case if it can't return for a long time user should manually remove it from BTL and it will do rebalance like in this example:

Re: running Apache Ignite in docker with cgroups

2018-06-22 Thread aealexsandrov
Hi, Could you please provide your configuration files? How many nodes did you start in your container? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: IgniteCheckedException: Error while creating file page store caused by NullPointerException

2018-06-19 Thread aealexsandrov
Hi, Is this issue reproducible? Can you change the work directory path or clear your work directory and check again? Did you try to modify or copy anything from work directory? However, could you please provide the cluster configuration and code reproducer? BR, Andrei -- Sent from:

Re: If a lock is held by another node IgniteCache.isLocalLocked() appears to return incorrect results.

2018-06-19 Thread aealexsandrov
Hi, I filed next issue: https://issues.apache.org/jira/browse/IGNITE-8833 Thank you, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Using Persistent ignite queues

2018-06-19 Thread aealexsandrov
Hi, Could you please provide next for investigation: 1)Thread dump that you should create at the moment when cluster hung. 2)Code of your service 3)Logs of the cluster nodes. 4)The configuration of the clusters. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Apache Ignite Rest API JOIN with multiple Caches

2018-06-21 Thread aealexsandrov
Hi, I will check it. Possible that something doesn't work as expected. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: What does "Non heap" mean in the log?

2018-04-26 Thread aealexsandrov
Hi, It's non-heap memory that can be used for JVM memory management. You can read about this here: https://docs.oracle.com/javase/7/docs/api/java/lang/management/MemoryUsage.html

Re: SQL Query full table scan, Node goes down

2018-06-20 Thread aealexsandrov
Hi, Please read the documentation more accurate. The lazy flag you should set on the SqlFieldsQuery object. It could be set on that node where you are going to use it. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Apache Ignite Rest API JOIN with multiple Caches

2018-06-20 Thread aealexsandrov
Hi, Question was answered in https://stackoverflow.com/questions/50950480/join-on-apache-ignite-rest-api/50950777#50950777. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Is there any way to remove a node from cluster safely?

2018-06-21 Thread aealexsandrov
Hi, Unfortunately, in your environment, you can't stop the node without losing the data. To stop one node safety you require at least one backup. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: setting baseline topology in kubernetes

2018-06-21 Thread aealexsandrov
Hi, All existing options of control.sh tool you can see here: https://apacheignite.readme.io/docs/baseline-topology#section-cluster-activation-tool To connect to some host and port you can use --host --port options (default values 127.0.0.1 and 11211). In case if you started the ignite in

Re: [ANNOUNCE] Apache Ignite 2.5.0 Released

2018-06-19 Thread aealexsandrov
Hi szj, Could you please redirect your questions to the new thread? Also, don't forget to provide the steps for reproducing and logs. PS. I will check your case with ignitevisorcmd.sh and node restarting. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: If a lock is held by another node IgniteCache.isLocalLocked() appears to return incorrect results.

2018-06-19 Thread aealexsandrov
Hi, It looks like an issue. Let me investigate it and create an issue. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: setting baseline topology in kubernetes

2018-06-22 Thread aealexsandrov
Hi, No 11211 is a default ignite TCP port. For every new node, it will be incremented 11211, 11212, 11213, etc. Also please check that you didn't overwrite it. https://www.gridgain.com/sdk/pe/latest/javadoc/org/apache/ignite/spi/discovery/tcp/TcpDiscoverySpi.html#setLocalPort-int- And yes

Re: Using SQL users to open jdbc connections

2018-07-26 Thread aealexsandrov
Hi, Could you please show the command how you create new users? When you create the user in quotes ("test") using SQL as next: CREATE USER "test" WITH PASSWORD 'test' It will be created as it was set (in this case it will be test) If you create the user without quotes (test) using SQL as

Re: The problem after the ignite upgrade

2018-07-27 Thread aealexsandrov
Hi, Could you please provide step by step instruction on how you upgrade the cluster? Please note that in case if you try to use the persistence then the important feature that was added in 8.4 - baseline topology. A baseline topology is a set of Ignite server nodes intended to store data. The

Re: Spark-Ignite integration: unable to find CONFIG

2018-08-08 Thread aealexsandrov
Hi, The most obvious reason that you have some mistake in the file name. I checked the path with white space and ignite was successfully started. In case if you are sure that path to file is ok then could you please attach your full example and I will try to start it with spark local

Re: C++ client Exception occurred: Unexpected header during deserialization: 9

2018-08-14 Thread aealexsandrov
Hi, Looks like something wrong with you serialization scheme. In case if you are going to store some C++ object you should implement the READ and WRITE methods like here: https://apacheignite-cpp.readme.io/docs/serialization#section-macros Could you please provide the cache configuration and

Re: how ignite c++ node set baselinetopology

2018-08-14 Thread aealexsandrov
Hi, C++ API doesn't contain the methods to update the baseline. So, in this case, you can use Java API for it: Add the code that will listen to the EVT_NODE_JOINED event private final IgniteEx ignite; ignite.events().localListen(event -> { DiscoveryEvent e = (DiscoveryEvent)event;

Re: Ignite with POJO persistency in SQLServer

2018-08-07 Thread aealexsandrov
I am not fully sure but according to the specification of java.sql.Types you can try to use next for Java objects: https://docs.oracle.com/javase/7/docs/api/java/sql/Types.html#JAVA_OBJECT https://docs.oracle.com/javase/7/docs/api/java/sql/Types.html#OTHER

Re: Ignite with POJO persistency in SQLServer

2018-08-07 Thread aealexsandrov
>From web console sources I see next mapping: {"dbName": "BIT", "dbType": -7, "signed": {"javaType": "Boolean", "primitiveType": "boolean"}}, {"dbName": "TINYINT", "dbType": -6, "signed": {"javaType": "Byte", "primitiveType": "byte"}, "unsigned": {"javaType": "Short",

Re: big wal/archive file,but node file is small

2018-08-07 Thread aealexsandrov
Hi, First of all read about the WAL: https://apacheignite.readme.io/docs/write-ahead-log https://cwiki.apache.org/confluence/display/IGNITE/Ignite+Persistent+Store+-+under+the+hood#IgnitePersistentStore-underthehood-WALHistorySize WAL Work maximum used size: walSegmentSize * walSegments = 640Mb

Re: Ignite with POJO persistency in SQLServer

2018-08-07 Thread aealexsandrov
Hi, You have pogo class - your.package.EquityClass wuth next fields: Long equityID; private ListingCode firstCode; private String equityName; private String equityType; private String equityClass; private Set listings; and you are going to store in into ignite. In

Re: Ignite with POJO persistency in SQLServer

2018-08-08 Thread aealexsandrov
Yes. In case if you don't want to store it as objects then you can move this fields to original object: class a{ Int a; class b; } class b{ int b; int c; } You can change it as next: class a{ int a, int b; int c; } -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Apache Ignite SQL- read Only User Creation

2018-08-21 Thread aealexsandrov
Hi, I believe that you said about https://apacheignite.readme.io/docs/advanced-security It will provide the possibility to create/drop/alter the users. Also, it provides the only simple authentification with the password. You can't set the rules like read-only using it. Also, you can try to

Re: Recommended HW on AWS EC2 - vertical vs horizontal scaling

2018-08-24 Thread aealexsandrov
Hi, Ignite doesn't have such kind of benchmarks because they are very specific for every case and setup. However, exists several common tips: 1)In case if you will use EBS then try to avoid the NVMe. It is fast but looks like doesn't provide the guarantees for saving your data. We face the

Re: Apache Ignite SQL- read Only User Creation

2018-08-22 Thread aealexsandrov
Hi, Yes, when you are using ignite advance security (not GridSecurityProcessor interface) then you are able only to manage the password. https://apacheignite.readme.io/docs/advanced-security provides the simple password authentification security. You can only: 1)Create the user -

Re: Runtime failure on bounds

2018-08-22 Thread aealexsandrov
Hi, Sorry, I missed this conversation. To understand your problem you should provide the reproducer, cache configuration or steps how we can reproduce it or file the issue with all this information. At the moment it's not cleared how to solve it. BR, Andrei -- Sent from:

Re: Runtime failure on bounds

2018-07-18 Thread aealexsandrov
Hi, I am out of context what you do in your code. However, I know that several page corruption issues were fixed in 2.6 release. So there is no specific suggestion from my side. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Runtime failure on bounds

2018-07-18 Thread aealexsandrov
Hi, In case if you see (page content is corrupted) and after that upgrade your version to 2.6 then it's possible that your persistence is still broken. The most simple way here is cleaning your PDS (work/db) directory before the upgrading to 2.6. In case if data is important then you also can

Re: Logging in C++

2018-07-18 Thread aealexsandrov
Hi, What did you mean when saying "remote logging"? In case if you asking how you can configure the standard Apache Ignite logging: Ignite java node will store its own log into a log file that will be located in work dir. C++ ignite node will be started as a wrapper for java node. When you

Re: what version of spark is supported by ignite 2.5

2018-07-18 Thread aealexsandrov
Hi, To check the spark version you can take a look at ignite-spark_2.10 dependency. For org.apache.ignite ignite-spark 2.4.0 you can see: org.apache.spark spark-core_2.10 2.2.0 compile For org.apache.ignite ignite-spark 2.5.0

Re: what version of spark is supported by ignite 2.5

2018-07-18 Thread aealexsandrov
Sorry, I have a typo. ignite contains "spark-core_2.11" inside . Not spark-core_2.10. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Running Server Node in UNIX

2018-07-16 Thread aealexsandrov
Hi, Did you add to IGNITE_HOME to the path? https://apacheignite.readme.io/docs/getting-started#section-with-default-configuration In case if you are going to create maven project then you still need to download the binaries and set the IGNITE_HOME: https://ignite.apache.org/download.cgi BR,

Re: what version of spark is supported by ignite 2.5

2018-07-18 Thread aealexsandrov
So you said that if I will try to start provided example I will see the same error? I mean that I can try to investigate the problem in case if I will be able to reproduce the same behavior. Let me some time to take a look at this example. -- Sent from:

Re: what version of spark is supported by ignite 2.5

2018-07-18 Thread aealexsandrov
Hi, First of all, you shouldn't use spark 2.1. With Ignite because you could have conflicts of spark versions. >From your log when you used ignite spark (that used spark 2.2) I see that you have the problem with spring configuration: class org.apache.ignite.IgniteException: Spring application

Re: AWS Cluster

2018-09-10 Thread aealexsandrov
Hello, In case if your nodes don't see each other then try to check next: 1)That your IP finder configuration for every node contains the IP addresses of every AWS node from the cluster like next:

Re: Authentication for Apache Ignite 2.5

2018-07-10 Thread aealexsandrov
Hi, 1)According to advanced security that provided by default: https://apacheignite.readme.io/docs/advanced-security It will provide the possibility to create/drop/alter the users. Also, it provides the only simple authentification with the password. Note that it required the persistence and .

Re: Ignite with hive as 3rdparty persistence

2018-04-06 Thread aealexsandrov
Hi, You can describe your own cacheConfiguration as follow: ... ... %HIVE_JDBC_DRIVER% you can find here:

Re: How suppress Ignite log message

2018-04-05 Thread aealexsandrov
Hello, You can try to use next options: -DIGNITE_NO_ASCII=true -DIGNITE_QUIET=false 1) IGNITE_NO_ASCII will turn off the Ignite ascii message: if (System.getProperty(IGNITE_NO_ASCII) == null) { String ver = "ver. " + ACK_VER_STR; // Big thanks to:

Re: Remote node ID is not as expected - New Node not coming up

2018-04-04 Thread aealexsandrov
Hi, You can configure TcpCommunicationSpi: TcpCommunicationSpi communicationSpi = new TcpCommunicationSpi(); communicationSpi.setLocalAddress(localAddress); communicationSpi.setLocalPort(cc.getCommunicationLocalPort());

Re: Customized affinity function

2018-04-11 Thread aealexsandrov
Hi Prasad, Affinity function does not directly map keys to nodes, it maps keys to partitions. So it takes care about entities balance between nodes. To read more please take a look here: https://apacheignite.readme.io/docs/affinity-collocation#affinity-function In case if for every subscriber

Re: Problem of datastorage after compute finished

2018-04-13 Thread aealexsandrov
Hi Michael, As I see from your configuration you are going to have cluster with two ignite servers and PARTITIONED cache. You can't choose directly on what node will be stored your cache entities because ignite will use its own affinity function that will maps keys to partitions (not nodes). In

Re: Inconsistency reading cache from code and via REST?

2018-04-18 Thread aealexsandrov
Hi Michail, Could you please provide next information: 1)Ignite version 2)your ignite xml config 3)your reproducer (GridCacheTest). Looks like it wasn't attached. Also if you are using Ignite 2.4 then do you add your servers to baseline topology using control.sh before cluster activation?

Re: Apache ignite support for multi-tenancy

2018-04-18 Thread aealexsandrov
Hi, You can create several separated caches per tenant with the same configuration. What is your use case? Thanks, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: How to start Ignite with a jar built from the source code

2018-04-18 Thread aealexsandrov
Hi, You can find ignite.bat and ignite.sh scripts in source bundle bin folder. It is the best way to start Ignite with custom configuration. It described here: https://apacheignite.readme.io/docs/getting-started#section-passing-configuration-file Also you can take a look inside these scripts

Re: Effective Data through DataStream

2018-04-20 Thread aealexsandrov
Hi, Could you please provide your code example, configuration and used Ignite version? Thank you, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: how to use bigbench test ignite performance

2018-04-16 Thread aealexsandrov
Hi, As I know Ignite provides its own benchmarks that used Yardstick framework. Documentation: https://apacheignite.readme.io/docs/perfomance-benchmarking yardstick: https://github.com/gridgain/yardstick In Ignite sources exists IgniteAbstractBenchmark class that could be used for creation

Re: Running Ignite as Windows service

2018-04-19 Thread aealexsandrov
Hi, Maybe next small guide for ignite 2.4 could help you (possible some steps could be out of date): 1)Download and unpack Ignite to IGNITE_HOME 2)Download Java Service Wrapper for your OS from http://wrapper.tanukisoftware.org (I used wrapper-delta-pack-3.5.34.zip) 3)Unpack it to

Re: How to start Ignite with a jar built from the source code

2018-04-20 Thread aealexsandrov
Hi, In source code we have DEVNOTES.txt that contains the information how to build ignite. I believe that next steps could help you: 1)git clone https://git-wip-us.apache.org/repos/asf/ignite.git 2)Update your source code. 3)Build ignite as described from DEVNOTES.txt: 1.Compile and install:

Re: Inconsistency reading cache from code and via REST?

2018-04-19 Thread aealexsandrov
Hi Michael, I reproduced your problem. It's a known issue. Please take a look at this responce to find the workaround: http://apache-ignite-users.70518.x6.nabble.com/How-to-use-rest-api-to-put-an-object-into-cache-td5897.html#a5955 Looks like this problem will be solved for basic types at next

Re: connection pool in ignite

2018-04-20 Thread aealexsandrov
Hi, From: https://ignite.apache.org/releases/latest/javadoc/org/apache/ignite/spi/communication/tcp/TcpCommunicationSpi.html This SPI caches connections to remote nodes so it does not have to reconnect every time a message is sent. By default, idle connections are kept active for

Re: Inconsistency reading cache from code and via REST?

2018-04-23 Thread aealexsandrov
Hi Michael, You are trying to work with sql queries. Let me provide to you the example how you can do it: 1) Start ingnite server node 2) Start ignite client node that will create the cache and put some values: StartNode.java

Re: Inconsistency reading cache from code and via REST?

2018-04-23 Thread aealexsandrov
Also I will check why it's not working in next case: CacheConfiguration cfg = new CacheConfiguration<>(); cfg.setIndexedTypes(String.class, String.class); cfg.setName(CACHE_NAME); IgniteCache cache =

Re: Redis KEYS command?

2018-03-28 Thread aealexsandrov
Hi Jose, All availavle information about ingine/redis compatibility you can see here: https://apacheignite.readme.io/docs/redis If you are going tobe informed about the last information about future integrations then you can read articleы from еру official site:

Re: Re:Re: Re:Issue about ignite-sql limit of table quantity

2018-03-26 Thread aealexsandrov
Hi Fvyaba, I investigated your example. In your code you are going to create new cache every time when you are going to create new table. Every new cache will have some memory overhead. Next code can help you to get the average allocated memory: try (IgniteCache cache =

Re: Re:Re: Re:Issue about ignite-sql limit of table quantity

2018-03-26 Thread aealexsandrov
Hi Fvyaba, I investigated your example. In your code you are going to create new cache every time when you are going to create new table. Every new cache will have some memory overhead. Next code can help you to get the average allocated memory: try (IgniteCache cache =

Re: Service Grid launching Compute Tasks

2018-03-22 Thread aealexsandrov
Hi Neeraj, Generally you can launch compute tasks from execute method because they will use separated thread pools executors. Also according documentation you can be in execute method until cancel method will not called:

Re: Re:Issue about ignite-sql limit of table quantity

2018-03-23 Thread aealexsandrov
Hi Fvyaba, There is no information about it in documentation but according several places in the code I see that it isn't greater than int32. void ReadTableMetaVector(ignite::impl::binary::BinaryReaderImpl& reader, TableMetaVector& meta) { int32_t metaNum

Re: Problems with unlocking multiply held cache locks.

2018-06-28 Thread aealexsandrov
Hi, As I remember we already discussed here with Jon: http://apache-ignite-users.70518.x6.nabble.com/If-a-lock-is-held-by-another-node-IgniteCache-isLocalLocked-appears-to-return-incorrect-results-td22110.html#a22149 that isLocalLocked method works incorrectly in case if several nodes started

Re: Recommended HW on AWS EC2 - vertical vs horizontal scaling

2018-09-19 Thread aealexsandrov
Hi, Left the list with some useful articles links here http://apache-ignite-users.70518.x6.nabble.com/Slow-SQL-query-uses-only-a-single-CPU-td23553.html BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Slow SQL query uses only a single CPU

2018-09-19 Thread aealexsandrov
Hi, I think you can try to investigate the articles from the next wiki: https://cwiki.apache.org/confluence/display/IGNITE/Design+Documents Next blog contains the interesting information (possible some will be out of date): http://gridgain.blogspot.com It contains a lot of information about

Re: Is there a way to use Ignite optimization and Spark optimization together when using Spark Dataframe API?

2018-09-19 Thread aealexsandrov
Hi, I am not sure that it will work but you can try next: SparkSession spark = SparkSession .builder() .appName("SomeAppName") .master("spark://10.0.75.1:7077") .config(OPTION_DISABLE_SPARK_SQL_OPTIMIZATION, "false") //or true

Re: IgniteSparkSession exception:Ignite instance with provided name doesn't exist. Did you call Ignition.start(..) to start an Ignite instance? [name=null]

2018-09-20 Thread aealexsandrov
Hi, Can you provide the code and configuration? Next one works okay for me: //start the server Ignite ignite = Ignition.start("server_config.xml"); //activate the cluster ignite.cluster().active(); //create the spark session with daemon client node

Re: ignite - what ports should be open on a linux machine

2018-09-17 Thread aealexsandrov
Hi, In default configuration Ignite will use next ports: Major: TCP 47500 - 47600 discovery TCP 47100 - 47200 communication Optional: TCP 11211 connect by internal http protocol TCP 49128 jmx connection TCP 48100 - 48200 if using shared memory TCP 10800 - 10900 connection ports (odbc/jdbc)

Re: Ignite TcpDiscoveryS3IpFinder and AWS VPC

2018-10-11 Thread aealexsandrov
Hi, According '127.0.0.1#47500', '0:0:0:0:0:0:0:1/0#47500': It's just the different views of the same address (localhost). For example, Ignite started on 10.0.75.1 could be available using next addresses from the same node: >>> Local node addresses: [LAPTOP-I5CE4BEI/0:0:0:0:0:0:0:1, >>>

Re: client probe cache metadata

2018-10-11 Thread aealexsandrov
Hi, You can get all caches configuration from Java API: IgniteCache cache = dr1Hub.getOrCreateCache("CACHE"); CacheConfiguration conf = cache.getConfiguration(CacheConfiguration.class); System.out.println("");

Re: How to use BinaryObject Cache API to query a table created from JDBC?

2018-10-12 Thread aealexsandrov
Hi, Try the next example and follow the same way for your: // Open the JDBC connection. try { Connection conn = DriverManager.getConnection("jdbc:ignite:thin://127.0.0.1;user=user;password=password"); //remove user password if you don't have security

Re: Ignite complains for low heap memory

2018-10-17 Thread aealexsandrov
Hi, The heap metrics that you see in topology message shows the max heap value that your cluster can use: Math.max(m.getHeapMemoryInitialized(), m.getHeapMemoryMaximum() Initial heap size (-Xms ) is different from the maximum (-Xmx). Your JVM will be started with Xms amount of memory and will

Re: Failed to process selector key error

2018-10-17 Thread aealexsandrov
Hi, Your client was disconnected from the server. It could be because of different reasons: 1. Network problems on your client. 2. Very long GC pause on the server side. I guess that you face first because you note that possible you had the network problems. In this case, the server will not

Re: Ignite Select Query Performance

2018-10-17 Thread aealexsandrov
Hi, We can try to check can your configuration be improved but first of all could you please provide some details: 1)How many data nodes you used. 2)Data node configuration 3)Cache configuration or DML Create Table command for your cache (table) BR, Andrei -- Sent from:

Re: SQL Engine

2018-10-17 Thread aealexsandrov
Hi Igor, I think that optimizationd for Ignite better to discuss it on the Apache Ignite Developer list: http://apache-ignite-developers.2346864.n4.nabble.com/ BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/