Re: Recommended HW on AWS EC2 - vertical vs horizontal scaling

Hi, Left the list with some useful articles links here http://apache-ignite-users.70518.x6.nabble.com/Slow-SQL-query-uses-only-a-single-CPU-td23553.html BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Slow SQL query uses only a single CPU

Hi, I think you can try to investigate the articles from the next wiki: https://cwiki.apache.org/confluence/display/IGNITE/Design+Documents Next blog contains the interesting information (possible some will be out of date): http://gridgain.blogspot.com It contains a lot of information about

Re: AWS Cluster

Hello, In case if your nodes don't see each other then try to check next: 1)That your IP finder configuration for every node contains the IP addresses of every AWS node from the cluster like next:

Re: Recommended HW on AWS EC2 - vertical vs horizontal scaling

Hi, Ignite doesn't have such kind of benchmarks because they are very specific for every case and setup. However, exists several common tips: 1)In case if you will use EBS then try to avoid the NVMe. It is fast but looks like doesn't provide the guarantees for saving your data. We face the

Re: Runtime failure on bounds

Hi, Sorry, I missed this conversation. To understand your problem you should provide the reproducer, cache configuration or steps how we can reproduce it or file the issue with all this information. At the moment it's not cleared how to solve it. BR, Andrei -- Sent from:

Re: Apache Ignite SQL- read Only User Creation

Hi, Yes, when you are using ignite advance security (not GridSecurityProcessor interface) then you are able only to manage the password. https://apacheignite.readme.io/docs/advanced-security provides the simple password authentification security. You can only: 1)Create the user -

Re: Apache Ignite SQL- read Only User Creation

Hi, I believe that you said about https://apacheignite.readme.io/docs/advanced-security It will provide the possibility to create/drop/alter the users. Also, it provides the only simple authentification with the password. You can't set the rules like read-only using it. Also, you can try to

Re: how ignite c++ node set baselinetopology

Hi, C++ API doesn't contain the methods to update the baseline. So, in this case, you can use Java API for it: Add the code that will listen to the EVT_NODE_JOINED event private final IgniteEx ignite; ignite.events().localListen(event -> { DiscoveryEvent e = (DiscoveryEvent)event;

Re: C++ client Exception occurred: Unexpected header during deserialization: 9

Hi, Looks like something wrong with you serialization scheme. In case if you are going to store some C++ object you should implement the READ and WRITE methods like here: https://apacheignite-cpp.readme.io/docs/serialization#section-macros Could you please provide the cache configuration and

Re: Ignite with POJO persistency in SQLServer

Yes. In case if you don't want to store it as objects then you can move this fields to original object: class a{ Int a; class b; } class b{ int b; int c; } You can change it as next: class a{ int a, int b; int c; } -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite with POJO persistency in SQLServer

>From web console sources I see next mapping: {"dbName": "BIT", "dbType": -7, "signed": {"javaType": "Boolean", "primitiveType": "boolean"}}, {"dbName": "TINYINT", "dbType": -6, "signed": {"javaType": "Byte", "primitiveType": "byte"}, "unsigned": {"javaType": "Short",

Re: Ignite with POJO persistency in SQLServer

I am not fully sure but according to the specification of java.sql.Types you can try to use next for Java objects: https://docs.oracle.com/javase/7/docs/api/java/sql/Types.html#JAVA_OBJECT https://docs.oracle.com/javase/7/docs/api/java/sql/Types.html#OTHER

Re: Ignite with POJO persistency in SQLServer

Hi, You have pogo class - your.package.EquityClass wuth next fields: Long equityID; private ListingCode firstCode; private String equityName; private String equityType; private String equityClass; private Set listings; and you are going to store in into ignite. In

Re: big wal/archive file,but node file is small

Hi, First of all read about the WAL: https://apacheignite.readme.io/docs/write-ahead-log https://cwiki.apache.org/confluence/display/IGNITE/Ignite+Persistent+Store+-+under+the+hood#IgnitePersistentStore-underthehood-WALHistorySize WAL Work maximum used size: walSegmentSize * walSegments = 640Mb

Re: The problem after the ignite upgrade

Hi, Could you please provide step by step instruction on how you upgrade the cluster? Please note that in case if you try to use the persistence then the important feature that was added in 8.4 - baseline topology. A baseline topology is a set of Ignite server nodes intended to store data. The

Re: Using SQL users to open jdbc connections

Hi, Could you please show the command how you create new users? When you create the user in quotes ("test") using SQL as next: CREATE USER "test" WITH PASSWORD 'test' It will be created as it was set (in this case it will be test) If you create the user without quotes (test) using SQL as

Re: Runtime failure on bounds

Hi, I am out of context what you do in your code. However, I know that several page corruption issues were fixed in 2.6 release. So there is no specific suggestion from my side. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: what version of spark is supported by ignite 2.5

So you said that if I will try to start provided example I will see the same error? I mean that I can try to investigate the problem in case if I will be able to reproduce the same behavior. Let me some time to take a look at this example. -- Sent from:

Re: what version of spark is supported by ignite 2.5

Hi, First of all, you shouldn't use spark 2.1. With Ignite because you could have conflicts of spark versions. >From your log when you used ignite spark (that used spark 2.2) I see that you have the problem with spring configuration: class org.apache.ignite.IgniteException: Spring application

Re: Runtime failure on bounds

Hi, In case if you see (page content is corrupted) and after that upgrade your version to 2.6 then it's possible that your persistence is still broken. The most simple way here is cleaning your PDS (work/db) directory before the upgrading to 2.6. In case if data is important then you also can

Re: what version of spark is supported by ignite 2.5

Sorry, I have a typo. ignite contains "spark-core_2.11" inside . Not spark-core_2.10. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Logging in C++

Hi, What did you mean when saying "remote logging"? In case if you asking how you can configure the standard Apache Ignite logging: Ignite java node will store its own log into a log file that will be located in work dir. C++ ignite node will be started as a wrapper for java node. When you

Re: Running Server Node in UNIX

Hi, Did you add to IGNITE_HOME to the path? https://apacheignite.readme.io/docs/getting-started#section-with-default-configuration In case if you are going to create maven project then you still need to download the binaries and set the IGNITE_HOME: https://ignite.apache.org/download.cgi BR,

Re: Authentication for Apache Ignite 2.5

Hi, 1)According to advanced security that provided by default: https://apacheignite.readme.io/docs/advanced-security It will provide the possibility to create/drop/alter the users. Also, it provides the only simple authentification with the password. Note that it required the persistence and .

Re: Problems with unlocking multiply held cache locks.

Hi, As I remember we already discussed here with Jon: http://apache-ignite-users.70518.x6.nabble.com/If-a-lock-is-held-by-another-node-IgniteCache-isLocalLocked-appears-to-return-incorrect-results-td22110.html#a22149 that isLocalLocked method works incorrectly in case if several nodes started

Re: Apache Ignite Rest API JOIN with multiple Caches

Hi, Try to use qryfldexe: For example, I create next caches: ss1.java It creates two caches with the same structure. Now I am going to execute next command: SELECT * FROM "mycache1".Value V1 join "mycache2".Value V2 on

Re: ClassCastException in Hibernate QueryCache

Hi, I think that the problem is that next code doesn't work in java: public static class SerializableObject implements Serializable {} and Object[] array = new Object[1]; array[0] = new SerializableObject(); Serializable[] serializableArr = (Serializable[])

Re: Question on Ignite and Spark Structured Streaming Integration.

Hi, As I know there is no any special sink function for streaming to Ignite. Also, I don't see "jdbc" format in official documentation of spark (only file, kafka, console, memory and foreach): https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html#output-sinks However,

Re: Distributed Closures Apply method/c#

Very strange. By default, there is no any timeout. I will take a look more carefully. Also is it possible that you cancel the closure somehow? -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Running Node removal from baseline

Hi, Now in case of the node was left the BLT cluster will wait for it. In case if it can't return for a long time user should manually remove it from BTL and it will do rebalance like in this example:

Re: ClassCastException in Hibernate QueryCache

Hi, Could you please provide some more details: cache configuration, an example of code that was failed and logs? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Distributed Closures Apply method/c#

Hi, Could you please provide the exception? As I see from the code if you didn't set some timeout manual using writeTimeout method then Long.MAX_VALUE should be used. Long timeout = (Long)map.get(TC_TIMEOUT); long timeout0 = timeout == null || timeout == 0 ? Long.MAX_VALUE :

Re: running Apache Ignite in docker with cgroups

Hi, Could you please provide your configuration files? How many nodes did you start in your container? BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: setting baseline topology in kubernetes

Hi, No 11211 is a default ignite TCP port. For every new node, it will be incremented 11211, 11212, 11213, etc. Also please check that you didn't overwrite it. https://www.gridgain.com/sdk/pe/latest/javadoc/org/apache/ignite/spi/discovery/tcp/TcpDiscoverySpi.html#setLocalPort-int- And yes

Re: Is there any way to remove a node from cluster safely?

Hi, Unfortunately, in your environment, you can't stop the node without losing the data. To stop one node safety you require at least one backup. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: setting baseline topology in kubernetes

Hi, All existing options of control.sh tool you can see here: https://apacheignite.readme.io/docs/baseline-topology#section-cluster-activation-tool To connect to some host and port you can use --host --port options (default values 127.0.0.1 and 11211). In case if you started the ignite in

Re: Apache Ignite Rest API JOIN with multiple Caches

Hi, Question was answered in https://stackoverflow.com/questions/50950480/join-on-apache-ignite-rest-api/50950777#50950777. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: SQL Query full table scan, Node goes down

Hi, Please read the documentation more accurate. The lazy flag you should set on the SqlFieldsQuery object. It could be set on that node where you are going to use it. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: IgniteCheckedException: Error while creating file page store caused by NullPointerException

As a workaround, you can try to add execution rights (like in your example) to all files under work directory. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Using Persistent ignite queues

Hi, Could you please provide next for investigation: 1)Thread dump that you should create at the moment when cluster hung. 2)Code of your service 3)Logs of the cluster nodes. 4)The configuration of the clusters. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: IgniteCheckedException: Error while creating file page store caused by NullPointerException

Hi, Is this issue reproducible? Can you change the work directory path or clear your work directory and check again? Did you try to modify or copy anything from work directory? However, could you please provide the cluster configuration and code reproducer? BR, Andrei -- Sent from:

Re: If a lock is held by another node IgniteCache.isLocalLocked() appears to return incorrect results.

Hi, I filed next issue: https://issues.apache.org/jira/browse/IGNITE-8833 Thank you, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: [ANNOUNCE] Apache Ignite 2.5.0 Released

Hi szj, Could you please redirect your questions to the new thread? Also, don't forget to provide the steps for reproducing and logs. PS. I will check your case with ignitevisorcmd.sh and node restarting. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: If a lock is held by another node IgniteCache.isLocalLocked() appears to return incorrect results.

Hi, It looks like an issue. Let me investigate it and create an issue. BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite user create/modify trouble

https://issues.apache.org/jira/browse/IGNITE-8756 -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Ignite user create/modify trouble

Hi, Documentation should be updated as for me to describe how it designed in SQL. I will file the issue. When you use SQL and require to create the user like TesT then just use quotes. Without quotes, you will create TEST. In case if you are going to change the password for TesT user via SQL

Re: Ignite user create/modify trouble

Hi, When you create the user in quotes ("test") using SQL as next: CREATE USER "test" WITH PASSWORD 'test' It will be created as it was set (in this case it will be test) If you create the user without quotes (test) using SQL as next: CREATE USER test WITH PASSWORD 'test' then username will

Re: Clarification regarding nodeFilter

Hi, I checked next code: Ignite ignite = IgnitionEx.start("examples/config/example-ignite.xml", "ignite-1"); Ignite ignite2 = IgnitionEx.start("examples/config/example-ignite.xml", "ignite-2"); ClusterGroup cg = ignite2.cluster().forPredicate(new IgnitePredicate() {

Re: Need clarification on redeploy behavior

Hi, There is no force deploying/undeploying possibility as I know. As was mentioned in another your question: http://apache-ignite-users.70518.x6.nabble.com/Clarification-regarding-nodeFilter-td21671.html Node filter predicate should be stateless and should always return the same value for the

Re: Clarification regarding nodeFilter

Hi, Please take a look at my answers below: 1)Yes. Node filter should be run only on coordinator node after reassignment process. It could be executed several times and possible that Ignite instance can be uninjected. All this behavior should be documented as well as for me. 2) Node filter

Re: Clarification regarding nodeFilter

Hi, Indeed there is some unexpected behavior of the how it documented and how it works. I filed next issues related to service/cache deploying with node filters: https://issues.apache.org/jira/browse/IGNITE-8629 - There is no documentation about what on which node Ignite Predicate will be

Re: Backup and Restore of Ignite Persistence

Hi, Yes Ignite store the data into files. For every cache entity could exist some primiry node and optionally several backups node. It could be configured in CacheConfiguration. Read about it you can here: https://apacheignite.readme.io/v1.1/docs/primary-and-backup-copies For example you have

Re: What is the most efficient way to scan all data partitions?

Hi, It's normal that writing to disk is causing the degradation. You can do several optimizations to speed up writting to disk: https://apacheignite.readme.io/docs/durable-memory-tuning https://apacheignite.readme.io/docs/performance-tips However you can try to test your example with next

Re: Inconsistency reading cache from code and via REST?

Hi, qryexe doesn't work correct. At some reason it ignores _key and _value in 2.4. You can use qryfldexe as it was describe here: http://apache-ignite-users.70518.x6.nabble.com/Example-of-SQL-query-td21427.html BR, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: Example of SQL query

Hi again, We already discussed about it recently. At the moment some things works incorrect in 2.4: 1)Rest API only support String as key and value. And looks like you can't use affinity key on strings for the same issue. But if you can setup it using AffinityKeyMapper anotation: public

Re: BinaryObjectBuilder - setField - Boolean Type - Problem

Hi Jonathan, I tested your example with last changes from ignite apache repository. Everything looks ok. My steps: 1)Start server node 2)Connect to server node using sqlline tool: sqlline.bat --color=true --verbose=true -u jdbc:ignite:thin://127.0.0.1:10800 3)Create new table: 0:

Re: What does "Non heap" mean in the log?

Hi, It's non-heap memory that can be used for JVM memory management. You can read about this here: https://docs.oracle.com/javase/7/docs/api/java/lang/management/MemoryUsage.html

Re: Inconsistency reading cache from code and via REST?

Also I will check why it's not working in next case: CacheConfiguration cfg = new CacheConfiguration<>(); cfg.setIndexedTypes(String.class, String.class); cfg.setName(CACHE_NAME); IgniteCache cache =

Re: Inconsistency reading cache from code and via REST?

Hi Michael, You are trying to work with sql queries. Let me provide to you the example how you can do it: 1) Start ingnite server node 2) Start ignite client node that will create the cache and put some values: StartNode.java

Re: Effective Data through DataStream

Hi, Could you please provide your code example, configuration and used Ignite version? Thank you, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: How to start Ignite with a jar built from the source code

Hi, In source code we have DEVNOTES.txt that contains the information how to build ignite. I believe that next steps could help you: 1)git clone https://git-wip-us.apache.org/repos/asf/ignite.git 2)Update your source code. 3)Build ignite as described from DEVNOTES.txt: 1.Compile and install:

Re: Inconsistency reading cache from code and via REST?

Hi Michael, I reproduced your problem. It's a known issue. Please take a look at this responce to find the workaround: http://apache-ignite-users.70518.x6.nabble.com/How-to-use-rest-api-to-put-an-object-into-cache-td5897.html#a5955 Looks like this problem will be solved for basic types at next

Re: Inconsistency reading cache from code and via REST?

Hi Michail, Could you please provide next information: 1)Ignite version 2)your ignite xml config 3)your reproducer (GridCacheTest). Looks like it wasn't attached. Also if you are using Ignite 2.4 then do you add your servers to baseline topology using control.sh before cluster activation?

Re: Apache ignite support for multi-tenancy

Hi, You can create several separated caches per tenant with the same configuration. What is your use case? Thanks, Andrei -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Re: How to start Ignite with a jar built from the source code

Hi, You can find ignite.bat and ignite.sh scripts in source bundle bin folder. It is the best way to start Ignite with custom configuration. It described here: https://apacheignite.readme.io/docs/getting-started#section-passing-configuration-file Also you can take a look inside these scripts

Re: how to use bigbench test ignite performance

Hi, As I know Ignite provides its own benchmarks that used Yardstick framework. Documentation: https://apacheignite.readme.io/docs/perfomance-benchmarking yardstick: https://github.com/gridgain/yardstick In Ignite sources exists IgniteAbstractBenchmark class that could be used for creation

Re: Problem of datastorage after compute finished

Hi Michael, As I see from your configuration you are going to have cluster with two ignite servers and PARTITIONED cache. You can't choose directly on what node will be stored your cache entities because ignite will use its own affinity function that will maps keys to partitions (not nodes). In

Re: Customized affinity function

Hi Prasad, Affinity function does not directly map keys to nodes, it maps keys to partitions. So it takes care about entities balance between nodes. To read more please take a look here: https://apacheignite.readme.io/docs/affinity-collocation#affinity-function In case if for every subscriber

Re: Ignite with hive as 3rdparty persistence

Hi, You can describe your own cacheConfiguration as follow: ... ... %HIVE_JDBC_DRIVER% you can find here:

Re: How suppress Ignite log message

Hello, You can try to use next options: -DIGNITE_NO_ASCII=true -DIGNITE_QUIET=false 1) IGNITE_NO_ASCII will turn off the Ignite ascii message: if (System.getProperty(IGNITE_NO_ASCII) == null) { String ver = "ver. " + ACK_VER_STR; // Big thanks to:

Re: Remote node ID is not as expected - New Node not coming up

Hi, You can configure TcpCommunicationSpi: TcpCommunicationSpi communicationSpi = new TcpCommunicationSpi(); communicationSpi.setLocalAddress(localAddress); communicationSpi.setLocalPort(cc.getCommunicationLocalPort());

Re: Redis KEYS command?

Hi Jose, All availavle information about ingine/redis compatibility you can see here: https://apacheignite.readme.io/docs/redis If you are going tobe informed about the last information about future integrations then you can read articleы from еру official site:

Re: Re:Re: Re:Issue about ignite-sql limit of table quantity

Hi Fvyaba, I investigated your example. In your code you are going to create new cache every time when you are going to create new table. Every new cache will have some memory overhead. Next code can help you to get the average allocated memory: try (IgniteCache cache =

Re: Re:Re: Re:Issue about ignite-sql limit of table quantity

Hi Fvyaba, I investigated your example. In your code you are going to create new cache every time when you are going to create new table. Every new cache will have some memory overhead. Next code can help you to get the average allocated memory: try (IgniteCache cache =

Re: Service Grid launching Compute Tasks

Hi Neeraj, Generally you can launch compute tasks from execute method because they will use separated thread pools executors. Also according documentation you can be in execute method until cancel method will not called:

<    1   2