[Web Console] Does Ignite Web Console Docker Image contains monitoring page

2019-02-20 Thread edvance CN
Hi Support, In console.gridgain.com, there is a monitoring page showing the many metrics for the cluster. But I deploy the Web Console Docker Image (standalone) and it does not show the monitoring page. Please advise how to enable the monitoring page. Thank you. James Wang / edvance Mobile/W

WAL - Fsync time average time is too higher

2019-02-20 Thread edvance CN
Hi Support, I monitor the system through console.gridgain.com and find WAL - Fsync time average time is too higher Please advise how to performance tuning on it a little. 378CD2DB is a VM based on normal disk. CF060CAB is a VM based on SSD D5F58399 is a VM based on the same SSD as CF060CAB.

Re: Cpu usage cannot be improved

2019-02-20 Thread gn01887818
Please look at the jstackInfo.txt file. Inside is the information when ignite db is executed. Thank you jstackInfo.txt -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

C++ computer delay

2019-02-20 Thread F.D.
Hi igniters, I've a problem when I launch a sequence of about 350 compute funcions in my cluster of 10 node. I register a delay in the first launcher od about 10 sec. after that, it works smoothly. If I launch the same numbers of task on a single node, there 's no delay. It seems like a problem in

Re: Distributed Training in tensorflow

2019-02-20 Thread dmitrievanthony
Hi, Ignite ML natively has a multilayer perceptron (see https://apacheignite.readme.io/docs/multilayer-perceptron), so you can use it to build a simple neural network. But, if we are talking about deep learning the answer will "no", Ignite ML provides it only via integration with TensorFlow. -

Re: How to define customized NodeID8

2019-02-20 Thread Ilya Kasnacheev
Hello! This is not cluster name, it is instance name, I can see how it could be displayed in place of NodeID8 but not as cluster name. There's *IGNITE_CLUSTER_NAME* system property to set cluster name, but I'm not sure if it is supported by Web Console. Regards, -- Ilya Kasnacheev ср, 20 февр

RE: How to define customized NodeID8

2019-02-20 Thread edvance CN
Hi Ilya, I define cluster name in Spring XML like following: for ignite configuration Best Regards, James Wang M/WeChat: +86 135 1215 1134 From: Ilya Kasnacheev mailto:ilya.kasnach...@gmail.com>> Sent: Wednesday, February 20, 2019 12:29 AM To: user@ignite.apache.org

Re: Apache Ignite starts fast and then become really slow with out of memory

2019-02-20 Thread Ilya Kasnacheev
Hello! For compute jobs, I believe it's public pool. For cache operations, I imagine it's striped pool. Regards, -- Ilya Kasnacheev ср, 20 февр. 2019 г. в 13:34, : > Hey, > > > > Which thread pools are responsible for the compute jobs and cache > operations ? > > > > Thanks, > > > > Nadav > >

Re: Cpu usage cannot be improved

2019-02-20 Thread Ilya Kasnacheev
Hello again! Please note that you should do that in the middle of load test (not before or after). Regards, -- Ilya Kasnacheev ср, 20 февр. 2019 г. в 15:32, Ilya Kasnacheev : > Hello! > > You can use jstack utility. > > Regards, > -- > Ilya Kasnacheev > > > ср, 20 февр. 2019 г. в 13:55, gn018

Re: Cpu usage cannot be improved

2019-02-20 Thread Ilya Kasnacheev
Hello! You can use jstack utility. Regards, -- Ilya Kasnacheev ср, 20 февр. 2019 г. в 13:55, gn01887818 : > How to dump, is there a file reference? Thank you > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/ >

Re: External multiple config files for Docker installation

2019-02-20 Thread Stephen Darlington
A lower-lift method might be to put your config files in the local file system and create a volume to make it accessible from your container. Something like: docker run —rm -it -v /home/me/config:/opt/ignite/config -e CONFIG_URI=file:///opt/ignite/config/local.xml apacheignite/ignite:2.7.0 R

Re: Data streamer has been closed.

2019-02-20 Thread Taras Ledkov
Hi, Workaround: use ordered streaming: SET STREAMING ON ORDERED There is a bug at the Ignite server on not ordered mode. The fix will be at the master soon. 20.01.2019 14:11, ilya.kasnacheev пишет: Hello! I have filed an issue https://issues.apache.org/jira/browse/IGNITE-10991 Regards, --

Re: Ignoring model fields

2019-02-20 Thread Stanislav Lukyanov
Regular Java `transient` keyword should suffice. Add it to all fields that shouldn't be serialized. Alan Ward wrote > Is there a way (preferably annotation-based) to exclude certain fields in > user-defined model classes from Ignite (cache, query, etc.), similar to > how > Jackson has a @JsonIgno

Re: External multiple config files for Docker installation

2019-02-20 Thread Stanislav Lukyanov
Ignite's Docker image doesn't have a parameter for that. You can create your own Dockerfile extending Ignite's image and define and handle a new parameter there. Stan kyro wrote > Hi akurbanov, > > Yes, I have the lines as you mentioned in my config. I was asking as to > how > do I pass the two

Re: Index inline size

2019-02-20 Thread Stanislav Lukyanov
Depends on the use case. Sometimes you want to save the memory as much as possible, and then you would use a lower inline size. However, in most cases you actually need a higher value because that will greatly improve the performance. Starting 2.7 there are warnings with a recommended size (calcul

Re: Cpu usage cannot be improved

2019-02-20 Thread gn01887818
How to dump, is there a file reference? Thank you -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/

RE: Apache Ignite starts fast and then become really slow with out of memory

2019-02-20 Thread nadav.hoze
Hey, Which thread pools are responsible for the compute jobs and cache operations ? Thanks, Nadav From: Ilya Kasnacheev Sent: Wednesday, February 20, 2019 12:26 PM To: user@ignite.apache.org Subject: Re: Apache Ignite starts fast and then become really slow with out of memory

Re: Apache Ignite starts fast and then become really slow with out of memory

2019-02-20 Thread Ilya Kasnacheev
Hello! Maybe you could do that by decreasing thread pool sizes as well as limiting message queue lengths. However, it might not be worth the hassle. Regards, -- Ilya Kasnacheev вт, 19 февр. 2019 г. в 21:26, : > Hey Ilya, > > > > I managed to stable the memory and avoid extreme slowness by sen

Re: Segfault in GridCacheEvictionManager.touch()

2019-02-20 Thread Ilya Kasnacheev
Hello! It's hard to say, I don't see any relevant issues filed and this method does not even do any unsafe access. Will be good to hear more from you about this issue. Regards, -- Ilya Kasnacheev пн, 18 февр. 2019 г. в 22:48, breischl : > I've been having problems recently with nodes crashin

Re: Ignite Node crashed in middle of checkpoint and data loss

2019-02-20 Thread Ilya Kasnacheev
Hello! Can you share your data files (WAL and db) so that we could try and reproduce the crash? If it is not feasible my recommendation is to try bring this data up when starting with Nightly Build instead of 2.7: https://ignite.apache.org/download.cgi#nightly-builds Regards, -- Ilya Kasnacheev

Re: Cpu usage cannot be improved

2019-02-20 Thread Ilya Kasnacheev
Hello! Please post thread dumps from all nodes then! Regards, -- Ilya Kasnacheev ср, 20 февр. 2019 г. в 11:35, gn01887818 : > 1. Have tried stream mode > streamingFlushFrequency=500 > streamingPerNodeBufferSize=512 > > 2. Have tried System Pool, Queries Pool part, > The default is 24 (machine

Re: Populating tables via IgniteDataStreamer

2019-02-20 Thread Ilya Kasnacheev
Hello! I don't think there is this particular example but you can frankenstain it from existing ones. If you have any troubles then you can share your project for us to see. Otherwise you can indeed use SET STREAMING and avoid trouble. There is extra time and space considerations when using seco

Re: Cpu usage cannot be improved

2019-02-20 Thread gn01887818
1. Have tried stream mode streamingFlushFrequency=500 streamingPerNodeBufferSize=512 2. Have tried System Pool, Queries Pool part, The default is 24 (machine cpu core number), raised to 80 Still no way to improve the use of cpu. -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/