Re: Real-world use cases: Ignite and High-Performance Computing
Thanks for this valuable sharing. De : "Denis Magda" A : "user" ,"dev" Envoyé: jeudi 2 Décembre 2021 23:52 Objet : Real-world use cases: Ignite and High-Performance Computing Folks, I've just published an article that lists some real-world use cases of Ignite for high-performance computing. Some of you might be interested in how the compute APIs are leveraged in practice: https://www.gridgain.com/resources/blog/how-apache-ignite-empowers-high-performance-computing-real-use-cases That's a short summary of recordings from past conferences and meetup talks. Thanks to everyone who shared their stories! - Denis
Re: Golang thin client
yes I suggest this one because I have been using it. De : "Stephen Darlington" A : user@ignite.apache.org Envoyé: jeudi 2 Décembre 2021 17:48 Objet : Re: Golang thin client There is no “official” Go thin client but I found one that someone has written: https://github.com/amsokol/ignite-go-client > On 2 Dec 2021, at 09:37, Marco Watkin wrote: > > Do you have the official library for go thin client? I saw the website > doesn’t mention that. > > Thanks
Re: Async StreamMultipleTupleExtractor
How does ignite integrate with kafka? do you have a guide doc? thanks. On 2021/12/1 11:06, Maxim Volkomorov wrote: I want to Ignite KafkaStreamer commits kafka without waiting for execution of extract() method.
Re: Please help: several questions for Ignite
That clarity some questions for me too. thanks. De : "Pavel Tupitsyn" A : "user" Envoyé: mercredi 1 Décembre 2021 21:05 Objet : Re: Please help: several questions for Ignite Hi Jon, #1 Probably yes, K/V and SQL are among the most used features. Yes, Ignite can be used instead of Redis as a distributed cache in some use cases. The API is different though. #2 Those features are production-ready. Ignite is not based on Spark. #3 Compute API has map/reduce functionality: https://ignite.apache.org/docs/latest/distributed-computing/map-reduce Grouping and filtering can be achieved based on that. Alternatively, use the SQL engine which performs map/reduce under the hood. #4 I'd say the choice between SQL and K/V is about two things - convenience and performance. K/V API maps the data to your classes, and it is generally faster than SQL for individual key operations (get, put, replace). On the other hand, SQL with proper indexes is faster for complex queries. #5 Please check https://ignite.apache.org/docs/latest/extensions-and-integrations/ignite-for-spark/ignite-dataframe Pavel On Wed, Dec 1, 2021 at 1:48 PM Jon Hua wrote: Hi community Today I spent a whole day reading the docs: https://ignite.apache.org/docs/latest/ This is a well-written documentation for Ignite, thanks for the work. I have several questions that: #1, Is the most used feature of Ignite the distributed K/V storage? Can I treat it as the distributed Redis? #2, It says it supports streaming, distributed computing, ML Lib. Are they affected by Apache Spark? Are these three features production ready? #3, I saw that distributed computing has very few API methods. Will you expand them later? For example, map(), reduce(), group(), filter() etc. #4, The document says SQL and K/V are essentially the same stuff. So when to use SQL and when to use K/V interface? #5. Will you support dataframe in future? Yes, both Spark and R have the dataframe. The structure is quite easy to load outside data such as CSV, JSON etc. Thank you in advance for any help. Regards Jon Hua
Re: Code Deployment configuration error, start ignite.sh
what’s the app env? The OS, JDK version etc. De : "Hajime Kobashi" A : user@ignite.apache.org Envoyé: jeudi 2 Décembre 2021 03:18 Objet : Code Deployment configuration error, start ignite.sh Hi community. Where is the UriDeploymentSpi.class and source file ? I want something for start ignite, what is wrong. I have some issue, that the ClassNotFoundException occured spi.deployment.uri.UriDeploymentSpi class configuration to XML file with ignite.sh starting. I can not find UriDeploymentSpi class next 3 directory or jars. 1: git clone my local directory. ./ignite/modules/core/src/main/java/org/apache/ignite/spi/deployment 2: download source jar: apache-ignite-2.11.0-src.zip ./apache-ignite-2.11.0-src/modules/core/src/main/java/org/apache/ignite/spi/deployment 3: ignite.sh execution environment jar in libs: ignite-core-2.11.0.jar ./org/apache/ignite/spi/deployment this configuration refer to Code Deployment-Deploying User Code section. https://ignite.apache.org/docs/latest/code-deployment/deploying-user-code. start ignite.sh java exception. configuration XML file name is ./config/testNode1.xml. issue part. === file://freq=5000@localhost/usr/local/bin/ignite/libs === next ignite.sh starting result messages. = [root@sidious apache-ignite]# ./bin/ignite.sh ./config/testNode1.xml class org.apache.ignite.IgniteException: Failed to instantiate Spring XML application context (make sure all classes used in Spring configuration are present at CLASSPATH) [springUrl=file:/opt/apache/apache-ignite/./config/testNode1.xml] at org.apache.ignite.internal.util.IgniteUtils.convertException(IgniteUtils.java:1098) at org.apache.ignite.Ignition.start(Ignition.java:356) at org.apache.ignite.startup.cmdline.CommandLineStartup.main(CommandLineStartup.java:367) Caused by: class org.apache.ignite.IgniteCheckedException: Failed to instantiate Spring XML application context (make sure all classes used in Spring configuration are present at CLASSPATH) [springUrl=file:/opt/apache/apache-ignite/./config/testNode1.xml] at org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl.applicationContext(IgniteSpringHelperImpl.java:387) at org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl.loadConfigurations(IgniteSpringHelperImpl.java:104) at org.apache.ignite.internal.util.spring.IgniteSpringHelperImpl.loadConfigurations(IgniteSpringHelperImpl.java:98) at org.apache.ignite.internal.IgnitionEx.loadConfigurations(IgnitionEx.java:741) at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:942) at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:851) at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:721) at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:690) at org.apache.ignite.Ignition.start(Ignition.java:353) ... 1 more Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'org.apache.ignite.configuration.IgniteConfiguration#0' defined in URL [file:/opt/apache/apache-ignite/./config/testNode1.xml]: Cannot create inner bean 'org.apache.ignite.spi.deployment.uri.UriDeploymentSpi#3327bd23' of type [org.apache.ignite.spi.deployment.uri.UriDeploymentSpi] while setting bean property 'deploymentSpi'; nested exception is org.springframework.beans.factory.CannotLoadBeanClassException: Cannot find class [org.apache.ignite.spi.deployment.uri.UriDeploymentSpi] for bean with name 'org.apache.ignite.spi.deployment.uri.UriDeploymentSpi#3327bd23' defined in URL [file:/opt/apache/apache-ignite/./config/testNode1.xml]; nested exception is java.lang.ClassNotFoundException: org.apache.ignite.spi.deployment.uri.UriDeploymentSpi at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveInnerBean(BeanDefinitionValueResolver.java:313) at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:122) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.applyPropertyValues(AbstractAutowireCapableBeanFactory.java:1522) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.populateBean(AbstractAutowireCapableBeanFactory.java:1269) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:551) at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:481) at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:312) at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:230) at
Windows installation
Can I install Ignite in Windows server? Thanks.
