Re: Official Apache Ignite meetup - Sept. 22nd - London

2016-10-06 Thread Alexey Kuznetsov
Hi Christos, I'like this video. Looking forward for new videos! Denis, does it make sense to add link to this video to https://ignite.apache.org "Latest news" section? -- Alexey Kuznetsov

Re: Ignite Cluster Communication with SSH Tunnels

2016-10-06 Thread Krzysztof
I also added 48500 mappings, so discovery could use it, but both do not use resolver for whatever reason - AddressResolver is only used for the client address - none of cluster addresses gets mapped. The only place resolver is called seems to be this one in TcpDiscoverySpi or TcpCommunicationSpi:

Re: Ignite Cluster Communication with SSH Tunnels

2016-10-06 Thread vkulichenko
You set 47099 as a communication port, but I don't see how it's mapped in the resolver. I think this is the reason. -Val -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Ignite-Cluster-Communication-with-SSH-Tunnels-tp273p8134.html Sent from the Apache Ignite

Re: Official Apache Ignite meetup - Sept. 22nd - London

2016-10-06 Thread Denis Magda
Hi Christos, Thanks for sharing! The use case is really unique. It was useful to learn how Apache Ignite and GridGain are applicable in betting and gambling platforms. — Denis > On Oct 6, 2016, at 3:27 AM, Christos Erotocritou > wrote: > > Hello Igniters, > > The

Killing a node under load stalls the grid with ignite 1.7

2016-10-06 Thread bintisepaha
Hi, we are using ignite 1.7 and under some load when caches are being updated and write behind is moving along if we just kill a node, the entire grid stalls. attaching thread dumps when the partitioned caches were in full_sync mode and also when all were in full_async mode. It looks like

secured mesos deployment

2016-10-06 Thread vincent gromakowski
Hi, Is there any way to configure mesos credentials in ignite-mesos ? Vincent

Re: Fail to cache rdd: java.lang.NoSuchMethodError: scala.Predef$.$conforms()Lscala/Predef$$less$colon$less;

2016-10-06 Thread Tracyl
Hi Denis, This is really helpful. Yes, I need the original dataframe for other API. Now I am using RDD[String, Row] as type and caching dataframe using: val rdd = df.map(row => (row.getAs[String]("KEY"), row)) igniteRDD.savePairs(rdd) It works perfectly fine. Also I was able to reconstruct the

Re: Fail to cache rdd: java.lang.NoSuchMethodError: scala.Predef$.$conforms()Lscala/Predef$$less$colon$less;

2016-10-06 Thread Denis Magda
Presently, You need to covert your data frame into key-value tuples and insert them in an IgniteRDD https://apacheignite-fs.readme.io/docs/ignitecontext-igniterdd#section-saving-values-to-ignite

Re: Fail to cache rdd: java.lang.NoSuchMethodError: scala.Predef$.$conforms()Lscala/Predef$$less$colon$less;

2016-10-06 Thread Tracyl
Thanks for prompt reply. So if I want to cache dataframe in IgniteCache, I have to do define a custom data model class(e.g. https://github.com/apache/ignite/blob/master/examples/src/main/java/org/apache/ignite/examples/model/Person.java ) as a schema of dataframe, then construct objects and

Re: Fail to cache rdd: java.lang.NoSuchMethodError: scala.Predef$.$conforms()Lscala/Predef$$less$colon$less;

2016-10-06 Thread Denis Magda
Duplicate message. Replied you in a similar one http://apache-ignite-users.70518.x6.nabble.com/Does-IgniteCache-could-be-access-thr-Spark-JDBC-data-source-api-tp8117.html

Re: Fail to cache rdd: java.lang.NoSuchMethodError: scala.Predef$.$conforms()Lscala/Predef$$less$colon$less;

2016-10-06 Thread Denis Magda
Hi, Presently Ignite integration for Spark is not intended to be used with Spark Data Frames. There is the ticket you can track on that was created in order to fill this gap. https://issues.apache.org/jira/browse/IGNITE-3084 As for

Fail to cache rdd: java.lang.NoSuchMethodError: scala.Predef$.$conforms()Lscala/Predef$$less$colon$less;

2016-10-06 Thread Tracyl
Hi team, I was trying to cache dataframe in Ignite Cache. I was able to cache generic type data elements(RDD). However each time when I use igniteRDDF.saveValues() to cache a non-generic data type(e.g. RDD), it will trigger the noSuchMethod for saveValues as following shows. I am using

Could IgniteCache be accessed thr Spark JDBC data source api?

2016-10-06 Thread Tracyl
Hey team, I was able to use JDBC driver tool to access IgniteCache. Is it possible to connect to Ignite thr Spark JDBC data source api? Below are the code and exceptions I got. It seems like the connection is successful but there are datatype mapping issues. Do I need to define some schema from

test

2016-10-06 Thread Tracyl
test -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/test-tp8120.html Sent from the Apache Ignite Users mailing list archive at Nabble.com.

Re: Couchbase as persistent store

2016-10-06 Thread kvipin
No Val, in fact it doesn't even seem to open the bucket/connection also. Following is the *output of server node:* $ ./nodemgr -c config/test-tool-server.xml log4j:WARN No appenders could be found for logger (org.springframework.core.env.StandardEnvironment). log4j:WARN Please initialize the

Re: Certificates for Encryption

2016-10-06 Thread Vladislav Pyatkov
Hi Ignite requires jks trust store for storing trusted certificates[1]. If you have certificate file you can to import it into store like this: *keytool -importcert -file certificate.cer -keystore keystore.jks -alias "Alias"* [1]: https://apacheignite.readme.io/docs/ssltls On Thu, Oct 6, 2016

Does IgniteCache could be access thr Spark JDBC data source api?

2016-10-06 Thread Tracyl
Hey team, I was able to use JDBC driver tool to access IgniteCache. Is it possible to connect to Ignite thr Spark JDBC data source api? Below are the code and exceptions I got. It seems like the connection is successful but there are datatype mapping issues. Do I need to define some schema from

Fail to cache rdd: java.lang.NoSuchMethodError: scala.Predef$.$conforms()Lscala/Predef$$less$colon$less;

2016-10-06 Thread Tracyl
Hi team, I was trying to cache dataframe in Ignite Cache. I was able to cache generic type data elements(RDD). However each time when I use igniteRDDF.saveValues() to cache a non-generic data type(e.g. RDD), it will trigger the noSuchMethod for saveValues as following shows. I am using

Certificates for Encryption

2016-10-06 Thread styriver
Hello Our Unix team is asking if Ignite requires a keystore or can we just pass the location path to a certificate without having to import into a java keystore. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Certificates-for-Encryption-tp8115.html Sent from

Re: Ignite Cluster Communication with SSH Tunnels

2016-10-06 Thread Krzysztof
Thanks for the hint, but in the snippet I sent there's already: // Override default discovery SPI. cfg.setDiscoverySpi(spi); cfg.setAddressResolver(basicResolver); // it does not change anything (spi, commSpi have the resolve set too). Or do you mean something else? Cheers On Wed, Oct 5, 2016

Re: Cache entry list on particular node in apache ignite

2016-10-06 Thread Sergej Sidorov
Hi, There is a ticket on this issue: https://issues.apache.org/jira/browse/IGNITE-4043 Could you please look for that ticket. -- View this message in context: http://apache-ignite-users.70518.x6.nabble.com/Cache-entry-list-on-particular-node-in-apache-ignite-tp8110p8113.html Sent from the

Re: Official Apache Ignite meetup - Sept. 22nd - London

2016-10-06 Thread Christos Erotocritou
Hello Igniters, The recording from our most recent Ignite London meetup is ready to share. This time we had the pleasure of having Sam Lawrence from FSB Technologies talk about how they have used Apache Ignite to transform their online sports betting platform. Check it out:

Re: spark SQL thriftserver over ignite and cassandra

2016-10-06 Thread vincent gromakowski
Thanks Starting the thriftserver with igniterdd tables doesn't seem very hard. Implementing a security layer over ignite cache may be harder as I need to: - get username from thriftserver - intercept each request and check permissions Maybe spark will also be able to handle permissions... I will