India Scala & Big Data Job Referral

2023-12-21 Thread sri hari kali charan Tummala
Hi Community, I was laid off from Apple in February 2023, which led to my relocation from the USA due to immigration issues related to my H1B visa. I have over 12 years of experience as a consultant in Big Data, Spark, Scala, Python, and Flink. Despite my move to India, I haven't secured a

Big Data Contract roles ?

2022-09-14 Thread sri hari kali charan Tummala
Hi Community, Is anyone hiring contract big Data spark scala corp to corp roles in USA ? I am open in market looking for work. Thanks Sri

Stand-alone Mode Ignite Installation

2021-04-10 Thread sri hari kali charan Tummala
Hi Ignite Users, Below we link is not working spark ignite standalone mode installation page. https://ignite.apache.org/docs/latest/installation/ https://ignite.apache.org/docs/latest/extensions-and-integrations/ignite-for-spark/installation Thanks Sri -- Thanks & Regards Sri Tummala

Re: Looking for feedback on the Ignite 3.0.0 Alpha

2021-01-13 Thread sri hari kali charan Tummala
vered, and how you will run > operations using the new CLI tool. > > -Val > > On Wed, Jan 13, 2021 at 11:21 AM sri hari kali charan Tummala < > kali.tumm...@gmail.com> wrote: > >> Sure few steps are missing. >> >> Creating a ignite cluster is missing (exa

Re: Looking for feedback on the Ignite 3.0.0 Alpha

2021-01-13 Thread sri hari kali charan Tummala
Sure few steps are missing. Creating a ignite cluster is missing (example 3 ec2 instances) Creating a ignite cluster on Aws would be nice step to add Thanks Sri On Wed, 13 Jan 2021 at 04:14, Kseniya Romanova wrote: > Here's the link for the online gathering: >

DataBricks Spark/Scala Opportunity

2020-12-22 Thread sri hari kali charan Tummala
> > Hi Apache Ignite Community, >> >> Note:- (This is a full time position) >> >> I copied Geoff in this email chain who is actively looking for >> Spark/Scala Developer for a full time position with DataBricks 200k+ >> (Salary/Bonus/Stocks/H1b/GC Process). >> >> If you know anyone or your friends

Re: New blog post on Apache Ignite in AWS

2020-01-28 Thread sri hari kali charan Tummala
gt; On Sat, Jan 25, 2020 at 7:22 AM sri hari kali charan Tummala < > kali.tumm...@gmail.com> wrote: > >> cant open second screenshot I mean cant expand , a simple example to read >> and write with spark would be nice using thrift jdbc etc ... >> >> conn

Re: New blog post on Apache Ignite in AWS

2020-01-24 Thread sri hari kali charan Tummala
cant open second screenshot I mean cant expand , a simple example to read and write with spark would be nice using thrift jdbc etc ... connecting Ignite from outside ec2 with spark.

Re: Adhoc Reporting use case (Ignite+Spark?)

2019-12-10 Thread sri hari kali charan Tummala
Check these examples. https://aws.amazon.com/blogs/big-data/real-time-in-memory-oltp-and-analytics-with-apache-ignite-on-aws/ Spark + ignite using thrift connection:-

Re: Ignite with Spark Intergration

2019-12-09 Thread sri hari kali charan Tummala
I integrated spark and ignite using thrift client will that do ? https://github.com/kali786516/ApacheIgnitePoc/blob/master/src/main/scala/com/ignite/examples/spark/SparkClientConnectionTest.scala#L73 On Monday, December 9, 2019, Denis Magda wrote: > Hi, just ensure that "clientMode" is set

Re: Apache Spark + Ignite Connection Issue

2019-10-24 Thread sri hari kali charan Tummala
d SQL APIs are all you > need. > > - > Denis > > > On Sun, Oct 20, 2019 at 2:06 PM sri hari kali charan Tummala < > kali.tumm...@gmail.com> wrote: > > so I got an answer from Grid Grain computing, JDBC thin client is the only > way yo connect the ign

Apache Ignite + DynamoDB Streams on AWS

2019-10-21 Thread sri hari kali charan Tummala
Hi All, this email is for info sake I put together a document that covers how to set up Ignite on AWS and fixed missing code ( https://aws.amazon.com/blogs/big-data/real-time-in-memory-oltp-and-analytics-with-apache-ignite-on-aws/) in this blog, which can be useful for Quick POC. Working Code to

Re: Apache Spark + Ignite Connection Issue

2019-10-20 Thread sri hari kali charan Tummala
=digestviewer=Thank+you+for+submitting+your+message. Thanks Sri On Fri, Oct 18, 2019 at 1:38 PM sri hari kali charan Tummala < kali.tumm...@gmail.com> wrote: > Ok I created a 2 node ec2 instance ignite cluster is below is the right > way to create cache? the code still using my laptop reso

Re: Apache Spark + Ignite Connection Issue

2019-10-18 Thread sri hari kali charan Tummala
EET,124232 as ZIP").write.mode(SaveMode.Append).jdbc("jdbc:ignite:thin://18.206.247.40", "Person2",connectionProperties) On Fri, Oct 18, 2019 at 12:00 PM sri hari kali charan Tummala < kali.tumm...@gmail.com> wrote: > unfortunately, tables that are cre

Re: Apache Spark + Ignite Connection Issue

2019-10-18 Thread sri hari kali charan Tummala
g/schema/util; xsi:schemaLocation=" http://www.springframework.org/schema/beans http://www.springframework.org/schema/beans/spring-beans.xsd http://www.springframework.org/schema/util http://www.sprin

Re: Apache Spark + Ignite Connection Issue

2019-10-18 Thread sri hari kali charan Tummala
48.113 <http://3.88.248.113:10800/> Thanks On Fri, Oct 18, 2019 at 9:18 AM sri hari kali charan Tummala < kali.tumm...@gmail.com> wrote: > Hi Stephen , > > do you mean 3.88.248.113: <http://3.88.248.113:10800/>4750

Re: Apache Spark + Ignite Connection Issue

2019-10-18 Thread sri hari kali charan Tummala
n Darlington < stephen.darling...@gridgain.com> wrote: > You’re trying to connect a thick client (the Spark integration) to the > thin client port (10800). Your example-default.xml file needs to have the > same configuration as your server node(s). > > Regards, > Stephen > &g

Apache Spark + Ignite Connection Issue

2019-10-17 Thread sri hari kali charan Tummala
Hi Community, I am trying to read and write into the Ignite cluster using apache-spark I am able to do that using JDBC thin client but not native method as mentioned in several spark + ignite examples. Right now all the spark + ignite examples launch a local ignite cluster but I want my code

Re: Does any one have working Ignite cluster on AWS

2019-10-17 Thread sri hari kali charan Tummala
arkDSLExample } } On Thu, Oct 17, 2019 at 7:09 AM Stephen Darlington < stephen.darling...@gridgain.com> wrote: > You have to tell it *where* to connect: > > ./sqlline -u jdbc:ignite:thin://127.0.0.1/ > > I also wrote this showing a few ways to load data without firing up a

Re: Connection Refused in Scala Ignite Client (Help!)

2019-10-17 Thread sri hari kali charan Tummala
o use the s3 one. > > add the libraries from libs/optional/ignite-aws to your application's > classpath. > > No file is required. > > > > *From:* sri hari kali charan Tummala > > *Sent:* Wednesday, October 16, 2019 8:10 PM > *To:* user@ignite.apache.org; alexanderko...@gm

Re: Ignite Node Connection Issue

2019-10-17 Thread sri hari kali charan Tummala
> > Denis > On 17 Oct 2019, 00:08 +0300, sri hari kali charan Tummala < > kali.tumm...@gmail.com>, wrote: > > I even tried with simple scala code still no luck! > > Error:- > Failed to connect to any address from IP finder (will retry to join > topology every

Re: Connection Refused in Scala Ignite Client (Help!)

2019-10-16 Thread sri hari kali charan Tummala
, October 16, 2019, sri hari kali charan Tummala < kali.tumm...@gmail.com> wrote: > Do I need to keep any file inside the s3 bucket or is it just a empty > bucket ? With aws credentials and bucket name ? > > > > On Wednesday, October 16, 2019, wrote: > >> Hi, >>

Re: Connection Refused in Scala Ignite Client (Help!)

2019-10-16 Thread sri hari kali charan Tummala
ed-discovery > > > > > > > > > > > > > > > > > > > > > > > > > > Thanks, Alex > > > > > > *From:* sri hari kali charan Tummala > *Sen

Re: Ignite Node Connection Issue

2019-10-16 Thread sri hari kali charan Tummala
ue) cfg.setPeerClassLoadingEnabled(true) val ignite: Ignite = Ignition.start(cfg) Ignition.ignite().cache("test") //LOG.info(">>> cache acquired") } } On Wed, Oct 16, 2019 at 3:41 PM sri hari kali charan Tummala < kali.tumm...@gmail.com> w

Re: Spring XML Issue

2019-10-16 Thread sri hari kali charan Tummala
ngframework.org/schema/beans > http://www.springframework.org/schema/beans/spring-beans.xsd;> > > to the start of the file and > > > > to the end. > > On Wed, Oct 16, 2019 at 8:22 PM sri hari kali charan Tummala < > kali.tumm...@gmail.com> wrote: > &g

Re: Does any one have working Ignite cluster on AWS

2019-10-16 Thread sri hari kali charan Tummala
> 172.31.81.211 > 172.31.82.21 > > > > > > > > > > On Wed, Oct 16, 2019 at 1:14 PM sri hari kali charan Tummala < >

Re: Does any one have working Ignite cluster on AWS

2019-10-16 Thread sri hari kali charan Tummala
-beans.xsd;> 172.31.81.211 172.31.82.21 On Wed, Oct 16, 2019 at 1:14 PM sri hari kali charan Tummala < kali.tumm...@gmail.com> wrote: > I am getting bean invalid exception can

Spring XML Issue

2019-10-16 Thread sri hari kali charan Tummala
Hi All, I am trying out steps mentioned in this blog ( https://www.gridgain.com/docs/8.7.6//installation-guide/manual-install-on-ec2) I created Ec2 nodes and .xml file when I try to run I get this bean xml error can anyone help with resolving this am I missing something in the file? Run

Re: Does any one have working Ignite cluster on AWS

2019-10-16 Thread sri hari kali charan Tummala
. On Wed, Oct 16, 2019 at 9:18 AM sri hari kali charan Tummala < kali.tumm...@gmail.com> wrote: > Hi , > > someone sent me this I will give a try. > > > https://www.gridgain.com/docs/8.7.6//installation-guide/manual-install

Re: Does any one have working Ignite cluster on AWS

2019-10-16 Thread sri hari kali charan Tummala
lp you > > > > *Regards,* > > *Favas * > > > > *From:* Denis Magda > *Sent:* Tuesday, October 15, 2019 11:21 PM > *To:* user@ignite.apache.org > *Subject:* Re: Does any one have working Ignite cluster on AWS > > > > Refer to GridGain documentation: > htt

Re: Does any one have working Ignite cluster on AWS

2019-10-15 Thread sri hari kali charan Tummala
; Ilya Kasnacheev > > > пн, 30 сент. 2019 г. в 17:57, sri hari kali charan Tummala < > kali.tumm...@gmail.com>: > >> thanks for replying but sorry not getting it please dumb it down, below >> are my questions. >> >> Statically giving the public IP list in t

Re: Does any one have working Ignite cluster on AWS

2019-09-30 Thread sri hari kali charan Tummala
> > > > > > > > > > > > > > > > *Regards,* > > *Favas * > > > > *From:* sri hari kali charan Tummala > *Sent:* Friday, September 27, 2019 10:02 PM &

Does any one have working Ignite cluster on AWS

2019-09-27 Thread sri hari kali charan Tummala
Hi All, can someone help me run a working ignite cuter on AWS , did anyone able to figure out steps required for setting up working ignite cluster on AWS. Ignite documentation doesnt make sense it's just launching a docker instance on Ec2. -- Thanks & Regards Sri Tummala

Re: Apache Ignite Cloud Formation Template

2019-09-27 Thread sri hari kali charan Tummala
quot;" >> /tmp/igniteconfig.xml echo " " >> /tmp/igniteconfig.xml echo " " >> /tmp/igniteconfig.xml echo "" >> /tmp/igniteconfig.xml echo "

Re: Apache Ignite Cloud Formation Template

2019-09-26 Thread sri hari kali charan Tummala
er if IPs are know in advance or AWS IPfinder if IPs > are assigned dynamically. > https://apacheignite.readme.io/docs/tcpip-discovery > > Let us know if it helps and we’ll update the docs. > > Denis > > On Thursday, September 26, 2019, sri hari kali charan Tummala < >

Re: Apache Ignite Cloud Formation Template

2019-09-26 Thread sri hari kali charan Tummala
Hi Community, this doesn't launch a multinode ignite cluster am I right? it just launches a single node ignite cluster on one ec2 instance. https://apacheignite.readme.io/docs/aws-deployment Thanks Sri On Thu, Sep 26, 2019 at 8:49 AM sri hari kali charan Tummala < kali.tumm...@gmail.com>

Apache Ignite Cloud Formation Template

2019-09-26 Thread sri hari kali charan Tummala
Hi All, did anyone have an cloud formation example for deploying Apache Ignite on AWS or steps to deploy or some successful deployment of Ignite onto AWS. this below blog has missing artifacts so not working.

Re: Professional Ignite Course

2019-09-25 Thread sri hari kali charan Tummala
I did went trough the course and I asked pluralsight to add more, in the next course I would like to see ignite installation on aws and spark + ignite integration. Real time analytics with spark + ignite. On Wednesday, September 25, 2019, Denis Magda wrote: > Igniters, > > Recently, I've come

Re: Ignite Spark Example Question

2019-08-13 Thread sri hari kali charan Tummala
how you architect it would depend on what you’re trying > to do. > > Regards, > Stephen > > On 12 Aug 2019, at 19:59, sri hari kali charan Tummala < > kali.tumm...@gmail.com> wrote: > > Thanks Stephen , last question so I have to keep looping to find new data > file

Re: Ignite Spark Example Question

2019-08-12 Thread sri hari kali charan Tummala
” but you could write a > custom CacheStore to do that. > > See here for more details: > https://apacheignite.readme.io/docs/3rd-party-store#section-custom-cachestore > > Regards, > Stephen > > On 9 Aug 2019, at 21:50, sri hari kali charan Tummala < > kali.tumm.

Re: Ignite Spark Example Question

2019-08-09 Thread sri hari kali charan Tummala
get loaded to S3 automatically gets loaded to Ignite (I can use spark structured streaming jobs but is there a direct approach ?) On Fri, Aug 9, 2019 at 4:34 PM sri hari kali charan Tummala < kali.tumm...@gmail.com> wrote: > Thank you, I got it now I have to change the id values to see

Re: Unable to access Ignite Ec2 Instance from Local PC

2019-08-09 Thread sri hari kali charan Tummala
charan Tummala < kali.tumm...@gmail.com> wrote: > please check. > > On Fri, Aug 9, 2019 at 10:58 AM sri hari kali charan Tummala < > kali.tumm...@gmail.com> wrote: > >> give me couple of minutes I think I opened 0 to 65000 ports for inbound >> thats

Re: Unable to access Ignite Ec2 Instance from Local PC

2019-08-09 Thread sri hari kali charan Tummala
l traffic All All ::/0 > > as mentioned in > http://apache-ignite-users.70518.x6.nabble.com/AWS-Cluster-td23903.html > > On Fri, Aug 9, 2019 at 9:52 AM sri hari kali charan Tummala < > kali.tumm...@gmail.com> wrote: > >> yes, all traffic inbound and outbound (TCP),

Re: Unable to access Ignite Ec2 Instance from Local PC

2019-08-09 Thread sri hari kali charan Tummala
ter is running? > > On Fri, Aug 9, 2019 at 8:50 AM sri hari kali charan Tummala < > kali.tumm...@gmail.com> wrote: > >> Hi, >> >> thanks for replying I am following the below blog as per some expert >> suggestion he asked me to use my laptop ip addr

Re: Unable to access Ignite Ec2 Instance from Local PC

2019-08-09 Thread sri hari kali charan Tummala
lient to talk to your > cluster? We do not recommend having heterogenous, non-collocated clusters, > and this includes thick client nodes. > > Regards, > -- > Ilya Kasnacheev > > > пт, 9 авг. 2019 г. в 03:35, sri hari kali charan Tummala < > kali.tumm...@gmail.com>

Unable to access Ignite Ec2 Instance from Local PC

2019-08-08 Thread sri hari kali charan Tummala
Hi All, I am trying to connect a ignite ec2 instance (one node) remotely from local PC Mac Intellij Idea I am using TcpDicoverySpi to connect ignite ec2 instance public IP but its failing to connect I did open all the ports I was able to do ssh and ping the host from my local PC even on the

Ignite Spark Example Question

2019-08-08 Thread sri hari kali charan Tummala
Hi All, I am new to Apache Ignite community I am testing out ignite for knowledge sake in the below example the code reads a json file and writes to ingite in-memory table is it overwriting can I do append mode I did try spark append mode .mode(org.apache.spark.sql.SaveMode.Append) without