Re: Flink Elastic Sink AWS ES

2017-08-28 Thread arpit srivastava
added the x’s they were returned on > the response > > ip port > > x.x.x.x 9300 > > Thanks your for you help > > Anthony > > > On 28 Aug 2017, at 10:34, arpit srivastava <arpit8...@gmail.com> wrote: > > Hi Ant, > > Can you try this. >

Re: Flink Elastic Sink AWS ES

2017-08-28 Thread arpit srivastava
something that you experienced? > > curl -XGET 'http:///_nodes' >> >> > Thanks, > > > On 27 Aug 2017, at 14:32, ant burton <apburto...@gmail.com> wrote: > > Thanks! I'll check later this evening. > > On Sun, 27 Aug 2017 at 07:44, arpit srivastava <arpit

Re: Flink Elastic Sink AWS ES

2017-08-27 Thread arpit srivastava
We also had same setup where ES cluster was behind a proxy server for which port 80 was used which redirected it to ES cluster 9200 port. For using Flink we got the actual ip address of the ES nodes and put that in ips below. transportAddresses.add(new

Re: Facing error while running Hands-in training example “writing to Apache Kafka”

2016-05-31 Thread arpit srivastava
Flink uses kryo serialization which doesn't support joda time object serialization. Use java.util.date or you have to change kryo. Thanks, Arpit On Tue, May 31, 2016 at 11:18 PM, ahmad Sa P wrote: > Hi > I have a problem at running a sample code from the hands-in examples

Re: Flink Yarn Cluster specifying Job Manager IP

2016-05-31 Thread arpit srivastava
t; you'll provide for your dedicated queue. > If you manage to do so could you send some feedback about how you did it ? > > Regards > > 2016-05-30 21:44 GMT+02:00 arpit srivastava <arpit8...@gmail.com>: > >> Hi, >> >> I have yarn cluster with 7 nodes. >&

Flink Yarn Cluster specifying Job Manager IP

2016-05-30 Thread arpit srivastava
Hi, I have yarn cluster with 7 nodes. Five nodes -16gb ram One node - 8gb ram One yarn resourcemanager - 8gb I want to specifically use 8gb machine (not resourcemanager) to act as job manager and other five nodes as task managers. Is there a way to do that ?

Re: Unsatisfied Link Error

2016-05-30 Thread arpit srivastava
I am not sure but the reason could be that you are not submitting "fat-jar" containing all the libs when submitting it to job manager. When you run it through intellij it takes care of including the libraries. To create fat jar use maven-shade-plugin. Let me know if it works. Thanks, Arpit On

Re: Checkpoint Error in flink with Rockdb state backend

2016-05-29 Thread arpit srivastava
t; Checkpointed interface and is keeping state? This might give people a > chance of understanding what is going on. > > Cheers, > Aljoscha > > On Sat, 28 May 2016 at 20:55 arpit srivastava <arpit8...@gmail.com> wrote: > >> Hi, >> >> I am using Flink on yarn clust

Checkpoint Error in flink with Rockdb state backend

2016-05-28 Thread arpit srivastava
Hi, I am using Flink on yarn cluster. My job was running for 2-3 days. After that it failed with two errors org.apache.flink.runtime.io.network.netty.exception.RemoteTransportException: Error at remote task manager 'ip-xx.xx.xx.xxx'. at