Re: Using FlinkKinesisConsumer through a proxy

2018-12-01 Thread Tzu-Li (Gordon) Tai
Good to hear that it's working, thanks for the update! On Sat, Dec 1, 2018, 4:29 AM Vijay Balakrishnan Hi Gordon, > Finally figured out my issue.Do not need to add http:// in proxyHost name. > String proxyHost= "proxy-chaincom";//not http://proxy-chain...com >

Re: Using FlinkKinesisConsumer through a proxy

2018-11-30 Thread Vijay Balakrishnan
Hi Gordon, Finally figured out my issue.Do not need to add http:// in proxyHost name. String proxyHost= "proxy-chaincom";//not http://proxy-chain...com kinesisConsumerConfig.setProperty(AWSUtil.AWS_CLIENT_CONFIG_PREFIX + "proxyHost", proxyHost);//<== mo http:// in proxyHost name TIA, Vijay

Re: Using FlinkKinesisConsumer through a proxy

2018-11-14 Thread Tzu-Li (Gordon) Tai
Hi Vijay, I’m pretty sure that this should work with the properties that you provided, unless the AWS Kinesis SDK isn’t working as expected. What I’ve tested is that with those properties, the ClientConfiguration used to build the Kinesis client has the proxy domain / host / ports etc.

Re: Using FlinkKinesisConsumer through a proxy

2018-11-06 Thread Vijay Balakrishnan
Hi Gordon, This still didn't work :( Tried a few combinations with: kinesisConsumerConfig.setProperty(AWSUtil.AWS_CLIENT_CONFIG_PREFIX + "proxyDomain", "..."); inesisConsumerConfig.setProperty(AWSUtil.AWS_CLIENT_CONFIG_PREFIX + "proxyHost", "http://.com;);

Re: Using FlinkKinesisConsumer through a proxy

2018-10-04 Thread Tzu-Li (Gordon) Tai
Hi, Since Flink 1.5, you should be able to set all available configurations on the ClientConfiguration through the consumer Properties (see FLINK-9188 [1]). The way to do that would be to prefix the configuration you want to set with "aws.clientconfig" and add that to the properties, as such:

Re: Using FlinkKinesisConsumer through a proxy

2018-10-04 Thread Aljoscha Krettek
Hi, I'm looping in Gordon and Thomas, they might have some idea about how to resolve this. Best, Aljoscha > On 3. Oct 2018, at 17:29, Vijay Balakrishnan wrote: > > I have been trying with all variations to no avail of java > -Dhttp.nonProxyHosts=.. -Dhttps.proxyHost=http://...

Re: Using FlinkKinesisConsumer through a proxy

2018-10-03 Thread Vijay Balakrishnan
I have been trying with all variations to no avail of java -Dhttp.nonProxyHosts=.. -Dhttps.proxyHost=http://... -Dhttps.proxyPort=911 -Dhttps.proxyUser= -Dhttps.proxyPassword=.. -Dhttp.proxyHost=http://.. -Dhttp.proxyPort=911 -Dhttp.proxyUser=... -Dhttp.proxyPassword=... -jar .. after looking at

Using FlinkKinesisConsumer through a proxy

2018-10-02 Thread Vijay Balakrishnan
HI, How do I use FlinkKinesisConsumer using the Properties through a proxy ? Getting a Connection issue through the proxy. Works outside the proxy. Properties kinesisConsumerConfig = new Properties(); kinesisConsumerConfig.setProperty(AWSConfigConstants.AWS_REGION, region); if