Joseph Sims created FLINK-10316:
-----------------------------------
Summary: Kinesalite bug fix (FLINK-9402) doesn't fully fix the
problem.
Key: FLINK-10316
URL: https://issues.apache.org/jira/browse/FLINK-10316
Project: Flink
Issue Type: Bug
Components: Kinesis Connector
Affects Versions: 1.6.0, 1.5.0, 1.7.0
Reporter: Joseph Sims
Related to: https://issues.apache.org/jira/browse/FLINK-9402
A fix (Flink-9402) was introduced to force the configurations to have *exactly*
one of "aws.region" or "aws.endpoint", but the underlying problem wasn't
entirely fixed.
If "aws.endpoint" is set and "aws.region" is unset, a different exception is
thrown, instead.
In *KinesisConfigUtil.java*, *getValidatedProducerConfiguration()* calls:
{code:java}
validateAwsConfiguration(config)
{code}
Where the original fix was introduced ("aws.region" XOR "aws.endpoint")
But a couple of lines later, *getValidatedProducerConfiguration()* then calls:
{code:java}
kpc.setRegion(config.getProperty(AWSConfigConstants.AWS_REGION));
{code}
Which explicitly checks for the existence of "aws.region", and throws an
exception if it is not set.
Thus, this class needs to be fixed such that "aws.region" is only required if
"aws.endpoint" is unset, as the original ticket indicated.
Also, *validateAwsConfiguration()* has a minor bug where is labels the
"aws.endpoint" incorrectly.
Current:
{code:java}
if (!(config.containsKey(AWSConfigConstants.AWS_REGION) ^
config.containsKey(ConsumerConfigConstants.AWS_ENDPOINT))) {
// per validation in AwsClientBuilder
throw new IllegalArgumentException(String.format("Either AWS region ('%s')
or AWS endpoint ('%s') must be set in the config.",
AWSConfigConstants.AWS_REGION, AWSConfigConstants.AWS_REGION));
}
{code}
But should be:
{code:java}
if (!(config.containsKey(AWSConfigConstants.AWS_REGION) ^
config.containsKey(ConsumerConfigConstants.AWS_ENDPOINT))) {
// per validation in AwsClientBuilder
throw new IllegalArgumentException(String.format("Either AWS region ('%s')
or AWS endpoint ('%s') must be set in the config.",
AWSConfigConstants.AWS_REGION, ConsumerConfigConstants.AWS_ENDPOINT));
}
{code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)