[
https://issues.apache.org/jira/browse/FLINK-4523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15946584#comment-15946584
]
Sriharsha Tikkireddy commented on FLINK-4523:
---------------------------------------------
[~tonywei]
Hey I tried to run using an input of timestamp as start position but the
following KinesisUtil function being called always throws an error because if
input epoch time the date formatter parsing will throw a parse exception and if
you enter in string characters you get an exception for parsing string values:
private static void validateOptionalDateProperty(Properties config, String key,
String message) {
if (config.containsKey(key)) {
try {
initTimestampDateFormat.parse(config.getProperty(key)); ---
double value =
Double.parseDouble(config.getProperty(key)); ---
if (value < 0) {
throw new NumberFormatException();
}
} catch (ParseException | NumberFormatException e) {
throw new IllegalArgumentException(message);
}
}
}
> Allow Kinesis Consumer to start from specific timestamp / Date
> --------------------------------------------------------------
>
> Key: FLINK-4523
> URL: https://issues.apache.org/jira/browse/FLINK-4523
> Project: Flink
> Issue Type: New Feature
> Components: Kinesis Connector
> Reporter: Tzu-Li (Gordon) Tai
> Assignee: Wei-Che Wei
> Fix For: 1.3.0
>
>
> We had a Kinesis user requesting this feature on an offline chat.
> To be specific, we let all initial Kinesis shards be iterated starting from
> records at the given timestamp.
> The AWS Java SDK we're using already provides API for this, so we can add
> this functionality with fairly low overhead:
> http://docs.aws.amazon.com/AWSJavaSDK/latest/javadoc/com/amazonaws/services/kinesis/model/GetShardIteratorRequest.html#setTimestamp-java.util.Date-
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
