[
https://issues.apache.org/jira/browse/BEAM-14104?focusedWorklogId=753916&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-753916
]
ASF GitHub Bot logged work on BEAM-14104:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 07/Apr/22 09:04
Start Date: 07/Apr/22 09:04
Worklog Time Spent: 10m
Work Description: mosche commented on code in PR #17113:
URL: https://github.com/apache/beam/pull/17113#discussion_r844896504
##########
sdks/java/io/amazon-web-services2/src/main/java/org/apache/beam/sdk/io/aws2/kinesis/KinesisPartitioner.java:
##########
@@ -47,6 +47,26 @@
return null;
}
+ /**
+ * An explicit partitioner that always returns a {@code Nonnull} explicit
hash key. The partition
+ * key is irrelevant in this case, though it cannot be {@code null}.
+ */
+ interface ExplicitPartitioner<T> extends KinesisPartitioner<T> {
+ @Override
+ default @Nonnull String getPartitionKey(T record) {
+ return "a"; // will be ignored, but can't be null
Review Comment:
It can't be empty, this constant is apparently what KPL uses in this case
Issue Time Tracking
-------------------
Worklog Id: (was: 753916)
Time Spent: 2h 40m (was: 2.5h)
> Shard aware Kinesis record aggregation (AWS Sdk v2)
> ---------------------------------------------------
>
> Key: BEAM-14104
> URL: https://issues.apache.org/jira/browse/BEAM-14104
> Project: Beam
> Issue Type: Improvement
> Components: io-java-aws
> Reporter: Moritz Mack
> Assignee: Moritz Mack
> Priority: P2
> Labels: aws-sdk-v2, kinesis
> Time Spent: 2h 40m
> Remaining Estimate: 0h
>
> Implement advanced Kinesis record aggregation that is aware of active shards
> in the stream for optimal record aggregation.
--
This message was sent by Atlassian Jira
(v8.20.1#820001)