Lukasz Gajowy created BEAM-7658:
-----------------------------------
Summary: Synthetic unbounded source looses (duplicates?) data
while splitting
Key: BEAM-7658
URL: https://issues.apache.org/jira/browse/BEAM-7658
Project: Beam
Issue Type: Bug
Components: testing
Reporter: Lukasz Gajowy
Assignee: Lukasz Gajowy
This came out while creating KafkaIOIT ingesting data generated using
SyntheticUnboundedSource. Hashcode of data created by
{code:java}
.apply("Calculate hashcode", Combine.globally(new
HashingFn()).withoutDefaults()){code}
was different for 1000 records every time. When a number of splits was set to 1
the problem disappeared (sourceOptions.forceNumInitialBundles).
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
