Boyuan Zhang created BEAM-9862:
----------------------------------
Summary: test_multimap_multiside_input breaks Spark python VR test
Key: BEAM-9862
URL: https://issues.apache.org/jira/browse/BEAM-9862
Project: Beam
Issue Type: New Feature
Components: test-failures
Reporter: Boyuan Zhang
Assignee: Pablo Estrada
======================================================================
ERROR: test_multimap_multiside_input (__main__.SparkRunnerTest)
----------------------------------------------------------------------
Traceback (most recent call last):
File "apache_beam/runners/portability/fn_api_runner/fn_runner_test.py", line
265, in test_multimap_multiside_input
equal_to([('a', [1, 3], [1, 2, 3]), ('b', [2], [1, 2, 3])]))
File "apache_beam/pipeline.py", line 543, in __exit__
self.run().wait_until_finish()
File "apache_beam/runners/portability/portable_runner.py", line 571, in
wait_until_finish
(self._job_id, self._state, self._last_error_message()))
RuntimeError: Pipeline
test_multimap_multiside_input_1588248535.23_9fee5456-d12d-451e-b112-a022d1c6ce1f
failed in state FAILED: java.lang.IllegalArgumentException: Multiple entries
with same key:
ref_PCollection_PCollection_21=(Broadcast(37),WindowedValue$FullWindowedValueCoder(KvCoder(ByteArrayCoder,VarLongCoder),GlobalWindow$Coder))
and
ref_PCollection_PCollection_21=(Broadcast(36),WindowedValue$FullWindowedValueCoder(KvCoder(ByteArrayCoder,VarLongCoder),GlobalWindow$Coder))
Link: https://builds.apache.org/job/beam_PostCommit_Python_VR_Spark/3099/
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
