[
https://issues.apache.org/jira/browse/BEAM-8839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Romanenko updated BEAM-8839:
-----------------------------------
Description:
Some of the transform translations for new Spark runner (Flatten and Combine in
particular) fail on several corner cases when ValidatesRunner tests are
running. These tests were excluded from run for new Spark Runner to keep
Jenkins job green and detect regression easily (if any) but they have to be
addressed and correspondent translations have to be fixed.
List of these tests:
{code}
'org.apache.beam.sdk.transforms.CombineFnsTest.testComposedCombineWithContext'
'org.apache.beam.sdk.transforms.CombineTest$CombineWithContextTests.testSimpleCombineWithContext'
'org.apache.beam.sdk.transforms.CombineTest$CombineWithContextTests.testSimpleCombineWithContextEmpty'
'org.apache.beam.sdk.transforms.CombineTest$WindowingTests.testFixedWindowsCombineWithContext'
'org.apache.beam.sdk.transforms.CombineTest$WindowingTests.testSessionsCombineWithContext'
'org.apache.beam.sdk.transforms.CombineTest$WindowingTests.testSlidingWindowsCombineWithContext'
'org.apache.beam.sdk.transforms.FlattenTest.testEmptyFlattenAsSideInput'
'org.apache.beam.sdk.transforms.FlattenTest.testFlattenMultipleCoders'
'org.apache.beam.sdk.transforms.FlattenTest.testFlattenPCollectionsEmpty'
'org.apache.beam.sdk.transforms.FlattenTest.testFlattenPCollectionsEmptyThenParDo'
'org.apache.beam.sdk.transforms.SplittableDoFnTest.testLifecycleMethodsBounded'
{code}
was:
Some of the transform translations for new Spark runner (Flatten and Combine in
particular) fail on several corner cases when ValidatesRunner tests are
running. These tests were excluded from run for new Spark Runner to keep
Jenkins job green and detect regression easily (if any) but they have to be
addressed and correspondent translations have to be fixed.
List of these tests:
{code}
'org.apache.beam.sdk.transforms.CombineFnsTest.testComposedCombineWithContext'
'org.apache.beam.sdk.transforms.CombineTest$CombineWithContextTests.testSimpleCombineWithContext'
'org.apache.beam.sdk.transforms.CombineTest$CombineWithContextTests.testSimpleCombineWithContextEmpty'
'org.apache.beam.sdk.transforms.CombineTest$WindowingTests.testFixedWindowsCombineWithContext'
'org.apache.beam.sdk.transforms.CombineTest$WindowingTests.testSessionsCombineWithContext'
'org.apache.beam.sdk.transforms.CombineTest$WindowingTests.testSlidingWindowsCombineWithContext'
'org.apache.beam.sdk.transforms.FlattenTest.testEmptyFlattenAsSideInput'
'org.apache.beam.sdk.transforms.FlattenTest.testFlattenMultipleCoders'
'org.apache.beam.sdk.transforms.FlattenTest.testFlattenPCollectionsEmpty'
'org.apache.beam.sdk.transforms.FlattenTest.testFlattenPCollectionsEmptyThenParDo'
'org.apache.beam.sdk.transforms.SplittableDoFnTest.testLifecycleMethodsBounded'
> Failed ValidatesRunner tests for new Spark Runner
> -------------------------------------------------
>
> Key: BEAM-8839
> URL: https://issues.apache.org/jira/browse/BEAM-8839
> Project: Beam
> Issue Type: Bug
> Components: runner-spark
> Reporter: Alexey Romanenko
> Priority: Major
>
> Some of the transform translations for new Spark runner (Flatten and Combine
> in particular) fail on several corner cases when ValidatesRunner tests are
> running. These tests were excluded from run for new Spark Runner to keep
> Jenkins job green and detect regression easily (if any) but they have to be
> addressed and correspondent translations have to be fixed.
> List of these tests:
> {code}
>
> 'org.apache.beam.sdk.transforms.CombineFnsTest.testComposedCombineWithContext'
>
> 'org.apache.beam.sdk.transforms.CombineTest$CombineWithContextTests.testSimpleCombineWithContext'
>
> 'org.apache.beam.sdk.transforms.CombineTest$CombineWithContextTests.testSimpleCombineWithContextEmpty'
>
> 'org.apache.beam.sdk.transforms.CombineTest$WindowingTests.testFixedWindowsCombineWithContext'
>
> 'org.apache.beam.sdk.transforms.CombineTest$WindowingTests.testSessionsCombineWithContext'
>
> 'org.apache.beam.sdk.transforms.CombineTest$WindowingTests.testSlidingWindowsCombineWithContext'
> 'org.apache.beam.sdk.transforms.FlattenTest.testEmptyFlattenAsSideInput'
> 'org.apache.beam.sdk.transforms.FlattenTest.testFlattenMultipleCoders'
> 'org.apache.beam.sdk.transforms.FlattenTest.testFlattenPCollectionsEmpty'
>
> 'org.apache.beam.sdk.transforms.FlattenTest.testFlattenPCollectionsEmptyThenParDo'
>
> 'org.apache.beam.sdk.transforms.SplittableDoFnTest.testLifecycleMethodsBounded'
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
