[
https://issues.apache.org/jira/browse/FLINK-32695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Martijn Visser updated FLINK-32695:
-----------------------------------
Description:
We should migrate the tests that still use a legacy SourceFunction to Source
V2, so they no longer block the API removal tracked in FLINK-28045. The
remaining work is split into subtasks, one per PR.
Tests that exercise the legacy machinery itself (SourceFunction, StreamSource,
SourceStreamTask, SourceFunctionProvider) are not migrated. They are deleted
together with the API in the removal PR, once a dev@ discussion has approved
the removal. End-to-end test programs and main-code sources are covered by
FLINK-32694, FLINK-33326, FLINK-37444 and FLINK-37445.
was:
* ProcessingTimeServiceSource in StreamSourceOperatorLatencyMetricsTest
(org.apache.flink.streaming.runtime.operators)
* TestSourceFunction in CommonExecSinkITCase
(org.apache.flink.table.planner.plan.nodes.exec.common)
* CheckpointingNonParallelSourceWithListState in MigrationTestUtils
(org.apache.flink.test.checkpointing.utils)
* NonSerializableTupleSource in StreamingOperatorsITCase
(org.apache.flink.test.streaming.api)
* ImmediatelyFinishingSource in StreamTaskFinalCheckpointsTest
(org.apache.flink.streaming.runtime.tasks)
* SimpleStringGenerator in CheckpointedStreamingProgram
(org.apache.flink.test.classloading.jar)
* TupleSource in StreamingOperatorsITCase (org.apache.flink.test.streaming.api)
* SystemExitSourceFunction in StreamTaskSystemExitTest
(org.apache.flink.streaming.runtime.tasks)
* EmptySource in SourceStreamTaskTest
(org.apache.flink.streaming.runtime.tasks)
* NumberSource in IgnoreInFlightDataITCase
(org.apache.flink.test.checkpointing)
* MyTimestampSource in TimestampITCase
(org.apache.flink.test.streaming.runtime)
* InfiniteTestSource in StreamTaskTimerITCase
(org.apache.flink.test.streaming.runtime)
* SavepointSource in SavepointReaderITTestBase (org.apache.flink.state.api)
* Source in TimersSavepointITCase (org.apache.flink.test.checkpointing)
* MyTimestampSourceInfinite in TimestampITCase
(org.apache.flink.test.streaming.runtime)
* TestSource in WithMasterCheckpointHookConfigTest
(org.apache.flink.streaming.graph)
* MockSourceFunction in StreamTaskTest
(org.apache.flink.streaming.runtime.tasks)
* MyCustomSourceFunction (org.apache.flink.python.util)
* RowSourceFunction in StreamExecutionEnvironmentTest
(org.apache.flink.streaming.api)
* FromRowDataSourceFunction in TestValuesTableFactory
(org.apache.flink.table.planner.factories)
* CancelLockingSource in SourceStreamTaskTest
(org.apache.flink.streaming.runtime.tasks)
* LockStepSourceWithOneWmPerElement in SourceTaskTerminationTest
(org.apache.flink.streaming.runtime.tasks)
* NonStoppingSource in SourceStreamTaskTest
(org.apache.flink.streaming.runtime.tasks)
* FromElementSourceFunctionWithWatermark in TestValuesRuntimeFunctions
(org.apache.flink.table.planner.factories)
* TestSource in InterruptSensitiveRestoreTest
(org.apache.flink.streaming.runtime.tasks)
* SavepointSource in DataSetSavepointReaderITTestBase
(org.apache.flink.state.api)
* FailingCollectionSource (org.apache.flink.table.planner.runtime.utils)
* SessionEventGeneratorDataSource in SessionWindowITCase
(org.apache.flink.test.windowing.sessionwindows)
* Source in BuiltInAggregateFunctionTestBase
(org.apache.flink.table.planner.functions)
* InterruptedSource in SourceStreamTaskTest
(org.apache.flink.streaming.runtime.tasks)
* MyNonWatermarkingSource in TimestampITCase
(org.apache.flink.test.streaming.runtime)
* NormalSource in NotifyCheckpointAbortedITCase
(org.apache.flink.test.checkpointing)
* MaxWatermarkSource (org.apache.flink.state.api.utils)
* TestSource in RestoreUpgradedJobITCase (org.apache.flink.test.checkpointing)
* InfiniteSource in StreamSourceOperatorWatermarksTest
(org.apache.flink.streaming.runtime.operators)
* InfiniteLongSourceFunction in JobCancelingITCase
(org.apache.flink.test.cancelling)
* TestSource in TypeFillTest (org.apache.flink.streaming.api)
* ManuallyClosedSourceFunction in
CoordinatorEventsToStreamOperatorRecipientExactlyOnceITCase
(org.apache.flink.streaming.runtime.tasks)
* GenericSourceFunction in YarnTestCacheJob (org.apache.flink.yarn.testjob)
* MockSource in SourceStreamTaskTest (org.apache.flink.streaming.runtime.tasks)
* DummySource in ReactiveModeITCase (org.apache.flink.test.scheduling)
* —
* Anonymous in testDisablingBufferTimeout() in BufferTimeoutITCase
(org.apache.flink.test.streaming.runtime)
* Anonymous in testWatermarkForwarding() in SideOutputITCase
(org.apache.flink.test.streaming.runtime)
* Anonymous in testCoGroup() in CoGroupJoinITCase
(org.apache.flink.test.streaming.runtime)
* Anonymous in testCoGroup() in CoGroupJoinITCase
(org.apache.flink.test.streaming.runtime)
* Anonymous in testJoin() in CoGroupJoinITCase
(org.apache.flink.test.streaming.runtime)
* Anonymous in testJoin() in CoGroupJoinITCase
(org.apache.flink.test.streaming.runtime)
* Anonymous in testSelfJoin() in CoGroupJoinITCase
(org.apache.flink.test.streaming.runtime)
* Anonymous in testTimestampExtractorWithAutoInterval() in TimestampITCase
(org.apache.flink.test.streaming.runtime)
* Anonymous in testTimestampExtractorWithCustomWatermarkEmit() in
TimestampITCase (org.apache.flink.test.streaming.runtime)
* Anonymous in testTimestampExtractorWithDecreasingCustomWatermarkEmit() in
TimestampITCase (org.apache.flink.test.streaming.runtime)
* Anonymous in testTimestampExtractorWithLongMaxWatermarkFromSource() in
TimestampITCase (org.apache.flink.test.streaming.runtime)
* Anonymous in testTimestampExtractorWithLongMaxWatermarkFromSource2() in
TimestampITCase (org.apache.flink.test.streaming.runtime)
* Anonymous in buildSourceStream() in IntervalJoinITCase
(org.apache.flink.test.streaming.runtime)
* Anonymous in testBoundedUnorderedStreamsStillJoinCorrectly() in
IntervalJoinITCase (org.apache.flink.test.streaming.runtime)
* Anonymous in testBoundedUnorderedStreamsStillJoinCorrectly() in
IntervalJoinITCase (org.apache.flink.test.streaming.runtime)
* Anonymous in emitUntil() in CheckpointStoreITCase
(org.apache.flink.test.checkpointing)
* Anonymous in go() in Anonymous in setUp() in JobManagerMetricsITCase
(org.apache.flink.runtime.metrics)
* Anonymous in testSources() in StreamExecutionEnvironmentTest
(org.apache.flink.streaming.api)
* Anonymous in testParallelismBounds() in StreamExecutionEnvironmentTest
(org.apache.flink.streaming.api)
* Anonymous in getEnvironment() in ChangelogStateBackendLoadingTest
(org.apache.flink.state.changelog)
* Anonymous in getScanRuntimeProvider() in ScanSourceBase in
TableFactoryHarness (org.apache.flink.table.planner.factories)
* Anonymous in doTestPropagationFromCheckpointConfig() in
CheckpointExceptionHandlerConfigurationTest
(org.apache.flink.streaming.runtime.tasks)
* CheckpointedSource in StatefulJobSavepointMigrationITCase
(org.apache.flink.api.scala.migration)
* FiniteTestSource (org.apache.flink.table.planner.runtime.stream)
* CheckpointedSource (org.apache.flink.api.scala.migration)
* EventTimeSourceFunction in TimeTestUtil$
(org.apache.flink.table.planner.runtime.utils)
* in testReduceWindow() in WindowReduceITCase
(org.apache.flink.streaming.api.scala)
* in testReduceWithWindowFunction() in WindowReduceITCase
(org.apache.flink.streaming.api.scala)
* in testReduceWithProcessWindowFunction() in WindowReduceITCase
(org.apache.flink.streaming.api.scala)
* in testReduceAllWindow() in WindowReduceITCase
(org.apache.flink.streaming.api.scala)
* in testReduceAllWithWindowFunction() in WindowReduceITCase
(org.apache.flink.streaming.api.scala)
* in testReduceAllWithProcessWindowFunction() in WindowReduceITCase
(org.apache.flink.streaming.api.scala)
* in testRichWindowFunction() in WindowFunctionITCase
(org.apache.flink.streaming.api.scala)
* in testRichProcessWindowFunction() in WindowFunctionITCase
(org.apache.flink.streaming.api.scala)
* in testRichAllWindowFunction() in WindowFunctionITCase
(org.apache.flink.streaming.api.scala)
* in testRichProcessAllWindowFunction() in WindowFunctionITCase
(org.apache.flink.streaming.api.scala)
* in testCoGroup() in CoGroupJoinITCase (org.apache.flink.streaming.api.scala)
* in testCoGroup() in CoGroupJoinITCase (org.apache.flink.streaming.api.scala)
* in testJoin() in CoGroupJoinITCase (org.apache.flink.streaming.api.scala)
* in testJoin() in CoGroupJoinITCase (org.apache.flink.streaming.api.scala)
* in testSelfJoin() in CoGroupJoinITCase (org.apache.flink.streaming.api.scala)
> Migrate SourceFunction in Tests to Source V2 API
> ------------------------------------------------
>
> Key: FLINK-32695
> URL: https://issues.apache.org/jira/browse/FLINK-32695
> Project: Flink
> Issue Type: Technical Debt
> Components: Connectors / Common
> Reporter: Alexander Fedulov
> Assignee: Poorvank Bhatia
> Priority: Major
> Labels: pull-request-available
>
> We should migrate the tests that still use a legacy SourceFunction to Source
> V2, so they no longer block the API removal tracked in FLINK-28045. The
> remaining work is split into subtasks, one per PR.
> Tests that exercise the legacy machinery itself (SourceFunction,
> StreamSource, SourceStreamTask, SourceFunctionProvider) are not migrated.
> They are deleted together with the API in the removal PR, once a dev@
> discussion has approved the removal. End-to-end test programs and main-code
> sources are covered by FLINK-32694, FLINK-33326, FLINK-37444 and FLINK-37445.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
