This is an automated email from the ASF dual-hosted git repository.
echauchot pushed a change to branch spark-runner_structured-streaming
in repository https://gitbox.apache.org/repos/asf/beam.git.
from f5fd012 Fix errorprone
new f19721f Fix testMode output to comply with new binary schema
new ca88d54 Cleaning
new 7bb1945 Remove bundleSize parameter and always use spark default
parallelism
new 707470b Fix split bug
The 4 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../structuredstreaming/SparkPipelineOptions.java | 10 --
.../spark/structuredstreaming/SparkRunner.java | 4 +-
.../translation/PipelineTranslator.java | 4 +-
.../translation/TranslationContext.java | 7 +-
.../translation/batch/DatasetSourceBatch.java | 9 +-
.../translation/batch/PipelineTranslatorBatch.java | 5 +-
.../translation/batch/TranslationContextBatch.java | 40 -------
.../batch/mocks/DatasetSourceMockBatch.java | 94 ---------------
.../batch/mocks/ReadSourceTranslatorMockBatch.java | 62 ----------
.../translation/batch/mocks/package-info.java | 20 ----
.../streaming/DatasetSourceStreaming.java | 133 +++------------------
...lator.java => PipelineTranslatorStreaming.java} | 6 +-
.../streaming/StreamingTranslationContext.java | 29 -----
13 files changed, 35 insertions(+), 388 deletions(-)
delete mode 100644
runners/spark-structured-streaming/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/TranslationContextBatch.java
delete mode 100644
runners/spark-structured-streaming/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/mocks/DatasetSourceMockBatch.java
delete mode 100644
runners/spark-structured-streaming/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/mocks/ReadSourceTranslatorMockBatch.java
delete mode 100644
runners/spark-structured-streaming/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/batch/mocks/package-info.java
rename
runners/spark-structured-streaming/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/streaming/{StreamingPipelineTranslator.java
=> PipelineTranslatorStreaming.java} (87%)
delete mode 100644
runners/spark-structured-streaming/src/main/java/org/apache/beam/runners/spark/structuredstreaming/translation/streaming/StreamingTranslationContext.java
