This is an automated email from the ASF dual-hosted git repository.
jbonofre pushed a change to branch dsl-euphoria
in repository https://gitbox.apache.org/repos/asf/beam.git.
from eff3ffd Merge pull request #5366 from dmvk/BEAM-3902
add 2a34cad [BEAM-3900] Allow for Beam windowing to be set through
Euphoria API.
add ef228ff [BEAM-3900] Missing licence header added.
add 3838e7b [BEAM-4294] Join translator empty shell added.
add 7ceefea [BEAM-4294] Crude Join operator translation implemented.
Still work in progress.
add 7331ddd [BEAM-4294] Inner join translation implemented.
add 8ccfba5 [BEAM-4294] Left, right and full joins implemeted.
add 4edd3f4 [BEAM-4294] BeamOperatorsSuite now includes tests of Join
operator. Application of windowing in JoinTranslator fixed.
add 0df6b55 [BEAM-4360] ReduceStateByKey tests adaptation to beam. - Work
in progress.
add a2a355a [BEAM-4360] Most tests are passing. Some are still ignored
mostly due to yet unsupported features.
add aa658aa [BEAM-4294] [BEAM-4360] Join translation and ReduceByKey test
suite where moved to org.apache.beam.* package. Small imports fixes after
rebase to seznam/beam eff3ffd5d224c6628606b355e3a5b6d8bc40150b.
add fee7abe [BEAM-4294] [BEAM-4360] Checkstyle warning fixes.
add a67b9c8 [BEAM-4394] Pull request review fixes.
add 77df99d [BEAM-4294] [BEAM-4360] Pull request review fixes.
OperatorTranslator extended to allow more than one translator per operator.
add 99061eb [BEAM-4294] [BEAM-4360] Circular dependency fix.
add 8fdd427 [BEAM-4294] [BEAM-4360] Missing licenses added.
add 4826847 [BEAM-4294] [BEAM-4360] Fix of local executor module compile
error.
add 939a104 [BEAM-4294] [BEAM-4360] Rollback of BEAM-3256 add archetype
testing to gradle build PreCommits.
new e282336 Merge pull request #5447 from seznam/dsl-euphoria
The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
.../job_beam_PreCommit_Java_GradleBuild.groovy | 2 -
build.gradle | 2 -
.../extensions/euphoria/euphoria-beam/build.gradle | 2 -
.../extensions/euphoria/beam/FlowTranslator.java | 51 ++-
.../extensions/euphoria/beam/JoinTranslator.java | 142 +++++++++
.../euphoria/beam/OperatorTranslator.java | 12 +-
.../euphoria/beam/ReduceByKeyTranslator.java | 39 +--
.../euphoria/beam/ReduceStateByKeyTranslator.java | 2 +-
.../euphoria/beam/common/InputToKvDoFn.java} | 22 +-
.../euphoria/beam/common}/package-info.java | 4 +-
.../extensions/euphoria/beam/join/FullJoinFn.java | 71 +++++
.../extensions/euphoria/beam/join/InnerJoinFn.java | 59 ++++
.../sdk/extensions/euphoria/beam/join/JoinFn.java | 69 ++++
.../euphoria/beam/join/LeftOuterJoinFn.java | 65 ++++
.../euphoria/beam/join/RightOuterJoinFn.java | 62 ++++
.../euphoria/beam/join}/package-info.java | 5 +-
.../euphoria/beam/window/BeamWindowing.java | 77 +++++
.../euphoria/beam/window/UnsupportedWindow.java} | 35 +-
.../euphoria/beam/window/WindowingUtils.java | 75 +++++
.../sdk/extensions/euphoria/beam/JoinTest.java | 216 +++++++++++++
.../extensions/euphoria/beam/ReduceByKeyTest.java | 36 ++-
.../sdk/extensions/euphoria/beam/TestUtils.java} | 16 +-
.../euphoria/beam/testkit/BeamOperatorsTest.java | 25 --
.../executor/local/testkit/LocalOperatorTest.java | 6 +-
.../euphoria-operator-testkit/build.gradle | 8 +-
.../euphoria/operator/test/AllOperatorsSuite.java | 44 ---
.../euphoria/operator/test/JoinTest.java | 175 +++++++---
.../euphoria/operator/test/ReduceByKeyTest.java | 353 ++++++++++++++++-----
.../operator/test/suite/OperatorsTestSuite.java} | 16 +-
.../operator/test/suite}/package-info.java | 4 +-
.../operator/test}/BeamExecutorProvider.java | 3 +-
.../euphoria/operator/test/OperatorsTest.java} | 10 +-
sdks/java/maven-archetypes/examples/build.gradle | 11 -
sdks/java/maven-archetypes/starter/build.gradle | 11 -
34 files changed, 1417 insertions(+), 313 deletions(-)
create mode 100644
sdks/java/extensions/euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/JoinTranslator.java
copy
sdks/java/extensions/{sql/src/main/java/org/apache/beam/sdk/extensions/sql/impl/transform/BeamSqlOutputToConsoleFn.java
=>
euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/common/InputToKvDoFn.java}
(59%)
copy
{runners/apex/src/main/java/org/apache/beam/runners/apex/translation/operators
=>
sdks/java/extensions/euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/common}/package-info.java
(87%)
create mode 100644
sdks/java/extensions/euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/join/FullJoinFn.java
create mode 100644
sdks/java/extensions/euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/join/InnerJoinFn.java
create mode 100644
sdks/java/extensions/euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/join/JoinFn.java
create mode 100644
sdks/java/extensions/euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/join/LeftOuterJoinFn.java
create mode 100644
sdks/java/extensions/euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/join/RightOuterJoinFn.java
copy
{runners/apex/src/main/java/org/apache/beam/runners/apex/translation/operators
=>
sdks/java/extensions/euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/join}/package-info.java
(82%)
create mode 100644
sdks/java/extensions/euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/window/BeamWindowing.java
copy
sdks/java/extensions/euphoria/{euphoria-operator-testkit/src/main/java/org/apache/beam/sdk/extensions/euphoria/operator/test/IntWindow.java
=>
euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/window/UnsupportedWindow.java}
(63%)
create mode 100644
sdks/java/extensions/euphoria/euphoria-beam/src/main/java/org/apache/beam/sdk/extensions/euphoria/beam/window/WindowingUtils.java
create mode 100644
sdks/java/extensions/euphoria/euphoria-beam/src/test/java/org/apache/beam/sdk/extensions/euphoria/beam/JoinTest.java
copy
sdks/java/extensions/euphoria/euphoria-beam/src/{main/java/org/apache/beam/sdk/extensions/euphoria/beam/package-info.java
=> test/java/org/apache/beam/sdk/extensions/euphoria/beam/TestUtils.java} (64%)
delete mode 100644
sdks/java/extensions/euphoria/euphoria-beam/src/test/java/org/apache/beam/sdk/extensions/euphoria/beam/testkit/BeamOperatorsTest.java
delete mode 100644
sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/org/apache/beam/sdk/extensions/euphoria/operator/test/AllOperatorsSuite.java
rename
sdks/java/extensions/euphoria/{euphoria-beam/src/test/java/org/apache/beam/sdk/extensions/euphoria/beam/testkit/BeamOperatorsSuite.java
=>
euphoria-operator-testkit/src/main/java/org/apache/beam/sdk/extensions/euphoria/operator/test/suite/OperatorsTestSuite.java}
(78%)
copy
{runners/gearpump/src/main/java/org/apache/beam/runners/gearpump/translators/utils
=>
sdks/java/extensions/euphoria/euphoria-operator-testkit/src/main/java/org/apache/beam/sdk/extensions/euphoria/operator/test/suite}/package-info.java
(89%)
rename
sdks/java/extensions/euphoria/{euphoria-beam/src/test/java/org/apache/beam/sdk/extensions/euphoria/beam/testkit
=>
euphoria-operator-testkit/src/test/java/org/apache/beam/sdk/extensions/euphoria/operator/test}/BeamExecutorProvider.java
(96%)
copy
sdks/java/extensions/euphoria/euphoria-operator-testkit/src/{main/java/org/apache/beam/sdk/extensions/euphoria/operator/test/package-info.java
=>
test/java/org/apache/beam/sdk/extensions/euphoria/operator/test/OperatorsTest.java}
(79%)
--
To stop receiving notification emails like this one, please contact
[email protected].
