[BEAM-807] Replace OldDoFn with DoFn.
Add a custom AssignWindows implementation.
Setup and teardown DoFn.
Add implementation for GroupAlsoByWindow via flatMap.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
This closes #1578
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/44b4eba5
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/44b4eba5
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/release-0.4.0-incubating b2780881a -> 10bb4767a
Revert "Allow stateful DoFn in DataflowRunner"
This reverts commit 42bb15d2df28b99b6788010450f41f2932095771.
The Dataflow service has introduced a bug that was masked by various
test
This closes #1607
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/10bb4767
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/10bb4767
Diff:
Re-exclude UsesStatefulParDo tests for Dataflow
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f78d9606
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/f78d9606
Diff:
This closes #1606
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b742a2c0
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b742a2c0
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master d99eec15d -> b742a2c09
Revert "Allow stateful DoFn in DataflowRunner"
This reverts commit 42bb15d2df28b99b6788010450f41f2932095771.
The Dataflow service has introduced a bug that was masked by various
test disabling.
Project:
This closes #1605
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d99eec15
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d99eec15
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master a5f2df2bd -> d99eec15d
Re-exclude UsesStatefulParDo tests for Dataflow
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/82249abe
Tree:
Repository: incubator-beam
Updated Branches:
refs/heads/release-0.4.0-incubating 9f3b06359 -> b2780881a
[BEAM-1149] Explode windows when fn uses side inputs
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
This closes #1602
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b2780881
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b2780881
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master dad5ba5a6 -> 0bdf7fc04
This closes #1601
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0bdf7fc0
Tree:
[BEAM-1149] Explode windows when fn uses side inputs
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a90c4285
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a90c4285
Diff:
Update Dataflow worker to beam-master-20161212
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d323d5d9
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d323d5d9
Diff:
This closes #1541
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a52600b6
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a52600b6
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 596f255bc -> a52600b68
Move PerKeyCombineFnRunner to runners-core
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/267edaaa
Tree:
Fix version of Kryo in examples/java jenkins-precommit profile
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f32f156a
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/f32f156a
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 2e22a4875 -> 6a89fffe3
Revert 91cc606 "This closes #1586": Kryo + UBRFBS
The above commit was a merge of the following commits to master:
47cc2dc Add Tests for Kryo Serialization of URFBS
3c2e550 Add no-arg constructor for
This closes #1597
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6a89fffe
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/6a89fffe
Diff:
Add IntervalWindow coder to the standard registry
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9678b1cc
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/9678b1cc
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 59f1fb26a -> d9657ffc3
Factor out ShardedFile from FileChecksumMatcher
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/db41940f
Tree:
Revise WindowedWordCount for runner and execution mode portability
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/42595dcd
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/42595dcd
Diff:
This closes #1536
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d9657ffc
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d9657ffc
Diff:
This closes #1579
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/bfd21d72
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/bfd21d72
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 321547fb1 -> bfd21d72f
[BEAM-1133] Add maxNumRecords per micro-batch for Spark runner options.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
[BEAM-1130] SparkRunner ResumeFromCheckpointStreamingTest Failing.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/74b0befb
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/74b0befb
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 05bb254b8 -> 1fab1521a
Fix LateDataDroppingDoFnRunner to not increment the counter on reiteration.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
Repository: incubator-beam
Updated Branches:
refs/heads/master e292032cb -> 409b5dfcf
[BEAM-978] Support bulk get file size in GcsUtil.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/4a12cd30
Tree:
This closes #1359
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/409b5dfc
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/409b5dfc
Diff:
This closes #1555
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/e292032c
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/e292032c
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 0bfa02dd2 -> e292032cb
Fix exclusion of UsesTimersInParDo for FlinkRunner streaming tests
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
This closes #1553
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0bfa02dd
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/0bfa02dd
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 96f9fce78 -> 0bfa02dd2
[BEAM-] Reject timers for ParDo in SparkRunner streaming evaluators
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
Reject timers for ParDo in DirectRunner
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/274f17f0
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/274f17f0
Diff:
Reject timers for ParDo in FlinkRunner
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/69e0ea25
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/69e0ea25
Diff:
Reject timers for ParDo in ApexRunner
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/18db3ace
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/18db3ace
Diff:
Reject timers for ParDo in SparkRunner
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/29f3af30
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/29f3af30
Diff:
No longer reject timers in ParDo
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c22e2a43
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c22e2a43
Diff:
Disable tests for timers in ParDo for Dataflow runner
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5a8f9565
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5a8f9565
Diff:
Disables tests for timers in ParDo for Spark runner
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/320f8881
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/320f8881
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 692905705 -> 96f9fce78
Disable tests for timers in ParDo for Apex runner
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/54c14be1
Tree:
This closes #1550
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/96f9fce7
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/96f9fce7
Diff:
Add basic test for timers in ParDoTest
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/50ffc7be
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/50ffc7be
Diff:
Add JUnit category UsesTimersInParDo
With this, various runners can disable tests for this capability
until they support it.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/96c6a3b4
Tree:
Rename PTransform.apply to PTransform.expand
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/4d607b5a
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/4d607b5a
Diff:
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/4d607b5a/sdks/java/core/src/main/java/org/apache/beam/sdk/io/PubsubIO.java
--
diff --git a/sdks/java/core/src/main/java/org/apache/beam/sdk/io/PubsubIO.java
Move CopyOnAccessStateInternals to runners/direct
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/09e2f309
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/09e2f309
Diff:
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/09e2f309/sdks/java/core/src/test/java/org/apache/beam/sdk/util/state/CopyOnAccessInMemoryStateInternalsTest.java
--
diff --git
Repository: incubator-beam
Updated Branches:
refs/heads/master 6807480a9 -> 772959447
Access to OnTimerContext via DoFnInvokers.ArgumentProvider
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2883062e
This closes #1528
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/77295944
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/77295944
Diff:
Add DoFn.OnTimerContext
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3f8c8076
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/3f8c8076
Diff:
Support OnTimerContext in ByteBuddyDoFnInvokerFactory
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a26ed134
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a26ed134
Diff:
Add OnTimerContext parameter support to DoFnSignature
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/42b506f0
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/42b506f0
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 1526184ae -> ae52ec1bc
Port ParDoTest from OldDoFn to new DoFn
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8e1e46e7
Tree:
Repository: incubator-beam
Updated Branches:
refs/heads/master c72708cd2 -> 5274dce5b
This closes #1523
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5274dce5
Tree:
This closes #1519
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c72708cd
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c72708cd
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/master 9d380de96 -> c72708cd2
Improve ReduceFnRunner prefetching
- add prefetch* methods for prefetching state matching existing methods
- prefetch triggers in processElements
- replace onTimer with batched onTimers method to allow
Repository: incubator-beam
Updated Branches:
refs/heads/master 493c04faa -> b29bb1b80
BEAM-651: Rename setTypeDescriptorInternal to setTypeDescriptor
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
Improve Splittable DoFn
Makes Splittable DoFn be more like a real DoFn:
- Adds support for side inputs and outputs to SDF
- Teaches `ProcessFn` to work with exploded windows inside the
`KeyedWorkItem`. It works with them by un-exploding the windows
in the `Iterable` into a
Revert "Move resource filtering later to avoid spurious rebuilds"
This reverts commit 2422365719c71cade97e1e74f1fb7f42b264244f.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b36048bd
Tree:
This closes #1484
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/63491bf2
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/63491bf2
Diff:
Reduce the visibility of TransformHierarchy Node Mutators
These mutators should not be accessible when visiting the nodes.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7c5c7910
Tree:
Autogenerate examples archetype during build
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/abd96b89
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/abd96b89
Diff:
Migrate TransformTreeNode to an Inner Class
TransformTreeNode requires access to the hierarchy it is contained
within, and generally cannot be separated from TransformHierarchy. It is
primarily an implementation detail of TransformHierarchy, so can be
relocated to within it.
Project:
travis.yml: disable skipping things that no longer run
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d6eb5143
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d6eb5143
Diff:
This closes #1469
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/48130f71
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/48130f71
Diff:
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/d9891234/sdks/java/core/src/test/java/org/apache/beam/sdk/testing/PaneExtractorsTest.java
--
diff --git
This closes #1507
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/88de0cb2
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/88de0cb2
Diff:
Closes #1480
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/fd4b631f
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/fd4b631f
Diff:
This closes #1344
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c22b97dd
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c22b97dd
Diff:
BEAM-1078: Changing the links from GCP to incubator-beam in the project
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5a997a1a
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5a997a1a
This closes #1461
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/26eb4354
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/26eb4354
Diff:
Closes #1488
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7ad78779
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7ad78779
Diff:
Closes #1489
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/e04cd47d
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/e04cd47d
Diff:
[BEAM-79] fix gearpump runner build failure
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2afc0cd9
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2afc0cd9
Diff:
This closes #1486
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c0c58022
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c0c58022
Diff:
BEAM-879: Changing DeDupExample to DistinctExample
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/e3dca4ca
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/e3dca4ca
Diff:
This closes #1487
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1abbb900
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/1abbb900
Diff:
[BEAM-1057] Fix JDBC test derby startup issues
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/58916b94
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/58916b94
Diff:
Merge remote-tracking branch 'upstream/master' into gearpump-runner-sync
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/86414c08
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/86414c08
Removes DoFnTester.of(OldDoFn)
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/86173a83
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/86173a83
Diff:
Makes DoFnTester use new DoFn internally.
There were 2 remaining users of DoFnTester.of(OldDoFn):
- SplittableParDo.ProcessElements: this is fixed in
https://github.com/apache/incubator-beam/pull/1261
- GroupAlsoByWindowsProperties: this one is harder.
Various GABWDoFn's use
Move Towards removing WindowedValue from SDK
- Introduces ValueInSingleWindow for purposes of PAssert
- Uses ValueInSingleWindow inside DoFnTester
- Moves WindowMatchers{,Test} to runners-core
After this commit, WindowedValue does not appear in any SDK APIs
used by Pipeline authors.
Project:
Add TextIO.Write support for runtime-valued output prefix
* Updates to TextIO
* Updates for FileBasedSink to support this change
* Updates to other FileBasedSinks that do not yet support
runtime values but need to be aware that values are now
ValueProvider instead of String
Project:
BEAM-1083: Removing the link for the DatastoreWordCount in the README
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8f712fd6
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8f712fd6
Diff:
Supports window parameter in DoFnTester
Also prohibits other parameters, and prohibits output from bundle
methods (whereas previously it was silently dropped).
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
Category for tests using splittable DoFn
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/887b357f
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/887b357f
Diff:
Stop using Maps of Transforms in the DirectRunner
Instead, add a "DirectGraph" class, which adds a layer of indirection to
all lookup methods.
Remove all remaining uses of getProducingTransformInternal, and instead
use DirectGraph methods to obtain the producing transform.
Project:
Rename ConsumerTrackingPipelineVisitor to DirectGraphVisitor
Reduce visibility of Visitor.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/662416a4
Tree:
Initial commit of jobs
Signed-off-by: Jason Kuster
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ad9ca455
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/ad9ca455
Create java8-examples archetype module
This archetype module is automatically generated during
the build process, and its dependencies and tests verified.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
This closes #1390
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8a7919b5
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/8a7919b5
Diff:
Add timerId to TimerData
This timerId is generated to be identical to historical behavior, and
to be unique per time domain and timestamp.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/840fb3b9
Tree:
Closes #1482
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0fb56106
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/0fb56106
Diff:
Closes #1483
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f70fc409
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/f70fc409
Diff:
[BEAM-1078] Closes #1498
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a13024c4
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a13024c4
Diff:
Explicitly Throw in TransformExecutorTest
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b4ee8b73
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b4ee8b73
Diff:
Add a test of ReleaseInfo
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1094fa6a
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/1094fa6a
Diff:
Remove global default execution of exec-maven-plugin
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6489b6db
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/6489b6db
Diff:
Fix pom syntax for excludedGroups for SplittableParDo
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ffa81edd
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/ffa81edd
Diff:
201 - 300 of 1254 matches
Mail list logo