Remove checked exceptions from PipelineResult.waitUntilFinish interface.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1559a7f4
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/1559a7f4
Diff
update parent pom version in python/pom.xml
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/654b848b
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/654b848b
Diff: http://git-wip-us.apache.or
Closes #1160
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/48fdd067
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/48fdd067
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff
Merge branch 'master' into py_merge_master
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/02b5b4c9
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/02b5b4c9
Diff: http://git-wip-us.apache.org
Display data: minor cleanups
* wrong @Nullable
* Remove unused function
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d2553500
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d2553500
Diff
Remove use of OldDoFn in ValueWithRecordId
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/40513578
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/40513578
Diff: http://git-wip-us.apache.org
pom.xml: make Dataflow runner like every other runner
Pom dependencies no longer require it to be treated specially.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6291a6f6
Tree: http://git-wip-us.apache.or
Add timestamps to maven output on Travis CI
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7f82a573
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7f82a573
Diff: http://git-wip-us.apache.or
This closes #1162
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/53fe3ee4
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/53fe3ee4
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam
[BEAM-816] Aggregators are not properly named when reported to Graphite.
Added NamedAggregatorTest.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6db94249
Tree: http://git-wip-us.apache.org/repos/asf/incub
This closes #1095
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f603d43e
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/f603d43e
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam
[BEAM-658] Support Read.Unbounded primitive.
Changed mapSourceFunction to use scala's native Option.
Upgrade to kryo-serializers 0.39 that provides support for ReverseList (used by
Top).
Better logging.
Allow a longer read time-frame for read in tests.
Assert initial parallelism is gerater th
Use project-wise version in SparkRunner dep on KafkaIO
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9d6598d3
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/9d6598d3
Diff: http://git-wip-u
Add default version for beam-sdks-java-io-kafka
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c8895338
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c8895338
Diff: http://git-wip-us.apach
Remove OldDoFn to DoFn in DirectRunner
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/28720191
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/28720191
Diff: http://git-wip-us.apache.org/rep
This closes #1163
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7abdcbfb
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7abdcbfb
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam
Update DataflowRunner worker image
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/90c30cba
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/90c30cba
Diff: http://git-wip-us.apache.org/repos/a
Add experimental ServiceAccount option
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/60907b21
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/60907b21
Diff: http://git-wip-us.apache.org/rep
Closes #1135
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d285e85d
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d285e85d
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff
This closes #1158
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0ec956d3
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/0ec956d3
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam
Encode bundle elements in the DirectRunner
This ensures that any changes that are caused when an element is encoded
and decoded is caught within the pipeline.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/
This closes #1195
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f9e07cfb
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/f9e07cfb
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam
Closes #1180
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7091a012
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7091a012
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff
Closes #1175
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7de8d571
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7de8d571
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff
Remove pieces of Trigger now owned by TriggerStateMachine
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1eff320d
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/1eff320d
Diff: http://git-wi
Closes #1105
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c94b8eac
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c94b8eac
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff
This closes #1185
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9f30b21a
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/9f30b21a
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam
Closes #1182
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f2fe1ae4
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/f2fe1ae4
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff
This closes #1143
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/dc61a001
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/dc61a001
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam
Closes #1181
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/09a80ecb
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/09a80ecb
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff
Remove unused GroupAlsoByWindowsDoFn.createDefault
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5ce3aac2
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5ce3aac2
Diff: http://git-wip-us.ap
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/1eff320d/sdks/java/core/src/main/java/org/apache/beam/sdk/util/TriggerContextFactory.java
--
diff --git
a/sdks/java/core/src/main/java/org/apache/beam/sdk/util/TriggerCont
Set up Maven settings globally for Travis CI builds
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3af2c1e7
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/3af2c1e7
Diff: http://git-wip-us.a
Add utility to handle JSON option manipulation
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/35244a68
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/35244a68
Diff: http://git-wip-us.apache
This closes #1173
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/25102f79
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/25102f79
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam
[BEAM-799] Support GroupByKey directly.
Remove runner override for GroupByKey.
Avoid NPE if no sideInputs are available in reader.
Handle CombineFn with or without context.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incuba
Revert "Fix invalid snapshot repo in Travis CI's maven settings.xml"
This reverts commit fbc23ed9234088c9d88bf88b19a3a4d6d5e52446.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3c71e4da
Tree: http://git-wi
This closes #1174
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c03e3e92
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c03e3e92
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam
Streamline Travis CI build
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5c558e6f
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5c558e6f
Diff: http://git-wip-us.apache.org/repos/asf/incub
[BEAM-813] support metadata in Avro sink
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/eba099f5
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/eba099f5
Diff: http://git-wip-us.apache.org/r
This closes #1178
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/13af296d
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/13af296d
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam
Improve teardown behavior in DoFnLifecycleManager
Use Cache invalidation hooks to teardown DoFns that are no longer in the
cache. Ensure that remove() and removeAll() report thrown exceptions
even though the exceptions are not thrown by the LoadingCache.
Project: http://git-wip-us.apache.org/rep
This closes #1171
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/78e2c038
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/78e2c038
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam
[BEAM-809] Create a KryoRegistrator for the SparkRunner.
Use Class#getName() instead of canonicalName().
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/13b83858
Tree: http://git-wip-us.apache.org/repos/asf/
Remove use of OldDoFn from some DirectRunner tests
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3d086857
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/3d086857
Diff: http://git-wip-us.ap
Adding documentation. Setting Python classes as STRING types.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/bfcff012
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/bfcff012
Diff: http://gi
Laying down infrastructure for static display data
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/07885c86
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/07885c86
Diff: http://git-wip-us.ap
Adding license text to all files. Fixing one lint issue. Refactoring runner_test
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/11022016
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/11022
Moving files. Using DisplayDataItem to enable dictionaries to be used as
display data
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d864d968
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree
Closes #1112
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/03662da9
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/03662da9
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 57f03f793 -> 03662da9d
Addressing comments
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1d478dd4
Tree: http://git-wip-us.apache.org/re
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/1211
Compare display data items, not dicts.
R: @pabloem
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/robertwb/incubator-beam display
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 03662da9d -> 811858bca
Closes #1209
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/811858bc
Tree: http://git-wip-us.apache.org/repos/asf
Removing superfluous TODO after unittest is passing
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/595bd0d5
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/595bd0d5
Diff: http://git-wip-us.a
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/1223
Adds IterableCoder, fast coding for sets, booleans.
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/1224
Estimate sizes
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like:
`[BEAM
Github user robertwb closed the pull request at:
https://github.com/apache/incubator-beam/pull/1211
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 811858bca -> 00b17e542
Compare display data items, not dicts.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9d1cfa1a
Tree: http://git-w
Closes #1211
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/00b17e54
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/00b17e54
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff
Closes #1200
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ef01140d
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/ef01140d
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff
Pushing check down. Rewritting error message
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/32f3214c
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/32f3214c
Diff: http://git-wip-us.apache.o
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 00b17e542 -> ef01140d6
Improving error of missing sdk_location
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a68c2461
Tree: http://git-
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk ef01140d6 -> 03c3c7074
Closes #1223
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/03c3c707
Tree: http://git-wip-us.apache.org/repos/asf
Adds IterableCoder, fast coding for sets, booleans.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9dd16455
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/9dd16455
Diff: http://git-wip-us.a
Github user robertwb closed the pull request at:
https://github.com/apache/incubator-beam/pull/1223
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the
Several fixes to coder size estimates.
The coder returned in alongside the observable must be the coder
of the observable's elements, not the coder of the observable
itself.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubat
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 03c3c7074 -> 979e299c7
Implement size observation for FastPrimitivesCoderImpl.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/fba0e91b
T
Closes #1224
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/979e299c
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/979e299c
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff
Github user robertwb closed the pull request at:
https://github.com/apache/incubator-beam/pull/1224
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/1241
Windowed value coder
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like
Closes #1241
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/13dd9ff4
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/13dd9ff4
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff
ks/python/apache_beam/transforms/timeutil.py
index 749cda1..5453b20 100644
--- a/sdks/python/apache_beam/transforms/timeutil.py
+++ b/sdks/python/apache_beam/transforms/timeutil.py
@@ -22,14 +22,16 @@ from __future__ import absolute_import
from abc import ABCMeta
from abc import abstractmethod
-imp
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 979e299c7 -> 13dd9ff49
Move Timestamp and related classes into apache_beam/utils.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/8fd651f
Improvements related to size estimation.
Updates FileBasedSource so that size estimation of glob patterns that expand
into a large number of files is done using sampling.
Updates Dataflow runner to set estimated sizes of sources when submitting jobs.
Project: http://git-wip-us.apache.org/repos
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 13dd9ff49 -> b33fdfdad
Closes #1235
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b33fdfda
Tree: http://git-wip-us.apache.org/repos/asf
Github user robertwb closed the pull request at:
https://github.com/apache/incubator-beam/pull/1241
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/1244
Fix a couple more coder vs. element-coder changes for element sizing.
Be sure to do all of the following to help us incorporate your contribution
quickly and easily
Closes #1244
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7e870613
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7e870613
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff
2,6 +152,14 @@ class CallbackCoderImpl(CoderImpl):
def estimate_size(self, value, nested=False):
return self._get_nested_size(self._size_estimator(value), nested)
+ def get_estimated_size_and_observables(self, value, nested=False):
+# TODO(robertwb): Remove this once all coders are corr
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/1253
Optimize WindowedValueCoder
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 7e870613f -> 9d2acc98e
Fixes two bugs in avroio_test 'test_corrupted_file'.
(1) Updates test to perform corruption properly (setting 'A' and 'B').
(2) Removes an invalid usage of bytearray().
Project: http://git-wip-us.apache
Closes #1267
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9d2acc98
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/9d2acc98
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff
Add unittests for BQ 2.0
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ce3f1726
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/ce3f1726
Diff: http://git-wip-us.apache.org/repos/asf/incubat
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 7270471bf -> 96c228675
Closes #1242
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/96c22867
Tree: http://git-wip-us.apache.org/repos/asf
BEAM-873 Support for BigQuery 2 SQL
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/0a339653
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/0a339653
Diff: http://git-wip-us.apache.org/repos/
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 9d2acc98e -> 7270471bf
Updated readme according to BEAM-693
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/43740a47
Tree: http://git-wip
Closes #1245
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7270471b
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7270471b
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/1274
Implement key range tracker.
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 96c228675 -> a6e104d6d
Checking for integer types in json conversion
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3321064e
Tree: http:
Closes #1273
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a6e104d6
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a6e104d6
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff
Adding unit tests
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b30208be
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b30208be
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam
Document the input and output of type conversions
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/456f9263
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/456f9263
Diff: http://git-wip-us.apa
Make the BQ input for dataflow runner and local runner is identical for time
related types
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d66cb174
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk a6e104d6d -> 32d719911
Closes #1250
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/32d71991
Tree: http://git-wip-us.apache.org/repos/asf
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/1286
Don't default to PickleCoder for sources.
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR tit
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 32d719911 -> 4bf848511
Add support for proto coder
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/e1e4b7ce
Tree: http://git-wip-us.apach
DeterministicCoder rename
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5d14b080
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5d14b080
Diff: http://git-wip-us.apache.org/repos/asf/incuba
Closes #1237
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/4bf84851
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/4bf84851
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff
Fix cythonization
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ef7e9727
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/ef7e9727
Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam
y(object):
# In some old code, None is used for Any.
# TODO(robertwb): Clean this up.
pass
+ elif typehint is object:
+# We explicitly want the fallback coder.
+pass
elif isinstance(typehint, typehints.TypeVariable):
# TODO(robertwb
301 - 400 of 517 matches
Mail list logo