Repository: incubator-beam-site
Updated Branches:
refs/heads/asf-site 87d9a07fe -> edd0705b8
Remove duplicate paragraph.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo
Commit:
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/edd0705b
Tree:
Repository: incubator-beam-site
Updated Branches:
refs/heads/asf-site edd0705b8 -> 0c5c6471b
Fix blog post typo.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam-site/repo
Commit:
http://git-wip-us.apache.org/repos/asf/incubator-beam-site/commit/0c5c6471
Tree:
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/88
Optimize the Count CombineFn
Previously the accumulator was stored as a Long. This uses
a singleton long[] to avoid the boxing and unboxing on every
increment
Update docstring.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/76f3864b
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/76f3864b
Diff:
Closes #730
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/26ff6579
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/26ff6579
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 153916fe9 -> 26ff65795
Fix SDK name and version sent to the Cloud Dataflow service
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 95a591e05 -> 67a769a9a
Made checksum_output optional in bigshuffle.py.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2b782ded
Tree:
Closes #625
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/67a769a9
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/67a769a9
Diff:
Closes #641
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/e8c39c79
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/e8c39c79
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 67a769a9a -> e8c39c798
Add type hints to bigshuffle to avoid pickle overhead.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f858ea93
Fix typo in Dataflow runner monitoring message
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ffbaccaa
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/ffbaccaa
Diff:
Closes #652
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2b9d81fc
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2b9d81fc
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 52c0d893e -> 2b9d81fcc
Added cy_combiners.py to the list of Cythonized Python SDK files.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
Github user robertwb closed the pull request at:
https://github.com/apache/incubator-beam/pull/641
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk e8c39c798 -> 52c0d893e
Closes #644
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/52c0d893
Tree:
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 2b9d81fcc -> 7c0c27ac0
Temporarily reverting pickler changes (@4e2d8ab).
It is causing infinite recursion when some tests are directly
invoked outside the testing framework.
Added one such test to tox tests for testing
Closes #645
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7c0c27ac
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/7c0c27ac
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 7c0c27ac0 -> 762a2930a
DoOutputsTuple cleanup
This avoids the same (logical) PCollection from being re-created
with a different producer.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
Closes #658
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/762a2930
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/762a2930
Diff:
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/658
DoOutputsTuple cleanup
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/657
Accept runners by fully qualified name.
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title
Closes #657
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3b695068
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/3b695068
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 762a2930a -> 3b6950689
Accept runners by fully qualified name.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/84fe8954
Tree:
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 3b6950689 -> c8cef2cba
Closes #653
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c8cef2cb
Tree:
Fix min and max timestamp on 32-bit machines
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/afc68bc3
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/afc68bc3
Diff:
;""Test for the autocomplete example."""
-import collections
import unittest
-
import apache_beam as beam
from apache_beam.examples.complete import autocomplete
-from apache_beam.pvalue import AsIter
-
-# TODO(robertwb): Move to testing utilities.
-
-
-def ass
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/706
Simple DoFnRunner optimizatons.
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like
Allow passing logging context directly.
This is better than passing a logger module with a specific class.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/de35f282
Tree:
Closes #721
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/153916fe
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/153916fe
Diff:
Github user robertwb closed the pull request at:
https://github.com/apache/incubator-beam/pull/721
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/741
Top improvements
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like:
`[BEAM
Closes #726
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/53ab635c
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/53ab635c
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 26ff65795 -> 53ab635c7
Make TextFileReader observable
This allows future implementation of size tracking for elements in side input
sources.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
Closes #741
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b4716d9d
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b4716d9d
Diff:
ing).
- compare_by_id = {}
-
- def __init__(self, n, compare, _compare_id=None): # pylint:
disable=invalid-name
+ # TODO(robertwb): Allow taking a key rather than a compare.
+ def __init__(self, n, compare):
self._n = n
+self._buffer_size = min(2 * n, n + 1000)
self._com
elf.windowing, True)
- state = InMemoryUnmergedState()
+ self.driver = create_trigger_driver(self.windowing, True)
+ self.state_type = InMemoryUnmergedState
+
+def process(self, context):
+ k, vs = context.element
+ state = self.state_type()
# TODO(robertwb): Condit
Github user robertwb closed the pull request at:
https://github.com/apache/incubator-beam/pull/748
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user robertwb closed the pull request at:
https://github.com/apache/incubator-beam/pull/741
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Closes #748
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/351c3831
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/351c3831
Diff:
Fix multi-input named PTransforms.
Now delegate the __ror__ logic entirely for the naming wrapper.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/937cf69e
Tree:
Final cleanup pass.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/e3c078fe
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/e3c078fe
Diff:
Fix label-sensitive test.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2a59a121
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2a59a121
Diff:
Fixes examples
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2ff5630b
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2ff5630b
Diff:
Lint fixes.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b15d35ca
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b15d35ca
Diff:
Move names out of transform constructors.
sed -i -r 's/[|] (\S+)[(](["'"'"'][^"'"'"']+.)(, +|([)]))/| \2 >> \1(\4/g'
Small number of tests will need to be fixed by hand.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
Make save_main_session optional
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2e36602c
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2e36602c
Diff:
Closes #723
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/9fe102a5
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/9fe102a5
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 47042ce89 -> 9fe102a5c
Refactor setup.py to separate strings/versions
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/af6d3804
Tree:
Refactor examples to use save_main_session
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3d64a8c5
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/3d64a8c5
Diff:
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/031c4cce/sdks/python/apache_beam/transforms/combiners_test.py
--
diff --git a/sdks/python/apache_beam/transforms/combiners_test.py
fixup: failing tests expecting name
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c5b5b14d
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c5b5b14d
Diff:
Closes #718
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/38d9dea2
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/38d9dea2
Diff:
Cleanup and fix combiners_test.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/01830510
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/01830510
Diff:
Github user robertwb closed the pull request at:
https://github.com/apache/incubator-beam/pull/718
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/705
Minor cdef value changes.
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/721
Make DoFnRunner a Receiver.
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like
Github user robertwb closed the pull request at:
https://github.com/apache/incubator-beam/pull/705
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user robertwb closed the pull request at:
https://github.com/apache/incubator-beam/pull/702
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Add tests for WindowedValue.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/441fad31
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/441fad31
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk e5006991d -> 09b4daf23
Closes #702
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/09b4daf2
Tree:
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 37f426faf -> d78b38d1d
Remove expensive per-element-step logging context.
This is 3-4% of the total runtime.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
/apache_beam/runners/common.pxd
index f01a362..7191659 100644
--- a/sdks/python/apache_beam/runners/common.pxd
+++ b/sdks/python/apache_beam/runners/common.pxd
@@ -27,7 +27,7 @@ cdef class DoFnRunner(object):
cdef object window_fn
cdef object context # TODO(robertwb): Make this a DoFnContext
Closes #706
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d78b38d1
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/d78b38d1
Diff:
cdef object window_fn
cdef object context # TODO(robertwb): Make this a DoFnContext
cdef object tagged_receivers
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/7c9d77ac/sdks/python/apache_beam/runners/common.py
-
Closes #705
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/e5006991
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/e5006991
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk d78b38d1d -> e5006991d
Minor cdef value changes.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/19082adb
Tree:
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/708
Revert "Restore (faster) logging context."
This fixes the jenkins build that relies on not-yet-pushed dataflow changes.
---
This reve
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 351c3831d -> c155ef0eb
Increased the GCS buffer size from 1MB to 8MB and introduced a 128kB buffer for
the pipe.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit:
Closes #752
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c155ef0e
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c155ef0e
Diff:
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/748
Optimize Map and Flatmap when there are no side inputs.
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/770
Implement add_input for all CombineFns.
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk e834fa82b -> 65152cab8
Implement add_input for all CombineFns.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3ebf28c6
Tree:
Document TupleCombineFns
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/4a2239d3
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/4a2239d3
Diff:
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/702
Add tests for WindowedValue.
I just realized I forgot to add this file when doing #691 .
You can merge this pull request into a Git repository by running:
$ git pull https
Closes #694
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/22126285
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/22126285
Diff:
mon.py
index 059359c..ef28c63 100644
--- a/sdks/python/apache_beam/runners/common.py
+++ b/sdks/python/apache_beam/runners/common.py
@@ -190,6 +190,7 @@ class DoFnState(object):
self.step_name, aggregator)
+# TODO(robertwb): Replace core.DoFnContext with this.
class DoFnContext(objec
type(left) is not type(right):
+ return cmp(type(left), type(right))
+else:
+ # Don't bother paying the cost of a total ordering.
+ # TODO(robertwb): Avoid the type checks?
+ return not WindowedValue._typed_eq(left, right)
+
+ @staticmethod
+ def _typed_eq(left, right):
+
dValue
+from apache_beam.utils.windowed_value cimport WindowedValue
+
+cdef type SideOutputValue, TimestampedValue
+
cdef class DoFnRunner(object):
cdef object dofn
cdef object window_fn
- cdef object context
+ cdef object context # TODO(robertwb): Make this a DoFnContext
cdef object tagg
Reduce the number of elements in the pvalue caching test.
It seems this test is causing travis-ci to time out,
as the non-compiled version got slightly slower.
100,000 elements should be sufficient to see the effects
of not caching.
Project:
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk a643e2009 -> 37f426faf
Closes #691
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/37f426fa
Tree:
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/676
Remove pipeline.apply(pvalue, callable)
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/679
Add >> operator for labeling PTransforms.
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR
Closes #683
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/062af66f
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/062af66f
Diff:
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 561090580 -> 062af66f8
Fix comment.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/fdab1f94
Tree:
Remove pipeline.apply(pvalue, callable)
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/e68eb05e
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/e68eb05e
Diff:
alue.py
index 6fc3041..063d0b5 100644
--- a/sdks/python/apache_beam/pvalue.py
+++ b/sdks/python/apache_beam/pvalue.py
@@ -79,10 +79,8 @@ class PValue(object):
optional first label and a transform/callable object. It will call the
pipeline.apply() method with this modified argument list.
Github user robertwb closed the pull request at:
https://github.com/apache/incubator-beam/pull/679
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Github user robertwb closed the pull request at:
https://github.com/apache/incubator-beam/pull/676
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 5daab7fb3 -> ad7c216f4
Closes #676
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/ad7c216f
Tree:
Fixing broken example tests
Nose does not pick up decorated tests unless the decorator name
starts with test_. This resulted in some test being inadvertently
disabled.
Also OptionsContext
(https://github.com/aaltay/incubator-beam/blob/python-sdk/sdks/python/apache_beam/utils/options.py#L457)
is
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk ad7c216f4 -> 69f895a2e
Closes #685
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/69f895a2
Tree:
Closes #679
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/56109058
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/56109058
Diff:
y.
+ def is_kv_coder(self):
+return True
+
+ def key_coder(self):
+return self
+
+ def value_coder(self):
+return self
+
+
class Base64PickleCoder(Coder):
"""Coder of objects by Python pickle, then base64 encoding."""
# TODO(robertwb): Do base64 en
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk 69f895a2e -> b00f915ee
Closes #683
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b00f915e
Tree:
Used fast primitives coder as fallback coder.
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/64457d04
Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/64457d04
Diff:
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/691
Add low-level data structures to be shared with the worker.
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure
GitHub user robertwb opened a pull request:
https://github.com/apache/incubator-beam/pull/696
Cythonize WindowedValue class.
Be sure to do all of the following to help us incorporate your contribution
quickly and easily:
- [ ] Make sure the PR title is formatted like
Repository: incubator-beam
Updated Branches:
refs/heads/python-sdk d898d56ae -> 1305c108a
Closes #599
Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo
Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/1305c108
Tree:
Fixes several issues related to 'filebasedsource'.
Adds a method 'fileio.ChannelFactory.size_in_bytes()' that can be used to
determine the size of a single file.
Implements this method for 'ChannelFactory' implementations for GCS and local
files.
Updates 'filebasedsource' to use this method
Github user robertwb closed the pull request at:
https://github.com/apache/incubator-beam/pull/657
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so
1 - 100 of 445 matches
Mail list logo