[jira] [Closed] (BEAM-459) Add BigInteger to TypeDescriptors

[ https://issues.apache.org/jira/browse/BEAM-459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-459. Resolution: Fixed Fix Version/s: 0.2.0-incubating > Add BigInteger to TypeDescriptors >

[jira] [Commented] (BEAM-153) Support timeout in runner API

[ https://issues.apache.org/jira/browse/BEAM-153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15422039#comment-15422039 ] Daniel Halperin commented on BEAM-153: -- Pei, this seems pretty well covered by some of your recent job

Jenkins build is back to stable : beam_PostCommit_RunnableOnService_GoogleCloudDataflow #961

See

[GitHub] incubator-beam pull request #832: [BEAM-557] Exclude guava-testlib from shad...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/832 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-557) Test-scoped dependencies should be excluded from shading package relocation

[ https://issues.apache.org/jira/browse/BEAM-557?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15421926#comment-15421926 ] ASF GitHub Bot commented on BEAM-557: - Github user asfgit closed the pull request at:

[jira] [Created] (BEAM-558) DataflowRunner does not support setup/teardown

Daniel Halperin created BEAM-558: Summary: DataflowRunner does not support setup/teardown Key: BEAM-558 URL: https://issues.apache.org/jira/browse/BEAM-558 Project: Beam Issue Type: Bug

[GitHub] incubator-beam pull request #834: BigtableIO StreamingWrite Setup and Teardo...

GitHub user ianzhou1 opened a pull request: https://github.com/apache/incubator-beam/pull/834 BigtableIO StreamingWrite Setup and Teardown You can merge this pull request into a Git repository by running: $ git pull https://github.com/ianzhou1/incubator-beam

[jira] [Commented] (BEAM-550) Datastore should support writes for Unbounded PCollections

[ https://issues.apache.org/jira/browse/BEAM-550?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15421823#comment-15421823 ] ASF GitHub Bot commented on BEAM-550: - GitHub user vikkyrk opened a pull request:

[2/2] incubator-beam git commit: Improve error handling in gcsio.py

Improve error handling in gcsio.py Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/4d6da9cf Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/4d6da9cf Diff:

[1/2] incubator-beam git commit: Closes #830

Repository: incubator-beam Updated Branches: refs/heads/python-sdk 1d53e28e9 -> 3b40945e9 Closes #830 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3b40945e Tree:

[1/2] incubator-beam git commit: Revert the changes to the accidentaly reverted files

Repository: incubator-beam Updated Branches: refs/heads/python-sdk b28e71979 -> 1d53e28e9 Revert the changes to the accidentaly reverted files Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a4760fe3

[GitHub] incubator-beam pull request #831: Exclude ParDoTest from Dataflow @RunnableO...

GitHub user dhalperi opened a pull request: https://github.com/apache/incubator-beam/pull/831 Exclude ParDoTest from Dataflow @RunnableOnService Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

Jenkins build became unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #960

See

incubator-beam git commit: [BEAM-378] integrate setuptools in Maven build

Repository: incubator-beam Updated Branches: refs/heads/python-sdk 18ce31c1d -> 76de6109f [BEAM-378] integrate setuptools in Maven build This PR provide an initial integration of the Python SDK in the Maven build, relying on the exec-maven-plugin to call setuptools (BEAM-378). Project:

[jira] [Commented] (BEAM-452) Implement DoFn per-instance setup and teardown methods

[ https://issues.apache.org/jira/browse/BEAM-452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15421690#comment-15421690 ] ASF GitHub Bot commented on BEAM-452: - Github user asfgit closed the pull request at:

[1/5] incubator-beam git commit: Closes #690

Repository: incubator-beam Updated Branches: refs/heads/master 0b1f66421 -> 7c680079b Closes #690 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/7c680079 Tree:

[4/5] incubator-beam git commit: Move ParDo Lifecycle tests to their own file

Move ParDo Lifecycle tests to their own file These tests are not yet functional in all runners, and this makes them easier to ignore. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/29cbdceb Tree:

[2/5] incubator-beam git commit: Add DoFn @Setup and @Teardown

Add DoFn @Setup and @Teardown Methods annotated with these annotations are used to perform expensive setup work and clean up a DoFn after another method throws an exception or the DoFn is discarded. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[GitHub] incubator-beam pull request #690: [BEAM-452] Add DoFn setup and teardown met...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/690 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[5/5] incubator-beam git commit: Replace CloningThreadLocal with DoFnLifecycleManager

Replace CloningThreadLocal with DoFnLifecycleManager This is a more focused interface that interacts with a DoFn before it is available for use and after it has completed and the reference is lost. It is required to properly support setup and teardown, as the fields in a ThreadLocal cannot all be

[jira] [Commented] (BEAM-554) Dataflow runner to support bounded writes in streaming mode.

[ https://issues.apache.org/jira/browse/BEAM-554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15421523#comment-15421523 ] ASF GitHub Bot commented on BEAM-554: - GitHub user peihe opened a pull request:

[GitHub] incubator-beam pull request #828: [BEAM-554] Set Gcs upload buffer size to 1...

GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/828 [BEAM-554] Set Gcs upload buffer size to 1M in DataflowRunner streaming mode This PR solves OOMs when DataflowRunner streaming mode writes hundreds files in parallel. You can merge this pull

[jira] [Created] (BEAM-554) Dataflow runner to support bounded in streaming mode.

Pei He created BEAM-554: --- Summary: Dataflow runner to support bounded in streaming mode. Key: BEAM-554 URL: https://issues.apache.org/jira/browse/BEAM-554 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-553) Add a custom text source

Chamikara Jayalath created BEAM-553: --- Summary: Add a custom text source Key: BEAM-553 URL: https://issues.apache.org/jira/browse/BEAM-553 Project: Beam Issue Type: New Feature

[jira] [Closed] (BEAM-552) TimeZone.getTimeZone has performance issue.

[ https://issues.apache.org/jira/browse/BEAM-552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Subhashrao Saley closed BEAM-552. Resolution: Invalid Fix Version/s: Not applicable Sorry, BEAM got auto

[jira] [Created] (BEAM-552) TimeZone.getTimeZone has performance issue.

Satish Subhashrao Saley created BEAM-552: Summary: TimeZone.getTimeZone has performance issue. Key: BEAM-552 URL: https://issues.apache.org/jira/browse/BEAM-552 Project: Beam Issue

[jira] [Commented] (BEAM-551) Support Dynamic PipelineOptions

[ https://issues.apache.org/jira/browse/BEAM-551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15421067#comment-15421067 ] ASF GitHub Bot commented on BEAM-551: - GitHub user sammcveety opened a pull request:

[GitHub] incubator-beam pull request #827: [BEAM-551] Add ValueProvider class

GitHub user sammcveety opened a pull request: https://github.com/apache/incubator-beam/pull/827 [BEAM-551] Add ValueProvider class Hi @lukecwik , can you please take a look? Currently implemented for ValueProvider only. Tests demonstrate intended functionality, once the

[jira] [Created] (BEAM-551) Support Dynamic PipelineOptions

Sam McVeety created BEAM-551: Summary: Support Dynamic PipelineOptions Key: BEAM-551 URL: https://issues.apache.org/jira/browse/BEAM-551 Project: Beam Issue Type: New Feature

[jira] [Closed] (BEAM-492) Spark runner should call Pipeline.run() instead of SparkRunner.run()

[ https://issues.apache.org/jira/browse/BEAM-492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela closed BEAM-492. -- Resolution: Fixed > Spark runner should call Pipeline.run() instead of SparkRunner.run() >

[jira] [Updated] (BEAM-492) Spark runner should call Pipeline.run() instead of SparkRunner.run()

[ https://issues.apache.org/jira/browse/BEAM-492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-492: --- Fix Version/s: 0.3.0-incubating > Spark runner should call Pipeline.run() instead of SparkRunner.run() >

[jira] [Commented] (BEAM-206) FileBasedSink does serial renames

[ https://issues.apache.org/jira/browse/BEAM-206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15420651#comment-15420651 ] ASF GitHub Bot commented on BEAM-206: - GitHub user dhalperi opened a pull request:

[GitHub] incubator-beam pull request #826: [BEAM-206] FileBasedSink: improve parallel...

GitHub user dhalperi opened a pull request: https://github.com/apache/incubator-beam/pull/826 [BEAM-206] FileBasedSink: improve parallelism in GCS copy/remove You can merge this pull request into a Git repository by running: $ git pull