[jira] [Created] (BEAM-656) Add support for side inputs/outputs to Java 8 lambdas in MapElements

Jani Patokallio created BEAM-656: Summary: Add support for side inputs/outputs to Java 8 lambdas in MapElements Key: BEAM-656 URL: https://issues.apache.org/jira/browse/BEAM-656 Project: Beam

[jira] [Commented] (BEAM-655) Rename @RunnableonService to something more descriptive

[ https://issues.apache.org/jira/browse/BEAM-655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15508687#comment-15508687 ] Kenneth Knowles commented on BEAM-655: -- Relevant proposal at [Capability Matrix Testin

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1179

See

[jira] [Closed] (BEAM-493) All Runners Run WordCount in Precommit

[ https://issues.apache.org/jira/browse/BEAM-493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kuster closed BEAM-493. - Resolution: Fixed Fix Version/s: 0.3.0-incubating All mainline runners now run wordcount in precommit

[jira] [Created] (BEAM-655) Rename @RunnableonService to something more descriptive

Jason Kuster created BEAM-655: - Summary: Rename @RunnableonService to something more descriptive Key: BEAM-655 URL: https://issues.apache.org/jira/browse/BEAM-655 Project: Beam Issue Type: Bug

[2/2] incubator-beam git commit: Closes #981

Closes #981 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/701aff07 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/701aff07 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/

[GitHub] incubator-beam pull request #981: Insert global windowing before write resul...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/981 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[1/2] incubator-beam git commit: Insert global windowing before write results GBK

Repository: incubator-beam Updated Branches: refs/heads/python-sdk acd8d7952 -> 701aff074 Insert global windowing before write results GBK Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/57a0b6af Tree: htt

[jira] [Created] (BEAM-654) When and how can merging windows "shrink" or "grow"?

Kenneth Knowles created BEAM-654: Summary: When and how can merging windows "shrink" or "grow"? Key: BEAM-654 URL: https://issues.apache.org/jira/browse/BEAM-654 Project: Beam Issue Type: New

[GitHub] incubator-beam pull request #965: Removed unnecessary throttling of rename p...

Github user mdvorsky closed the pull request at: https://github.com/apache/incubator-beam/pull/965 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the featu

[GitHub] incubator-beam pull request #981: Insert global windowing before write resul...

GitHub user robertwb opened a pull request: https://github.com/apache/incubator-beam/pull/981 Insert global windowing before write results GBK Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[jira] [Commented] (BEAM-643) Allow users to specify a custom service account

[ https://issues.apache.org/jira/browse/BEAM-643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507880#comment-15507880 ] ASF GitHub Bot commented on BEAM-643: - Github user chamikaramj closed the pull request a

[GitHub] incubator-beam pull request #978: [BEAM-643] Updates Dataflow API client.

Github user chamikaramj closed the pull request at: https://github.com/apache/incubator-beam/pull/978 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[jira] [Commented] (BEAM-643) Allow users to specify a custom service account

[ https://issues.apache.org/jira/browse/BEAM-643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507878#comment-15507878 ] ASF GitHub Bot commented on BEAM-643: - Github user chamikaramj closed the pull request a

[GitHub] incubator-beam pull request #975: [BEAM-643] Adds support for specifying a c...

Github user chamikaramj closed the pull request at: https://github.com/apache/incubator-beam/pull/975 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[1/2] incubator-beam git commit: Closes #975

Repository: incubator-beam Updated Branches: refs/heads/python-sdk c1964bdd6 -> acd8d7952 Closes #975 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/acd8d795 Tree: http://git-wip-us.apache.org/repos/asf/

[2/2] incubator-beam git commit: Adds support for specifying a custom service account.

Adds support for specifying a custom service account. Updates Dataflow API client to latest version. Adds ability to skip generated files during lint checks. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/

[2/3] incubator-beam git commit: Updates Dataflow API client.

Updates Dataflow API client. These files were generated using following command but I updated the licence and package name manually to match the current version. gen_client --discovery_url=dataflow.v1b3 --overwrite --outdir=out pip_package Project: http://git-wip-us.apache.org/repos/asf/incubat

[1/3] incubator-beam git commit: Updates Dataflow API client.

Repository: incubator-beam Updated Branches: refs/heads/python-sdk b6c7478ff -> c1964bdd6 http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/2e3384e6/sdks/python/apache_beam/internal/clients/dataflow/dataflow_v1b3_messages.py -

[3/3] incubator-beam git commit: Closes #978

Closes #978 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c1964bdd Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c1964bdd Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/diff/

[jira] [Created] (BEAM-653) Refine specification for WindowFn.isCompatible()

Kenneth Knowles created BEAM-653: Summary: Refine specification for WindowFn.isCompatible() Key: BEAM-653 URL: https://issues.apache.org/jira/browse/BEAM-653 Project: Beam Issue Type: New Fe

[jira] [Created] (BEAM-652) StateNamespaces.window() potentially unstable / stable encodings for windows

Kenneth Knowles created BEAM-652: Summary: StateNamespaces.window() potentially unstable / stable encodings for windows Key: BEAM-652 URL: https://issues.apache.org/jira/browse/BEAM-652 Project: Beam

[jira] [Updated] (BEAM-652) StateNamespaces.window() potentially unstable / stable encodings for windows

[ https://issues.apache.org/jira/browse/BEAM-652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-652: - Issue Type: Improvement (was: New Feature) > StateNamespaces.window() potentially unstable / stable

[jira] [Commented] (BEAM-638) Add a Window function to create a bounded PCollection from an unbounded one

[ https://issues.apache.org/jira/browse/BEAM-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507706#comment-15507706 ] Aljoscha Krettek commented on BEAM-638: --- I don't think it's possible to provide such a

[jira] [Created] (BEAM-651) Consider making TypedPValue.setTypeDescriptorInternal no longer Internal

Kenneth Knowles created BEAM-651: Summary: Consider making TypedPValue.setTypeDescriptorInternal no longer Internal Key: BEAM-651 URL: https://issues.apache.org/jira/browse/BEAM-651 Project: Beam

[jira] [Created] (BEAM-650) Test pipeline that uses side input from prior window

Kenneth Knowles created BEAM-650: Summary: Test pipeline that uses side input from prior window Key: BEAM-650 URL: https://issues.apache.org/jira/browse/BEAM-650 Project: Beam Issue Type: Tes

[jira] [Commented] (BEAM-626) AvroCoder not deserializing correctly in Kryo

[ https://issues.apache.org/jira/browse/BEAM-626?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507585#comment-15507585 ] Amit Sela commented on BEAM-626: [~dhalp...@google.com] the thread safety issues you mention

[jira] [Commented] (BEAM-645) Running Wordcount in Spark Checks Locally and Outputs in HDFS

[ https://issues.apache.org/jira/browse/BEAM-645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507582#comment-15507582 ] Jesse Anderson commented on BEAM-645: - TextIO passing the knowledge to the runner is the

[jira] [Commented] (BEAM-645) Running Wordcount in Spark Checks Locally and Outputs in HDFS

[ https://issues.apache.org/jira/browse/BEAM-645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507498#comment-15507498 ] Amit Sela commented on BEAM-645: I think it's the other way around - TextIO is the one passi

[jira] [Created] (BEAM-649) Pipeline "actions" should use foreachRDD via ParDo.

Amit Sela created BEAM-649: -- Summary: Pipeline "actions" should use foreachRDD via ParDo. Key: BEAM-649 URL: https://issues.apache.org/jira/browse/BEAM-649 Project: Beam Issue Type: Bug Co

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1178

See

[jira] [Created] (BEAM-648) Persist and restore Aggergator values in case of recovery from failure

Amit Sela created BEAM-648: -- Summary: Persist and restore Aggergator values in case of recovery from failure Key: BEAM-648 URL: https://issues.apache.org/jira/browse/BEAM-648 Project: Beam Issue Ty

[jira] [Commented] (BEAM-645) Running Wordcount in Spark Checks Locally and Outputs in HDFS

[ https://issues.apache.org/jira/browse/BEAM-645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507437#comment-15507437 ] Jesse Anderson commented on BEAM-645: - No, it doesn't happen with {{org.apache.beam.runn

[jira] [Created] (BEAM-647) Faul-tolerant sideInputs via Broadcast variables.

Amit Sela created BEAM-647: -- Summary: Faul-tolerant sideInputs via Broadcast variables. Key: BEAM-647 URL: https://issues.apache.org/jira/browse/BEAM-647 Project: Beam Issue Type: Bug Comp

[jira] [Commented] (BEAM-645) Running Wordcount in Spark Checks Locally and Outputs in HDFS

[ https://issues.apache.org/jira/browse/BEAM-645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507410#comment-15507410 ] Amit Sela commented on BEAM-645: Does this happen with the SDKs example or the WordCount exa

[jira] [Commented] (BEAM-644) Primitive to shift the watermark while assigning timestamps

[ https://issues.apache.org/jira/browse/BEAM-644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507379#comment-15507379 ] Ben Chambers commented on BEAM-644: --- Minor note on "A function from TimestampedElement to

[jira] [Created] (BEAM-646) Get runners out of the apply()

Kenneth Knowles created BEAM-646: Summary: Get runners out of the apply() Key: BEAM-646 URL: https://issues.apache.org/jira/browse/BEAM-646 Project: Beam Issue Type: Improvement Com

[jira] [Created] (BEAM-645) Running Wordcount in Spark Checks Locally and Outputs in HDFS

Jesse Anderson created BEAM-645: --- Summary: Running Wordcount in Spark Checks Locally and Outputs in HDFS Key: BEAM-645 URL: https://issues.apache.org/jira/browse/BEAM-645 Project: Beam Issue T

[jira] [Created] (BEAM-644) Primitive to shift the watermark while assigning timestamps

Kenneth Knowles created BEAM-644: Summary: Primitive to shift the watermark while assigning timestamps Key: BEAM-644 URL: https://issues.apache.org/jira/browse/BEAM-644 Project: Beam Issue T

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1177

See

[jira] [Commented] (BEAM-643) Allow users to specify a custom service account

[ https://issues.apache.org/jira/browse/BEAM-643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507203#comment-15507203 ] ASF GitHub Bot commented on BEAM-643: - Github user chamikaramj closed the pull request a

[GitHub] incubator-beam pull request #979: [BEAM-643] Updates lint configurations to ...

Github user chamikaramj closed the pull request at: https://github.com/apache/incubator-beam/pull/979 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the fe

[jira] [Commented] (BEAM-636) Add Char, Byte to TypeDescriptors

[ https://issues.apache.org/jira/browse/BEAM-636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507144#comment-15507144 ] ASF GitHub Bot commented on BEAM-636: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #966: [BEAM-636] Add Char, Byte to TypeDescripto...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/966 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[2/2] incubator-beam git commit: This closes #966

This closes #966 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5c23f495 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5c23f495 Diff: http://git-wip-us.apache.org/repos/asf/incubator-beam/

[1/2] incubator-beam git commit: Adding Byte and Character TypeDescriptors.

Repository: incubator-beam Updated Branches: refs/heads/master 9e7ed2929 -> 5c23f4954 Adding Byte and Character TypeDescriptors. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a596835e Tree: http://git-w

[jira] [Commented] (BEAM-625) Make Dataflow Python Materialized PCollection representation more efficient

[ https://issues.apache.org/jira/browse/BEAM-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15507020#comment-15507020 ] ASF GitHub Bot commented on BEAM-625: - Github user katsiapis closed the pull request at:

[GitHub] incubator-beam pull request #976: [BEAM-625] Making Dataflow Python Material...

Github user katsiapis closed the pull request at: https://github.com/apache/incubator-beam/pull/976 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feat

[2/2] incubator-beam git commit: Updates lint configurations to ignore generated files.

Updates lint configurations to ignore generated files. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/49c03593 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/49c03593 Diff: http://git-wip-u

[1/2] incubator-beam git commit: Closes #979

Repository: incubator-beam Updated Branches: refs/heads/python-sdk adda16320 -> b6c7478ff Closes #979 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b6c7478f Tree: http://git-wip-us.apache.org/repos/asf/

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1176

See

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1175

See