[jira] [Commented] (BEAM-636) Add Char, Byte to TypeDescriptors

2016-09-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507144#comment-15507144 ] ASF GitHub Bot commented on BEAM-636: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #966: [BEAM-636] Add Char, Byte to TypeDescripto...

2016-09-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/966 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: Updates lint configurations to ignore generated files.

2016-09-20 Thread robertwb
Updates lint configurations to ignore generated files. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/49c03593 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/49c03593 Diff:

[1/2] incubator-beam git commit: Closes #979

2016-09-20 Thread robertwb
Repository: incubator-beam Updated Branches: refs/heads/python-sdk adda16320 -> b6c7478ff Closes #979 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b6c7478f Tree:

[jira] [Commented] (BEAM-625) Make Dataflow Python Materialized PCollection representation more efficient

2016-09-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507020#comment-15507020 ] ASF GitHub Bot commented on BEAM-625: - Github user katsiapis closed the pull request at:

[GitHub] incubator-beam pull request #976: [BEAM-625] Making Dataflow Python Material...

2016-09-20 Thread katsiapis
Github user katsiapis closed the pull request at: https://github.com/apache/incubator-beam/pull/976 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1175

2016-09-20 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-643) Allow users to specify a custom service account

2016-09-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507203#comment-15507203 ] ASF GitHub Bot commented on BEAM-643: - Github user chamikaramj closed the pull request at:

[jira] [Created] (BEAM-646) Get runners out of the apply()

2016-09-20 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-646: Summary: Get runners out of the apply() Key: BEAM-646 URL: https://issues.apache.org/jira/browse/BEAM-646 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-644) Primitive to shift the watermark while assigning timestamps

2016-09-20 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507379#comment-15507379 ] Ben Chambers commented on BEAM-644: --- Minor note on "A function from TimestampedElement to new timestamp

[jira] [Commented] (BEAM-645) Running Wordcount in Spark Checks Locally and Outputs in HDFS

2016-09-20 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507410#comment-15507410 ] Amit Sela commented on BEAM-645: Does this happen with the SDKs example or the WordCount example in the

[2/2] incubator-beam git commit: This closes #966

2016-09-20 Thread kenn
This closes #966 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5c23f495 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5c23f495 Diff:

[jira] [Created] (BEAM-647) Faul-tolerant sideInputs via Broadcast variables.

2016-09-20 Thread Amit Sela (JIRA)
Amit Sela created BEAM-647: -- Summary: Faul-tolerant sideInputs via Broadcast variables. Key: BEAM-647 URL: https://issues.apache.org/jira/browse/BEAM-647 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-645) Running Wordcount in Spark Checks Locally and Outputs in HDFS

2016-09-20 Thread Jesse Anderson (JIRA)
Jesse Anderson created BEAM-645: --- Summary: Running Wordcount in Spark Checks Locally and Outputs in HDFS Key: BEAM-645 URL: https://issues.apache.org/jira/browse/BEAM-645 Project: Beam Issue

[GitHub] incubator-beam pull request #965: Removed unnecessary throttling of rename p...

2016-09-20 Thread mdvorsky
Github user mdvorsky closed the pull request at: https://github.com/apache/incubator-beam/pull/965 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Created] (BEAM-654) When and how can merging windows "shrink" or "grow"?

2016-09-20 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-654: Summary: When and how can merging windows "shrink" or "grow"? Key: BEAM-654 URL: https://issues.apache.org/jira/browse/BEAM-654 Project: Beam Issue Type:

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1177

2016-09-20 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-644) Primitive to shift the watermark while assigning timestamps

2016-09-20 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-644: Summary: Primitive to shift the watermark while assigning timestamps Key: BEAM-644 URL: https://issues.apache.org/jira/browse/BEAM-644 Project: Beam Issue

[jira] [Created] (BEAM-652) StateNamespaces.window() potentially unstable / stable encodings for windows

2016-09-20 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-652: Summary: StateNamespaces.window() potentially unstable / stable encodings for windows Key: BEAM-652 URL: https://issues.apache.org/jira/browse/BEAM-652 Project: Beam

[jira] [Created] (BEAM-653) Refine specification for WindowFn.isCompatible()

2016-09-20 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-653: Summary: Refine specification for WindowFn.isCompatible() Key: BEAM-653 URL: https://issues.apache.org/jira/browse/BEAM-653 Project: Beam Issue Type: New

[2/3] incubator-beam git commit: Updates Dataflow API client.

2016-09-20 Thread robertwb
Updates Dataflow API client. These files were generated using following command but I updated the licence and package name manually to match the current version. gen_client --discovery_url=dataflow.v1b3 --overwrite --outdir=out pip_package Project:

[GitHub] incubator-beam pull request #978: [BEAM-643] Updates Dataflow API client.

2016-09-20 Thread chamikaramj
Github user chamikaramj closed the pull request at: https://github.com/apache/incubator-beam/pull/978 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-643) Allow users to specify a custom service account

2016-09-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507878#comment-15507878 ] ASF GitHub Bot commented on BEAM-643: - Github user chamikaramj closed the pull request at:

[GitHub] incubator-beam pull request #975: [BEAM-643] Adds support for specifying a c...

2016-09-20 Thread chamikaramj
Github user chamikaramj closed the pull request at: https://github.com/apache/incubator-beam/pull/975 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Updated] (BEAM-652) StateNamespaces.window() potentially unstable / stable encodings for windows

2016-09-20 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-652: - Issue Type: Improvement (was: New Feature) > StateNamespaces.window() potentially unstable /

[jira] [Commented] (BEAM-643) Allow users to specify a custom service account

2016-09-20 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507880#comment-15507880 ] ASF GitHub Bot commented on BEAM-643: - Github user chamikaramj closed the pull request at:

[3/3] incubator-beam git commit: Closes #978

2016-09-20 Thread robertwb
Closes #978 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c1964bdd Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c1964bdd Diff:

[1/3] incubator-beam git commit: Updates Dataflow API client.

2016-09-20 Thread robertwb
Repository: incubator-beam Updated Branches: refs/heads/python-sdk b6c7478ff -> c1964bdd6 http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/2e3384e6/sdks/python/apache_beam/internal/clients/dataflow/dataflow_v1b3_messages.py

[jira] [Commented] (BEAM-638) Add a Window function to create a bounded PCollection from an unbounded one

2016-09-20 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507706#comment-15507706 ] Aljoscha Krettek commented on BEAM-638: --- I don't think it's possible to provide such a function. What

[1/2] incubator-beam git commit: Closes #975

2016-09-20 Thread robertwb
Repository: incubator-beam Updated Branches: refs/heads/python-sdk c1964bdd6 -> acd8d7952 Closes #975 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/acd8d795 Tree:

[2/2] incubator-beam git commit: Adds support for specifying a custom service account.

2016-09-20 Thread robertwb
Adds support for specifying a custom service account. Updates Dataflow API client to latest version. Adds ability to skip generated files during lint checks. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[jira] [Commented] (BEAM-645) Running Wordcount in Spark Checks Locally and Outputs in HDFS

2016-09-20 Thread Jesse Anderson (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507437#comment-15507437 ] Jesse Anderson commented on BEAM-645: - No, it doesn't happen with

[jira] [Commented] (BEAM-645) Running Wordcount in Spark Checks Locally and Outputs in HDFS

2016-09-20 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507498#comment-15507498 ] Amit Sela commented on BEAM-645: I think it's the other way around - TextIO is the one passing knowledge to

[jira] [Commented] (BEAM-645) Running Wordcount in Spark Checks Locally and Outputs in HDFS

2016-09-20 Thread Jesse Anderson (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15507582#comment-15507582 ] Jesse Anderson commented on BEAM-645: - TextIO passing the knowledge to the runner is the issue. Unless

[jira] [Created] (BEAM-649) Pipeline "actions" should use foreachRDD via ParDo.

2016-09-20 Thread Amit Sela (JIRA)
Amit Sela created BEAM-649: -- Summary: Pipeline "actions" should use foreachRDD via ParDo. Key: BEAM-649 URL: https://issues.apache.org/jira/browse/BEAM-649 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-655) Rename @RunnableonService to something more descriptive

2016-09-20 Thread Jason Kuster (JIRA)
Jason Kuster created BEAM-655: - Summary: Rename @RunnableonService to something more descriptive Key: BEAM-655 URL: https://issues.apache.org/jira/browse/BEAM-655 Project: Beam Issue Type: Bug

[jira] [Closed] (BEAM-493) All Runners Run WordCount in Precommit

2016-09-20 Thread Jason Kuster (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Kuster closed BEAM-493. - Resolution: Fixed Fix Version/s: 0.3.0-incubating All mainline runners now run wordcount in

[2/2] incubator-beam git commit: Closes #981

2016-09-20 Thread robertwb
Closes #981 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/701aff07 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/701aff07 Diff:

[GitHub] incubator-beam pull request #981: Insert global windowing before write resul...

2016-09-20 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/981 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Insert global windowing before write results GBK

2016-09-20 Thread robertwb
Repository: incubator-beam Updated Branches: refs/heads/python-sdk acd8d7952 -> 701aff074 Insert global windowing before write results GBK Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/57a0b6af Tree:

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1179

2016-09-20 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-655) Rename @RunnableonService to something more descriptive

2016-09-20 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15508687#comment-15508687 ] Kenneth Knowles commented on BEAM-655: -- Relevant proposal at [Capability Matrix

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1176

2016-09-20 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-656) Add support for side inputs/outputs to Java 8 lambdas in MapElements

2016-09-20 Thread Jani Patokallio (JIRA)
Jani Patokallio created BEAM-656: Summary: Add support for side inputs/outputs to Java 8 lambdas in MapElements Key: BEAM-656 URL: https://issues.apache.org/jira/browse/BEAM-656 Project: Beam