[jira] [Commented] (BEAM-1934) Code examples for CoGroupByKey

2017-04-14 Thread Melissa Pashniak (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969639#comment-15969639 ] Melissa Pashniak commented on BEAM-1934: Starting work on this > Code examples for CoGroupByKey >

[jira] [Created] (BEAM-1983) SDF should properly support windowed side inputs

2017-04-14 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1983: -- Summary: SDF should properly support windowed side inputs Key: BEAM-1983 URL: https://issues.apache.org/jira/browse/BEAM-1983 Project: Beam Issue Type:

[1/3] beam git commit: This closes #2501

2017-04-14 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 3c2b855f5 -> fdbadfc9c This closes #2501 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/fdbadfc9 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/fdbadfc9 Diff:

[3/3] beam git commit: Update Signature of PTransformOverrideFactory

2017-04-14 Thread tgroh
Update Signature of PTransformOverrideFactory This enables replacements to be reobtained with the entire transform that is being replaced. This is required when Side Inputs are part of the input of the PTransform Application, as PTransforms are not applied to their side inputs. Project:

[2/3] beam git commit: Update Signature of PTransformOverrideFactory

2017-04-14 Thread tgroh
http://git-wip-us.apache.org/repos/asf/beam/blob/f3b49605/runners/google-cloud-dataflow-java/src/main/java/org/apache/beam/runners/dataflow/DataflowRunner.java -- diff --git

[jira] [Commented] (BEAM-1938) Side Inputs should be part of the expanded inputs

2017-04-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969691#comment-15969691 ] ASF GitHub Bot commented on BEAM-1938: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2501: [BEAM-1938] Update Signature of PTransformOverrideF...

2017-04-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2501 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3313

2017-04-14 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-301) Add a Beam SQL DSL

2017-04-14 Thread Julian Hyde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969712#comment-15969712 ] Julian Hyde commented on BEAM-301: -- Yes. And "last year" is a rolling total based on the time each order

Build failed in Jenkins: beam_PostCommit_Python_Verify #1865

2017-04-14 Thread Apache Jenkins Server
See -- [...truncated 352.90 KB...] test_flat_type_hint (apache_beam.typehints.typed_pipeline_test.CustomTransformTest) ... ok test_keyword_type_hints

[jira] [Commented] (BEAM-1964) Upgrade pylint to 1.7.0

2017-04-14 Thread Sourabh Bajaj (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969708#comment-15969708 ] Sourabh Bajaj commented on BEAM-1964: - [~altay] this can be resolved now. > Upgrade pylint to 1.7.0 >

[jira] [Resolved] (BEAM-1778) Clean up pass of dataflow/google references/URLs in Java SDK

2017-04-14 Thread Melissa Pashniak (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Melissa Pashniak resolved BEAM-1778. Resolution: Fixed Fix Version/s: Not applicable > Clean up pass of dataflow/google

[jira] [Resolved] (BEAM-1799) IO ITs: simplify data loading design pattern

2017-04-14 Thread Stephen Sisk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Sisk resolved BEAM-1799. Resolution: Fixed Fix Version/s: First stable release The concept was supported on the

[jira] [Commented] (BEAM-1983) SDF should properly support windowed side inputs

2017-04-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969733#comment-15969733 ] Eugene Kirpichov commented on BEAM-1983: ...which means that really, we *must* explode windows

[jira] [Commented] (BEAM-1983) SDF should properly support windowed side inputs

2017-04-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969727#comment-15969727 ] Eugene Kirpichov commented on BEAM-1983: ...which is challenging cause ProcessFn currently

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #2840

2017-04-14 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1510) Merge new source and sink Python-specific content into language agnostic page with toggles

2017-04-14 Thread Melissa Pashniak (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969630#comment-15969630 ] Melissa Pashniak commented on BEAM-1510: [~sisk] I believe this is obsolete and incorrect now,

Build failed in Jenkins: beam_PerformanceTests_Dataflow #309

2017-04-14 Thread Apache Jenkins Server
See Changes: [tgroh] Add PCollections Utilities [dhalperi] ApexRunner: register standard IOs when deserializing pipeline options [dhalperi] Avoi repackaging bigtable classes in dataflow runner.

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Apex #1099

2017-04-14 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1972) HIFIO jdk module fails enforcer when only java 7 is installed on machine

2017-04-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969763#comment-15969763 ] ASF GitHub Bot commented on BEAM-1972: -- GitHub user ssisk opened a pull request:

[GitHub] beam pull request #2546: [BEAM-1972] Only compile HIFIO ITs when compiling w...

2017-04-14 Thread ssisk
GitHub user ssisk opened a pull request: https://github.com/apache/beam/pull/2546 [BEAM-1972] Only compile HIFIO ITs when compiling with java 8. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [X] Make sure the PR title

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #2841

2017-04-14 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-221) ProtoIO

2017-04-14 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-221: - Issue Type: New Feature (was: Bug) > ProtoIO > --- > > Key: BEAM-221 >

[jira] [Updated] (BEAM-221) ProtoIO

2017-04-14 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-221: - Labels: newbie starter (was: ) > ProtoIO > --- > > Key: BEAM-221 >

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #2839

2017-04-14 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1972) HIFIO jdk module fails enforcer when only java 7 is installed on machine

2017-04-14 Thread Stephen Sisk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969696#comment-15969696 ] Stephen Sisk commented on BEAM-1972: cc [~dhalp...@google.com] [~davor] wanted to make sure you were

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3311

2017-04-14 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1983) SDF should properly support windowed side inputs

2017-04-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969724#comment-15969724 ] Eugene Kirpichov commented on BEAM-1983: One more thing to be on the lookout for in test coverage:

[jira] [Commented] (BEAM-1980) Seeming deadlock using Apex with relatively small data

2017-04-14 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969598#comment-15969598 ] Daniel Halperin commented on BEAM-1980: --- Hmm, that is a good question. I'm honestly not sure I know

[jira] [Commented] (BEAM-802) Support Dynamic PipelineOptions for python

2017-04-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969637#comment-15969637 ] ASF GitHub Bot commented on BEAM-802: - GitHub user aaltay opened a pull request:

[jira] [Closed] (BEAM-1778) Clean up pass of dataflow/google references/URLs in Java SDK

2017-04-14 Thread Melissa Pashniak (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1778?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Melissa Pashniak closed BEAM-1778. -- > Clean up pass of dataflow/google references/URLs in Java SDK >

[GitHub] beam pull request #2545: [BEAM-802] Python templates

2017-04-14 Thread aaltay
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2545 [BEAM-802] Python templates Re-reverts the python templates. First two commits are clean reverts of the original commits. The last commit: - Removes the concept of options id. (Except

[jira] [Commented] (BEAM-1983) SDF should properly support windowed side inputs

2017-04-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969678#comment-15969678 ] Eugene Kirpichov commented on BEAM-1983: CC: [~aljoscha] [~kenn] [~thomasWeise] [~tgroh] > SDF

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #3312

2017-04-14 Thread Apache Jenkins Server
See

[jira] [Resolved] (BEAM-1966) ApexRunner in cluster mode does not register standard FileSystems/IOChannelFactories

2017-04-14 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1966. --- Resolution: Fixed Assignee: Daniel Halperin (was: Thomas Weise) > ApexRunner in cluster

[jira] [Commented] (BEAM-1441) Add an IOChannelFactory interface to Python SDK

2017-04-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969624#comment-15969624 ] ASF GitHub Bot commented on BEAM-1441: -- GitHub user sb2nov opened a pull request:

[GitHub] beam pull request #2542: [BEAM-1964] Fix lint issues and pylint upgrade

2017-04-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2542 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2542

2017-04-14 Thread altay
This closes #2542 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3c2b855f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3c2b855f Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/3c2b855f Branch:

[jira] [Updated] (BEAM-1983) SDF should properly support windowed side inputs

2017-04-14 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov updated BEAM-1983: --- Issue Type: Bug (was: New Feature) > SDF should properly support windowed side inputs >

[jira] [Commented] (BEAM-1972) HIFIO jdk module fails enforcer when only java 7 is installed on machine

2017-04-14 Thread Stephen Sisk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1972?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969697#comment-15969697 ] Stephen Sisk commented on BEAM-1972: It looks like something like:

[jira] [Resolved] (BEAM-1964) Upgrade pylint to 1.7.0

2017-04-14 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-1964. --- Resolution: Fixed Fix Version/s: First stable release > Upgrade pylint to 1.7.0 >

Build failed in Jenkins: beam_PerformanceTests_Dataflow #307

2017-04-14 Thread Apache Jenkins Server
See -- [...truncated 237.11 KB...] x [deleted] (none) -> origin/pr/977/merge x [deleted] (none) -> origin/pr/978/head x [deleted] (none)

Build failed in Jenkins: beam_PerformanceTests_Dataflow #306

2017-04-14 Thread Apache Jenkins Server
See Changes: [altay] [BEAM-1964] Fix lint issues for linter upgrade [altay] fix the simplest typo [altay] Update java8 examples pom files to include maven-shade-plugin.

[jira] [Assigned] (BEAM-1757) Improve log configuration when using multiple logging frameworks in Pipeline

2017-04-14 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur reassigned BEAM-1757: --- Assignee: (was: Aviem Zur) > Improve log configuration when using multiple logging frameworks in

[jira] [Updated] (BEAM-1975) Documentation around logging in different runners

2017-04-14 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1975?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1975: Description: Add documentation on how to configure logging in different runners, relate to SLF4J and

[GitHub] beam pull request #2539: [BEAM-1964] Fix lint issues for linter upgrade -2

2017-04-14 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/2539 [BEAM-1964] Fix lint issues for linter upgrade -2 Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[jira] [Commented] (BEAM-1802) Spark Runner does not shutdown correctly when executing multiple pipelines in sequence

2017-04-14 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969101#comment-15969101 ] Aviem Zur commented on BEAM-1802: - Yes, it is working as designed, there is an inconsistency regarding the

[jira] [Commented] (BEAM-1802) Spark Runner does not shutdown correctly when executing multiple pipelines in sequence

2017-04-14 Thread Etienne Chauchot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969068#comment-15969068 ] Etienne Chauchot commented on BEAM-1802: It works in batch mode but not in streaming mode: in

[jira] [Commented] (BEAM-1802) Spark Runner does not shutdown correctly when executing multiple pipelines in sequence

2017-04-14 Thread Etienne Chauchot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969099#comment-15969099 ] Etienne Chauchot commented on BEAM-1802: It makes sense to have an infinite loop for a stream, so I

[GitHub] beam pull request #2518: [BEAM-1347] Update protos related to State API for ...

2017-04-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2518 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: [BEAM-1347] Update protos related to State API for prototyping purposes.

2017-04-14 Thread lcwik
Repository: beam Updated Branches: refs/heads/master 4daac6644 -> 6bf42622c [BEAM-1347] Update protos related to State API for prototyping purposes. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/25d77b12 Tree:

[2/2] beam git commit: [BEAM-1347] Update protos related to State API for prototyping purposes

2017-04-14 Thread lcwik
[BEAM-1347] Update protos related to State API for prototyping purposes This closes #2518 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6bf42622 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6bf42622 Diff:

[jira] [Commented] (BEAM-1347) Basic Java harness capable of understanding process bundle tasks and sending data over the Fn Api

2017-04-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969212#comment-15969212 ] ASF GitHub Bot commented on BEAM-1347: -- Github user asfgit closed the pull request at:

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Apex #1092

2017-04-14 Thread Apache Jenkins Server
See -- [...truncated 235.71 KB...] x [deleted] (none) -> origin/pr/942/head x [deleted] (none) -> origin/pr/942/merge x [deleted]

[jira] [Commented] (BEAM-1970) Cannot run UserScore on Flink runner

2017-04-14 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969230#comment-15969230 ] Aljoscha Krettek commented on BEAM-1970: [~lcwik] Since you seem to know the work around, is this a

[jira] [Commented] (BEAM-1970) Cannot run UserScore on Flink runner

2017-04-14 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1970?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969234#comment-15969234 ] Luke Cwik commented on BEAM-1970: - The workaround wasn't need on other runners (tried Direct, Spark local

[1/2] beam git commit: Avoi repackaging bigtable classes in dataflow runner.

2017-04-14 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master 735a82bda -> cf9ac454d Avoi repackaging bigtable classes in dataflow runner. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4017a37d Tree:

[GitHub] beam pull request #2541: [BEAM-1978] Avoid repackaging bigtable classes in d...

2017-04-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2541 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-1978) Avoid repackaging bigtable classes in Dataflow runner jar

2017-04-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969465#comment-15969465 ] ASF GitHub Bot commented on BEAM-1978: -- Github user asfgit closed the pull request at:

[2/2] beam git commit: This closes #2541

2017-04-14 Thread dhalperi
This closes #2541 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/cf9ac454 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/cf9ac454 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/cf9ac454 Branch:

[jira] [Created] (BEAM-1980) Seeming deadlock using Apex with relatively small data

2017-04-14 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1980: - Summary: Seeming deadlock using Apex with relatively small data Key: BEAM-1980 URL: https://issues.apache.org/jira/browse/BEAM-1980 Project: Beam Issue

[GitHub] beam pull request #2541: [BEAM-1978] Avoid repackaging bigtable classes in d...

2017-04-14 Thread rangadi
GitHub user rangadi opened a pull request: https://github.com/apache/beam/pull/2541 [BEAM-1978] Avoid repackaging bigtable classes in dataflow runner. Dataflow bundled jar does not need to repackage bigtable classes. This repackaging was probably never required in Apache Beam.

[jira] [Commented] (BEAM-1978) Avoid repackaging bigtable classes in Dataflow runner jar

2017-04-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1978?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969369#comment-15969369 ] ASF GitHub Bot commented on BEAM-1978: -- GitHub user rangadi opened a pull request:

[jira] [Created] (BEAM-1978) Avoid repackaging bigtable classes in Dataflow runner jar

2017-04-14 Thread Raghu Angadi (JIRA)
Raghu Angadi created BEAM-1978: -- Summary: Avoid repackaging bigtable classes in Dataflow runner jar Key: BEAM-1978 URL: https://issues.apache.org/jira/browse/BEAM-1978 Project: Beam Issue Type:

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Spark #1640

2017-04-14 Thread Apache Jenkins Server
See

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #3304

2017-04-14 Thread Apache Jenkins Server
See

[1/2] beam git commit: ApexRunner: register standard IOs when deserializing pipeline options

2017-04-14 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master eea96ffa3 -> 735a82bda ApexRunner: register standard IOs when deserializing pipeline options This needs to be done once per JVM using the Job's pipeline options. The following is a hack that is tolerant of multiple initialization. Is

[GitHub] beam pull request #2528: [BEAM-1966] ApexRunner: register standard IOs when ...

2017-04-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2528 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2528

2017-04-14 Thread dhalperi
This closes #2528 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/735a82bd Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/735a82bd Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/735a82bd Branch:

[jira] [Commented] (BEAM-1886) Remove TextIO override in Flink runner

2017-04-14 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969240#comment-15969240 ] Aljoscha Krettek commented on BEAM-1886: [~kenn] Does regular write now support unbounded inputs?

[jira] [Created] (BEAM-1979) Outputting to an undeclared side output TupleTag should throw

2017-04-14 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1979: -- Summary: Outputting to an undeclared side output TupleTag should throw Key: BEAM-1979 URL: https://issues.apache.org/jira/browse/BEAM-1979 Project: Beam

[jira] [Commented] (BEAM-1964) Upgrade pylint to 1.7.0

2017-04-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969485#comment-15969485 ] ASF GitHub Bot commented on BEAM-1964: -- GitHub user sb2nov opened a pull request:

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #3303

2017-04-14 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1937) PipelineSurgery renumbers already-unique transforms

2017-04-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1937?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969312#comment-15969312 ] ASF GitHub Bot commented on BEAM-1937: -- Github user asfgit closed the pull request at:

[2/2] beam git commit: Add PCollections Utilities

2017-04-14 Thread tgroh
Add PCollections Utilities Convert a PCollection into a Proto Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8dcfa540 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8dcfa540 Diff:

[1/2] beam git commit: This closes #2516

2017-04-14 Thread tgroh
Repository: beam Updated Branches: refs/heads/master b2329a7ef -> eea96ffa3 This closes #2516 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/eea96ffa Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/eea96ffa Diff:

[jira] [Commented] (BEAM-1928) Populate Runner API Components from the Java SDK

2017-04-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969352#comment-15969352 ] ASF GitHub Bot commented on BEAM-1928: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2516: [BEAM-1928] Add PCollections Utilities

2017-04-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2516 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-1966) ApexRunner in cluster mode does not register standard FileSystems/IOChannelFactories

2017-04-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969377#comment-15969377 ] ASF GitHub Bot commented on BEAM-1966: -- Github user asfgit closed the pull request at:

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Apex #1094

2017-04-14 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1928) Populate Runner API Components from the Java SDK

2017-04-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969353#comment-15969353 ] ASF GitHub Bot commented on BEAM-1928: -- GitHub user tgroh opened a pull request:

[GitHub] beam pull request #2540: [BEAM-1928] Translate PTransforms to and from Runne...

2017-04-14 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2540 [BEAM-1928] Translate PTransforms to and from Runner API Protos Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR

[2/3] beam git commit: [BEAM-1964] Fix lint issues for linter upgrade -2

2017-04-14 Thread altay
[BEAM-1964] Fix lint issues for linter upgrade -2 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bf474a0b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bf474a0b Diff:

[GitHub] beam pull request #2539: [BEAM-1964] Fix lint issues for linter upgrade -2

2017-04-14 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2539 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/3] beam git commit: [BEAM-1964] Fix lint issues for linter upgrade -3

2017-04-14 Thread altay
Repository: beam Updated Branches: refs/heads/master cf9ac454d -> 89ff0b145 [BEAM-1964] Fix lint issues for linter upgrade -3 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bd79f4d8 Tree:

[3/3] beam git commit: This closes #2539

2017-04-14 Thread altay
This closes #2539 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/89ff0b14 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/89ff0b14 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/89ff0b14 Branch:

[jira] [Commented] (BEAM-1964) Upgrade pylint to 1.7.0

2017-04-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969467#comment-15969467 ] ASF GitHub Bot commented on BEAM-1964: -- Github user asfgit closed the pull request at:

[jira] [Assigned] (BEAM-1964) Upgrade pylint to 1.7.0

2017-04-14 Thread Sourabh Bajaj (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sourabh Bajaj reassigned BEAM-1964: --- Assignee: Sourabh Bajaj (was: Ahmet Altay) > Upgrade pylint to 1.7.0 >

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #2837

2017-04-14 Thread Apache Jenkins Server
See

Jenkins build is back to normal : beam_PostCommit_Python_Verify #1862

2017-04-14 Thread Apache Jenkins Server
See

[2/4] beam git commit: Rename DoFn.Context#sideOutput to output

2017-04-14 Thread tgroh
http://git-wip-us.apache.org/repos/asf/beam/blob/113471d6/sdks/java/core/src/test/java/org/apache/beam/sdk/values/TypedPValueTest.java -- diff --git a/sdks/java/core/src/test/java/org/apache/beam/sdk/values/TypedPValueTest.java

Jenkins build is unstable: beam_PostCommit_Java_ValidatesRunner_Apex #1093

2017-04-14 Thread Apache Jenkins Server
See

[GitHub] beam pull request #2543: [BEAM-1956] Modify types for input PCollections of ...

2017-04-14 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2543 [BEAM-1956] Modify types for input PCollections of Flatten transform Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #2836

2017-04-14 Thread Apache Jenkins Server
See

[GitHub] beam pull request #2542: [BEAM-1964] Fix lint issues and pylint upgrade

2017-04-14 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/2542 [BEAM-1964] Fix lint issues and pylint upgrade Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

Build failed in Jenkins: beam_PostCommit_Python_Verify #1861

2017-04-14 Thread Apache Jenkins Server
See Changes: [dhalperi] Avoi repackaging bigtable classes in dataflow runner. -- [...truncated 716.47 KB...] File "/usr/lib/python2.7/pickle.py", line 286,

[jira] [Commented] (BEAM-1956) Flatten operation should respect input type hints.

2017-04-14 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969521#comment-15969521 ] ASF GitHub Bot commented on BEAM-1956: -- GitHub user vikkyrk opened a pull request:

[jira] [Commented] (BEAM-1980) Seeming deadlock using Apex with relatively small data

2017-04-14 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1980?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15969586#comment-15969586 ] Thomas Weise commented on BEAM-1980: Did the stalled run produce the expected output and just not exit