[jira] [Created] (BEAM-2653) Python SDK missing OrderByKey

Shahar Frank created BEAM-2653: -- Summary: Python SDK missing OrderByKey Key: BEAM-2653 URL: https://issues.apache.org/jira/browse/BEAM-2653 Project: Beam Issue Type: New Feature

[GitHub] beam pull request #3611: [BEAM-79] merge gearpump-runner into master

GitHub user manuzhang opened a pull request: https://github.com/apache/beam/pull/3611 [BEAM-79] merge gearpump-runner into master Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[jira] [Commented] (BEAM-79) Gearpump runner

[ https://issues.apache.org/jira/browse/BEAM-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095850#comment-16095850 ] ASF GitHub Bot commented on BEAM-79: GitHub user manuzhang opened a pull request:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3624

See

[GitHub] beam pull request #3612: Kafka exactly-once sink.

GitHub user rangadi opened a pull request: https://github.com/apache/beam/pull/3612 Kafka exactly-once sink. Implementation of an exactly-once sink for Kafka, making use of transactions added in Kafka 0.11. This requires exact-once semantics for runners similar to Dataflow.

Jenkins build is unstable: beam_PostCommit_Java_MavenInstall #4423

See

Build failed in Jenkins: beam_PerformanceTests_Python #125

See -- Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam6 (beam) in workspace

[jira] [Commented] (BEAM-2653) Python SDK missing OrderByKey

[ https://issues.apache.org/jira/browse/BEAM-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16095899#comment-16095899 ] Shahar Frank commented on BEAM-2653: Link to Stackoverflow for tracking:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2676

See

Build failed in Jenkins: beam_PerformanceTests_JDBC #175

See -- [...truncated 25.44 KB...] [INFO] Replacing original test artifact with shaded test artifact. [INFO] Replacing

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3456

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3461

See

[1/2] beam git commit: Use RehydratedComponents for memoized rehydration

Repository: beam Updated Branches: refs/heads/master b6f126dc6 -> f870bf516 Use RehydratedComponents for memoized rehydration Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/01492e69 Tree:

[2/2] beam git commit: This closes #3601: Use RehydratedComponents for memoized rehydration

This closes #3601: Use RehydratedComponents for memoized rehydration Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f870bf51 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f870bf51 Diff:

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4425

See

[GitHub] beam pull request #3609: [BEAM-2371] Use dehydration-insensitive APIs in Win...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3609 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Use dehydration-insensitive APIs in WindowEvaluatorFactory

Repository: beam Updated Branches: refs/heads/master f870bf516 -> 8bd647596 Use dehydration-insensitive APIs in WindowEvaluatorFactory Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e38dc5fb Tree:

[2/2] beam git commit: This closes #3609: Use dehydration-insensitive APIs in WindowEvaluatorFactory

This closes #3609: Use dehydration-insensitive APIs in WindowEvaluatorFactory Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8bd64759 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8bd64759 Diff:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3458

See

[jira] [Commented] (BEAM-2371) Make Java DirectRunner demonstrate language-agnostic Runner API translation wrappers

[ https://issues.apache.org/jira/browse/BEAM-2371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096726#comment-16096726 ] ASF GitHub Bot commented on BEAM-2371: -- Github user asfgit closed the pull request at:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3459

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2680

See

[2/2] beam git commit: Register a PTransformTranslator for Combine

Register a PTransformTranslator for Combine Include the Combine Payload in the Runner API Graph. Add getCombineFn(AppliedPTransform) to extract the CombineFn from an arbitrary transform. Update Pipeline Translation tests to include accumulator coders. Project:

[jira] [Commented] (BEAM-2655) Improve Python API reference generation

[ https://issues.apache.org/jira/browse/BEAM-2655?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096544#comment-16096544 ] ASF GitHub Bot commented on BEAM-2655: -- GitHub user davidcavazos opened a pull request:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2678

See

[GitHub] beam pull request #3614: [BEAM-2652] cleanup pom.xml

GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3614 [BEAM-2652] cleanup pom.xml R: @kennknowles @rangadi @rangadi I also update pom.xml in kafka-io as now kafka-client is shared in multiple modules. You can merge this pull request into a

Build failed in Jenkins: beam_PerformanceTests_Python #127

See Changes: [tgroh] Register a PTransformTranslator for Combine [klk] Use RehydratedComponents for memoized rehydration [klk] Use dehydration-insensitive APIs in WindowEvaluatorFactory

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Apex #2036

See

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Apex #2035

See Changes: [tgroh] Register a PTransformTranslator for Combine -- [...truncated 53.91 KB...] 2017-07-21T17:06:14.763 [INFO] Downloaded:

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Dataflow #3626

See Changes: [tgroh] Register a PTransformTranslator for Combine -- [...truncated 91.02 KB...] 2017-07-21T17:06:15.756 [INFO] Downloaded:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3460

See

Jenkins build is back to normal : beam_PostCommit_Python_Verify #2775

See

[GitHub] beam pull request #3613: [BEAM-2655] Makes Python API reference generation m...

GitHub user davidcavazos opened a pull request: https://github.com/apache/beam/pull/3613 [BEAM-2655] Makes Python API reference generation more strict This changes the Python API reference theme to something more readable. It also makes cross reference checking more strict and

[jira] [Commented] (BEAM-2652) cleanup pom.xml

[ https://issues.apache.org/jira/browse/BEAM-2652?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096606#comment-16096606 ] ASF GitHub Bot commented on BEAM-2652: -- GitHub user XuMingmin opened a pull request:

[1/2] beam git commit: This closes #3597

Repository: beam Updated Branches: refs/heads/master 1d9160fa3 -> b6f126dc6 This closes #3597 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b6f126dc Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b6f126dc Diff:

[GitHub] beam pull request #3597: [BEAM-2333] Register a PTransformTranslator for Com...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3597 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-2333) Rehydrate Pipeline from Runner API proto

[ https://issues.apache.org/jira/browse/BEAM-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096529#comment-16096529 ] ASF GitHub Bot commented on BEAM-2333: -- Github user asfgit closed the pull request at:

[jira] [Created] (BEAM-2655) Improve Python API reference generation

David Cavazos created BEAM-2655: --- Summary: Improve Python API reference generation Key: BEAM-2655 URL: https://issues.apache.org/jira/browse/BEAM-2655 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-2648) beam_PerformanceTests_Python failing since 2017-07-17

[ https://issues.apache.org/jira/browse/BEAM-2648?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096694#comment-16096694 ] Mark Liu commented on BEAM-2648: fix PR:

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4426

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3457

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2679

See

[1/2] beam git commit: Use dehydration-insensitive APIs in ParDoEvaluatorFactory

Repository: beam Updated Branches: refs/heads/master 8bd647596 -> 4b355844a Use dehydration-insensitive APIs in ParDoEvaluatorFactory Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/fa3a5abb Tree:

[2/2] beam git commit: This closes #3610: Use dehydration-insensitive APIs in ParDoEvaluatorFactory

This closes #3610: Use dehydration-insensitive APIs in ParDoEvaluatorFactory Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4b355844 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/4b355844 Diff:

[GitHub] beam pull request #3610: [BEAM-2371] Use dehydration-insensitive APIs in Par...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3610 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #3608: Uniquify application nodes in TextIOReadTest and only run pipeline once

This closes #3608: Uniquify application nodes in TextIOReadTest and only run pipeline once Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/81c2e90f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/81c2e90f Diff:

[1/2] beam git commit: Uniquify application nodes in TextIOReadTest and only run pipeline once

Repository: beam Updated Branches: refs/heads/master 4b355844a -> 81c2e90f3 Uniquify application nodes in TextIOReadTest and only run pipeline once - These nodes have never had stable unique names, but we have always mutated the pipeline before running it so they got lucky. - A pipeline

[GitHub] beam pull request #3608: Uniquify application nodes in TextIOReadTest

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3608 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Build failed in Jenkins: beam_PerformanceTests_Python #126

See -- Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam3 (beam) in workspace

Build failed in Jenkins: beam_PerformanceTests_JDBC #176

See -- [...truncated 25.44 KB...] [INFO] Replacing original test artifact with shaded test artifact. [INFO] Replacing

[jira] [Commented] (BEAM-2499) Support Custom Windows in Spark runner

[ https://issues.apache.org/jira/browse/BEAM-2499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096196#comment-16096196 ] Etienne Chauchot commented on BEAM-2499: I'm renaming this ticket and closing the above PR because

[jira] [Commented] (BEAM-2499) Support Custom Windows in Spark runner

[ https://issues.apache.org/jira/browse/BEAM-2499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096199#comment-16096199 ] ASF GitHub Bot commented on BEAM-2499: -- Github user echauchot closed the pull request at:

[GitHub] beam pull request #3517: [BEAM-2499] Make SparkAbstractCombineFn generic to ...

Github user echauchot closed the pull request at: https://github.com/apache/beam/pull/3517 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-2230) Core SDK ApiSurface should be only org.apache.beam.sdk and should be defined outside of the general ApiSurface class

[ https://issues.apache.org/jira/browse/BEAM-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096209#comment-16096209 ] ASF GitHub Bot commented on BEAM-2230: -- GitHub user evindj reopened a pull request:

[jira] [Commented] (BEAM-2230) Core SDK ApiSurface should be only org.apache.beam.sdk and should be defined outside of the general ApiSurface class

[ https://issues.apache.org/jira/browse/BEAM-2230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096208#comment-16096208 ] ASF GitHub Bot commented on BEAM-2230: -- Github user evindj closed the pull request at:

[jira] [Updated] (BEAM-2499) Support Custom Windows in Spark runner

[ https://issues.apache.org/jira/browse/BEAM-2499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-2499: --- Summary: Support Custom Windows in Spark runner (was: Fail to merge Custom Windows in Spark

[GitHub] beam pull request #3533: [BEAM-2230] ApiSurface Refactoring

Github user evindj closed the pull request at: https://github.com/apache/beam/pull/3533 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3533: [BEAM-2230] ApiSurface Refactoring

GitHub user evindj reopened a pull request: https://github.com/apache/beam/pull/3533 [BEAM-2230] ApiSurface Refactoring Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is formatted like:

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4428

See

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4429

See

Jenkins build is unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3627

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2681

See

[jira] [Commented] (BEAM-2656) Introduce AvroIO.readAll()

[ https://issues.apache.org/jira/browse/BEAM-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096903#comment-16096903 ] Chamikara Jayalath commented on BEAM-2656: -- I created

[jira] [Created] (BEAM-2656) Introduce AvroIO.readAll()

Eugene Kirpichov created BEAM-2656: -- Summary: Introduce AvroIO.readAll() Key: BEAM-2656 URL: https://issues.apache.org/jira/browse/BEAM-2656 Project: Beam Issue Type: Bug

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4427

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2682

See

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4430

See

[jira] [Commented] (BEAM-2656) Introduce AvroIO.readAll()

[ https://issues.apache.org/jira/browse/BEAM-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096888#comment-16096888 ] Ahmet Altay commented on BEAM-2656: --- [~chamikara] Should we have python equivalent for {{readAll}}? >

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3628

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2677

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3625

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3455

See

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4424

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3462

See

Jenkins build is unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3631

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2684

See

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4431

See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Flink #3463

See

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4432

See Changes: [kirpichov] Unbreaks AvroSource compatibility with Dataflow worker -- [...truncated 1.07 MB...] 2017-07-22T02:13:03.229 [INFO] Downloading:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3629

See

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Dataflow #3630

See -- GitHub pull request #3616 of commit 4f7d0b4ed70b40443aede1ce28d0939f08b1d04f, no merge conflicts. [EnvInject] - Loading node environment variables.

[GitHub] beam pull request #3616: Unbreaks AvroSource compatibility with Dataflow wor...

GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/3616 Unbreaks AvroSource compatibility with Dataflow worker R: @kennknowles You can merge this pull request into a Git repository by running: $ git pull https://github.com/jkff/incubator-beam

Build failed in Jenkins: beam_PerformanceTests_Python #128

See Changes: [klk] Uniquify application nodes in TextIOReadTest and only run pipeline once [klk] Use dehydration-insensitive APIs in ParDoEvaluatorFactory --

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2683

See

[GitHub] beam pull request #3616: Unbreaks AvroSource compatibility with Dataflow wor...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3616 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Unbreaks AvroSource compatibility with Dataflow worker

Repository: beam Updated Branches: refs/heads/master 81c2e90f3 -> f39874860 Unbreaks AvroSource compatibility with Dataflow worker Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/4f7d0b4e Tree:

[2/2] beam git commit: This closes #3616: Unbreaks AvroSource compatibility with Dataflow worker

This closes #3616: Unbreaks AvroSource compatibility with Dataflow worker Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f3987486 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f3987486 Diff:

[GitHub] beam pull request #3615: [BEAM-2656] Introduces AvroIO.readAll()

GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/3615 [BEAM-2656] Introduces AvroIO.readAll() This includes a couple more improvements: - Adding ValueProvider support to AvroIO.read() - Creating a common utility transform for reading a

[jira] [Commented] (BEAM-2656) Introduce AvroIO.readAll()

[ https://issues.apache.org/jira/browse/BEAM-2656?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096882#comment-16096882 ] ASF GitHub Bot commented on BEAM-2656: -- GitHub user jkff opened a pull request:

[GitHub] beam pull request #3601: [BEAM-2333] Use RehydratedComponents for memoized r...

Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3601 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-2333) Rehydrate Pipeline from Runner API proto

[ https://issues.apache.org/jira/browse/BEAM-2333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096675#comment-16096675 ] ASF GitHub Bot commented on BEAM-2333: -- Github user asfgit closed the pull request at:

[jira] [Created] (BEAM-2654) io-it-suite profile: support ability to use other runners

Stephen Sisk created BEAM-2654: -- Summary: io-it-suite profile: support ability to use other runners Key: BEAM-2654 URL: https://issues.apache.org/jira/browse/BEAM-2654 Project: Beam Issue Type:

[jira] [Commented] (BEAM-2653) Python SDK missing OrderByKey

[ https://issues.apache.org/jira/browse/BEAM-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096509#comment-16096509 ] Shahar Frank commented on BEAM-2653: Sorry my bad - I thought it was a PTransform. I'll go over it

[jira] [Closed] (BEAM-2653) Python SDK missing OrderByKey

[ https://issues.apache.org/jira/browse/BEAM-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shahar Frank closed BEAM-2653. -- Resolution: Not A Problem Fix Version/s: Not applicable > Python SDK missing OrderByKey >

[jira] [Assigned] (BEAM-2653) Python SDK missing OrderByKey

[ https://issues.apache.org/jira/browse/BEAM-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-2653: - Assignee: (was: Frances Perry) > Python SDK missing OrderByKey >

[jira] [Commented] (BEAM-2653) Python SDK missing OrderByKey

[ https://issues.apache.org/jira/browse/BEAM-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16096437#comment-16096437 ] Ahmet Altay commented on BEAM-2653: --- [~srfrnk] Could you describe what are you trying to accomplish?

[jira] [Updated] (BEAM-2653) Python SDK missing OrderByKey

[ https://issues.apache.org/jira/browse/BEAM-2653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-2653: -- Priority: Minor (was: Critical) > Python SDK missing OrderByKey > - > >