Jenkins build is back to stable : beam_PostCommit_RunnableOnService_SparkLocal #187

See

[1/2] incubator-beam git commit: Improve GcsIO throughput by 10x

Repository: incubator-beam Updated Branches: refs/heads/python-sdk cce4331dc -> c1440f7aa Improve GcsIO throughput by 10x This change increases the read buffer used from 1M to 16M. Previously, the speed of reading an incompressible file were: (50 MB: 3.17 MB/s, 100 MB: 3.79 MB/s, 200 MB:

[2/2] incubator-beam git commit: Closes #1379

Closes #1379 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/c1440f7a Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/c1440f7a Diff:

[jira] [Commented] (BEAM-101) Data-driven triggers

[ https://issues.apache.org/jira/browse/BEAM-101?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15678424#comment-15678424 ] ASF GitHub Bot commented on BEAM-101: - GitHub user katsiapis opened a pull request:

[GitHub] incubator-beam pull request #1392: [BEAM-101] A few improvements to Apache B...

GitHub user katsiapis opened a pull request: https://github.com/apache/incubator-beam/pull/1392 [BEAM-101] A few improvements to Apache Beam Python's FileIO. - Ensuring that AUTO compression works properly for FileSinks. - Introducing __enter__ and __exit__ in _CompressedFile to

[jira] [Created] (BEAM-1015) Need language specific tabs that allow both regular text and code blocks

Melissa Pashniak created BEAM-1015: -- Summary: Need language specific tabs that allow both regular text and code blocks Key: BEAM-1015 URL: https://issues.apache.org/jira/browse/BEAM-1015 Project:

[jira] [Created] (BEAM-1014) Anchor target ends up hidden behind the top nav bar

Melissa Pashniak created BEAM-1014: -- Summary: Anchor target ends up hidden behind the top nav bar Key: BEAM-1014 URL: https://issues.apache.org/jira/browse/BEAM-1014 Project: Beam Issue

[jira] [Updated] (BEAM-1013) Recheck all existing programming guide code snippets for correctness

[ https://issues.apache.org/jira/browse/BEAM-1013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Melissa Pashniak updated BEAM-1013: --- Issue Type: Bug (was: Improvement) > Recheck all existing programming guide code snippets for

[jira] [Created] (BEAM-1013) Recheck all existing programming guide code snippets for correctness

Melissa Pashniak created BEAM-1013: -- Summary: Recheck all existing programming guide code snippets for correctness Key: BEAM-1013 URL: https://issues.apache.org/jira/browse/BEAM-1013 Project: Beam

[jira] [Created] (BEAM-1012) Add data encoding section

Melissa Pashniak created BEAM-1012: -- Summary: Add data encoding section Key: BEAM-1012 URL: https://issues.apache.org/jira/browse/BEAM-1012 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-1011) Add Windowing/Triggers section

Melissa Pashniak created BEAM-1011: -- Summary: Add Windowing/Triggers section Key: BEAM-1011 URL: https://issues.apache.org/jira/browse/BEAM-1011 Project: Beam Issue Type: Sub-task

[jira] [Commented] (BEAM-1010) Custom FileSinks should respect AUTO compression

[ https://issues.apache.org/jira/browse/BEAM-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15678338#comment-15678338 ] ASF GitHub Bot commented on BEAM-1010: -- Github user katsiapis closed the pull request at:

[GitHub] incubator-beam pull request #1391: [BEAM-1010] A few improvements to Apache ...

Github user katsiapis closed the pull request at: https://github.com/apache/incubator-beam/pull/1391 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #1391: [BEAM-1010] A few improvements to Apache ...

GitHub user katsiapis opened a pull request: https://github.com/apache/incubator-beam/pull/1391 [BEAM-1010] A few improvements to Apache Beam Python's FileIO. - Ensuring that AUTO compression works properly for FileSinks. - Introducing __enter__ and __exit__ in _CompressedFile

[jira] [Commented] (BEAM-1010) Custom FileSinks should respect AUTO compression

[ https://issues.apache.org/jira/browse/BEAM-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15678335#comment-15678335 ] ASF GitHub Bot commented on BEAM-1010: -- GitHub user katsiapis opened a pull request:

[jira] [Updated] (BEAM-1010) Custom FileSinks should respect AUTO compression

[ https://issues.apache.org/jira/browse/BEAM-1010?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantinos Katsiapis updated BEAM-1010: - Description: Currently AUTO compression is respected by Native FileSinks but not

[jira] [Created] (BEAM-1010) Custom FileSinks should respect AUTO compression

Konstantinos Katsiapis created BEAM-1010: Summary: Custom FileSinks should respect AUTO compression Key: BEAM-1010 URL: https://issues.apache.org/jira/browse/BEAM-1010 Project: Beam

Jenkins build became unstable: beam_PostCommit_RunnableOnService_SparkLocal #186

See

[jira] [Created] (BEAM-1009) Upgrade from mockito-all 1 to mockito-core 2

Pei He created BEAM-1009: Summary: Upgrade from mockito-all 1 to mockito-core 2 Key: BEAM-1009 URL: https://issues.apache.org/jira/browse/BEAM-1009 Project: Beam Issue Type: Test

[jira] [Assigned] (BEAM-1009) Upgrade from mockito-all 1 to mockito-core 2

[ https://issues.apache.org/jira/browse/BEAM-1009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He reassigned BEAM-1009: Assignee: Pei He > Upgrade from mockito-all 1 to mockito-core 2 >

[GitHub] incubator-beam pull request #1390: Jenkins DSL Config

GitHub user jasonkuster opened a pull request: https://github.com/apache/incubator-beam/pull/1390 Jenkins DSL Config Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

[jira] [Created] (BEAM-1008) KeyedWorkItemCoder claims three coder arguments in getCoderArguments but only has two generic type variables

Kenneth Knowles created BEAM-1008: - Summary: KeyedWorkItemCoder claims three coder arguments in getCoderArguments but only has two generic type variables Key: BEAM-1008 URL:

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1605

See

[jira] [Commented] (BEAM-23) User-facing state and timers for ParDo(DoFn)

[ https://issues.apache.org/jira/browse/BEAM-23?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15678060#comment-15678060 ] ASF GitHub Bot commented on BEAM-23: Github user asfgit closed the pull request at:

[3/6] incubator-beam git commit: Separate ParDoTest cases and make them more flexible

Separate ParDoTest cases and make them more flexible A number of excessively rigid name tests preclude runner expansion of ParDo. This change makes them into independent unit tests for better signal and makes them more accurate to the intent - the name should have the relevant information, but

[2/6] incubator-beam git commit: Use getNewFn for coder inferences in ParDo

Use getNewFn for coder inferences in ParDo Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/34e2a352 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/34e2a352 Diff:

[5/6] incubator-beam git commit: DirectRunner: Expand ParDo.Bound into ParDo.BoundMulti

DirectRunner: Expand ParDo.Bound into ParDo.BoundMulti Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/f86e98c9 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/f86e98c9 Diff:

[GitHub] incubator-beam pull request #1378: [BEAM-23] DirectRunner: rewrite single-ou...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1378 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[6/6] incubator-beam git commit: Delegate getAggregators() in various DoFn adapters

Delegate getAggregators() in various DoFn adapters Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/b0d46c2d Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/b0d46c2d Diff:

[1/6] incubator-beam git commit: This closes #1378

Repository: incubator-beam Updated Branches: refs/heads/master 3548ffb06 -> d93e9a88b This closes #1378 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/d93e9a88 Tree:

[4/6] incubator-beam git commit: Do not override type descriptor in WithTimestamps

Do not override type descriptor in WithTimestamps Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/6fa8057f Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/6fa8057f Diff:

[2/2] incubator-beam git commit: This closes #1389

This closes #1389 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3548ffb0 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/3548ffb0 Diff:

[GitHub] incubator-beam pull request #1389: Restore StateContexts.windowOnly for temp...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1389 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Restore StateContexts.windowOnly for temporary compatibility

Repository: incubator-beam Updated Branches: refs/heads/master 2a7169b6f -> 3548ffb06 Restore StateContexts.windowOnly for temporary compatibility Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/73692b80

[jira] [Updated] (BEAM-1007) Runner Toggles in Quickstart.md Don't Work in Safari

[ https://issues.apache.org/jira/browse/BEAM-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek updated BEAM-1007: --- Attachment: Screen Shot 2016-11-19 at 00.00.45.png > Runner Toggles in Quickstart.md Don't

[jira] [Commented] (BEAM-1007) Runner Toggles in Quickstart.md Don't Work in Safari

[ https://issues.apache.org/jira/browse/BEAM-1007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15678046#comment-15678046 ] Aljoscha Krettek commented on BEAM-1007: [~mabdullah353], I assigned to you because you initially

[jira] [Created] (BEAM-1007) Runner Toggles in Quickstart.md Don't Work in Safari

Aljoscha Krettek created BEAM-1007: -- Summary: Runner Toggles in Quickstart.md Don't Work in Safari Key: BEAM-1007 URL: https://issues.apache.org/jira/browse/BEAM-1007 Project: Beam Issue

[jira] [Commented] (BEAM-795) org.apache.beam.sdk.io.ReadTest.testStreamingPrimitiveDisplayData failing in Dataflow RunnableOnService

[ https://issues.apache.org/jira/browse/BEAM-795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15677994#comment-15677994 ] Scott Wegner commented on BEAM-795: --- This is done. [~jasonkuster] can you close? >

[GitHub] incubator-beam pull request #1389: Restore StateContexts.windowOnly for temp...

GitHub user kennknowles opened a pull request: https://github.com/apache/incubator-beam/pull/1389 Restore StateContexts.windowOnly for temporary compatibility Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make

[jira] [Closed] (BEAM-767) Add DisplayData builder '.nested(..)' operation

[ https://issues.apache.org/jira/browse/BEAM-767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Wegner closed BEAM-767. - > Add DisplayData builder '.nested(..)' operation > --- > >

[jira] [Commented] (BEAM-767) Add DisplayData builder '.nested(..)' operation

[ https://issues.apache.org/jira/browse/BEAM-767?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15677988#comment-15677988 ] Scott Wegner commented on BEAM-767: --- After chatting with @lukecwik, we decided that it was confusing to

[jira] [Resolved] (BEAM-767) Add DisplayData builder '.nested(..)' operation

[ https://issues.apache.org/jira/browse/BEAM-767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Scott Wegner resolved BEAM-767. --- Resolution: Won't Fix Fix Version/s: Not applicable > Add DisplayData builder '.nested(..)'

[jira] [Commented] (BEAM-498) Make DoFnWithContext the new DoFn

[ https://issues.apache.org/jira/browse/BEAM-498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15677946#comment-15677946 ] ASF GitHub Bot commented on BEAM-498: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #1386: [BEAM-498] Move DoFn.ArgumentProvider to ...

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1386 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: This closes #1386

This closes #1386 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/2a7169b6 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/2a7169b6 Diff:

[1/2] incubator-beam git commit: Move DoFn.ArgumentProvider to DoFnInvoker.ArgumentProvider

Repository: incubator-beam Updated Branches: refs/heads/master bb9c38664 -> 2a7169b6f Move DoFn.ArgumentProvider to DoFnInvoker.ArgumentProvider The arguments provided as a single object are an aspect of the DoFnInvoker, not the DoFn. The DoFn itself is a specification that may have other

[GitHub] incubator-beam pull request #1385: Fixes couple of issues of FileBasedSource...

Github user chamikaramj closed the pull request at: https://github.com/apache/incubator-beam/pull/1385 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #1383: Remove redundant REQUIRED_TEST_PACKAGES

Github user aaltay closed the pull request at: https://github.com/apache/incubator-beam/pull/1383 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: Closes #1380

Closes #1380 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/cce4331d Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/cce4331d Diff:

[1/2] incubator-beam git commit: Fix issue where batch GCS renames were not issued

Repository: incubator-beam Updated Branches: refs/heads/python-sdk 45b420d82 -> cce4331dc Fix issue where batch GCS renames were not issued Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/99bcafe7 Tree:

[1/2] incubator-beam git commit: Remove redundant REQUIRED_PACKAGES

Repository: incubator-beam Updated Branches: refs/heads/python-sdk 3a0f01c8e -> 45b420d82 Remove redundant REQUIRED_PACKAGES Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/329be6e9 Tree:

[2/2] incubator-beam git commit: Closes #1383

Closes #1383 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/45b420d8 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/45b420d8 Diff:

[2/2] incubator-beam git commit: Closes #1385

Closes #1385 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3a0f01c8 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/3a0f01c8 Diff:

[1/2] incubator-beam git commit: Fixes a couple of issues of FileBasedSource.

Repository: incubator-beam Updated Branches: refs/heads/python-sdk b83f12b9f -> 3a0f01c8e Fixes a couple of issues of FileBasedSource. (1) Updates code so that a user-specified coder properly gets set to sub-sources. (2) Currently each SingleFileSource takes a reference to FileBasedSource

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1604

See

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1603

See

[GitHub] incubator-beam pull request #1388: Move PerKeyCombineFnRunners to runners/co...

GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1388 Move PerKeyCombineFnRunners to runners/core. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

Jenkins build is still unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1602

See

[jira] [Updated] (BEAM-436) DirectRunner RunnableOnService tempLocation configuration insufficient

[ https://issues.apache.org/jira/browse/BEAM-436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-436: -- Assignee: Scott Wegner (was: Davor Bonaci) > DirectRunner RunnableOnService tempLocation configuration

[1/2] incubator-beam git commit: Closes #1381

Repository: incubator-beam Updated Branches: refs/heads/master 4852d2ebf -> bb9c38664 Closes #1381 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/bb9c3866 Tree:

[GitHub] incubator-beam pull request #1381: Remove dead code from MetricsContainer

Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1381 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[2/2] incubator-beam git commit: Remove dead code from MetricsContainer

Remove dead code from MetricsContainer Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/5fc68a5c Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/5fc68a5c Diff:

[jira] [Commented] (BEAM-1006) splitKeysToFilter method is creating a bad query string.

[ https://issues.apache.org/jira/browse/BEAM-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15677065#comment-15677065 ] David Billings commented on BEAM-1006: -- I've fixed in PR

[jira] [Issue Comment Deleted] (BEAM-1006) splitKeysToFilter method is creating a bad query string.

[ https://issues.apache.org/jira/browse/BEAM-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Billings updated BEAM-1006: - Comment: was deleted (was: I've fixed in PR https://github.com/apache/incubator-beam/pull/1387

[GitHub] incubator-beam pull request #1387: [BEAM-1006] Fixing the splitKeysToFilters...

GitHub user david-billings opened a pull request: https://github.com/apache/incubator-beam/pull/1387 [BEAM-1006] Fixing the splitKeysToFilters methofd as calling toString on the Document prefixed …"Document" Be sure to do all of the following to help us incorporate your

[jira] [Commented] (BEAM-1006) splitKeysToFilter method is creating a bad query string.

[ https://issues.apache.org/jira/browse/BEAM-1006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15677058#comment-15677058 ] ASF GitHub Bot commented on BEAM-1006: -- GitHub user david-billings opened a pull request:

[jira] [Created] (BEAM-1006) splitKeysToFilter method is creating a bad query string.

David Billings created BEAM-1006: Summary: splitKeysToFilter method is creating a bad query string. Key: BEAM-1006 URL: https://issues.apache.org/jira/browse/BEAM-1006 Project: Beam Issue

[GitHub] incubator-beam pull request #1354: Add IP configuration to Python SDK

Github user sammcveety closed the pull request at: https://github.com/apache/incubator-beam/pull/1354 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Updated] (BEAM-920) Support triggers and panes in streaming.

[ https://issues.apache.org/jira/browse/BEAM-920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-920: --- Description: Implement event-time based aggregation using triggers, panes and watermarks. (was: Use Spark's

[jira] [Updated] (BEAM-920) Support triggers, panes and watermarks.

[ https://issues.apache.org/jira/browse/BEAM-920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela updated BEAM-920: --- Issue Type: New Feature (was: Bug) > Support triggers, panes and watermarks. >

Jenkins build became unstable: beam_PostCommit_RunnableOnService_GoogleCloudDataflow #1600

See