Build failed in Jenkins: beam_PerformanceTests_JDBC #201

2017-09-19 Thread Apache Jenkins Server
See Changes: [robertwb] Add option for toProto/fromProto translations in DirectRunner, disabled [robertwb] Fix typo in variable name: window_fn --> windowfn [iemejia] [BEAM-2764] Change document size

Build failed in Jenkins: beam_PerformanceTests_JDBC #202

2017-09-19 Thread Apache Jenkins Server
See -- GitHub pull request #3668 of commit b76e566d26be4ab9eefe83308402116225ff49bc, no merge conflicts. Setting status of b76e566d26be4ab9eefe83308402116225ff49bc to PENDING

[jira] [Commented] (BEAM-2271) Release guide or pom.xml needs update to avoid releasing Python binary artifacts

2017-09-19 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172651#comment-16172651 ] Kenneth Knowles commented on BEAM-2271: --- It looks like the PR was closed but not merged. I expect

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4829

2017-09-19 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2271) Release guide or pom.xml needs update to avoid releasing Python binary artifacts

2017-09-19 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172623#comment-16172623 ] Reuven Lax commented on BEAM-2271: -- Can this bug be closed now? > Release guide or pom.xml needs update

[jira] [Commented] (BEAM-2576) Move non-core transform payloads out of Runner API proto

2017-09-19 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172624#comment-16172624 ] Reuven Lax commented on BEAM-2576: -- Moving to 2.3.0 > Move non-core transform payloads out of Runner API

[jira] [Updated] (BEAM-2576) Move non-core transform payloads out of Runner API proto

2017-09-19 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reuven Lax updated BEAM-2576: - Fix Version/s: (was: 2.2.0) 2.3.0 > Move non-core transform payloads out of Runner

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Dataflow #4000

2017-09-19 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2966) Allow subclasses of tuple, list, dict as pvalues.

2017-09-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172441#comment-16172441 ] ASF GitHub Bot commented on BEAM-2966: -- Github user asfgit closed the pull request at:

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4828

2017-09-19 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-2603) Add Meter in beam metrics

2017-09-19 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2603?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reuven Lax updated BEAM-2603: - Fix Version/s: (was: 2.2.0) 2.3.0 > Add Meter in beam metrics >

[jira] [Updated] (BEAM-2604) Delegate beam metrics to runners

2017-09-19 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reuven Lax updated BEAM-2604: - Fix Version/s: (was: 2.2.0) 2.3.0 > Delegate beam metrics to runners >

Build failed in Jenkins: beam_PerformanceTests_JDBC #204

2017-09-19 Thread Apache Jenkins Server
See Changes: [chamikara] Updates. -- GitHub pull request #3668 of commit 59a80e4a72f61dfe9122105e7995b6f4fa834cf3, no merge conflicts. Setting status of

[jira] [Commented] (BEAM-1868) CreateStreamTest testMultiOutputParDo is flaky on the Spark runner

2017-09-19 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1868?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172620#comment-16172620 ] Reuven Lax commented on BEAM-1868: -- This still hasn't been worked on AFAICT, so bumping to 2.3.0. >

[jira] [Updated] (BEAM-1868) CreateStreamTest testMultiOutputParDo is flaky on the Spark runner

2017-09-19 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1868?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reuven Lax updated BEAM-1868: - Fix Version/s: (was: 2.2.0) 2.3.0 > CreateStreamTest testMultiOutputParDo is flaky

[jira] [Updated] (BEAM-2345) Version configuration of plugins / dependencies in root pom.xml is inconsistent

2017-09-19 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2345?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reuven Lax updated BEAM-2345: - Fix Version/s: (was: 2.2.0) 2.3.0 > Version configuration of plugins / dependencies

[jira] [Commented] (BEAM-2956) DataflowRunner incorrectly reports the user agent for the Dataflow distribution

2017-09-19 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172626#comment-16172626 ] Reuven Lax commented on BEAM-2956: -- Can this be closed? > DataflowRunner incorrectly reports the user

[jira] [Closed] (BEAM-2837) Writing To Spanner From Google Cloud DataFlow - Failure

2017-09-19 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2837. -- Resolution: Fixed Fix Version/s: 2.2.0 > Writing To Spanner From Google Cloud DataFlow -

[GitHub] beam pull request #3870: Marks TikaIO as experimental to allow backward-inco...

2017-09-19 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/3870 Marks TikaIO as experimental to allow backward-incompatible changes R: @jbonofre You can merge this pull request into a Git repository by running: $ git pull

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #4004

2017-09-19 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Python_Verify #3169

2017-09-19 Thread Apache Jenkins Server
See -- [...truncated 43.98 KB...] Collecting crcmod<2.0,>=1.7 (from apache-beam==2.2.0.dev0) Collecting dill==0.2.6 (from apache-beam==2.2.0.dev0) Requirement already

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4827

2017-09-19 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-2970) Add comparator function to equal_to

2017-09-19 Thread Sarah Walters (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sarah Walters updated BEAM-2970: Description: The equal_to function provided by testing/util.py

Jenkins build is unstable: beam_PostCommit_Java_MavenInstall #4823

2017-09-19 Thread Apache Jenkins Server
See

[2/3] beam git commit: Support multiple materializations of the same pvalue.

2017-09-19 Thread robertwb
Support multiple materializations of the same pvalue. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/07c08cc8 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/07c08cc8 Diff:

[1/3] beam git commit: Closes #3831

2017-09-19 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 28d4f0989 -> cfbdb6115 Closes #3831 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/cfbdb611 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/cfbdb611 Diff:

[3/3] beam git commit: Allow subclasses of tuple, list, and dict as pvaluish inputs/outputs.

2017-09-19 Thread robertwb
Allow subclasses of tuple, list, and dict as pvaluish inputs/outputs. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/72960b31 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/72960b31 Diff:

[GitHub] beam pull request #3868: Add Nullable Metric getter to MetricsContainerImpl.

2017-09-19 Thread pedapudi
GitHub user pedapudi opened a pull request: https://github.com/apache/beam/pull/3868 Add Nullable Metric getter to MetricsContainerImpl. MetricsContainerImpl currently creates a Counter with a given name when attempting to read that Counter. In order to read potentially

[jira] [Updated] (BEAM-2970) Add comparator function to equal_to

2017-09-19 Thread Sarah Walters (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sarah Walters updated BEAM-2970: Description: The equal_to function provided by testing/util.py

[1/2] beam git commit: Updates grpc-google-pubsub-v1 to grpc-google-cloud-pubsub-v1

2017-09-19 Thread jkff
Repository: beam Updated Branches: refs/heads/master cfbdb6115 -> e8a52827e Updates grpc-google-pubsub-v1 to grpc-google-cloud-pubsub-v1 This is good because it's a newer version, and because it gets rid of a dependency conflict with Spanner. Project:

[GitHub] beam pull request #3862: [BEAM-2837] Updated grpc-google-pubsub-v1 dependenc...

2017-09-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3862 ---

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4826

2017-09-19 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2837) Writing To Spanner From Google Cloud DataFlow - Failure

2017-09-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2837?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172549#comment-16172549 ] ASF GitHub Bot commented on BEAM-2837: -- Github user asfgit closed the pull request at:

[2/2] beam git commit: This closes #3862: [BEAM-2837] Updated grpc-google-pubsub-v1 dependency

2017-09-19 Thread jkff
This closes #3862: [BEAM-2837] Updated grpc-google-pubsub-v1 dependency Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e8a52827 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e8a52827 Diff:

[GitHub] beam pull request #3869: Remove any_param field from the Runner API

2017-09-19 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/3869 Remove any_param field from the Runner API Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[jira] [Created] (BEAM-2970) Add comparator function to equal_to

2017-09-19 Thread Sarah Walters (JIRA)
Sarah Walters created BEAM-2970: --- Summary: Add comparator function to equal_to Key: BEAM-2970 URL: https://issues.apache.org/jira/browse/BEAM-2970 Project: Beam Issue Type: Improvement

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4819

2017-09-19 Thread Apache Jenkins Server
See -- [...truncated 3.63 MB...] from apitools.base.protorpclite import messages File

[jira] [Resolved] (BEAM-2347) Elasticsearch IO - test ES 5?

2017-09-19 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved BEAM-2347. Resolution: Fixed Fix Version/s: 2.2.0 > Elasticsearch IO - test ES 5? >

Build failed in Jenkins: beam_PostCommit_Python_Verify #3160

2017-09-19 Thread Apache Jenkins Server
See -- [...truncated 44.07 KB...] Requirement already satisfied: grpcio<2.0,>=1.0 in ./target/.tox/py27cython/lib/python2.7/site-packages (from apache-beam==2.2.0.dev0)

[GitHub] beam pull request #3867: Included immediate results after CoGroupByKey for b...

2017-09-19 Thread davidcavazos
GitHub user davidcavazos opened a pull request: https://github.com/apache/beam/pull/3867 Included immediate results after CoGroupByKey for better readability in docs R: @melap R: @aaltay This makes the outputs show the data structures after the `CoGroupByKey`

[GitHub] beam pull request #3831: [BEAM-2966] Allow subclasses of tuple, list, and di...

2017-09-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3831 ---

[jira] [Updated] (BEAM-2299) Beam repo build fails in Windows OS

2017-09-19 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2299?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reuven Lax updated BEAM-2299: - Fix Version/s: (was: 2.2.0) 2.3.0 > Beam repo build fails in Windows OS >

[jira] [Updated] (BEAM-2523) GCP IO exposes protobuf on its API surface, causing user pain

2017-09-19 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reuven Lax updated BEAM-2523: - Fix Version/s: (was: 2.2.0) 2.3.0 > GCP IO exposes protobuf on its API surface,

[jira] [Commented] (BEAM-2299) Beam repo build fails in Windows OS

2017-09-19 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2299?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172173#comment-16172173 ] Reuven Lax commented on BEAM-2299: -- bumping this to 2.3.0 > Beam repo build fails in Windows OS >

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3999

2017-09-19 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4824

2017-09-19 Thread Apache Jenkins Server
See

[GitHub] beam pull request #3827: [BEAM-407] fixes inconsistent synchronization in Of...

2017-09-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3827 ---

[1/2] beam git commit: [BEAM-407] Fixes findbugs warnings in OffsetRangeTracker

2017-09-19 Thread jkff
Repository: beam Updated Branches: refs/heads/master 5dab9e109 -> e7eefddea [BEAM-407] Fixes findbugs warnings in OffsetRangeTracker Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/517192f7 Tree:

[jira] [Closed] (BEAM-407) Inconsistent synchronization in OffsetRangeTracker.copy

2017-09-19 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-407?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-407. - Resolution: Fixed Fix Version/s: 2.2.0 > Inconsistent synchronization in

[jira] [Commented] (BEAM-407) Inconsistent synchronization in OffsetRangeTracker.copy

2017-09-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172326#comment-16172326 ] ASF GitHub Bot commented on BEAM-407: - Github user asfgit closed the pull request at:

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4825

2017-09-19 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1934) Code examples for CoGroupByKey

2017-09-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172216#comment-16172216 ] ASF GitHub Bot commented on BEAM-1934: -- GitHub user davidcavazos opened a pull request:

[2/2] beam git commit: This closes #3827: [BEAM-407] fixes inconsistent synchronization in OffsetRangeTracker.copy

2017-09-19 Thread jkff
This closes #3827: [BEAM-407] fixes inconsistent synchronization in OffsetRangeTracker.copy Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e7eefdde Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e7eefdde Diff:

[4/6] beam git commit: Implement ULR subprocess mode.

2017-09-19 Thread robertwb
Implement ULR subprocess mode. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2999ec9d Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2999ec9d Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/2999ec9d Branch:

[6/6] beam git commit: Closes #3847

2017-09-19 Thread robertwb
Closes #3847 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/28d4f098 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/28d4f098 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/28d4f098 Branch: refs/heads/master

[2/6] beam git commit: Refactor fn api runner into universal local runner.

2017-09-19 Thread robertwb
Refactor fn api runner into universal local runner. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/bd115898 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/bd115898 Diff:

[GitHub] beam pull request #3847: Refactor fn api runner into a universal local runne...

2017-09-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3847 ---

[jira] [Created] (BEAM-2969) BigQueryIO fails when reading then writing timestamps before 1970

2017-09-19 Thread Kevin Peterson (JIRA)
Kevin Peterson created BEAM-2969: Summary: BigQueryIO fails when reading then writing timestamps before 1970 Key: BEAM-2969 URL: https://issues.apache.org/jira/browse/BEAM-2969 Project: Beam

[jira] [Commented] (BEAM-2298) Java WordCount doesn't work in Window OS for glob expressions or file: prefixed paths

2017-09-19 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172175#comment-16172175 ] Reuven Lax commented on BEAM-2298: -- is this fixed? > Java WordCount doesn't work in Window OS for glob

[jira] [Resolved] (BEAM-2829) Add ability to set job labels in DataflowPipelineOptions

2017-09-19 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reuven Lax resolved BEAM-2829. -- Resolution: Fixed > Add ability to set job labels in DataflowPipelineOptions >

[jira] [Closed] (BEAM-2829) Add ability to set job labels in DataflowPipelineOptions

2017-09-19 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reuven Lax closed BEAM-2829. > Add ability to set job labels in DataflowPipelineOptions >

[jira] [Updated] (BEAM-2273) mvn clean doesn't fully clean up archetypes.

2017-09-19 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reuven Lax updated BEAM-2273: - Fix Version/s: (was: 2.2.0) 2.3.0 > mvn clean doesn't fully clean up archetypes. >

[5/6] beam git commit: Lint and documentation.

2017-09-19 Thread robertwb
Lint and documentation. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a1abccda Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a1abccda Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/a1abccda Branch:

[3/6] beam git commit: Allow worker to be started as a subprocess.

2017-09-19 Thread robertwb
Allow worker to be started as a subprocess. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/cb778748 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/cb778748 Diff:

[1/6] beam git commit: Streaming Job API.

2017-09-19 Thread robertwb
Repository: beam Updated Branches: refs/heads/master e7eefddea -> 28d4f0989 Streaming Job API. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8a62ceae Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8a62ceae Diff:

[jira] [Commented] (BEAM-2948) Unable to find registrar when restoring flink job from savepoint

2017-09-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2948?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171426#comment-16171426 ] ASF GitHub Bot commented on BEAM-2948: -- Github user aljoscha closed the pull request at:

[jira] [Closed] (BEAM-2948) Unable to find registrar when restoring flink job from savepoint

2017-09-19 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aljoscha Krettek closed BEAM-2948. -- Resolution: Fixed Fix Version/s: 2.2.0 Fixed in 14ea5abe3c3900e5cb423a8580fbdcc6e28fe376

[GitHub] beam pull request #3855: [BEAM-2948] Register default FileSystems in StreamO...

2017-09-19 Thread aljoscha
Github user aljoscha closed the pull request at: https://github.com/apache/beam/pull/3855 ---

[1/2] beam git commit: [BEAM-2948] Register default FileSystems in StreamOperator.setup()

2017-09-19 Thread aljoscha
Repository: beam Updated Branches: refs/heads/master fdd99650d -> c65aca07f [BEAM-2948] Register default FileSystems in StreamOperator.setup() Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/14ea5abe Tree:

[2/2] beam git commit: This closes #3855

2017-09-19 Thread aljoscha
This closes #3855 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c65aca07 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c65aca07 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/c65aca07 Branch:

Build failed in Jenkins: beam_PostCommit_Python_Verify #3161

2017-09-19 Thread Apache Jenkins Server
See Changes: [aljoscha.krettek] [BEAM-2948] Register default FileSystems in StreamOperator.setup() -- [...truncated 459.31 KB...]

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4820

2017-09-19 Thread Apache Jenkins Server
See Changes: [aljoscha.krettek] [BEAM-2948] Register default FileSystems in StreamOperator.setup() -- [...truncated 3.63 MB...] class

Build failed in Jenkins: beam_PerformanceTests_JDBC #205

2017-09-19 Thread Apache Jenkins Server
See Changes: [chamikara] Updates. -- GitHub pull request #3668 of commit e8fcca5c3306da162cd94f4b8f41a1b322285482, no merge conflicts. Setting status of

Build failed in Jenkins: beam_PerformanceTests_JDBC #208

2017-09-19 Thread Apache Jenkins Server
See -- [...truncated 29.48 KB...] [INFO] Excluding org.slf4j:slf4j-api:jar:1.7.25 from the shaded jar. [INFO] Excluding com.google.auto.service:auto-service:jar:1.0-rc2 from

Build failed in Jenkins: beam_PerformanceTests_JDBC #209

2017-09-19 Thread Apache Jenkins Server
See Changes: [chamikara] Updates. -- GitHub pull request #3668 of commit 8adb779ec7f8b3726928ae3a7ead86bd429bc8bb, no merge conflicts. Setting status of

Build failed in Jenkins: beam_PerformanceTests_JDBC #211

2017-09-19 Thread Apache Jenkins Server
See Changes: [chamikara] Updates. -- [...truncated 115.30 KB...] 2017-09-20 05:20:55,034 69bade6f MainThread beam_integration_benchmark(1/1) ERRORRetrying

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4821

2017-09-19 Thread Apache Jenkins Server
See -- [...truncated 3.63 MB...] File

[jira] [Commented] (BEAM-2945) Nexmark: Fix query9 window merging

2017-09-19 Thread Etienne Chauchot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171701#comment-16171701 ] Etienne Chauchot commented on BEAM-2945: I forgot to put this ticket unassigned at creation time,

[jira] [Assigned] (BEAM-2944) Update Beam capability matrix using Nexmark

2017-09-19 Thread Etienne Chauchot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-2944: -- Assignee: (was: Reuven Lax) > Update Beam capability matrix using Nexmark >

[jira] [Commented] (BEAM-2856) Update Nexmark Query 10 to use AvroIO

2017-09-19 Thread Etienne Chauchot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171713#comment-16171713 ] Etienne Chauchot commented on BEAM-2856: Updating this issue to apply what [~reuvenlax] suggested

[1/3] beam git commit: Move DoFnInfo to SDK util

2017-09-19 Thread kenn
Repository: beam Updated Branches: refs/heads/master c65aca07f -> c25bead55 Move DoFnInfo to SDK util Previously, the DoFnInfo wrapped things just enough for Dataflow to execute a DoFn without much context. The Java SDK harness has the same need, and relies on DoFnInfo. Effectively, DoFnInfo

[GitHub] beam pull request #3858: [BEAM-2884] Move DoFnInfo to SDK util

2017-09-19 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3858 ---

[3/3] beam git commit: This closes #3858: [BEAM-2884] Move DoFnInfo to SDK util

2017-09-19 Thread kenn
This closes #3858: [BEAM-2884] Move DoFnInfo to SDK util Update Dataflow container version to 20170918 Move DoFnInfo to SDK util Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c25bead5 Tree:

[2/3] beam git commit: Update Dataflow container version to 20170918

2017-09-19 Thread kenn
Update Dataflow container version to 20170918 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/056b720c Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/056b720c Diff:

[jira] [Updated] (BEAM-2856) Update Nexmark Query 10 to use AvroIO

2017-09-19 Thread Etienne Chauchot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-2856: --- Summary: Update Nexmark Query 10 to use AvroIO (was: Fix Nexmark Query 10 'log to sharded

[jira] [Assigned] (BEAM-2946) Nexmark: enhance unit tests of queries

2017-09-19 Thread Etienne Chauchot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-2946: -- Assignee: (was: Reuven Lax) > Nexmark: enhance unit tests of queries >

[jira] [Assigned] (BEAM-2945) Nexmark: Fix query9 window merging

2017-09-19 Thread Etienne Chauchot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot reassigned BEAM-2945: -- Assignee: (was: Reuven Lax) > Nexmark: Fix query9 window merging >

[jira] [Commented] (BEAM-2944) Update Beam capability matrix using Nexmark

2017-09-19 Thread Etienne Chauchot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2944?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171703#comment-16171703 ] Etienne Chauchot commented on BEAM-2944: I forgot to put this ticket unassigned at creation time,

[jira] [Commented] (BEAM-2946) Nexmark: enhance unit tests of queries

2017-09-19 Thread Etienne Chauchot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171700#comment-16171700 ] Etienne Chauchot commented on BEAM-2946: I forgot to put this ticket unassigned at creation time,

[GitHub] beam pull request #3863: [Beam-2858] Ensure that file deletion happens consi...

2017-09-19 Thread reuvenlax
GitHub user reuvenlax opened a pull request: https://github.com/apache/beam/pull/3863 [Beam-2858] Ensure that file deletion happens consistently, and only after table loads are completed We do this by adding a GroupByKey between the BQ load and the file deletion. Once the

[jira] [Commented] (BEAM-2500) Add support for S3 as a Apache Beam FileSystem

2017-09-19 Thread Jacob Marble (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171952#comment-16171952 ] Jacob Marble commented on BEAM-2500: Thanks, Steve. Fixed. > Add support for S3 as a Apache Beam

[jira] [Commented] (BEAM-2884) Dataflow runs portable pipelines

2017-09-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171788#comment-16171788 ] ASF GitHub Bot commented on BEAM-2884: -- Github user asfgit closed the pull request at:

Build failed in Jenkins: beam_PostCommit_Python_Verify #3162

2017-09-19 Thread Apache Jenkins Server
See Changes: [klk] Move DoFnInfo to SDK util [klk] Update Dataflow container version to 20170918 -- [...truncated 457.23 KB...]

[jira] [Commented] (BEAM-2500) Add support for S3 as a Apache Beam FileSystem

2017-09-19 Thread Steve Loughran (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2500?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16171891#comment-16171891 ] Steve Loughran commented on BEAM-2500: -- looking at the code, the main thing I'd highlight is that

Build failed in Jenkins: beam_PostCommit_Python_Verify #3163

2017-09-19 Thread Apache Jenkins Server
See -- [...truncated 45.40 KB...] Collecting mock<3.0.0,>=1.0.1 (from apache-beam==2.2.0.dev0) Using cached mock-2.0.0-py2.py3-none-any.whl Collecting

[GitHub] beam pull request #3865: [BEAM-2964] Exclude incompatible six release.

2017-09-19 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3865 [BEAM-2964] Exclude incompatible six release. Upstream bugs being tracked at https://github.com/google/apitools/issues/175 and https://github.com/benjaminp/six/issues/210 Follow this

[jira] [Commented] (BEAM-2870) BQ Partitioned Table Write Fails When Destination has Partition Decorator

2017-09-19 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172081#comment-16172081 ] Reuven Lax commented on BEAM-2870: -- I think the problem is that we need to strip the partition decorator

[jira] [Commented] (BEAM-2834) NullPointerException @ BigQueryServicesImpl.java:759

2017-09-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172075#comment-16172075 ] ASF GitHub Bot commented on BEAM-2834: -- GitHub user reuvenlax opened a pull request:

[GitHub] beam pull request #3864: [BEAM-2834] Ensure that we never pass in a null ret...

2017-09-19 Thread reuvenlax
GitHub user reuvenlax opened a pull request: https://github.com/apache/beam/pull/3864 [BEAM-2834] Ensure that we never pass in a null retry policy R: @jkff You can merge this pull request into a Git repository by running: $ git pull https://github.com/reuvenlax/incubator-beam

[jira] [Commented] (BEAM-2964) Latest six (1.11.0) produces "metaclass conflict: the metaclass of a derived class must be a (non-strict) subclass of the metaclasses of all its bases"

2017-09-19 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16172077#comment-16172077 ] ASF GitHub Bot commented on BEAM-2964: -- GitHub user robertwb opened a pull request:

  1   2   >