[jira] [Commented] (BEAM-3673) FlinkRunner: Harness manager for connecting operators to SDK Harnesses

2018-02-09 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358208#comment-16358208 ] Aljoscha Krettek commented on BEAM-3673: [~bsidhom] Am I supposed to be assigned to all of those

[jira] [Updated] (BEAM-3678) Document "eager mode" for the Python SDK DirectRunner in the website

2018-02-09 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-3678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] María GH updated BEAM-3678: --- Summary: Document "eager mode" for the Python SDK DirectRunner in the website (was: Document "eager mode" in

[jira] [Updated] (BEAM-3253) Support Gradle incremental builds

2018-02-09 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-3253: -- Issue Type: Bug (was: Sub-task) Parent: (was: BEAM-3249) > Support Gradle

[jira] [Commented] (BEAM-3253) Support Gradle incremental builds

2018-02-09 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3253?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358514#comment-16358514 ] Kenneth Knowles commented on BEAM-3253: --- I don't think this is a prerequisite to using Gradle for the

[jira] [Created] (BEAM-3680) Revise code on state & timers blog posts

2018-02-09 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-3680: - Summary: Revise code on state & timers blog posts Key: BEAM-3680 URL: https://issues.apache.org/jira/browse/BEAM-3680 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-3681) Amazon S3 write breaks randomly

2018-02-09 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-3681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-3681: --- Description: When executing a simple write on S3 with the direct runner. It breaks sometimes when it

[jira] [Created] (BEAM-3681) Amazon S3 write breaks randomly

2018-02-09 Thread JIRA
Ismaël Mejía created BEAM-3681: -- Summary: Amazon S3 write breaks randomly Key: BEAM-3681 URL: https://issues.apache.org/jira/browse/BEAM-3681 Project: Beam Issue Type: Bug Components:

[beam] 01/01: Merge pull request #4608 from cclauss/patch-1

2018-02-09 Thread altay
This is an automated email from the ASF dual-hosted git repository. altay pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 0feb813d571d4d0999ecd80a47c8dfa7879aab79 Merge: d0ad6cf 89f1173 Author: Ahmet Altay AuthorDate: Fri Feb

[beam] branch master updated (d0ad6cf -> 0feb813)

2018-02-09 Thread altay
This is an automated email from the ASF dual-hosted git repository. altay pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from d0ad6cf Merge pull request #4476 from alanmyrvold/beam-container add 89f1173 Consistantly show Python and pip

[jira] [Commented] (BEAM-3670) DirectRunner: TypeError: 'KeyedWorkItem' object is not iterable

2018-02-09 Thread cclauss (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358781#comment-16358781 ] cclauss commented on BEAM-3670: --- The last message talks about **line 1453** but the text it is showing is

Build failed in Jenkins: beam_PerformanceTests_Python #894

2018-02-09 Thread Apache Jenkins Server
See Changes: [github] Consistantly show Python and pip versions in tests [alan] [BEAM-3524] Automate testing using python sdk container built at head [kenn] Increase gradle logging to --info

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #5919

2018-02-09 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-3253) Gradle configurations do not declare correct inputs/outputs, requiring --rerun-tasks

2018-02-09 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-3253: -- Summary: Gradle configurations do not declare correct inputs/outputs, requiring --rerun-tasks

[beam] branch master updated (8c5ebe4 -> 2736646)

2018-02-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository. lcwik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 8c5ebe4 Merge pull request #4641 [BEAM-3644] Disable verbose typecoder warnings. add 5089cb8 Increase gradle

[beam] 01/01: Increase gradle logging to --info

2018-02-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository. lcwik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 2736646453d4034e02f90baf3c7c6f996454d01a Merge: 8c5ebe4 5089cb8 Author: Lukasz Cwik AuthorDate: Fri Feb

[jira] [Created] (BEAM-3679) Upgrade calcite to release 1.16

2018-02-09 Thread Ted Yu (JIRA)
Ted Yu created BEAM-3679: Summary: Upgrade calcite to release 1.16 Key: BEAM-3679 URL: https://issues.apache.org/jira/browse/BEAM-3679 Project: Beam Issue Type: Improvement Components:

[jira] [Updated] (BEAM-3253) Support Gradle incremental builds

2018-02-09 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-3253: -- Priority: Major (was: Minor) > Support Gradle incremental builds >

[jira] [Created] (BEAM-3678) Document "eager mode" in the website

2018-02-09 Thread JIRA
María GH created BEAM-3678: -- Summary: Document "eager mode" in the website Key: BEAM-3678 URL: https://issues.apache.org/jira/browse/BEAM-3678 Project: Beam Issue Type: New Feature

[jira] [Resolved] (BEAM-3579) Go textio.Write does not work on non-direct runners

2018-02-09 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde resolved BEAM-3579. - Resolution: Fixed Fix Version/s: Not applicable > Go textio.Write does not work on

[jira] [Commented] (BEAM-3673) FlinkRunner: Harness manager for connecting operators to SDK Harnesses

2018-02-09 Thread Ben Sidhom (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358647#comment-16358647 ] Ben Sidhom commented on BEAM-3673: -- That was not intentional. I assume it's because the umbrella but was

[beam] branch master updated (2736646 -> d0ad6cf)

2018-02-09 Thread altay
This is an automated email from the ASF dual-hosted git repository. altay pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 2736646 Increase gradle logging to --info add a2bcb5f [BEAM-3524] Automate testing using python sdk container

[jira] [Created] (BEAM-3677) Declare proper exception type in catch block of KafkaExactlyOnceSink#initShardWriter

2018-02-09 Thread Ted Yu (JIRA)
Ted Yu created BEAM-3677: Summary: Declare proper exception type in catch block of KafkaExactlyOnceSink#initShardWriter Key: BEAM-3677 URL: https://issues.apache.org/jira/browse/BEAM-3677 Project: Beam

[jira] [Comment Edited] (BEAM-3673) FlinkRunner: Harness manager for connecting operators to SDK Harnesses

2018-02-09 Thread Ben Sidhom (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358647#comment-16358647 ] Ben Sidhom edited comment on BEAM-3673 at 2/9/18 4:51 PM: -- That was not

[beam] 01/01: Merge pull request #4476 from alanmyrvold/beam-container

2018-02-09 Thread altay
This is an automated email from the ASF dual-hosted git repository. altay pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit d0ad6cfa9aed89a996b109452195546edb08ba6e Merge: 2736646 a2bcb5f Author: Ahmet Altay AuthorDate: Fri Feb

[beam] 01/01: Merge pull request #4634 [BEAM-3644] Add switchable DirectRunner which uses the fast FnApiRunner when possible

2018-02-09 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 81932199e8da2a58be4c507f1b1a3f3abb35a92d Merge: 0feb813 46931b4b Author: Robert Bradshaw

Build failed in Jenkins: beam_PostCommit_Python_ValidatesContainer_Dataflow #14

2018-02-09 Thread Apache Jenkins Server
found matching 'README.md' warning: no files found matching 'NOTICE' warning: no files found matching 'LICENSE' writing manifest file 'apache_beam.egg-info/SOURCES.txt' <https://builds.apache.org/job/beam_PostCommit_Python_ValidatesContainer_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py>:

[jira] [Resolved] (BEAM-3613) SpannerIO: Typo in "witHost"

2018-02-09 Thread David Yan (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Yan resolved BEAM-3613. - Resolution: Fixed Fix Version/s: 2.4.0 > SpannerIO: Typo in "witHost" >

[beam] branch master updated (248feba -> bd11416)

2018-02-09 Thread chamikara
This is an automated email from the ASF dual-hosted git repository. chamikara pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 248feba Merge pull request #4592: [BEAM-3613] Correct typo in SpannerIO.Write.withHost add 429a495

[beam] 01/01: Merge pull request #4606: [BEAM-2817] BigQuery queries are allowed to run in either BATCH or IN…

2018-02-09 Thread chamikara
This is an automated email from the ASF dual-hosted git repository. chamikara pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit bd11416ef9d18b602fa725770cd14e50ade86b37 Merge: 248feba 429a495 Author: Chamikara Jayalath

[beam] branch master updated (8193219 -> 21b715d)

2018-02-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository. lcwik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 8193219 Merge pull request #4634 [BEAM-3644] Add switchable DirectRunner which uses the fast FnApiRunner when

[beam] 01/01: Replace boolean ternary operator + simplify some Boolean expressions

2018-02-09 Thread lcwik
This is an automated email from the ASF dual-hosted git repository. lcwik pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 21b715d69e77d78b02d4f78d84fca33cd86cfc3d Merge: 8193219 f31a983 Author: Lukasz Cwik AuthorDate: Fri Feb

Build failed in Jenkins: beam_PostRelease_NightlySnapshot #28

2018-02-09 Thread Apache Jenkins Server
See -- GitHub pull request #4494 of commit 3164049c3d4a6907fb0f0793f94118a4a7926e53, no merge conflicts. Setting status of 3164049c3d4a6907fb0f0793f94118a4a7926e53 to

Build failed in Jenkins: beam_PostRelease_NightlySnapshot #27

2018-02-09 Thread Apache Jenkins Server
See -- GitHub pull request #4494 of commit 28704bd43bac32f0c816e495ceb8ce63c933dec7, no merge conflicts. Setting status of 28704bd43bac32f0c816e495ceb8ce63c933dec7 to

[beam] branch master updated (0feb813 -> 8193219)

2018-02-09 Thread robertwb
This is an automated email from the ASF dual-hosted git repository. robertwb pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 0feb813 Merge pull request #4608 from cclauss/patch-1 add 46931b4b Add switchable DirectRunner which uses the

[jira] [Updated] (BEAM-3682) Hard to read snippet comments in the programming guide

2018-02-09 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-3682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] María GH updated BEAM-3682: --- Summary: Hard to read snippet comments in the programming guide (was: Hard to read comments in the

[jira] [Created] (BEAM-3682) Hard to read comments in the programming guide

2018-02-09 Thread JIRA
María GH created BEAM-3682: -- Summary: Hard to read comments in the programming guide Key: BEAM-3682 URL: https://issues.apache.org/jira/browse/BEAM-3682 Project: Beam Issue Type: New Feature

Build failed in Jenkins: beam_PostRelease_NightlySnapshot #29

2018-02-09 Thread Apache Jenkins Server
See -- [...truncated 3.14 MB...] at java.lang.Thread.run(Thread.java:748) Feb 10, 2018 12:15:42 AM org.apache.spark.network.client.TransportResponseHandler

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #5926

2018-02-09 Thread Apache Jenkins Server
See

Jenkins build is back to normal : beam_PostCommit_Python_ValidatesRunner_Dataflow #874

2018-02-09 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostRelease_NightlySnapshot #31

2018-02-09 Thread Apache Jenkins Server
See -- [...truncated 486.07 KB...] copying apache_beam/runners/portability/maptask_executor_runner_test.py -> apache-beam-2.3.0/apache_beam/runners/portability copying

[jira] [Assigned] (BEAM-3653) Port BatchViewOverridesTest off DoFnTester

2018-02-09 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles reassigned BEAM-3653: - Assignee: (was: Kenneth Knowles) > Port BatchViewOverridesTest off DoFnTester >

[jira] [Commented] (BEAM-3653) Port BatchViewOverridesTest off DoFnTester

2018-02-09 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359233#comment-16359233 ] Kenneth Knowles commented on BEAM-3653: --- Feel free to unassign. But since this is code that only you

Build failed in Jenkins: beam_PostCommit_Python_ValidatesContainer_Dataflow #17

2018-02-09 Thread Apache Jenkins Server
See Changes: [daniel.o.programmer] [BEAM-419] Modifying FindBug comment. -- [...truncated 93.62 KB...] copying

[jira] [Created] (BEAM-3683) Support BigQuery column-based time partitioning

2018-02-09 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-3683: -- Summary: Support BigQuery column-based time partitioning Key: BEAM-3683 URL: https://issues.apache.org/jira/browse/BEAM-3683 Project: Beam Issue Type:

[jira] [Updated] (BEAM-3684) Update well-known coder URNs in Go SDK

2018-02-09 Thread Henning Rohde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Henning Rohde updated BEAM-3684: Labels: portability (was: ) > Update well-known coder URNs in Go SDK >

[jira] [Created] (BEAM-3684) Update well-known coder URNs in Go SDK

2018-02-09 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-3684: -- Summary: Update well-known coder URNs in Go SDK Key: BEAM-3684 URL: https://issues.apache.org/jira/browse/BEAM-3684 Project: Beam Issue Type: Bug

Build failed in Jenkins: beam_PostCommit_Python_Verify #4195

2018-02-09 Thread Apache Jenkins Server
See Changes: [joey.baruch] Add javadoc to ConsoleIO [rmannibucau] better error message when there are conflicting anonymous names [rmannibucau] adding comments to make the code more obvious and

Jenkins build is back to normal : beam_PostCommit_Python_Verify #4196

2018-02-09 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PerformanceTests_Python #895

2018-02-09 Thread Apache Jenkins Server
See Changes: [davidyan] Correct typo in SpannerIO.Write.withHost [coheigea] Replace boolean ternary operator + simplify some Boolean expressions [fjetumale] [BEAM-2817] BigQuery queries are allowed

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #5925

2018-02-09 Thread Apache Jenkins Server
See

[jira] [Assigned] (BEAM-3653) Port BatchViewOverridesTest off DoFnTester

2018-02-09 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3653?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-3653: --- Assignee: Kenneth Knowles (was: Luke Cwik) > Port BatchViewOverridesTest off DoFnTester >

Build failed in Jenkins: beam_PostCommit_Python_ValidatesContainer_Dataflow #15

2018-02-09 Thread Apache Jenkins Server
g/job/beam_PostCommit_Python_ValidatesContainer_Dataflow/ws/src/sdks/python/apache_beam/io/gcp/gcsio.py>:166: DeprecationWarning: object() takes no parameters super(GcsIO, cls).__new__(cls, storage_client)) test_wordcount_fnapi_it (apache_beam.examples.wordcount_it_test.WordCountIT) ... o

Build failed in Jenkins: beam_PostCommit_Python_ValidatesRunner_Dataflow #873

2018-02-09 Thread Apache Jenkins Server
See Changes: [fjetumale] [BEAM-2817] BigQuery queries are allowed to run in either BATCH or -- [...truncated 172.29 KB...]

Build failed in Jenkins: beam_PostRelease_NightlySnapshot #30

2018-02-09 Thread Apache Jenkins Server
See -- [...truncated 3.12 MB...] INFO: Found inactive connection to /127.0.0.1:41080, creating a new one. Feb 10, 2018 12:27:12 AM

Build failed in Jenkins: beam_PostCommit_Python_ValidatesContainer_Dataflow #16

2018-02-09 Thread Apache Jenkins Server
See -- [...truncated 93.80 KB...] copying apache_beam/runners/dataflow/internal/clients/__init__.py ->

[beam] branch master updated (bd11416 -> 959748d)

2018-02-09 Thread kenn
This is an automated email from the ASF dual-hosted git repository. kenn pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from bd11416 Merge pull request #4606: [BEAM-2817] BigQuery queries are allowed to run in either BATCH or IN… add

[beam] 01/01: Merge pull request #3886: [BEAM-419] Fixing SE_BAD_FIELD FindBug in CombineFnUtil

2018-02-09 Thread kenn
This is an automated email from the ASF dual-hosted git repository. kenn pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 959748d3f5851b2c55b76ba55168ef9fe3381518 Merge: bd11416 384e45f Author: Kenn Knowles AuthorDate: Fri

[jira] [Resolved] (BEAM-2267) Final files for WordCount not appearing with Apex on YARN

2018-02-09 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-2267. Resolution: Done Assignee: (was: Thomas Weise) Fix Version/s: Not applicable >

[jira] [Commented] (BEAM-2267) Final files for WordCount not appearing with Apex on YARN

2018-02-09 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16359268#comment-16359268 ] Thomas Weise commented on BEAM-2267: Found working during 2.2.0 release verification, possibly due to 

[jira] [Resolved] (BEAM-1067) apex.examples.WordCountTest.testWordCountExample is flaky

2018-02-09 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-1067. Resolution: Done Assignee: (was: Thomas Weise) Fix Version/s: Not applicable

[jira] [Resolved] (BEAM-2270) Examples archetype bundles Hadoop 2.6 in its jar for ApexRunner; cannot run on Hadoop 2.7?

2018-02-09 Thread Thomas Weise (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Weise resolved BEAM-2270. Resolution: Fixed Assignee: (was: Thomas Weise) Fix Version/s: 2.3.0 > Examples

Build failed in Jenkins: beam_PostRelease_NightlySnapshot #26

2018-02-09 Thread Apache Jenkins Server
See -- [...truncated 485.03 KB...] copying apache_beam/runners/experimental/python_rpc_direct/server.py ->

[beam] branch master updated (21b715d -> 248feba)

2018-02-09 Thread chamikara
This is an automated email from the ASF dual-hosted git repository. chamikara pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 21b715d Replace boolean ternary operator + simplify some Boolean expressions add f06ba98 Correct typo in

[beam] 01/01: Merge pull request #4592: [BEAM-3613] Correct typo in SpannerIO.Write.withHost

2018-02-09 Thread chamikara
This is an automated email from the ASF dual-hosted git repository. chamikara pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 248febaf4e9764cceaa11c191afa6bb8325d78d6 Merge: 21b715d f06ba98 Author: Chamikara Jayalath

Build failed in Jenkins: beam_PerformanceTests_Python #893

2018-02-09 Thread Apache Jenkins Server
See -- Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam7 (beam) in workspace

[jira] [Commented] (BEAM-3519) GCP IO exposes netty on its API surface, causing conflicts with runners

2018-02-09 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-3519?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16358132#comment-16358132 ] Ismaël Mejía commented on BEAM-3519: The explicit issue probably existed before (GCPIO leaking netty),

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #5918

2018-02-09 Thread Apache Jenkins Server
See