[jira] [Commented] (BEAM-1859) sorter extension depends on hadoop but does not declare as such in repository artifact

2017-04-02 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15953000#comment-15953000 ] Jean-Baptiste Onofré commented on BEAM-1859: This approach allows you to match your Hadoop

[jira] [Comment Edited] (BEAM-1859) sorter extension depends on hadoop but does not declare as such in repository artifact

2017-04-02 Thread Wesley Tanaka (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952999#comment-15952999 ] Wesley Tanaka edited comment on BEAM-1859 at 4/3/17 5:06 AM: - Adding

[jira] [Commented] (BEAM-1859) sorter extension depends on hadoop but does not declare as such in repository artifact

2017-04-02 Thread Wesley Tanaka (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952999#comment-15952999 ] Wesley Tanaka commented on BEAM-1859: - Adding org.apache.hadoop:hadoop-core:0.20.2 as a dependency

[jira] [Resolved] (BEAM-1859) sorter extension depends on hadoop but does not declare as such in repository artifact

2017-04-02 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci resolved BEAM-1859. Resolution: Not A Problem Fix Version/s: Not applicable > sorter extension depends on hadoop

[jira] [Commented] (BEAM-1859) sorter extension depends on hadoop but does not declare as such in repository artifact

2017-04-02 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952988#comment-15952988 ] Davor Bonaci commented on BEAM-1859: "beam-sdks-java-extensions-sorter" depends on the Hadoop codebase

[jira] [Resolved] (BEAM-1843) 'PDone' object has no attribute 'to_runner_api'

2017-04-02 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-1843. --- Resolution: Fixed Fix Version/s: Not applicable > 'PDone' object has no attribute

[jira] [Commented] (BEAM-1859) sorter extension depends on hadoop but does not declare as such in repository artifact

2017-04-02 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1859?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952967#comment-15952967 ] Jean-Baptiste Onofré commented on BEAM-1859: As a workaround, can you try to add hadoop client

[jira] [Created] (BEAM-1859) sorter extension depends on hadoop but does not declare as such in repository artifact

2017-04-02 Thread Wesley Tanaka (JIRA)
Wesley Tanaka created BEAM-1859: --- Summary: sorter extension depends on hadoop but does not declare as such in repository artifact Key: BEAM-1859 URL: https://issues.apache.org/jira/browse/BEAM-1859

[jira] [Commented] (BEAM-1151) BigQueryIO.Write has no way of handling failures

2017-04-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952953#comment-15952953 ] ASF GitHub Bot commented on BEAM-1151: -- GitHub user reuvenlax opened a pull request:

[GitHub] beam pull request #2404: [BEAM-1151] Add interface for accessing failed BigQ...

2017-04-02 Thread reuvenlax
GitHub user reuvenlax opened a pull request: https://github.com/apache/beam/pull/2404 [BEAM-1151] Add interface for accessing failed BigQuery inserts This PR adds a new return type to BigQueryIO.Write, to replace PDone. This enables future features such as accessing failed inserts

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Spark #1479

2017-04-02 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PerformanceTests_Dataflow #262

2017-04-02 Thread Apache Jenkins Server
See -- Started by timer [EnvInject] - Loading node environment variables. Building remotely on beam5 (beam) in workspace

[jira] [Commented] (BEAM-1676) SdkCoreApiSurfaceTest Failed When Directory Contains Space

2017-04-02 Thread Jason Kuster (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952864#comment-15952864 ] Jason Kuster commented on BEAM-1676: Briefly chatted with [~dhalp...@google.com] -- he seemed to be

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Spark #1478

2017-04-02 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1773) Consider allowing Source#validate() to throw exception

2017-04-02 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952662#comment-15952662 ] Ted Yu commented on BEAM-1773: -- JB: If you are busy, I can work on this. > Consider allowing

Build failed in Jenkins: beam_PerformanceTests_Dataflow #260

2017-04-02 Thread Apache Jenkins Server
See Changes: [staslevin] [BEAM-1048] Added a read duration metric to SparkUnboundedSource. -- [...truncated 240.24 KB...] * [new ref]

[jira] [Commented] (BEAM-1777) If PipelineEnforcement throws an exception after Pipeline.run() fails, it overwrites the original failure

2017-04-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952626#comment-15952626 ] ASF GitHub Bot commented on BEAM-1777: -- GitHub user staslev opened a pull request:

[GitHub] beam pull request #2403: [BEAM-1777] In certain circumstances PipelineEnforc...

2017-04-02 Thread staslev
GitHub user staslev opened a pull request: https://github.com/apache/beam/pull/2403 [BEAM-1777] In certain circumstances PipelineEnforcement shades exceptions. …ine's exceptions. Be sure to do all of the following to help us incorporate your contribution quickly and

[jira] [Commented] (BEAM-1048) Spark Runner streaming batch duration does not include duration of reading from source

2017-04-02 Thread Stas Levin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952616#comment-15952616 ] Stas Levin commented on BEAM-1048: -- While batch duration is still (and probably won't be) reported as part

[jira] [Resolved] (BEAM-1048) Spark Runner streaming batch duration does not include duration of reading from source

2017-04-02 Thread Stas Levin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stas Levin resolved BEAM-1048. -- Resolution: Workaround > Spark Runner streaming batch duration does not include duration of reading >

[jira] [Updated] (BEAM-1048) Spark Runner streaming batch duration does not include duration of reading from source

2017-04-02 Thread Stas Levin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stas Levin updated BEAM-1048: - Fix Version/s: First stable release > Spark Runner streaming batch duration does not include duration of

[jira] [Commented] (BEAM-1048) Spark Runner streaming batch duration does not include duration of reading from source

2017-04-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952613#comment-15952613 ] ASF GitHub Bot commented on BEAM-1048: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2073: [BEAM-1048] Added a per-batch read duration metric ...

2017-04-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2073 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2073

2017-04-02 Thread staslevin
This closes #2073 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/fe1d4124 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/fe1d4124 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/fe1d4124 Branch:

[1/2] beam git commit: [BEAM-1048] Added a read duration metric to SparkUnboundedSource.

2017-04-02 Thread staslevin
Repository: beam Updated Branches: refs/heads/master ea33e3373 -> fe1d4124e [BEAM-1048] Added a read duration metric to SparkUnboundedSource. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/38e00f3f Tree:

[jira] [Updated] (BEAM-25) Add user-ready API for interacting with state

2017-04-02 Thread Wesley Tanaka (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-25?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wesley Tanaka updated BEAM-25: -- Description: Our current state API is targeted at runner implementers, not pipeline authors. As such it

[jira] [Commented] (BEAM-1851) Sample.fixedSizedGlobally documentation should include single worker memory constraint

2017-04-02 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952581#comment-15952581 ] Davor Bonaci commented on BEAM-1851: Thanks [~mdshalda] -- your contribution is much appreciated! >

[jira] [Assigned] (BEAM-1851) Sample.fixedSizedGlobally documentation should include single worker memory constraint

2017-04-02 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1851: -- Assignee: Mark Shalda (was: Davor Bonaci) > Sample.fixedSizedGlobally documentation should

[jira] [Commented] (BEAM-1852) dead links on beam website

2017-04-02 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952579#comment-15952579 ] Davor Bonaci commented on BEAM-1852: Not sure -- we'll see if it persists. > dead links on beam

[3/3] beam-site git commit: This closes #198

2017-04-02 Thread davor
This closes #198 Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/787d5706 Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/787d5706 Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/787d5706

[1/3] beam-site git commit: Update Capability Matrix: Flink supports state/timers in batch mode

2017-04-02 Thread davor
Repository: beam-site Updated Branches: refs/heads/asf-site 0ee032422 -> 787d5706d Update Capability Matrix: Flink supports state/timers in batch mode Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/6261b1ad Tree:

[2/3] beam-site git commit: Regenerate website

2017-04-02 Thread davor
Regenerate website Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/8de1bcc6 Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/8de1bcc6 Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/8de1bcc6

[GitHub] beam-site pull request #198: Update Capability Matrix: Flink supports state/...

2017-04-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam-site/pull/198 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Assigned] (BEAM-1854) Replace the magic number 42 in PAssert.

2017-04-02 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1854: -- Assignee: Pei He (was: Davor Bonaci) > Replace the magic number 42 in PAssert. >

[jira] [Commented] (BEAM-1856) HDFSFileSink class do not use the same configuration in master and slave

2017-04-02 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952559#comment-15952559 ] Davor Bonaci commented on BEAM-1856: Thanks [~397090770] for this contribution! > HDFSFileSink class

[jira] [Assigned] (BEAM-1856) HDFSFileSink class do not use the same configuration in master and slave

2017-04-02 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1856: -- Assignee: yangping wu (was: Davor Bonaci) > HDFSFileSink class do not use the same

[jira] [Updated] (BEAM-1856) HDFSFileSink class do not use the same configuration in master and slave

2017-04-02 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci updated BEAM-1856: --- Component/s: (was: sdk-java-core) sdk-java-extensions > HDFSFileSink class do not

[jira] [Assigned] (BEAM-1858) improve error message when Create.of() is called with an empty iterator

2017-04-02 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1858: -- Assignee: Wesley Tanaka (was: Davor Bonaci) > improve error message when Create.of() is called

[jira] [Commented] (BEAM-1858) improve error message when Create.of() is called with an empty iterator

2017-04-02 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1858?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952557#comment-15952557 ] Davor Bonaci commented on BEAM-1858: Thanks for your contribution, [~wtanaka]. > improve error message

[jira] [Updated] (BEAM-1680) Uber-JIRA: Extend Python-SDK's unit test coverage

2017-04-02 Thread Tibor Kiss (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tibor Kiss updated BEAM-1680: - Description: Some components of the Python-SDK has low coverage rate. As of now

[jira] [Commented] (BEAM-1680) Uber-JIRA: Extend Python-SDK's unit test coverage

2017-04-02 Thread Tibor Kiss (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15952554#comment-15952554 ] Tibor Kiss commented on BEAM-1680: -- Updated the coverage results to use GCP profile > Uber-JIRA: Extend

[jira] [Updated] (BEAM-1680) Uber-JIRA: Extend Python-SDK's unit test coverage

2017-04-02 Thread Tibor Kiss (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tibor Kiss updated BEAM-1680: - Description: Some components of the Python-SDK has low coverage rate. As of now

Build failed in Jenkins: beam_PerformanceTests_Dataflow #259

2017-04-02 Thread Apache Jenkins Server
See -- [...truncated 221.39 KB...] x [deleted] (none) -> origin/pr/983/merge x [deleted] (none) -> origin/pr/984/head x [deleted] (none)