Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2760

2017-08-02 Thread Apache Jenkins Server
See

[GitHub] beam pull request #3677: Tez runner

2017-08-02 Thread bschell
GitHub user bschell opened a pull request: https://github.com/apache/beam/pull/3677 Tez runner Adding a TezRunner. Intended to be merged to a feature branch for continued work. You can merge this pull request into a Git repository by running: $ git pull

Jenkins build is back to normal : beam_PostCommit_Python_Verify #2855

2017-08-02 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2709) Add TezRunner

2017-08-02 Thread Brandon Scheller (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2709?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111853#comment-16111853 ] Brandon Scheller commented on BEAM-2709: This is being addressed by pull request:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3703

2017-08-02 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2708) Decompressing bzip2 files with multiple "streams" only reads the first stream

2017-08-02 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112011#comment-16112011 ] Chamikara Jayalath commented on BEAM-2708: -- A similar issue exists in Python SDK as well but

[jira] [Closed] (BEAM-2707) DSL_SQL branch broken by PR 3334

2017-08-02 Thread Tyler Akidau (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tyler Akidau closed BEAM-2707. -- Resolution: Not A Problem Fix Version/s: Not applicable > DSL_SQL branch broken by PR 3334 >

[jira] [Commented] (BEAM-2707) DSL_SQL branch broken by PR 3334

2017-08-02 Thread Tyler Akidau (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110386#comment-16110386 ] Tyler Akidau commented on BEAM-2707: It appears this was indeed some sort of maven artifact. Closing.

[jira] [Comment Edited] (BEAM-2671) CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark runner

2017-08-02 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16106440#comment-16106440 ] Aviem Zur edited comment on BEAM-2671 at 8/2/17 6:44 AM: - CreateStreamTest has

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Apex #2109

2017-08-02 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-2690) Make hadoop and hive dependencies provided for HCatalogIO

2017-08-02 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré updated BEAM-2690: --- Fix Version/s: 2.1.0 > Make hadoop and hive dependencies provided for HCatalogIO >

Jenkins build is unstable: beam_PostCommit_Java_MavenInstall #4503

2017-08-02 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Dataflow #3699

2017-08-02 Thread Apache Jenkins Server
See -- [...truncated 8.02 MB...] at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:47) at

[GitHub] beam pull request #3674: [BEAM-2690] HCatalogIO needs provided scope depende...

2017-08-02 Thread iemejia
GitHub user iemejia opened a pull request: https://github.com/apache/beam/pull/3674 [BEAM-2690] HCatalogIO needs provided scope dependencies on Hadoop, Hive Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[jira] [Commented] (BEAM-2690) Make hadoop and hive dependencies provided for HCatalogIO

2017-08-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110422#comment-16110422 ] ASF GitHub Bot commented on BEAM-2690: -- GitHub user iemejia opened a pull request:

Jenkins build is unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2758

2017-08-02 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2676) move BeamSqlRow and BeamSqlRowType to sdk/java/core

2017-08-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110430#comment-16110430 ] ASF GitHub Bot commented on BEAM-2676: -- Github user XuMingmin closed the pull request at:

[GitHub] beam pull request #3633: [BEAM-2676] move BeamSqlRow and BeamSqlRowType to s...

2017-08-02 Thread XuMingmin
Github user XuMingmin closed the pull request at: https://github.com/apache/beam/pull/3633 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Reopened] (BEAM-2690) Make hadoop and hive dependencies provided for HCatalogIO

2017-08-02 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré reopened BEAM-2690: > Make hadoop and hive dependencies provided for HCatalogIO >

[2/4] beam git commit: Introduces SerializablePipelineOptions in core-construction

2017-08-02 Thread jkff
Introduces SerializablePipelineOptions in core-construction Removes analogous classes from spark/flink and their tests. The analogous class in Spark was SparkRuntimeContext, which also contained a CoderRegistry, but the CoderRegistry was used only in a class that was itself unused. I removed

[jira] [Commented] (BEAM-1190) FileBasedSource should ignore files that matched the glob but don't exist

2017-08-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1190?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111508#comment-16111508 ] Eugene Kirpichov commented on BEAM-1190: GCS object listing is strongly consistent now. However the

[2/2] beam git commit: [BEAM-2708] This closes #3670

2017-08-02 Thread jbonofre
[BEAM-2708] This closes #3670 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/58928b94 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/58928b94 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/58928b94 Branch:

[jira] [Commented] (BEAM-2708) Decompressing bzip2 files with multiple "streams" only reads the first stream

2017-08-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111516#comment-16111516 ] ASF GitHub Bot commented on BEAM-2708: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3670: [BEAM-2708] Configure BZIP2 to read all "streams"

2017-08-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3670 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: [BEAM-2708] Configure BZIP2 to read all "streams"

2017-08-02 Thread jbonofre
Repository: beam Updated Branches: refs/heads/release-2.1.0 749cff290 -> 58928b942 [BEAM-2708] Configure BZIP2 to read all "streams" Without this, CompressionMode.BZIP2 only supports "standard" bz2 files containing a single stream. With this change, BZIP2 also supports bz2 files containing

[jira] [Commented] (BEAM-2708) Decompressing bzip2 files with multiple "streams" only reads the first stream

2017-08-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111518#comment-16111518 ] ASF GitHub Bot commented on BEAM-2708: -- Github user asfgit closed the pull request at:

[jira] [Assigned] (BEAM-2400) Null pointer exception when creating a template

2017-08-02 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-2400: - Assignee: (was: Daniel Halperin) > Null pointer exception when creating a template >

[jira] [Assigned] (BEAM-1494) GcsFileSystem should check content encoding when setting IsReadSeekEfficient

2017-08-02 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1494: - Assignee: (was: Daniel Halperin) > GcsFileSystem should check content encoding when

[jira] [Assigned] (BEAM-2391) Migrate to gcloud java core for default GCP project id detection

2017-08-02 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-2391: - Assignee: (was: Daniel Halperin) > Migrate to gcloud java core for default GCP

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2763

2017-08-02 Thread Apache Jenkins Server
See

[GitHub] beam pull request #3669: [BEAM-2708] Configure BZIP2 to read all "streams"

2017-08-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3669 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: [BEAM-2708] This closes #3669

2017-08-02 Thread jbonofre
[BEAM-2708] This closes #3669 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9582840b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9582840b Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/9582840b Branch:

Build failed in Jenkins: beam_PostCommit_Python_Verify #2851

2017-08-02 Thread Apache Jenkins Server
See Changes: [tgroh] Add the Beam Job API service definition -- [...truncated 559.74 KB...] File was already downloaded

[1/2] beam git commit: [BEAM-2708] Configure BZIP2 to read all "streams"

2017-08-02 Thread jbonofre
Repository: beam Updated Branches: refs/heads/master 339976c9f -> 9582840bc [BEAM-2708] Configure BZIP2 to read all "streams" Without this, CompressionMode.BZIP2 only supports "standard" bz2 files containing a single stream. With this change, BZIP2 also supports bz2 files containing multiple

[jira] [Reopened] (BEAM-2708) Decompressing bzip2 files with multiple "streams" only reads the first stream

2017-08-02 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath reopened BEAM-2708: -- Assignee: Chamikara Jayalath (was: Ben Chambers) Have to check if this applies to

Build failed in Jenkins: beam_PostCommit_Python_Verify #2853

2017-08-02 Thread Apache Jenkins Server
See Changes: [jbonofre] [BEAM-2708] Configure BZIP2 to read all "streams" -- [...truncated 561.16 KB...] Collecting funcsigs>=1 (from mock->-r

[jira] [Created] (BEAM-2716) AvroReader should refuse dynamic splits while in the last block

2017-08-02 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-2716: -- Summary: AvroReader should refuse dynamic splits while in the last block Key: BEAM-2716 URL: https://issues.apache.org/jira/browse/BEAM-2716 Project: Beam

[jira] [Commented] (BEAM-2708) Decompressing bzip2 files with multiple "streams" only reads the first stream

2017-08-02 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111520#comment-16111520 ] Chamikara Jayalath commented on BEAM-2708: -- I'll check if this applies to Python SDK as well.

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2762

2017-08-02 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Python_Verify #2854

2017-08-02 Thread Apache Jenkins Server
See Changes: [kirpichov] [BEAM-1542] Specifies a User Agent in Spanner Client -- [...truncated 558.71 KB...] File was already downloaded

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #4505

2017-08-02 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2708) Decompressing bzip2 files with multiple "streams" only reads the first stream

2017-08-02 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111524#comment-16111524 ] Jean-Baptiste Onofré commented on BEAM-2708: Oh yeah ! Thanks ! > Decompressing bzip2 files

Build failed in Jenkins: beam_PostCommit_Python_Verify #2852

2017-08-02 Thread Apache Jenkins Server
See Changes: [kirpichov] [BEAM-2670] Fixes SparkRuntimeContext.getPipelineOptions() [kirpichov] Introduces SerializablePipelineOptions in core-construction

[jira] [Commented] (BEAM-2716) AvroReader should refuse dynamic splits while in the last block

2017-08-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111671#comment-16111671 ] Eugene Kirpichov commented on BEAM-2716: I think this affects only Avro, other file-based formats

[4/4] beam git commit: This closes #3654: [BEAM-2670] Deduplicates serializable wrappers over PipelineOptions from Spark, Flink and Apex, and removes buggy SparkRuntimeContext

2017-08-02 Thread jkff
This closes #3654: [BEAM-2670] Deduplicates serializable wrappers over PipelineOptions from Spark, Flink and Apex, and removes buggy SparkRuntimeContext Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/339976c9 Tree:

[jira] [Commented] (BEAM-2670) ParDoTest.testPipelineOptionsParameter* validatesRunner tests fail on Spark runner

2017-08-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2670?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111461#comment-16111461 ] ASF GitHub Bot commented on BEAM-2670: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3654: [BEAM-2670] Deduplicates serializable wrappers over...

2017-08-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3654 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (BEAM-2708) Decompressing bzip2 files with multiple "streams" only reads the first stream

2017-08-02 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2708?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved BEAM-2708. Resolution: Fixed > Decompressing bzip2 files with multiple "streams" only reads the

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3701

2017-08-02 Thread Apache Jenkins Server
See

[GitHub] beam pull request #3574: [BEAM-1542] Specifies a User Agent in Spanner Clien...

2017-08-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3574 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #3574: [BEAM-1542] Specifies a User Agent in Spanner Client

2017-08-02 Thread jkff
This closes #3574: [BEAM-1542] Specifies a User Agent in Spanner Client Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8ac796c5 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8ac796c5 Diff:

[1/2] beam git commit: [BEAM-1542] Specifies a User Agent in Spanner Client

2017-08-02 Thread jkff
Repository: beam Updated Branches: refs/heads/master 9582840bc -> 8ac796c5e [BEAM-1542] Specifies a User Agent in Spanner Client Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/fc0f9c7b Tree:

[3/4] beam git commit: [BEAM-2670] Fixes SparkRuntimeContext.getPipelineOptions()

2017-08-02 Thread jkff
[BEAM-2670] Fixes SparkRuntimeContext.getPipelineOptions() It used a global variable to store the deserialized options, so even if there were several instances of SparkRuntimeContext created with different PipelineOptions, they would all return the same value depending on which one was asked

[1/4] beam git commit: Introduces SerializablePipelineOptions in core-construction

2017-08-02 Thread jkff
Repository: beam Updated Branches: refs/heads/master 0a358c780 -> 339976c9f http://git-wip-us.apache.org/repos/asf/beam/blob/7db051ae/runners/spark/src/main/java/org/apache/beam/runners/spark/stateful/SparkGroupAlsoByWindowViaWindowSet.java

[jira] [Closed] (BEAM-2670) ParDoTest.testPipelineOptionsParameter* validatesRunner tests fail on Spark runner

2017-08-02 Thread Eugene Kirpichov (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2670?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eugene Kirpichov closed BEAM-2670. -- Resolution: Fixed > ParDoTest.testPipelineOptionsParameter* validatesRunner tests fail on Spark

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2761

2017-08-02 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1542) Need Source/Sink for Spanner

2017-08-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111609#comment-16111609 ] ASF GitHub Bot commented on BEAM-1542: -- Github user asfgit closed the pull request at:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3702

2017-08-02 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2676) move BeamSqlRow and BeamSqlRowType to sdk/java/core

2017-08-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110516#comment-16110516 ] ASF GitHub Bot commented on BEAM-2676: -- GitHub user XuMingmin opened a pull request:

[GitHub] beam pull request #3675: [BEAM-2676] move BeamSqlRow and BeamSqlRowType to s...

2017-08-02 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3675 [BEAM-2676] move BeamSqlRow and BeamSqlRowType to sdk/java/core create a new PR to get rid of the huge rebase work after #3666. Following the discussion in

Build failed in Jenkins: beam_PostCommit_Python_Verify #2849

2017-08-02 Thread Apache Jenkins Server
See -- [...truncated 558.91 KB...] File was already downloaded /tmp/dataflow-requirements-cache/six-1.10.0.tar.gz Collecting funcsigs>=1 (from mock->-r

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2764

2017-08-02 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2714) ParDo.getAdditionalInputs() return the input of View.CreatePCollectionView instead of output.

2017-08-02 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112072#comment-16112072 ] Pei He commented on BEAM-2714: -- Just to clarify: with runner API, there will be no view transform (neither

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3704

2017-08-02 Thread Apache Jenkins Server
See

[2/2] beam git commit: Closes #3671

2017-08-02 Thread robertwb
Closes #3671 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/520a51b4 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/520a51b4 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/520a51b4 Branch: refs/heads/master

[1/2] beam git commit: Fix typo in dataflow_runner.

2017-08-02 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 8ac796c5e -> 520a51b4f Fix typo in dataflow_runner. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9cbc0d3b Tree:

[GitHub] beam pull request #3671: Fix typo in dataflow_runner.

2017-08-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3671 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-1874) Google Cloud Storage TextIO read fails with gz-files having Content-Encoding: gzip header

2017-08-02 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16112160#comment-16112160 ] Ahmet Altay commented on BEAM-1874: --- Can we close this issue? > Google Cloud Storage TextIO read fails

[GitHub] beam pull request #3658: Remove unneeded surefire configuration for modules ...

2017-08-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3658 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Remove unneeded surefire configuration for hadoop-file-system

2017-08-02 Thread jbonofre
Repository: beam Updated Branches: refs/heads/master 520a51b4f -> de0148c3e Remove unneeded surefire configuration for hadoop-file-system Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/01f1d94b Tree:

[2/2] beam git commit: This closes #3658

2017-08-02 Thread jbonofre
This closes #3658 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/de0148c3 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/de0148c3 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/de0148c3 Branch:

[2/2] beam git commit: [BEAM-2690] This closes #3674

2017-08-02 Thread jbonofre
[BEAM-2690] This closes #3674 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/749cff29 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/749cff29 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/749cff29 Branch:

[1/2] beam git commit: [BEAM-2690] HCatalogIO needs provided scope dependencies on Hadoop, Hive

2017-08-02 Thread jbonofre
Repository: beam Updated Branches: refs/heads/release-2.1.0 04899e414 -> 749cff290 [BEAM-2690] HCatalogIO needs provided scope dependencies on Hadoop, Hive Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1779bc75 Tree:

[GitHub] beam pull request #3674: [BEAM-2690] HCatalogIO needs provided scope depende...

2017-08-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3674 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-2690) Make hadoop and hive dependencies provided for HCatalogIO

2017-08-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110775#comment-16110775 ] ASF GitHub Bot commented on BEAM-2690: -- Github user asfgit closed the pull request at:

[jira] [Resolved] (BEAM-2690) Make hadoop and hive dependencies provided for HCatalogIO

2017-08-02 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved BEAM-2690. Resolution: Fixed > Make hadoop and hive dependencies provided for HCatalogIO >

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2759

2017-08-02 Thread Apache Jenkins Server
See

Jenkins build is unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3700

2017-08-02 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2714) ParDo.getAdditionalInputs() return the input of View.CreatePCollectionView instead of output.

2017-08-02 Thread Pei He (JIRA)
Pei He created BEAM-2714: Summary: ParDo.getAdditionalInputs() return the input of View.CreatePCollectionView instead of output. Key: BEAM-2714 URL: https://issues.apache.org/jira/browse/BEAM-2714 Project:

[jira] [Updated] (BEAM-2714) ParDo.getAdditionalInputs() return the input of View.CreatePCollectionView instead of output.

2017-08-02 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-2714: - Attachment: view-tag.png I use TransformHierarchy.Node getInputs() and getOutputs() to setup this diagram. The

[jira] [Commented] (BEAM-2671) CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark runner

2017-08-02 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16110962#comment-16110962 ] Jean-Baptiste Onofré commented on BEAM-2671: Just to be clear. I checked out on commit

[jira] [Comment Edited] (BEAM-2714) ParDo.getAdditionalInputs() return the input of View.CreatePCollectionView instead of output.

2017-08-02 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111016#comment-16111016 ] Pei He edited comment on BEAM-2714 at 8/2/17 2:38 PM: -- I use TransformHierarchy.Node

[jira] [Comment Edited] (BEAM-2714) ParDo.getAdditionalInputs() return the input of View.CreatePCollectionView instead of output.

2017-08-02 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111016#comment-16111016 ] Pei He edited comment on BEAM-2714 at 8/2/17 2:37 PM: -- I use TransformHierarchy.Node

[jira] [Commented] (BEAM-2431) Model Runner interactions in RPC layer for Runner API

2017-08-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111045#comment-16111045 ] ASF GitHub Bot commented on BEAM-2431: -- GitHub user sb2nov opened a pull request:

[GitHub] beam pull request #3676: [BEAM-2431] Adding the job API

2017-08-02 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/3676 [BEAM-2431] Adding the job API Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a [JIRA

[jira] [Created] (BEAM-2715) Expose PubsubSource to create UnboundedSource and utilize withMaxNumRecords from BoundedReadFromUnboundedSource

2017-08-02 Thread Adam Levy (JIRA)
Adam Levy created BEAM-2715: --- Summary: Expose PubsubSource to create UnboundedSource and utilize withMaxNumRecords from BoundedReadFromUnboundedSource Key: BEAM-2715 URL: https://issues.apache.org/jira/browse/BEAM-2715

[jira] [Commented] (BEAM-1669) Pipeline I/O - add content on how to unit test

2017-08-02 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1669?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111368#comment-16111368 ] Chamikara Jayalath commented on BEAM-1669: -- Closing since

[jira] [Resolved] (BEAM-1669) Pipeline I/O - add content on how to unit test

2017-08-02 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath resolved BEAM-1669. -- Resolution: Fixed Fix Version/s: Not applicable > Pipeline I/O - add content on

[jira] [Commented] (BEAM-2622) I/O Testing docs - Integration Testing section

2017-08-02 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111373#comment-16111373 ] Chamikara Jayalath commented on BEAM-2622: -- Can this be closed since

[jira] [Closed] (BEAM-2714) ParDo.getAdditionalInputs() return the input of View.CreatePCollectionView instead of output.

2017-08-02 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh closed BEAM-2714. - Resolution: Not A Problem Fix Version/s: Not applicable This change was made as part of the move to

Build failed in Jenkins: beam_PostCommit_Python_Verify #2850

2017-08-02 Thread Apache Jenkins Server
See -- [...truncated 559.54 KB...] warnings.warn('Using fallback coder for typehint: %r.' % typehint) File was already downloaded

[GitHub] beam pull request #3676: [BEAM-2431] Adding the job API

2017-08-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3676 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: Add the Beam Job API service definition

2017-08-02 Thread tgroh
Add the Beam Job API service definition Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e2396446 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e2396446 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/e2396446

[1/2] beam git commit: This closes #3676

2017-08-02 Thread tgroh
Repository: beam Updated Branches: refs/heads/master ba5e31466 -> 0a358c780 This closes #3676 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0a358c78 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/0a358c78 Diff:

[jira] [Commented] (BEAM-2431) Model Runner interactions in RPC layer for Runner API

2017-08-02 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16111391#comment-16111391 ] ASF GitHub Bot commented on BEAM-2431: -- Github user asfgit closed the pull request at: