Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #3631

2017-05-03 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1491) HDFSFileSource should be able to read the HADOOP_CONF_DIR(YARN_CONF_DIR) environment variable

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996235#comment-15996235 ] ASF GitHub Bot commented on BEAM-1491: -- Github user 397090770 closed the pull request

[GitHub] beam pull request #2819: [BEAM-1491]Identify HADOOP_CONF_DIR(or YARN_CONF_DI...

2017-05-03 Thread 397090770
Github user 397090770 closed the pull request at: https://github.com/apache/beam/pull/2819 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[jira] [Commented] (BEAM-1491) HDFSFileSource should be able to read the HADOOP_CONF_DIR(YARN_CONF_DIR) environment variable

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996232#comment-15996232 ] ASF GitHub Bot commented on BEAM-1491: -- GitHub user 397090770 opened a pull request:

[GitHub] beam pull request #2890: [BEAM-1491]Identify HADOOP_CONF_DIR(or YARN_CONF_DI...

2017-05-03 Thread 397090770
GitHub user 397090770 opened a pull request: https://github.com/apache/beam/pull/2890 [BEAM-1491]Identify HADOOP_CONF_DIR(or YARN_CONF_DIR) environment variables Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make s

Build failed in Jenkins: beam_PerformanceTests_Dataflow #370

2017-05-03 Thread Apache Jenkins Server
See Changes: [dhalperi] Convert WriteFiles/FileBasedSink from IOChannelFactory to FileSystems [tgroh] Inline TypedPValue [lcwik] [BEAM-2157] Fix HDFS Test That Failed in Other JDK Versions [kirpic

[jira] [Commented] (BEAM-59) Switch from IOChannelFactory to FileSystems

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-59?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996197#comment-15996197 ] ASF GitHub Bot commented on BEAM-59: GitHub user vikkyrk opened a pull request: http

[GitHub] beam pull request #2889: [BEAM-59] Remove IOChannelUtil/Factory from BigQuer...

2017-05-03 Thread vikkyrk
GitHub user vikkyrk opened a pull request: https://github.com/apache/beam/pull/2889 [BEAM-59] Remove IOChannelUtil/Factory from BigQueryIO Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is for

[jira] [Commented] (BEAM-1920) Add Spark 2.x support in Spark runner

2017-05-03 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996189#comment-15996189 ] Jean-Baptiste Onofré commented on BEAM-1920: Yes, it's part of the PR on which

[jira] [Resolved] (BEAM-806) Maven Release Plugin Does Not Set Archetype Versions

2017-05-03 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci resolved BEAM-806. --- Resolution: Fixed Fix Version/s: First stable release > Maven Release Plugin Does Not Set Archety

[jira] [Assigned] (BEAM-806) Maven Release Plugin Does Not Set Archetype Versions

2017-05-03 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-806: - Assignee: Davor Bonaci > Maven Release Plugin Does Not Set Archetype Versions > ---

[jira] [Updated] (BEAM-2164) Build beam-sdks-java-maven-archetypes-examples Failed If Dir Contains Space

2017-05-03 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-2164: --- Description: Error log from [Jenkins console log|https://builds.apache.org/job/beam_PostCommit_Java_JDK_Versio

[jira] [Closed] (BEAM-2157) HadoopFileSystemModuleTest Failed in Some JDK Versions on Jenkins

2017-05-03 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-2157. -- > HadoopFileSystemModuleTest Failed in Some JDK Versions on Jenkins > ---

[GitHub] beam pull request #2888: [BEAM-79] Merge master into gearpump-runner branch

2017-05-03 Thread manuzhang
GitHub user manuzhang opened a pull request: https://github.com/apache/beam/pull/2888 [BEAM-79] Merge master into gearpump-runner branch Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is forma

[jira] [Commented] (BEAM-79) Gearpump runner

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996155#comment-15996155 ] ASF GitHub Bot commented on BEAM-79: GitHub user manuzhang opened a pull request: ht

[jira] [Comment Edited] (BEAM-806) Maven Release Plugin Does Not Set Archetype Versions

2017-05-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996153#comment-15996153 ] Daniel Halperin edited comment on BEAM-806 at 5/4/17 4:11 AM: --

[jira] [Commented] (BEAM-806) Maven Release Plugin Does Not Set Archetype Versions

2017-05-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-806?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996153#comment-15996153 ] Daniel Halperin commented on BEAM-806: -- [~davor] can we now close this after [~elek]'s

[jira] [Commented] (BEAM-2093) Update Jackson version to 2.8.8 in archetype (or align with parent pom)

2017-05-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2093?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996151#comment-15996151 ] Daniel Halperin commented on BEAM-2093: --- Thanks again, [~elek] -- this one is awesome

[jira] [Closed] (BEAM-2093) Update Jackson version to 2.8.8 in archetype (or align with parent pom)

2017-05-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-2093. - Resolution: Fixed > Update Jackson version to 2.8.8 in archetype (or align with parent pom) > -

[jira] [Closed] (BEAM-1642) Combine transformation evaluation fails on direct runner with Avro as a fallback coder

2017-05-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1642. - Resolution: Fixed > Combine transformation evaluation fails on direct runner with Avro as a > fall

[jira] [Closed] (BEAM-775) Remove Aggregators from the Java SDK

2017-05-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-775. Resolution: Fixed > Remove Aggregators from the Java SDK > > >

[jira] [Closed] (BEAM-1765) Remove Aggregators from Spark runner

2017-05-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1765. - Resolution: Fixed Assignee: Pablo Estrada (was: Amit Sela) > Remove Aggregators from Spark r

[jira] [Commented] (BEAM-59) Switch from IOChannelFactory to FileSystems

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-59?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996142#comment-15996142 ] ASF GitHub Bot commented on BEAM-59: GitHub user dhalperi opened a pull request: htt

[GitHub] beam pull request #2887: [BEAM-59] Swap IOChannel to FileSystems finishing t...

2017-05-03 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/2887 [BEAM-59] Swap IOChannel to FileSystems finishing touches All these are small. After this, all I have left is BigQuery. You can merge this pull request into a Git repository by running:

[1/2] beam git commit: Inline TypedPValue

2017-05-03 Thread kenn
Repository: beam Updated Branches: refs/heads/master 34d25f406 -> ff6bb3530 Inline TypedPValue This has exactly one implementation, and this is not expected to change. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ef27abd

[GitHub] beam pull request #2867: Inline TypedPValue

2017-05-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2867 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[2/2] beam git commit: This closes #2867: Inline TypedPValue

2017-05-03 Thread kenn
This closes #2867: Inline TypedPValue Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ff6bb353 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ff6bb353 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/ff6bb353 Bran

[GitHub] beam pull request #2851: [BEAM 775] Removal of Aggregator class. Also remova...

2017-05-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2851 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: Removal of Aggregator class. Also removal from comments.

2017-05-03 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master f3f881084 -> 34d25f406 Removal of Aggregator class. Also removal from comments. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/878981fd Tree: http://git-wip-us.apache.org

[2/2] beam git commit: This closes #2851

2017-05-03 Thread dhalperi
This closes #2851 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/34d25f40 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/34d25f40 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/34d25f40 Branch: refs/heads/maste

[GitHub] beam pull request #2886: [BEAM-2151]Fix inconsistent mapping for SQL FLOAT

2017-05-03 Thread xumingming
GitHub user xumingming opened a pull request: https://github.com/apache/beam/pull/2886 [BEAM-2151]Fix inconsistent mapping for SQL FLOAT This pull request is mainly to fix the SQL FLOAT mapping, previously it is mapped to Float in `BeamSQLRow`, but mapped to `Double` in `BeamSQLRowC

[jira] [Commented] (BEAM-2151) Type mapping inconsistent in BeamSqlRow & BeamSqlRowCoder

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996139#comment-15996139 ] ASF GitHub Bot commented on BEAM-2151: -- GitHub user xumingming opened a pull request:

[2/2] beam git commit: This closes #2873: BigQueryIO: Remove tempLocation usage at pipeline construction time

2017-05-03 Thread kenn
This closes #2873: BigQueryIO: Remove tempLocation usage at pipeline construction time Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f3f88108 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f3f88108 Diff: http://git-wi

[jira] [Commented] (BEAM-828) Remove PipelineOptions from construction time in BigQueryIO

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996138#comment-15996138 ] ASF GitHub Bot commented on BEAM-828: - Github user asfgit closed the pull request at:

[GitHub] beam pull request #2873: [BEAM-828] BigQueryIO: Remove tempLocation usage at...

2017-05-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2873 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: BigQueryIO: Remove tempLocation usage at pipeline construction time

2017-05-03 Thread kenn
Repository: beam Updated Branches: refs/heads/master ad12f6316 -> f3f881084 BigQueryIO: Remove tempLocation usage at pipeline construction time Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d0a2249f Tree: http://git-wip-us

[GitHub] beam pull request #1927: [BEAM-1402] Remove static Read/Write classes from T...

2017-05-03 Thread reuvenlax
Github user reuvenlax closed the pull request at: https://github.com/apache/beam/pull/1927 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[jira] [Commented] (BEAM-1402) Make TextIO and AvroIO use best-practice types.

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1402?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996068#comment-15996068 ] ASF GitHub Bot commented on BEAM-1402: -- Github user reuvenlax closed the pull request

[GitHub] beam pull request #2885: Provides a default coder for PubsubMessage

2017-05-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2885 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[3/3] beam git commit: This closes #2885

2017-05-03 Thread jkff
This closes #2885 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ad12f631 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ad12f631 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/ad12f631 Branch: refs/heads/maste

[2/3] beam git commit: Provides a default coder for PubsubMessage

2017-05-03 Thread jkff
Provides a default coder for PubsubMessage Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e57b5013 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e57b5013 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/e57b5013

[1/3] beam git commit: Moves PubsubMessage to upper level and renames payload

2017-05-03 Thread jkff
Repository: beam Updated Branches: refs/heads/master 5b0a8684a -> ad12f6316 Moves PubsubMessage to upper level and renames payload Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/210e216d Tree: http://git-wip-us.apache.org/r

[jira] [Resolved] (BEAM-2157) HadoopFileSystemModuleTest Failed in Some JDK Versions on Jenkins

2017-05-03 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-2157. - Resolution: Fixed Fix Version/s: First stable release > HadoopFileSystemModuleTest Failed in Some JD

[jira] [Commented] (BEAM-2157) HadoopFileSystemModuleTest Failed in Some JDK Versions on Jenkins

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996047#comment-15996047 ] ASF GitHub Bot commented on BEAM-2157: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2876: [BEAM-2157] Fix HDFS Test That Failed in Other JDK ...

2017-05-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2876 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/2] beam git commit: [BEAM-2157] Fix HDFS Test That Failed in Other JDK Versions

2017-05-03 Thread lcwik
Repository: beam Updated Branches: refs/heads/master 1bc50d627 -> 5b0a8684a [BEAM-2157] Fix HDFS Test That Failed in Other JDK Versions Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8f3fbc06 Tree: http://git-wip-us.apache.

[2/2] beam git commit: [BEAM-2157] Fix HDFS Test That Failed in Other JDK Versions

2017-05-03 Thread lcwik
[BEAM-2157] Fix HDFS Test That Failed in Other JDK Versions This closes #2876 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5b0a8684 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5b0a8684 Diff: http://git-wip-us.apac

[jira] [Commented] (BEAM-2166) Remove Coder.Context from the public API

2017-05-03 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15996032#comment-15996032 ] Kenneth Knowles commented on BEAM-2166: --- Big +1 > Remove Coder.Context from the publ

[jira] [Updated] (BEAM-2166) Remove Coder.Context from the public API

2017-05-03 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2166: -- Fix Version/s: First stable release > Remove Coder.Context from the public API >

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Dataflow #3030

2017-05-03 Thread Apache Jenkins Server
See

[jira] [Assigned] (BEAM-2168) PubsubMessageWithAttributesCoder should be registered via CoderRegistrar

2017-05-03 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2168?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh reassigned BEAM-2168: - Assignee: (was: Daniel Halperin) > PubsubMessageWithAttributesCoder should be registered via C

[jira] [Created] (BEAM-2168) PubsubMessageWithAttributesCoder should be registered via CoderRegistrar

2017-05-03 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-2168: - Summary: PubsubMessageWithAttributesCoder should be registered via CoderRegistrar Key: BEAM-2168 URL: https://issues.apache.org/jira/browse/BEAM-2168 Project: Beam

[GitHub] beam pull request #2885: Provides a default coder for PubsubMessage

2017-05-03 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/2885 Provides a default coder for PubsubMessage Default coder is useful to avoid having to specify it when you use PubsubIO.writePubsubMessages, on its input PCollection. A couple more cosmetic chan

[jira] [Resolved] (BEAM-2051) Reduce scope of the PCollectionView interface

2017-05-03 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2051?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-2051. --- Resolution: Fixed > Reduce scope of the PCollectionView interface > ---

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #3626

2017-05-03 Thread Apache Jenkins Server
See

[jira] [Assigned] (BEAM-1199) Condense recordAsOutput, finishSpecifyingOutput from POutput

2017-05-03 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1199?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh reassigned BEAM-1199: - Assignee: Thomas Groh (was: Kenneth Knowles) > Condense recordAsOutput, finishSpecifyingOutput fr

[jira] [Created] (BEAM-2167) Add appropriate display data to BigQueryIO and tests.

2017-05-03 Thread Vikas Kedigehalli (JIRA)
Vikas Kedigehalli created BEAM-2167: --- Summary: Add appropriate display data to BigQueryIO and tests. Key: BEAM-2167 URL: https://issues.apache.org/jira/browse/BEAM-2167 Project: Beam Issue

[jira] [Updated] (BEAM-2167) Add appropriate display data to BigQueryIO and tests.

2017-05-03 Thread Vikas Kedigehalli (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vikas Kedigehalli updated BEAM-2167: Affects Version/s: First stable release > Add appropriate display data to BigQueryIO and test

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #3625

2017-05-03 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-59) Switch from IOChannelFactory to FileSystems

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-59?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995976#comment-15995976 ] ASF GitHub Bot commented on BEAM-59: Github user asfgit closed the pull request at:

[GitHub] beam pull request #2779: [BEAM-59] Convert WriteFiles/FileBasedSink from IOC...

2017-05-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2779 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[1/4] beam git commit: Convert WriteFiles/FileBasedSink from IOChannelFactory to FileSystems

2017-05-03 Thread dhalperi
Repository: beam Updated Branches: refs/heads/master b4bafd092 -> 1bc50d627 http://git-wip-us.apache.org/repos/asf/beam/blob/17358248/sdks/java/core/src/test/java/org/apache/beam/sdk/io/WriteFilesTest.java -- diff --git a/sdks

[4/4] beam git commit: This closes #2779

2017-05-03 Thread dhalperi
This closes #2779 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1bc50d62 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/1bc50d62 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/1bc50d62 Branch: refs/heads/maste

[2/4] beam git commit: Convert WriteFiles/FileBasedSink from IOChannelFactory to FileSystems

2017-05-03 Thread dhalperi
http://git-wip-us.apache.org/repos/asf/beam/blob/17358248/sdks/java/core/src/main/java/org/apache/beam/sdk/io/TFRecordIO.java -- diff --git a/sdks/java/core/src/main/java/org/apache/beam/sdk/io/TFRecordIO.java b/sdks/java/core/sr

[3/4] beam git commit: Convert WriteFiles/FileBasedSink from IOChannelFactory to FileSystems

2017-05-03 Thread dhalperi
Convert WriteFiles/FileBasedSink from IOChannelFactory to FileSystems This converts FileBasedSink from IOChannelFactory to FileSystems, with fallout changes on all existing Transforms that use WriteFiles. We preserve the existing semantics of most transforms, simply adding the ability for users t

[jira] [Assigned] (BEAM-2166) Remove Coder.Context from the public API

2017-05-03 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw reassigned BEAM-2166: - Assignee: Robert Bradshaw (was: Davor Bonaci) > Remove Coder.Context from the public API

[GitHub] beam pull request #2884: One more TaggedOutput name change.

2017-05-03 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/2884 One more TaggedOutput name change. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Spark #1926

2017-05-03 Thread Apache Jenkins Server
See

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #3624

2017-05-03 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2154) Writing to large numbers of BigQuery tables causes out-of-memory

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995960#comment-15995960 ] ASF GitHub Bot commented on BEAM-2154: -- GitHub user reuvenlax opened a pull request:

[GitHub] beam pull request #2883: [BEAM-2154] Make BigQuery's dynamic-destination sup...

2017-05-03 Thread reuvenlax
GitHub user reuvenlax opened a pull request: https://github.com/apache/beam/pull/2883 [BEAM-2154] Make BigQuery's dynamic-destination support scale to large numbers of destinations Generating hundreds or thousands of file write buffers in a single bundle was causing workers to cra

[jira] [Assigned] (BEAM-2157) HadoopFileSystemModuleTest Failed in Some JDK Versions on Jenkins

2017-05-03 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu reassigned BEAM-2157: -- Assignee: Mark Liu > HadoopFileSystemModuleTest Failed in Some JDK Versions on Jenkins > ---

[jira] [Commented] (BEAM-2162) Add logging during and after long running BigQuery jobs

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995954#comment-15995954 ] ASF GitHub Bot commented on BEAM-2162: -- GitHub user bjchambers opened a pull request:

[GitHub] beam pull request #2882: [BEAM-2162] Add logging to long BigQuery jobs

2017-05-03 Thread bjchambers
GitHub user bjchambers opened a pull request: https://github.com/apache/beam/pull/2882 [BEAM-2162] Add logging to long BigQuery jobs Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [*] Make sure the PR title is formatted

[jira] [Commented] (BEAM-2165) Support custom user Jackson modules for PipelineOptions

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995948#comment-15995948 ] ASF GitHub Bot commented on BEAM-2165: -- GitHub user lukecwik opened a pull request:

[jira] [Commented] (BEAM-2135) Rename hdfs module to hadoop-file-system, rename gcp-core to google-cloud-platform-core

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995949#comment-15995949 ] ASF GitHub Bot commented on BEAM-2135: -- GitHub user lukecwik opened a pull request:

[GitHub] beam pull request #2881: [BEAM-2135] Update Dataflow to support serializing/...

2017-05-03 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2881 [BEAM-2135] Update Dataflow to support serializing/deserializing custom user types configured via Jackson modules This also updates the runner harness and existing tests to use a properly construct

[GitHub] beam pull request #2880: [BEAM-2165] Update Apex to support serializing/dese...

2017-05-03 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2880 [BEAM-2165] Update Apex to support serializing/deserializing custom user types configured via Jackson modules Be sure to do all of the following to help us incorporate your contribution quickly

[jira] [Commented] (BEAM-2165) Support custom user Jackson modules for PipelineOptions

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995947#comment-15995947 ] ASF GitHub Bot commented on BEAM-2165: -- GitHub user lukecwik opened a pull request:

[jira] [Commented] (BEAM-2135) Rename hdfs module to hadoop-file-system, rename gcp-core to google-cloud-platform-core

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995945#comment-15995945 ] ASF GitHub Bot commented on BEAM-2135: -- GitHub user lukecwik opened a pull request:

[GitHub] beam pull request #2879: [BEAM-2165] Update Flink to support serializing/des...

2017-05-03 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2879 [BEAM-2165] Update Flink to support serializing/deserializing custom user types configured via Jackson modules Be sure to do all of the following to help us incorporate your contribution quickly

[GitHub] beam pull request #2878: Forward integrate from `master` to `DSL_SQL`

2017-05-03 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/2878 Forward integrate from `master` to `DSL_SQL` To fix the unit test failure `org.apache.beam.examples.WordCountIT.testE2EWordCount` You can merge this pull request into a Git repository by running:

[GitHub] beam pull request #2877: [BEAM-2135] Update Spark to support serializing/des...

2017-05-03 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/2877 [BEAM-2135] Update Spark to support serializing/deserializing custom user types configured via Jackson modules Be sure to do all of the following to help us incorporate your contribution quickly

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3029

2017-05-03 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-2166) Remove Coder.Context from the public API

2017-05-03 Thread Robert Bradshaw (JIRA)
Robert Bradshaw created BEAM-2166: - Summary: Remove Coder.Context from the public API Key: BEAM-2166 URL: https://issues.apache.org/jira/browse/BEAM-2166 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-2157) HadoopFileSystemModuleTest Failed in Some JDK Versions on Jenkins

2017-05-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995934#comment-15995934 ] ASF GitHub Bot commented on BEAM-2157: -- GitHub user markflyhigh opened a pull request:

[GitHub] beam pull request #2851: [BEAM 775] Removal of Aggregator class. Also remova...

2017-05-03 Thread pabloem
Github user pabloem closed the pull request at: https://github.com/apache/beam/pull/2851 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] beam pull request #2851: [BEAM 775] Removal of Aggregator class. Also remova...

2017-05-03 Thread pabloem
GitHub user pabloem reopened a pull request: https://github.com/apache/beam/pull/2851 [BEAM 775] Removal of Aggregator class. Also removal from comments. To be merged after the worker is rebuilt. You can merge this pull request into a Git repository by running: $ git pull https

[GitHub] beam pull request #2876: [BEAM-2157] Fix HDFS Test That Failed in Other JDK ...

2017-05-03 Thread markflyhigh
GitHub user markflyhigh opened a pull request: https://github.com/apache/beam/pull/2876 [BEAM-2157] Fix HDFS Test That Failed in Other JDK Versions Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR tit

[jira] [Created] (BEAM-2165) Support custom user Jackson modules for PipelineOptions

2017-05-03 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2165: --- Summary: Support custom user Jackson modules for PipelineOptions Key: BEAM-2165 URL: https://issues.apache.org/jira/browse/BEAM-2165 Project: Beam Issue Type: Improvem

[jira] [Commented] (BEAM-2157) HadoopFileSystemModuleTest Failed in Some JDK Versions on Jenkins

2017-05-03 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15995927#comment-15995927 ] Mark Liu commented on BEAM-2157: Thanks [~lcwik]. problem is solved. Will have a PR soon.

[jira] [Created] (BEAM-2164) Build beam-sdks-java-maven-archetypes-examples Failed If Dir Contains Space

2017-05-03 Thread Mark Liu (JIRA)
Mark Liu created BEAM-2164: -- Summary: Build beam-sdks-java-maven-archetypes-examples Failed If Dir Contains Space Key: BEAM-2164 URL: https://issues.apache.org/jira/browse/BEAM-2164 Project: Beam I

Build failed in Jenkins: beam_PerformanceTests_Dataflow #369

2017-05-03 Thread Apache Jenkins Server
See Changes: [klk] Use Thread context ClassLoader as parent in AvroCoderTest [tgroh] Mark all PCollectionView methods internal [lcwik] [BEAM-1871] Move GCP specific serialization CloudObject and su

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Spark #1925

2017-05-03 Thread Apache Jenkins Server
See

[GitHub] beam pull request #2875: Fixes PubsubIO.Write translation in Dataflow runner

2017-05-03 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2875 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[2/2] beam git commit: This closes #2875

2017-05-03 Thread jkff
This closes #2875 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b4bafd09 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b4bafd09 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b4bafd09 Branch: refs/heads/maste

[1/2] beam git commit: Fixes PubsubIO.Write translation in Dataflow runner

2017-05-03 Thread jkff
Repository: beam Updated Branches: refs/heads/master a1d82c203 -> b4bafd092 Fixes PubsubIO.Write translation in Dataflow runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/415d4bb1 Tree: http://git-wip-us.apache.org/repo

[jira] [Updated] (BEAM-2163) Remove the dependency on examples from ptransform_test

2017-05-03 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-2163: -- Labels: newbie starter (was: newbie) > Remove the dependency on examples from ptransform_test >

[jira] [Assigned] (BEAM-2163) Remove the dependency on examples from ptransform_test

2017-05-03 Thread Sourabh Bajaj (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sourabh Bajaj reassigned BEAM-2163: --- Assignee: (was: Ahmet Altay) > Remove the dependency on examples from ptransform_test > --

[GitHub] beam pull request #2875: Fixes PubsubIO.Write translation in Dataflow runner

2017-05-03 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/2875 Fixes PubsubIO.Write translation in Dataflow runner Accidentally deleted this line in the style PR. Still don't understand how this passed tests against prod Dataflow. R: @tgroh You can merge

  1   2   3   4   >