Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #4695

2017-08-31 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2803) JdbcIO read is very slow when query return a lot of rows

2017-08-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149899#comment-16149899 ] ASF GitHub Bot commented on BEAM-2803: -- GitHub user jkff opened a pull request: h

[GitHub] beam pull request #3800: [BEAM-2803, BEAM-2706] JdbcIO improvements

2017-08-31 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/3800 [BEAM-2803, BEAM-2706] JdbcIO improvements This solves two issues: * https://issues.apache.org/jira/browse/BEAM-2803 by changing the strategy of breaking fusion: instead of a regular reshuffle,

[jira] [Commented] (BEAM-2828) Create FileIO

2017-08-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149850#comment-16149850 ] ASF GitHub Bot commented on BEAM-2828: -- GitHub user jkff opened a pull request: h

[GitHub] beam pull request #3799: [BEAM-2828, BEAM-2750] Introduces FileIO.read() and...

2017-08-31 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/3799 [BEAM-2828, BEAM-2750] Introduces FileIO.read() and uses it in Text, Avro and Xml This is on top of https://github.com/apache/beam/pull/3759. * Creates a `ReadableFile` type that's just a utili

[jira] [Created] (BEAM-2834) NullPointerException @ BigQueryServicesImpl.java:759

2017-08-31 Thread Andy Barron (JIRA)
Andy Barron created BEAM-2834: - Summary: NullPointerException @ BigQueryServicesImpl.java:759 Key: BEAM-2834 URL: https://issues.apache.org/jira/browse/BEAM-2834 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-2833) TestPipeline fail to get Coder

2017-08-31 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2833: - Summary: TestPipeline fail to get Coder (was: TestPipeline failure to get Coder) > TestPipeline fail to g

[jira] [Commented] (BEAM-2545) bigtable e2e tests failing - UNKNOWN: Stale requests/Error mutating row

2017-08-31 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149693#comment-16149693 ] Chamikara Jayalath commented on BEAM-2545: -- I'll send out an PR to upgrade to late

[GitHub] beam pull request #3798: CoGroupByKey snippet with concrete example

2017-08-31 Thread davidcavazos
GitHub user davidcavazos opened a pull request: https://github.com/apache/beam/pull/3798 CoGroupByKey snippet with concrete example R: @aaltay R: @melap Having a concrete common example for the docs, Python, and Java will allow referencing the same example on every la

[jira] [Updated] (BEAM-2833) TestPipeline failure to get Coder

2017-08-31 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2833: - Description: See this error when preparing merge branch DSL_SQL to master, it seems caused by https://gith

[jira] [Updated] (BEAM-2833) TestPipeline failure to get Coder

2017-08-31 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2833: - Fix Version/s: 2.2.0 > TestPipeline failure to get Coder > - > >

[jira] [Updated] (BEAM-2833) TestPipeline failure to get Coder

2017-08-31 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin updated BEAM-2833: - Summary: TestPipeline failure to get Coder (was: TestPipeline failure) > TestPipeline failure to get Coder

[jira] [Assigned] (BEAM-2833) TestPipeline failure

2017-08-31 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2833?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin reassigned BEAM-2833: Assignee: (was: Kenneth Knowles) > TestPipeline failure > > >

[GitHub] beam pull request #2341: Stops referring to NeedsRunner/ValidatesRunner in j...

2017-08-31 Thread jkff
Github user jkff closed the pull request at: https://github.com/apache/beam/pull/2341 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled

[jira] [Created] (BEAM-2833) TestPipeline failure

2017-08-31 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-2833: Summary: TestPipeline failure Key: BEAM-2833 URL: https://issues.apache.org/jira/browse/BEAM-2833 Project: Beam Issue Type: Bug Components: sdk-java-core,

[jira] [Commented] (BEAM-2545) bigtable e2e tests failing - UNKNOWN: Stale requests/Error mutating row

2017-08-31 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2545?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149654#comment-16149654 ] Fábio Uechi commented on BEAM-2545: --- We are seeing the same issue when using 2.1.0 downgr

[jira] [Assigned] (BEAM-2832) Python wordcount example snippets do not match real example code

2017-08-31 Thread Melissa Pashniak (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Melissa Pashniak reassigned BEAM-2832: -- Assignee: David Cavazos (was: Melissa Pashniak) > Python wordcount example snippets do

[jira] [Commented] (BEAM-667) Include code snippets from real examples

2017-08-31 Thread Melissa Pashniak (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149604#comment-16149604 ] Melissa Pashniak commented on BEAM-667: --- PR: https://github.com/apache/beam-site/pull/

[jira] [Created] (BEAM-2832) Python wordcount example snippets do not match real example code

2017-08-31 Thread Melissa Pashniak (JIRA)
Melissa Pashniak created BEAM-2832: -- Summary: Python wordcount example snippets do not match real example code Key: BEAM-2832 URL: https://issues.apache.org/jira/browse/BEAM-2832 Project: Beam

[jira] [Commented] (BEAM-2831) Possible bug in Beam+Flink memory management, disk spillover

2017-08-31 Thread Reinier Kip (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149496#comment-16149496 ] Reinier Kip commented on BEAM-2831: --- [~aljoscha] Yes! The pipeline consistently succeeds

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #4693

2017-08-31 Thread Apache Jenkins Server
See

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Spark #2970

2017-08-31 Thread Apache Jenkins Server
See

[jira] [Closed] (BEAM-1054) Language specific IO docs

2017-08-31 Thread Melissa Pashniak (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1054?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Melissa Pashniak closed BEAM-1054. -- Resolution: Won't Fix Fix Version/s: Not applicable > Language specific IO docs >

[jira] [Commented] (BEAM-1054) Language specific IO docs

2017-08-31 Thread Melissa Pashniak (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1054?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149437#comment-16149437 ] Melissa Pashniak commented on BEAM-1054: This was a placeholder and too general. wi

[jira] [Commented] (BEAM-1630) Add Splittable DoFn to Python SDK

2017-08-31 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149436#comment-16149436 ] Chamikara Jayalath commented on BEAM-1630: -- Yeah, I'm working on adding support fo

[jira] [Commented] (BEAM-1197) Slowly-changing external data as a side input

2017-08-31 Thread Tyler Akidau (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149414#comment-16149414 ] Tyler Akidau commented on BEAM-1197: For the record, there are additional thoughts on t

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2969

2017-08-31 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-893) Update Mobile Gaming Example

2017-08-31 Thread Melissa Pashniak (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-893?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149398#comment-16149398 ] Melissa Pashniak commented on BEAM-893: --- PR: https://github.com/apache/beam-site/pull/

[jira] [Commented] (BEAM-1630) Add Splittable DoFn to Python SDK

2017-08-31 Thread Kai Jiang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1630?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149391#comment-16149391 ] Kai Jiang commented on BEAM-1630: - Any process on this? > Add Splittable DoFn to Python SD

[jira] [Commented] (BEAM-1347) Basic Java harness capable of understanding process bundle tasks and sending data over the Fn Api

2017-08-31 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16149387#comment-16149387 ] ASF GitHub Bot commented on BEAM-1347: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3795: [BEAM-1347] Wire up the BeamFnStateGrpcClientCache ...

2017-08-31 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3795 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabl

[2/2] beam git commit: [BEAM-1347] Wire up the BeamFnStateGrpcClientCache implementation into the ProcessBundleHandler

2017-08-31 Thread lcwik
[BEAM-1347] Wire up the BeamFnStateGrpcClientCache implementation into the ProcessBundleHandler This closes #3795 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c9653f27 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/

[1/2] beam git commit: [BEAM-1347] Wire up the BeamFnStateGrpcClientCache implementation into the ProcessBundleHandler

2017-08-31 Thread lcwik
Repository: beam Updated Branches: refs/heads/master 5cb7be78b -> c9653f270 [BEAM-1347] Wire up the BeamFnStateGrpcClientCache implementation into the ProcessBundleHandler Add a BeamFnStateClient that is dependent on whether the State API service descriptor is populated. Project: http://gi

[jira] [Comment Edited] (BEAM-2831) Possible bug in Beam+Flink memory management, disk spillover

2017-08-31 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16148985#comment-16148985 ] Aljoscha Krettek edited comment on BEAM-2831 at 8/31/17 1:41 PM:

[jira] [Commented] (BEAM-2831) Possible bug in Beam+Flink memory management, disk spillover

2017-08-31 Thread Aljoscha Krettek (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16148985#comment-16148985 ] Aljoscha Krettek commented on BEAM-2831: Could you try running it with this modifie

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #4692

2017-08-31 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-2831) Possible bug in Beam+Flink memory management, disk spillover

2017-08-31 Thread Reinier Kip (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reinier Kip updated BEAM-2831: -- Environment: Flink 1.2.1 and 1.3.0, Java HotSpot and OpenJDK 8, macOS 10.12.6 and unknown Linux (was: Fl

[jira] [Updated] (BEAM-2831) Possible bug in Beam+Flink memory management, disk spillover

2017-08-31 Thread Reinier Kip (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reinier Kip updated BEAM-2831: -- Description: I’ve been running a Beam pipeline on Flink. Depending on the dataset size and the heap memo

[jira] [Created] (BEAM-2831) Possible bug in Beam+Flink memory management, disk spillover

2017-08-31 Thread Reinier Kip (JIRA)
Reinier Kip created BEAM-2831: - Summary: Possible bug in Beam+Flink memory management, disk spillover Key: BEAM-2831 URL: https://issues.apache.org/jira/browse/BEAM-2831 Project: Beam Issue Type

[GitHub] beam pull request #3789: [JStorm-runner] Fix two issues of metrics reporter ...

2017-08-31 Thread bastiliu
Github user bastiliu closed the pull request at: https://github.com/apache/beam/pull/3789 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #4691

2017-08-31 Thread Apache Jenkins Server
See

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Dataflow #3877

2017-08-31 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2803) JdbcIO read is very slow when query return a lot of rows

2017-08-31 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16148552#comment-16148552 ] Jean-Baptiste Onofré commented on BEAM-2803: Thanks Eugene. I'm just back from

[jira] [Commented] (BEAM-2803) JdbcIO read is very slow when query return a lot of rows

2017-08-31 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16148550#comment-16148550 ] Jérémie Vexiau commented on BEAM-2803: -- great! thanks! > JdbcIO read is very slow whe