[GitHub] incubator-beam pull request #1089: [BEAM-742] Replicate triggers to runners-...

2016-10-13 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/incubator-beam/pull/1089 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-741) Values transform does not use the correct output coder when values is an Iterable

2016-10-13 Thread Andrew Martin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572443#comment-15572443 ] Andrew Martin commented on BEAM-741: [~kenn] After investigating further, it seems like the coder for

[jira] [Created] (BEAM-747) Text checksum verifier is not resilient to eventually consistent filesystems

2016-10-13 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-747: Summary: Text checksum verifier is not resilient to eventually consistent filesystems Key: BEAM-747 URL: https://issues.apache.org/jira/browse/BEAM-747 Project: Beam

[jira] [Resolved] (BEAM-257) fix ConcurrentModificationException in KafkaIO

2016-10-13 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-257?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raghu Angadi resolved BEAM-257. --- Resolution: Fixed Fix Version/s: 0.1.0-incubating

[jira] [Updated] (BEAM-748) Issues with local processes in MongoDbIO and JdbcIO

2016-10-13 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-748: - Description: Hey JB, Can you take a look at these issues? Causing flakes in precommit testing.

[jira] [Comment Edited] (BEAM-688) Repeated 'mvn install' fails on beam-sdks-java-maven-archetypes-starter with undeclared dependency error

2016-10-13 Thread Ven Bijjam (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572415#comment-15572415 ] Ven Bijjam edited comment on BEAM-688 at 10/13/16 4:30 PM: --- I am seeing this on

[jira] [Commented] (BEAM-742) Move trigger state machines to runners-core, convert triggers to AST

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572593#comment-15572593 ] ASF GitHub Bot commented on BEAM-742: - Github user kennknowles closed the pull request at:

[1/2] incubator-beam git commit: Update to compile in eclipse again

2016-10-13 Thread dkulp
Repository: incubator-beam Updated Branches: refs/heads/eclipse2 [created] 83f0b6436 Update to compile in eclipse again Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a8cbd246 Tree:

[2/2] incubator-beam git commit: Attempt to add eclipse-jdt profile to a travis build

2016-10-13 Thread dkulp
Attempt to add eclipse-jdt profile to a travis build Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/83f0b643 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/83f0b643 Diff:

[jira] [Commented] (BEAM-591) Better handling watermark in KafkaIO

2016-10-13 Thread Raghu Angadi (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-591?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572540#comment-15572540 ] Raghu Angadi commented on BEAM-591: --- PubSubIO does advance the watermark to current time if there haven't

[jira] [Updated] (BEAM-593) Support unblocking run() in FlinkRunner and cancel() and waitUntilFinish() in FlinkRunnerResult

2016-10-13 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-593: Summary: Support unblocking run() in FlinkRunner and cancel() and waitUntilFinish() in FlinkRunnerResult (was:

[jira] [Reopened] (BEAM-741) Values transform does not use the correct output coder when values is an Iterable

2016-10-13 Thread Andrew Martin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Martin reopened BEAM-741: > Values transform does not use the correct output coder when values is an > Iterable >

[jira] [Created] (BEAM-748) Issues with local processes in MongoDbIO and JdbcIO

2016-10-13 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-748: Summary: Issues with local processes in MongoDbIO and JdbcIO Key: BEAM-748 URL: https://issues.apache.org/jira/browse/BEAM-748 Project: Beam Issue Type: Bug

[GitHub] incubator-beam pull request #1094: Build in eclipse/eclipse-jdt

2016-10-13 Thread dkulp
GitHub user dkulp opened a pull request: https://github.com/apache/incubator-beam/pull/1094 Build in eclipse/eclipse-jdt This just updates the code to build with eclipse-jdt (again) and adds the travis.xml changes back in . You can merge this pull request into a Git repository by

[jira] [Commented] (BEAM-688) Repeated 'mvn install' fails on beam-sdks-java-maven-archetypes-starter with undeclared dependency error

2016-10-13 Thread Venkata Bijjam (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-688?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572415#comment-15572415 ] Venkata Bijjam commented on BEAM-688: - I am seeing this on the initial build itself. I downloaded the

[incubator-beam] Git Push Summary

2016-10-13 Thread dkulp
Repository: incubator-beam Updated Branches: refs/heads/eclipse2 [deleted] 83f0b6436

[jira] [Created] (BEAM-749) Syntax highlight on website

2016-10-13 Thread Frances Perry (JIRA)
Frances Perry created BEAM-749: -- Summary: Syntax highlight on website Key: BEAM-749 URL: https://issues.apache.org/jira/browse/BEAM-749 Project: Beam Issue Type: Bug Components:

[GitHub] incubator-beam pull request #662: [BEAM-115] WIP: JSON Schema definition of ...

2016-10-13 Thread kennknowles
Github user kennknowles closed the pull request at: https://github.com/apache/incubator-beam/pull/662 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-115) Beam Runner API

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15572807#comment-15572807 ] ASF GitHub Bot commented on BEAM-115: - Github user kennknowles closed the pull request at:

[jira] [Commented] (BEAM-520) Update Python SDK example tests to use assert_that

2016-10-13 Thread Ven Bijjam (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573085#comment-15573085 ] Ven Bijjam commented on BEAM-520: - I would like to work on this. How do I get started? > Update Python SDK

[jira] [Updated] (BEAM-520) Update Python SDK example tests to use assert_that

2016-10-13 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-520: - Assignee: (was: Frances Perry) > Update Python SDK example tests to use assert_that >

[jira] [Updated] (BEAM-520) Update Python SDK example tests to use assert_that

2016-10-13 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-520: - Assignee: Frances Perry > Update Python SDK example tests to use assert_that >

[jira] [Updated] (BEAM-595) Support non-blocking run() in SparkRunner and cancel() and waitUntilFinish() in Spark EvaluationContext

2016-10-13 Thread Pei He (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-595?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Pei He updated BEAM-595: Summary: Support non-blocking run() in SparkRunner and cancel() and waitUntilFinish() in Spark EvaluationContext

[jira] [Commented] (BEAM-748) Issues with local processes in MongoDbIO and JdbcIO

2016-10-13 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-748?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573247#comment-15573247 ] Jean-Baptiste Onofré commented on BEAM-748: --- Yup, let me take a look. > Issues with local

[GitHub] incubator-beam pull request #1097: [BEAM-443] Update Beam batch examples to ...

2016-10-13 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1097 [BEAM-443] Update Beam batch examples to call waitUntilFinish() You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (BEAM-147) Introduce an easy API pipeline metrics

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573440#comment-15573440 ] ASF GitHub Bot commented on BEAM-147: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #1099: Move the step output ids to use a flat na...

2016-10-13 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/incubator-beam/pull/1099 Move the step output ids to use a flat namespace. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title

[GitHub] incubator-beam pull request #1096: [BEAM-595] avoid throwing Exception in wa...

2016-10-13 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/incubator-beam/pull/1096 [BEAM-595] avoid throwing Exception in waitUntilFinish in SparkRunner You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (BEAM-570) Update AvroSource to support more compression types

2016-10-13 Thread Konstantinos Katsiapis (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-570?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573243#comment-15573243 ] Konstantinos Katsiapis commented on BEAM-570: - Thanks Frances, PR

[GitHub] incubator-beam pull request #1024: [BEAM-147] Prototype of Metrics API for J...

2016-10-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1024 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[4/5] incubator-beam git commit: Initial Metrics API for Beam Java

2016-10-13 Thread bchambers
Initial Metrics API for Beam Java This includes a simple Counter metric and a Distribution metric that reports the SUM, COUNT, MIN, MAX and MEAN of the reported values. The API is labeled @Experimental since metrics will only be reported and queryable with the DirectRunner, and the API may

[5/5] incubator-beam git commit: Closes #1024

2016-10-13 Thread bchambers
Closes #1024 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/3c731707 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/3c731707 Diff:

[3/5] incubator-beam git commit: Initial Metrics API for Beam Java

2016-10-13 Thread bchambers
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/8524ed95/sdks/java/core/src/test/java/org/apache/beam/sdk/metrics/MetricsMapTest.java -- diff --git

[1/5] incubator-beam git commit: Implement Metrics in the DirectRunner

2016-10-13 Thread bchambers
Repository: incubator-beam Updated Branches: refs/heads/master e969f3d38 -> 3c731707b Implement Metrics in the DirectRunner Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/834933c5 Tree:

[2/5] incubator-beam git commit: Add the ability to query metrics on PipelineResult

2016-10-13 Thread bchambers
Add the ability to query metrics on PipelineResult All runners currently implement this by throwing an UnsupportedOperationException. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/51fee39b Tree:

[jira] [Updated] (BEAM-147) Introduce an easy API for pipeline metrics

2016-10-13 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-147?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ben Chambers updated BEAM-147: -- Summary: Introduce an easy API for pipeline metrics (was: Introduce an easy API pipeline metrics) >

[jira] [Commented] (BEAM-520) Update Python SDK example tests to use assert_that

2016-10-13 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-520?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573113#comment-15573113 ] Ahmet Altay commented on BEAM-520: -- Ven, thank you for your interest. A partial cleanup was already done

[jira] [Commented] (BEAM-361) Batch Pub/Sub sink does not set idLabel

2016-10-13 Thread Ven Bijjam (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573234#comment-15573234 ] Ven Bijjam commented on BEAM-361: - I am thinking along these lines:: in {code}PubsubUnboundedSource{code}

[jira] [Commented] (BEAM-596) Support cancel() and waitUntilFinish() in DirectRunner

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573352#comment-15573352 ] ASF GitHub Bot commented on BEAM-596: - GitHub user tgroh opened a pull request:

[GitHub] incubator-beam pull request #1098: [BEAM-596] Replace DirectResult#awaitComp...

2016-10-13 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/incubator-beam/pull/1098 [BEAM-596] Replace DirectResult#awaitCompletion with waitUntilFinish Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[jira] [Commented] (BEAM-595) Support non-blocking run() in SparkRunner and cancel() and waitUntilFinish() in Spark EvaluationContext

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573207#comment-15573207 ] ASF GitHub Bot commented on BEAM-595: - GitHub user peihe opened a pull request:

[jira] [Commented] (BEAM-742) Move trigger state machines to runners-core, convert triggers to AST

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573390#comment-15573390 ] ASF GitHub Bot commented on BEAM-742: - Github user asfgit closed the pull request at:

[14/17] incubator-beam git commit: Restore prior trigger files, for temporary compatibility

2016-10-13 Thread kenn
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/a64acb2f/sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/windowing/AfterSynchronizedProcessingTimeTest.java -- diff --git

[05/17] incubator-beam git commit: Rename runners-core Trigger to TriggerStateMachine

2016-10-13 Thread kenn
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/69b1efda/runners/core-java/src/main/java/org/apache/beam/runners/core/reactors/Repeatedly.java -- diff --git

[12/17] incubator-beam git commit: Move triggers to runners-core

2016-10-13 Thread kenn
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/e4398e1e/runners/core-java/src/main/java/org/apache/beam/runners/core/reactors/FinishedTriggersSet.java -- diff --git

[08/17] incubator-beam git commit: Move triggers to runners-core

2016-10-13 Thread kenn
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/e4398e1e/sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/windowing/AfterSynchronizedProcessingTimeTest.java -- diff --git

[jira] [Comment Edited] (BEAM-361) Batch Pub/Sub sink does not set idLabel

2016-10-13 Thread Ven Bijjam (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573234#comment-15573234 ] Ven Bijjam edited comment on BEAM-361 at 10/13/16 9:29 PM: --- I am thinking along

[jira] [Commented] (BEAM-443) PipelineResult needs waitToFinish() and cancel()

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573284#comment-15573284 ] ASF GitHub Bot commented on BEAM-443: - GitHub user peihe opened a pull request:

Build failed in Jenkins: beam_PostCommit_MavenVerify » Apache Beam :: SDKs :: Java :: IO :: Google Cloud Platform #1522

2016-10-13 Thread Apache Jenkins Server
See -- [INFO] [INFO]

[jira] [Commented] (BEAM-361) Batch Pub/Sub sink does not set idLabel

2016-10-13 Thread Ven Bijjam (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573125#comment-15573125 ] Ven Bijjam commented on BEAM-361: - Hi I would like to take this up. But I am not sure how to contribute as

[jira] [Comment Edited] (BEAM-361) Batch Pub/Sub sink does not set idLabel

2016-10-13 Thread Ven Bijjam (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573234#comment-15573234 ] Ven Bijjam edited comment on BEAM-361 at 10/13/16 9:30 PM: --- I am thinking along

[jira] [Comment Edited] (BEAM-361) Batch Pub/Sub sink does not set idLabel

2016-10-13 Thread Ven Bijjam (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573234#comment-15573234 ] Ven Bijjam edited comment on BEAM-361 at 10/13/16 9:29 PM: --- I am thinking along

[15/17] incubator-beam git commit: Restore prior trigger files, for temporary compatibility

2016-10-13 Thread kenn
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/a64acb2f/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/windowing/Trigger.java -- diff --git

[13/17] incubator-beam git commit: Move triggers to runners-core

2016-10-13 Thread kenn
Move triggers to runners-core This commit is effectively a "git hint" that all the files in runners-core are moved from prior files. The moved files will be replaced. Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit:

[16/17] incubator-beam git commit: Restore prior trigger files, for temporary compatibility

2016-10-13 Thread kenn
Restore prior trigger files, for temporary compatibility Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/a64acb2f Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/a64acb2f Diff:

[GitHub] incubator-beam pull request #1083: [BEAM-742] Replicate triggers to runners-...

2016-10-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1083 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[04/17] incubator-beam git commit: Rename runners-core Trigger to TriggerStateMachine

2016-10-13 Thread kenn
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/69b1efda/runners/core-java/src/main/java/org/apache/beam/runners/core/triggers/AfterProcessingTimeStateMachine.java -- diff --git

[01/17] incubator-beam git commit: Rename runners-core Trigger to TriggerStateMachine

2016-10-13 Thread kenn
Repository: incubator-beam Updated Branches: refs/heads/master 73226168a -> e969f3d38 http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/69b1efda/runners/core-java/src/test/java/org/apache/beam/runners/core/triggers/AfterWatermarkStateMachineTest.java

[03/17] incubator-beam git commit: Rename runners-core Trigger to TriggerStateMachine

2016-10-13 Thread kenn
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/69b1efda/runners/core-java/src/main/java/org/apache/beam/runners/core/triggers/TriggerStateMachineRunner.java -- diff --git

[11/17] incubator-beam git commit: Move triggers to runners-core

2016-10-13 Thread kenn
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/e4398e1e/runners/core-java/src/test/java/org/apache/beam/runners/core/reactors/AfterPaneTest.java -- diff --git

[17/17] incubator-beam git commit: This closes #1083

2016-10-13 Thread kenn
This closes #1083 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/e969f3d3 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/e969f3d3 Diff:

[07/17] incubator-beam git commit: Move triggers to runners-core

2016-10-13 Thread kenn
http://git-wip-us.apache.org/repos/asf/incubator-beam/blob/e4398e1e/sdks/java/core/src/test/java/org/apache/beam/sdk/util/TriggerTester.java -- diff --git a/sdks/java/core/src/test/java/org/apache/beam/sdk/util/TriggerTester.java

Re: Build failed in Jenkins: beam_PostCommit_MavenVerify #1522

2016-10-13 Thread Kenneth Knowles
FYI I am watching the subsequent results. This error was caused by the JVM on the Jenkins worker getting OOM-killed, did not seem to relate to recent changes. But I'll watch to make sure. On Thu, Oct 13, 2016 at 3:35 PM Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See < >

[1/2] incubator-beam git commit: KafkaIO reader should set consumedOffset even before reading the first record.

2016-10-13 Thread dhalperi
Repository: incubator-beam Updated Branches: refs/heads/master 3c731707b -> 93d2e374c KafkaIO reader should set consumedOffset even before reading the first record. * Distinguish between uninitialized consumed offset and consumed offset for an empty partition. * Add test to verify we

Jenkins build became unstable: beam_PostCommit_MavenVerify » Apache Beam :: Examples :: Java #1525

2016-10-13 Thread Apache Jenkins Server
See

[GitHub] incubator-beam pull request #1071: KafkaIO reader should set consumedOffset ...

2016-10-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1071 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] incubator-beam pull request #1009: [BEAM-551] Add ValueProvider class (Take ...

2016-10-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1009 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Commented] (BEAM-551) Support Dynamic PipelineOptions

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574304#comment-15574304 ] ASF GitHub Bot commented on BEAM-551: - Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #1100: Windowed side inputs

2016-10-13 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/incubator-beam/pull/1100 Windowed side inputs Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

Jenkins build became unstable: beam_PostCommit_MavenVerify #1525

2016-10-13 Thread Apache Jenkins Server
See

[1/2] incubator-beam git commit: Add DoFn.StateId annotation and validation on fields

2016-10-13 Thread kenn
Repository: incubator-beam Updated Branches: refs/heads/master 5bfeb958d -> a0f649eac Add DoFn.StateId annotation and validation on fields Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/add34518 Tree:

[jira] [Updated] (BEAM-747) Text checksum verifier is not resilient to eventually consistent filesystems

2016-10-13 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-747: - Description: Example 1:

Re: Jenkins build became unstable: beam_PostCommit_MavenVerify #1525

2016-10-13 Thread Dan Halperin
Filed https://issues.apache.org/jira/browse/BEAM-747 On Thu, Oct 13, 2016 at 5:33 PM, Apache Jenkins Server < jenk...@builds.apache.org> wrote: > See > >

[jira] [Commented] (BEAM-25) Add user-ready API for interacting with state

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-25?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574331#comment-15574331 ] ASF GitHub Bot commented on BEAM-25: Github user asfgit closed the pull request at:

[GitHub] incubator-beam pull request #1086: [BEAM-25] Add DoFn.StateId annotation and...

2016-10-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/1086 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[jira] [Comment Edited] (BEAM-697) TextIO.Write.Bound.withHeader() and withFooter() do not use the current value of validate for the returned Bound instance

2016-10-13 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574335#comment-15574335 ] Daniel Halperin edited comment on BEAM-697 at 10/14/16 5:55 AM: Thanks for

[jira] [Commented] (BEAM-697) TextIO.Write.Bound.withHeader() and withFooter() do not use the current value of validate for the returned Bound instance

2016-10-13 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574335#comment-15574335 ] Daniel Halperin commented on BEAM-697: -- Thanks for this. Mirroring from discussion on that PR, prefer

Re: Jenkins build became unstable: beam_PostCommit_MavenVerify #1525

2016-10-13 Thread Jean-Baptiste Onofré
Thx ! Regards JB On 10/14/2016 07:52 AM, Dan Halperin wrote: Filed https://issues.apache.org/jira/browse/BEAM-747 On Thu, Oct 13, 2016 at 5:33 PM, Apache Jenkins Server > wrote: See

[GitHub] incubator-beam pull request #908: Fix inconsistent in formatting flink logs

2016-10-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/incubator-beam/pull/908 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[1/2] incubator-beam git commit: Fix inconsistent in formatting logs: leaveCompositeTransform always decrement depth, but enterCompositeTransform increment depth only on ENTER_TRANSFORM

2016-10-13 Thread mxm
Repository: incubator-beam Updated Branches: refs/heads/master 13b45895e -> 73226168a Fix inconsistent in formatting logs: leaveCompositeTransform always decrement depth, but enterCompositeTransform increment depth only on ENTER_TRANSFORM Project:

[2/2] incubator-beam git commit: This closes #908

2016-10-13 Thread mxm
This closes #908 Project: http://git-wip-us.apache.org/repos/asf/incubator-beam/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-beam/commit/73226168 Tree: http://git-wip-us.apache.org/repos/asf/incubator-beam/tree/73226168 Diff:

[jira] [Commented] (BEAM-593) Support cancel() and waitUntilFinish() in FlinkRunnerResult

2016-10-13 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15571724#comment-15571724 ] ASF GitHub Bot commented on BEAM-593: - GitHub user mxm opened a pull request:

[GitHub] incubator-beam pull request #1093: [BEAM-593] avoid throwing Exception in wa...

2016-10-13 Thread mxm
GitHub user mxm opened a pull request: https://github.com/apache/incubator-beam/pull/1093 [BEAM-593] avoid throwing Exception in waitUntilFinish The current implementation of Flink's `PipelineResult` assumes that the pipeline has already been processed. Hence, we can return