[jira] [Commented] (BEAM-2703) KafkaIO: watermark outside the bounds of BoundedWindow

2017-08-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140750#comment-16140750 ] ASF GitHub Bot commented on BEAM-2703: -- GitHub user rangadi opened a pull request:

[GitHub] beam pull request #3758: [BEAM-2703] Fix min_timestamp used for KafkaIO wate...

2017-08-24 Thread rangadi
GitHub user rangadi opened a pull request: https://github.com/apache/beam/pull/3758 [BEAM-2703] Fix min_timestamp used for KafkaIO watermark. Use correct -ve infinity timestamp in KafkaIO as suggested in description of [BEAM-2703].(https://issues.apache.org/jira/browse/BEAM-2703).

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3829

2017-08-24 Thread Apache Jenkins Server
See

[jira] [Assigned] (BEAM-1457) Enable rat plugin and findbugs plugin in default build

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1457: -- Assignee: (was: Davor Bonaci) > Enable rat plugin and findbugs plugin in default build >

[jira] [Assigned] (BEAM-1957) Missing DoFn annotations documentation

2017-08-24 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1957?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-1957: -- Assignee: Kenneth Knowles (was: Davor Bonaci) > Missing DoFn annotations documentation >

[jira] [Resolved] (BEAM-2302) WriteFiles with runner-determined sharding and large numbers of windows causes OOM errors

2017-08-24 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reuven Lax resolved BEAM-2302. -- Resolution: Fixed Fix Version/s: 2.1.0 > WriteFiles with runner-determined sharding and large

[jira] [Created] (BEAM-2804) support TIMESTAMP in Sort

2017-08-24 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-2804: Summary: support TIMESTAMP in Sort Key: BEAM-2804 URL: https://issues.apache.org/jira/browse/BEAM-2804 Project: Beam Issue Type: Improvement Components:

[jira] [Created] (BEAM-2805) Potential arithmetic overflow in Generator#nextAuctionLengthMs()

2017-08-24 Thread Ted Yu (JIRA)
Ted Yu created BEAM-2805: Summary: Potential arithmetic overflow in Generator#nextAuctionLengthMs() Key: BEAM-2805 URL: https://issues.apache.org/jira/browse/BEAM-2805 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-2797) Update unit tests for python mobile gaming examples

2017-08-24 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16140836#comment-16140836 ] Ahmet Altay commented on BEAM-2797: --- https://github.com/apache/beam/pull/3756 fixed this. > Update unit

[jira] [Resolved] (BEAM-2797) Update unit tests for python mobile gaming examples

2017-08-24 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-2797. --- Resolution: Fixed Fix Version/s: 2.2.0 > Update unit tests for python mobile gaming examples >

[jira] [Created] (BEAM-2806) support View.CreatePCollectionView in FlinkRunner

2017-08-24 Thread Xu Mingmin (JIRA)
Xu Mingmin created BEAM-2806: Summary: support View.CreatePCollectionView in FlinkRunner Key: BEAM-2806 URL: https://issues.apache.org/jira/browse/BEAM-2806 Project: Beam Issue Type: New Feature

[GitHub] beam pull request #3759: Moves Match into FileIO.match()/matchAll()

2017-08-24 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/3759 Moves Match into FileIO.match()/matchAll() FileIO will later gain other methods, such as read()/write(). Also introduces FileIO.match().filepattern(...) as a shorthand for

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3830

2017-08-24 Thread Apache Jenkins Server
See

[1/2] beam git commit: Fix min_timestamp used for KafkaIO watermark.

2017-08-24 Thread chamikara
Repository: beam Updated Branches: refs/heads/master c33cb0340 -> 20d88dbfc Fix min_timestamp used for KafkaIO watermark. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3362d1f5 Tree:

[2/2] beam git commit: This closes #3758

2017-08-24 Thread chamikara
This closes #3758 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/20d88dbf Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/20d88dbf Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/20d88dbf Branch:

[GitHub] beam pull request #3758: [BEAM-2703] Fix min_timestamp used for KafkaIO wate...

2017-08-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3758 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-2703) KafkaIO: watermark outside the bounds of BoundedWindow

2017-08-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141005#comment-16141005 ] ASF GitHub Bot commented on BEAM-2703: -- Github user asfgit closed the pull request at:

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4640

2017-08-24 Thread Apache Jenkins Server
See Changes: [chamikara] Fix min_timestamp used for KafkaIO watermark. -- [...truncated 1.12 MB...] 2017-08-25T01:25:43.220 [INFO] Downloading:

[beam-site] 02/02: This closes #280

2017-08-24 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 6a6df3934f85779ec5967c2a8c926e92ab8cf309 Merge: 6558483 71bff15 Author: Mergebot

[beam-site] 01/02: [BEAM-2726] Fix typo in programming guide

2017-08-24 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 71bff154c1aa2a52280673b112e26841a1af4376 Author: Lukasz Cwik AuthorDate: Fri Aug 4

[beam-site] branch mergebot updated (d00f31d -> 6a6df39)

2017-08-24 Thread mergebot-role
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. from d00f31d This closes #299 add 6558483 Prepare repository for deployment. new 71bff15

[1/2] beam git commit: [BEAM-2671] Implemented an InputDStream that syncs up with the watermark values, this should help with streaming tests in spark-runner.

2017-08-24 Thread staslevin
Repository: beam Updated Branches: refs/heads/master c4517d04c -> 5181e619f [BEAM-2671] Implemented an InputDStream that syncs up with the watermark values, this should help with streaming tests in spark-runner. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[GitHub] beam pull request #3738: [BEAM-2671] Fixing CreateStreamTest#testFirstElemen...

2017-08-24 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3738 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #3738

2017-08-24 Thread staslevin
This closes #3738 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5181e619 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5181e619 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/5181e619 Branch:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3824

2017-08-24 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2901

2017-08-24 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PerformanceTests_JDBC #196

2017-08-24 Thread Apache Jenkins Server
See Changes: [lcwik] [BEAM-1347] Provide an abstraction which creates an Iterator view over -- [...truncated 51.77 KB...] 2017-08-24 06:13:39,795 fa51d343

[jira] [Created] (BEAM-2802) TextIO should allow specifying a custom delimiter

2017-08-24 Thread Etienne Chauchot (JIRA)
Etienne Chauchot created BEAM-2802: -- Summary: TextIO should allow specifying a custom delimiter Key: BEAM-2802 URL: https://issues.apache.org/jira/browse/BEAM-2802 Project: Beam Issue Type:

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Spark #2902

2017-08-24 Thread Apache Jenkins Server
See

[jira] [Closed] (BEAM-2671) CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark runner

2017-08-24 Thread Stas Levin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stas Levin closed BEAM-2671. Resolution: Fixed > CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark > runner >

[jira] [Commented] (BEAM-2671) CreateStreamTest.testFirstElementLate validatesRunner test fails on Spark runner

2017-08-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139642#comment-16139642 ] ASF GitHub Bot commented on BEAM-2671: -- Github user asfgit closed the pull request at:

[jira] [Commented] (BEAM-2802) TextIO should allow specifying a custom delimiter

2017-08-24 Thread Etienne Chauchot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139735#comment-16139735 ] Etienne Chauchot commented on BEAM-2802: Besides, there is client use cases of multi-byte delimiter

[jira] [Updated] (BEAM-2789) Watermark can become unavailable for executors while it's updated with new values

2017-08-24 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-2789: Affects Version/s: (was: 2.0.0) > Watermark can become unavailable for executors while it's updated with

[jira] [Commented] (BEAM-2789) Watermark can become unavailable for executors while it's updated with new values

2017-08-24 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139764#comment-16139764 ] Aviem Zur commented on BEAM-2789: - While this affects the tests greatly since these are in a single JVM, I

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3825

2017-08-24 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-160) Port 'NexMark Queries' to Beam for use as integration test

2017-08-24 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-160: -- Fix Version/s: 2.2.0 > Port 'NexMark Queries' to Beam for use as integration test >

[jira] [Resolved] (BEAM-160) Port 'NexMark Queries' to Beam for use as integration test

2017-08-24 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-160?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-160. --- Resolution: Fixed > Port 'NexMark Queries' to Beam for use as integration test >

[jira] [Created] (BEAM-2803) JdbcIO read is very slow when query return a lot of rows

2017-08-24 Thread JIRA
Jérémie Vexiau created BEAM-2803: Summary: JdbcIO read is very slow when query return a lot of rows Key: BEAM-2803 URL: https://issues.apache.org/jira/browse/BEAM-2803 Project: Beam Issue

[jira] [Commented] (BEAM-1531) Support dynamic work rebalancing for HBaseIO

2017-08-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16139838#comment-16139838 ] ASF GitHub Bot commented on BEAM-1531: -- GitHub user iemejia opened a pull request:

[GitHub] beam pull request #3754: [BEAM-1531] Add dynamic work rebalancing support fo...

2017-08-24 Thread iemejia
GitHub user iemejia opened a pull request: https://github.com/apache/beam/pull/3754 [BEAM-1531] Add dynamic work rebalancing support for HBaseIO Follow this checklist to help us incorporate your contribution quickly and easily: - [x] Make sure there is a [JIRA

[GitHub] beam pull request #3761: [BEAM-1347] Remove unused FakeStepContext now that ...

2017-08-24 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3761 [BEAM-1347] Remove unused FakeStepContext now that FnApiDoFnRunner has its own implementation Follow this checklist to help us incorporate your contribution quickly and easily: - [ ]

[GitHub] beam pull request #3760: [BEAM-1347] Add a BagUserState implementation over ...

2017-08-24 Thread lukecwik
GitHub user lukecwik opened a pull request: https://github.com/apache/beam/pull/3760 [BEAM-1347] Add a BagUserState implementation over the BeamFnStateClient Follow this checklist to help us incorporate your contribution quickly and easily: - [ ] Make sure there is a

[jira] [Commented] (BEAM-1347) Basic Java harness capable of understanding process bundle tasks and sending data over the Fn Api

2017-08-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141048#comment-16141048 ] ASF GitHub Bot commented on BEAM-1347: -- GitHub user lukecwik opened a pull request:

[jira] [Commented] (BEAM-1347) Basic Java harness capable of understanding process bundle tasks and sending data over the Fn Api

2017-08-24 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16141046#comment-16141046 ] ASF GitHub Bot commented on BEAM-1347: -- GitHub user lukecwik opened a pull request:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Dataflow #3831

2017-08-24 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-2624) File-based sinks should produce a PCollection of written filenames

2017-08-24 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Reuven Lax updated BEAM-2624: - Fix Version/s: 2.2.0 > File-based sinks should produce a PCollection of written filenames >

<    1   2