[jira] [Assigned] (BEAM-2441) DSL SQL maven module location and name

2017-06-22 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xu Mingmin reassigned BEAM-2441: Assignee: (was: Xu Mingmin) > DSL SQL maven module location and name >

[jira] [Commented] (BEAM-301) Add a Beam SQL DSL

2017-06-22 Thread Xu Mingmin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060434#comment-16060434 ] Xu Mingmin commented on BEAM-301: - [~julianhyde] we're preparing for the first version of SQL support in

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2457

2017-06-22 Thread Apache Jenkins Server
See

[jira] [Resolved] (BEAM-2497) TextIO can't read concatenated gzip files

2017-06-22 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath resolved BEAM-2497. -- Resolution: Fixed > TextIO can't read concatenated gzip files >

[jira] [Commented] (BEAM-2497) TextIO can't read concatenated gzip files

2017-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060410#comment-16060410 ] ASF GitHub Bot commented on BEAM-2497: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3428: [BEAM-2497] Fix the reading of concat gzip files

2017-06-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3428 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: [BEAM-2497] Fix the reading of concat gzip files

2017-06-22 Thread chamikara
Repository: beam Updated Branches: refs/heads/master b3c36256e -> 336b7f1cf [BEAM-2497] Fix the reading of concat gzip files Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8dcda6e4 Tree:

[2/2] beam git commit: This closes #3428

2017-06-22 Thread chamikara
This closes #3428 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/336b7f1c Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/336b7f1c Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/336b7f1c Branch:

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4194

2017-06-22 Thread Apache Jenkins Server
See

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Gearpump #175

2017-06-22 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4195

2017-06-22 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2490) ReadFromText function is not taking all data with glob operator (*)

2017-06-22 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060384#comment-16060384 ] Chamikara Jayalath commented on BEAM-2490: -- Thanks Guillermo and Ahmet. Guillermo, let us know if

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2456

2017-06-22 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2455

2017-06-22 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1458) Checkpoint support in Beam

2017-06-22 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060364#comment-16060364 ] Kenneth Knowles commented on BEAM-1458: --- I would suggest we consider checkpoint migration/conversion

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4193

2017-06-22 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-301) Add a Beam SQL DSL

2017-06-22 Thread Julian Hyde (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060361#comment-16060361 ] Julian Hyde commented on BEAM-301: -- I'd like to track/participate in the SQL-DSL effort. But sorry, I don't

[jira] [Resolved] (BEAM-1282) DoFnTester should allow output() calls in start/finishBundle

2017-06-22 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-1282. --- Resolution: Fixed > DoFnTester should allow output() calls in start/finishBundle >

[jira] [Updated] (BEAM-1282) DoFnTester should allow output() calls in start/finishBundle

2017-06-22 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-1282: -- Fix Version/s: 2.1.0 > DoFnTester should allow output() calls in start/finishBundle >

[jira] [Commented] (BEAM-1282) DoFnTester should allow output() calls in start/finishBundle

2017-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060357#comment-16060357 ] ASF GitHub Bot commented on BEAM-1282: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3367: [BEAM-1282] Support @FinishBundle output in DoFnTes...

2017-06-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3367 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Allow output from FinishBundle in DoFnTester

2017-06-22 Thread kenn
Repository: beam Updated Branches: refs/heads/master 5f8cfa741 -> b3c36256e Allow output from FinishBundle in DoFnTester Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/649994b3 Tree:

[2/2] beam git commit: This closes #3367: Allow output from FinishBundle in DoFnTester

2017-06-22 Thread kenn
This closes #3367: Allow output from FinishBundle in DoFnTester Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b3c36256 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b3c36256 Diff:

[jira] [Resolved] (BEAM-2485) Reject stateful ParDo / DoFn in merging windows at construction time in Dataflow runner

2017-06-22 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-2485. --- Resolution: Fixed > Reject stateful ParDo / DoFn in merging windows at construction time in >

[jira] [Commented] (BEAM-2485) Reject stateful ParDo / DoFn in merging windows at construction time in Dataflow runner

2017-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060354#comment-16060354 ] ASF GitHub Bot commented on BEAM-2485: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3419: [BEAM-2485] DataflowRunner: Reject merging windowin...

2017-06-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3419 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-2478) Distinct Aggregates

2017-06-22 Thread Jingsong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2478?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060353#comment-16060353 ] Jingsong Lee commented on BEAM-2478: Count(Distinct) is a very interesting function. It needs operator

[1/2] beam git commit: DataflowRunner: Reject merging windowing for stateful ParDo

2017-06-22 Thread kenn
Repository: beam Updated Branches: refs/heads/master 8860cceb7 -> 5f8cfa741 DataflowRunner: Reject merging windowing for stateful ParDo Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/cab4d896 Tree:

[2/2] beam git commit: This closes #3419: DataflowRunner: Reject merging windowing for stateful ParDo

2017-06-22 Thread kenn
This closes #3419: DataflowRunner: Reject merging windowing for stateful ParDo Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5f8cfa74 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5f8cfa74 Diff:

[jira] [Commented] (BEAM-79) Gearpump runner

2017-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-79?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060352#comment-16060352 ] ASF GitHub Bot commented on BEAM-79: Github user asfgit closed the pull request at:

[31/50] beam git commit: [BEAM-2439] Dynamic sizing of Datastore write RPCs

2017-06-22 Thread kenn
[BEAM-2439] Dynamic sizing of Datastore write RPCs This closes #3390 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/9ed0af8f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/9ed0af8f Diff:

[44/50] beam git commit: Remove fn api bundle descriptor translation.

2017-06-22 Thread kenn
Remove fn api bundle descriptor translation. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5d6ad199 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5d6ad199 Diff:

[48/50] beam git commit: This closes #3417: [BEAM-1377] Uses KV in SplittableParDo expansion instead of ElementAndRestriction

2017-06-22 Thread kenn
This closes #3417: [BEAM-1377] Uses KV in SplittableParDo expansion instead of ElementAndRestriction Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8860cceb Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8860cceb

[07/50] beam git commit: Turn notifications for broken Windows test off.

2017-06-22 Thread kenn
Turn notifications for broken Windows test off. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/65a6d662 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/65a6d662 Diff:

[46/50] beam git commit: Uses KV in SplittableParDo expansion instead of ElementAndRestriction

2017-06-22 Thread kenn
Uses KV in SplittableParDo expansion instead of ElementAndRestriction This is a workaround for the following issue. ElementAndRestriction is in runners-core, which may be shaded by runners (and is shaded by Dataflow runner), hence it should be *both* produced and consumed by workers - but

[23/50] beam git commit: This closes #3343

2017-06-22 Thread kenn
This closes #3343 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e2ee5955 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e2ee5955 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/e2ee5955 Branch:

[20/50] beam git commit: This closes #3399

2017-06-22 Thread kenn
This closes #3399 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b3099bba Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b3099bba Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b3099bba Branch:

[22/50] beam git commit: Move Spark runner streaming tests to post commit.

2017-06-22 Thread kenn
Move Spark runner streaming tests to post commit. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/22dbb500 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/22dbb500 Diff:

[10/50] beam git commit: This closes #3412

2017-06-22 Thread kenn
This closes #3412 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/28c6fd42 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/28c6fd42 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/28c6fd42 Branch:

[49/50] beam git commit: Remove unused codes

2017-06-22 Thread kenn
Remove unused codes Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b21fa04f Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b21fa04f Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b21fa04f Branch:

[37/50] beam git commit: Do not GC windows based on processing time timer!

2017-06-22 Thread kenn
Do not GC windows based on processing time timer! Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/50c43d96 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/50c43d96 Diff:

[25/50] beam git commit: This closes #3421

2017-06-22 Thread kenn
This closes #3421 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3785b5ba Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3785b5ba Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/3785b5ba Branch:

[13/50] beam git commit: Remove GroupedShuffleRangeTracker which is unused in the SDK

2017-06-22 Thread kenn
Remove GroupedShuffleRangeTracker which is unused in the SDK Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c6d0d798 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c6d0d798 Diff:

[29/50] beam git commit: This closes #3423

2017-06-22 Thread kenn
This closes #3423 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3dc454a9 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3dc454a9 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/3dc454a9 Branch:

[03/50] beam git commit: [BEAM-2481] Update commons-lang3 dependency to version 3.6

2017-06-22 Thread kenn
[BEAM-2481] Update commons-lang3 dependency to version 3.6 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6681472a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6681472a Diff:

[50/50] beam git commit: This closes #3388: Sync gearpump-runner branch with master

2017-06-22 Thread kenn
This closes #3388: Sync gearpump-runner branch with master Remove unused codes Fix kryo exception Fix PCollectionView translation upgrade to gearpump 0.8.4-SNAPSHOT Fix side input handling in DoFnFunction Respect WindowFn#getOutputTime in gearpump-runner Activate Gearpump

[41/50] beam git commit: Add tests for corner cases of processing time timers

2017-06-22 Thread kenn
Add tests for corner cases of processing time timers Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d2b384a2 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d2b384a2 Diff:

[04/50] beam git commit: [BEAM-2481] This closes #3401

2017-06-22 Thread kenn
[BEAM-2481] This closes #3401 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/50acc6c2 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/50acc6c2 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/50acc6c2 Branch:

[33/50] beam git commit: This closes #3420: DataflowRunner: Reject SetState and MapState

2017-06-22 Thread kenn
This closes #3420: DataflowRunner: Reject SetState and MapState Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/5506be87 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/5506be87 Diff:

[15/50] beam git commit: ReduceFnRunner.onTrigger: skip storeCurrentPaneInfo() if trigger isFinished.

2017-06-22 Thread kenn
ReduceFnRunner.onTrigger: skip storeCurrentPaneInfo() if trigger isFinished. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/cd886300 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/cd886300 Diff:

[06/50] beam git commit: This closes #3405

2017-06-22 Thread kenn
This closes #3405 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d1d78121 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d1d78121 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/d1d78121 Branch:

[26/50] beam git commit: Java Dataflow runner harness compatibility.

2017-06-22 Thread kenn
Java Dataflow runner harness compatibility. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/8cab1533 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/8cab1533 Diff:

[43/50] beam git commit: Remove unused (and untested) initial splittling logic.

2017-06-22 Thread kenn
Remove unused (and untested) initial splittling logic. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a882e8f3 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a882e8f3 Diff:

[17/50] beam git commit: [BEAM-2495] Add Python test dependency six>=1.9

2017-06-22 Thread kenn
[BEAM-2495] Add Python test dependency six>=1.9 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/17c50122 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/17c50122 Diff:

[40/50] beam git commit: Add test reproducing BEAM-2505, ignored

2017-06-22 Thread kenn
Add test reproducing BEAM-2505, ignored Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/fda589c0 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/fda589c0 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/fda589c0

[35/50] beam git commit: ReduceFnTester assertion for windows that have data buffered

2017-06-22 Thread kenn
ReduceFnTester assertion for windows that have data buffered Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/795760d3 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/795760d3 Diff:

[39/50] beam git commit: Tidy LateDataDroppingDoFnRunner

2017-06-22 Thread kenn
Tidy LateDataDroppingDoFnRunner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/d4e5db51 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/d4e5db51 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/d4e5db51 Branch:

[47/50] beam git commit: Bump Dataflow worker to 0622

2017-06-22 Thread kenn
google-cloud-dataflow-java/pom.xml @@ -33,7 +33,7 @@ jar - beam-master-20170619 + beam-master-20170622 1 6

[45/50] beam git commit: Closes #3424

2017-06-22 Thread kenn
Closes #3424 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7a9f762e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7a9f762e Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/7a9f762e Branch:

[GitHub] beam pull request #3388: [BEAM-79] Sync gearpump-runner branch with master

2017-06-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3388 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[34/50] beam git commit: ReduceFnTester can advance clocks without firing timers

2017-06-22 Thread kenn
ReduceFnTester can advance clocks without firing timers Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/1c1f2395 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/1c1f2395 Diff:

[36/50] beam git commit: Drop late data in ReduceFnTester

2017-06-22 Thread kenn
Drop late data in ReduceFnTester Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/412fd7ea Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/412fd7ea Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/412fd7ea Branch:

[16/50] beam git commit: This closes #3235

2017-06-22 Thread kenn
This closes #3235 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e015168a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e015168a Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/e015168a Branch:

[27/50] beam git commit: Closes #3418

2017-06-22 Thread kenn
Closes #3418 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2a552001 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2a552001 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/2a552001 Branch:

[05/50] beam git commit: Use state / timer API for DirectRunner timer firings

2017-06-22 Thread kenn
Use state / timer API for DirectRunner timer firings Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/56041b78 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/56041b78 Diff:

[32/50] beam git commit: DataflowRunner: Reject SetState and MapState

2017-06-22 Thread kenn
DataflowRunner: Reject SetState and MapState Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c0576445 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/c0576445 Diff:

[18/50] beam git commit: This closes #3416

2017-06-22 Thread kenn
This closes #3416 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ae50fdd9 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ae50fdd9 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/ae50fdd9 Branch:

[02/50] beam git commit: This closes #3407

2017-06-22 Thread kenn
This closes #3407 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f96a127e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f96a127e Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/f96a127e Branch:

[30/50] beam git commit: [BEAM-2439] Dynamic sizing of Datastore write RPCs

2017-06-22 Thread kenn
[BEAM-2439] Dynamic sizing of Datastore write RPCs This stops the Datastore connector from always sending 500 entities per RPC. Instead, it starts at a lower number which is more likely to complete within the deadline even in adverse conditions, and then increases or reduces the batch size in

[21/50] beam git commit: [BEAM-2359] Fix watermark broadcasting to executors in Spark runner

2017-06-22 Thread kenn
[BEAM-2359] Fix watermark broadcasting to executors in Spark runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/20820fa5 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/20820fa5 Diff:

[12/50] beam git commit: This closes #3409

2017-06-22 Thread kenn
This closes #3409 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f0467b72 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f0467b72 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/f0467b72 Branch:

[09/50] beam git commit: Fix minor issues on HCatalogIO

2017-06-22 Thread kenn
Fix minor issues on HCatalogIO - Restrict access level when possible - Rename Filter to Partition for the write to be coherent with the HCatalog API - Improve test coverage - Fix documentation details - Implement TearDown method for the writer Project:

[14/50] beam git commit: This closes #3414

2017-06-22 Thread kenn
This closes #3414 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3746d4ca Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3746d4ca Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/3746d4ca Branch:

[08/50] beam git commit: This closes #3413: Turn notifications for broken Windows test off.

2017-06-22 Thread kenn
This closes #3413: Turn notifications for broken Windows test off. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/2d25b684 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/2d25b684 Diff:

[01/50] beam git commit: Return a valid Coder for any subtype of Mutation on HBaseCoderProviderRegistrar

2017-06-22 Thread kenn
Repository: beam Updated Branches: refs/heads/gearpump-runner 559e3c341 -> 99f4f8b1b Return a valid Coder for any subtype of Mutation on HBaseCoderProviderRegistrar Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6b6d20d9

[11/50] beam git commit: Allow production of unprocessed bundles, introduce TestStream evaluator in DirectRunner

2017-06-22 Thread kenn
Allow production of unprocessed bundles, introduce TestStream evaluator in DirectRunner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3520f948 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3520f948 Diff:

[jira] [Created] (BEAM-2507) Support stateful processing in merging windows in DataflowRunner

2017-06-22 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-2507: - Summary: Support stateful processing in merging windows in DataflowRunner Key: BEAM-2507 URL: https://issues.apache.org/jira/browse/BEAM-2507 Project: Beam

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2454

2017-06-22 Thread Apache Jenkins Server
See

[1/3] beam git commit: Uses KV in SplittableParDo expansion instead of ElementAndRestriction

2017-06-22 Thread jkff
Repository: beam Updated Branches: refs/heads/master 7a9f762e4 -> 8860cceb7 Uses KV in SplittableParDo expansion instead of ElementAndRestriction This is a workaround for the following issue. ElementAndRestriction is in runners-core, which may be shaded by runners (and is shaded by Dataflow

[GitHub] beam pull request #3417: [BEAM-1377] Uses KV in SplittableParDo expansion in...

2017-06-22 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3417 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4192

2017-06-22 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-2502) Processing time timers for expired windows are not ignored

2017-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060275#comment-16060275 ] ASF GitHub Bot commented on BEAM-2502: -- GitHub user kennknowles opened a pull request:

[GitHub] beam pull request #3429: [BEAM-2502] Ignore processing time timers in expire...

2017-06-22 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3429 [BEAM-2502] Ignore processing time timers in expired windows Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4191

2017-06-22 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-2502) Processing time timers for expired windows are not ignored

2017-06-22 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2502: -- Priority: Minor (was: Critical) > Processing time timers for expired windows are not ignored >

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4190

2017-06-22 Thread Apache Jenkins Server
See

[GitHub] beam pull request #3428: [BEAM-2497] Fix the reading of concat gzip files

2017-06-22 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/3428 [BEAM-2497] Fix the reading of concat gzip files Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

[jira] [Resolved] (BEAM-2504) Processing time timers with timestamp past GC time are interpreted as GC timers

2017-06-22 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2504?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-2504. --- Resolution: Fixed > Processing time timers with timestamp past GC time are interpreted as GC

[jira] [Commented] (BEAM-2490) ReadFromText function is not taking all data with glob operator (*)

2017-06-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060219#comment-16060219 ] Guillermo Rodríguez Cano commented on BEAM-2490: Thanks [~altay]. My bad, I did not notice

[jira] [Commented] (BEAM-2503) use static table name in BeamSql.simpleQuery

2017-06-22 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060218#comment-16060218 ] ASF GitHub Bot commented on BEAM-2503: -- GitHub user XuMingmin opened a pull request:

[GitHub] beam pull request #3427: [BEAM-2503] use static table name in BeamSql.simple...

2017-06-22 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/3427 [BEAM-2503] use static table name in BeamSql.simpleQuery R: @takidau As discussed in #3372, here's the part to use fixed table name `PCOLLECTION` in `BeamSql.simpleQuery`. You can merge

[jira] [Comment Edited] (BEAM-2490) ReadFromText function is not taking all data with glob operator (*)

2017-06-22 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060191#comment-16060191 ] Ahmet Altay edited comment on BEAM-2490 at 6/22/17 11:30 PM: - Hi [~wileeam], it

[jira] [Commented] (BEAM-2490) ReadFromText function is not taking all data with glob operator (*)

2017-06-22 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060191#comment-16060191 ] Ahmet Altay commented on BEAM-2490: --- Hi [~wileeam], it looks like your problem is that your shell is

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #2451

2017-06-22 Thread Apache Jenkins Server
See

[jira] [Comment Edited] (BEAM-2490) ReadFromText function is not taking all data with glob operator (*)

2017-06-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060177#comment-16060177 ] Guillermo Rodríguez Cano edited comment on BEAM-2490 at 6/22/17 11:21 PM:

[jira] [Comment Edited] (BEAM-2490) ReadFromText function is not taking all data with glob operator (*)

2017-06-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060177#comment-16060177 ] Guillermo Rodríguez Cano edited comment on BEAM-2490 at 6/22/17 11:19 PM:

[jira] [Comment Edited] (BEAM-2490) ReadFromText function is not taking all data with glob operator (*)

2017-06-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060177#comment-16060177 ] Guillermo Rodríguez Cano edited comment on BEAM-2490 at 6/22/17 11:18 PM:

[jira] [Comment Edited] (BEAM-2490) ReadFromText function is not taking all data with glob operator (*)

2017-06-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060177#comment-16060177 ] Guillermo Rodríguez Cano edited comment on BEAM-2490 at 6/22/17 11:18 PM:

[jira] [Comment Edited] (BEAM-2490) ReadFromText function is not taking all data with glob operator (*)

2017-06-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060177#comment-16060177 ] Guillermo Rodríguez Cano edited comment on BEAM-2490 at 6/22/17 11:17 PM:

[jira] [Comment Edited] (BEAM-2490) ReadFromText function is not taking all data with glob operator (*)

2017-06-22 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16060177#comment-16060177 ] Guillermo Rodríguez Cano edited comment on BEAM-2490 at 6/22/17 11:17 PM:

  1   2   >