Build failed in Jenkins: beam_PostCommit_Java_MavenInstall_Windows #159

2017-06-21 Thread Apache Jenkins Server
See Changes: [kirpichov] BEAM-1438 Auto shard streaming sinks [robertwb] None should be a valid return element -- [...truncated 2.65 MB...]

[jira] [Commented] (BEAM-9) Storm Runner

2017-06-21 Thread Xiao LI (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057070#comment-16057070 ] Xiao LI commented on BEAM-9: It's great to hear the progress about storm runner. Our team are looking for an

[GitHub] beam pull request #3407: Return a valid Coder for any subtype of Mutation on...

2017-06-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3407 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Return a valid Coder for any subtype of Mutation on HBaseCoderProviderRegistrar

2017-06-21 Thread iemejia
Repository: beam Updated Branches: refs/heads/master a40d11c8e -> f96a127e2 Return a valid Coder for any subtype of Mutation on HBaseCoderProviderRegistrar Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6b6d20d9 Tree:

[2/2] beam git commit: This closes #3407

2017-06-21 Thread iemejia
This closes #3407 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f96a127e Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f96a127e Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/f96a127e Branch:

[1/2] beam git commit: [BEAM-2481] Update commons-lang3 dependency to version 3.6

2017-06-21 Thread jbonofre
Repository: beam Updated Branches: refs/heads/master f96a127e2 -> 50acc6c20 [BEAM-2481] Update commons-lang3 dependency to version 3.6 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6681472a Tree:

[GitHub] beam pull request #3401: [BEAM-2481] Update commons-lang3 dependency to vers...

2017-06-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3401 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3411: [BEAM-2489] Use dynamic ES port in HIFIOWithElastic...

2017-06-21 Thread echauchot
GitHub user echauchot opened a pull request: https://github.com/apache/beam/pull/3411 [BEAM-2489] Use dynamic ES port in HIFIOWithElasticTest Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [X] Make sure the PR title is

[jira] [Comment Edited] (BEAM-9) Storm Runner

2017-06-21 Thread Xiao LI (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-9?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057070#comment-16057070 ] Xiao LI edited comment on BEAM-9 at 6/21/17 6:59 AM: - It's great to hear the progress

[jira] [Created] (BEAM-2488) Elasticsearch IO should read also in replica shards

2017-06-21 Thread Etienne Chauchot (JIRA)
Etienne Chauchot created BEAM-2488: -- Summary: Elasticsearch IO should read also in replica shards Key: BEAM-2488 URL: https://issues.apache.org/jira/browse/BEAM-2488 Project: Beam Issue

[2/2] beam git commit: [BEAM-2481] This closes #3401

2017-06-21 Thread jbonofre
[BEAM-2481] This closes #3401 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/50acc6c2 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/50acc6c2 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/50acc6c2 Branch:

[jira] [Resolved] (BEAM-2365) Use highest protocol for pickle coder.

2017-06-21 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw resolved BEAM-2365. --- Resolution: Fixed Fix Version/s: 2.1.0 > Use highest protocol for pickle coder. >

[jira] [Commented] (BEAM-991) DatastoreIO Write should flush early for large batches

2017-06-21 Thread Mingwei Samuel (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057102#comment-16057102 ] Mingwei Samuel commented on BEAM-991: - Also want to chime in that I'm hitting this issue. Found it via

[jira] [Commented] (BEAM-2488) Elasticsearch IO should read also in replica shards

2017-06-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057158#comment-16057158 ] ASF GitHub Bot commented on BEAM-2488: -- GitHub user echauchot opened a pull request:

[jira] [Created] (BEAM-2489) Use dynamic ES port in HIFIOWithElasticTest in module IO :: Hadoop :: jdk1.8-tests

2017-06-21 Thread Etienne Chauchot (JIRA)
Etienne Chauchot created BEAM-2489: -- Summary: Use dynamic ES port in HIFIOWithElasticTest in module IO :: Hadoop :: jdk1.8-tests Key: BEAM-2489 URL: https://issues.apache.org/jira/browse/BEAM-2489

[jira] [Commented] (BEAM-2481) Update commons-lang3 dependency to version 3.6

2017-06-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057118#comment-16057118 ] ASF GitHub Bot commented on BEAM-2481: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3410: [BEAM-2488] Elasticsearch IO should read also in re...

2017-06-21 Thread echauchot
GitHub user echauchot opened a pull request: https://github.com/apache/beam/pull/3410 [BEAM-2488] Elasticsearch IO should read also in replica shards Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [X] Make sure the PR

[jira] [Resolved] (BEAM-2481) Update commons-lang3 dependency to version 3.6

2017-06-21 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-2481. Resolution: Fixed Fix Version/s: 2.1.0 > Update commons-lang3 dependency to version 3.6 >

[jira] [Commented] (BEAM-2489) Use dynamic ES port in HIFIOWithElasticTest in module IO :: Hadoop :: jdk1.8-tests

2017-06-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057195#comment-16057195 ] ASF GitHub Bot commented on BEAM-2489: -- GitHub user echauchot opened a pull request:

[jira] [Created] (BEAM-2490) ReadFromText function not taking all data with glob operator (*)

2017-06-21 Thread Olivier NGUYEN QUOC (JIRA)
Olivier NGUYEN QUOC created BEAM-2490: - Summary: ReadFromText function not taking all data with glob operator (*) Key: BEAM-2490 URL: https://issues.apache.org/jira/browse/BEAM-2490 Project:

[jira] [Updated] (BEAM-2490) ReadFromText function not taking all data with glob operator (*)

2017-06-21 Thread Olivier NGUYEN QUOC (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olivier NGUYEN QUOC updated BEAM-2490: -- Description: I run a very simple pipeline: * Read my files from storage * Split with

[jira] [Updated] (BEAM-2490) ReadFromText function is not taking all data with glob operator (*)

2017-06-21 Thread Olivier NGUYEN QUOC (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olivier NGUYEN QUOC updated BEAM-2490: -- Description: I run a very simple pipeline: * Read my files from Google Cloud Storage *

[jira] [Updated] (BEAM-2490) ReadFromText function not taking all data with glob operator (*)

2017-06-21 Thread Olivier NGUYEN QUOC (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olivier NGUYEN QUOC updated BEAM-2490: -- Description: I run a very simple pipeline: * Read my files from storage * Split with

[jira] [Updated] (BEAM-2490) ReadFromText function is not taking all data with glob operator (*)

2017-06-21 Thread Olivier NGUYEN QUOC (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olivier NGUYEN QUOC updated BEAM-2490: -- Summary: ReadFromText function is not taking all data with glob operator (*) (was:

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #4169

2017-06-21 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-2490) ReadFromText function is not taking all data with glob operator (*)

2017-06-21 Thread Olivier NGUYEN QUOC (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olivier NGUYEN QUOC updated BEAM-2490: -- Description: I run a very simple pipeline: * Read my files from Google Cloud Storage *

[GitHub] beam pull request #3412: Fix minor issues on HCatalogIO

2017-06-21 Thread iemejia
GitHub user iemejia opened a pull request: https://github.com/apache/beam/pull/3412 Fix minor issues on HCatalogIO - Restrict access level when possible - Rename Filter to Partition for the write to be coherent with the HCatalog API - Improve test coverage - Fix

[jira] [Updated] (BEAM-2490) ReadFromText function is not taking all data with glob operator (*)

2017-06-21 Thread Olivier NGUYEN QUOC (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Olivier NGUYEN QUOC updated BEAM-2490: -- Description: I run a very simple pipeline: * Read my files from storage * Split with

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall_Windows #160

2017-06-21 Thread Apache Jenkins Server
See Changes: [iemejia] Return a valid Coder for any subtype of Mutation on [jbonofre] [BEAM-2481] Update commons-lang3 dependency to version 3.6

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4170

2017-06-21 Thread Apache Jenkins Server
See

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Flink #3201

2017-06-21 Thread Apache Jenkins Server
See

[1/2] beam git commit: [BEAM-2495] Add Python test dependency six>=1.9

2017-06-21 Thread altay
Repository: beam Updated Branches: refs/heads/master e015168a3 -> ae50fdd9e [BEAM-2495] Add Python test dependency six>=1.9 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/17c50122 Tree:

Jenkins build is unstable: beam_PostCommit_Java_MavenInstall #4178

2017-06-21 Thread Apache Jenkins Server
See

[1/2] beam git commit: Remove GroupedShuffleRangeTracker which is unused in the SDK

2017-06-21 Thread chamikara
Repository: beam Updated Branches: refs/heads/master f0467b72f -> 3746d4cad Remove GroupedShuffleRangeTracker which is unused in the SDK Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/c6d0d798 Tree:

[2/2] beam git commit: This closes #3414

2017-06-21 Thread chamikara
This closes #3414 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3746d4ca Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/3746d4ca Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/3746d4ca Branch:

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4177

2017-06-21 Thread Apache Jenkins Server
See Changes: [pei] ReduceFnRunner.onTrigger: skip storeCurrentPaneInfo() if trigger -- [...truncated 1.28 MB...] 2017-06-21T22:23:42.046 [INFO]

[jira] [Commented] (BEAM-1265) Add streaming support to Python DirectRunner

2017-06-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16058195#comment-16058195 ] ASF GitHub Bot commented on BEAM-1265: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3409: [BEAM-1265] Allow production of unprocessed bundles...

2017-06-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3409 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #3409

2017-06-21 Thread altay
This closes #3409 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f0467b72 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f0467b72 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/f0467b72 Branch:

[jira] [Created] (BEAM-2495) Python IT test fails if six<1.9

2017-06-21 Thread Mark Liu (JIRA)
Mark Liu created BEAM-2495: -- Summary: Python IT test fails if six<1.9 Key: BEAM-2495 URL: https://issues.apache.org/jira/browse/BEAM-2495 Project: Beam Issue Type: Bug Components: sdk-py,

[GitHub] beam pull request #3416: [BEAM-2495] Add Python test dependency six>=1.9

2017-06-21 Thread markflyhigh
GitHub user markflyhigh opened a pull request: https://github.com/apache/beam/pull/3416 [BEAM-2495] Add Python test dependency six>=1.9 Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make sure the PR title is

[GitHub] beam pull request #3235: ReduceFnRunner.onTrigger: skip storeCurrentPaneInfo...

2017-06-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3235 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #3417: [BEAM-1377] Uses KV in SplittableParDo expansion in...

2017-06-21 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/3417 [BEAM-1377] Uses KV in SplittableParDo expansion instead of ElementAndRestriction This is a workaround for the following issue. ElementAndRestriction is in runners-core, which may be shaded by

[jira] [Assigned] (BEAM-2493) TestStream.Builder.addElements() should return the same builder

2017-06-21 Thread Davor Bonaci (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davor Bonaci reassigned BEAM-2493: -- Assignee: Thomas Groh (was: Davor Bonaci) > TestStream.Builder.addElements() should return the

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4174

2017-06-21 Thread Apache Jenkins Server
See

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Flink #3204

2017-06-21 Thread Apache Jenkins Server
See

[2/2] beam git commit: This closes #3235

2017-06-21 Thread pei
This closes #3235 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/e015168a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/e015168a Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/e015168a Branch:

[1/2] beam git commit: ReduceFnRunner.onTrigger: skip storeCurrentPaneInfo() if trigger isFinished.

2017-06-21 Thread pei
Repository: beam Updated Branches: refs/heads/master 3746d4cad -> e015168a3 ReduceFnRunner.onTrigger: skip storeCurrentPaneInfo() if trigger isFinished. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/cd886300 Tree:

Jenkins build is unstable: beam_PostCommit_Java_MavenInstall #4176

2017-06-21 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink #3203

2017-06-21 Thread Apache Jenkins Server
See Changes: [altay] Allow production of unprocessed bundles, introduce TestStream evaluator -- [...truncated 465.87 KB...]

[jira] [Commented] (BEAM-2495) Python IT test fails if six<1.9

2017-06-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16058302#comment-16058302 ] ASF GitHub Bot commented on BEAM-2495: -- GitHub user markflyhigh opened a pull request:

[jira] [Commented] (BEAM-2496) Use virtualenv in Performance test for dependency management

2017-06-21 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16058320#comment-16058320 ] Mark Liu commented on BEAM-2496: looks like we can use virtualenv in Jenkins DSL

[jira] [Created] (BEAM-2497) TextIO can't read concatenated gzip files

2017-06-21 Thread Ahmet Altay (JIRA)
Ahmet Altay created BEAM-2497: - Summary: TextIO can't read concatenated gzip files Key: BEAM-2497 URL: https://issues.apache.org/jira/browse/BEAM-2497 Project: Beam Issue Type: Bug

[1/2] beam git commit: Add example for Bigquery streaming sink

2017-06-21 Thread altay
Repository: beam Updated Branches: refs/heads/master ae50fdd9e -> b3099bba2 Add example for Bigquery streaming sink Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/aa65ea11 Tree:

[2/2] beam git commit: This closes #3399

2017-06-21 Thread altay
This closes #3399 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/b3099bba Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/b3099bba Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/b3099bba Branch:

[GitHub] beam pull request #3399: Add example for Bigquery streaming sink

2017-06-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3399 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Resolved] (BEAM-2494) Remove 'GroupedShuffleRangeTracker' which is unused in the SDK

2017-06-21 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath resolved BEAM-2494. -- Resolution: Fixed Fix Version/s: 2.1.0 > Remove 'GroupedShuffleRangeTracker'

[jira] [Commented] (BEAM-2494) Remove 'GroupedShuffleRangeTracker' which is unused in the SDK

2017-06-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16058232#comment-16058232 ] ASF GitHub Bot commented on BEAM-2494: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #3414: [BEAM-2494] Remove GroupedShuffleRangeTracker which...

2017-06-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3414 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-2495) Python IT test fails if six<1.9

2017-06-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16058405#comment-16058405 ] ASF GitHub Bot commented on BEAM-2495: -- Github user markflyhigh closed the pull request at:

[GitHub] beam pull request #3416: [BEAM-2495] Add Python test dependency six>=1.9

2017-06-21 Thread markflyhigh
Github user markflyhigh closed the pull request at: https://github.com/apache/beam/pull/3416 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #4175

2017-06-21 Thread Apache Jenkins Server
See Changes: [altay] Allow production of unprocessed bundles, introduce TestStream evaluator -- [...truncated 3.34 MB...] 2017-06-21T21:49:42.429 [INFO]

[jira] [Created] (BEAM-2496) Use virtualenv in Performance test for dependency management

2017-06-21 Thread Mark Liu (JIRA)
Mark Liu created BEAM-2496: -- Summary: Use virtualenv in Performance test for dependency management Key: BEAM-2496 URL: https://issues.apache.org/jira/browse/BEAM-2496 Project: Beam Issue Type:

[jira] [Commented] (BEAM-1377) Support Splittable DoFn in Dataflow streaming runner

2017-06-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16058370#comment-16058370 ] ASF GitHub Bot commented on BEAM-1377: -- GitHub user jkff opened a pull request:

[jira] [Commented] (BEAM-2490) ReadFromText function is not taking all data with glob operator (*)

2017-06-21 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16058426#comment-16058426 ] Chamikara Jayalath commented on BEAM-2490: -- I ran the same pipeline with a similar but smaller (8

[jira] [Commented] (BEAM-2447) Reintroduce DoFn.ProcessContinuation

2017-06-21 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057882#comment-16057882 ] Kenneth Knowles commented on BEAM-2447: --- Is "After a failed tryClaim() call, the ProcessElement

[jira] [Commented] (BEAM-2392) Avoid use of proto builder clone

2017-06-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2392?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16058091#comment-16058091 ] ASF GitHub Bot commented on BEAM-2392: -- GitHub user nkilmer opened a pull request:

[GitHub] beam pull request #3415: [BEAM-2392] Remove uses of proto builder clone

2017-06-21 Thread nkilmer
GitHub user nkilmer opened a pull request: https://github.com/apache/beam/pull/3415 [BEAM-2392] Remove uses of proto builder clone Hi @lukecwik, could you please review this? You can merge this pull request into a Git repository by running: $ git pull

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4172

2017-06-21 Thread Apache Jenkins Server
See

[1/2] beam git commit: Fix minor issues on HCatalogIO

2017-06-21 Thread iemejia
Repository: beam Updated Branches: refs/heads/master 2d25b6840 -> 28c6fd42e Fix minor issues on HCatalogIO - Restrict access level when possible - Rename Filter to Partition for the write to be coherent with the HCatalog API - Improve test coverage - Fix documentation details - Implement

[GitHub] beam pull request #3414: [BEAM-2494] Remove GroupedShuffleRangeTracker which...

2017-06-21 Thread chamikaramj
GitHub user chamikaramj opened a pull request: https://github.com/apache/beam/pull/3414 [BEAM-2494] Remove GroupedShuffleRangeTracker which is unused in the SDK Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[jira] [Commented] (BEAM-2494) Remove 'GroupedShuffleRangeTracker' which is unused in the SDK

2017-06-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057895#comment-16057895 ] ASF GitHub Bot commented on BEAM-2494: -- GitHub user chamikaramj opened a pull request:

[GitHub] beam pull request #3412: Fix minor issues on HCatalogIO

2017-06-21 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/3412 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #3412

2017-06-21 Thread iemejia
This closes #3412 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/28c6fd42 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/28c6fd42 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/28c6fd42 Branch:

[jira] [Created] (BEAM-2494) Remove 'GroupedShuffleRangeTracker' which is unused in the SDK

2017-06-21 Thread Chamikara Jayalath (JIRA)
Chamikara Jayalath created BEAM-2494: Summary: Remove 'GroupedShuffleRangeTracker' which is unused in the SDK Key: BEAM-2494 URL: https://issues.apache.org/jira/browse/BEAM-2494 Project: Beam

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4173

2017-06-21 Thread Apache Jenkins Server
See

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4171

2017-06-21 Thread Apache Jenkins Server
See

[1/2] beam git commit: Allow production of unprocessed bundles, introduce TestStream evaluator in DirectRunner

2017-06-21 Thread altay
Repository: beam Updated Branches: refs/heads/master 28c6fd42e -> f0467b72f Allow production of unprocessed bundles, introduce TestStream evaluator in DirectRunner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3520f948

[GitHub] beam pull request #3418: Java Dataflow runner harness compatibility.

2017-06-21 Thread robertwb
GitHub user robertwb opened a pull request: https://github.com/apache/beam/pull/3418 Java Dataflow runner harness compatibility. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted

Jenkins build is still unstable: beam_PostCommit_Java_MavenInstall #4179

2017-06-21 Thread Apache Jenkins Server
See

[jira] [Updated] (BEAM-2486) Should throws some useful messages when statefulParDo use non-KV input

2017-06-21 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2486?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2486: -- Fix Version/s: 2.1.0 > Should throws some useful messages when statefulParDo use non-KV input >

[jira] [Updated] (BEAM-2473) Dataflow runner should reject unsupported state & timers (MapState, SetState) at construction time, and documentation should be more prominent

2017-06-21 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2473: -- Summary: Dataflow runner should reject unsupported state & timers (MapState, SetState) at

[jira] [Updated] (BEAM-2473) Dataflow runner should reject unsupported state & timers (MapState, SetState) at construction time, and documentation should be more prominent

2017-06-21 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2473?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2473: -- Fix Version/s: 2.1.0 > Dataflow runner should reject unsupported state & timers (MapState,

[jira] [Updated] (BEAM-1612) Support real Bundle in Flink runner

2017-06-21 Thread Jingsong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jingsong Lee updated BEAM-1612: --- Fix Version/s: 2.1.0 > Support real Bundle in Flink runner > --- > >

[jira] [Comment Edited] (BEAM-2486) Should throws some useful messages when statefulParDo use non-KV input

2017-06-21 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16058646#comment-16058646 ] Kenneth Knowles edited comment on BEAM-2486 at 6/22/17 2:56 AM: Hmm, I

[GitHub] beam pull request #3419: [BEAM-2485] DataflowRunner: Reject merging windowin...

2017-06-21 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/3419 [BEAM-2485] DataflowRunner: Reject merging windowing for stateful ParDo Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [x] Make

[jira] [Commented] (BEAM-2486) Should throws some useful messages when statefulParDo use non-KV input

2017-06-21 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2486?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16058646#comment-16058646 ] Kenneth Knowles commented on BEAM-2486: --- Hmm, I thought this was done in {{DoFnSignatures}}. It is

[jira] [Commented] (BEAM-1458) Checkpoint support in Beam

2017-06-21 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16058773#comment-16058773 ] Reuven Lax commented on BEAM-1458: -- Correct - I'm working on a doc for snapshot/update support for Beam.

[jira] [Commented] (BEAM-2485) Reject stateful ParDo / DoFn in merging windows at construction time in Dataflow runner

2017-06-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2485?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16058670#comment-16058670 ] ASF GitHub Bot commented on BEAM-2485: -- GitHub user kennknowles opened a pull request:

[jira] [Commented] (BEAM-2473) Dataflow runner should reject unsupported state & timers (MapState, SetState) at construction time, and documentation should be more prominent

2017-06-21 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16058690#comment-16058690 ] ASF GitHub Bot commented on BEAM-2473: -- GitHub user kennknowles opened a pull request:

[jira] [Created] (BEAM-2498) Dataflow runner should shade Runner/Fn API protos

2017-06-21 Thread Kenneth Knowles (JIRA)
Kenneth Knowles created BEAM-2498: - Summary: Dataflow runner should shade Runner/Fn API protos Key: BEAM-2498 URL: https://issues.apache.org/jira/browse/BEAM-2498 Project: Beam Issue Type:

[jira] [Comment Edited] (BEAM-2491) Duplicate org.apache.beam.runners.core.metrics.pachage-info.class

2017-06-21 Thread Etienne Chauchot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057615#comment-16057615 ] Etienne Chauchot edited comment on BEAM-2491 at 6/21/17 3:19 PM: - I propose

[jira] [Comment Edited] (BEAM-2491) Duplicate org.apache.beam.runners.core.metrics.pachage-info.class

2017-06-21 Thread Etienne Chauchot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057615#comment-16057615 ] Etienne Chauchot edited comment on BEAM-2491 at 6/21/17 3:19 PM: - I propose

[jira] [Commented] (BEAM-2491) Duplicate org.apache.beam.runners.core.metrics.pachage-info.class

2017-06-21 Thread Ben Chambers (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057756#comment-16057756 ] Ben Chambers commented on BEAM-2491: That seems OK. I think both of the classes in the

[jira] [Assigned] (BEAM-2490) ReadFromText function is not taking all data with glob operator (*)

2017-06-21 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2490?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-2490: - Assignee: Chamikara Jayalath (was: Ahmet Altay) > ReadFromText function is not taking all data

[jira] [Created] (BEAM-2492) Have PipelineOptions DisplayData filter out attributes marked with @org.apache.beam.sdk.options.Hidden

2017-06-21 Thread Luke Cwik (JIRA)
Luke Cwik created BEAM-2492: --- Summary: Have PipelineOptions DisplayData filter out attributes marked with @org.apache.beam.sdk.options.Hidden Key: BEAM-2492 URL: https://issues.apache.org/jira/browse/BEAM-2492

[jira] [Updated] (BEAM-2491) Duplicate org.apache.beam.runners.core.metrics.pachage-info.class

2017-06-21 Thread Etienne Chauchot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-2491: --- Priority: Trivial (was: Minor) > Duplicate

[jira] [Updated] (BEAM-2491) Duplicate org.apache.beam.runners.core.metrics.pachage-info.class

2017-06-21 Thread Etienne Chauchot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Etienne Chauchot updated BEAM-2491: --- Description: There is twice the package org.apache.beam.runners.core.metrics in the code

[jira] [Comment Edited] (BEAM-2491) Duplicate org.apache.beam.runners.core.metrics.pachage-info.class

2017-06-21 Thread Etienne Chauchot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057615#comment-16057615 ] Etienne Chauchot edited comment on BEAM-2491 at 6/21/17 3:14 PM: - I propose

[jira] [Commented] (BEAM-1458) Checkpoint support in Beam

2017-06-21 Thread Rafal Wojdyla (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1458?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16057577#comment-16057577 ] Rafal Wojdyla commented on BEAM-1458: - Fyi - we have a first version of checkpoints in

  1   2   >