[jira] [Commented] (BEAM-1678) Create MemcachedIO

2017-04-06 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960310#comment-15960310 ] Ismaël Mejía commented on BEAM-1678: Memcached is a protocol to communicate with KV stores, and is used

[jira] [Commented] (BEAM-1678) Create MemcachedIO

2017-04-06 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960312#comment-15960312 ] Ismaël Mejía commented on BEAM-1678: For the concrete implementation of this IO I evaluated both folsom

[jira] [Updated] (BEAM-1763) TestPipeline should ensure that all assertions succeeded

2017-04-06 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1763: Priority: Blocker (was: Major) > TestPipeline should ensure that all assertions succeeded >

[jira] [Updated] (BEAM-1763) TestPipeline should ensure that all assertions succeeded

2017-04-06 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aviem Zur updated BEAM-1763: Fix Version/s: First stable release > TestPipeline should ensure that all assertions succeeded >

[jira] [Commented] (BEAM-1700) Add Timer metric type to Java SDK

2017-04-06 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1700?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960288#comment-15960288 ] Aviem Zur commented on BEAM-1700: - No current deadline for this issue, metrics are still experimental. >

[GitHub] beam pull request #2458: [Beam-1705]: add method in Pipeline to visualize th...

2017-04-06 Thread XuMingmin
GitHub user XuMingmin opened a pull request: https://github.com/apache/beam/pull/2458 [Beam-1705]: add method in Pipeline to visualize the DAG Add a method `visualizePipeline` in `Pipeline` to visualize data flow. You can merge this pull request into a Git repository by running:

[jira] [Commented] (BEAM-1581) JSON source and sink

2017-04-06 Thread Aviem Zur (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1581?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960271#comment-15960271 ] Aviem Zur commented on BEAM-1581: - We probably won't solve the entire space in one commit, as you said -

[GitHub] beam pull request #2457: Start jstorm runner moduel in feature branch with e...

2017-04-06 Thread peihe
GitHub user peihe opened a pull request: https://github.com/apache/beam/pull/2457 Start jstorm runner moduel in feature branch with empty runner implementation. Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make

[beam] Git Push Summary

2017-04-06 Thread kenn
Repository: beam Updated Branches: refs/heads/jstorm-runner [created] a8edbb81f

[jira] [Comment Edited] (BEAM-1899) JStorm runner

2017-04-06 Thread JiJun Tang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960065#comment-15960065 ] JiJun Tang edited comment on BEAM-1899 at 4/7/17 1:18 AM: -- Hello, An Apache Storm

[jira] [Commented] (BEAM-41) State for "Set" data, supporting efficient membership checks

2017-04-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-41?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960121#comment-15960121 ] ASF GitHub Bot commented on BEAM-41: Github user asfgit closed the pull request at:

[1/2] beam git commit: Revise MapState and SetState APIs to leverage ReadableState

2017-04-06 Thread kenn
Repository: beam Updated Branches: refs/heads/master b92032ff6 -> a8edbb81f Revise MapState and SetState APIs to leverage ReadableState Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/604be670 Tree:

[GitHub] beam pull request #2353: [BEAM-41,BEAM-42] Revise MapState and SetState APIs...

2017-04-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2353 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2353: Revise MapState and SetState APIs to leverage ReadableState

2017-04-06 Thread kenn
This closes #2353: Revise MapState and SetState APIs to leverage ReadableState Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a8edbb81 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/a8edbb81 Diff:

[jira] [Commented] (BEAM-1899) JStorm runner

2017-04-06 Thread JiJun Tang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1899?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15960065#comment-15960065 ] JiJun Tang commented on BEAM-1899: -- Hello, An Apache Storm runner or JStrom runner for Apache Beam would

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Spark #1546

2017-04-06 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PerformanceTests_JDBC #83

2017-04-06 Thread Apache Jenkins Server
See Changes: [klk] Rename filePath to filePattern in NumbedShardedFile [chamikara] [BEAM-1892] File size estimation process reporting [klk] Rename FunctionSpec and UrnWithParameter to their (hopefully)

Build failed in Jenkins: beam_PerformanceTests_Dataflow #277

2017-04-06 Thread Apache Jenkins Server
See Changes: [klk] Rename filePath to filePattern in NumbedShardedFile [chamikara] [BEAM-1892] File size estimation process reporting [klk] Rename FunctionSpec and UrnWithParameter to their

[jira] [Commented] (BEAM-778) Make filesystem._CompressedFile seekable.

2017-04-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959978#comment-15959978 ] ASF GitHub Bot commented on BEAM-778: - GitHub user sb2nov opened a pull request:

[GitHub] beam pull request #2456: [BEAM-778] Fix the Compressed file seek tests on wi...

2017-04-06 Thread sb2nov
GitHub user sb2nov opened a pull request: https://github.com/apache/beam/pull/2456 [BEAM-778] Fix the Compressed file seek tests on windows Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

Jenkins build is back to normal : beam_PostCommit_Python_Verify #1770

2017-04-06 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1666) Add language-neutral overview content for Pipeline I/O authoring docs

2017-04-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1666?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959945#comment-15959945 ] ASF GitHub Bot commented on BEAM-1666: -- Github user asfgit closed the pull request at:

[GitHub] beam-site pull request #196: [BEAM-1666] Read Transform content for Authorin...

2017-04-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam-site/pull/196 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[3/3] beam-site git commit: This closes #196

2017-04-06 Thread altay
This closes #196 Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/fd7fe062 Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/fd7fe062 Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/fd7fe062

[1/3] beam-site git commit: Add Read Transform content for Authoring I/O Transforms - Overview

2017-04-06 Thread altay
Repository: beam-site Updated Branches: refs/heads/asf-site 6f44376a9 -> fd7fe0627 Add Read Transform content for Authoring I/O Transforms - Overview Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/8c9cda3c Tree:

[2/3] beam-site git commit: Regenerate website

2017-04-06 Thread altay
Regenerate website Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/6bded068 Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/6bded068 Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/6bded068

[jira] [Commented] (BEAM-1896) Add list of In Progress IOs to the Pipeline I/O section of the website

2017-04-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1896?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959942#comment-15959942 ] ASF GitHub Bot commented on BEAM-1896: -- Github user asfgit closed the pull request at:

[3/3] beam-site git commit: This closes #202

2017-04-06 Thread altay
This closes #202 Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/6f44376a Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/6f44376a Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/6f44376a

[GitHub] beam-site pull request #202: [BEAM-1896] Add "In-Progress" info to the Built...

2017-04-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam-site/pull/202 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/3] beam-site git commit: Regenerate website

2017-04-06 Thread altay
Regenerate website Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/234bccff Tree: http://git-wip-us.apache.org/repos/asf/beam-site/tree/234bccff Diff: http://git-wip-us.apache.org/repos/asf/beam-site/diff/234bccff

[1/3] beam-site git commit: Add "In-Progress" info to the Built-in I/O Transforms page

2017-04-06 Thread altay
Repository: beam-site Updated Branches: refs/heads/asf-site 56d16cd79 -> 6f44376a9 Add "In-Progress" info to the Built-in I/O Transforms page Project: http://git-wip-us.apache.org/repos/asf/beam-site/repo Commit: http://git-wip-us.apache.org/repos/asf/beam-site/commit/815311d5 Tree:

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Spark #1545

2017-04-06 Thread Apache Jenkins Server
See

[jira] [Closed] (BEAM-1714) Null Pointer Exception when outputting a TableRow with a Null value for a key

2017-04-06 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1714. - Resolution: Not A Problem Fix Version/s: (was: First stable release)

[1/6] beam git commit: Upgrade Dataflow worker image to beam-master-20170405

2017-04-06 Thread kenn
Repository: beam Updated Branches: refs/heads/master bb1838476 -> b92032ff6 Upgrade Dataflow worker image to beam-master-20170405 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/359040e8 Tree:

[3/6] beam git commit: Rename CombiningState to GroupingState

2017-04-06 Thread kenn
Rename CombiningState to GroupingState Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/24c0495a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/24c0495a Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/24c0495a

[GitHub] beam pull request #2413: [BEAM-1864] Rename CombiningState and friends to be...

2017-04-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2413 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (BEAM-1864) Shorten combining state names: "CombiningValue" and "AccumulatorCombiningState" to Combining (as appropriate)

2017-04-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959902#comment-15959902 ] ASF GitHub Bot commented on BEAM-1864: -- Github user asfgit closed the pull request at:

[6/6] beam git commit: This closes #2413: Rename CombiningState and friends to be more user-friendly

2017-04-06 Thread kenn
This closes #2413: Rename CombiningState and friends to be more user-friendly Upgrade Dataflow worker image to beam-master-20170405 Rename combiningValue to combining in StateSpecs Rename AccumulatorCombiningState to CombiningState Rename CombiningState to GroupingState Project:

[jira] [Commented] (BEAM-1714) Null Pointer Exception when outputting a TableRow with a Null value for a key

2017-04-06 Thread Mark Shalda (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1714?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959901#comment-15959901 ] Mark Shalda commented on BEAM-1714: --- This looks like an issue in TableRow itself and not something in

[4/6] beam git commit: Rename AccumulatorCombiningState to CombiningState

2017-04-06 Thread kenn
http://git-wip-us.apache.org/repos/asf/beam/blob/ef480a37/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/GroupIntoBatches.java -- diff --git

[2/6] beam git commit: Rename combiningValue to combining in StateSpecs

2017-04-06 Thread kenn
Rename combiningValue to combining in StateSpecs Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/33259d05 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/33259d05 Diff:

[5/6] beam git commit: Rename AccumulatorCombiningState to CombiningState

2017-04-06 Thread kenn
Rename AccumulatorCombiningState to CombiningState Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/ef480a37 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/ef480a37 Diff:

Build failed in Jenkins: beam_PostCommit_Python_Verify #1769

2017-04-06 Thread Apache Jenkins Server
See Changes: [klk] Remove NeedsRunner category tags from non-core libraries [klk] Remove ValidatesRunner category tags from non-core libraries --

[GitHub] beam pull request #2455: [BEAM-1903, BEAM-1904] Fixes SDF issues re: waterma...

2017-04-06 Thread jkff
GitHub user jkff opened a pull request: https://github.com/apache/beam/pull/2455 [BEAM-1903, BEAM-1904] Fixes SDF issues re: watermarks and stop/resume See detailed discussion in document: https://docs.google.com/document/d/1BGc8pM1GOvZhwR9SARSVte-20XEoBUxrGJ5gTWXdv3c/edit

[jira] [Commented] (BEAM-1903) Splittable DoFn should report watermarks via ProcessContext

2017-04-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959881#comment-15959881 ] ASF GitHub Bot commented on BEAM-1903: -- GitHub user jkff opened a pull request:

[jira] [Created] (BEAM-1904) Remove DoFn.ProcessContinuation

2017-04-06 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1904: -- Summary: Remove DoFn.ProcessContinuation Key: BEAM-1904 URL: https://issues.apache.org/jira/browse/BEAM-1904 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-1903) Splittable DoFn should report watermarks via ProcessContext

2017-04-06 Thread Eugene Kirpichov (JIRA)
Eugene Kirpichov created BEAM-1903: -- Summary: Splittable DoFn should report watermarks via ProcessContext Key: BEAM-1903 URL: https://issues.apache.org/jira/browse/BEAM-1903 Project: Beam

[jira] [Created] (BEAM-1902) Datastore IO never retries on errors

2017-04-06 Thread Ahmet Altay (JIRA)
Ahmet Altay created BEAM-1902: - Summary: Datastore IO never retries on errors Key: BEAM-1902 URL: https://issues.apache.org/jira/browse/BEAM-1902 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-1622) Java: Rename RunnableOnService to ValidatesRunner

2017-04-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1622?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959808#comment-15959808 ] ASF GitHub Bot commented on BEAM-1622: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2359: [BEAM-1622] Remove NeedsRunner and ValidatesRunner ...

2017-04-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2359 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/3] beam git commit: Remove NeedsRunner category tags from non-core libraries

2017-04-06 Thread kenn
Remove NeedsRunner category tags from non-core libraries Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0683ac12 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/0683ac12 Diff:

[3/3] beam git commit: This closes #2359: Remove NeedsRunner and ValidatesRunner category tags from non-core libraries

2017-04-06 Thread kenn
This closes #2359: Remove NeedsRunner and ValidatesRunner category tags from non-core libraries Remove ValidatesRunner category tags from non-core libraries Remove NeedsRunner category tags from non-core libraries Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit:

[1/3] beam git commit: Remove ValidatesRunner category tags from non-core libraries

2017-04-06 Thread kenn
Repository: beam Updated Branches: refs/heads/master 07a49e90b -> bb1838476 Remove ValidatesRunner category tags from non-core libraries Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f388cc71 Tree:

[jira] [Created] (BEAM-1901) Faling to re-raise exceptions

2017-04-06 Thread Ahmet Altay (JIRA)
Ahmet Altay created BEAM-1901: - Summary: Faling to re-raise exceptions Key: BEAM-1901 URL: https://issues.apache.org/jira/browse/BEAM-1901 Project: Beam Issue Type: Bug Components:

[jira] [Commented] (BEAM-1011) Add Windowing/Triggers section

2017-04-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1011?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959742#comment-15959742 ] ASF GitHub Bot commented on BEAM-1011: -- GitHub user melap opened a pull request:

[GitHub] beam-site pull request #204: [BEAM-1011] Add triggers content to the program...

2017-04-06 Thread melap
GitHub user melap opened a pull request: https://github.com/apache/beam-site/pull/204 [BEAM-1011] Add triggers content to the programming guide R: @kennknowles Triggers content + minor changes to the windowing section + a small amount of white space cleanup You can merge

[GitHub] beam pull request #2425: Rename filePath to filePattern in NumbedShardedFile

2017-04-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2425 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Rename filePath to filePattern in NumbedShardedFile

2017-04-06 Thread kenn
Repository: beam Updated Branches: refs/heads/master 61790f038 -> 07a49e90b Rename filePath to filePattern in NumbedShardedFile This probably would have saved a few hours of debugging by signposting the intended usage more clearly. Project: http://git-wip-us.apache.org/repos/asf/beam/repo

[2/2] beam git commit: This closes #2425: Rename filePath to filePattern in NumbedShardedFile

2017-04-06 Thread kenn
This closes #2425: Rename filePath to filePattern in NumbedShardedFile Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/07a49e90 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/07a49e90 Diff:

[jira] [Commented] (BEAM-1874) Google Cloud Storage TextIO read fails with gz-files having Content-Encoding: gzip header

2017-04-06 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1874?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959683#comment-15959683 ] Chamikara Jayalath commented on BEAM-1874: -- Python SDK currently doesn't support these files but I

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #3200

2017-04-06 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-301) Add a Beam SQL DSL

2017-04-06 Thread Tyler Akidau (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959621#comment-15959621 ] Tyler Akidau commented on BEAM-301: --- I agree with what I think Mingmin is saying here in that it's

[GitHub] beam pull request #2453: Remove DirectSideInputReader, PTuple

2017-04-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2453 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: Remove DirectSideInputReader, PTuple

2017-04-06 Thread tgroh
Remove DirectSideInputReader, PTuple DirectSideInputReader is unused. PTuple is unused except in DirectSideInputReader. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/3e922ed5 Tree:

[1/2] beam git commit: This closes #2453

2017-04-06 Thread tgroh
Repository: beam Updated Branches: refs/heads/master 0a176454c -> 61790f038 This closes #2453 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/61790f03 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/61790f03 Diff:

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #3199

2017-04-06 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-115) Beam Runner API

2017-04-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959537#comment-15959537 ] ASF GitHub Bot commented on BEAM-115: - Github user asfgit closed the pull request at:

[GitHub] beam pull request #2452: [BEAM-115] Rename FunctionSpec and UrnWithParameter...

2017-04-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2452 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2452: Rename FunctionSpec and UrnWithParameter to their (hopefully) final names

2017-04-06 Thread kenn
This closes #2452: Rename FunctionSpec and UrnWithParameter to their (hopefully) final names Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/0a176454 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/0a176454 Diff:

[1/2] beam git commit: Rename FunctionSpec and UrnWithParameter to their (hopefully) final names

2017-04-06 Thread kenn
Repository: beam Updated Branches: refs/heads/master 37e4cc1b8 -> 0a176454c Rename FunctionSpec and UrnWithParameter to their (hopefully) final names Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/fa47527e Tree:

[jira] [Resolved] (BEAM-1892) Log process during size estimation in filebasedsource

2017-04-06 Thread Sourabh Bajaj (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sourabh Bajaj resolved BEAM-1892. - Resolution: Fixed Fix Version/s: Not applicable > Log process during size estimation in

[jira] [Commented] (BEAM-1832) Potentially unclosed OutputStream in ApexYarnLauncher

2017-04-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959529#comment-15959529 ] ASF GitHub Bot commented on BEAM-1832: -- GitHub user rekhajoshm opened a pull request:

[GitHub] beam pull request #2445: [BEAM-1892] File size estimation thresholding and p...

2017-04-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2445 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: [BEAM-1892] File size estimation process reporting

2017-04-06 Thread chamikara
Repository: beam Updated Branches: refs/heads/master f87597e10 -> 37e4cc1b8 [BEAM-1892] File size estimation process reporting Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/378b3f5b Tree:

[2/2] beam git commit: This closes #2445

2017-04-06 Thread chamikara
This closes #2445 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/37e4cc1b Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/37e4cc1b Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/37e4cc1b Branch:

[jira] [Assigned] (BEAM-1373) Update Python SDK code to support both Python 2 and 3

2017-04-06 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chamikara Jayalath reassigned BEAM-1373: Assignee: Ahmet Altay (was: Chamikara Jayalath) > Update Python SDK code to

[jira] [Commented] (BEAM-1373) Update Python SDK code to support both Python 2 and 3

2017-04-06 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959462#comment-15959462 ] Chamikara Jayalath commented on BEAM-1373: -- We'll have to run 2to3 but without porting

[jira] [Commented] (BEAM-526) Mismatched pipelines give unclear error

2017-04-06 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959461#comment-15959461 ] Ahmet Altay commented on BEAM-526: -- [~nssalian] Thank you, that is great. > Mismatched pipelines give

Build failed in Jenkins: beam_PerformanceTests_Dataflow #276

2017-04-06 Thread Apache Jenkins Server
See Changes: [davor] HadoopInputFormatIO with junits [jbonofre] [BEAM-1856] Use the same configuration in master thread and slave thread -- [...truncated

[jira] [Commented] (BEAM-1373) Update Python SDK code to support both Python 2 and 3

2017-04-06 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959450#comment-15959450 ] Ahmet Altay commented on BEAM-1373: --- Based on the comment thread, it looks like we are not planning to

[jira] [Commented] (BEAM-526) Mismatched pipelines give unclear error

2017-04-06 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959452#comment-15959452 ] Neelesh Srinivas Salian commented on BEAM-526: -- Hi [~altay], apologies for the delay. I'll

[jira] [Commented] (BEAM-1373) Update Python SDK code to support both Python 2 and 3

2017-04-06 Thread Chamikara Jayalath (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959443#comment-15959443 ] Chamikara Jayalath commented on BEAM-1373: -- This is for 2to3 conversion which I think only a part

[jira] [Commented] (BEAM-1575) Add ValidatesRunner test to PipelineTest.test_metrics_in_source

2017-04-06 Thread Pablo Estrada (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959427#comment-15959427 ] Pablo Estrada commented on BEAM-1575: - I have not made any progress, because it seems like there's no

[jira] [Commented] (BEAM-1723) FlinkRunner should deduplicate when an UnboundedSource requires Deduping

2017-04-06 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1723?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959390#comment-15959390 ] Kenneth Knowles commented on BEAM-1723: --- The caches do need to be fault-tolerant or you'll get dupes.

[jira] [Commented] (BEAM-1575) Add ValidatesRunner test to PipelineTest.test_metrics_in_source

2017-04-06 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1575?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959375#comment-15959375 ] Ahmet Altay commented on BEAM-1575: --- [~pabloem] Any progress on this one? > Add ValidatesRunner test to

[jira] [Commented] (BEAM-526) Mismatched pipelines give unclear error

2017-04-06 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959374#comment-15959374 ] Ahmet Altay commented on BEAM-526: -- Any update on this one? > Mismatched pipelines give unclear error >

[jira] [Assigned] (BEAM-1509) Python sdk pom runs only on unix

2017-04-06 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-1509: - Assignee: (was: Ahmet Altay) > Python sdk pom runs only on unix >

[jira] [Updated] (BEAM-1506) py DataflowRunner should warn if the stagingLocation has a TTL

2017-04-06 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-1506: -- Labels: newbie starter (was: ) > py DataflowRunner should warn if the stagingLocation has a TTL >

[jira] [Assigned] (BEAM-1506) py DataflowRunner should warn if the stagingLocation has a TTL

2017-04-06 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-1506: - Assignee: (was: Ahmet Altay) > py DataflowRunner should warn if the stagingLocation has a TTL

[jira] [Assigned] (BEAM-1472) Use cross-language serialization schema for triggers in Python SDK

2017-04-06 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-1472: - Assignee: Robert Bradshaw (was: Vikas Kedigehalli) > Use cross-language serialization schema for

[jira] [Updated] (BEAM-1462) DirectRunner unnecessarily re-scheules tasks after exceptions

2017-04-06 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-1462: -- Labels: newbie starter (was: ) > DirectRunner unnecessarily re-scheules tasks after exceptions >

[jira] [Resolved] (BEAM-1368) Python setup should be portable to Python 3.x

2017-04-06 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-1368. --- Resolution: Fixed Assignee: (was: Ahmet Altay) Fix Version/s: Not applicable >

[jira] [Assigned] (BEAM-1368) Python setup should be portable to Python 3.x

2017-04-06 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-1368: - Assignee: Sergio Fernández > Python setup should be portable to Python 3.x >

[jira] [Commented] (BEAM-1856) HDFSFileSink class do not use the same configuration in master and slave

2017-04-06 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959361#comment-15959361 ] ASF GitHub Bot commented on BEAM-1856: -- Github user asfgit closed the pull request at:

[jira] [Resolved] (BEAM-1856) HDFSFileSink class do not use the same configuration in master and slave

2017-04-06 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jean-Baptiste Onofré resolved BEAM-1856. Resolution: Fixed Fix Version/s: First stable release > HDFSFileSink class do

[GitHub] beam pull request #2399: [BEAM-1856]HDFSFileSink class do not use the same c...

2017-04-06 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2399 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: [BEAM-1856] This closes #2399

2017-04-06 Thread jbonofre
[BEAM-1856] This closes #2399 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/f87597e1 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/f87597e1 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/f87597e1 Branch:

[jira] [Assigned] (BEAM-588) All runners should support ProfilingOptions

2017-04-06 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-588: Assignee: (was: Ahmet Altay) > All runners should support ProfilingOptions >

[jira] [Commented] (BEAM-588) All runners should support ProfilingOptions

2017-04-06 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-588?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15959360#comment-15959360 ] Ahmet Altay commented on BEAM-588: -- Status: - DataflowRunner supports cpu and memory profiling. -

[jira] [Updated] (BEAM-588) All runners should support ProfilingOptions

2017-04-06 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-588: - Labels: newbie starter (was: ) > All runners should support ProfilingOptions >

  1   2   >