[jira] [Comment Edited] (BEAM-1881) Exclude protobuf-lite everywhere

2017-04-04 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956287#comment-15956287 ] Ismaël Mejía edited comment on BEAM-1881 at 4/5/17 4:43 AM: Great to know, I

[jira] [Commented] (BEAM-1881) Exclude protobuf-lite everywhere

2017-04-04 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956287#comment-15956287 ] Ismaël Mejía commented on BEAM-1881: Great to know, I used this dependency without been sure. It

[jira] [Resolved] (BEAM-1550) HBaseIO tests timeout precommit

2017-04-04 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1550?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-1550. Resolution: Fixed Fix Version/s: Not applicable > HBaseIO tests timeout precommit >

Build failed in Jenkins: beam_PostCommit_Python_Verify #1740

2017-04-04 Thread Apache Jenkins Server
See -- [...truncated 835.59 KB...] Collecting pbr>=0.11 (from mock->-r postcommit_requirements.txt (line 2)) File was already downloaded

Build failed in Jenkins: beam_PostCommit_Python_Verify #1739

2017-04-04 Thread Apache Jenkins Server
See Changes: [altay] Add ValueProvider class for FileBasedSource I/O Transforms -- [...truncated 703.96 KB...] File was already downloaded

Jenkins build is back to stable : beam_PostCommit_Java_ValidatesRunner_Flink #2194

2017-04-04 Thread Apache Jenkins Server
See

[jira] [Closed] (BEAM-1835) NPE in DirectRunner PubsubReader.ackBatch

2017-04-04 Thread Rafal Wojdyla (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rafal Wojdyla closed BEAM-1835. --- Resolution: Fixed > NPE in DirectRunner PubsubReader.ackBatch >

Build failed in Jenkins: beam_PostCommit_Java_MavenInstall #3164

2017-04-04 Thread Apache Jenkins Server
See -- [...truncated 224.16 KB...] x [deleted] (none) -> origin/pr/942/head x [deleted] (none) -> origin/pr/942/merge x [deleted]

[GitHub] beam pull request #2383: Add ValueProvider class for FileBasedSource I/O Tra...

2017-04-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2383 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: Add ValueProvider class for FileBasedSource I/O Transforms

2017-04-04 Thread altay
Repository: beam Updated Branches: refs/heads/master fcf3b5619 -> 6df661b0e Add ValueProvider class for FileBasedSource I/O Transforms Incorporate a BeamArgumentParser (argparse.ArgumentParser + ValueProviders). Add StaticValueProvider and RuntimeValueProvider derived from ValueProvider. Add

[2/2] beam git commit: This closes #2383

2017-04-04 Thread altay
This closes #2383 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/6df661b0 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/6df661b0 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/6df661b0 Branch:

[GitHub] beam pull request #2394: Remove PDone

2017-04-04 Thread aaltay
Github user aaltay closed the pull request at: https://github.com/apache/beam/pull/2394 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Created] (BEAM-1885) Remove PDone

2017-04-04 Thread Ahmet Altay (JIRA)
Ahmet Altay created BEAM-1885: - Summary: Remove PDone Key: BEAM-1885 URL: https://issues.apache.org/jira/browse/BEAM-1885 Project: Beam Issue Type: Bug Components: sdk-py

[jira] [Created] (BEAM-1884) Add DataflowRunner unit tests

2017-04-04 Thread Ahmet Altay (JIRA)
Ahmet Altay created BEAM-1884: - Summary: Add DataflowRunner unit tests Key: BEAM-1884 URL: https://issues.apache.org/jira/browse/BEAM-1884 Project: Beam Issue Type: Bug Components:

[jira] [Created] (BEAM-1883) Ignore the result of shutil.rmtree

2017-04-04 Thread Ahmet Altay (JIRA)
Ahmet Altay created BEAM-1883: - Summary: Ignore the result of shutil.rmtree Key: BEAM-1883 URL: https://issues.apache.org/jira/browse/BEAM-1883 Project: Beam Issue Type: Bug

Build failed in Jenkins: beam_PostCommit_Python_Verify #1738

2017-04-04 Thread Apache Jenkins Server
See Changes: [tgroh] Make Pubsub ackBatch safer [altay] Do not have empty side input names -- [...truncated 493.59 KB...] File was already downloaded

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Flink #2193

2017-04-04 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1882) Jdbc k8s scripts: switch pod -> replicaController

2017-04-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956099#comment-15956099 ] ASF GitHub Bot commented on BEAM-1882: -- GitHub user ssisk opened a pull request:

[GitHub] beam pull request #2431: [BEAM-1882] Update postgres k8 scripts & add script...

2017-04-04 Thread ssisk
GitHub user ssisk opened a pull request: https://github.com/apache/beam/pull/2431 [BEAM-1882] Update postgres k8 scripts & add scripts for running local dev test Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [X] Make

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Flink #2192

2017-04-04 Thread Apache Jenkins Server
See

[jira] [Created] (BEAM-1882) Jdbc k8s scripts: switch pod -> replicaController

2017-04-04 Thread Stephen Sisk (JIRA)
Stephen Sisk created BEAM-1882: -- Summary: Jdbc k8s scripts: switch pod -> replicaController Key: BEAM-1882 URL: https://issues.apache.org/jira/browse/BEAM-1882 Project: Beam Issue Type:

[jira] [Created] (BEAM-1881) Exclude protobuf-lite everywhere

2017-04-04 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1881: - Summary: Exclude protobuf-lite everywhere Key: BEAM-1881 URL: https://issues.apache.org/jira/browse/BEAM-1881 Project: Beam Issue Type: Bug

[GitHub] beam pull request #2429: Do not have empty ParDo names when there are no sid...

2017-04-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2429 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Build failed in Jenkins: beam_PerformanceTests_Dataflow #270

2017-04-04 Thread Apache Jenkins Server
See Changes: [robertwb] Avoid Runner API translation of pipelines with PDone. [dhalperi] Change BigQueryIO.Write return type to allow for future new [tgroh] Make Pubsub ackBatch safer

[jira] [Commented] (BEAM-1508) PInput, POutput#expand should not be ordered

2017-04-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956075#comment-15956075 ] ASF GitHub Bot commented on BEAM-1508: -- GitHub user tgroh opened a pull request:

[GitHub] beam pull request #2430: [BEAM-1508] Remove Orderdness of Input, Output expa...

2017-04-04 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2430 [BEAM-1508] Remove Orderdness of Input, Output expansions Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is

[GitHub] beam pull request #2429: Do not have empty side input names

2017-04-04 Thread aaltay
GitHub user aaltay opened a pull request: https://github.com/apache/beam/pull/2429 Do not have empty side input names R: @bjchambers (cc: @robertwb ) You can merge this pull request into a Git repository by running: $ git pull https://github.com/aaltay/beam graph

[GitHub] beam pull request #2417: [BEAM-1148] Port PAssert away from Aggregators

2017-04-04 Thread pabloem
Github user pabloem closed the pull request at: https://github.com/apache/beam/pull/2417 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] beam pull request #2417: [BEAM-1148] Port PAssert away from Aggregators

2017-04-04 Thread pabloem
GitHub user pabloem reopened a pull request: https://github.com/apache/beam/pull/2417 [BEAM-1148] Port PAssert away from Aggregators Still running into trouble with the direct runner, but unit tests in other runners are passing. You can merge this pull request into a Git

[jira] [Commented] (BEAM-1148) Port PAssert away from Aggregators

2017-04-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15956043#comment-15956043 ] ASF GitHub Bot commented on BEAM-1148: -- Github user pabloem closed the pull request at:

Build failed in Jenkins: beam_PostCommit_Python_Verify #1737

2017-04-04 Thread Apache Jenkins Server
See -- [...truncated 224.80 KB...] x [deleted] (none) -> origin/pr/942/head x [deleted] (none) -> origin/pr/942/merge x [deleted] (none)

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Flink #2191

2017-04-04 Thread Apache Jenkins Server
See -- [...truncated 224.61 KB...] x [deleted] (none) -> origin/pr/942/head x [deleted] (none) -> origin/pr/942/merge x [deleted]

[jira] [Commented] (BEAM-1835) NPE in DirectRunner PubsubReader.ackBatch

2017-04-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1835?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955995#comment-15955995 ] ASF GitHub Bot commented on BEAM-1835: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2368: [BEAM-1835] Make Pubsub ackBatch safer

2017-04-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2368 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: Make Pubsub ackBatch safer

2017-04-04 Thread tgroh
Make Pubsub ackBatch safer Checkpoints can be finalized at any point, including while the reader is being closed or after it has been. Calls to close with an active checkpoint mark the PubsubUnboundedSource as inactive. If there are no active checkpoints, the Client is closed. Otherwise the

[jira] [Created] (BEAM-1880) DataflowPipelineJob.cancel() should behave gracefully if called concurrent with job termination

2017-04-04 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1880: - Summary: DataflowPipelineJob.cancel() should behave gracefully if called concurrent with job termination Key: BEAM-1880 URL: https://issues.apache.org/jira/browse/BEAM-1880

[jira] [Commented] (BEAM-1880) DataflowPipelineJob.cancel() should behave gracefully if called concurrent with job termination

2017-04-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955991#comment-15955991 ] ASF GitHub Bot commented on BEAM-1880: -- GitHub user dhalperi opened a pull request:

[GitHub] beam pull request #2428: [BEAM-1880] DataflowPipelineJob: handle concurrent ...

2017-04-04 Thread dhalperi
GitHub user dhalperi opened a pull request: https://github.com/apache/beam/pull/2428 [BEAM-1880] DataflowPipelineJob: handle concurrent cancel and finish This makes job.cancel() not throw an exception if cancel() is called while job is finished. (Note that state.isTerminal() is

[GitHub] beam pull request #2427: Test

2017-04-04 Thread charlesccychen
GitHub user charlesccychen opened a pull request: https://github.com/apache/beam/pull/2427 Test Do not submit You can merge this pull request into a Git repository by running: $ git pull https://github.com/charlesccychen/beam py_custom_create Alternatively you can review and

[GitHub] beam pull request #2427: Test

2017-04-04 Thread charlesccychen
Github user charlesccychen closed the pull request at: https://github.com/apache/beam/pull/2427 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[jira] [Commented] (BEAM-1283) DoFn finishBundle should be required to specify the window

2017-04-04 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955920#comment-15955920 ] Ahmet Altay commented on BEAM-1283: --- [~kenn] What are the implications of this in python? > DoFn

[jira] [Commented] (BEAM-547) Align Python SDK version with Maven

2017-04-04 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955916#comment-15955916 ] Ahmet Altay commented on BEAM-547: -- [~wikier] I believe adding the `pom.xml` in `package_data` would not

[jira] [Assigned] (BEAM-1502) CombinePerKey returns a list of lists when run locally, but something else when run on Dataflow

2017-04-04 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-1502: - Assignee: Ahmet Altay > CombinePerKey returns a list of lists when run locally, but something

[jira] [Comment Edited] (BEAM-1832) Potentially unclosed OutputStream in ApexYarnLauncher

2017-04-04 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15947383#comment-15947383 ] Ted Yu edited comment on BEAM-1832 at 4/4/17 9:02 PM: -- In the same class: {code}

[jira] [Updated] (BEAM-1831) Checking of containment in createdTables may have race condition in StreamingWriteFn

2017-04-04 Thread Ted Yu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ted Yu updated BEAM-1831: - Description: {code} public TableReference getOrCreateTable(BigQueryOptions options, String tableSpec)

[jira] [Resolved] (BEAM-1443) Re-windowing should preserve the duplicity following sliding-window-like assignment

2017-04-04 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-1443. --- Resolution: Fixed Fix Version/s: Not applicable > Re-windowing should preserve the duplicity

[jira] [Resolved] (BEAM-1441) Add an IOChannelFactory interface to Python SDK

2017-04-04 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-1441. --- Resolution: Fixed > Add an IOChannelFactory interface to Python SDK >

[jira] [Resolved] (BEAM-1450) NewDoFn does not properly explode windows

2017-04-04 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-1450. --- Resolution: Fixed Fix Version/s: Not applicable > NewDoFn does not properly explode windows >

[jira] [Resolved] (BEAM-1869) getProducingTransformInternal should not be available on any PValue

2017-04-04 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-1869. --- Resolution: Fixed Fix Version/s: First stable release > getProducingTransformInternal should

[jira] [Commented] (BEAM-1151) BigQueryIO.Write has no way of handling failures

2017-04-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955626#comment-15955626 ] ASF GitHub Bot commented on BEAM-1151: -- Github user asfgit closed the pull request at:

[jira] [Created] (BEAM-1879) PTransform style guide should discuss display data

2017-04-04 Thread Stephen Sisk (JIRA)
Stephen Sisk created BEAM-1879: -- Summary: PTransform style guide should discuss display data Key: BEAM-1879 URL: https://issues.apache.org/jira/browse/BEAM-1879 Project: Beam Issue Type:

[GitHub] beam pull request #2404: [BEAM-1151] Add interface for accessing failed BigQ...

2017-04-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2404 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: This closes #2404

2017-04-04 Thread dhalperi
This closes #2404 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/65ffd6c6 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/65ffd6c6 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/65ffd6c6 Branch:

Jenkins build is back to normal : beam_PostCommit_Java_ValidatesRunner_Apex #972

2017-04-04 Thread Apache Jenkins Server
See

[jira] [Commented] (BEAM-1843) 'PDone' object has no attribute 'to_runner_api'

2017-04-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955567#comment-15955567 ] ASF GitHub Bot commented on BEAM-1843: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2400: [BEAM-1843] Avoid Runner API translation of pipelin...

2017-04-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2400 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[2/2] beam git commit: Closes #2400

2017-04-04 Thread robertwb
Closes #2400 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/50fc63a9 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/50fc63a9 Diff: http://git-wip-us.apache.org/repos/asf/beam/diff/50fc63a9 Branch: refs/heads/master

[1/2] beam git commit: Avoid Runner API translation of pipelines with PDone.

2017-04-04 Thread robertwb
Repository: beam Updated Branches: refs/heads/master 22ff898a3 -> 50fc63a9b Avoid Runner API translation of pipelines with PDone. Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/a419 Tree:

Jenkins build is still unstable: beam_PostCommit_Java_ValidatesRunner_Spark #1504

2017-04-04 Thread Apache Jenkins Server
See

Jenkins build is back to stable : beam_PostCommit_Java_MavenInstall #3156

2017-04-04 Thread Apache Jenkins Server
See

Build failed in Jenkins: beam_PerformanceTests_Dataflow #269

2017-04-04 Thread Apache Jenkins Server
See Changes: [iemejia] [BEAM-1875] Remove Spark-runner-custom Hadoop and Avro IOs [dhalperi] [BEAM-1550] Fix HBaseIO tests and change HBaseIO to use shaded [dhalperi] [BEAM-1550] Enable parallel

Build failed in Jenkins: beam_PostCommit_Java_ValidatesRunner_Apex #971

2017-04-04 Thread Apache Jenkins Server
See -- [...truncated 748.46 KB...] x [deleted] (none) -> origin/pr/903/head x [deleted] (none) -> origin/pr/903/merge x [deleted]

[jira] [Resolved] (BEAM-1525) RuntimeWarning: Unable to load plugin beam_test_plugin when using nosetests

2017-04-04 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-1525. --- Resolution: Fixed Fix Version/s: Not applicable > RuntimeWarning: Unable to load plugin

[jira] [Commented] (BEAM-1525) RuntimeWarning: Unable to load plugin beam_test_plugin when using nosetests

2017-04-04 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955513#comment-15955513 ] María GH commented on BEAM-1525: I haven't seen it again, so we can close it by now. > RuntimeWarning:

[jira] [Updated] (BEAM-1525) RuntimeWarning: Unable to load plugin beam_test_plugin when using nosetests

2017-04-04 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] María GH updated BEAM-1525: --- I haven't seen it again, so we can close it by now. > RuntimeWarning: Unable to load plugin beam_test_plugin

[jira] [Created] (BEAM-1878) IO ITs: how to handle custom docker images?

2017-04-04 Thread Stephen Sisk (JIRA)
Stephen Sisk created BEAM-1878: -- Summary: IO ITs: how to handle custom docker images? Key: BEAM-1878 URL: https://issues.apache.org/jira/browse/BEAM-1878 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-1664) Support Kafka0.8.x client in KafkaIO

2017-04-04 Thread Neelesh Srinivas Salian (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neelesh Srinivas Salian updated BEAM-1664: -- Summary: Support Kafka0.8.x client in KafkaIO (was: Support Kafka0.8.x client

[jira] [Updated] (BEAM-1355) HDFS IO should comply with PTransform style guide

2017-04-04 Thread Stephen Sisk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Stephen Sisk updated BEAM-1355: --- Labels: backward-incompatible (was: backward-incompatible starter) > HDFS IO should comply with

[jira] [Commented] (BEAM-1816) Add a test timeout for validates runner tests

2017-04-04 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955496#comment-15955496 ] Mark Liu commented on BEAM-1816: Yes, I think we can close now, since all ValidatesRunner tests have

[jira] [Commented] (BEAM-1525) RuntimeWarning: Unable to load plugin beam_test_plugin when using nosetests

2017-04-04 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1525?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955495#comment-15955495 ] Ahmet Altay commented on BEAM-1525: --- Any updates on this one? > RuntimeWarning: Unable to load plugin

[jira] [Commented] (BEAM-1555) Python post commits failing

2017-04-04 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1555?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955494#comment-15955494 ] Ahmet Altay commented on BEAM-1555: --- [~pabloem] Is re-enabling this tracked in

[jira] [Commented] (BEAM-1610) Add support for Python SDK to Dataflow in PKB

2017-04-04 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955489#comment-15955489 ] Ahmet Altay commented on BEAM-1610: --- Jason what needs to happen here? > Add support for Python SDK to

[jira] [Assigned] (BEAM-1615) Add Meter metric type to Python SDK

2017-04-04 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-1615: - Assignee: (was: Ahmet Altay) > Add Meter metric type to Python SDK >

[jira] [Commented] (BEAM-1852) dead links on beam website

2017-04-04 Thread Stephen Sisk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955485#comment-15955485 ] Stephen Sisk commented on BEAM-1852: https://www.apache.org/licenses/icla.txt - this file is still

[jira] [Assigned] (BEAM-1618) Add Gauge metric type to Python SDK

2017-04-04 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1618?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-1618: - Assignee: (was: Ahmet Altay) > Add Gauge metric type to Python SDK >

[jira] [Commented] (BEAM-846) Decouple side input window mapping from WindowFn

2017-04-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955486#comment-15955486 ] ASF GitHub Bot commented on BEAM-846: - GitHub user tgroh opened a pull request:

[GitHub] beam pull request #2426: [BEAM-846] Remove getSideInputWindow

2017-04-04 Thread tgroh
GitHub user tgroh opened a pull request: https://github.com/apache/beam/pull/2426 [BEAM-846] Remove getSideInputWindow Be sure to do all of the following to help us incorporate your contribution quickly and easily: - [ ] Make sure the PR title is formatted like:

[jira] [Closed] (BEAM-1715) Wordcount on Dataflow checksum mismatch

2017-04-04 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay closed BEAM-1715. - Resolution: Fixed Fix Version/s: Not applicable > Wordcount on Dataflow checksum mismatch >

[jira] [Resolved] (BEAM-1731) RuntimeError when running wordcount with ValueProviders

2017-04-04 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-1731. --- Resolution: Fixed Fix Version/s: Not applicable commit was rolled back. > RuntimeError when

[jira] [Updated] (BEAM-1748) Clean DeprecationWarning from SDK/tests

2017-04-04 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-1748: -- Labels: newbie starter (was: ) > Clean DeprecationWarning from SDK/tests >

[jira] [Updated] (BEAM-1749) Upgrade pep8 to pycodestyle

2017-04-04 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1749?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-1749: -- Labels: newbie starter (was: ) > Upgrade pep8 to pycodestyle > --- > >

[jira] [Commented] (BEAM-1753) ImportError (cannot import name descriptor) in new venv after 'python setup.py install'

2017-04-04 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955481#comment-15955481 ] Ahmet Altay commented on BEAM-1753: --- Is it still happening? > ImportError (cannot import name

[jira] [Commented] (BEAM-1816) Add a test timeout for validates runner tests

2017-04-04 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955475#comment-15955475 ] Ahmet Altay commented on BEAM-1816: --- Can we close this now all tests have `process-timeout=600`, or

Jenkins build became unstable: beam_PostCommit_Java_ValidatesRunner_Spark #1503

2017-04-04 Thread Apache Jenkins Server
See

[jira] [Resolved] (BEAM-1853) AttributeError: 'AsIter' object has no attribute 'producer' (post commit failure)

2017-04-04 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-1853. --- Resolution: Fixed Fix Version/s: Not applicable > AttributeError: 'AsIter' object has no

[jira] [Commented] (BEAM-680) Python Dataflow stages stale requirements-cache dependencies

2017-04-04 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955471#comment-15955471 ] Ahmet Altay commented on BEAM-680: -- The solution to this is to use `requirements_cache` flag which can be

Jenkins build became unstable: beam_PostCommit_Java_MavenInstall #3155

2017-04-04 Thread Apache Jenkins Server
See

[GitHub] beam pull request #2425: Rename filePath to filePattern in NumbedShardedFile

2017-04-04 Thread kennknowles
GitHub user kennknowles opened a pull request: https://github.com/apache/beam/pull/2425 Rename filePath to filePattern in NumbedShardedFile R: @reuvenlax @tgroh You can merge this pull request into a Git repository by running: $ git pull https://github.com/kennknowles/beam

[jira] [Resolved] (BEAM-1818) Expose side-channel inputs in PTransform

2017-04-04 Thread Thomas Groh (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Thomas Groh resolved BEAM-1818. --- Resolution: Fixed Fix Version/s: First stable release > Expose side-channel inputs in

[jira] [Commented] (BEAM-1579) Runners should verify that PT overrides converged

2017-04-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955454#comment-15955454 ] ASF GitHub Bot commented on BEAM-1579: -- GitHub user tgroh opened a pull request:

[jira] [Commented] (BEAM-1579) Runners should verify that PT overrides converged

2017-04-04 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955438#comment-15955438 ] ASF GitHub Bot commented on BEAM-1579: -- Github user asfgit closed the pull request at:

[GitHub] beam pull request #2379: [BEAM-1579] Use Batch Replacement API in the Datafl...

2017-04-04 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/beam/pull/2379 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[1/2] beam git commit: This closes #2379

2017-04-04 Thread tgroh
Repository: beam Updated Branches: refs/heads/master db3144bf6 -> 22ff898a3 This closes #2379 Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/22ff898a Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/22ff898a Diff:

[2/2] beam git commit: Use Batch Replacement API in the Dataflow Runner

2017-04-04 Thread tgroh
Use Batch Replacement API in the Dataflow Runner Project: http://git-wip-us.apache.org/repos/asf/beam/repo Commit: http://git-wip-us.apache.org/repos/asf/beam/commit/7efee543 Tree: http://git-wip-us.apache.org/repos/asf/beam/tree/7efee543 Diff:

[jira] [Commented] (BEAM-165) Add Hadoop MapReduce runner

2017-04-04 Thread Mark Lester (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955434#comment-15955434 ] Mark Lester commented on BEAM-165: -- Are you going to push to the same branch? Really excited to try this

[jira] [Commented] (BEAM-1870) ByteKey / ByteKeyRangeTracker should not use ByteString on public API surface

2017-04-04 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-1870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955404#comment-15955404 ] Ismaël Mejía commented on BEAM-1870: I agree about removing protobuf from the public API, so removing

[jira] [Resolved] (BEAM-1875) Remove Spark runner custom Hadoop and Avro IOs.

2017-04-04 Thread Amit Sela (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Amit Sela resolved BEAM-1875. - Resolution: Fixed Fix Version/s: First stable release > Remove Spark runner custom Hadoop and Avro

[jira] [Commented] (BEAM-1612) Support real Bundle in Flink runner

2017-04-04 Thread Jingsong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15955360#comment-15955360 ] Jingsong Lee commented on BEAM-1612: I think this is a good idea. No matter how small it is better than

[jira] [Created] (BEAM-1877) Use Iterables.isEmpty in GroupIntoBatches

2017-04-04 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-1877: - Summary: Use Iterables.isEmpty in GroupIntoBatches Key: BEAM-1877 URL: https://issues.apache.org/jira/browse/BEAM-1877 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-1876) GroupIntoBatches may be able to use Combine.BinaryCombineLongFn

2017-04-04 Thread Thomas Groh (JIRA)
Thomas Groh created BEAM-1876: - Summary: GroupIntoBatches may be able to use Combine.BinaryCombineLongFn Key: BEAM-1876 URL: https://issues.apache.org/jira/browse/BEAM-1876 Project: Beam Issue

  1   2   >