[jira] [Created] (BEAM-5097) Increment counter for "small words" in go SDK example

2018-08-06 Thread holdenk (JIRA)
holdenk created BEAM-5097: - Summary: Increment counter for "small words" in go SDK example Key: BEAM-5097 URL: https://issues.apache.org/jira/browse/BEAM-5097 Project: Beam Issue Type: Improvement

[jira] [Closed] (BEAM-5094) go generate specialize isn't super clear where to find specialize

2018-08-06 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk closed BEAM-5094. - Resolution: Not A Problem Fix Version/s: Not applicable nvm, was in sdk/go/cmd but I was looking in

[jira] [Commented] (BEAM-3878) Improve error reporting in calls.go

2018-08-06 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3878?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16570815#comment-16570815 ] holdenk commented on BEAM-3878: --- I started working on this, but then I ran into some confusion with the go

[jira] [Created] (BEAM-5094) go generate specialize isn't super clear where to find specialize

2018-08-06 Thread holdenk (JIRA)
holdenk created BEAM-5094: - Summary: go generate specialize isn't super clear where to find specialize Key: BEAM-5094 URL: https://issues.apache.org/jira/browse/BEAM-5094 Project: Beam Issue Type:

[jira] [Created] (BEAM-5076) In Python worker docker file use a requirements.txt file

2018-08-05 Thread holdenk (JIRA)
holdenk created BEAM-5076: - Summary: In Python worker docker file use a requirements.txt file Key: BEAM-5076 URL: https://issues.apache.org/jira/browse/BEAM-5076 Project: Beam Issue Type:

[jira] [Closed] (BEAM-5047) Make clean cleanup go vendor directories for Beam

2018-07-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk closed BEAM-5047. - Resolution: Cannot Reproduce Fix Version/s: Not applicable > Make clean cleanup go vendor directories for

[jira] [Commented] (BEAM-5047) Make clean cleanup go vendor directories for Beam

2018-07-30 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16562607#comment-16562607 ] holdenk commented on BEAM-5047: --- So it seems to be working now, but it wasn't before. I'm going to close

[jira] [Created] (BEAM-5048) Document common build pattern for SDKs

2018-07-30 Thread holdenk (JIRA)
holdenk created BEAM-5048: - Summary: Document common build pattern for SDKs Key: BEAM-5048 URL: https://issues.apache.org/jira/browse/BEAM-5048 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-5047) Make clean cleanup go vendor directories for Beam

2018-07-30 Thread holdenk (JIRA)
holdenk created BEAM-5047: - Summary: Make clean cleanup go vendor directories for Beam Key: BEAM-5047 URL: https://issues.apache.org/jira/browse/BEAM-5047 Project: Beam Issue Type: Improvement

[jira] [Closed] (BEAM-4865) run_validatescontainer.sh in Python sdk is likely not run in jenkins

2018-07-25 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk closed BEAM-4865. - Resolution: Not A Problem Fix Version/s: Not applicable > run_validatescontainer.sh in Python sdk is

[jira] [Commented] (BEAM-4865) run_validatescontainer.sh in Python sdk is likely not run in jenkins

2018-07-25 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16556037#comment-16556037 ] holdenk commented on BEAM-4865: --- nvm, we just have the credentials hard coded in jenkins. >

[jira] [Created] (BEAM-4865) run_validatescontainer.sh in Python sdk is likely not run in jenkins

2018-07-25 Thread holdenk (JIRA)
holdenk created BEAM-4865: - Summary: run_validatescontainer.sh in Python sdk is likely not run in jenkins Key: BEAM-4865 URL: https://issues.apache.org/jira/browse/BEAM-4865 Project: Beam Issue

[jira] [Created] (BEAM-4864) run_validatescontainer.sh in Python sdk has hard-coded bucket of sadness

2018-07-25 Thread holdenk (JIRA)
holdenk created BEAM-4864: - Summary: run_validatescontainer.sh in Python sdk has hard-coded bucket of sadness Key: BEAM-4864 URL: https://issues.apache.org/jira/browse/BEAM-4864 Project: Beam Issue

[jira] [Created] (BEAM-4833) Add support for users specifying a requirements.txt for their Python portable container

2018-07-19 Thread holdenk (JIRA)
holdenk created BEAM-4833: - Summary: Add support for users specifying a requirements.txt for their Python portable container Key: BEAM-4833 URL: https://issues.apache.org/jira/browse/BEAM-4833 Project: Beam

[jira] [Commented] (BEAM-3142) Fix proto generation in Python 3

2018-07-02 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16530430#comment-16530430 ] holdenk commented on BEAM-3142: --- It should be, but I can't assign it to myself. > Fix proto generation in

[jira] [Created] (BEAM-3985) Update developer guide to reference new Python linting enviroments

2018-04-02 Thread holdenk (JIRA)
holdenk created BEAM-3985: - Summary: Update developer guide to reference new Python linting enviroments Key: BEAM-3985 URL: https://issues.apache.org/jira/browse/BEAM-3985 Project: Beam Issue Type:

[jira] [Created] (BEAM-3984) Add dependencies to tox.ini file

2018-04-02 Thread holdenk (JIRA)
holdenk created BEAM-3984: - Summary: Add dependencies to tox.ini file Key: BEAM-3984 URL: https://issues.apache.org/jira/browse/BEAM-3984 Project: Beam Issue Type: Task Components:

[jira] [Commented] (BEAM-3781) Figure out min supported Python 3 version

2018-03-23 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16411920#comment-16411920 ] holdenk commented on BEAM-3781: --- So I'd like to encourage 3.4 since PySpark currently supports 3.4 and if we

[jira] [Commented] (BEAM-3850) I/O transform for HDH5 files with extension H5

2018-03-14 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399026#comment-16399026 ] holdenk commented on BEAM-3850: --- Thanks for the issue!   So for some additional context for folks thinking

[jira] [Updated] (BEAM-3761) Fix Python 3 cmp function

2018-02-27 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated BEAM-3761: -- Description: Various functions don't exist in Python 3 that did in python 2. This Jira is to fix the use of cmp

[jira] [Updated] (BEAM-3761) Fix Python 3 cmp function

2018-02-27 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated BEAM-3761: -- Summary: Fix Python 3 cmp function (was: Fix Python 3 missing functions) > Fix Python 3 cmp function >

[jira] [Updated] (BEAM-3761) Fix Python 3 cmp function

2018-02-27 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated BEAM-3761: -- Description: Various functions don't exist in Python 3 that did in python 2. This Jira is to fix the use of cmp

[jira] [Updated] (BEAM-3761) Fix Python 3 missing functions

2018-02-27 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated BEAM-3761: -- Issue Type: Improvement (was: Bug) > Fix Python 3 missing functions > -- > >

[jira] [Updated] (BEAM-3761) Fix Python 3 missing functions

2018-02-27 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated BEAM-3761: -- Issue Type: Bug (was: Sub-task) Parent: (was: BEAM-1251) > Fix Python 3 missing functions >

[jira] [Created] (BEAM-3761) Fix Python 3 missing functions

2018-02-27 Thread holdenk (JIRA)
holdenk created BEAM-3761: - Summary: Fix Python 3 missing functions Key: BEAM-3761 URL: https://issues.apache.org/jira/browse/BEAM-3761 Project: Beam Issue Type: Sub-task Components:

[jira] [Created] (BEAM-3738) Enable Py3 linting in Jenkins

2018-02-22 Thread holdenk (JIRA)
holdenk created BEAM-3738: - Summary: Enable Py3 linting in Jenkins Key: BEAM-3738 URL: https://issues.apache.org/jira/browse/BEAM-3738 Project: Beam Issue Type: Bug Components:

[jira] [Created] (BEAM-3444) Fix flake8 detected errors E999 (AST compile error)

2018-01-09 Thread holdenk (JIRA)
holdenk created BEAM-3444: - Summary: Fix flake8 detected errors E999 (AST compile error) Key: BEAM-3444 URL: https://issues.apache.org/jira/browse/BEAM-3444 Project: Beam Issue Type: Sub-task

[jira] [Commented] (BEAM-3143) Fix type inference in Python 3 for generators

2018-01-08 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16315893#comment-16315893 ] holdenk commented on BEAM-3143: --- So I don't have permission to assign this issue, maybe [~altay] can do this

[jira] [Created] (BEAM-3290) Construct iterators directly if possible to allow spilling to disk

2017-12-05 Thread holdenk (JIRA)
holdenk created BEAM-3290: - Summary: Construct iterators directly if possible to allow spilling to disk Key: BEAM-3290 URL: https://issues.apache.org/jira/browse/BEAM-3290 Project: Beam Issue Type:

[jira] [Created] (BEAM-3233) Fix Py3 list comprehension type inferance

2017-11-21 Thread holdenk (JIRA)
holdenk created BEAM-3233: - Summary: Fix Py3 list comprehension type inferance Key: BEAM-3233 URL: https://issues.apache.org/jira/browse/BEAM-3233 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-3185) Build blocks on parsing long as int from github status json

2017-11-13 Thread holdenk (JIRA)
holdenk created BEAM-3185: - Summary: Build blocks on parsing long as int from github status json Key: BEAM-3185 URL: https://issues.apache.org/jira/browse/BEAM-3185 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-3174) Master python sdk seems broken with test_harness_override_present_in_dataflow_distributions on Py 2.7.6

2017-11-12 Thread holdenk (JIRA)
holdenk created BEAM-3174: - Summary: Master python sdk seems broken with test_harness_override_present_in_dataflow_distributions on Py 2.7.6 Key: BEAM-3174 URL: https://issues.apache.org/jira/browse/BEAM-3174

[jira] [Created] (BEAM-3173) Proto code generation fails in Python on Jenkins

2017-11-10 Thread holdenk (JIRA)
holdenk created BEAM-3173: - Summary: Proto code generation fails in Python on Jenkins Key: BEAM-3173 URL: https://issues.apache.org/jira/browse/BEAM-3173 Project: Beam Issue Type: Bug

[jira] [Created] (BEAM-3164) Capture stderr logs during gen proto

2017-11-08 Thread holdenk (JIRA)
holdenk created BEAM-3164: - Summary: Capture stderr logs during gen proto Key: BEAM-3164 URL: https://issues.apache.org/jira/browse/BEAM-3164 Project: Beam Issue Type: Bug Components:

[jira] [Created] (BEAM-3143) Fix type inference in Python 3 for generators

2017-11-05 Thread holdenk (JIRA)
holdenk created BEAM-3143: - Summary: Fix type inference in Python 3 for generators Key: BEAM-3143 URL: https://issues.apache.org/jira/browse/BEAM-3143 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-3142) Fix proto generation in Python 3

2017-11-05 Thread holdenk (JIRA)
holdenk created BEAM-3142: - Summary: Fix proto generation in Python 3 Key: BEAM-3142 URL: https://issues.apache.org/jira/browse/BEAM-3142 Project: Beam Issue Type: Sub-task Components:

[jira] [Created] (BEAM-3141) Make coders & streams work in Python 3

2017-11-05 Thread holdenk (JIRA)
holdenk created BEAM-3141: - Summary: Make coders & streams work in Python 3 Key: BEAM-3141 URL: https://issues.apache.org/jira/browse/BEAM-3141 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-3058) Python futurize stage 2

2017-10-13 Thread holdenk (JIRA)
holdenk created BEAM-3058: - Summary: Python futurize stage 2 Key: BEAM-3058 URL: https://issues.apache.org/jira/browse/BEAM-3058 Project: Beam Issue Type: Sub-task Components: sdk-py-core

[jira] [Created] (BEAM-2836) Apply futurize stage 1 ("safe")

2017-09-01 Thread holdenk (JIRA)
holdenk created BEAM-2836: - Summary: Apply futurize stage 1 ("safe") Key: BEAM-2836 URL: https://issues.apache.org/jira/browse/BEAM-2836 Project: Beam Issue Type: Sub-task Components:

[jira] [Commented] (BEAM-2821) isort and autopep8 the current Python code base

2017-09-01 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16151380#comment-16151380 ] holdenk commented on BEAM-2821: --- Would it be ok to close this and assign to me then? > isort and autopep8

[jira] [Created] (BEAM-2821) isort and autopep8 the current Python code base

2017-08-29 Thread holdenk (JIRA)
holdenk created BEAM-2821: - Summary: isort and autopep8 the current Python code base Key: BEAM-2821 URL: https://issues.apache.org/jira/browse/BEAM-2821 Project: Beam Issue Type: Sub-task

[jira] [Commented] (BEAM-2784) Fix issues from automated conversion to allow Python 2 functionality

2017-08-22 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16136481#comment-16136481 ] holdenk commented on BEAM-2784: --- I've started working on this (it's down under a 100 errors :p)

[jira] [Created] (BEAM-2786) Update jenkins test scripts to test with Py2 & Py3

2017-08-21 Thread holdenk (JIRA)
holdenk created BEAM-2786: - Summary: Update jenkins test scripts to test with Py2 & Py3 Key: BEAM-2786 URL: https://issues.apache.org/jira/browse/BEAM-2786 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-2784) Fix issues from automated conversion to allow Python 2 functionality

2017-08-21 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] holdenk updated BEAM-2784: -- Issue Type: Improvement (was: Sub-task) Parent: (was: BEAM-1251) > Fix issues from automated

[jira] [Created] (BEAM-2784) Fix issues from automated conversion to allow Python 2 functionality

2017-08-21 Thread holdenk (JIRA)
holdenk created BEAM-2784: - Summary: Fix issues from automated conversion to allow Python 2 functionality Key: BEAM-2784 URL: https://issues.apache.org/jira/browse/BEAM-2784 Project: Beam Issue

[jira] [Commented] (BEAM-1373) Update Python SDK code to support both Python 2 and 3

2017-08-20 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16134582#comment-16134582 ] holdenk commented on BEAM-1373: --- I've started looking at the converting again. It looks like all of our

[jira] [Commented] (BEAM-981) Not possible to directly submit a pipeline on spark cluster

2017-05-06 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15999608#comment-15999608 ] holdenk commented on BEAM-981: -- Sure thing, no mean to pressure - but let me know if I can help or answer any

[jira] [Commented] (BEAM-981) Not possible to directly submit a pipeline on spark cluster

2017-05-01 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15992305#comment-15992305 ] holdenk commented on BEAM-981: -- I can take a look at this later on this week if no one else is. > Not possible

[jira] [Commented] (BEAM-2087) conda python breaks the python tests

2017-04-28 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2087?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989396#comment-15989396 ] holdenk commented on BEAM-2087: --- So is [~altay] planning on working on this or would it be an OK thing for me

[jira] [Commented] (BEAM-1451) Java Objects have bad toStrings

2017-04-28 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15989394#comment-15989394 ] holdenk commented on BEAM-1451: --- It seems like this issue should be marked as resolved? What do you think

[jira] [Created] (BEAM-2087) conda python breaks the python tests

2017-04-26 Thread holdenk (JIRA)
holdenk created BEAM-2087: - Summary: conda python breaks the python tests Key: BEAM-2087 URL: https://issues.apache.org/jira/browse/BEAM-2087 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-2057) Test metrics are reported to Spark Metrics sink.

2017-04-26 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15985401#comment-15985401 ] holdenk commented on BEAM-2057: --- Giving this a quick attempt for the hackathon :) > Test metrics are