[jira] [Commented] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-05-28 Thread Chad Dombrova (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16850078#comment-16850078 ] Chad Dombrova commented on BEAM-7060: - {quote}For example, a PTransform may be parameterized by an SQL

[jira] [Commented] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-05-22 Thread Chad Dombrova (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16846309#comment-16846309 ] Chad Dombrova commented on BEAM-7060: - Hi all, I'm quite interested in this topic and I have quite a

[jira] [Commented] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-05-23 Thread Chad Dombrova (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16847176#comment-16847176 ] Chad Dombrova commented on BEAM-7060: - > By supporting I mean adding adding annotations to Beam (note

[jira] [Updated] (BEAM-7379) Flink runner build instructions need updating

2019-05-21 Thread Chad Dombrova (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Dombrova updated BEAM-7379: Description: Hi, I'm new to the project and trying to follow the instructions on 

[jira] [Updated] (BEAM-7379) Flink runner build instructions need updating

2019-05-21 Thread Chad Dombrova (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Dombrova updated BEAM-7379: Description: Hi, I'm new to the project and trying to follow the instructions on 

[jira] [Created] (BEAM-7379) Flink runner build instructions need updating

2019-05-21 Thread Chad Dombrova (JIRA)
Chad Dombrova created BEAM-7379: --- Summary: Flink runner build instructions need updating Key: BEAM-7379 URL: https://issues.apache.org/jira/browse/BEAM-7379 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-3788) Implement a Kafka IO for Python SDK

2019-05-20 Thread Chad Dombrova (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1683#comment-1683 ] Chad Dombrova commented on BEAM-3788: - Hi, any updates on this?   > Implement a Kafka IO for Python

[jira] [Updated] (BEAM-7720) Fix the exception type of InMemoryJobService when job id not found

2019-07-10 Thread Chad Dombrova (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Dombrova updated BEAM-7720: Description: The contract in beam_job_api.proto for `CancelJobRequest`, `GetJobStateRequest`, and

[jira] [Created] (BEAM-7720) Fix the exception type of InMemoryJobService when job id not found

2019-07-10 Thread Chad Dombrova (JIRA)
Chad Dombrova created BEAM-7720: --- Summary: Fix the exception type of InMemoryJobService when job id not found Key: BEAM-7720 URL: https://issues.apache.org/jira/browse/BEAM-7720 Project: Beam

[jira] [Commented] (BEAM-3595) Normalize URNs across SDKs and runners.

2019-07-12 Thread Chad Dombrova (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883566#comment-16883566 ] Chad Dombrova commented on BEAM-3595: - I see that this is marked as fixed, but when using v2.13.0 of 

[jira] [Commented] (BEAM-3595) Normalize URNs across SDKs and runners.

2019-07-12 Thread Chad Dombrova (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16883940#comment-16883940 ] Chad Dombrova commented on BEAM-3595: - Ah, looks like those were fixed in yet-to-be released (on PyPI)

[jira] [Created] (BEAM-7738) Support PubSubIO to be configured externally for use with other SDKs

2019-07-13 Thread Chad Dombrova (JIRA)
Chad Dombrova created BEAM-7738: --- Summary: Support PubSubIO to be configured externally for use with other SDKs Key: BEAM-7738 URL: https://issues.apache.org/jira/browse/BEAM-7738 Project: Beam

[jira] [Created] (BEAM-7677) create a CLI to convert a pipeline to graphviz dot format

2019-07-02 Thread Chad Dombrova (JIRA)
Chad Dombrova created BEAM-7677: --- Summary: create a CLI to convert a pipeline to graphviz dot format Key: BEAM-7677 URL: https://issues.apache.org/jira/browse/BEAM-7677 Project: Beam Issue

[jira] [Updated] (BEAM-7677) create a CLI to convert a pipeline to graphviz dot format

2019-07-02 Thread Chad Dombrova (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Dombrova updated BEAM-7677: Description: As a Beam developer (especially one using python or go) I want a way to convert a

[jira] [Commented] (BEAM-7668) Add ability to query a pipeline from a gRPC JobService

2019-07-01 Thread Chad Dombrova (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876576#comment-16876576 ] Chad Dombrova commented on BEAM-7668: - PR is up:  [https://nuget.pkg.github.com/apache/beam/pull/8977]

[jira] [Created] (BEAM-7668) Add ability to query a pipeline from a gRPC JobService

2019-07-01 Thread Chad Dombrova (JIRA)
Chad Dombrova created BEAM-7668: --- Summary: Add ability to query a pipeline from a gRPC JobService Key: BEAM-7668 URL: https://issues.apache.org/jira/browse/BEAM-7668 Project: Beam Issue Type:

[jira] [Created] (BEAM-7984) [python] The coder returned for typehints.List should be IterableCoder

2019-08-14 Thread Chad Dombrova (JIRA)
Chad Dombrova created BEAM-7984: --- Summary: [python] The coder returned for typehints.List should be IterableCoder Key: BEAM-7984 URL: https://issues.apache.org/jira/browse/BEAM-7984 Project: Beam

[jira] [Created] (BEAM-8000) Add Delete method to gRPC JobService

2019-08-18 Thread Chad Dombrova (JIRA)
Chad Dombrova created BEAM-8000: --- Summary: Add Delete method to gRPC JobService Key: BEAM-8000 URL: https://issues.apache.org/jira/browse/BEAM-8000 Project: Beam Issue Type: Improvement

[jira] [Assigned] (BEAM-7720) Fix the exception type of InMemoryJobService when job id not found

2019-08-14 Thread Chad Dombrova (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7720?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Dombrova reassigned BEAM-7720: --- Assignee: Chad Dombrova > Fix the exception type of InMemoryJobService when job id not found

[jira] [Commented] (BEAM-7870) Externally configured KafkaIO consumer causes coder problems

2019-08-21 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912720#comment-16912720 ] Chad Dombrova commented on BEAM-7870: - Another possible solution: replace PubsubMessage & KafkaRecord

[jira] [Comment Edited] (BEAM-7870) Externally configured KafkaIO consumer causes coder problems

2019-08-20 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911560#comment-16911560 ] Chad Dombrova edited comment on BEAM-7870 at 8/20/19 10:04 PM: --- To follow up

[jira] [Comment Edited] (BEAM-7870) Externally configured KafkaIO consumer causes coder problems

2019-08-20 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16911560#comment-16911560 ] Chad Dombrova edited comment on BEAM-7870 at 8/20/19 7:01 PM: -- To follow up

[jira] [Created] (BEAM-8088) PCollection boundedness should be tracked and propagated

2019-08-24 Thread Chad Dombrova (Jira)
Chad Dombrova created BEAM-8088: --- Summary: PCollection boundedness should be tracked and propagated Key: BEAM-8088 URL: https://issues.apache.org/jira/browse/BEAM-8088 Project: Beam Issue

[jira] [Created] (BEAM-8085) PubsubMessageWithAttributesCoder should not produce null attributes map

2019-08-23 Thread Chad Dombrova (Jira)
Chad Dombrova created BEAM-8085: --- Summary: PubsubMessageWithAttributesCoder should not produce null attributes map Key: BEAM-8085 URL: https://issues.apache.org/jira/browse/BEAM-8085 Project: Beam

[jira] [Created] (BEAM-8148) [python] allow tests to be specified when using tox

2019-09-04 Thread Chad Dombrova (Jira)
Chad Dombrova created BEAM-8148: --- Summary: [python] allow tests to be specified when using tox Key: BEAM-8148 URL: https://issues.apache.org/jira/browse/BEAM-8148 Project: Beam Issue Type:

[jira] [Commented] (BEAM-8148) [python] allow tests to be specified when using tox

2019-09-05 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923730#comment-16923730 ] Chad Dombrova commented on BEAM-8148: - PR is merged, so this is fixed! > [python] allow tests to be

[jira] [Commented] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-09-05 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16923739#comment-16923739 ] Chad Dombrova commented on BEAM-7060: - Note that work on type annotations is continuing in BEAM-7746

[jira] [Updated] (BEAM-8088) PCollection boundedness should be tracked and propagated in python sdk

2019-09-05 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Dombrova updated BEAM-8088: Summary: PCollection boundedness should be tracked and propagated in python sdk (was: [python]

[jira] [Updated] (BEAM-8088) [python] PCollection boundedness should be tracked and propagated

2019-09-05 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Dombrova updated BEAM-8088: Summary: [python] PCollection boundedness should be tracked and propagated (was: PCollection

[jira] [Created] (BEAM-8213) Run and report python tox tasks separately within Jenkins

2019-09-11 Thread Chad Dombrova (Jira)
Chad Dombrova created BEAM-8213: --- Summary: Run and report python tox tasks separately within Jenkins Key: BEAM-8213 URL: https://issues.apache.org/jira/browse/BEAM-8213 Project: Beam Issue

[jira] [Commented] (BEAM-8229) Python postcommit 2.7 tests are failing since we try to run a test with Python 3.6+ syntax on Python 2.

2019-09-13 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929363#comment-16929363 ] Chad Dombrova commented on BEAM-8229: - {quote} I am not familiar with pytest, but suspected it may

[jira] [Commented] (BEAM-8229) Python postcommit 3.7 tests are failing with syntax error

2019-09-13 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929346#comment-16929346 ] Chad Dombrova commented on BEAM-8229: - This is getting a bit difficult to communicate as the

[jira] [Commented] (BEAM-8229) Python postcommit 2.7 tests are failing since we try to run a test with Python 3.6+ syntax on Python 2.

2019-09-13 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929412#comment-16929412 ] Chad Dombrova commented on BEAM-8229: - Based on feedback from Robert, I'm going to split my PR into

[jira] [Commented] (BEAM-8230) Python pre-commits need to include python 3.x tests

2019-09-13 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929335#comment-16929335 ] Chad Dombrova commented on BEAM-8230: - Reposting this from the PR: There's a misunderstanding here.

[jira] [Commented] (BEAM-8229) Python postcommit 2.7 tests are failing since we try to run a test with Python 3.6+ syntax on Python 2.

2019-09-13 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16929360#comment-16929360 ] Chad Dombrova commented on BEAM-8229: - Back with more insight. The integration tests don't go through

[jira] [Commented] (BEAM-8235) Python Post Commit 3.6 issue

2019-09-16 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8235?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930747#comment-16930747 ] Chad Dombrova commented on BEAM-8235: - this is resolved > Python Post Commit 3.6 issue >

[jira] [Commented] (BEAM-8229) Python postcommit 2.7 tests are failing since we try to run a test with Python 3.6+ syntax on Python 2.

2019-09-16 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930749#comment-16930749 ] Chad Dombrova commented on BEAM-8229: - this is resolved > Python postcommit 2.7 tests are failing

[jira] [Commented] (BEAM-8213) Run and report python tox tasks separately within Jenkins

2019-09-16 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930762#comment-16930762 ] Chad Dombrova commented on BEAM-8213: - Here's a hierarchy of the relevant pre-commit tasks: {code}

[jira] [Commented] (BEAM-8213) Run and report python tox tasks separately within Jenkins

2019-09-16 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16930767#comment-16930767 ] Chad Dombrova commented on BEAM-8213: - I should also mention I'm fine with lumping the IT jobs in with

[jira] [Created] (BEAM-8238) Improve python gen_protos script

2019-09-15 Thread Chad Dombrova (Jira)
Chad Dombrova created BEAM-8238: --- Summary: Improve python gen_protos script Key: BEAM-8238 URL: https://issues.apache.org/jira/browse/BEAM-8238 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-8172) Add a label field to FunctionSpec proto

2019-09-06 Thread Chad Dombrova (Jira)
Chad Dombrova created BEAM-8172: --- Summary: Add a label field to FunctionSpec proto Key: BEAM-8172 URL: https://issues.apache.org/jira/browse/BEAM-8172 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-7768) Formalize Python external transform API

2019-09-17 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7768?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932021#comment-16932021 ] Chad Dombrova commented on BEAM-7768: - This is resolved with https://github.com/apache/beam/pull/9098

[jira] [Commented] (BEAM-7984) [python] The coder returned for typehints.List should be IterableCoder

2019-09-17 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7984?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932020#comment-16932020 ] Chad Dombrova commented on BEAM-7984: - this is resolved > [python] The coder returned for

[jira] [Created] (BEAM-8271) StateGetRequest/Response continuation_token should be string

2019-09-17 Thread Chad Dombrova (Jira)
Chad Dombrova created BEAM-8271: --- Summary: StateGetRequest/Response continuation_token should be string Key: BEAM-8271 URL: https://issues.apache.org/jira/browse/BEAM-8271 Project: Beam Issue

[jira] [Commented] (BEAM-8238) Improve python gen_protos script

2019-09-17 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932018#comment-16932018 ] Chad Dombrova commented on BEAM-8238: - this is resolved > Improve python gen_protos script >

[jira] [Commented] (BEAM-8148) [python] allow tests to be specified when using tox

2019-09-17 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8148?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16932019#comment-16932019 ] Chad Dombrova commented on BEAM-8148: - this is resolved > [python] allow tests to be specified when

[jira] [Updated] (BEAM-8213) Run and report python tox tasks separately within Jenkins

2019-09-13 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Dombrova updated BEAM-8213: Description: As a python developer, the speed and comprehensibility of the jenkins PreCommit job

[jira] [Updated] (BEAM-8213) Run and report python tox tasks separately within Jenkins

2019-09-13 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Dombrova updated BEAM-8213: Description: As a python developer, the speed and comprehensibility of the jenkins PreCommit job

[jira] [Updated] (BEAM-8213) Run and report python tox tasks separately within Jenkins

2019-09-13 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8213?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Dombrova updated BEAM-8213: Description: As a python developer, the speed and comprehensibility of the jenkins PreCommit job

[jira] [Created] (BEAM-7927) Add ability to get the list of submitted jobs from gRPC JobService

2019-08-07 Thread Chad Dombrova (JIRA)
Chad Dombrova created BEAM-7927: --- Summary: Add ability to get the list of submitted jobs from gRPC JobService Key: BEAM-7927 URL: https://issues.apache.org/jira/browse/BEAM-7927 Project: Beam

[jira] [Assigned] (BEAM-7738) Support PubSubIO to be configured externally for use with other SDKs

2019-08-05 Thread Chad Dombrova (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Dombrova reassigned BEAM-7738: --- Assignee: Chad Dombrova > Support PubSubIO to be configured externally for use with other

[jira] [Created] (BEAM-7931) Fix gradlew to allow offline builds

2019-08-08 Thread Chad Dombrova (JIRA)
Chad Dombrova created BEAM-7931: --- Summary: Fix gradlew to allow offline builds Key: BEAM-7931 URL: https://issues.apache.org/jira/browse/BEAM-7931 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-7768) Formalize Python external transform API

2019-07-18 Thread Chad Dombrova (JIRA)
Chad Dombrova created BEAM-7768: --- Summary: Formalize Python external transform API Key: BEAM-7768 URL: https://issues.apache.org/jira/browse/BEAM-7768 Project: Beam Issue Type: New Feature

[jira] [Created] (BEAM-7746) Add type hints to python code

2019-07-15 Thread Chad Dombrova (JIRA)
Chad Dombrova created BEAM-7746: --- Summary: Add type hints to python code Key: BEAM-7746 URL: https://issues.apache.org/jira/browse/BEAM-7746 Project: Beam Issue Type: New Feature

[jira] [Updated] (BEAM-7746) Add type hints to python code

2019-07-15 Thread Chad Dombrova (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Dombrova updated BEAM-7746: Description: As a developer of the beam source code, I would like the code to use pep484 type

[jira] [Created] (BEAM-8552) Spark runner should not used STOPPED state as a terminal state

2019-11-04 Thread Chad Dombrova (Jira)
Chad Dombrova created BEAM-8552: --- Summary: Spark runner should not used STOPPED state as a terminal state Key: BEAM-8552 URL: https://issues.apache.org/jira/browse/BEAM-8552 Project: Beam

[jira] [Updated] (BEAM-6857) Support dynamic timers

2019-11-01 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Dombrova updated BEAM-6857: Description: The Beam timers API currently requires each timer to be statically specified in the

[jira] [Updated] (BEAM-6857) Support dynamic timers

2019-11-01 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-6857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Dombrova updated BEAM-6857: Description: The Beam timers API currently requires each timer to be statically specified in the

[jira] [Commented] (BEAM-7870) Externally configured KafkaIO / PubsubIO consumer causes coder problems

2019-11-03 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16966373#comment-16966373 ] Chad Dombrova commented on BEAM-7870: - Note that there is not yet support in python for registering a

[jira] [Commented] (BEAM-4441) Incorrect coder inference for List and Tuple typehints.

2019-11-07 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969430#comment-16969430 ] Chad Dombrova commented on BEAM-4441: - Quick thought on this:  the {{Tuple[int, ...]}} case will be

[jira] [Commented] (BEAM-4441) Incorrect coder inference for List and Tuple typehints.

2019-11-07 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-4441?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969422#comment-16969422 ] Chad Dombrova commented on BEAM-4441: - I fixed the list case, but not the homogenous tuple case. >

[jira] [Commented] (BEAM-8523) Add useful timestamp to job servicer GetJobs

2019-10-31 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964223#comment-16964223 ] Chad Dombrova commented on BEAM-8523: - Looking at this a little more, it seems it would be pretty easy

[jira] [Comment Edited] (BEAM-8523) Add useful timestamp to job servicer GetJobs

2019-10-31 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964223#comment-16964223 ] Chad Dombrova edited comment on BEAM-8523 at 10/31/19 5:22 PM: --- Looking at

[jira] [Created] (BEAM-8539) Clearly define the valid job state transitions

2019-10-31 Thread Chad Dombrova (Jira)
Chad Dombrova created BEAM-8539: --- Summary: Clearly define the valid job state transitions Key: BEAM-8539 URL: https://issues.apache.org/jira/browse/BEAM-8539 Project: Beam Issue Type:

[jira] [Updated] (BEAM-8539) Clearly define the valid job state transitions

2019-10-31 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Dombrova updated BEAM-8539: Description: The Beam job state transitions are ill-defined, which is big problem for anything

[jira] [Commented] (BEAM-8539) Clearly define the valid job state transitions

2019-10-31 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964580#comment-16964580 ] Chad Dombrova commented on BEAM-8539: - [~lcwik], [~mxm] you might be interested in this. > Clearly

[jira] [Updated] (BEAM-8539) Clearly define the valid job state transitions

2019-10-31 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Dombrova updated BEAM-8539: Description: The Beam job state transitions are ill-defined, which is big problem for anything

[jira] [Commented] (BEAM-8523) Add useful timestamp to job servicer GetJobs

2019-10-31 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964406#comment-16964406 ] Chad Dombrova commented on BEAM-8523: - WIP: https://github.com/apache/beam/pull/9959 > Add useful

[jira] [Commented] (BEAM-8411) Re-enable pylint checks disabled due to pylint bug

2019-10-30 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963296#comment-16963296 ] Chad Dombrova commented on BEAM-8411: - No, this was introduced with 2.4.2. we need to switch to

[jira] [Commented] (BEAM-8523) Add useful timestamp to job servicer GetJobs

2019-10-30 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963522#comment-16963522 ] Chad Dombrova commented on BEAM-8523: - [~lcwik] does this change sound reasonable to you? > Add

[jira] [Updated] (BEAM-8523) Add useful timestamp to job servicer GetJobs

2019-10-30 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Dombrova updated BEAM-8523: Description: As a user querying jobs with JobService.GetJobs, it would be useful if the JobInfo

[jira] [Created] (BEAM-8523) Add useful timestamp to job servicer GetJobs

2019-10-30 Thread Chad Dombrova (Jira)
Chad Dombrova created BEAM-8523: --- Summary: Add useful timestamp to job servicer GetJobs Key: BEAM-8523 URL: https://issues.apache.org/jira/browse/BEAM-8523 Project: Beam Issue Type: New

[jira] [Commented] (BEAM-8523) Add useful timestamp to job servicer GetJobs

2019-10-30 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963645#comment-16963645 ] Chad Dombrova commented on BEAM-8523: - {quote} Seems to make sense but we might as well just have all

[jira] [Commented] (BEAM-8646) PR #9814 appears to cause failures in fnapi_runner tests on Windows

2019-11-13 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16973881#comment-16973881 ] Chad Dombrova commented on BEAM-8646: - Hi all.  The simplest solution would be to make this new

[jira] [Created] (BEAM-8732) Add support for additional structured types to Schemas/RowCoders

2019-11-16 Thread Chad Dombrova (Jira)
Chad Dombrova created BEAM-8732: --- Summary: Add support for additional structured types to Schemas/RowCoders Key: BEAM-8732 URL: https://issues.apache.org/jira/browse/BEAM-8732 Project: Beam

[jira] [Commented] (BEAM-7886) Make row coder a standard coder and implement in python

2019-11-17 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16976165#comment-16976165 ] Chad Dombrova commented on BEAM-7886: - Is there a Jira for adding support for logical types?   Is the

[jira] [Created] (BEAM-8930) External workers should receive artifact endpoint when started from python

2019-12-09 Thread Chad Dombrova (Jira)
Chad Dombrova created BEAM-8930: --- Summary: External workers should receive artifact endpoint when started from python Key: BEAM-8930 URL: https://issues.apache.org/jira/browse/BEAM-8930 Project: Beam

[jira] [Commented] (BEAM-8613) Add environment variable support to Docker environment

2019-12-09 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992035#comment-16992035 ] Chad Dombrova commented on BEAM-8613: - {quote}What kind of environment variables are you trying to

[jira] [Commented] (BEAM-8613) Add environment variable support to Docker environment

2019-12-16 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997743#comment-16997743 ] Chad Dombrova commented on BEAM-8613: - [~robertwb] any additional thoughts on this? > Add environment

[jira] [Comment Edited] (BEAM-8613) Add environment variable support to Docker environment

2019-12-16 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8613?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16992035#comment-16992035 ] Chad Dombrova edited comment on BEAM-8613 at 12/17/19 12:34 AM:

[jira] [Commented] (BEAM-8966) failure in :sdks:python:test-suites:direct:py37:hdfsIntegrationTest

2019-12-16 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997438#comment-16997438 ] Chad Dombrova commented on BEAM-8966: - hmmm...  the errors show two different problems.   In Udi's,  

[jira] [Commented] (BEAM-8966) failure in :sdks:python:test-suites:direct:py37:hdfsIntegrationTest

2019-12-16 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16997506#comment-16997506 ] Chad Dombrova commented on BEAM-8966: - Ok, I'm working on trying to reproduce this, but running into

[jira] [Commented] (BEAM-8172) Add a label field to FunctionSpec proto

2019-10-15 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16952312#comment-16952312 ] Chad Dombrova commented on BEAM-8172: - The goal of clarifying intent is a fine one, but I'm concerned

[jira] [Created] (BEAM-8402) Create a class hierarchy to represent environments

2019-10-14 Thread Chad Dombrova (Jira)
Chad Dombrova created BEAM-8402: --- Summary: Create a class hierarchy to represent environments Key: BEAM-8402 URL: https://issues.apache.org/jira/browse/BEAM-8402 Project: Beam Issue Type: New

[jira] [Updated] (BEAM-7870) Externally configured KafkaIO / PubsubIO consumer causes coder problems

2019-10-24 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chad Dombrova updated BEAM-7870: Summary: Externally configured KafkaIO / PubsubIO consumer causes coder problems (was: Externally

[jira] [Commented] (BEAM-7870) Externally configured KafkaIO / PubsubIO consumer causes coder problems

2019-10-24 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16959135#comment-16959135 ] Chad Dombrova commented on BEAM-7870: - The plan forming is to use DefaultSchema with either

[jira] [Commented] (BEAM-8350) Upgrade to pylint 2.4

2019-10-23 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16958027#comment-16958027 ] Chad Dombrova commented on BEAM-8350: - done! > Upgrade to pylint 2.4 > - > >

[jira] [Created] (BEAM-8411) Re-enable pylint checks disabled due to pylint bug

2019-10-16 Thread Chad Dombrova (Jira)
Chad Dombrova created BEAM-8411: --- Summary: Re-enable pylint checks disabled due to pylint bug Key: BEAM-8411 URL: https://issues.apache.org/jira/browse/BEAM-8411 Project: Beam Issue Type: Task

[jira] [Created] (BEAM-8486) Reference to ParallelBundleManager attr "_skip_registration" should be "_registered"

2019-10-25 Thread Chad Dombrova (Jira)
Chad Dombrova created BEAM-8486: --- Summary: Reference to ParallelBundleManager attr "_skip_registration" should be "_registered" Key: BEAM-8486 URL: https://issues.apache.org/jira/browse/BEAM-8486

[jira] [Commented] (BEAM-8539) Clearly define the valid job state transitions

2019-11-01 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16964981#comment-16964981 ] Chad Dombrova commented on BEAM-8539: - I searched the java code for STOPPED and it seems to be used

[jira] [Created] (BEAM-8746) Allow the local job service to work from inside docker

2019-11-19 Thread Chad Dombrova (Jira)
Chad Dombrova created BEAM-8746: --- Summary: Allow the local job service to work from inside docker Key: BEAM-8746 URL: https://issues.apache.org/jira/browse/BEAM-8746 Project: Beam Issue Type:

[jira] [Created] (BEAM-8350) Upgrade to pylint 2.4

2019-10-03 Thread Chad Dombrova (Jira)
Chad Dombrova created BEAM-8350: --- Summary: Upgrade to pylint 2.4 Key: BEAM-8350 URL: https://issues.apache.org/jira/browse/BEAM-8350 Project: Beam Issue Type: Improvement Components:

[jira] [Created] (BEAM-8355) Make BooleanCoder a standard coder

2019-10-05 Thread Chad Dombrova (Jira)
Chad Dombrova created BEAM-8355: --- Summary: Make BooleanCoder a standard coder Key: BEAM-8355 URL: https://issues.apache.org/jira/browse/BEAM-8355 Project: Beam Issue Type: New Feature

[jira] [Commented] (BEAM-9012) Include `-> None` on Pipeline and PipelineOptions `__init__` methods for pytype compatibility

2019-12-20 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17001295#comment-17001295 ] Chad Dombrova commented on BEAM-9012: - I imagine there are going to be _lots_ of little differences

[jira] [Commented] (BEAM-9012) Include `-> None` on Pipeline and PipelineOptions `__init__` methods for pytype compatibility

2019-12-20 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9012?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17001279#comment-17001279 ] Chad Dombrova commented on BEAM-9012: - Fine by me.  Brian, if you're into the static typing thing, you

[jira] [Created] (BEAM-9274) Support running yapf in a git pre-commit hook

2020-02-08 Thread Chad Dombrova (Jira)
Chad Dombrova created BEAM-9274: --- Summary: Support running yapf in a git pre-commit hook Key: BEAM-9274 URL: https://issues.apache.org/jira/browse/BEAM-9274 Project: Beam Issue Type:

[jira] [Commented] (BEAM-9414) [beam_PostCommit_Python2] build failed

2020-02-29 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048423#comment-17048423 ] Chad Dombrova commented on BEAM-9414: - This should have been fixed in BEAM-9405, in this PR:

[jira] [Commented] (BEAM-9058) Line-too-long Python lint checks are no longer working.

2020-02-29 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9058?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048437#comment-17048437 ] Chad Dombrova commented on BEAM-9058: - This is resolved. > Line-too-long Python lint checks are no

[jira] [Commented] (BEAM-8979) protoc-gen-mypy: program not found or is not executable

2020-02-29 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8979?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048436#comment-17048436 ] Chad Dombrova commented on BEAM-8979: - This is resolved. > protoc-gen-mypy: program not found or is

[jira] [Commented] (BEAM-9427) Python precommits flaky with ImportError: cannot import name 'ContextManager'

2020-03-02 Thread Chad Dombrova (Jira)
[ https://issues.apache.org/jira/browse/BEAM-9427?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17049714#comment-17049714 ] Chad Dombrova commented on BEAM-9427: - Is there a traceback anywhere that can tell us what's importing

  1   2   >