[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=291824=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291824 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291794=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291794 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3489) Expose the message id of received messages within PubsubMessage

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3489?focusedWorklogId=291685=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291685 ] ASF GitHub Bot logged work on BEAM-3489: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291680=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291680 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-3489) Expose the message id of received messages within PubsubMessage

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3489?focusedWorklogId=291666=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291666 ] ASF GitHub Bot logged work on BEAM-3489: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=291665=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291665 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7049) Merge multiple input to one BeamUnionRel

2019-08-08 Thread sridhar Reddy (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903422#comment-16903422 ] sridhar Reddy commented on BEAM-7049: - [~amaliujia] Thanks for the update. I think I understand the

[jira] [Work logged] (BEAM-7916) Add ElasticsearchIO query parameter to take a ValueProvider

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7916?focusedWorklogId=291658=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291658 ] ASF GitHub Bot logged work on BEAM-7916: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7713) Migrate to "typing" module typing types in Beam typehints (on Py2 and Py3).

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903397#comment-16903397 ] Udi Meiri commented on BEAM-7713: - Most important is to allow Beam users to only use typing hints. >

[jira] [Work logged] (BEAM-7696) If classpath directory contains a directory it causes exception in Spark runner staging

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7696?focusedWorklogId=291623=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291623 ] ASF GitHub Bot logged work on BEAM-7696: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-5822) Vendor bytebuddy

2019-08-08 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-5822. - Resolution: Fixed Fix Version/s: 2.16.0 > Vendor bytebuddy > > >

[jira] [Work logged] (BEAM-5822) Vendor bytebuddy

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5822?focusedWorklogId=291598=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291598 ] ASF GitHub Bot logged work on BEAM-5822: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-2535) Allow explicit output time independent of firing specification for all timers

2019-08-08 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903366#comment-16903366 ] Luke Cwik commented on BEAM-2535: - I did a little bit of this work by defining the coder for timers and

[jira] [Created] (BEAM-7935) TypeError: can't pickle _cffi_backend.CDataGCP objects

2019-08-08 Thread Marappa Ganesan (JIRA)
Marappa Ganesan created BEAM-7935: - Summary: TypeError: can't pickle _cffi_backend.CDataGCP objects Key: BEAM-7935 URL: https://issues.apache.org/jira/browse/BEAM-7935 Project: Beam Issue

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291586=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291586 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291583=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291583 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291578=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291578 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291580=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291580 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291579=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291579 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7678) typehints with_output_types annotation doesn't work for stateful DoFn

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7678?focusedWorklogId=291575=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291575 ] ASF GitHub Bot logged work on BEAM-7678: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-7678) typehints with_output_types annotation doesn't work for stateful DoFn

2019-08-08 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-7678. --- Resolution: Fixed Fix Version/s: 2.16.0 > typehints with_output_types annotation doesn't work

[jira] [Assigned] (BEAM-7678) typehints with_output_types annotation doesn't work for stateful DoFn

2019-08-08 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-7678: - Assignee: Enrico Canzonieri > typehints with_output_types annotation doesn't work for stateful

[jira] [Created] (BEAM-7934) Dataflow Python SDK logging: step_id is always empty string

2019-08-08 Thread James Hutchison (JIRA)
James Hutchison created BEAM-7934: - Summary: Dataflow Python SDK logging: step_id is always empty string Key: BEAM-7934 URL: https://issues.apache.org/jira/browse/BEAM-7934 Project: Beam

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291561=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291561 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291560=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291560 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7820) Add hot key detection to Dataflow Runner

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7820?focusedWorklogId=291559=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291559 ] ASF GitHub Bot logged work on BEAM-7820: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291555=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291555 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291553=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291553 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291552=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291552 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291549=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291549 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291548=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291548 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291554=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291554 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Comment Edited] (BEAM-1251) Python 3 Support

2019-08-08 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890504#comment-16890504 ] Valentyn Tymofieiev edited comment on BEAM-1251 at 8/8/19 8:04 PM: ---

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291547=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291547 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291551=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291551 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291550=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291550 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7930) bundle_processor log spam using python SDK on dataflow runner

2019-08-08 Thread James Hutchison (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Hutchison updated BEAM-7930: -- Description: When running my pipeline on dataflow, I can see in the stackdriver logs a large

[jira] [Work logged] (BEAM-6907) Standardize Gradle projects/tasks structure for Python SDK

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6907?focusedWorklogId=291540=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291540 ] ASF GitHub Bot logged work on BEAM-6907: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291539=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291539 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7802) Expose a method to make an Avro-based PCollection into an Schema-based one

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7802?focusedWorklogId=291538=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291538 ] ASF GitHub Bot logged work on BEAM-7802: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7776) Implement Kubernetes setup/teardown code to gradle/jenkins tasks.

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7776?focusedWorklogId=291522=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291522 ] ASF GitHub Bot logged work on BEAM-7776: Author: ASF GitHub Bot

[jira] [Issue Comment Deleted] (BEAM-7931) Fix gradlew to allow offline builds

2019-08-08 Thread Daniel Gazineu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Gazineu updated BEAM-7931: - Comment: was deleted (was: This is an issue with the way Gradle Wrapper works 

[jira] [Resolved] (BEAM-7877) Change the log level when deleting unknown temporary files in FileBasedSink

2019-08-08 Thread Heejong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heejong Lee resolved BEAM-7877. --- Resolution: Fixed Fix Version/s: 2.15.0 > Change the log level when deleting unknown temporary

[jira] [Resolved] (BEAM-7744) LTS backport: Temporary directory for WriteOperation may not be unique in FileBaseSink

2019-08-08 Thread Heejong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heejong Lee resolved BEAM-7744. --- Resolution: Fixed > LTS backport: Temporary directory for WriteOperation may not be unique in >

[jira] [Resolved] (BEAM-6683) Add an integration test suite for cross-language transforms for Flink runner

2019-08-08 Thread Heejong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heejong Lee resolved BEAM-6683. --- Resolution: Fixed Fix Version/s: 2.15.0 > Add an integration test suite for cross-language

[jira] [Closed] (BEAM-7915) show cross-language validate runner Flink badge on github PR template

2019-08-08 Thread Heejong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heejong Lee closed BEAM-7915. - Resolution: Fixed Fix Version/s: Not applicable > show cross-language validate runner Flink badge

[jira] [Closed] (BEAM-7924) Failure in Python 2 postcommit: crossLanguagePythonJavaFlink

2019-08-08 Thread Heejong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7924?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Heejong Lee closed BEAM-7924. - Resolution: Fixed Fix Version/s: 2.15.0 > Failure in Python 2 postcommit:

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=291511=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291511 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7931) Fix gradlew to allow offline builds

2019-08-08 Thread Daniel Gazineu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903246#comment-16903246 ] Daniel Gazineu commented on BEAM-7931: -- This is an issue with the way Gradle Wrapper works 

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291507=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291507 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291506=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291506 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Closed] (BEAM-7675) Unify test suite configuration structure across Py2 and Py 3 suites

2019-08-08 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-7675. -- > Unify test suite configuration structure across Py2 and Py 3 suites >

[jira] [Work logged] (BEAM-7678) typehints with_output_types annotation doesn't work for stateful DoFn

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7678?focusedWorklogId=291504=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291504 ] ASF GitHub Bot logged work on BEAM-7678: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7932) GcsFileSystem should validate directories and file names for \n chars

2019-08-08 Thread Daniel Mills (JIRA)
Daniel Mills created BEAM-7932: -- Summary: GcsFileSystem should validate directories and file names for \n chars Key: BEAM-7932 URL: https://issues.apache.org/jira/browse/BEAM-7932 Project: Beam

[jira] [Created] (BEAM-7933) Adding timeout to JobServer grpc calls

2019-08-08 Thread Enrico Canzonieri (JIRA)
Enrico Canzonieri created BEAM-7933: --- Summary: Adding timeout to JobServer grpc calls Key: BEAM-7933 URL: https://issues.apache.org/jira/browse/BEAM-7933 Project: Beam Issue Type:

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291498=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291498 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6907) Standardize Gradle projects/tasks structure for Python SDK

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6907?focusedWorklogId=291496=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291496 ] ASF GitHub Bot logged work on BEAM-6907: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6907) Standardize Gradle projects/tasks structure for Python SDK

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6907?focusedWorklogId=291497=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291497 ] ASF GitHub Bot logged work on BEAM-6907: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7861) Make it easy to change multi-process and multi-thread mode for Python Direct runners

2019-08-08 Thread Hannah Jiang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hannah Jiang updated BEAM-7861: --- Status: Open (was: Triage Needed) > Make it easy to change multi-process and multi-thread mode for

[jira] [Updated] (BEAM-7861) Make it easy to change between multi-process and multi-thread mode for Python Direct runners

2019-08-08 Thread Hannah Jiang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hannah Jiang updated BEAM-7861: --- Summary: Make it easy to change between multi-process and multi-thread mode for Python Direct runners

[jira] [Updated] (BEAM-7888) Test Multi Process Direct Runner With Largish Data

2019-08-08 Thread Hannah Jiang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hannah Jiang updated BEAM-7888: --- Status: Open (was: Triage Needed) > Test Multi Process Direct Runner With Largish Data >

[jira] [Updated] (BEAM-7861) Make it easy to change multi-process and multi-thread mode for Python Direct runners

2019-08-08 Thread Hannah Jiang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7861?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hannah Jiang updated BEAM-7861: --- Issue Type: Sub-task (was: Improvement) Parent: BEAM-3645 > Make it easy to change

[jira] [Updated] (BEAM-7888) Test Multi Process Direct Runner With Largish Data

2019-08-08 Thread Hannah Jiang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hannah Jiang updated BEAM-7888: --- Issue Type: Sub-task (was: Bug) Parent: BEAM-3645 > Test Multi Process Direct Runner With

[jira] [Work logged] (BEAM-6907) Standardize Gradle projects/tasks structure for Python SDK

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6907?focusedWorklogId=291494=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291494 ] ASF GitHub Bot logged work on BEAM-6907: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6907) Standardize Gradle projects/tasks structure for Python SDK

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6907?focusedWorklogId=291493=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291493 ] ASF GitHub Bot logged work on BEAM-6907: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291489=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291489 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-7836) Provide a way to exclude unit / integration tests with incompatible syntax from running under particular version of Python.

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-7836. - Resolution: Fixed Fix Version/s: Not applicable > Provide a way to exclude unit / integration

[jira] [Commented] (BEAM-7836) Provide a way to exclude unit / integration tests with incompatible syntax from running under particular version of Python.

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903209#comment-16903209 ] Udi Meiri commented on BEAM-7836: - The spotless and other Gradle task breakages were fixed as a part of

[jira] [Updated] (BEAM-7523) Add a server for KafkaTable Integration Test

2019-08-08 Thread Alireza Samadianzakaria (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alireza Samadianzakaria updated BEAM-7523: -- Description: We need a server for Kafka Integration test and after setting it

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291482=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291482 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291483=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291483 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Assigned] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread Alireza Samadianzakaria (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alireza Samadianzakaria reassigned BEAM-7896: - Assignee: Alireza Samadianzakaria > Rate estimation for Kafka Table >

[jira] [Resolved] (BEAM-7898) Remove Default Implementation of getStatistics for Tables

2019-08-08 Thread Alireza Samadianzakaria (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alireza Samadianzakaria resolved BEAM-7898. --- Resolution: Fixed Fix Version/s: Not applicable > Remove Default

[jira] [Resolved] (BEAM-7777) Stream Cost Model and RelNode Cost Estimation

2019-08-08 Thread Alireza Samadianzakaria (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alireza Samadianzakaria resolved BEAM-. --- Resolution: Implemented Fix Version/s: Not applicable > Stream Cost

[jira] [Updated] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread Alireza Samadianzakaria (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alireza Samadianzakaria updated BEAM-7896: -- Status: Open (was: Triage Needed) > Rate estimation for Kafka Table >

[jira] [Reopened] (BEAM-7608) v1new ReadFromDatastore skips entities

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reopened BEAM-7608: - reopening to get included in 2.15 > v1new ReadFromDatastore skips entities >

[jira] [Reopened] (BEAM-7828) Add key type conversion in from and to client entity in Datastore v1new IO.

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reopened BEAM-7828: - Reopening to get cherrypicked on 2.15 > Add key type conversion in from and to client entity in Datastore

[jira] [Updated] (BEAM-7828) Add key type conversion in from and to client entity in Datastore v1new IO.

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7828: Fix Version/s: (was: 2.16.0) 2.15.0 > Add key type conversion in from and to client

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291478=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291478 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291479=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291479 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Comment Edited] (BEAM-7929) ParquetTable.buildIOReader should support column projection and filter predicate

2019-08-08 Thread Rui Wang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903192#comment-16903192 ] Rui Wang edited comment on BEAM-7929 at 8/8/19 6:01 PM: Calcite has well support

[jira] [Commented] (BEAM-7929) ParquetTable.buildIOReader should support column projection and filter predicate

2019-08-08 Thread Rui Wang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903192#comment-16903192 ] Rui Wang commented on BEAM-7929: Calcite has well support on filter/pushdown so we don't need to analyzing

[jira] [Closed] (BEAM-2103) Document Python 3 support in Beam starting from 2.14.0

2019-08-08 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev closed BEAM-2103. - Resolution: Fixed Fix Version/s: Not applicable > Document Python 3 support in

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291470=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291470 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291473=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291473 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291472=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291472 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291475=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291475 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291471=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291471 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291469=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291469 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291474=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291474 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291476=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291476 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7930) bundle_processor log spam using python SDK on dataflow runner

2019-08-08 Thread James Hutchison (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903189#comment-16903189 ] James Hutchison commented on BEAM-7930: --- If this isn't already a known issue I can try to provide

[jira] [Reopened] (BEAM-7476) Datastore write failures with "[Errno 32] Broken pipe"

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reopened BEAM-7476: - reopening so it gets cherrypicked onto 2.15 > Datastore write failures with "[Errno 32] Broken pipe" >

[jira] [Updated] (BEAM-7476) Datastore write failures with "[Errno 32] Broken pipe"

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7476: Status: Open (was: Triage Needed) > Datastore write failures with "[Errno 32] Broken pipe" >

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291466=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291466 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7476) Datastore write failures with "[Errno 32] Broken pipe"

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7476: Fix Version/s: (was: 2.16.0) 2.15.0 > Datastore write failures with "[Errno 32]

[jira] [Resolved] (BEAM-7476) Datastore write failures with "[Errno 32] Broken pipe"

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-7476. - Resolution: Fixed Fix Version/s: 2.16.0 > Datastore write failures with "[Errno 32] Broken pipe" >

[jira] [Work logged] (BEAM-7917) Python datastore v1new fails on retry

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7917?focusedWorklogId=291460=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291460 ] ASF GitHub Bot logged work on BEAM-7917: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7820) Add hot key detection to Dataflow Runner

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7820?focusedWorklogId=291459=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291459 ] ASF GitHub Bot logged work on BEAM-7820: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7917) Python datastore v1new fails on retry

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7917?focusedWorklogId=291457=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291457 ] ASF GitHub Bot logged work on BEAM-7917: Author: ASF GitHub Bot

  1   2   >