[jira] [Work logged] (BEAM-6858) Support side inputs injected into a DoFn

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6858?focusedWorklogId=291043=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291043 ] ASF GitHub Bot logged work on BEAM-6858: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6858) Support side inputs injected into a DoFn

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6858?focusedWorklogId=291045=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291045 ] ASF GitHub Bot logged work on BEAM-6858: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6858) Support side inputs injected into a DoFn

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6858?focusedWorklogId=291044=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291044 ] ASF GitHub Bot logged work on BEAM-6858: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6858) Support side inputs injected into a DoFn

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6858?focusedWorklogId=291042=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291042 ] ASF GitHub Bot logged work on BEAM-6858: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6858) Support side inputs injected into a DoFn

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6858?focusedWorklogId=291046=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291046 ] ASF GitHub Bot logged work on BEAM-6858: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7060) Design Py3-compatible typehints annotation support in Beam 3.

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7060?focusedWorklogId=291026=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291026 ] ASF GitHub Bot logged work on BEAM-7060: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7917) Python datastore v1new fails on retry

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7917?focusedWorklogId=291002=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291002 ] ASF GitHub Bot logged work on BEAM-7917: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7917) Python datastore v1new fails on retry

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7917?focusedWorklogId=291024=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291024 ] ASF GitHub Bot logged work on BEAM-7917: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7476) Datastore write failures with "[Errno 32] Broken pipe"

2019-08-08 Thread Dmytro Sadovnychyi (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902727#comment-16902727 ] Dmytro Sadovnychyi commented on BEAM-7476: -- Can confirm that issue is gone in datastore.v1new,

[jira] [Work logged] (BEAM-6855) Side inputs are not supported when using the state API

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6855?focusedWorklogId=291064=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291064 ] ASF GitHub Bot logged work on BEAM-6855: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7776) Implement Kubernetes setup/teardown code to gradle/jenkins tasks.

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7776?focusedWorklogId=291090=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291090 ] ASF GitHub Bot logged work on BEAM-7776: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=291377=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291377 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=291399=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291399 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=291397=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291397 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=291398=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291398 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291421=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291421 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7931) Fix gradlew to allow offline builds

2019-08-08 Thread Chad Dombrova (JIRA)
Chad Dombrova created BEAM-7931: --- Summary: Fix gradlew to allow offline builds Key: BEAM-7931 URL: https://issues.apache.org/jira/browse/BEAM-7931 Project: Beam Issue Type: Improvement

[jira] [Work logged] (BEAM-7874) FnApi only supports up to 10 workers

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7874?focusedWorklogId=291422=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291422 ] ASF GitHub Bot logged work on BEAM-7874: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7476) Datastore write failures with "[Errno 32] Broken pipe"

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7476: Status: Open (was: Triage Needed) > Datastore write failures with "[Errno 32] Broken pipe" >

[jira] [Reopened] (BEAM-7476) Datastore write failures with "[Errno 32] Broken pipe"

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reopened BEAM-7476: - reopening so it gets cherrypicked onto 2.15 > Datastore write failures with "[Errno 32] Broken pipe" >

[jira] [Work logged] (BEAM-7613) HadoopFileSystem can be only used with fs.defaultFS

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7613?focusedWorklogId=291306=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291306 ] ASF GitHub Bot logged work on BEAM-7613: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-7741) Add SetState in Python sdk

2019-08-08 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw resolved BEAM-7741. --- Resolution: Fixed Fix Version/s: 2.16.0 > Add SetState in Python sdk >

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291324=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291324 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291321=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291321 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291326=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291326 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291320=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291320 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291325=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291325 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291322=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291322 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291323=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291323 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6907) Standardize Gradle projects/tasks structure for Python SDK

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6907?focusedWorklogId=291352=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291352 ] ASF GitHub Bot logged work on BEAM-6907: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7912) Optimize GroupIntoBatches for batch Dataflow pipelines

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7912?focusedWorklogId=291391=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291391 ] ASF GitHub Bot logged work on BEAM-7912: Author: ASF GitHub Bot

[jira] [Comment Edited] (BEAM-3645) Support multi-process execution on the FnApiRunner

2019-08-08 Thread Hannah Jiang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16896575#comment-16896575 ] Hannah Jiang edited comment on BEAM-3645 at 8/8/19 4:48 PM: Direct runner can

[jira] [Commented] (BEAM-7929) ParquetTable.buildIOReader should support column projection and filter predicate

2019-08-08 Thread Rui Wang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903156#comment-16903156 ] Rui Wang commented on BEAM-7929: This is an awesome feature! > ParquetTable.buildIOReader should support

[jira] [Commented] (BEAM-7929) ParquetTable.buildIOReader should support column projection and filter predicate

2019-08-08 Thread Neville Li (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903164#comment-16903164 ] Neville Li commented on BEAM-7929: -- For column projection, {{BeamSqlTable}} already has potentially user

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=291396=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291396 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6907) Standardize Gradle projects/tasks structure for Python SDK

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6907?focusedWorklogId=291418=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291418 ] ASF GitHub Bot logged work on BEAM-6907: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6907) Standardize Gradle projects/tasks structure for Python SDK

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6907?focusedWorklogId=291420=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291420 ] ASF GitHub Bot logged work on BEAM-6907: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-7476) Datastore write failures with "[Errno 32] Broken pipe"

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-7476. - Resolution: Fixed Fix Version/s: 2.16.0 > Datastore write failures with "[Errno 32] Broken pipe" >

[jira] [Work logged] (BEAM-7917) Python datastore v1new fails on retry

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7917?focusedWorklogId=291460=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291460 ] ASF GitHub Bot logged work on BEAM-7917: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7613) HadoopFileSystem can be only used with fs.defaultFS

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7613?focusedWorklogId=291303=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291303 ] ASF GitHub Bot logged work on BEAM-7613: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7613) HadoopFileSystem can be only used with fs.defaultFS

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7613?focusedWorklogId=291382=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291382 ] ASF GitHub Bot logged work on BEAM-7613: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7495) Add support for dynamic worker re-balancing when reading BigQuery data using Cloud Dataflow

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7495?focusedWorklogId=291424=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291424 ] ASF GitHub Bot logged work on BEAM-7495: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6907) Standardize Gradle projects/tasks structure for Python SDK

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6907?focusedWorklogId=291438=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291438 ] ASF GitHub Bot logged work on BEAM-6907: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7917) Python datastore v1new fails on retry

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903180#comment-16903180 ] Udi Meiri commented on BEAM-7917: - It seems that commit() always marks the batch as finished, which is

[jira] [Updated] (BEAM-7476) Datastore write failures with "[Errno 32] Broken pipe"

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7476: Fix Version/s: (was: 2.16.0) 2.15.0 > Datastore write failures with "[Errno 32]

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291466=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291466 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7930) bundle_processor log spam using python SDK on dataflow runner

2019-08-08 Thread James Hutchison (JIRA)
James Hutchison created BEAM-7930: - Summary: bundle_processor log spam using python SDK on dataflow runner Key: BEAM-7930 URL: https://issues.apache.org/jira/browse/BEAM-7930 Project: Beam

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291439=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291439 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7924) Failure in Python 2 postcommit: crossLanguagePythonJavaFlink

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7924?focusedWorklogId=291440=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291440 ] ASF GitHub Bot logged work on BEAM-7924: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7917) Python datastore v1new fails on retry

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7917?focusedWorklogId=291457=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291457 ] ASF GitHub Bot logged work on BEAM-7917: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7820) Add hot key detection to Dataflow Runner

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7820?focusedWorklogId=291459=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291459 ] ASF GitHub Bot logged work on BEAM-7820: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7820) Add hot key detection to Dataflow Runner

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7820?focusedWorklogId=291458=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291458 ] ASF GitHub Bot logged work on BEAM-7820: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5878) Support DoFns with Keyword-only arguments in Python 3.

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5878?focusedWorklogId=291349=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291349 ] ASF GitHub Bot logged work on BEAM-5878: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7776) Implement Kubernetes setup/teardown code to gradle/jenkins tasks.

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7776?focusedWorklogId=291372=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291372 ] ASF GitHub Bot logged work on BEAM-7776: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7929) ParquetTable.buildIOReader should support column projection and filter predicate

2019-08-08 Thread Rui Wang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated BEAM-7929: --- Priority: Critical (was: Major) > ParquetTable.buildIOReader should support column projection and filter >

[jira] [Comment Edited] (BEAM-7929) ParquetTable.buildIOReader should support column projection and filter predicate

2019-08-08 Thread Rui Wang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903156#comment-16903156 ] Rui Wang edited comment on BEAM-7929 at 8/8/19 5:10 PM: This is an awesome feature

[jira] [Updated] (BEAM-7929) ParquetTable.buildIOReader should support column projection and filter predicate

2019-08-08 Thread Rui Wang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated BEAM-7929: --- Issue Type: New Feature (was: Improvement) > ParquetTable.buildIOReader should support column projection and

[jira] [Updated] (BEAM-7921) Add Schema support for Tensorflow

2019-08-08 Thread Neville Li (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neville Li updated BEAM-7921: - Description: Similar to BEAM-5807, Tensorflow's defacto storage format is {{TFRecord}} files with

[jira] [Created] (BEAM-7929) ParquetTable.buildIOReader should support column projection and filter predicate

2019-08-08 Thread Neville Li (JIRA)
Neville Li created BEAM-7929: Summary: ParquetTable.buildIOReader should support column projection and filter predicate Key: BEAM-7929 URL: https://issues.apache.org/jira/browse/BEAM-7929 Project: Beam

[jira] [Resolved] (BEAM-7613) HadoopFileSystem can be only used with fs.defaultFS

2019-08-08 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-7613. - Resolution: Fixed Fix Version/s: 2.16.0 > HadoopFileSystem can be only used with fs.defaultFS >

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291430=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291430 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291431=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291431 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6907) Standardize Gradle projects/tasks structure for Python SDK

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6907?focusedWorklogId=291433=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291433 ] ASF GitHub Bot logged work on BEAM-6907: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7930) bundle_processor log spam using python SDK on dataflow runner

2019-08-08 Thread James Hutchison (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903189#comment-16903189 ] James Hutchison commented on BEAM-7930: --- If this isn't already a known issue I can try to provide

[jira] [Reopened] (BEAM-7608) v1new ReadFromDatastore skips entities

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reopened BEAM-7608: - reopening to get included in 2.15 > v1new ReadFromDatastore skips entities >

[jira] [Updated] (BEAM-7523) Add a server for KafkaTable Integration Test

2019-08-08 Thread Alireza Samadianzakaria (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alireza Samadianzakaria updated BEAM-7523: -- Description: We need a server for Kafka Integration test and after setting it

[jira] [Updated] (BEAM-7888) Test Multi Process Direct Runner With Largish Data

2019-08-08 Thread Hannah Jiang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7888?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hannah Jiang updated BEAM-7888: --- Issue Type: Sub-task (was: Bug) Parent: BEAM-3645 > Test Multi Process Direct Runner With

[jira] [Closed] (BEAM-7675) Unify test suite configuration structure across Py2 and Py 3 suites

2019-08-08 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu closed BEAM-7675. -- > Unify test suite configuration structure across Py2 and Py 3 suites >

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291506=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291506 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7820) Add hot key detection to Dataflow Runner

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7820?focusedWorklogId=291559=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291559 ] ASF GitHub Bot logged work on BEAM-7820: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7934) Dataflow Python SDK logging: step_id is always empty string

2019-08-08 Thread James Hutchison (JIRA)
James Hutchison created BEAM-7934: - Summary: Dataflow Python SDK logging: step_id is always empty string Key: BEAM-7934 URL: https://issues.apache.org/jira/browse/BEAM-7934 Project: Beam

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291583=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291583 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291472=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291472 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291470=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291470 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291473=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291473 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Closed] (BEAM-2103) Document Python 3 support in Beam starting from 2.14.0

2019-08-08 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2103?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev closed BEAM-2103. - Resolution: Fixed Fix Version/s: Not applicable > Document Python 3 support in

[jira] [Commented] (BEAM-7929) ParquetTable.buildIOReader should support column projection and filter predicate

2019-08-08 Thread Rui Wang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903192#comment-16903192 ] Rui Wang commented on BEAM-7929: Calcite has well support on filter/pushdown so we don't need to analyzing

[jira] [Work logged] (BEAM-6907) Standardize Gradle projects/tasks structure for Python SDK

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6907?focusedWorklogId=291493=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291493 ] ASF GitHub Bot logged work on BEAM-6907: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7776) Implement Kubernetes setup/teardown code to gradle/jenkins tasks.

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7776?focusedWorklogId=291522=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291522 ] ASF GitHub Bot logged work on BEAM-7776: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7802) Expose a method to make an Avro-based PCollection into an Schema-based one

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7802?focusedWorklogId=291538=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291538 ] ASF GitHub Bot logged work on BEAM-7802: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7930) bundle_processor log spam using python SDK on dataflow runner

2019-08-08 Thread James Hutchison (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Hutchison updated BEAM-7930: -- Description: When running my pipeline on dataflow, I can see in the stackdriver logs a large

[jira] [Resolved] (BEAM-7678) typehints with_output_types annotation doesn't work for stateful DoFn

2019-08-08 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay resolved BEAM-7678. --- Resolution: Fixed Fix Version/s: 2.16.0 > typehints with_output_types annotation doesn't work

[jira] [Assigned] (BEAM-7678) typehints with_output_types annotation doesn't work for stateful DoFn

2019-08-08 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay reassigned BEAM-7678: - Assignee: Enrico Canzonieri > typehints with_output_types annotation doesn't work for stateful

[jira] [Created] (BEAM-7935) TypeError: can't pickle _cffi_backend.CDataGCP objects

2019-08-08 Thread Marappa Ganesan (JIRA)
Marappa Ganesan created BEAM-7935: - Summary: TypeError: can't pickle _cffi_backend.CDataGCP objects Key: BEAM-7935 URL: https://issues.apache.org/jira/browse/BEAM-7935 Project: Beam Issue

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291482=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291482 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291483=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291483 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291489=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291489 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=291511=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291511 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6907) Standardize Gradle projects/tasks structure for Python SDK

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6907?focusedWorklogId=291540=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291540 ] ASF GitHub Bot logged work on BEAM-6907: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291561=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291561 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?focusedWorklogId=291586=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291586 ] ASF GitHub Bot logged work on BEAM-7896: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291476=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291476 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291471=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291471 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291469=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291469 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291474=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291474 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291475=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291475 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-7898) Remove Default Implementation of getStatistics for Tables

2019-08-08 Thread Alireza Samadianzakaria (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alireza Samadianzakaria resolved BEAM-7898. --- Resolution: Fixed Fix Version/s: Not applicable > Remove Default

[jira] [Assigned] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread Alireza Samadianzakaria (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alireza Samadianzakaria reassigned BEAM-7896: - Assignee: Alireza Samadianzakaria > Rate estimation for Kafka Table >

[jira] [Updated] (BEAM-7896) Rate estimation for Kafka Table

2019-08-08 Thread Alireza Samadianzakaria (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alireza Samadianzakaria updated BEAM-7896: -- Status: Open (was: Triage Needed) > Rate estimation for Kafka Table >

[jira] [Resolved] (BEAM-7777) Stream Cost Model and RelNode Cost Estimation

2019-08-08 Thread Alireza Samadianzakaria (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alireza Samadianzakaria resolved BEAM-. --- Resolution: Implemented Fix Version/s: Not applicable > Stream Cost

  1   2   >