[jira] [Work logged] (BEAM-6858) Support side inputs injected into a DoFn

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6858?focusedWorklogId=291043&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291043 ] ASF GitHub Bot logged work on BEAM-6858: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6858) Support side inputs injected into a DoFn

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6858?focusedWorklogId=291045&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291045 ] ASF GitHub Bot logged work on BEAM-6858: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6858) Support side inputs injected into a DoFn

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6858?focusedWorklogId=291044&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291044 ] ASF GitHub Bot logged work on BEAM-6858: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6858) Support side inputs injected into a DoFn

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6858?focusedWorklogId=291042&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291042 ] ASF GitHub Bot logged work on BEAM-6858: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6858) Support side inputs injected into a DoFn

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6858?focusedWorklogId=291046&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291046 ] ASF GitHub Bot logged work on BEAM-6858: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6855) Side inputs are not supported when using the state API

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6855?focusedWorklogId=291064&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291064 ] ASF GitHub Bot logged work on BEAM-6855: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7776) Implement Kubernetes setup/teardown code to gradle/jenkins tasks.

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7776?focusedWorklogId=291090&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291090 ] ASF GitHub Bot logged work on BEAM-7776: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6855) Side inputs are not supported when using the state API

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6855?focusedWorklogId=291108&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291108 ] ASF GitHub Bot logged work on BEAM-6855: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7721) Measure throughput in BigQueryIO read in Java

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7721?focusedWorklogId=291133&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291133 ] ASF GitHub Bot logged work on BEAM-7721: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7721) Measure throughput in BigQueryIO read in Java

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7721?focusedWorklogId=291132&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291132 ] ASF GitHub Bot logged work on BEAM-7721: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7874) FnApi only supports up to 10 workers

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7874?focusedWorklogId=291153&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291153 ] ASF GitHub Bot logged work on BEAM-7874: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6855) Side inputs are not supported when using the state API

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6855?focusedWorklogId=291154&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291154 ] ASF GitHub Bot logged work on BEAM-6855: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6855) Side inputs are not supported when using the state API

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6855?focusedWorklogId=291156&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291156 ] ASF GitHub Bot logged work on BEAM-6855: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6855) Side inputs are not supported when using the state API

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6855?focusedWorklogId=291155&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291155 ] ASF GitHub Bot logged work on BEAM-6855: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6855) Side inputs are not supported when using the state API

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6855?focusedWorklogId=291157&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291157 ] ASF GitHub Bot logged work on BEAM-6855: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7874) FnApi only supports up to 10 workers

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7874?focusedWorklogId=291158&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291158 ] ASF GitHub Bot logged work on BEAM-7874: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6855) Side inputs are not supported when using the state API

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6855?focusedWorklogId=291171&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291171 ] ASF GitHub Bot logged work on BEAM-6855: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6855) Side inputs are not supported when using the state API

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6855?focusedWorklogId=291175&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291175 ] ASF GitHub Bot logged work on BEAM-6855: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6855) Side inputs are not supported when using the state API

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6855?focusedWorklogId=291181&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291181 ] ASF GitHub Bot logged work on BEAM-6855: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6855) Side inputs are not supported when using the state API

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6855?focusedWorklogId=291183&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291183 ] ASF GitHub Bot logged work on BEAM-6855: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6855) Side inputs are not supported when using the state API

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6855?focusedWorklogId=291182&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291182 ] ASF GitHub Bot logged work on BEAM-6855: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7916) Add ElasticsearchIO query parameter to take a ValueProvider

2019-08-08 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-7916: --- Summary: Add ElasticsearchIO query parameter to take a ValueProvider (was: Change Elasticsear

[jira] [Work logged] (BEAM-7916) Add ElasticsearchIO query parameter to take a ValueProvider

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7916?focusedWorklogId=291212&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291212 ] ASF GitHub Bot logged work on BEAM-7916: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5980) Add load tests for Core Apache Beam opertaions

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5980?focusedWorklogId=291214&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291214 ] ASF GitHub Bot logged work on BEAM-5980: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7916) Add ElasticsearchIO query parameter to take a ValueProvider

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7916?focusedWorklogId=291215&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291215 ] ASF GitHub Bot logged work on BEAM-7916: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7916) Add ElasticsearchIO query parameter to take a ValueProvider

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7916?focusedWorklogId=291216&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291216 ] ASF GitHub Bot logged work on BEAM-7916: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7916) Add ElasticsearchIO query parameter to take a ValueProvider

2019-08-08 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko updated BEAM-7916: --- Status: Open (was: Triage Needed) > Add ElasticsearchIO query parameter to take a ValueProvid

[jira] [Resolved] (BEAM-7916) Add ElasticsearchIO query parameter to take a ValueProvider

2019-08-08 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko resolved BEAM-7916. Resolution: Fixed Fix Version/s: 2.16.0 A small note - new method {{Read.withQuery(Va

[jira] [Work logged] (BEAM-7776) Implement Kubernetes setup/teardown code to gradle/jenkins tasks.

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7776?focusedWorklogId=291234&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291234 ] ASF GitHub Bot logged work on BEAM-7776: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=291235&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291235 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=291238&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291238 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=291239&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291239 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4775) JobService should support returning metrics

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4775?focusedWorklogId=291244&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291244 ] ASF GitHub Bot logged work on BEAM-4775: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7776) Implement Kubernetes setup/teardown code to gradle/jenkins tasks.

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7776?focusedWorklogId=291246&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291246 ] ASF GitHub Bot logged work on BEAM-7776: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4775) JobService should support returning metrics

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4775?focusedWorklogId=291252&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291252 ] ASF GitHub Bot logged work on BEAM-4775: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7730) Add Flink 1.9 build target and Make FlinkRunner compatible with Flink 1.9

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7730?focusedWorklogId=291255&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291255 ] ASF GitHub Bot logged work on BEAM-7730: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-6766) Sort Merge Bucket Join support in Beam

2019-08-08 Thread Neville Li (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neville Li updated BEAM-6766: - Description: Design doc: https://docs.google.com/document/d/1AQlonN8t4YJrARcWzepyP7mWHTxHAd6WIECwk1s3LQQ/

[jira] [Work logged] (BEAM-7721) Measure throughput in BigQueryIO read in Java

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7721?focusedWorklogId=291259&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291259 ] ASF GitHub Bot logged work on BEAM-7721: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7776) Implement Kubernetes setup/teardown code to gradle/jenkins tasks.

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7776?focusedWorklogId=291260&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291260 ] ASF GitHub Bot logged work on BEAM-7776: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-4775) JobService should support returning metrics

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4775?focusedWorklogId=291263&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291263 ] ASF GitHub Bot logged work on BEAM-4775: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-7755) BigQuery Repeated Records do not seem to work

2019-08-08 Thread Sahith Nallapareddy (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7755?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sahith Nallapareddy resolved BEAM-7755. --- Resolution: Fixed Fix Version/s: 2.15.0 > BigQuery Repeated Records do not seem

[jira] [Created] (BEAM-7928) Being able to specify disk type and disk size

2019-08-08 Thread Thomas (JIRA)
Thomas created BEAM-7928: Summary: Being able to specify disk type and disk size Key: BEAM-7928 URL: https://issues.apache.org/jira/browse/BEAM-7928 Project: Beam Issue Type: New Feature Co

[jira] [Work logged] (BEAM-7613) HadoopFileSystem can be only used with fs.defaultFS

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7613?focusedWorklogId=291303&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291303 ] ASF GitHub Bot logged work on BEAM-7613: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7613) HadoopFileSystem can be only used with fs.defaultFS

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7613?focusedWorklogId=291306&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291306 ] ASF GitHub Bot logged work on BEAM-7613: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7741) Add SetState in Python sdk

2019-08-08 Thread Rakesh Kumar (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903044#comment-16903044 ] Rakesh Kumar commented on BEAM-7741: [~robertwb] can we resolve this ticket since PR i

[jira] [Resolved] (BEAM-7741) Add SetState in Python sdk

2019-08-08 Thread Robert Bradshaw (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Bradshaw resolved BEAM-7741. --- Resolution: Fixed Fix Version/s: 2.16.0 > Add SetState in Python sdk >

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291324&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291324 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291321&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291321 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291326&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291326 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291320&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291320 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291325&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291325 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291322&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291322 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291323&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291323 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5878) Support DoFns with Keyword-only arguments in Python 3.

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5878?focusedWorklogId=291349&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291349 ] ASF GitHub Bot logged work on BEAM-5878: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6907) Standardize Gradle projects/tasks structure for Python SDK

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6907?focusedWorklogId=291352&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291352 ] ASF GitHub Bot logged work on BEAM-6907: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7921) Add Schema support for Tensorflow

2019-08-08 Thread Neville Li (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neville Li updated BEAM-7921: - Description: Similar to BEAM-5807, Tensorflow's defacto storage format is {{TFRecord}} files with {{Examp

[jira] [Updated] (BEAM-7920) AvroTableProvider

2019-08-08 Thread Neville Li (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neville Li updated BEAM-7920: - Description: https://github.com/apache/beam/pull/6777 and BEAM-5807 mentioned {{AvroTableProvider}} but I

[jira] [Created] (BEAM-7929) ParquetTable.buildIOReader should support column projection and filter predicate

2019-08-08 Thread Neville Li (JIRA)
Neville Li created BEAM-7929: Summary: ParquetTable.buildIOReader should support column projection and filter predicate Key: BEAM-7929 URL: https://issues.apache.org/jira/browse/BEAM-7929 Project: Beam

[jira] [Work logged] (BEAM-7776) Implement Kubernetes setup/teardown code to gradle/jenkins tasks.

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7776?focusedWorklogId=291372&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291372 ] ASF GitHub Bot logged work on BEAM-7776: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=291377&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291377 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7613) HadoopFileSystem can be only used with fs.defaultFS

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7613?focusedWorklogId=291382&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291382 ] ASF GitHub Bot logged work on BEAM-7613: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7930) bundle_processor log spam using python SDK on dataflow runner

2019-08-08 Thread James Hutchison (JIRA)
James Hutchison created BEAM-7930: - Summary: bundle_processor log spam using python SDK on dataflow runner Key: BEAM-7930 URL: https://issues.apache.org/jira/browse/BEAM-7930 Project: Beam I

[jira] [Work logged] (BEAM-7912) Optimize GroupIntoBatches for batch Dataflow pipelines

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7912?focusedWorklogId=291391&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291391 ] ASF GitHub Bot logged work on BEAM-7912: Author: ASF GitHub Bot

[jira] [Comment Edited] (BEAM-3645) Support multi-process execution on the FnApiRunner

2019-08-08 Thread Hannah Jiang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3645?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16896575#comment-16896575 ] Hannah Jiang edited comment on BEAM-3645 at 8/8/19 4:48 PM: Di

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=291396&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291396 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=291398&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291398 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=291399&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291399 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7819) PubsubMessage message parsing is lacking non-attribute fields

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7819?focusedWorklogId=291397&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291397 ] ASF GitHub Bot logged work on BEAM-7819: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7613) HadoopFileSystem can be only used with fs.defaultFS

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7613?focusedWorklogId=291408&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291408 ] ASF GitHub Bot logged work on BEAM-7613: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-7613) HadoopFileSystem can be only used with fs.defaultFS

2019-08-08 Thread Luke Cwik (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-7613. - Resolution: Fixed Fix Version/s: 2.16.0 > HadoopFileSystem can be only used with fs.defaultFS > ---

[jira] [Commented] (BEAM-7929) ParquetTable.buildIOReader should support column projection and filter predicate

2019-08-08 Thread Rui Wang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903156#comment-16903156 ] Rui Wang commented on BEAM-7929: This is an awesome feature! > ParquetTable.buildIOReade

[jira] [Updated] (BEAM-7929) ParquetTable.buildIOReader should support column projection and filter predicate

2019-08-08 Thread Rui Wang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated BEAM-7929: --- Issue Type: New Feature (was: Improvement) > ParquetTable.buildIOReader should support column projection and

[jira] [Comment Edited] (BEAM-7929) ParquetTable.buildIOReader should support column projection and filter predicate

2019-08-08 Thread Rui Wang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903156#comment-16903156 ] Rui Wang edited comment on BEAM-7929 at 8/8/19 5:10 PM: This is an

[jira] [Updated] (BEAM-7929) ParquetTable.buildIOReader should support column projection and filter predicate

2019-08-08 Thread Rui Wang (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang updated BEAM-7929: --- Priority: Critical (was: Major) > ParquetTable.buildIOReader should support column projection and filter > p

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291419&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291419 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6907) Standardize Gradle projects/tasks structure for Python SDK

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6907?focusedWorklogId=291418&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291418 ] ASF GitHub Bot logged work on BEAM-6907: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6907) Standardize Gradle projects/tasks structure for Python SDK

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6907?focusedWorklogId=291420&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291420 ] ASF GitHub Bot logged work on BEAM-6907: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291421&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291421 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7931) Fix gradlew to allow offline builds

2019-08-08 Thread Chad Dombrova (JIRA)
Chad Dombrova created BEAM-7931: --- Summary: Fix gradlew to allow offline builds Key: BEAM-7931 URL: https://issues.apache.org/jira/browse/BEAM-7931 Project: Beam Issue Type: Improvement

[jira] [Work logged] (BEAM-7874) FnApi only supports up to 10 workers

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7874?focusedWorklogId=291422&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291422 ] ASF GitHub Bot logged work on BEAM-7874: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7929) ParquetTable.buildIOReader should support column projection and filter predicate

2019-08-08 Thread Neville Li (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903164#comment-16903164 ] Neville Li commented on BEAM-7929: -- For column projection, {{BeamSqlTable}} already has p

[jira] [Work logged] (BEAM-7495) Add support for dynamic worker re-balancing when reading BigQuery data using Cloud Dataflow

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7495?focusedWorklogId=291424&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291424 ] ASF GitHub Bot logged work on BEAM-7495: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291427&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291427 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291430&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291430 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7389) Colab examples for element-wise transforms (Python)

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7389?focusedWorklogId=291431&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291431 ] ASF GitHub Bot logged work on BEAM-7389: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6907) Standardize Gradle projects/tasks structure for Python SDK

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6907?focusedWorklogId=291433&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291433 ] ASF GitHub Bot logged work on BEAM-6907: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6907) Standardize Gradle projects/tasks structure for Python SDK

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6907?focusedWorklogId=291434&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291434 ] ASF GitHub Bot logged work on BEAM-6907: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6907) Standardize Gradle projects/tasks structure for Python SDK

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6907?focusedWorklogId=291438&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291438 ] ASF GitHub Bot logged work on BEAM-6907: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291439&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291439 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7924) Failure in Python 2 postcommit: crossLanguagePythonJavaFlink

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7924?focusedWorklogId=291440&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291440 ] ASF GitHub Bot logged work on BEAM-7924: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7917) Python datastore v1new fails on retry

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16903180#comment-16903180 ] Udi Meiri commented on BEAM-7917: - It seems that commit() always marks the batch as finish

[jira] [Work logged] (BEAM-7820) Add hot key detection to Dataflow Runner

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7820?focusedWorklogId=291458&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291458 ] ASF GitHub Bot logged work on BEAM-7820: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7917) Python datastore v1new fails on retry

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7917?focusedWorklogId=291457&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291457 ] ASF GitHub Bot logged work on BEAM-7917: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7820) Add hot key detection to Dataflow Runner

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7820?focusedWorklogId=291459&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291459 ] ASF GitHub Bot logged work on BEAM-7820: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7917) Python datastore v1new fails on retry

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7917?focusedWorklogId=291460&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291460 ] ASF GitHub Bot logged work on BEAM-7917: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-7476) Datastore write failures with "[Errno 32] Broken pipe"

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-7476. - Resolution: Fixed Fix Version/s: 2.16.0 > Datastore write failures with "[Errno 32] Broken pipe" >

[jira] [Updated] (BEAM-7476) Datastore write failures with "[Errno 32] Broken pipe"

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7476: Fix Version/s: (was: 2.16.0) 2.15.0 > Datastore write failures with "[Errno 32] Broke

[jira] [Work logged] (BEAM-7866) Python MongoDB IO performance and correctness issues

2019-08-08 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7866?focusedWorklogId=291466&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-291466 ] ASF GitHub Bot logged work on BEAM-7866: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7476) Datastore write failures with "[Errno 32] Broken pipe"

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7476: Status: Open (was: Triage Needed) > Datastore write failures with "[Errno 32] Broken pipe" > --

[jira] [Reopened] (BEAM-7476) Datastore write failures with "[Errno 32] Broken pipe"

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reopened BEAM-7476: - reopening so it gets cherrypicked onto 2.15 > Datastore write failures with "[Errno 32] Broken pipe" > --

  1   2   >