[jira] [Created] (BEAM-7957) Warn users if a step is named with a / or empty in DataflowRunner

2019-08-12 Thread David Yan (JIRA)
David Yan created BEAM-7957: --- Summary: Warn users if a step is named with a / or empty in DataflowRunner Key: BEAM-7957 URL: https://issues.apache.org/jira/browse/BEAM-7957 Project: Beam Issue

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=293190=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293190 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5148) Implement MongoDB IO for Python SDK

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5148?focusedWorklogId=293244=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293244 ] ASF GitHub Bot logged work on BEAM-5148: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7946) Fix all Dataflow LoadTests sdist task issue

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7946?focusedWorklogId=293246=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293246 ] ASF GitHub Bot logged work on BEAM-7946: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7495) Add support for dynamic worker re-balancing when reading BigQuery data using Cloud Dataflow

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7495?focusedWorklogId=293261=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293261 ] ASF GitHub Bot logged work on BEAM-7495: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5822) Vendor bytebuddy

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5822?focusedWorklogId=293306=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293306 ] ASF GitHub Bot logged work on BEAM-5822: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5822) Vendor bytebuddy

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5822?focusedWorklogId=293305=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293305 ] ASF GitHub Bot logged work on BEAM-5822: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5820) Vendor Calcite

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5820?focusedWorklogId=293309=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293309 ] ASF GitHub Bot logged work on BEAM-5820: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7944) Improvements of portability framework to make it usable in other projects

2019-08-12 Thread yifan zou (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yifan zou updated BEAM-7944: Fix Version/s: (was: 2.15.0) 2.16.0 > Improvements of portability framework to make

[jira] [Created] (BEAM-7955) Dynamic Writer - combining computed shards' number for late events with window's

2019-08-12 Thread Mariusz Rebandel (JIRA)
Mariusz Rebandel created BEAM-7955: -- Summary: Dynamic Writer - combining computed shards' number for late events with window's Key: BEAM-7955 URL: https://issues.apache.org/jira/browse/BEAM-7955

[jira] [Work logged] (BEAM-5820) Vendor Calcite

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5820?focusedWorklogId=293241=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293241 ] ASF GitHub Bot logged work on BEAM-5820: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=293271=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293271 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=293265=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293265 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=293264=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293264 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=293263=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293263 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=293268=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293268 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=293270=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293270 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=293269=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293269 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=293267=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293267 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=293266=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293266 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7958) Log message argument missing for stager's .whl extra_package warning

2019-08-12 Thread JIRA
Matjaž Smolej created BEAM-7958: --- Summary: Log message argument missing for stager's .whl extra_package warning Key: BEAM-7958 URL: https://issues.apache.org/jira/browse/BEAM-7958 Project: Beam

[jira] [Work logged] (BEAM-7946) Fix all Dataflow LoadTests sdist task issue

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7946?focusedWorklogId=293248=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293248 ] ASF GitHub Bot logged work on BEAM-7946: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5148) Implement MongoDB IO for Python SDK

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5148?focusedWorklogId=293253=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293253 ] ASF GitHub Bot logged work on BEAM-5148: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7495) Add support for dynamic worker re-balancing when reading BigQuery data using Cloud Dataflow

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7495?focusedWorklogId=293257=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293257 ] ASF GitHub Bot logged work on BEAM-7495: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5148) Implement MongoDB IO for Python SDK

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5148?focusedWorklogId=293284=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293284 ] ASF GitHub Bot logged work on BEAM-5148: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5822) Vendor bytebuddy

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5822?focusedWorklogId=293299=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293299 ] ASF GitHub Bot logged work on BEAM-5822: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7916) Add ElasticsearchIO query parameter to take a ValueProvider

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7916?focusedWorklogId=293199=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293199 ] ASF GitHub Bot logged work on BEAM-7916: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7911) test_corrupted_file test flaky

2019-08-12 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-7911: -- Summary: test_corrupted_file test flaky (was: test_corrupted_file test flak) > test_corrupted_file

[jira] [Commented] (BEAM-7956) FloatCoder and DoubleCoder structuralValue doesn't handle NaN

2019-08-12 Thread Neville Li (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7956?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905319#comment-16905319 ] Neville Li commented on BEAM-7956: -- Actually this might be due to how scala handles primitive types and

[jira] [Work logged] (BEAM-7954) Beam should only use guava imports coming from vendored guava

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7954?focusedWorklogId=293308=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293308 ] ASF GitHub Bot logged work on BEAM-7954: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7956) FloatCoder and DoubleCoder structuralValue doesn't handle NaN

2019-08-12 Thread Neville Li (JIRA)
Neville Li created BEAM-7956: Summary: FloatCoder and DoubleCoder structuralValue doesn't handle NaN Key: BEAM-7956 URL: https://issues.apache.org/jira/browse/BEAM-7956 Project: Beam Issue

[jira] [Work logged] (BEAM-7772) Stop using Perfkit Benchmarker tool in all tests

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7772?focusedWorklogId=293227=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293227 ] ASF GitHub Bot logged work on BEAM-7772: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7772) Stop using Perfkit Benchmarker tool in all tests

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7772?focusedWorklogId=293229=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293229 ] ASF GitHub Bot logged work on BEAM-7772: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-5148) Implement MongoDB IO for Python SDK

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5148?focusedWorklogId=293243=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293243 ] ASF GitHub Bot logged work on BEAM-5148: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7013) A new count distinct transform based on BigQuery compatible HyperLogLog++ implementation

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7013?focusedWorklogId=293262=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293262 ] ASF GitHub Bot logged work on BEAM-7013: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7696) If classpath directory contains a directory it causes exception in Spark runner staging

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7696?focusedWorklogId=293304=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-293304 ] ASF GitHub Bot logged work on BEAM-7696: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7929) ParquetTable.buildIOReader should support column projection and filter predicate

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7929: --- Status: Open (was: Triage Needed) > ParquetTable.buildIOReader should support column projection and

[jira] [Updated] (BEAM-7925) ParquetIO supports neither column projection nor filter predicate

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7925: --- Status: Open (was: Triage Needed) > ParquetIO supports neither column projection nor filter

[jira] [Updated] (BEAM-7913) Add drain() to DataflowPipelineJob

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7913?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7913: --- Status: Open (was: Triage Needed) > Add drain() to DataflowPipelineJob >

[jira] [Updated] (BEAM-7914) Add python 3 test in crossLanguageValidateRunner task

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7914: --- Labels: portability (was: ) > Add python 3 test in crossLanguageValidateRunner task >

[jira] [Updated] (BEAM-7914) Add python 3 test in crossLanguageValidateRunner task

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7914: --- Summary: Add python 3 test in crossLanguageValidateRunner task (was: add python 3 test in

[jira] [Updated] (BEAM-7857) Portable Wordcount on Flink runner finishes but does not produce output files in DOCKER execution mode

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7857: --- Status: Open (was: Triage Needed) > Portable Wordcount on Flink runner finishes but does not produce

[jira] [Updated] (BEAM-7858) Portable wordcount tests must verify that output was created and is correct.

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7858: --- Status: Open (was: Triage Needed) > Portable wordcount tests must verify that output was created and

[jira] [Updated] (BEAM-7858) Portable wordcount tests must verify that output was created and is correct.

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7858?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7858: --- Labels: portability (was: ) > Portable wordcount tests must verify that output was created and is

[jira] [Updated] (BEAM-7857) Portable Wordcount on Flink runner finishes but does not produce output files in DOCKER execution mode

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7857: --- Labels: portability (was: ) > Portable Wordcount on Flink runner finishes but does not produce

[jira] [Updated] (BEAM-7885) DoFn.setup() don't run for streaming jobs on DirectRunner.

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7885: --- Status: Open (was: Triage Needed) > DoFn.setup() don't run for streaming jobs on DirectRunner. >

[jira] [Updated] (BEAM-7930) bundle_processor log spam using python SDK on dataflow runner

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7930: --- Component/s: sdk-py-core > bundle_processor log spam using python SDK on dataflow runner >

[jira] [Commented] (BEAM-7934) Dataflow Python SDK logging: step_id is always empty string

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904981#comment-16904981 ] Ismaël Mejía commented on BEAM-7934: [~altay] can you please take a look or pass to someone who can.

[jira] [Updated] (BEAM-7930) bundle_processor log spam using python SDK on dataflow runner

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7930: --- Status: Open (was: Triage Needed) > bundle_processor log spam using python SDK on dataflow runner >

[jira] [Updated] (BEAM-7934) Dataflow Python SDK logging: step_id is always empty string

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7934: --- Status: Open (was: Triage Needed) > Dataflow Python SDK logging: step_id is always empty string >

[jira] [Updated] (BEAM-7934) Dataflow Python SDK logging: step_id is always empty string

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7934: --- Component/s: sdk-py-core > Dataflow Python SDK logging: step_id is always empty string >

[jira] [Updated] (BEAM-7911) test_corrupted_file test flak

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7911: --- Status: Open (was: Triage Needed) > test_corrupted_file test flak > - >

[jira] [Updated] (BEAM-7943) Spark Portable Runner flakes on KeysTest.testKeys

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7943: --- Component/s: test-failures > Spark Portable Runner flakes on KeysTest.testKeys >

[jira] [Updated] (BEAM-7911) test_corrupted_file test flak

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7911?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7911: --- Component/s: io-py-avro > test_corrupted_file test flak > - > >

[jira] [Updated] (BEAM-7883) PubsubIO (Java) write batch size can exceed request payload limit

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7883?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7883: --- Status: Open (was: Triage Needed) > PubsubIO (Java) write batch size can exceed request payload

[jira] [Updated] (BEAM-7865) Java precommit Samza tests opening RocksDB flaky

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7865: --- Status: Open (was: Triage Needed) > Java precommit Samza tests opening RocksDB flaky >

[jira] [Updated] (BEAM-7863) Update throttling counters to use generic throttling-msecs metric and dedicated namespace

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7863: --- Status: Open (was: Triage Needed) > Update throttling counters to use generic throttling-msecs

[jira] [Commented] (BEAM-7883) PubsubIO (Java) write batch size can exceed request payload limit

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905011#comment-16905011 ] Ismaël Mejía commented on BEAM-7883: [~pabl...@google.com] can you take a look or pass to someone who

[jira] [Updated] (BEAM-7884) Run pylint in Python 3

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7884: --- Status: Open (was: Triage Needed) > Run pylint in Python 3 > -- > >

[jira] [Assigned] (BEAM-7073) AvroUtils converting generic record to Beam Row causes class cast exception

2019-08-12 Thread Ryan Skraba (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Skraba reassigned BEAM-7073: - Assignee: Ryan Skraba > AvroUtils converting generic record to Beam Row causes class cast

[jira] [Work logged] (BEAM-7878) Refine Spark runner dependencies

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7878?focusedWorklogId=292948=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-292948 ] ASF GitHub Bot logged work on BEAM-7878: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7878) Refine Spark runner dependencies

2019-08-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7878?focusedWorklogId=292947=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-292947 ] ASF GitHub Bot logged work on BEAM-7878: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7886) Make row coder a standard coder and implement in python

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7886?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7886: --- Status: Open (was: Triage Needed) > Make row coder a standard coder and implement in python >

[jira] [Updated] (BEAM-7941) Example of DoFn.setup()

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7941: --- Status: Open (was: Triage Needed) > Example of DoFn.setup() > --- > >

[jira] [Commented] (BEAM-7942) Kafka backward compatibility

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7942?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904953#comment-16904953 ] Ismaël Mejía commented on BEAM-7942: Can you please share the full stacktrace. What runner do you use?

[jira] [Updated] (BEAM-7916) Add ElasticsearchIO query parameter to take a ValueProvider

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7916: --- Status: Open (was: Triage Needed) > Add ElasticsearchIO query parameter to take a ValueProvider >

[jira] [Updated] (BEAM-7916) Add ElasticsearchIO query parameter to take a ValueProvider

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7916: --- Fix Version/s: 2.16.0 > Add ElasticsearchIO query parameter to take a ValueProvider >

[jira] [Updated] (BEAM-7916) Add ElasticsearchIO query parameter to take a ValueProvider

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7916: --- Labels: (was: pull-request-available) > Add ElasticsearchIO query parameter to take a ValueProvider

[jira] [Updated] (BEAM-7944) Improvements of portability framework to make it usable in other projects

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7944: --- Status: Open (was: Triage Needed) > Improvements of portability framework to make it usable in other

[jira] [Updated] (BEAM-7919) Add a Python 3 test scenario for MongoDB IO

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7919: --- Summary: Add a Python 3 test scenario for MongoDB IO (was: Add a Python 3 test scenario for MongoDB

[jira] [Updated] (BEAM-7919) Add a Python 3 test scenario for MongoDB IO

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7919?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7919: --- Status: Open (was: Triage Needed) > Add a Python 3 test scenario for MongoDB IO >

[jira] [Updated] (BEAM-7918) UNNEST does not work with nested records

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7918: --- Fix Version/s: 2.16.0 > UNNEST does not work with nested records >

[jira] [Resolved] (BEAM-7918) UNNEST does not work with nested records

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-7918. Resolution: Fixed > UNNEST does not work with nested records >

[jira] [Updated] (BEAM-7922) Storage API reads in BigQueryTableProvider

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7922: --- Status: Open (was: Triage Needed) > Storage API reads in BigQueryTableProvider >

[jira] [Commented] (BEAM-2960) Missing type parameter in some AvroIO.Write API

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16905000#comment-16905000 ] Ismaël Mejía commented on BEAM-2960: Is this still an issue? > Missing type parameter in some

[jira] [Updated] (BEAM-2960) Missing type parameter in some AvroIO.Write API

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-2960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-2960: --- Component/s: (was: sdk-java-core) io-java-avro > Missing type parameter in some

[jira] [Resolved] (BEAM-7940) beam_Release_Python_NightlySnapshot is broken due to directory not exist

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía resolved BEAM-7940. Resolution: Fixed Fix Version/s: Not applicable > beam_Release_Python_NightlySnapshot is

[jira] [Updated] (BEAM-7940) beam_Release_Python_NightlySnapshot is broken due to directory not exist

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7940: --- Status: Open (was: Triage Needed) > beam_Release_Python_NightlySnapshot is broken due to directory

[jira] [Updated] (BEAM-7938) ProtoCoder throws NoSuchMethodException: com.google.protobuf.Message.getDefaultInstance()

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7938: --- Component/s: (was: sdk-java-core) extensions-java-protobuf > ProtoCoder throws

[jira] [Created] (BEAM-7944) Improvements of portability framework to make it usable in other projects

2019-08-12 Thread sunjincheng (JIRA)
sunjincheng created BEAM-7944: - Summary: Improvements of portability framework to make it usable in other projects Key: BEAM-7944 URL: https://issues.apache.org/jira/browse/BEAM-7944 Project: Beam

[jira] [Updated] (BEAM-7944) Improvements of portability framework to make it usable in other projects

2019-08-12 Thread sunjincheng (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sunjincheng updated BEAM-7944: -- Description: The Flink community will use Beam's portability framework for its multi-language support,

[jira] [Updated] (BEAM-7928) Being able to specify disk type and disk size

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7928?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7928: --- Status: Open (was: Triage Needed) > Being able to specify disk type and disk size >

[jira] [Updated] (BEAM-7921) Add Schema support for Tensorflow

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7921: --- Status: Open (was: Triage Needed) > Add Schema support for Tensorflow >

[jira] [Updated] (BEAM-7921) Add Schema support for Tensorflow

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7921: --- Component/s: io-java-tfrecord > Add Schema support for Tensorflow > -

[jira] [Updated] (BEAM-7920) AvroTableProvider

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7920?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7920: --- Component/s: io-java-avro > AvroTableProvider > - > > Key: BEAM-7920

[jira] [Updated] (BEAM-7922) Storage API reads in BigQueryTableProvider

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7922: --- Component/s: io-java-gcp > Storage API reads in BigQueryTableProvider >

[jira] [Updated] (BEAM-7887) Release automation improvement

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7887: --- Status: Open (was: Triage Needed) > Release automation improvement > --

[jira] [Updated] (BEAM-7884) Run pylint in Python 3

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7884: --- Component/s: build-system > Run pylint in Python 3 > -- > > Key:

[jira] [Assigned] (BEAM-1974) Metrics documentation

2019-08-12 Thread Alexey Romanenko (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Romanenko reassigned BEAM-1974: -- Assignee: Alexey Romanenko > Metrics documentation > - > >

[jira] [Updated] (BEAM-7942) Kafka backward compatibility

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7942?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7942: --- Status: Open (was: Triage Needed) > Kafka backward compatibility > - >

[jira] [Updated] (BEAM-7937) Hadoop Version 3.2 + support

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7937: --- Status: Open (was: Triage Needed) > Hadoop Version 3.2 + support > > >

[jira] [Updated] (BEAM-7944) Improvements of portability framework to make it usable in other projects

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7944: --- Labels: portability (was: ) > Improvements of portability framework to make it usable in other

[jira] [Updated] (BEAM-7944) Improvements of portability framework to make it usable in other projects

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7944: --- Component/s: (was: runner-dataflow) > Improvements of portability framework to make it usable in

[jira] [Updated] (BEAM-7927) Add ability to get the list of submitted jobs from gRPC JobService

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7927: --- Status: Open (was: Triage Needed) > Add ability to get the list of submitted jobs from gRPC

[jira] [Assigned] (BEAM-7927) Add ability to get the list of submitted jobs from gRPC JobService

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía reassigned BEAM-7927: -- Assignee: Chad Dombrova > Add ability to get the list of submitted jobs from gRPC JobService >

[jira] [Commented] (BEAM-7928) Being able to specify disk type and disk size

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904988#comment-16904988 ] Ismaël Mejía commented on BEAM-7928: [~lostluck] can you take a look at this. > Being able to specify

[jira] [Updated] (BEAM-7926) Visualize PCollection with iBeam

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7926: --- Status: Open (was: Triage Needed) > Visualize PCollection with iBeam >

[jira] [Updated] (BEAM-7904) Standardize naming for cross-language transform URN

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7904: --- Status: Open (was: Triage Needed) > Standardize naming for cross-language transform URN >

[jira] [Updated] (BEAM-7904) Standardize naming for cross-language transform URN

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7904: --- Summary: Standardize naming for cross-language transform URN (was: standardize naming for

[jira] [Updated] (BEAM-7904) Standardize naming for cross-language transform URN

2019-08-12 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7904: --- Component/s: (was: io-ideas) runner-core beam-model >

<    1   2   3   4   >