[jira] [Work logged] (BEAM-7305) Add first version of Hazelcast Jet Runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7305?focusedWorklogId=243839=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243839 ] ASF GitHub Bot logged work on BEAM-7305: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7190) enable file system based token authentication for portable runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7190?focusedWorklogId=243815=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243815 ] ASF GitHub Bot logged work on BEAM-7190: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7190) enable file system based token authentication for portable runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7190?focusedWorklogId=243797=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243797 ] ASF GitHub Bot logged work on BEAM-7190: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6988) TypeHints Py3 Error: test_non_function (apache_beam.typehints.typed_pipeline_test.MainInputTest) Fails on Python 3.7+

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6988?focusedWorklogId=243779=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243779 ] ASF GitHub Bot logged work on BEAM-6988: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7347) beam_Performance failed with benchmark flag config error

2019-05-16 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-7347: --- Description: [All|https://builds.apache.org/view/A-D/view/Beam/view/PerformanceTests/] performance

[jira] [Work logged] (BEAM-6988) TypeHints Py3 Error: test_non_function (apache_beam.typehints.typed_pipeline_test.MainInputTest) Fails on Python 3.7+

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6988?focusedWorklogId=243774=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243774 ] ASF GitHub Bot logged work on BEAM-6988: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7347) beam_Performance failed with benchmark flag config error

2019-05-16 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mark Liu updated BEAM-7347: --- Description: [All|https://builds.apache.org/view/A-D/view/Beam/view/PerformanceTests/] performance

[jira] [Created] (BEAM-7347) beam_Performance failed with benchmark flag config error

2019-05-16 Thread Mark Liu (JIRA)
Mark Liu created BEAM-7347: -- Summary: beam_Performance failed with benchmark flag config error Key: BEAM-7347 URL: https://issues.apache.org/jira/browse/BEAM-7347 Project: Beam Issue Type: Bug

[jira] [Work logged] (BEAM-6988) TypeHints Py3 Error: test_non_function (apache_beam.typehints.typed_pipeline_test.MainInputTest) Fails on Python 3.7+

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6988?focusedWorklogId=243773=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243773 ] ASF GitHub Bot logged work on BEAM-6988: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6988) TypeHints Py3 Error: test_non_function (apache_beam.typehints.typed_pipeline_test.MainInputTest) Fails on Python 3.7+

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6988?focusedWorklogId=243767=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243767 ] ASF GitHub Bot logged work on BEAM-6988: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6988) TypeHints Py3 Error: test_non_function (apache_beam.typehints.typed_pipeline_test.MainInputTest) Fails on Python 3.7+

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6988?focusedWorklogId=243768=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243768 ] ASF GitHub Bot logged work on BEAM-6988: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6988) TypeHints Py3 Error: test_non_function (apache_beam.typehints.typed_pipeline_test.MainInputTest) Fails on Python 3.7+

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6988?focusedWorklogId=243766=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243766 ] ASF GitHub Bot logged work on BEAM-6988: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6988) TypeHints Py3 Error: test_non_function (apache_beam.typehints.typed_pipeline_test.MainInputTest) Fails on Python 3.7+

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6988?focusedWorklogId=243770=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243770 ] ASF GitHub Bot logged work on BEAM-6988: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6988) TypeHints Py3 Error: test_non_function (apache_beam.typehints.typed_pipeline_test.MainInputTest) Fails on Python 3.7+

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6988?focusedWorklogId=243769=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243769 ] ASF GitHub Bot logged work on BEAM-6988: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7135) Spark executable stage: Job bundle factory is not being closed

2019-05-16 Thread Kyle Weaver (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841836#comment-16841836 ] Kyle Weaver commented on BEAM-7135: --- It also doesn't help that I'm logging every exception that's going

[jira] [Commented] (BEAM-7135) Spark executable stage: Job bundle factory is not being closed

2019-05-16 Thread Kyle Weaver (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7135?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841828#comment-16841828 ] Kyle Weaver commented on BEAM-7135: --- This issue creates a huge number of errors that often end up

[jira] [Work logged] (BEAM-6908) Add Python3 performance benchmarks

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6908?focusedWorklogId=243762=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243762 ] ASF GitHub Bot logged work on BEAM-6908: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6908) Add Python3 performance benchmarks

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6908?focusedWorklogId=243760=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243760 ] ASF GitHub Bot logged work on BEAM-6908: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7271) Adding StringUtf8Coder to ModelCoder in JavaSDK [REOPENED]

2019-05-16 Thread Heejong Lee (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841827#comment-16841827 ] Heejong Lee commented on BEAM-7271: --- Yes. I think we still need to backport

[jira] [Work logged] (BEAM-7339) Enable 1Gb input for Python wordcount benchmark

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7339?focusedWorklogId=243747=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243747 ] ASF GitHub Bot logged work on BEAM-7339: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7326) Document that Beam BigQuery IO expects users to pass base64-encoded bytes, and BQ IO serves base64-encoded bytes to the user.

2019-05-16 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7326?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841822#comment-16841822 ] Robert Burke commented on BEAM-7326: The BigQuery Go package (not Beam's IO) doesn't mention base64 at

[jira] [Work logged] (BEAM-6908) Add Python3 performance benchmarks

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6908?focusedWorklogId=243746=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243746 ] ASF GitHub Bot logged work on BEAM-6908: Author: ASF GitHub Bot

[jira] [Assigned] (BEAM-7342) Extend SyntheticPipeline map steps to be able to be splittable (Beam Python SDK)

2019-05-16 Thread Lara Schmidt (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lara Schmidt reassigned BEAM-7342: -- Assignee: Lara Schmidt > Extend SyntheticPipeline map steps to be able to be splittable (Beam

[jira] [Work logged] (BEAM-6683) Add an integration test suite for cross-language transforms for Flink runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6683?focusedWorklogId=243727=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243727 ] ASF GitHub Bot logged work on BEAM-6683: Author: ASF GitHub Bot

[jira] [Work started] (BEAM-7190) enable file system based token authentication for portable runner

2019-05-16 Thread Hai Lu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7190?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-7190 started by Hai Lu. > enable file system based token authentication for portable runner >

[jira] [Updated] (BEAM-7346) Add tests for BigQuery connector in Go SDK that will exercise all types supported by BQ.

2019-05-16 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev updated BEAM-7346: -- Priority: Minor (was: Major) > Add tests for BigQuery connector in Go SDK that will

[jira] [Created] (BEAM-7346) Add tests for BigQuery connector in Go SDK that will exercise all types supported by BQ.

2019-05-16 Thread Valentyn Tymofieiev (JIRA)
Valentyn Tymofieiev created BEAM-7346: - Summary: Add tests for BigQuery connector in Go SDK that will exercise all types supported by BQ. Key: BEAM-7346 URL: https://issues.apache.org/jira/browse/BEAM-7346

[jira] [Work logged] (BEAM-6683) Add an integration test suite for cross-language transforms for Flink runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6683?focusedWorklogId=243726=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243726 ] ASF GitHub Bot logged work on BEAM-6683: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6959) Run Go SDK Post Commit tests against the Flink Runner.

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6959?focusedWorklogId=243725=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243725 ] ASF GitHub Bot logged work on BEAM-6959: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6988) TypeHints Py3 Error: test_non_function (apache_beam.typehints.typed_pipeline_test.MainInputTest) Fails on Python 3.7+

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6988?focusedWorklogId=243722=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243722 ] ASF GitHub Bot logged work on BEAM-6988: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7116) Remove KV from Schema transforms

2019-05-16 Thread Brian Hulette (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841798#comment-16841798 ] Brian Hulette commented on BEAM-7116: - Ah shoot. My intention was just to make it so that we could

[jira] [Created] (BEAM-7345) Add support for generics in schema inference

2019-05-16 Thread Brian Hulette (JIRA)
Brian Hulette created BEAM-7345: --- Summary: Add support for generics in schema inference Key: BEAM-7345 URL: https://issues.apache.org/jira/browse/BEAM-7345 Project: Beam Issue Type: Sub-task

[jira] [Commented] (BEAM-7345) Add support for generics in schema inference

2019-05-16 Thread Brian Hulette (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7345?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841797#comment-16841797 ] Brian Hulette commented on BEAM-7345: - Some more discussion here:

[jira] [Work logged] (BEAM-6683) Add an integration test suite for cross-language transforms for Flink runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6683?focusedWorklogId=243715=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243715 ] ASF GitHub Bot logged work on BEAM-6683: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6683) Add an integration test suite for cross-language transforms for Flink runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6683?focusedWorklogId=243714=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243714 ] ASF GitHub Bot logged work on BEAM-6683: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7344) Consider removing the requirement that users need to base64-encode their BYTES before passing them to BQ IO connector.

2019-05-16 Thread Valentyn Tymofieiev (JIRA)
Valentyn Tymofieiev created BEAM-7344: - Summary: Consider removing the requirement that users need to base64-encode their BYTES before passing them to BQ IO connector. Key: BEAM-7344 URL:

[jira] [Updated] (BEAM-7344) Consider removing the requirement that users need to base64-encode their BYTES before passing them to BQ IO connector.

2019-05-16 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev updated BEAM-7344: -- Priority: Minor (was: Major) > Consider removing the requirement that users need to

[jira] [Work logged] (BEAM-6988) TypeHints Py3 Error: test_non_function (apache_beam.typehints.typed_pipeline_test.MainInputTest) Fails on Python 3.7+

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6988?focusedWorklogId=243709=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243709 ] ASF GitHub Bot logged work on BEAM-6988: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6988) TypeHints Py3 Error: test_non_function (apache_beam.typehints.typed_pipeline_test.MainInputTest) Fails on Python 3.7+

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6988?focusedWorklogId=243706=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243706 ] ASF GitHub Bot logged work on BEAM-6988: Author: ASF GitHub Bot

[jira] [Updated] (BEAM-7326) Document that Beam BigQuery IO expects users to pass base64-encoded bytes, and BQ IO serves base64-encoded bytes to the user.

2019-05-16 Thread Valentyn Tymofieiev (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Valentyn Tymofieiev updated BEAM-7326: -- Description: BYTES is one of the Datatypes supported by Google Cloud BigQuery, and

[jira] [Commented] (BEAM-7271) Adding StringUtf8Coder to ModelCoder in JavaSDK [REOPENED]

2019-05-16 Thread Ankur Goenka (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7271?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841780#comment-16841780 ] Ankur Goenka commented on BEAM-7271: Flink PortableValidatesRunner test cases are passing on 2.13.0 

[jira] [Work logged] (BEAM-6908) Add Python3 performance benchmarks

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6908?focusedWorklogId=243704=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243704 ] ASF GitHub Bot logged work on BEAM-6908: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7116) Remove KV from Schema transforms

2019-05-16 Thread Reuven Lax (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841777#comment-16841777 ] Reuven Lax commented on BEAM-7116: -- The problem is that Beam special cases KvCoder all over the place, so

[jira] [Created] (BEAM-7343) Fix Google Cloud Dataflow Runner * tests on 2.13.0

2019-05-16 Thread Ankur Goenka (JIRA)
Ankur Goenka created BEAM-7343: -- Summary: Fix Google Cloud Dataflow Runner * tests on 2.13.0 Key: BEAM-7343 URL: https://issues.apache.org/jira/browse/BEAM-7343 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-7342) Extend SyntheticPipeline map steps to be able to be splittable (Beam Python SDK)

2019-05-16 Thread Lara Schmidt (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lara Schmidt updated BEAM-7342: --- Status: Open (was: Triage Needed) > Extend SyntheticPipeline map steps to be able to be splittable

[jira] [Created] (BEAM-7342) Extend SyntheticPipeline map steps to be able to be splittable (Beam Python SDK)

2019-05-16 Thread Lara Schmidt (JIRA)
Lara Schmidt created BEAM-7342: -- Summary: Extend SyntheticPipeline map steps to be able to be splittable (Beam Python SDK) Key: BEAM-7342 URL: https://issues.apache.org/jira/browse/BEAM-7342 Project:

[jira] [Resolved] (BEAM-7177) Spark portable runner fails testGlobalCombineWithDefaultsAndTriggers

2019-05-16 Thread Kyle Weaver (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-7177. --- Resolution: Duplicate Fix Version/s: Not applicable > Spark portable runner fails

[jira] [Closed] (BEAM-7282) Spark portable runner doesn't support `pre_optimize=all`

2019-05-16 Thread Kyle Weaver (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver closed BEAM-7282. - Resolution: Fixed Fix Version/s: 2.14.0 > Spark portable runner doesn't support `pre_optimize=all`

[jira] [Created] (BEAM-7341) portable Spark: testGlobalCombineWithDefaultsAndTriggers fails

2019-05-16 Thread Kyle Weaver (JIRA)
Kyle Weaver created BEAM-7341: - Summary: portable Spark: testGlobalCombineWithDefaultsAndTriggers fails Key: BEAM-7341 URL: https://issues.apache.org/jira/browse/BEAM-7341 Project: Beam Issue

[jira] [Updated] (BEAM-563) DoFn Reuse: Update DirectRunner

2019-05-16 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-563: - Fix Version/s: (was: Not applicable) 2.14.0 > DoFn Reuse: Update DirectRunner >

[jira] [Updated] (BEAM-562) DoFn Reuse: Add new methods to DoFn

2019-05-16 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ahmet Altay updated BEAM-562: - Fix Version/s: (was: Not applicable) 2.14.0 > DoFn Reuse: Add new methods to DoFn >

[jira] [Work logged] (BEAM-7339) Enable 1Gb input for Python wordcount benchmark

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7339?focusedWorklogId=243674=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243674 ] ASF GitHub Bot logged work on BEAM-7339: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7339) Enable 1Gb input for Python wordcount benchmark

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7339?focusedWorklogId=243673=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243673 ] ASF GitHub Bot logged work on BEAM-7339: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6683) Add an integration test suite for cross-language transforms for Flink runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6683?focusedWorklogId=243666=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243666 ] ASF GitHub Bot logged work on BEAM-6683: Author: ASF GitHub Bot

[jira] [Resolved] (BEAM-6690) Spark Translator - ASSIGN_WINDOWS_TRANSFORM_URN

2019-05-16 Thread Kyle Weaver (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weaver resolved BEAM-6690. --- Resolution: Won't Fix Fix Version/s: Not applicable > Spark Translator -

[jira] [Commented] (BEAM-6690) Spark Translator - ASSIGN_WINDOWS_TRANSFORM_URN

2019-05-16 Thread Kyle Weaver (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6690?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841735#comment-16841735 ] Kyle Weaver commented on BEAM-6690: --- `translateAssignWindows` was removed from the Flink portable runner

[jira] [Work logged] (BEAM-6683) Add an integration test suite for cross-language transforms for Flink runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6683?focusedWorklogId=243643=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243643 ] ASF GitHub Bot logged work on BEAM-6683: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6683) Add an integration test suite for cross-language transforms for Flink runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6683?focusedWorklogId=243642=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243642 ] ASF GitHub Bot logged work on BEAM-6683: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-6877) TypeHints Py3 Error: Type inference tests fail on Python 3.6 due to bytecode changes

2019-05-16 Thread niklas Hansson (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841716#comment-16841716 ] niklas Hansson commented on BEAM-6877: -- Sadly not :(. Should I release it? Plan to work with it on

[jira] [Work logged] (BEAM-6988) TypeHints Py3 Error: test_non_function (apache_beam.typehints.typed_pipeline_test.MainInputTest) Fails on Python 3.7+

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6988?focusedWorklogId=243624=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243624 ] ASF GitHub Bot logged work on BEAM-6988: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6988) TypeHints Py3 Error: test_non_function (apache_beam.typehints.typed_pipeline_test.MainInputTest) Fails on Python 3.7+

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6988?focusedWorklogId=243623=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243623 ] ASF GitHub Bot logged work on BEAM-6988: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6988) TypeHints Py3 Error: test_non_function (apache_beam.typehints.typed_pipeline_test.MainInputTest) Fails on Python 3.7+

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6988?focusedWorklogId=243616=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243616 ] ASF GitHub Bot logged work on BEAM-6988: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7116) Remove KV from Schema transforms

2019-05-16 Thread Brian Hulette (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7116?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841702#comment-16841702 ] Brian Hulette commented on BEAM-7116: - [~reuvenlax] - Could we just use the existing

[jira] [Issue Comment Deleted] (BEAM-7338) Deprecate PoolableDataSourceProvider from JdbcIO

2019-05-16 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismaël Mejía updated BEAM-7338: --- Comment: was deleted (was: Another reason to do so is that it leaks DBCP into the JDBCIO user

[jira] [Work logged] (BEAM-7339) Enable 1Gb input for Python wordcount benchmark

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7339?focusedWorklogId=243611=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243611 ] ASF GitHub Bot logged work on BEAM-7339: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7339) Enable 1Gb input for Python wordcount benchmark

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7339?focusedWorklogId=243609=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243609 ] ASF GitHub Bot logged work on BEAM-7339: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7339) Enable 1Gb input for Python wordcount benchmark

2019-05-16 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841684#comment-16841684 ] Ahmet Altay commented on BEAM-7339: --- Related to the quota issue, we need to have a solution to this,

[jira] [Commented] (BEAM-7338) Deprecate PoolableDataSourceProvider from JdbcIO

2019-05-16 Thread JIRA
[ https://issues.apache.org/jira/browse/BEAM-7338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841680#comment-16841680 ] Ismaël Mejía commented on BEAM-7338: Another reason to do so is that it leaks DBCP into the JDBCIO

[jira] [Work logged] (BEAM-6683) Add an integration test suite for cross-language transforms for Flink runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6683?focusedWorklogId=243604=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243604 ] ASF GitHub Bot logged work on BEAM-6683: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7339) Enable 1Gb input for Python wordcount benchmark

2019-05-16 Thread Mark Liu (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841674#comment-16841674 ] Mark Liu commented on BEAM-7339: Two concerns for >100Gb input: 1. The resource we have for

[jira] [Work logged] (BEAM-6988) TypeHints Py3 Error: test_non_function (apache_beam.typehints.typed_pipeline_test.MainInputTest) Fails on Python 3.7+

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6988?focusedWorklogId=243599=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243599 ] ASF GitHub Bot logged work on BEAM-6988: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6988) TypeHints Py3 Error: test_non_function (apache_beam.typehints.typed_pipeline_test.MainInputTest) Fails on Python 3.7+

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6988?focusedWorklogId=243598=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243598 ] ASF GitHub Bot logged work on BEAM-6988: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6985) TypeHints Py3 Error: Native type compatibility tests fail on Python 3.7+

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6985?focusedWorklogId=243601=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243601 ] ASF GitHub Bot logged work on BEAM-6985: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6683) Add an integration test suite for cross-language transforms for Flink runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6683?focusedWorklogId=243597=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243597 ] ASF GitHub Bot logged work on BEAM-6683: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7305) Add first version of Hazelcast Jet Runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7305?focusedWorklogId=243594=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243594 ] ASF GitHub Bot logged work on BEAM-7305: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7305) Add first version of Hazelcast Jet Runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7305?focusedWorklogId=243596=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243596 ] ASF GitHub Bot logged work on BEAM-7305: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7305) Add first version of Hazelcast Jet Runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7305?focusedWorklogId=243595=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243595 ] ASF GitHub Bot logged work on BEAM-7305: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-562) DoFn Reuse: Add new methods to DoFn

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-562?focusedWorklogId=243592=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243592 ] ASF GitHub Bot logged work on BEAM-562: --- Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6988) TypeHints Py3 Error: test_non_function (apache_beam.typehints.typed_pipeline_test.MainInputTest) Fails on Python 3.7+

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6988?focusedWorklogId=243590=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243590 ] ASF GitHub Bot logged work on BEAM-6988: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6988) TypeHints Py3 Error: test_non_function (apache_beam.typehints.typed_pipeline_test.MainInputTest) Fails on Python 3.7+

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6988?focusedWorklogId=243591=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243591 ] ASF GitHub Bot logged work on BEAM-6988: Author: ASF GitHub Bot

[jira] [Created] (BEAM-7340) DoFn.teardown metrics are lost in Python SDK

2019-05-16 Thread Yifan Mai (JIRA)
Yifan Mai created BEAM-7340: --- Summary: DoFn.teardown metrics are lost in Python SDK Key: BEAM-7340 URL: https://issues.apache.org/jira/browse/BEAM-7340 Project: Beam Issue Type: Bug

[jira] [Work logged] (BEAM-6988) TypeHints Py3 Error: test_non_function (apache_beam.typehints.typed_pipeline_test.MainInputTest) Fails on Python 3.7+

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6988?focusedWorklogId=243593=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243593 ] ASF GitHub Bot logged work on BEAM-6988: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6683) Add an integration test suite for cross-language transforms for Flink runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6683?focusedWorklogId=243587=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243587 ] ASF GitHub Bot logged work on BEAM-6683: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6683) Add an integration test suite for cross-language transforms for Flink runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6683?focusedWorklogId=243588=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243588 ] ASF GitHub Bot logged work on BEAM-6683: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6985) TypeHints Py3 Error: Native type compatibility tests fail on Python 3.7+

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6985?focusedWorklogId=243586=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243586 ] ASF GitHub Bot logged work on BEAM-6985: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6683) Add an integration test suite for cross-language transforms for Flink runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6683?focusedWorklogId=243585=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243585 ] ASF GitHub Bot logged work on BEAM-6683: Author: ASF GitHub Bot

[jira] [Closed] (BEAM-563) DoFn Reuse: Update DirectRunner

2019-05-16 Thread Yifan Mai (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yifan Mai closed BEAM-563. -- Resolution: Done Fix Version/s: Not applicable This was also done in

[jira] [Work logged] (BEAM-6683) Add an integration test suite for cross-language transforms for Flink runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6683?focusedWorklogId=243584=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243584 ] ASF GitHub Bot logged work on BEAM-6683: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7230) Using JdbcIO creates huge amount of connections

2019-05-16 Thread Brachi Packter (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841646#comment-16841646 ] Brachi Packter commented on BEAM-7230: -- Hi. Looked into the code, seems that like when using API

[jira] [Work logged] (BEAM-6683) Add an integration test suite for cross-language transforms for Flink runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6683?focusedWorklogId=243582=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243582 ] ASF GitHub Bot logged work on BEAM-6683: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6683) Add an integration test suite for cross-language transforms for Flink runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6683?focusedWorklogId=243583=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243583 ] ASF GitHub Bot logged work on BEAM-6683: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6683) Add an integration test suite for cross-language transforms for Flink runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6683?focusedWorklogId=243577=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243577 ] ASF GitHub Bot logged work on BEAM-6683: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6683) Add an integration test suite for cross-language transforms for Flink runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6683?focusedWorklogId=243578=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243578 ] ASF GitHub Bot logged work on BEAM-6683: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6683) Add an integration test suite for cross-language transforms for Flink runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6683?focusedWorklogId=243576=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243576 ] ASF GitHub Bot logged work on BEAM-6683: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-7339) Enable 1Gb input for Python wordcount benchmark

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7339?focusedWorklogId=243575=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243575 ] ASF GitHub Bot logged work on BEAM-7339: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-5510) Records including datetime to be saved as DATETIME or TIMESTAMP in BigQuery

2019-05-16 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841636#comment-16841636 ] Ahmet Altay commented on BEAM-5510: --- cc: [~chamikara] [~pabloem] > Records including datetime to be

[jira] [Work logged] (BEAM-7339) Enable 1Gb input for Python wordcount benchmark

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7339?focusedWorklogId=243565=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243565 ] ASF GitHub Bot logged work on BEAM-7339: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6683) Add an integration test suite for cross-language transforms for Flink runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6683?focusedWorklogId=243560=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243560 ] ASF GitHub Bot logged work on BEAM-6683: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-7339) Enable 1Gb input for Python wordcount benchmark

2019-05-16 Thread Ahmet Altay (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7339?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16841629#comment-16841629 ] Ahmet Altay commented on BEAM-7339: --- If this is for a benchmark, should we target larger input (> 100

[jira] [Work logged] (BEAM-6683) Add an integration test suite for cross-language transforms for Flink runner

2019-05-16 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6683?focusedWorklogId=243556=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-243556 ] ASF GitHub Bot logged work on BEAM-6683: Author: ASF GitHub Bot

  1   2   >