[jira] [Created] (BEAM-8095) pytest Py3.7 crashes on test_remote_runner_display_data

2019-08-26 Thread Udi Meiri (Jira)
Udi Meiri created BEAM-8095: --- Summary: pytest Py3.7 crashes on test_remote_runner_display_data Key: BEAM-8095 URL: https://issues.apache.org/jira/browse/BEAM-8095 Project: Beam Issue Type:

[jira] [Created] (BEAM-8078) streaming_wordcount_debugging.py is missing a test

2019-08-22 Thread Udi Meiri (Jira)
Udi Meiri created BEAM-8078: --- Summary: streaming_wordcount_debugging.py is missing a test Key: BEAM-8078 URL: https://issues.apache.org/jira/browse/BEAM-8078 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-7616) urlopen calls could get stuck without a timeout

2019-08-22 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16913549#comment-16913549 ] Udi Meiri commented on BEAM-7616: - Monkey patching seems like a bad idea. Calling

[jira] [Resolved] (BEAM-7531) Don't auto-create GCS buckets with KMS settings

2019-08-21 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-7531. - Fix Version/s: Not applicable Resolution: Fixed > Don't auto-create GCS buckets with KMS settings

[jira] [Resolved] (BEAM-7986) Increase minimum grpcio required version

2019-08-21 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-7986. - Fix Version/s: 2.16.0 Resolution: Fixed > Increase minimum grpcio required version >

[jira] [Commented] (BEAM-7531) Don't auto-create GCS buckets with KMS settings

2019-08-21 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-7531?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16912732#comment-16912732 ] Udi Meiri commented on BEAM-7531: - PR was closed for being stale. Closing this. > Don't auto-create GCS

[jira] [Created] (BEAM-8009) Pipeline context manager calls wait_until_finish on streaming pipelines

2019-08-19 Thread Udi Meiri (Jira)
Udi Meiri created BEAM-8009: --- Summary: Pipeline context manager calls wait_until_finish on streaming pipelines Key: BEAM-8009 URL: https://issues.apache.org/jira/browse/BEAM-8009 Project: Beam

[jira] [Commented] (BEAM-8005) beam_PostCommit_Python37 timing out

2019-08-19 Thread Udi Meiri (Jira)
[ https://issues.apache.org/jira/browse/BEAM-8005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16910712#comment-16910712 ] Udi Meiri commented on BEAM-8005: - This also happens on beam_PostCommit_Python36, just less frequently.

[jira] [Created] (BEAM-8005) beam_PostCommit_Python37 timing out

2019-08-19 Thread Udi Meiri (Jira)
Udi Meiri created BEAM-8005: --- Summary: beam_PostCommit_Python37 timing out Key: BEAM-8005 URL: https://issues.apache.org/jira/browse/BEAM-8005 Project: Beam Issue Type: Bug Components:

[jira] [Assigned] (BEAM-7981) ParDo function wrapper doesn't support Iterable output types

2019-08-16 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-7981: --- Assignee: Udi Meiri > ParDo function wrapper doesn't support Iterable output types >

[jira] [Commented] (BEAM-7993) portable python precommit is flaky

2019-08-16 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909362#comment-16909362 ] Udi Meiri commented on BEAM-7993: - Similar failures:

[jira] [Created] (BEAM-7993) portable python precommit is flaky

2019-08-16 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7993: --- Summary: portable python precommit is flaky Key: BEAM-7993 URL: https://issues.apache.org/jira/browse/BEAM-7993 Project: Beam Issue Type: Bug Components:

[jira] [Commented] (BEAM-7164) Python precommit failing on Java PRs. dataflow:setupVirtualenv

2019-08-16 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909353#comment-16909353 ] Udi Meiri commented on BEAM-7164: - Seems to not reproduce when adding --no-parallel to the setupVirtualenv

[jira] [Created] (BEAM-7992) Unhandled type_constraint in apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests.test_big_query_write_new_types

2019-08-16 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7992: --- Summary: Unhandled type_constraint in apache_beam.io.gcp.bigquery_write_it_test.BigQueryWriteIntegrationTests.test_big_query_write_new_types Key: BEAM-7992 URL:

[jira] [Commented] (BEAM-7164) Python precommit failing on Java PRs. dataflow:setupVirtualenv

2019-08-16 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909263#comment-16909263 ] Udi Meiri commented on BEAM-7164: - Reproducible locally via: {code} for i in `seq 100`; do ../../gradlew

[jira] [Updated] (BEAM-7991) gradle cleanPython race

2019-08-16 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7991?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7991: Priority: Minor (was: Major) > gradle cleanPython race > --- > > Key:

[jira] [Created] (BEAM-7991) gradle cleanPython race

2019-08-16 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7991: --- Summary: gradle cleanPython race Key: BEAM-7991 URL: https://issues.apache.org/jira/browse/BEAM-7991 Project: Beam Issue Type: Bug Components: build-system

[jira] [Commented] (BEAM-7164) Python precommit failing on Java PRs. dataflow:setupVirtualenv

2019-08-16 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7164?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16909164#comment-16909164 ] Udi Meiri commented on BEAM-7164: - Still happening: {code} 18:15:04 > Task

[jira] [Comment Edited] (BEAM-7986) Increase minimum grpcio required version

2019-08-15 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908569#comment-16908569 ] Udi Meiri edited comment on BEAM-7986 at 8/16/19 12:19 AM: --- Added in 1.12:

[jira] [Commented] (BEAM-7986) Increase minimum grpcio required version

2019-08-15 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7986?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16908565#comment-16908565 ] Udi Meiri commented on BEAM-7986: - Will upgrade dep to the oldest version that has the abstract method

[jira] [Assigned] (BEAM-7986) Increase minimum grpcio required version

2019-08-15 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7986?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-7986: --- Assignee: Udi Meiri > Increase minimum grpcio required version >

[jira] [Created] (BEAM-7986) Increase minimum grpcio required version

2019-08-15 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7986: --- Summary: Increase minimum grpcio required version Key: BEAM-7986 URL: https://issues.apache.org/jira/browse/BEAM-7986 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-7981) ParDo function wrapper doesn't support Iterable output types

2019-08-14 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16907753#comment-16907753 ] Udi Meiri commented on BEAM-7981: - I have not committed to working on it yet. > ParDo function wrapper

[jira] [Updated] (BEAM-7981) ParDo function wrapper doesn't support Iterable output types

2019-08-14 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7981: Summary: ParDo function wrapper doesn't support Iterable output types (was: CallableWrapperDoFn) > ParDo

[jira] [Created] (BEAM-7981) CallableWrapperDoFn

2019-08-14 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7981: --- Summary: CallableWrapperDoFn Key: BEAM-7981 URL: https://issues.apache.org/jira/browse/BEAM-7981 Project: Beam Issue Type: Bug Components: sdk-py-core

[jira] [Commented] (BEAM-7971) Pycharm debugger for apache_beam/*_test.py broken

2019-08-13 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16906696#comment-16906696 ] Udi Meiri commented on BEAM-7971: - "Run" for these tests still works from within Pycharm, "Debug" is

[jira] [Created] (BEAM-7971) Pycharm debugger for apache_beam/*_test.py broken

2019-08-13 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7971: --- Summary: Pycharm debugger for apache_beam/*_test.py broken Key: BEAM-7971 URL: https://issues.apache.org/jira/browse/BEAM-7971 Project: Beam Issue Type: Bug

[jira] [Closed] (BEAM-7828) Add key type conversion in from and to client entity in Datastore v1new IO.

2019-08-09 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri closed BEAM-7828. --- Resolution: Fixed Got pushed back to 2.16 > Add key type conversion in from and to client entity in

[jira] [Updated] (BEAM-7828) Add key type conversion in from and to client entity in Datastore v1new IO.

2019-08-09 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7828: Fix Version/s: (was: 2.15.0) 2.16.0 > Add key type conversion in from and to client

[jira] [Updated] (BEAM-7608) v1new ReadFromDatastore skips entities

2019-08-09 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7608: Priority: Blocker (was: Critical) > v1new ReadFromDatastore skips entities >

[jira] [Commented] (BEAM-7713) Migrate to "typing" module typing types in Beam typehints (on Py2 and Py3).

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903397#comment-16903397 ] Udi Meiri commented on BEAM-7713: - Most important is to allow Beam users to only use typing hints. >

[jira] [Resolved] (BEAM-7836) Provide a way to exclude unit / integration tests with incompatible syntax from running under particular version of Python.

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-7836. - Resolution: Fixed Fix Version/s: Not applicable > Provide a way to exclude unit / integration

[jira] [Commented] (BEAM-7836) Provide a way to exclude unit / integration tests with incompatible syntax from running under particular version of Python.

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7836?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903209#comment-16903209 ] Udi Meiri commented on BEAM-7836: - The spotless and other Gradle task breakages were fixed as a part of

[jira] [Reopened] (BEAM-7608) v1new ReadFromDatastore skips entities

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reopened BEAM-7608: - reopening to get included in 2.15 > v1new ReadFromDatastore skips entities >

[jira] [Reopened] (BEAM-7828) Add key type conversion in from and to client entity in Datastore v1new IO.

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reopened BEAM-7828: - Reopening to get cherrypicked on 2.15 > Add key type conversion in from and to client entity in Datastore

[jira] [Updated] (BEAM-7828) Add key type conversion in from and to client entity in Datastore v1new IO.

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7828: Fix Version/s: (was: 2.16.0) 2.15.0 > Add key type conversion in from and to client

[jira] [Reopened] (BEAM-7476) Datastore write failures with "[Errno 32] Broken pipe"

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reopened BEAM-7476: - reopening so it gets cherrypicked onto 2.15 > Datastore write failures with "[Errno 32] Broken pipe" >

[jira] [Updated] (BEAM-7476) Datastore write failures with "[Errno 32] Broken pipe"

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7476: Status: Open (was: Triage Needed) > Datastore write failures with "[Errno 32] Broken pipe" >

[jira] [Updated] (BEAM-7476) Datastore write failures with "[Errno 32] Broken pipe"

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7476: Fix Version/s: (was: 2.16.0) 2.15.0 > Datastore write failures with "[Errno 32]

[jira] [Resolved] (BEAM-7476) Datastore write failures with "[Errno 32] Broken pipe"

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-7476. - Resolution: Fixed Fix Version/s: 2.16.0 > Datastore write failures with "[Errno 32] Broken pipe" >

[jira] [Commented] (BEAM-7917) Python datastore v1new fails on retry

2019-08-08 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7917?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903180#comment-16903180 ] Udi Meiri commented on BEAM-7917: - It seems that commit() always marks the batch as finished, which is

[jira] [Commented] (BEAM-7860) v1new ReadFromDatastore returns duplicates if keys are of mixed types

2019-08-07 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902495#comment-16902495 ] Udi Meiri commented on BEAM-7860: - merged > v1new ReadFromDatastore returns duplicates if keys are of

[jira] [Created] (BEAM-7924) Failure in Python 2 postcommit: crossLanguagePythonJavaFlink

2019-08-07 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7924: --- Summary: Failure in Python 2 postcommit: crossLanguagePythonJavaFlink Key: BEAM-7924 URL: https://issues.apache.org/jira/browse/BEAM-7924 Project: Beam Issue Type:

[jira] [Commented] (BEAM-7860) v1new ReadFromDatastore returns duplicates if keys are of mixed types

2019-08-07 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16902366#comment-16902366 ] Udi Meiri commented on BEAM-7860: - Hopefully PR will be merged today. > v1new ReadFromDatastore returns

[jira] [Created] (BEAM-7899) beam_PostCommit_Py_VR_Dataflow failure: build/apache-beam.tar.gz cannot be found

2019-08-05 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7899: --- Summary: beam_PostCommit_Py_VR_Dataflow failure: build/apache-beam.tar.gz cannot be found Key: BEAM-7899 URL: https://issues.apache.org/jira/browse/BEAM-7899 Project: Beam

[jira] [Resolved] (BEAM-7892) beam_Release_NightlySnapshot broken

2019-08-05 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7892?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-7892. - Resolution: Fixed Fix Version/s: Not applicable > beam_Release_NightlySnapshot broken >

[jira] [Commented] (BEAM-7892) beam_Release_NightlySnapshot broken

2019-08-05 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7892?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16900303#comment-16900303 ] Udi Meiri commented on BEAM-7892: - Sorry everyone for breaking the build. I should have tested more

[jira] [Updated] (BEAM-7860) v1new ReadFromDatastore returns duplicates if keys are of mixed types

2019-08-05 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7860: Fix Version/s: 2.15.0 > v1new ReadFromDatastore returns duplicates if keys are of mixed types >

[jira] [Updated] (BEAM-7860) v1new ReadFromDatastore returns duplicates if keys are of mixed types

2019-08-05 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7860: Priority: Blocker (was: Major) > v1new ReadFromDatastore returns duplicates if keys are of mixed types >

[jira] [Comment Edited] (BEAM-7860) v1new ReadFromDatastore returns duplicates if keys are of mixed types

2019-08-02 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899271#comment-16899271 ] Udi Meiri edited comment on BEAM-7860 at 8/2/19 11:51 PM: -- Verified that this

[jira] [Commented] (BEAM-7860) v1new ReadFromDatastore returns duplicates if keys are of mixed types

2019-08-02 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899273#comment-16899273 ] Udi Meiri commented on BEAM-7860: - I should be possible to work around this by setting num_splits=1 in

[jira] [Comment Edited] (BEAM-7860) v1new ReadFromDatastore returns duplicates if keys are of mixed types

2019-08-02 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899273#comment-16899273 ] Udi Meiri edited comment on BEAM-7860 at 8/2/19 11:18 PM: -- It should be possible

[jira] [Commented] (BEAM-7860) v1new ReadFromDatastore returns duplicates if keys are of mixed types

2019-08-02 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899271#comment-16899271 ] Udi Meiri commented on BEAM-7860: - Verified that this happens in both v1 and v1new. > v1new

[jira] [Resolved] (BEAM-7788) Go modules breaking precommits?

2019-08-02 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-7788. - Resolution: Fixed Fix Version/s: Not applicable > Go modules breaking precommits? >

[jira] [Commented] (BEAM-7884) Run pylint in Python 3

2019-08-02 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7884?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16899137#comment-16899137 ] Udi Meiri commented on BEAM-7884: - Optional step 0: Since files ending with py3.py (introduced in

[jira] [Created] (BEAM-7884) Run pylint in Python 3

2019-08-02 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7884: --- Summary: Run pylint in Python 3 Key: BEAM-7884 URL: https://issues.apache.org/jira/browse/BEAM-7884 Project: Beam Issue Type: Sub-task Components:

[jira] [Assigned] (BEAM-7860) v1new ReadFromDatastore returns duplicates if keys are of mixed types

2019-08-01 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-7860: --- Assignee: Udi Meiri > v1new ReadFromDatastore returns duplicates if keys are of mixed types >

[jira] [Resolved] (BEAM-7828) Add key type conversion in from and to client entity in Datastore v1new IO.

2019-08-01 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-7828. - Resolution: Fixed Fix Version/s: 2.16.0 > Add key type conversion in from and to client entity in

[jira] [Commented] (BEAM-7814) bigquery tests flaky with empty actual result values

2019-08-01 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16898369#comment-16898369 ] Udi Meiri commented on BEAM-7814: - Still buggy, PR forthcoming.

[jira] [Resolved] (BEAM-2264) Re-use credential instead of generating a new one one each GCS call

2019-08-01 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-2264. - Resolution: Fixed Fix Version/s: 2.15.0 > Re-use credential instead of generating a new one one

[jira] [Created] (BEAM-7867) DoFn invocation has wrong argument assignment

2019-07-31 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7867: --- Summary: DoFn invocation has wrong argument assignment Key: BEAM-7867 URL: https://issues.apache.org/jira/browse/BEAM-7867 Project: Beam Issue Type: Bug

[jira] [Resolved] (BEAM-6877) TypeHints Py3 Error: Type inference tests fail on Python 3.6 due to bytecode changes

2019-07-30 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-6877. - Resolution: Fixed Fix Version/s: 2.14.0 > TypeHints Py3 Error: Type inference tests fail on Python

[jira] [Resolved] (BEAM-7814) bigquery tests flaky with empty actual result values

2019-07-29 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-7814. - Resolution: Fixed > bigquery tests flaky with empty actual result values >

[jira] [Resolved] (BEAM-7608) v1new ReadFromDatastore skips entities

2019-07-26 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-7608. - Resolution: Fixed Fix Version/s: 2.15.0 > v1new ReadFromDatastore skips entities >

[jira] [Resolved] (BEAM-7641) collect statistics about python ITs

2019-07-26 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-7641. - Resolution: Fixed Fix Version/s: Not applicable > collect statistics about python ITs >

[jira] [Created] (BEAM-7831) :sdks:python:portableWordCountBatch out of memory in python precommit

2019-07-26 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7831: --- Summary: :sdks:python:portableWordCountBatch out of memory in python precommit Key: BEAM-7831 URL: https://issues.apache.org/jira/browse/BEAM-7831 Project: Beam

[jira] [Commented] (BEAM-7828) Add key type conversion in from and to client entity in Datastore v1new IO.

2019-07-26 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16894054#comment-16894054 ] Udi Meiri commented on BEAM-7828: - Any details? > Add key type conversion in from and to client entity in

[jira] [Updated] (BEAM-7814) bigquery tests flaky with empty actual result values

2019-07-25 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7814: Status: Open (was: Triage Needed) > bigquery tests flaky with empty actual result values >

[jira] [Reopened] (BEAM-7814) bigquery tests flaky with empty actual result values

2019-07-25 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reopened BEAM-7814: - Still happening:

[jira] [Updated] (BEAM-7814) bigquery tests flaky with empty actual result values

2019-07-24 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7814?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7814: Issue Type: Bug (was: New Feature) > bigquery tests flaky with empty actual result values >

[jira] [Created] (BEAM-7814) bigquery tests flaky with empty actual result values

2019-07-24 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7814: --- Summary: bigquery tests flaky with empty actual result values Key: BEAM-7814 URL: https://issues.apache.org/jira/browse/BEAM-7814 Project: Beam Issue Type: New

[jira] [Resolved] (BEAM-7679) examples.complete.game ITs might use the same BQ dataset

2019-07-24 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-7679. - Resolution: Fixed Fix Version/s: Not applicable > examples.complete.game ITs might use the same BQ

[jira] [Resolved] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-24 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-7650. - Resolution: Fixed Fix Version/s: Not applicable > Python Portable and HDFS IT need to clean up the

[jira] [Commented] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-24 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892156#comment-16892156 ] Udi Meiri commented on BEAM-7650: - This is done in #9138. One possible side-effect is that `docker system

[jira] [Commented] (BEAM-7713) Migrate to "typing" module typing types in Beam typehints (on Py2 and Py3).

2019-07-24 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7713?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892139#comment-16892139 ] Udi Meiri commented on BEAM-7713: - Goals: - Allow using typing module types for type hints in Beam

[jira] [Commented] (BEAM-7788) Go modules breaking precommits?

2019-07-24 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892066#comment-16892066 ] Udi Meiri commented on BEAM-7788: - I think that the speed up from keeping the git workspace around is

[jira] [Commented] (BEAM-7577) Allow the use of ValueProviders in datastore.v1new.datastoreio.ReadFromDatastore query

2019-07-24 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16892011#comment-16892011 ] Udi Meiri commented on BEAM-7577: - FYI, I've also opened https://issues.apache.org/jira/browse/BEAM-7810

[jira] [Created] (BEAM-7810) Allow ValueProvider arguments to ReadFromDatastore

2019-07-24 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7810: --- Summary: Allow ValueProvider arguments to ReadFromDatastore Key: BEAM-7810 URL: https://issues.apache.org/jira/browse/BEAM-7810 Project: Beam Issue Type: New Feature

[jira] [Assigned] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-23 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-7650: --- Assignee: Udi Meiri (was: Ankur Goenka) > Python Portable and HDFS IT need to clean up the docker

[jira] [Commented] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-23 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891435#comment-16891435 ] Udi Meiri commented on BEAM-7650: - I'm thinking of piggy-backing on the inventory job. WDYT? > Python

[jira] [Commented] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-23 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16891434#comment-16891434 ] Udi Meiri commented on BEAM-7650: - It's a racey command. I wouldn't want to run it more than once per day.

[jira] [Commented] (BEAM-7650) Python Portable and HDFS IT need to clean up the docker image after complete

2019-07-22 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890570#comment-16890570 ] Udi Meiri commented on BEAM-7650: - This should do the trick: {code} docker system prune --all --filter

[jira] [Commented] (BEAM-7798) After changes in type inference, apache_beam.io.gcp.bigquery_io_read_it_test.BigqueryIOReadIT.test_bigquery_read_1M_python is failing in Python 3.5 postcommits

2019-07-22 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890551#comment-16890551 ] Udi Meiri commented on BEAM-7798: - Thanks for triaging Valentyn. Robert, please add unit test if

[jira] [Commented] (BEAM-2155) Investigate problem creating Map PCollection view on Dataflow

2019-07-22 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16890465#comment-16890465 ] Udi Meiri commented on BEAM-2155: - I've tried my own slightly modified version and it seems to work. Logs

[jira] [Commented] (BEAM-7788) Go modules breaking precommits?

2019-07-19 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889165#comment-16889165 ] Udi Meiri commented on BEAM-7788: - Running as the jenkins user, the failed file is read-only: {code}

[jira] [Commented] (BEAM-7788) Go modules breaking precommits?

2019-07-19 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889163#comment-16889163 ] Udi Meiri commented on BEAM-7788: - {code}

[jira] [Commented] (BEAM-7788) Go modules breaking precommits?

2019-07-19 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16889108#comment-16889108 ] Udi Meiri commented on BEAM-7788: - I suspect that there are insufficient permissions to delete those

[jira] [Created] (BEAM-7788) Go modules breaking precommits?

2019-07-19 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7788: --- Summary: Go modules breaking precommits? Key: BEAM-7788 URL: https://issues.apache.org/jira/browse/BEAM-7788 Project: Beam Issue Type: Bug Components:

[jira] [Resolved] (BEAM-7784) Compilation error in Java PreCommit test suite: cannot find symbol ImmutableMap

2019-07-18 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-7784. - Resolution: Fixed Fix Version/s: Not applicable > Compilation error in Java PreCommit test suite:

[jira] [Updated] (BEAM-7784) Compilation error in Java PreCommit test suite: cannot find symbol ImmutableMap

2019-07-18 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7784: Status: Open (was: Triage Needed) > Compilation error in Java PreCommit test suite: cannot find symbol >

[jira] [Assigned] (BEAM-7784) Compilation error in Java PreCommit test suite: cannot find symbol ImmutableMap

2019-07-18 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-7784: --- Assignee: Udi Meiri (was: Alireza Samadianzakaria) > Compilation error in Java PreCommit test

[jira] [Commented] (BEAM-7784) Compilation error in Java PreCommit test suite: cannot find symbol ImmutableMap

2019-07-18 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16888415#comment-16888415 ] Udi Meiri commented on BEAM-7784: - This is due to an upgrade: https://github.com/apache/beam/pull/8899 >

[jira] [Created] (BEAM-7765) Add test for snippet accessing_valueprovider_info_after_run

2019-07-17 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7765: --- Summary: Add test for snippet accessing_valueprovider_info_after_run Key: BEAM-7765 URL: https://issues.apache.org/jira/browse/BEAM-7765 Project: Beam Issue Type:

[jira] [Updated] (BEAM-7763) Python DirectRunner _PubSubReadEvaluator creates new client per bundle

2019-07-17 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-7763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-7763: Status: Open (was: Triage Needed) > Python DirectRunner _PubSubReadEvaluator creates new client per bundle

[jira] [Comment Edited] (BEAM-2264) Re-use credential instead of generating a new one one each GCS call

2019-07-17 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887387#comment-16887387 ] Udi Meiri edited comment on BEAM-2264 at 7/17/19 8:16 PM: -- And also affects

[jira] [Created] (BEAM-7763) Python DirectRunner _PubSubReadEvaluator creates new client per bundle

2019-07-17 Thread Udi Meiri (JIRA)
Udi Meiri created BEAM-7763: --- Summary: Python DirectRunner _PubSubReadEvaluator creates new client per bundle Key: BEAM-7763 URL: https://issues.apache.org/jira/browse/BEAM-7763 Project: Beam

[jira] [Comment Edited] (BEAM-2264) Re-use credential instead of generating a new one one each GCS call

2019-07-17 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887387#comment-16887387 ] Udi Meiri edited comment on BEAM-2264 at 7/17/19 8:00 PM: -- And also affects

[jira] [Commented] (BEAM-2264) Re-use credential instead of generating a new one one each GCS call

2019-07-17 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16887387#comment-16887387 ] Udi Meiri commented on BEAM-2264: - And also affects pubsub:

[jira] [Commented] (BEAM-2264) Re-use credential instead of generating a new one one each GCS call

2019-07-16 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16886315#comment-16886315 ] Udi Meiri commented on BEAM-2264: - The same credential fetch issue also affects BQ reads here:

[jira] [Commented] (BEAM-2264) Re-use credential instead of generating a new one one each GCS call

2019-07-15 Thread Udi Meiri (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16885693#comment-16885693 ] Udi Meiri commented on BEAM-2264: - Migrating off of apitools-based clients (such as the one used for GCS)

<    1   2   3   4   5   6   7   8   9   >