[jira] [Commented] (BEAM-5706) PubSub dependency upgrade causes internal issues for Dataflow

[ https://issues.apache.org/jira/browse/BEAM-5706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650802#comment-16650802 ] Udi Meiri commented on BEAM-5706: - Internal investigation showed that the internal issues turned out to be

[jira] [Commented] (BEAM-5315) Finish Python 3 porting for io module

[ https://issues.apache.org/jira/browse/BEAM-5315?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650993#comment-16650993 ] Udi Meiri commented on BEAM-5315: - Hi, I'm working on upgrading Beam's datastore client dependency. How

[jira] [Commented] (BEAM-5712) Need an integration test for Datastore IO in Python

[ https://issues.apache.org/jira/browse/BEAM-5712?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16651005#comment-16651005 ] Udi Meiri commented on BEAM-5712: - https://github.com/apache/beam/pull/6642 > Need an integration test

[jira] [Commented] (BEAM-5539) Beam Dependency Update Request: google-cloud-pubsub

[ https://issues.apache.org/jira/browse/BEAM-5539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16650953#comment-16650953 ] Udi Meiri commented on BEAM-5539: - https://github.com/apache/beam/pull/6697 upgrades to 0.35.4 > Beam

[jira] [Resolved] (BEAM-5706) PubSub dependency upgrade causes internal issues for Dataflow

[ https://issues.apache.org/jira/browse/BEAM-5706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-5706. - Resolution: Fixed > PubSub dependency upgrade causes internal issues for Dataflow >

[jira] [Resolved] (BEAM-4492) Update Python bigquery library to latest version

[ https://issues.apache.org/jira/browse/BEAM-4492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-4492. - Resolution: Duplicate Fix Version/s: Not applicable I'm taking over upgrading bigquery client. See

[jira] [Commented] (BEAM-5794) TestDirectRunner: poll matchers for wait_until_finish_duration, then cancel the pipeline

[ https://issues.apache.org/jira/browse/BEAM-5794?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657097#comment-16657097 ] Udi Meiri commented on BEAM-5794: - Note that this would require reviewing all matchers to make sure they

[jira] [Created] (BEAM-5794) TestDirectRunner: poll matchers for wait_until_finish_duration, then cancel the pipeline

Udi Meiri created BEAM-5794: --- Summary: TestDirectRunner: poll matchers for wait_until_finish_duration, then cancel the pipeline Key: BEAM-5794 URL: https://issues.apache.org/jira/browse/BEAM-5794 Project:

[jira] [Comment Edited] (BEAM-5779) Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow

[ https://issues.apache.org/jira/browse/BEAM-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657012#comment-16657012 ] Udi Meiri edited comment on BEAM-5779 at 10/19/18 4:16 PM: --- The log from 6317

[jira] [Commented] (BEAM-5779) Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow

[ https://issues.apache.org/jira/browse/BEAM-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657012#comment-16657012 ] Udi Meiri commented on BEAM-5779: - The log from 6317 shows TestDataflowRunner attempting to cancel the job

[jira] [Commented] (BEAM-5779) Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow

[ https://issues.apache.org/jira/browse/BEAM-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657103#comment-16657103 ] Udi Meiri commented on BEAM-5779: - I think the error in 6321 is similar in nature: the job was cancelled

[jira] [Commented] (BEAM-5779) Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow

[ https://issues.apache.org/jira/browse/BEAM-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657078#comment-16657078 ] Udi Meiri commented on BEAM-5779: - Sadly it doesn't. The on_success_matcher is only run after the

[jira] [Commented] (BEAM-5779) Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow

[ https://issues.apache.org/jira/browse/BEAM-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16661104#comment-16661104 ] Udi Meiri commented on BEAM-5779: - Still failing:

[jira] [Commented] (BEAM-4256) Gradle setupVirtualenv task fails on Jenkins

[ https://issues.apache.org/jira/browse/BEAM-4256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670820#comment-16670820 ] Udi Meiri commented on BEAM-4256: - I can verify that shortening the path solved the issue, as we just came

[jira] [Resolved] (BEAM-4256) Gradle setupVirtualenv task fails on Jenkins

[ https://issues.apache.org/jira/browse/BEAM-4256?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-4256. - Resolution: Fixed Fix Version/s: Not applicable > Gradle setupVirtualenv task fails on Jenkins >

[jira] [Commented] (BEAM-5932) Python SDK deprecation warnings are broken

[ https://issues.apache.org/jira/browse/BEAM-5932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671009#comment-16671009 ] Udi Meiri commented on BEAM-5932: - [~tvalentyn] so you mean all warnings from warnings.warn() are printed,

[jira] [Created] (BEAM-5932) Python SDK deprecation warnings are broken

Udi Meiri created BEAM-5932: --- Summary: Python SDK deprecation warnings are broken Key: BEAM-5932 URL: https://issues.apache.org/jira/browse/BEAM-5932 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-5932) Python SDK deprecation warnings are broken

[ https://issues.apache.org/jira/browse/BEAM-5932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16671003#comment-16671003 ] Udi Meiri commented on BEAM-5932: - I don't believe it does enable all warnings, but I didn't read the PR

[jira] [Assigned] (BEAM-5462) get rid of .options deprecation warnings in tests

[ https://issues.apache.org/jira/browse/BEAM-5462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-5462: --- Assignee: Heejong Lee (was: Udi Meiri) > get rid of .options deprecation warnings in tests >

[jira] [Assigned] (BEAM-5462) get rid of .options deprecation warnings in tests

[ https://issues.apache.org/jira/browse/BEAM-5462?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-5462: --- Assignee: Udi Meiri > get rid of .options deprecation warnings in tests >

[jira] [Created] (BEAM-5959) Add Cloud KMS support to GCS copies

Udi Meiri created BEAM-5959: --- Summary: Add Cloud KMS support to GCS copies Key: BEAM-5959 URL: https://issues.apache.org/jira/browse/BEAM-5959 Project: Beam Issue Type: Bug Components:

[jira] [Resolved] (BEAM-5537) Beam Dependency Update Request: google-cloud-bigquery

[ https://issues.apache.org/jira/browse/BEAM-5537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-5537. - Resolution: Fixed Fix Version/s: 2.9.0 > Beam Dependency Update Request: google-cloud-bigquery >

[jira] [Resolved] (BEAM-5932) Python SDK deprecation warnings are broken

[ https://issues.apache.org/jira/browse/BEAM-5932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-5932. - Resolution: Fixed Fix Version/s: Not applicable PR merged > Python SDK deprecation warnings are

[jira] [Updated] (BEAM-5959) Add Cloud KMS support to GCS copies

[ https://issues.apache.org/jira/browse/BEAM-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-5959: Description: Beam SDK currently uses the CopyTo GCS API call, which doesn't support copying objects that

[jira] [Commented] (BEAM-4821) Update Built-in I/O transforms page for Python

[ https://issues.apache.org/jira/browse/BEAM-4821?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16678699#comment-16678699 ] Udi Meiri commented on BEAM-4821: - I believe both reads and writes are possible on HDFS. > Update

[jira] [Created] (BEAM-6033) normalize httplib2.Http initialization and usage

Udi Meiri created BEAM-6033: --- Summary: normalize httplib2.Http initialization and usage Key: BEAM-6033 URL: https://issues.apache.org/jira/browse/BEAM-6033 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-6033) normalize httplib2.Http initialization and usage

[ https://issues.apache.org/jira/browse/BEAM-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-6033: Description: Ideally solve both issues below in one PR, but issue 1 has priority as it can halt a

[jira] [Commented] (BEAM-6018) Memory leak in GCSUtil.java executeBatches

[ https://issues.apache.org/jira/browse/BEAM-6018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679186#comment-16679186 ] Udi Meiri commented on BEAM-6018: - Peeking at the code in MoreExecutors.java, addDelayedShutdownHook()

[jira] [Created] (BEAM-6018) Memory leak in GCSUtil.java executeBatches

Udi Meiri created BEAM-6018: --- Summary: Memory leak in GCSUtil.java executeBatches Key: BEAM-6018 URL: https://issues.apache.org/jira/browse/BEAM-6018 Project: Beam Issue Type: Bug

[jira] [Comment Edited] (BEAM-6047) hdfsIntegrationTest is failing due to DisallowedDatanodeException

[ https://issues.apache.org/jira/browse/BEAM-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684608#comment-16684608 ] Udi Meiri edited comment on BEAM-6047 at 11/13/18 1:52 AM: --- The script was

[jira] [Commented] (BEAM-6047) hdfsIntegrationTest is failing due to DisallowedDatanodeException

[ https://issues.apache.org/jira/browse/BEAM-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16684608#comment-16684608 ] Udi Meiri commented on BEAM-6047: - The script pruned old networks but leftover containers still referenced

[jira] [Commented] (BEAM-6047) hdfsIntegrationTest is failing due to DisallowedDatanodeException

[ https://issues.apache.org/jira/browse/BEAM-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685949#comment-16685949 ] Udi Meiri commented on BEAM-6047: - Previous theory was wrong, but the PR is beneficial for running the

[jira] [Assigned] (BEAM-6033) normalize httplib2.Http initialization and usage

[ https://issues.apache.org/jira/browse/BEAM-6033?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-6033: --- Assignee: Heejong Lee > normalize httplib2.Http initialization and usage >

[jira] [Created] (BEAM-6072) add encrypt/decrypt permissions for Cloud KMS key testing

Udi Meiri created BEAM-6072: --- Summary: add encrypt/decrypt permissions for Cloud KMS key testing Key: BEAM-6072 URL: https://issues.apache.org/jira/browse/BEAM-6072 Project: Beam Issue Type: Task

[jira] [Assigned] (BEAM-5514) BigQueryIO doesn't handle quotaExceeded errors properly

[ https://issues.apache.org/jira/browse/BEAM-5514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-5514: --- Assignee: Heejong Lee (was: Chamikara Jayalath) > BigQueryIO doesn't handle quotaExceeded errors

[jira] [Commented] (BEAM-6048) pylint-27 failed but not caught in Pre/PostCommit

[ https://issues.apache.org/jira/browse/BEAM-6048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16687385#comment-16687385 ] Udi Meiri commented on BEAM-6048: - https://github.com/apache/beam/pull/7048 should fix it > pylint-27

[jira] [Resolved] (BEAM-6018) Memory leak in GCSUtil.java executeBatches

[ https://issues.apache.org/jira/browse/BEAM-6018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-6018. - Resolution: Fixed Fix Version/s: 2.9.0 > Memory leak in GCSUtil.java executeBatches >

[jira] [Resolved] (BEAM-6047) hdfsIntegrationTest is failing due to DisallowedDatanodeException

[ https://issues.apache.org/jira/browse/BEAM-6047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-6047. - Resolution: Fixed Fix Version/s: Not applicable > hdfsIntegrationTest is failing due to

[jira] [Updated] (BEAM-5948) Add a ParquetIO integration test

[ https://issues.apache.org/jira/browse/BEAM-5948?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-5948: Issue Type: Test (was: Bug) > Add a ParquetIO integration test > > >

[jira] [Updated] (BEAM-5959) Add Cloud KMS support to GCS creates copies

[ https://issues.apache.org/jira/browse/BEAM-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-5959: Summary: Add Cloud KMS support to GCS creates copies (was: Add Cloud KMS support to GCS copies) > Add

[jira] [Updated] (BEAM-5959) Add Cloud KMS support to GCS creates and copies

[ https://issues.apache.org/jira/browse/BEAM-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-5959: Summary: Add Cloud KMS support to GCS creates and copies (was: Add Cloud KMS support to GCS creates

[jira] [Commented] (BEAM-6489) Python precommits are failiing due to a pip error: "no such option: --process-dependency-links"

[ https://issues.apache.org/jira/browse/BEAM-6489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16749324#comment-16749324 ] Udi Meiri commented on BEAM-6489: - [~markflyhigh] believes this is due to a new version of pip:

[jira] [Assigned] (BEAM-5539) Beam Dependency Update Request: google-cloud-pubsub

[ https://issues.apache.org/jira/browse/BEAM-5539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-5539: --- Assignee: Heejong Lee (was: Udi Meiri) > Beam Dependency Update Request: google-cloud-pubsub >

[jira] [Created] (BEAM-6251) perfkit tests log should include gradle logs

Udi Meiri created BEAM-6251: --- Summary: perfkit tests log should include gradle logs Key: BEAM-6251 URL: https://issues.apache.org/jira/browse/BEAM-6251 Project: Beam Issue Type: Bug

[jira] [Commented] (BEAM-6251) perfkit tests log should include gradle logs

[ https://issues.apache.org/jira/browse/BEAM-6251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16723409#comment-16723409 ] Udi Meiri commented on BEAM-6251: - Fix will probably be in this code:

[jira] [Resolved] (BEAM-6272) :beam-sdks-java-io-hadoop-format:test fails due to static port conflict

[ https://issues.apache.org/jira/browse/BEAM-6272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-6272. - Resolution: Duplicate Fix Version/s: Not applicable > :beam-sdks-java-io-hadoop-format:test fails

[jira] [Commented] (BEAM-5779) Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow

[ https://issues.apache.org/jira/browse/BEAM-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726998#comment-16726998 ] Udi Meiri commented on BEAM-5779: - Went away on its own. Closing, please reopen if this happens again. >

[jira] [Resolved] (BEAM-5779) Failure in beam_PostCommit_Python_Verify PubSubIntegrationTest on Dataflow

[ https://issues.apache.org/jira/browse/BEAM-5779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-5779. - Resolution: Cannot Reproduce Fix Version/s: Not applicable > Failure in

[jira] [Commented] (BEAM-6072) add encrypt/decrypt permissions for Cloud KMS key testing

[ https://issues.apache.org/jira/browse/BEAM-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16705290#comment-16705290 ] Udi Meiri commented on BEAM-6072: - Figured out which service account needs permissions:

[jira] [Resolved] (BEAM-6072) add encrypt/decrypt permissions for Cloud KMS key testing

[ https://issues.apache.org/jira/browse/BEAM-6072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-6072. - Resolution: Fixed Fix Version/s: Not applicable > add encrypt/decrypt permissions for Cloud KMS

[jira] [Commented] (BEAM-6171) beam_PostCommit_Java_GradleBuild timing out (4 hours)

[ https://issues.apache.org/jira/browse/BEAM-6171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708060#comment-16708060 ] Udi Meiri commented on BEAM-6171: - Failing tests: 12:05:11

[jira] [Commented] (BEAM-6171) beam_PostCommit_Java_GradleBuild timing out (4 hours)

[ https://issues.apache.org/jira/browse/BEAM-6171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16708064#comment-16708064 ] Udi Meiri commented on BEAM-6171: - [~charleschen] > beam_PostCommit_Java_GradleBuild timing out (4 hours)

[jira] [Created] (BEAM-6171) beam_PostCommit_Java_GradleBuild timing out (4 hours)

Udi Meiri created BEAM-6171: --- Summary: beam_PostCommit_Java_GradleBuild timing out (4 hours) Key: BEAM-6171 URL: https://issues.apache.org/jira/browse/BEAM-6171 Project: Beam Issue Type: Task

[jira] [Updated] (BEAM-6171) beam_PostCommit_Java_GradleBuild timing out (4 hours)

[ https://issues.apache.org/jira/browse/BEAM-6171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-6171: Issue Type: Bug (was: Task) > beam_PostCommit_Java_GradleBuild timing out (4 hours) >

[jira] [Resolved] (BEAM-6196) NExmark result in google redirects to non-existent site

[ https://issues.apache.org/jira/browse/BEAM-6196?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-6196. - Resolution: Fixed Fix Version/s: Not applicable > NExmark result in google redirects to

[jira] [Commented] (BEAM-6171) beam_PostCommit_Java_GradleBuild timing out (4 hours)

[ https://issues.apache.org/jira/browse/BEAM-6171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16709474#comment-16709474 ] Udi Meiri commented on BEAM-6171: - Any updates? > beam_PostCommit_Java_GradleBuild timing out (4 hours) >

[jira] [Resolved] (BEAM-4741) Upgrade Python BigQuery client to latest version

[ https://issues.apache.org/jira/browse/BEAM-4741?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-4741. - Resolution: Duplicate Fix Version/s: Not applicable > Upgrade Python BigQuery client to latest

[jira] [Updated] (BEAM-6352) Watch PTransform is broken

[ https://issues.apache.org/jira/browse/BEAM-6352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-6352: Priority: Blocker (was: Major) > Watch PTransform is broken > -- > >

[jira] [Assigned] (BEAM-6352) Watch PTransform is broken

[ https://issues.apache.org/jira/browse/BEAM-6352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-6352: --- Assignee: Scott Wegner (was: Kenneth Knowles) > Watch PTransform is broken >

[jira] [Reopened] (BEAM-5718) Exclude Bigquery IO Read IT

[ https://issues.apache.org/jira/browse/BEAM-5718?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reopened BEAM-5718: - BigQueryIOReadIT.class is still excluded > Exclude Bigquery IO Read IT > > >

[jira] [Assigned] (BEAM-6362) reduce logging volume on Jenkins pre-commit and post-commit jobs

[ https://issues.apache.org/jira/browse/BEAM-6362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-6362: --- Assignee: Udi Meiri (was: Luke Cwik) > reduce logging volume on Jenkins pre-commit and post-commit

[jira] [Updated] (BEAM-6357) Datastore Python client: retry on ABORTED rpc responses

[ https://issues.apache.org/jira/browse/BEAM-6357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-6357: Summary: Datastore Python client: retry on ABORTED rpc responses (was: Datastore clients: retry on ABORTED

[jira] [Resolved] (BEAM-6362) reduce logging volume on Jenkins pre-commit and post-commit jobs

[ https://issues.apache.org/jira/browse/BEAM-6362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-6362. - Resolution: Fixed Fix Version/s: Not applicable > reduce logging volume on Jenkins pre-commit and

[jira] [Commented] (BEAM-6352) Watch PTransform is broken

[ https://issues.apache.org/jira/browse/BEAM-6352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736519#comment-16736519 ] Udi Meiri commented on BEAM-6352: - I can recreate this in 2.9.0, using the Java quickstart instructions

[jira] [Updated] (BEAM-6352) Watch PTransform is broken

[ https://issues.apache.org/jira/browse/BEAM-6352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-6352: Affects Version/s: 2.9.0 > Watch PTransform is broken > -- > > Key:

[jira] [Commented] (BEAM-6362) reduce logging volume on Jenkins pre-commit and post-commit jobs

[ https://issues.apache.org/jira/browse/BEAM-6362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16733753#comment-16733753 ] Udi Meiri commented on BEAM-6362: - The plan is: 1. Remove --info. Test tasks (at least for Java) should

[jira] [Created] (BEAM-6357) Datastore clients: retry on ABORTED rpc responses

Udi Meiri created BEAM-6357: --- Summary: Datastore clients: retry on ABORTED rpc responses Key: BEAM-6357 URL: https://issues.apache.org/jira/browse/BEAM-6357 Project: Beam Issue Type: Bug

[jira] [Updated] (BEAM-6357) Datastore clients: retry on ABORTED rpc responses

[ https://issues.apache.org/jira/browse/BEAM-6357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-6357: Component/s: (was: io-java-gcp) > Datastore clients: retry on ABORTED rpc responses >

[jira] [Created] (BEAM-6362) reduce logging volume on Jenkins pre-commit and post-commit jobs

Udi Meiri created BEAM-6362: --- Summary: reduce logging volume on Jenkins pre-commit and post-commit jobs Key: BEAM-6362 URL: https://issues.apache.org/jira/browse/BEAM-6362 Project: Beam Issue

[jira] [Commented] (BEAM-6357) Datastore clients: retry on ABORTED rpc responses

[ https://issues.apache.org/jira/browse/BEAM-6357?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16733460#comment-16733460 ] Udi Meiri commented on BEAM-6357: - Removing Java component, as it actually does retry on ABORTED already.

[jira] [Commented] (BEAM-1440) Create a BigQuery source (that implements iobase.BoundedSource) for Python SDK

[ https://issues.apache.org/jira/browse/BEAM-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16799407#comment-16799407 ] Udi Meiri commented on BEAM-1440: - Any progress on this? This would allow templates to set sources (query

[jira] [Commented] (BEAM-6668) use add experiment methods (Java and Python)

[ https://issues.apache.org/jira/browse/BEAM-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16805335#comment-16805335 ] Udi Meiri commented on BEAM-6668: - [~tvalentyn] > use add experiment methods (Java and Python) >

[jira] [Created] (BEAM-6917) ClickHouseIOTest failing in Java Precommits

Udi Meiri created BEAM-6917: --- Summary: ClickHouseIOTest failing in Java Precommits Key: BEAM-6917 URL: https://issues.apache.org/jira/browse/BEAM-6917 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-6210) Conflicting Libraries

[ https://issues.apache.org/jira/browse/BEAM-6210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812614#comment-16812614 ] Udi Meiri commented on BEAM-6210: - I'm afraid this bug will stay unresolved until

[jira] [Commented] (BEAM-5067) Switch from datastore-v1-protos to proto-google-cloud-datastore-v1

[ https://issues.apache.org/jira/browse/BEAM-5067?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16812619#comment-16812619 ] Udi Meiri commented on BEAM-5067: - The PR was merged so I'm closing this as resolved. Please reopen if

[jira] [Resolved] (BEAM-5067) Switch from datastore-v1-protos to proto-google-cloud-datastore-v1

[ https://issues.apache.org/jira/browse/BEAM-5067?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-5067. - Resolution: Fixed Fix Version/s: Not applicable > Switch from datastore-v1-protos to

[jira] [Commented] (BEAM-1440) Create a BigQuery source (that implements iobase.BoundedSource) for Python SDK

[ https://issues.apache.org/jira/browse/BEAM-1440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800901#comment-16800901 ] Udi Meiri commented on BEAM-1440: - [~pabloem] To be clear, this bug is for sources not sinks. > Create a

[jira] [Resolved] (BEAM-2969) BigQueryIO fails when reading then writing timestamps before 1970

[ https://issues.apache.org/jira/browse/BEAM-2969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-2969. - Resolution: Fixed Fix Version/s: 2.12.0 > BigQueryIO fails when reading then writing timestamps

[jira] [Resolved] (BEAM-6459) gradle clean depends on setupVirtualEnv, which installs lots of stuff

[ https://issues.apache.org/jira/browse/BEAM-6459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-6459. - Resolution: Fixed Fix Version/s: Not applicable > gradle clean depends on setupVirtualEnv, which

[jira] [Resolved] (BEAM-1267) BigQueryIO.Write should support the ignoreUnknownValues option

[ https://issues.apache.org/jira/browse/BEAM-1267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-1267. - Resolution: Duplicate Fix Version/s: Not applicable This has been implemented. > BigQueryIO.Write

[jira] [Assigned] (BEAM-3713) Consider moving away from nose to nose2 or pytest.

[ https://issues.apache.org/jira/browse/BEAM-3713?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-3713: --- Assignee: Udi Meiri > Consider moving away from nose to nose2 or pytest. >

[jira] [Assigned] (BEAM-2969) BigQueryIO fails when reading then writing timestamps before 1970

[ https://issues.apache.org/jira/browse/BEAM-2969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-2969: --- Assignee: Udi Meiri > BigQueryIO fails when reading then writing timestamps before 1970 >

[jira] [Created] (BEAM-6775) Fix "unparseable args" warning for --kms_key_name

Udi Meiri created BEAM-6775: --- Summary: Fix "unparseable args" warning for --kms_key_name Key: BEAM-6775 URL: https://issues.apache.org/jira/browse/BEAM-6775 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-6636) [beam_PostCommit_Java] testGcsWriteWithKmsKey test fails

[ https://issues.apache.org/jira/browse/BEAM-6636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16763819#comment-16763819 ] Udi Meiri commented on BEAM-6636: - Detailed log are actually available:

[jira] [Created] (BEAM-6658) Add kms_key to BigQuery transforms, pass to Dataflow

Udi Meiri created BEAM-6658: --- Summary: Add kms_key to BigQuery transforms, pass to Dataflow Key: BEAM-6658 URL: https://issues.apache.org/jira/browse/BEAM-6658 Project: Beam Issue Type:

[jira] [Updated] (BEAM-6658) Add kms_key to BigQuery transforms, pass to Dataflow

[ https://issues.apache.org/jira/browse/BEAM-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-6658: Priority: Blocker (was: Major) > Add kms_key to BigQuery transforms, pass to Dataflow >

[jira] [Created] (BEAM-6660) Integration tests for KMS: BigQuery Dataflow native IO

Udi Meiri created BEAM-6660: --- Summary: Integration tests for KMS: BigQuery Dataflow native IO Key: BEAM-6660 URL: https://issues.apache.org/jira/browse/BEAM-6660 Project: Beam Issue Type:

[jira] [Resolved] (BEAM-6658) Add kms_key to BigQuery transforms, pass to Dataflow

[ https://issues.apache.org/jira/browse/BEAM-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-6658. - Resolution: Fixed Fix Version/s: Not applicable > Add kms_key to BigQuery transforms, pass to

[jira] [Commented] (BEAM-6380) apache_beam.examples.wordcount_it_test.WordCountIT with DirectRunner failed

[ https://issues.apache.org/jira/browse/BEAM-6380?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767773#comment-16767773 ] Udi Meiri commented on BEAM-6380: - Reference doc:

[jira] [Commented] (BEAM-6636) [beam_PostCommit_Java] testGcsWriteWithKmsKey test fails

[ https://issues.apache.org/jira/browse/BEAM-6636?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16767785#comment-16767785 ] Udi Meiri commented on BEAM-6636: - I believe this is fixed. Java post-commits are currently green. >

[jira] [Created] (BEAM-6669) revert service_default_cmek_config experiment flag

Udi Meiri created BEAM-6669: --- Summary: revert service_default_cmek_config experiment flag Key: BEAM-6669 URL: https://issues.apache.org/jira/browse/BEAM-6669 Project: Beam Issue Type: Improvement

[jira] [Updated] (BEAM-6668) use add experiment methods (Java and Python)

[ https://issues.apache.org/jira/browse/BEAM-6668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-6668: Labels: beginner easyfix newbie (was: ) > use add experiment methods (Java and Python) >

[jira] [Commented] (BEAM-5959) Add Cloud KMS support to GCS creates and copies

[ https://issues.apache.org/jira/browse/BEAM-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1676#comment-1676 ] Udi Meiri commented on BEAM-5959: - Copy support is done (implemented as a rewrite call). Create support

[jira] [Assigned] (BEAM-6380) apache_beam.examples.wordcount_it_test.WordCountIT with DirectRunner failed

[ https://issues.apache.org/jira/browse/BEAM-6380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-6380: --- Assignee: Udi Meiri > apache_beam.examples.wordcount_it_test.WordCountIT with DirectRunner failed >

[jira] [Resolved] (BEAM-6636) [beam_PostCommit_Java] testGcsWriteWithKmsKey test fails

[ https://issues.apache.org/jira/browse/BEAM-6636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-6636. - Resolution: Fixed Fix Version/s: Not applicable > [beam_PostCommit_Java] testGcsWriteWithKmsKey

[jira] [Assigned] (BEAM-2801) Implement a BigQuery custom sink

[ https://issues.apache.org/jira/browse/BEAM-2801?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri reassigned BEAM-2801: --- Assignee: Pablo Estrada (was: Udi Meiri) > Implement a BigQuery custom sink >

[jira] [Updated] (BEAM-6658) Add kms_key to BigQuery transforms, pass to Dataflow

[ https://issues.apache.org/jira/browse/BEAM-6658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-6658: Fix Version/s: (was: Not applicable) 2.11.0 > Add kms_key to BigQuery transforms,

[jira] [Updated] (BEAM-5959) Add Cloud KMS support to GCS copies

[ https://issues.apache.org/jira/browse/BEAM-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri updated BEAM-5959: Summary: Add Cloud KMS support to GCS copies (was: Add Cloud KMS support to GCS creates and copies) > Add

[jira] [Resolved] (BEAM-5959) Add Cloud KMS support to GCS copies

[ https://issues.apache.org/jira/browse/BEAM-5959?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Udi Meiri resolved BEAM-5959. - Resolution: Fixed Fix Version/s: 2.11.0 > Add Cloud KMS support to GCS copies >

[jira] [Created] (BEAM-6668) use add experiment methods (Java and Python)

Udi Meiri created BEAM-6668: --- Summary: use add experiment methods (Java and Python) Key: BEAM-6668 URL: https://issues.apache.org/jira/browse/BEAM-6668 Project: Beam Issue Type: Improvement

  1   2   3   4   5   6   7   8   9   >