[jira] [Assigned] (BEAM-8298) Implement state caching for side inputs for Python

[ https://issues.apache.org/jira/browse/BEAM-8298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-8298: --- Assignee: Robert Bradshaw (was: Jing Chen) > Implement state caching for side inputs for Python >

[jira] [Closed] (BEAM-8298) Implement state caching for side inputs for Python

[ https://issues.apache.org/jira/browse/BEAM-8298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik closed BEAM-8298. --- Fix Version/s: 2.20.0 Resolution: Fixed > Implement state caching for side inputs for Python >

[jira] [Updated] (BEAM-8298) Implement state caching for side inputs for Python

[ https://issues.apache.org/jira/browse/BEAM-8298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-8298: Summary: Implement state caching for side inputs for Python (was: Implement state caching for side inputs)

[jira] [Commented] (BEAM-9206) Easy way to run checkJavaLinkage?

[ https://issues.apache.org/jira/browse/BEAM-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17027068#comment-17027068 ] Luke Cwik commented on BEAM-9206: - Option 3: Linkage checker outputs the result into a file, it also can

[jira] [Commented] (BEAM-9206) Easy way to run checkJavaLinkage?

[ https://issues.apache.org/jira/browse/BEAM-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026887#comment-17026887 ] Luke Cwik commented on BEAM-9206: - Reading the diff is difficult.   Typically I have seen people use an

[jira] [Closed] (BEAM-9220) Add use_runner_v2 argument for dataflow

[ https://issues.apache.org/jira/browse/BEAM-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik closed BEAM-9220. --- Fix Version/s: 2.20.0 Resolution: Fixed > Add use_runner_v2 argument for dataflow >

[jira] [Updated] (BEAM-8989) Backwards incompatible change in ParDo.getSideInputs (caught by failure when running Apache Nemo quickstart)

[ https://issues.apache.org/jira/browse/BEAM-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-8989: Affects Version/s: 2.19.0 > Backwards incompatible change in ParDo.getSideInputs (caught by failure when >

[jira] [Updated] (BEAM-8989) Backwards incompatible change in ParDo.getSideInputs (caught by failure when running Apache Nemo quickstart)

[ https://issues.apache.org/jira/browse/BEAM-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-8989: Fix Version/s: (was: 2.19.0) 2.20.0 > Backwards incompatible change in

[jira] [Commented] (BEAM-8989) Backwards incompatible change in ParDo.getSideInputs (caught by failure when running Apache Nemo quickstart)

[ https://issues.apache.org/jira/browse/BEAM-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17026262#comment-17026262 ] Luke Cwik commented on BEAM-8989: - I'm not aware of any progress. Since RC1 is already built it makes

[jira] [Closed] (BEAM-9204) HBase SDF @SplitRestriction does not take the range input into account to restrict splits

[ https://issues.apache.org/jira/browse/BEAM-9204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik closed BEAM-9204. --- Fix Version/s: 2.20.0 Resolution: Fixed > HBase SDF @SplitRestriction does not take the range input

[jira] [Commented] (BEAM-4735) Make HBaseIO.read() based on SDF

[ https://issues.apache.org/jira/browse/BEAM-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024812#comment-17024812 ] Luke Cwik commented on BEAM-4735: - I noticed there was a bug in the `@SplitRestriction`. The range input

[jira] [Closed] (BEAM-9176) Update dataflow Java container

[ https://issues.apache.org/jira/browse/BEAM-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik closed BEAM-9176. --- Fix Version/s: 2.20.0 Resolution: Fixed > Update dataflow Java container >

[jira] [Assigned] (BEAM-9176) Update dataflow Java container

[ https://issues.apache.org/jira/browse/BEAM-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-9176: --- Assignee: Ahmet Altay (was: Luke Cwik) > Update dataflow Java container >

[jira] [Updated] (BEAM-9176) Update dataflow Java container

[ https://issues.apache.org/jira/browse/BEAM-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-9176: Status: Open (was: Triage Needed) > Update dataflow Java container > -- > >

[jira] [Updated] (BEAM-9176) Update dataflow Java container

[ https://issues.apache.org/jira/browse/BEAM-9176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-9176: Summary: Update dataflow Java container (was: Update dataflow container) > Update dataflow Java container

[jira] [Created] (BEAM-9176) Update dataflow container

Luke Cwik created BEAM-9176: --- Summary: Update dataflow container Key: BEAM-9176 URL: https://issues.apache.org/jira/browse/BEAM-9176 Project: Beam Issue Type: Improvement Components:

[jira] [Created] (BEAM-9173) Remove the need to patch up the coder for DataflowRunner iterable side inputs on the unified worker

Luke Cwik created BEAM-9173: --- Summary: Remove the need to patch up the coder for DataflowRunner iterable side inputs on the unified worker Key: BEAM-9173 URL: https://issues.apache.org/jira/browse/BEAM-9173

[jira] [Commented] (BEAM-9144) Beam's own Avro TimeConversion class in beam-sdk-java-core

[ https://issues.apache.org/jira/browse/BEAM-9144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17020473#comment-17020473 ] Luke Cwik commented on BEAM-9144: - You have to look at the stackdriver logs to find out what is going on.

[jira] [Closed] (BEAM-8695) Beam Dependency Update Request: com.google.http-client:google-http-client

[ https://issues.apache.org/jira/browse/BEAM-8695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik closed BEAM-8695. --- Fix Version/s: 2.20.0 Assignee: Tomo Suzuki Resolution: Fixed > Beam Dependency Update

[jira] [Closed] (BEAM-9124) Upgrade linkage checker 1.1.2 to avoid Maven HTTPS problem

[ https://issues.apache.org/jira/browse/BEAM-9124?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik closed BEAM-9124. --- Fix Version/s: 2.20.0 Resolution: Fixed > Upgrade linkage checker 1.1.2 to avoid Maven HTTPS problem >

[jira] [Resolved] (BEAM-9030) Bump grpc to 1.26.0

[ https://issues.apache.org/jira/browse/BEAM-9030?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-9030. - Fix Version/s: 2.20.0 Resolution: Fixed > Bump grpc to 1.26.0 > --- > >

[jira] [Closed] (BEAM-9126) TestStreamTest.testDiscarding mode fails for Dataflow since Dataflow TestStream only updates watermarks at 1s resolution.

[ https://issues.apache.org/jira/browse/BEAM-9126?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik closed BEAM-9126. --- Fix Version/s: 2.20.0 Resolution: Fixed > TestStreamTest.testDiscarding mode fails for Dataflow since

[jira] [Commented] (BEAM-9030) Bump grpc to 1.26.0

[ https://issues.apache.org/jira/browse/BEAM-9030?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17014733#comment-17014733 ] Luke Cwik commented on BEAM-9030: - 1.26.0 has now been released and we can move onto updating the existing

[jira] [Updated] (BEAM-9078) Large Tarball Artifacts Should Use GCS Resumable Upload

[ https://issues.apache.org/jira/browse/BEAM-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-9078: Status: Open (was: Triage Needed) > Large Tarball Artifacts Should Use GCS Resumable Upload >

[jira] [Updated] (BEAM-9059) Migrate PTransformTranslation to use string constants

[ https://issues.apache.org/jira/browse/BEAM-9059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-9059: Status: Open (was: Triage Needed) > Migrate PTransformTranslation to use string constants >

[jira] [Created] (BEAM-9059) Migrate PTransformTranslation to use string constants

Luke Cwik created BEAM-9059: --- Summary: Migrate PTransformTranslation to use string constants Key: BEAM-9059 URL: https://issues.apache.org/jira/browse/BEAM-9059 Project: Beam Issue Type:

[jira] [Assigned] (BEAM-58) Support Google Cloud Storage encryption keys

[ https://issues.apache.org/jira/browse/BEAM-58?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-58: - Assignee: Valentyn Tymofieiev > Support Google Cloud Storage encryption keys >

[jira] [Commented] (BEAM-58) Support Google Cloud Storage encryption keys

[ https://issues.apache.org/jira/browse/BEAM-58?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17009081#comment-17009081 ] Luke Cwik commented on BEAM-58: --- [~tvalentyn], is this now supported? > Support Google Cloud Storage

[jira] [Closed] (BEAM-8696) Beam Dependency Update Request: com.google.protobuf:protobuf-java

[ https://issues.apache.org/jira/browse/BEAM-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik closed BEAM-8696. --- Fix Version/s: 2.19.0 Resolution: Fixed > Beam Dependency Update Request:

[jira] [Closed] (BEAM-9055) Unify the config names of Fn Data API across languages

[ https://issues.apache.org/jira/browse/BEAM-9055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik closed BEAM-9055. --- Resolution: Fixed > Unify the config names of Fn Data API across languages >

[jira] [Closed] (BEAM-9053) Improve error message when unable to get the correct filesystem for specified path in Python SDK

[ https://issues.apache.org/jira/browse/BEAM-9053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik closed BEAM-9053. --- Fix Version/s: 2.19.0 Resolution: Fixed > Improve error message when unable to get the correct

[jira] [Resolved] (BEAM-8935) Fail fast if sdk harness startup failed

[ https://issues.apache.org/jira/browse/BEAM-8935?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-8935. - Resolution: Fixed > Fail fast if sdk harness startup failed > --- > >

[jira] [Commented] (BEAM-7951) Allow runner to configure customization WindowedValue coder such as ValueOnlyWindowedValueCoder

[ https://issues.apache.org/jira/browse/BEAM-7951?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002462#comment-17002462 ] Luke Cwik commented on BEAM-7951: - There is still outstanding work: # to apply my [last reviews comment

[jira] [Resolved] (BEAM-8846) Force synchronization of the stream observer in BeamFnControlClient

[ https://issues.apache.org/jira/browse/BEAM-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-8846. - Fix Version/s: 2.19.0 Resolution: Not A Problem > Force synchronization of the stream observer in

[jira] [Comment Edited] (BEAM-8846) Force synchronization of the stream observer in BeamFnControlClient

[ https://issues.apache.org/jira/browse/BEAM-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002445#comment-17002445 ] Luke Cwik edited comment on BEAM-8846 at 12/23/19 7:12 PM: --- The stream observers

[jira] [Commented] (BEAM-8846) Force synchronization of the stream observer in BeamFnControlClient

[ https://issues.apache.org/jira/browse/BEAM-8846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002445#comment-17002445 ] Luke Cwik commented on BEAM-8846: - The stream observers are meant to be thread safe already. All that

[jira] [Resolved] (BEAM-9000) Java Test Assertions without toString for GenericJson subclasses

[ https://issues.apache.org/jira/browse/BEAM-9000?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-9000. - Fix Version/s: 2.19.0 Resolution: Fixed > Java Test Assertions without toString for GenericJson

[jira] [Assigned] (BEAM-8897) JdbcIO.readRows issue when type is Numeric

[ https://issues.apache.org/jira/browse/BEAM-8897?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-8897: --- Assignee: Shashanka Balakuntala Srinivasa > JdbcIO.readRows issue when type is Numeric >

[jira] [Assigned] (BEAM-8987) Support reverse/descending order in SortValues

[ https://issues.apache.org/jira/browse/BEAM-8987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-8987: --- Assignee: Shashanka Balakuntala Srinivasa > Support reverse/descending order in SortValues >

[jira] [Assigned] (BEAM-9014) Update CachingShuffleBatchReader to record weights by size in bytes

[ https://issues.apache.org/jira/browse/BEAM-9014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-9014: --- Assignee: Tyson Hamilton > Update CachingShuffleBatchReader to record weights by size in bytes >

[jira] [Commented] (BEAM-9020) LengthPrefixUnknownCodersTest to avoid relying on AbstractMap's equality

[ https://issues.apache.org/jira/browse/BEAM-9020?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17002387#comment-17002387 ] Luke Cwik commented on BEAM-9020: - Should be non-issue as long as the tests are updated to use

[jira] [Closed] (BEAM-9014) Update CachingShuffleBatchReader to record weights by size in bytes

[ https://issues.apache.org/jira/browse/BEAM-9014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik closed BEAM-9014. --- Fix Version/s: 2.19.0 Resolution: Fixed > Update CachingShuffleBatchReader to record weights by size

[jira] [Created] (BEAM-9014) Update CachingShuffleBatchReader to record weights by size in bytes

Luke Cwik created BEAM-9014: --- Summary: Update CachingShuffleBatchReader to record weights by size in bytes Key: BEAM-9014 URL: https://issues.apache.org/jira/browse/BEAM-9014 Project: Beam Issue

[jira] [Created] (BEAM-9004) Update Mockito Matchers usage to ArgumentMatchers since Matchers is deprecated in Mockito 2

Luke Cwik created BEAM-9004: --- Summary: Update Mockito Matchers usage to ArgumentMatchers since Matchers is deprecated in Mockito 2 Key: BEAM-9004 URL: https://issues.apache.org/jira/browse/BEAM-9004

[jira] [Comment Edited] (BEAM-106) Native support for conditional iteration

[ https://issues.apache.org/jira/browse/BEAM-106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000494#comment-17000494 ] Luke Cwik edited comment on BEAM-106 at 12/20/19 12:04 AM: --- [~nishant009]: Does

[jira] [Commented] (BEAM-106) Native support for conditional iteration

[ https://issues.apache.org/jira/browse/BEAM-106?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17000494#comment-17000494 ] Luke Cwik commented on BEAM-106: [~nishant009]: Does using a glob expression for the path work when

[jira] [Updated] (BEAM-8989) Backwards incompatible change in ParDo.getSideInputs (caught by failure when running Apache Nemo quickstart)

[ https://issues.apache.org/jira/browse/BEAM-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-8989: Summary: Backwards incompatible change in ParDo.getSideInputs (caught by failure when running Apache Nemo

[jira] [Updated] (BEAM-8989) Apache Nemo quickstart broken for Apache Beam 2.16 and 2.17 due to backwards incompatible change in ParDo.getSideInputs

[ https://issues.apache.org/jira/browse/BEAM-8989?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-8989: Description: [PR/9275|https://github.com/apache/beam/pull/9275] changed *ParDo.getSideInputs* from *List* 

[jira] [Created] (BEAM-8989) Apache Nemo quickstart broken for Apache Beam 2.16 and 2.17 due to backwards incompatible change in ParDo.getSideInputs

Luke Cwik created BEAM-8989: --- Summary: Apache Nemo quickstart broken for Apache Beam 2.16 and 2.17 due to backwards incompatible change in ParDo.getSideInputs Key: BEAM-8989 URL:

[jira] [Commented] (BEAM-5495) PipelineResources algorithm is not working in most environments

[ https://issues.apache.org/jira/browse/BEAM-5495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16999358#comment-16999358 ] Luke Cwik commented on BEAM-5495: - l would also agree that classgraph is a better choice since it has a

[jira] [Resolved] (BEAM-8536) Migrate usage of DelayedBundleApplication.requested_execution_time to time duration

[ https://issues.apache.org/jira/browse/BEAM-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-8536. - Fix Version/s: 2.19.0 Resolution: Fixed > Migrate usage of

[jira] [Closed] (BEAM-8562) source packages don't include gradlew

[ https://issues.apache.org/jira/browse/BEAM-8562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik closed BEAM-8562. --- Fix Version/s: Not applicable Resolution: Won't Fix Its not just gradle and gradlew.bat but the entire

[jira] [Created] (BEAM-8873) Add support for splitting at fractions > 0 to org.apache.beam.sdk.transforms.Watch.GrowthTracker

Luke Cwik created BEAM-8873: --- Summary: Add support for splitting at fractions > 0 to org.apache.beam.sdk.transforms.Watch.GrowthTracker Key: BEAM-8873 URL: https://issues.apache.org/jira/browse/BEAM-8873

[jira] [Updated] (BEAM-8873) Add support for splitting at fractions > 0 to org.apache.beam.sdk.transforms.Watch.GrowthTracker

[ https://issues.apache.org/jira/browse/BEAM-8873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-8873: Status: Open (was: Triage Needed) > Add support for splitting at fractions > 0 to >

[jira] [Updated] (BEAM-8871) Add support for splitting at fractions > 0 to org.apache.beam.sdk.transforms.splittabledofn.ByteKeyRangeTracker

[ https://issues.apache.org/jira/browse/BEAM-8871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-8871: Status: Open (was: Triage Needed) > Add support for splitting at fractions > 0 to >

[jira] [Updated] (BEAM-8872) Add support for splitting at fractions > 0 to org.apache.beam.sdk.transforms.splittabledofn.OffsetRangeTracker

[ https://issues.apache.org/jira/browse/BEAM-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-8872: Status: Open (was: Triage Needed) > Add support for splitting at fractions > 0 to >

[jira] [Created] (BEAM-8872) Add support for splitting at fractions > 0 to org.apache.beam.sdk.transforms.splittabledofn.OffsetRangeTracker

Luke Cwik created BEAM-8872: --- Summary: Add support for splitting at fractions > 0 to org.apache.beam.sdk.transforms.splittabledofn.OffsetRangeTracker Key: BEAM-8872 URL: https://issues.apache.org/jira/browse/BEAM-8872

[jira] [Created] (BEAM-8871) Add support for splitting at fractions > 0 to org.apache.beam.sdk.transforms.splittabledofn.ByteKeyRangeTracker

Luke Cwik created BEAM-8871: --- Summary: Add support for splitting at fractions > 0 to org.apache.beam.sdk.transforms.splittabledofn.ByteKeyRangeTracker Key: BEAM-8871 URL: https://issues.apache.org/jira/browse/BEAM-8871

[jira] [Updated] (BEAM-4737) SplittableDoFn dynamic rebalancing in Dataflow

[ https://issues.apache.org/jira/browse/BEAM-4737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-4737: Parent: BEAM-5605 Issue Type: Sub-task (was: Bug) > SplittableDoFn dynamic rebalancing in Dataflow

[jira] [Updated] (BEAM-4287) SplittableDoFn: splitAtFraction() API for Java

[ https://issues.apache.org/jira/browse/BEAM-4287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-4287: Parent: BEAM-5605 Issue Type: Sub-task (was: Bug) > SplittableDoFn: splitAtFraction() API for Java

[jira] [Commented] (BEAM-8831) Python PreCommit Failures: Could not copy file '/some/path/file.egg'

[ https://issues.apache.org/jira/browse/BEAM-8831?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16983004#comment-16983004 ] Luke Cwik commented on BEAM-8831: - This isn't limited to just timeloop, I have seen failures for other egg

[jira] [Created] (BEAM-8831) Python PreCommit Failures: Could not copy file '/some/path/file.egg'

Luke Cwik created BEAM-8831: --- Summary: Python PreCommit Failures: Could not copy file '/some/path/file.egg' Key: BEAM-8831 URL: https://issues.apache.org/jira/browse/BEAM-8831 Project: Beam Issue

[jira] [Commented] (BEAM-8733) The "KeyError: u'-47'" error from line 305 of sdk_worker.py

[ https://issues.apache.org/jira/browse/BEAM-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16980836#comment-16980836 ] Luke Cwik commented on BEAM-8733: - Yes. > The "KeyError: u'-47'" error from line 305 of sdk_worker.py >

[jira] [Resolved] (BEAM-8805) Remove obsolete worker_threads experiment in tests

[ https://issues.apache.org/jira/browse/BEAM-8805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-8805. - Fix Version/s: 2.18.0 Resolution: Fixed > Remove obsolete worker_threads experiment in tests >

[jira] [Closed] (BEAM-8619) Tear down the DoFns upon the control service termination in Java SDK harness

[ https://issues.apache.org/jira/browse/BEAM-8619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik closed BEAM-8619. --- Fix Version/s: 2.18.0 Resolution: Fixed > Tear down the DoFns upon the control service termination in

[jira] [Commented] (BEAM-8733) The "KeyError: u'-47'" error from line 305 of sdk_worker.py

[ https://issues.apache.org/jira/browse/BEAM-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16980494#comment-16980494 ] Luke Cwik commented on BEAM-8733: - Your not wrong, the java implementation is also bad and makes

[jira] [Resolved] (BEAM-6495) ./gradlew compileJava broken on master branch

[ https://issues.apache.org/jira/browse/BEAM-6495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-6495. - Fix Version/s: Not applicable Resolution: Fixed This must have been fixed a long time ago. >

[jira] [Commented] (BEAM-8799) Python WordCountIT benchmarks broken

[ https://issues.apache.org/jira/browse/BEAM-8799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16979441#comment-16979441 ] Luke Cwik commented on BEAM-8799: - It looks like 

[jira] [Updated] (BEAM-8799) Python WordCountIT benchmarks broken

[ https://issues.apache.org/jira/browse/BEAM-8799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-8799: Description: This impacts beam_PerformanceTests_WordCountIT_Py27, beam_PerformanceTests_WordCountIT_Py35,

[jira] [Created] (BEAM-8799) Python WordCountIT benchmarks broken

Luke Cwik created BEAM-8799: --- Summary: Python WordCountIT benchmarks broken Key: BEAM-8799 URL: https://issues.apache.org/jira/browse/BEAM-8799 Project: Beam Issue Type: Bug Components:

[jira] [Resolved] (BEAM-3493) Prevent users from "implementing" PipelineOptions

[ https://issues.apache.org/jira/browse/BEAM-3493?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-3493. - Fix Version/s: 2.18.0 Resolution: Fixed > Prevent users from "implementing" PipelineOptions >

[jira] [Commented] (BEAM-8733) The "KeyError: u'-47'" error from line 305 of sdk_worker.py

[ https://issues.apache.org/jira/browse/BEAM-8733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16977662#comment-16977662 ] Luke Cwik commented on BEAM-8733: - I think in general we shouldn't move the registration to a separate

[jira] [Closed] (BEAM-8729) beam_Dependency_Check to skip HTTP gracefully

[ https://issues.apache.org/jira/browse/BEAM-8729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik closed BEAM-8729. --- Fix Version/s: Not applicable Resolution: Fixed > beam_Dependency_Check to skip HTTP gracefully >

[jira] [Closed] (BEAM-8667) Data channel should to avoid unlimited buffering in Python SDK

[ https://issues.apache.org/jira/browse/BEAM-8667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik closed BEAM-8667. --- Fix Version/s: 2.18.0 Resolution: Fixed > Data channel should to avoid unlimited buffering in Python

[jira] [Work started] (BEAM-8151) Allow the Python SDK to use many many threads

[ https://issues.apache.org/jira/browse/BEAM-8151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-8151 started by Luke Cwik. --- > Allow the Python SDK to use many many threads >

[jira] [Resolved] (BEAM-8151) Allow the Python SDK to use many many threads

[ https://issues.apache.org/jira/browse/BEAM-8151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-8151. - Fix Version/s: 2.18.0 Resolution: Fixed > Allow the Python SDK to use many many threads >

[jira] [Closed] (BEAM-8594) Remove unnecessary error check of the control service accessing in DataFlow Runner

[ https://issues.apache.org/jira/browse/BEAM-8594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik closed BEAM-8594. --- Resolution: Fixed > Remove unnecessary error check of the control service accessing in DataFlow > Runner >

[jira] [Resolved] (BEAM-8579) Strip UTF-8 BOM bytes (if present) in TextSource.

[ https://issues.apache.org/jira/browse/BEAM-8579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-8579. - Fix Version/s: 2.18.0 Resolution: Fixed > Strip UTF-8 BOM bytes (if present) in TextSource. >

[jira] [Updated] (BEAM-8587) Add TestStream support for Dataflow runner

[ https://issues.apache.org/jira/browse/BEAM-8587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-8587: Status: Open (was: Triage Needed) > Add TestStream support for Dataflow runner >

[jira] [Commented] (BEAM-8587) Add TestStream support for Dataflow runner

[ https://issues.apache.org/jira/browse/BEAM-8587?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971879#comment-16971879 ] Luke Cwik commented on BEAM-8587: - Were you planning on adding support to Java/Go? > Add TestStream

[jira] [Commented] (BEAM-8602) Always use shadow configuration for direct runner dependencies

[ https://issues.apache.org/jira/browse/BEAM-8602?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971734#comment-16971734 ] Luke Cwik commented on BEAM-8602: - ./sdks/java/testing/nexmark/build.gradle and 

[jira] [Updated] (BEAM-8602) Always use shadow configuration for direct runner dependencies

[ https://issues.apache.org/jira/browse/BEAM-8602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-8602: Status: Open (was: Triage Needed) > Always use shadow configuration for direct runner dependencies >

[jira] [Assigned] (BEAM-8579) Strip UTF-8 BOM bytes (if present) in TextSource.

[ https://issues.apache.org/jira/browse/BEAM-8579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-8579: --- Assignee: Changming Ma > Strip UTF-8 BOM bytes (if present) in TextSource. >

[jira] [Assigned] (BEAM-8564) Add LZO compression and decompression support

[ https://issues.apache.org/jira/browse/BEAM-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-8564: --- Assignee: Amogh Tiwari > Add LZO compression and decompression support >

[jira] [Resolved] (BEAM-8573) @SplitRestriction's documented signature is incorrect

[ https://issues.apache.org/jira/browse/BEAM-8573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-8573. - Fix Version/s: 2.18.0 Resolution: Fixed > @SplitRestriction's documented signature is incorrect >

[jira] [Assigned] (BEAM-8575) Add more Python validates runner tests

[ https://issues.apache.org/jira/browse/BEAM-8575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik reassigned BEAM-8575: --- Assignee: wendy liu > Add more Python validates runner tests >

[jira] [Commented] (BEAM-8539) Clearly define the valid job state transitions

[ https://issues.apache.org/jira/browse/BEAM-8539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965028#comment-16965028 ] Luke Cwik commented on BEAM-8539: - >From my knowledge, the job state transition diagram should be:  

[jira] [Commented] (BEAM-8523) Add useful timestamp to job servicer GetJobs

[ https://issues.apache.org/jira/browse/BEAM-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965023#comment-16965023 ] Luke Cwik commented on BEAM-8523: - Typically when you would connect you would want to give some lower

[jira] [Commented] (BEAM-8539) Clearly define the valid job state transitions

[ https://issues.apache.org/jira/browse/BEAM-8539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965022#comment-16965022 ] Luke Cwik commented on BEAM-8539: - Another thing is whether all state transitions are required, for

[jira] [Commented] (BEAM-8539) Clearly define the valid job state transitions

[ https://issues.apache.org/jira/browse/BEAM-8539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16965020#comment-16965020 ] Luke Cwik commented on BEAM-8539: - There is no good documentation generation that I'm aware during the

[jira] [Closed] (BEAM-8524) Stop using pubsub in fnapi streaming dataflow Impluse

[ https://issues.apache.org/jira/browse/BEAM-8524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik closed BEAM-8524. --- Fix Version/s: 2.18.0 Resolution: Fixed > Stop using pubsub in fnapi streaming dataflow Impluse >

[jira] [Commented] (BEAM-8523) Add useful timestamp to job servicer GetJobs

[ https://issues.apache.org/jira/browse/BEAM-8523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16963624#comment-16963624 ] Luke Cwik commented on BEAM-8523: - Seems to make sense but we might as well just have all the job states

[jira] [Resolved] (BEAM-8398) Upgrade Dataflow Java Client API

[ https://issues.apache.org/jira/browse/BEAM-8398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-8398. - Fix Version/s: 2.18.0 Resolution: Fixed > Upgrade Dataflow Java Client API >

[jira] [Resolved] (BEAM-8517) Jdbc Schema timestamp conversion has timezone inconsistency issue in test

[ https://issues.apache.org/jira/browse/BEAM-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-8517. - Fix Version/s: 2.18.0 Resolution: Fixed > Jdbc Schema timestamp conversion has timezone

[jira] [Resolved] (BEAM-8515) Ensure that ValueProvider types have equals/hashCode implemented for comparison reasons

[ https://issues.apache.org/jira/browse/BEAM-8515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik resolved BEAM-8515. - Fix Version/s: 2.18.0 Resolution: Fixed > Ensure that ValueProvider types have equals/hashCode

[jira] [Updated] (BEAM-8517) Jdbc Schema timestamp conversion has timezone inconsistency issue in test

[ https://issues.apache.org/jira/browse/BEAM-8517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-8517: Status: Open (was: Triage Needed) > Jdbc Schema timestamp conversion has timezone inconsistency issue in

[jira] [Created] (BEAM-8517) Jdbc Schema timestamp conversion has timezone inconsistency issue in test

Luke Cwik created BEAM-8517: --- Summary: Jdbc Schema timestamp conversion has timezone inconsistency issue in test Key: BEAM-8517 URL: https://issues.apache.org/jira/browse/BEAM-8517 Project: Beam

[jira] [Updated] (BEAM-8515) Ensure that ValueProvider types have equals/hashCode implemented for comparison reasons

[ https://issues.apache.org/jira/browse/BEAM-8515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Luke Cwik updated BEAM-8515: Status: Open (was: Triage Needed) > Ensure that ValueProvider types have equals/hashCode implemented for

[jira] [Created] (BEAM-8515) Ensure that ValueProvider types have equals/hashCode implemented for comparison reasons

Luke Cwik created BEAM-8515: --- Summary: Ensure that ValueProvider types have equals/hashCode implemented for comparison reasons Key: BEAM-8515 URL: https://issues.apache.org/jira/browse/BEAM-8515 Project:

[jira] [Commented] (BEAM-7230) Using JdbcIO creates huge amount of connections

[ https://issues.apache.org/jira/browse/BEAM-7230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16962474#comment-16962474 ] Luke Cwik commented on BEAM-7230: - Also, the connection factory here assumes that only one JdbcIO

<    1   2   3   4   5   6   7   8   9   >