[jira] [Updated] (BEAM-1439) Beam Example(s) exploring public document datasets

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-1439: -- Labels: gsoc2017 java mentor python triaged (was: gsoc2017 java mentor python) > Beam

[jira] [Updated] (BEAM-2104) Consider adding interactive notebooks as examples

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2104: -- Labels: community-onboarding triaged (was: community-onboarding) > Consider adding interactive

[jira] [Updated] (BEAM-6859) Spark-runner: DoFn tearDown function will not be invoked if there is no data in the batch

2019-03-18 Thread Ron Cai (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Cai updated BEAM-6859: -- Summary: Spark-runner: DoFn tearDown function will not be invoked if there is no data in the batch (was: DoFn

[jira] [Updated] (BEAM-6809) spark.streaming.backpressure not work properly

2019-03-18 Thread Ron Cai (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ron Cai updated BEAM-6809: -- Affects Version/s: 2.11.0 > spark.streaming.backpressure not work properly >

[jira] [Commented] (BEAM-2903) Java SDK support for portable progress reporting

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795697#comment-16795697 ] Kenneth Knowles commented on BEAM-2903: --- [~ajam...@google.com] is this still outstanding? > Java

[jira] [Created] (BEAM-6859) DoFn tearDown function will not be invoked if there is no data in the batch

2019-03-18 Thread Ron Cai (JIRA)
Ron Cai created BEAM-6859: - Summary: DoFn tearDown function will not be invoked if there is no data in the batch Key: BEAM-6859 URL: https://issues.apache.org/jira/browse/BEAM-6859 Project: Beam

[jira] [Updated] (BEAM-2905) ULR supports portable progress reporting

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2905: -- Labels: portability triaged (was: portability) > ULR supports portable progress reporting >

[jira] [Updated] (BEAM-2843) Log the reason for failure for BigQuery jobs

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2843: -- Labels: newbie starter triaged (was: newbie starter) > Log the reason for failure for BigQuery

[jira] [Updated] (BEAM-2843) Log the reason for failure for BigQuery jobs

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2843: -- Priority: Major (was: Minor) > Log the reason for failure for BigQuery jobs >

[jira] [Updated] (BEAM-3344) DirectRunner should serialize/deserialize PipelineOptions via Jackson to simulate what remote execution runners do

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-3344: -- Labels: newbie starter triaged (was: newbie starter) > DirectRunner should

[jira] [Updated] (BEAM-1507) java DataflowRunner should warn if the stagingLocation has a TTL

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-1507: -- Labels: newbie starter triaged (was: newbie starter) > java DataflowRunner should warn if the

[jira] [Updated] (BEAM-1553) OutputTimeFn maybe should be allowed to move elements back in time

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-1553: -- Labels: starter triaged (was: starter) > OutputTimeFn maybe should be allowed to move elements

[jira] [Resolved] (BEAM-400) Direct/InProcess runner should use Pubsub publish time timestamp if timestampLabel is not set

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-400. -- Resolution: Fixed Fix Version/s: Not applicable > Direct/InProcess runner should use

[jira] [Updated] (BEAM-2127) Test Spark streaming pipelines with maxRecordsPerBatch

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2127: -- Labels: newbie starter triaged (was: newbie starter) > Test Spark streaming pipelines with

[jira] [Updated] (BEAM-184) Using Merging Windows and/or Triggers without a downstream aggregation should fail

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-184?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-184: - Labels: backward-incompatible triaged (was: backward-incompatible) > Using Merging Windows and/or

[jira] [Updated] (BEAM-464) HolderCoder should be a StandardCoder and not a CustomCoder

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-464: - Labels: backward-incompatible triaged (was: backward-incompatible) > HolderCoder should be a

[jira] [Closed] (BEAM-2849) Validate nexmark with the Gearpump runner

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles closed BEAM-2849. - Resolution: Duplicate Fix Version/s: Not applicable Duplicating to the one with a linked

[jira] [Updated] (BEAM-2474) Tests in DataflowSDK-examples should test code in DataflowSDK-examples

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2474: -- Labels: community-onboarding triaged (was: community-onboarding) > Tests in

[jira] [Updated] (BEAM-2849) Validate nexmark with the Gearpump runner

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2849?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2849: -- Labels: nexmark triaged (was: nexmark) > Validate nexmark with the Gearpump runner >

[jira] [Updated] (BEAM-3129) Add debug option to do a 'dry run' instead of running the pipeline

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-3129: -- Labels: portability triaged (was: portability) > Add debug option to do a 'dry run' instead of

[jira] [Updated] (BEAM-2851) Enable Pubsub as source/sink on Nexmark

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2851: -- Labels: dataflow nexmark triaged (was: dataflow nexmark) > Enable Pubsub as source/sink on

[jira] [Updated] (BEAM-3128) Add debug option to dump the submitted pipeline proto

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-3128: -- Labels: portability starter triaged (was: portability) > Add debug option to dump the

[jira] [Updated] (BEAM-332) Matcher(s) for TableRow

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-332: - Labels: starter triaged (was: starter) > Matcher(s) for TableRow > --- > >

[jira] [Commented] (BEAM-2907) Flink supports portable progress reporting

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795682#comment-16795682 ] Kenneth Knowles commented on BEAM-2907: --- [~thw] [~angoenka] still open? > Flink supports portable

[jira] [Updated] (BEAM-3072) Improve error handling at staging time time for DataflowRunner

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-3072: -- Labels: starter triaged (was: starter) > Improve error handling at staging time time for

[jira] [Updated] (BEAM-2907) Flink supports portable progress reporting

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2907: -- Labels: portability triaged (was: portability) > Flink supports portable progress reporting >

[jira] [Updated] (BEAM-3059) Timeout option for individual integration tests

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3059?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-3059: -- Labels: starter triaged (was: starter) > Timeout option for individual integration tests >

[jira] [Work logged] (BEAM-6443) decrease the number of threads for BigQuery streaming insertAll

2019-03-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6443?focusedWorklogId=215221=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-215221 ] ASF GitHub Bot logged work on BEAM-6443: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6841) Support reading query results with the BigQuery storage API

2019-03-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6841?focusedWorklogId=215224=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-215224 ] ASF GitHub Bot logged work on BEAM-6841: Author: ASF GitHub Bot

[jira] [Work logged] (BEAM-6841) Support reading query results with the BigQuery storage API

2019-03-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6841?focusedWorklogId=215225=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-215225 ] ASF GitHub Bot logged work on BEAM-6841: Author: ASF GitHub Bot

[jira] [Commented] (BEAM-6846) Beam Performance Degradation on Dataflow Runner

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795656#comment-16795656 ] Kenneth Knowles commented on BEAM-6846: --- TableRow is a pretty heavyweight object. I would definitely

[jira] [Resolved] (BEAM-5784) Retire FindBugs static analysis in Beam

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-5784. --- Resolution: Fixed Assignee: Kenneth Knowles Fix Version/s: Not applicable We

[jira] [Updated] (BEAM-2386) Change regex used for splitting words

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2386: -- Labels: newbie starter triaged (was: newbie starter) > Change regex used for splitting words >

[jira] [Commented] (BEAM-308) PipelineOptions throws when using package-private PipelineOptions interfaces from multiple packages

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-308?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795637#comment-16795637 ] Kenneth Knowles commented on BEAM-308: -- I actually think that since the state is global it is a spec

[jira] [Updated] (BEAM-5864) Host Grafana UI on GrafanaCloud

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-5864: -- Labels: community-metrics triaged (was: community-metrics) > Host Grafana UI on GrafanaCloud >

[jira] [Updated] (BEAM-5863) Automate Community Metrics infrastructure deployment

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-5863: -- Labels: community-metrics triaged (was: community-metrics) > Automate Community Metrics

[jira] [Commented] (BEAM-3320) DataflowRunner for python streaming uses portable containers

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3320?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795627#comment-16795627 ] Kenneth Knowles commented on BEAM-3320: --- This is done, right? > DataflowRunner for python streaming

[jira] [Commented] (BEAM-5649) Remove deprecated primitive CREATE_VIEW transform from Runner API

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795634#comment-16795634 ] Kenneth Knowles commented on BEAM-5649: --- [~lcwik] [~mxm] can this be removed now? It is definitely

[jira] [Updated] (BEAM-1081) annotations should support custom messages and classes

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-1081: -- Labels: newbie starter triaged (was: newbie starter) > annotations should support custom

[jira] [Updated] (BEAM-3320) DataflowRunner for python streaming uses portable containers

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-3320: -- Labels: portability (was: portability triaged) > DataflowRunner for python streaming uses

[jira] [Commented] (BEAM-2947) SDK harnesses should be able to indicate panic in FnAPI

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795631#comment-16795631 ] Kenneth Knowles commented on BEAM-2947: --- [~lcwik] [~thw] [~lostluck] is this solved? > SDK

[jira] [Updated] (BEAM-6277) KV#of parameters marked with @Nullable, even though nullability is encapsulated in type variables KeyT and ValueT

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6277?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-6277: -- Labels: starter triaged (was: starter) > KV#of parameters marked with @Nullable, even though

[jira] [Updated] (BEAM-2947) SDK harnesses should be able to indicate panic in FnAPI

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2947: -- Labels: portability triaged (was: portability) > SDK harnesses should be able to indicate

[jira] [Updated] (BEAM-2855) Implement a python version of the nexmark queries

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2855: -- Labels: newbie nexmark starter triaged (was: newbie nexmark starter) > Implement a python

[jira] [Updated] (BEAM-588) All runners should support ProfilingOptions

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-588?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-588: - Labels: newbie starter triaged (was: newbie starter) > All runners should support

[jira] [Updated] (BEAM-2902) Add user state support for ParDo.Multi for the Dataflow runner

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2902: -- Labels: portability sickbay triaged (was: portability sickbay) > Add user state support for

[jira] [Updated] (BEAM-39) Audit trigger implementations to ensure they prefetch appropriately

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-39?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-39: Labels: Triggers triaged (was: Triggers) > Audit trigger implementations to ensure they prefetch

[jira] [Updated] (BEAM-2207) BeamSqlInputRefExpression in BeamSQLFnExecutor.buildExpression error

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2207: -- Labels: easyfix triaged (was: easyfix) > BeamSqlInputRefExpression in

[jira] [Closed] (BEAM-39) Audit trigger implementations to ensure they prefetch appropriately

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-39?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles closed BEAM-39. --- Resolution: Won't Do Fix Version/s: Not applicable > Audit trigger implementations to ensure

[jira] [Closed] (BEAM-2940) Portability milestone: mobile gaming runs everywhere

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles closed BEAM-2940. - Resolution: Later Fix Version/s: Not applicable > Portability milestone: mobile gaming

[jira] [Comment Edited] (BEAM-6846) Beam Performance Degradation on Dataflow Runner

2019-03-18 Thread Kishan Kumar (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795594#comment-16795594 ] Kishan Kumar edited comment on BEAM-6846 at 3/19/19 3:37 AM: - [~kenn] , The

[jira] [Closed] (BEAM-2941) Portability milestone: windowed wordcount runs everywhere

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles closed BEAM-2941. - Resolution: Later Fix Version/s: Not applicable > Portability milestone: windowed

[jira] [Closed] (BEAM-2896) Portability milestone: wordcount runs everywhere

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles closed BEAM-2896. - Resolution: Later Fix Version/s: Not applicable > Portability milestone: wordcount runs

[jira] [Closed] (BEAM-2895) JStorm runs portable pipelines

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles closed BEAM-2895. - Resolution: Later Fix Version/s: Not applicable > JStorm runs portable pipelines >

[jira] [Resolved] (BEAM-2887) Python SDK support for portable pipelines

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-2887. --- Resolution: Implemented Fix Version/s: Not applicable > Python SDK support for

[jira] [Closed] (BEAM-2891) Spark runs portable pipelines

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2891?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles closed BEAM-2891. - Resolution: Later Fix Version/s: Not applicable > Spark runs portable pipelines >

[jira] [Closed] (BEAM-2592) Python shim for submitting to ApexRunner

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles closed BEAM-2592. - Resolution: Won't Do Fix Version/s: Not applicable > Python shim for submitting to

[jira] [Closed] (BEAM-2893) Tez runs portable pipelines

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles closed BEAM-2893. - Resolution: Later Fix Version/s: Not applicable > Tez runs portable pipelines >

[jira] [Closed] (BEAM-2894) MapReduce runs portable pipelines

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles closed BEAM-2894. - Resolution: Later Fix Version/s: Not applicable > MapReduce runs portable pipelines >

[jira] [Commented] (BEAM-2593) Python shim for submitting to SparkRunner

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795625#comment-16795625 ] Kenneth Knowles commented on BEAM-2593: --- [~angoenka] I think we are not doing these shims, right?

[jira] [Updated] (BEAM-2593) Python shim for submitting to SparkRunner

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2593: -- Labels: portability (was: portability triaged) > Python shim for submitting to SparkRunner >

[jira] [Updated] (BEAM-2593) Python shim for submitting to SparkRunner

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2593: -- Labels: portability triaged (was: portability) > Python shim for submitting to SparkRunner >

[jira] [Updated] (BEAM-2069) Remove ResourceId.getCurrentDirectory()?

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2069: -- Labels: backward-incompatible triaged (was: backward-incompatible) > Remove

[jira] [Updated] (BEAM-1308) Consider removing TimeDomain from user APIs

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1308?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-1308: -- Labels: backward-incompatible triaged (was: backward-incompatible) > Consider removing

[jira] [Commented] (BEAM-28) Support side inputs for Sessions

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-28?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795622#comment-16795622 ] Kenneth Knowles commented on BEAM-28: - [~lcwik] [~CraigChambersG] another issue for the portable model

[jira] [Updated] (BEAM-28) Support side inputs for Sessions

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-28?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-28: Labels: Windowing triaged (was: Windowing) > Support side inputs for Sessions >

[jira] [Updated] (BEAM-31) When triggers are changed via pipeline update, stale finished triggers data applied

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-31?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-31: Labels: Triggers Update triaged (was: Triggers Update) > When triggers are changed via pipeline

[jira] [Commented] (BEAM-987) TestStream.advanceWatermarkToInfinity should perhaps also advance processing time

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-987?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795617#comment-16795617 ] Kenneth Knowles commented on BEAM-987: -- Strongly disagree. Advancing the watermark to infinity happens

[jira] [Updated] (BEAM-497) Modify offset range tracker to use first response as start offset

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-497: - Labels: newbie starter triaged (was: newbie starter) > Modify offset range tracker to use first

[jira] [Closed] (BEAM-987) TestStream.advanceWatermarkToInfinity should perhaps also advance processing time

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles closed BEAM-987. Resolution: Invalid Fix Version/s: Not applicable > TestStream.advanceWatermarkToInfinity

[jira] [Updated] (BEAM-1080) python sdk apiclient needs proper unit tests

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1080?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-1080: -- Labels: newbie starter triaged (was: newbie starter) > python sdk apiclient needs proper unit

[jira] [Closed] (BEAM-2599) ApexRunner Fn API based ParDo operator

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles closed BEAM-2599. - Resolution: Won't Do Fix Version/s: Not applicable [~thw] I figure there's no point

[jira] [Closed] (BEAM-2890) Apex runs portable pipelines

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles closed BEAM-2890. - Resolution: Won't Do Fix Version/s: Not applicable [~thw] I figure there's no point

[jira] [Updated] (BEAM-2426) Remove imports from runner/init

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2426: -- Labels: backward-incompatible triaged (was: backward-incompatible) > Remove imports from

[jira] [Updated] (BEAM-2427) ParDo should only accept DoFns

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2427: -- Labels: backward-incompatible triaged (was: backward-incompatible) > ParDo should only accept

[jira] [Closed] (BEAM-2589) ApexRunner shim for Job API

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2589?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles closed BEAM-2589. - Resolution: Won't Do Fix Version/s: Not applicable [~thw] I figure there's no point

[jira] [Commented] (BEAM-2819) Key only reads from Google Datastore

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795607#comment-16795607 ] Kenneth Knowles commented on BEAM-2819: --- [~chamikara] FYI > Key only reads from Google Datastore >

[jira] [Resolved] (BEAM-2335) Document various maven commands for running tests

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2335?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-2335. --- Resolution: Won't Do Fix Version/s: Not applicable No more maven - no more

[jira] [Updated] (BEAM-2819) Key only reads from Google Datastore

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2819: -- Labels: datastore triaged (was: datastore) > Key only reads from Google Datastore >

[jira] [Resolved] (BEAM-1324) Able to define the thread count via PipelineOptions

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-1324. --- Resolution: Implemented Fix Version/s: Not applicable > Able to define the thread

[jira] [Commented] (BEAM-1324) Able to define the thread count via PipelineOptions

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795605#comment-16795605 ] Kenneth Knowles commented on BEAM-1324: --- [~zborisha] yes I think that is already the implementation.

[jira] [Updated] (BEAM-296) Retry failures in the DirectRunner

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-296: - Labels: newbie starter triaged (was: newbie starter) > Retry failures in the DirectRunner >

[jira] [Updated] (BEAM-1448) Coder encode/decode context documentation is lacking

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-1448: -- Labels: documentation triaged (was: documentation) > Coder encode/decode context documentation

[jira] [Updated] (BEAM-6846) Beam Performance Degradation on Dataflow Runner

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-6846: -- Labels: patch (was: patch triaged) > Beam Performance Degradation on Dataflow Runner >

[jira] [Resolved] (BEAM-2306) @Deprecated without @deprecated javadoc explanation should cause build failure

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles resolved BEAM-2306. --- Resolution: Fixed Fix Version/s: Not applicable > @Deprecated without @deprecated

[jira] [Commented] (BEAM-2306) @Deprecated without @deprecated javadoc explanation should cause build failure

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795603#comment-16795603 ] Kenneth Knowles commented on BEAM-2306: --- I'm pretty sure this does cause failure. > @Deprecated

[jira] [Updated] (BEAM-2306) @Deprecated without @deprecated javadoc explanation should cause build failure

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2306: -- Labels: starter triaged (was: starter) > @Deprecated without @deprecated javadoc explanation

[jira] [Updated] (BEAM-2525) WindowFnTestUtils#runWindowFn should be removed

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2525: -- Labels: easyfix newbie starter triaged (was: easyfix newbie starter) >

[jira] [Updated] (BEAM-3658) Port SpannerIOReadTest off DoFnTester

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-3658: -- Labels: beginner newbie starter triaged (was: beginner newbie starter) > Port

[jira] [Commented] (BEAM-3377) assert_that not working for streaming

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795598#comment-16795598 ] Kenneth Knowles commented on BEAM-3377: --- [~mariagh] is this now done? > assert_that not working for

[jira] [Updated] (BEAM-3300) Portable flattens in Go SDK Harness

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-3300: -- Labels: portability triaged (was: portability) > Portable flattens in Go SDK Harness >

[jira] [Commented] (BEAM-3300) Portable flattens in Go SDK Harness

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795599#comment-16795599 ] Kenneth Knowles commented on BEAM-3300: --- [~lostluck] just going through things lacking "triage"

[jira] [Updated] (BEAM-4682) Integrate support for timers using the portability APIs into Dataflow

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-4682: -- Labels: portability triaged (was: portability) > Integrate support for timers using the

[jira] [Commented] (BEAM-2715) Expose PubsubSource to create UnboundedSource and utilize withMaxNumRecords from BoundedReadFromUnboundedSource

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2715?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795596#comment-16795596 ] Kenneth Knowles commented on BEAM-2715: --- [~alevy] is this still an outstanding request? It is quite

[jira] [Commented] (BEAM-6846) Beam Performance Degradation on Dataflow Runner

2019-03-18 Thread Kishan Kumar (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6846?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795594#comment-16795594 ] Kishan Kumar commented on BEAM-6846: [~kenn] , The Performance Issue is coming While Doing GroupBy and

[jira] [Updated] (BEAM-6811) [JobName] [TestName] Failure summaryBuild broken: repo.spring.io is down

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-6811: -- Labels: currently-failing triaged (was: currently-failing) > [JobName] [TestName] Failure

[jira] [Updated] (BEAM-2715) Expose PubsubSource to create UnboundedSource and utilize withMaxNumRecords from BoundedReadFromUnboundedSource

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2715: -- Labels: pubsub triaged (was: pubsub) > Expose PubsubSource to create UnboundedSource and

[jira] [Updated] (BEAM-2715) Expose PubsubSource to create UnboundedSource and utilize withMaxNumRecords from BoundedReadFromUnboundedSource

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-2715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-2715: -- Component/s: (was: runner-direct) io-java-gcp > Expose PubsubSource to

[jira] [Updated] (BEAM-6832) Populate labels and custom metadata on VMs that serves Dataflow

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-6832: -- Labels: google-dataflow triaged (was: google-dataflow) > Populate labels and custom metadata

[jira] [Updated] (BEAM-6831) python sdk WriteToBigQuery excessive usage of metered API

2019-03-18 Thread Kenneth Knowles (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kenneth Knowles updated BEAM-6831: -- Labels: bigquery dataflow gcp python triaged (was: bigquery dataflow gcp python) > python sdk

  1   2   3   >