[jira] [Commented] (BEAM-1834) Bigquery Write validation doesn't work well with ValueInSingleWindow

2017-03-29 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15948040#comment-15948040 ] Daniel Halperin commented on BEAM-1834: --- Yeah, I meant "former". Sorry. We have table

[jira] [Closed] (BEAM-153) Support timeout in runner API

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-153. Resolution: Fixed Fix Version/s: Not applicable > Support timeout in runner API > -

[jira] [Commented] (BEAM-31) When triggers are changed via pipeline update, stale finished triggers data applied

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-31?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949376#comment-15949376 ] Daniel Halperin commented on BEAM-31: - [~kenn] – is this still an issue? > When triggers

[jira] [Resolved] (BEAM-632) Dataflow runner does not correctly flatten duplicate inputs

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-632. -- Resolution: Fixed > Dataflow runner does not correctly flatten duplicate inputs >

[jira] [Assigned] (BEAM-760) Validation needs to exist that @NeedsRunner / @RunnableOnService tests execute

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-760?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-760: Assignee: (was: Jason Kuster) > Validation needs to exist that @NeedsRunner / @RunnableOn

[jira] [Assigned] (BEAM-779) filesToStage should allow for common ways in which people package their resources

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-779: Assignee: (was: Davor Bonaci) > filesToStage should allow for common ways in which people

[jira] [Assigned] (BEAM-925) Findbugs doesn't pass in Dataflow Runner

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-925: Assignee: (was: Davor Bonaci) > Findbugs doesn't pass in Dataflow Runner > --

[jira] [Resolved] (BEAM-1108) Remove deprecated Dataflow Runner options and update documentation

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1108. --- Resolution: Fixed Done for now. > Remove deprecated Dataflow Runner options and update documen

[jira] [Commented] (BEAM-1124) Python ValidateRunner Test test_multi_valued_singleton_side_input Break Postcommit

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949386#comment-15949386 ] Daniel Halperin commented on BEAM-1124: --- [~altay] any progress here? > Python Valida

[jira] [Updated] (BEAM-925) Findbugs doesn't pass in Dataflow Runner

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-925: - Labels: newbie starter (was: ) > Findbugs doesn't pass in Dataflow Runner > ---

[jira] [Commented] (BEAM-1170) Streaming watermark should be easier to read

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1170?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949388#comment-15949388 ] Daniel Halperin commented on BEAM-1170: --- [~tgroh] [~bchambers] any updates in thinkin

[jira] [Updated] (BEAM-1194) DataflowRunner should canonicalize gcpTempLocation/stagingLocation/etc formats.

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1194: -- Labels: newbie starter (was: ) > DataflowRunner should canonicalize gcpTempLocation/stagingLocat

[jira] [Updated] (BEAM-1286) DataflowRunner handling of missing filesToStage

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1286: -- Labels: newbie starter (was: starter) > DataflowRunner handling of missing filesToStage > --

[jira] [Assigned] (BEAM-1325) DataflowRunner support for Class-Path jars

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1325: - Assignee: (was: Davor Bonaci) > DataflowRunner support for Class-Path jars > -

[jira] [Commented] (BEAM-1453) Unicode chars in local file system paths break dataflow runner tests.

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949394#comment-15949394 ] Daniel Halperin commented on BEAM-1453: --- [~pei...@gmail.com] any updates here? > Uni

[jira] [Commented] (BEAM-1474) Support MapState in DataflowRunner

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949396#comment-15949396 ] Daniel Halperin commented on BEAM-1474: --- [~kenn] confirming this is just a tracking b

[jira] [Comment Edited] (BEAM-1474) Support MapState in DataflowRunner

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949396#comment-15949396 ] Daniel Halperin edited comment on BEAM-1474 at 3/30/17 4:52 PM: -

[jira] [Commented] (BEAM-1578) Runners should put PT overrides into a list rather than map

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949400#comment-15949400 ] Daniel Halperin commented on BEAM-1578: --- [~tgroh] – any feedback here? > Runners sho

[jira] [Updated] (BEAM-1507) java DataflowRunner should warn if the stagingLocation has a TTL

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1507?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1507: -- Labels: newbie starter (was: ) > java DataflowRunner should warn if the stagingLocation has a TT

[jira] [Assigned] (BEAM-1578) Runners should put PT overrides into a list rather than map

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1578: - Assignee: (was: Eugene Kirpichov) > Runners should put PT overrides into a list rather

[jira] [Commented] (BEAM-1578) Runners should put PT overrides into a list rather than map

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949402#comment-15949402 ] Daniel Halperin commented on BEAM-1578: --- Does this apply to the other runners? (Shoul

[jira] [Commented] (BEAM-1579) Runners should verify that PT overrides converged

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1579?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949403#comment-15949403 ] Daniel Halperin commented on BEAM-1579: --- [~tgroh] Is this resolved or partially resol

[jira] [Closed] (BEAM-1586) DataflowRunner mixes up cached and uploaded staged file counters

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1586?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1586. - Resolution: Fixed Fix Version/s: 0.6.0 > DataflowRunner mixes up cached and uploaded staged

[jira] [Resolved] (BEAM-1594) JOB_STATE_DRAINED should be terminal for waitUntilFinish()

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1594. --- Resolution: Fixed Fix Version/s: First stable release > JOB_STATE_DRAINED should be term

[jira] [Updated] (BEAM-1594) Treat JOB_STATE_DRAINED as terminal in DataflowRunner

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1594: -- Summary: Treat JOB_STATE_DRAINED as terminal in DataflowRunner (was: JOB_STATE_DRAINED should be

[jira] [Updated] (BEAM-1600) Dataflow Runner support in PerfKit Benchmarker

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1600: -- Component/s: sdk-py > Dataflow Runner support in PerfKit Benchmarker > --

[jira] [Commented] (BEAM-1600) Dataflow Runner support in PerfKit Benchmarker

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949409#comment-15949409 ] Daniel Halperin commented on BEAM-1600: --- [~jasonkuster] -- I know you've got some bas

[jira] [Assigned] (BEAM-1600) Dataflow Runner support in PerfKit Benchmarker

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1600: - Assignee: Jason Kuster (was: Davor Bonaci) > Dataflow Runner support in PerfKit Benchmark

[jira] [Commented] (BEAM-28) Support side inputs for Sessions

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-28?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949416#comment-15949416 ] Daniel Halperin commented on BEAM-28: - [~kenn] [~tgroh] -- have we made any progress in u

[jira] [Assigned] (BEAM-324) Improve TypeDescriptor inference of DoFn's created inside a generic PTransform

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-324: Assignee: (was: Frances Perry) > Improve TypeDescriptor inference of DoFn's created insid

[jira] [Updated] (BEAM-324) Improve TypeDescriptor inference of DoFn's created inside a generic PTransform

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-324: - Component/s: (was: beam-model) sdk-java-core > Improve TypeDescriptor inference

[jira] [Commented] (BEAM-324) Improve TypeDescriptor inference of DoFn's created inside a generic PTransform

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949417#comment-15949417 ] Daniel Halperin commented on BEAM-324: -- [~bchambers] -- I know we've made some more imp

[jira] [Updated] (BEAM-324) Improve TypeDescriptor inference of DoFn's created inside a generic PTransform

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-324?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-324: - Issue Type: Wish (was: Bug) > Improve TypeDescriptor inference of DoFn's created inside a generic P

[jira] [Updated] (BEAM-478) Create Vector, Matrix types and operations to enable linear algebra API

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-478: - Component/s: (was: beam-model) sdk-ideas > Create Vector, Matrix types and oper

[jira] [Updated] (BEAM-92) Data-dependent sinks

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-92?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-92: Component/s: sdk-py > Data-dependent sinks > > > Key: BEAM-92 >

[jira] [Updated] (BEAM-92) Data-dependent sinks

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-92?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-92: Component/s: (was: beam-model) sdk-java-core > Data-dependent sinks >

[jira] [Assigned] (BEAM-92) Data-dependent sinks

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-92?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-92: --- Assignee: Daniel Halperin (was: Vikas Kedigehalli) > Data-dependent sinks > ---

[jira] [Updated] (BEAM-92) Data-dependent sinks

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-92?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-92: Component/s: (was: sdk-py) > Data-dependent sinks > > > Key: B

[jira] [Commented] (BEAM-92) Data-dependent sinks

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-92?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949420#comment-15949420 ] Daniel Halperin commented on BEAM-92: - Progress: * Data-dependent file based sink is in

[jira] [Updated] (BEAM-621) Add MapValues and MapKeys functions

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-621: - Component/s: (was: beam-model) sdk-py sdk-java-core > Add MapV

[jira] [Comment Edited] (BEAM-92) Data-dependent sinks

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-92?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949420#comment-15949420 ] Daniel Halperin edited comment on BEAM-92 at 3/30/17 5:08 PM: -- P

[jira] [Updated] (BEAM-621) Add MapValues and MapKeys functions

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-621: - Labels: newbie starer (was: ) > Add MapValues and MapKeys functions > -

[jira] [Updated] (BEAM-621) Add MapValues and MapKeys functions

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-621: - Labels: newbie starter (was: newbie starer) > Add MapValues and MapKeys functions > ---

[jira] [Updated] (BEAM-702) Simple pattern for per-bundle and per-DoFn Closeable resources

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-702: - Component/s: (was: beam-model) sdk-ideas > Simple pattern for per-bundle and pe

[jira] [Updated] (BEAM-702) Simple pattern for per-bundle and per-DoFn Closeable resources

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-702: - Priority: Minor (was: Major) > Simple pattern for per-bundle and per-DoFn Closeable resources > ---

[jira] [Updated] (BEAM-726) Standardize naming of PipelineResult objects

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-726: - Component/s: (was: beam-model) sdk-py sdk-java-core > Standard

[jira] [Updated] (BEAM-726) Standardize naming of PipelineResult objects

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-726: - Labels: newbie starter (was: ) > Standardize naming of PipelineResult objects > ---

[jira] [Updated] (BEAM-726) Standardize naming of PipelineResult objects

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-726: - Issue Type: Improvement (was: Bug) > Standardize naming of PipelineResult objects > ---

[jira] [Assigned] (BEAM-726) Standardize naming of PipelineResult objects

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-726: Assignee: (was: Frances Perry) > Standardize naming of PipelineResult objects > -

[jira] [Updated] (BEAM-696) Document: Side-Inputs non-deterministic with merging main-input windows

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-696: - Summary: Document: Side-Inputs non-deterministic with merging main-input windows (was: Side-Inputs

[jira] [Assigned] (BEAM-696) Document: Side-Inputs non-deterministic with merging main-input windows

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-696: Assignee: (was: Pei He) > Document: Side-Inputs non-deterministic with merging main-input

[jira] [Updated] (BEAM-696) Side-Inputs non-deterministic with merging main-input windows

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-696: - Issue Type: Task (was: Improvement) > Side-Inputs non-deterministic with merging main-input windows

[jira] [Updated] (BEAM-696) Side-Inputs non-deterministic with merging main-input windows

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-696: - Issue Type: Improvement (was: Bug) > Side-Inputs non-deterministic with merging main-input windows

[jira] [Assigned] (BEAM-696) Document: Side-Inputs non-deterministic with merging main-input windows

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-696: Assignee: Amit Sela > Document: Side-Inputs non-deterministic with merging main-input windows

[jira] [Commented] (BEAM-696) Document: Side-Inputs non-deterministic with merging main-input windows

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-696?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949438#comment-15949438 ] Daniel Halperin commented on BEAM-696: -- Status update: * Community has agreed that the

[jira] [Updated] (BEAM-912) Range join in Beam

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-912: - Component/s: (was: beam-model) sdk-ideas > Range join in Beam > ---

[jira] [Commented] (BEAM-912) Range join in Beam

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-912?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949440#comment-15949440 ] Daniel Halperin commented on BEAM-912: -- [~kenn] – should we update this bug to point to

[jira] [Assigned] (BEAM-101) Data-driven triggers

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-101: Assignee: (was: Frances Perry) > Data-driven triggers > > >

[jira] [Updated] (BEAM-1022) TableNamespace should not use Java object equality when comparing windows

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1022: -- Component/s: (was: beam-model) sdk-java-core > TableNamespace should not use

[jira] [Commented] (BEAM-1166) Source.getDefaultOutputCoder() documentation should mention CannotProvideCoderException

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1166?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949449#comment-15949449 ] Daniel Halperin commented on BEAM-1166: --- [~sisk] – any update here? > Source.getDefa

[jira] [Updated] (BEAM-1022) TableNamespace should not use Java object equality when comparing windows

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1022?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1022: -- Affects Version/s: (was: 0.3.0-incubating) > TableNamespace should not use Java object equali

[jira] [Commented] (BEAM-1022) TableNamespace should not use Java object equality when comparing windows

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1022?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949448#comment-15949448 ] Daniel Halperin commented on BEAM-1022: --- [~tgroh] – any update here? > TableNamespac

[jira] [Updated] (BEAM-1166) Source.getDefaultOutputCoder() documentation should mention CannotProvideCoderException

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1166: -- Issue Type: Improvement (was: Bug) > Source.getDefaultOutputCoder() documentation should mention

[jira] [Updated] (BEAM-1166) Source.getDefaultOutputCoder() documentation should mention CannotProvideCoderException

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1166: -- Component/s: (was: beam-model) > Source.getDefaultOutputCoder() documentation should mention

[jira] [Updated] (BEAM-1171) Source.getDefaultOutputCoder() - add a version that allows access to a CoderRegistry

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1171: -- Fix Version/s: First stable release > Source.getDefaultOutputCoder() - add a version that allows

[jira] [Assigned] (BEAM-1171) Source.getDefaultOutputCoder() - add a version that allows access to a CoderRegistry

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1171: - Assignee: (was: Stephen Sisk) > Source.getDefaultOutputCoder() - add a version that al

[jira] [Updated] (BEAM-1171) Source.getDefaultOutputCoder() - add a version that allows access to a CoderRegistry

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1171: -- Component/s: (was: beam-model) > Source.getDefaultOutputCoder() - add a version that allows a

[jira] [Updated] (BEAM-1164) Allow a DoFn to opt in to mutating it's input

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1164: -- Issue Type: New Feature (was: Bug) > Allow a DoFn to opt in to mutating it's input > ---

[jira] [Commented] (BEAM-1002) Enable caching of side-input dependent computations

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949459#comment-15949459 ] Daniel Halperin commented on BEAM-1002: --- (assigned to [~kenn] just to provide a comme

[jira] [Commented] (BEAM-1002) Enable caching of side-input dependent computations

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1002?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949458#comment-15949458 ] Daniel Halperin commented on BEAM-1002: --- [~kenn] – does state help here? I'm guessing

[jira] [Assigned] (BEAM-1002) Enable caching of side-input dependent computations

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1002?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1002: - Assignee: Kenneth Knowles (was: Frances Perry) > Enable caching of side-input dependent c

[jira] [Updated] (BEAM-1242) convert older IO/Sources to use standard ReadTransform style

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1242: -- Component/s: (was: beam-model) > convert older IO/Sources to use standard ReadTransform style

[jira] [Assigned] (BEAM-1242) convert older IO/Sources to use standard ReadTransform style

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1242: - Assignee: Eugene Kirpichov (was: Frances Perry) > convert older IO/Sources to use standar

[jira] [Commented] (BEAM-1242) convert older IO/Sources to use standard ReadTransform style

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949460#comment-15949460 ] Daniel Halperin commented on BEAM-1242: --- [~kirpichov] – is this a dupe of your style

[jira] [Commented] (BEAM-551) Support Dynamic PipelineOptions

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15949461#comment-15949461 ] Daniel Halperin commented on BEAM-551: -- Status: Complete in Java; ongoing in Python >

[jira] [Updated] (BEAM-551) Support Dynamic PipelineOptions

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-551: - Component/s: (was: beam-model) sdk-py sdk-java-core > Support

[jira] [Updated] (BEAM-551) Support Dynamic PipelineOptions

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-551: - Component/s: (was: sdk-py) > Support Dynamic PipelineOptions > --- >

[jira] [Resolved] (BEAM-551) Support Dynamic PipelineOptions

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-551. -- Resolution: Fixed Fix Version/s: Not applicable > Support Dynamic PipelineOptions > ---

[jira] [Assigned] (BEAM-1314) DoFn per-key lifecycle (Setup/Teardown)

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1314?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1314: - Assignee: (was: Frances Perry) > DoFn per-key lifecycle (Setup/Teardown) > ---

[jira] [Closed] (BEAM-1838) GlobalWindow equals() and hashCode() doesn't work with other serialization frameworks

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin closed BEAM-1838. - Resolution: Fixed Fix Version/s: First stable release > GlobalWindow equals() and hashCode()

[jira] [Assigned] (BEAM-1673) PubSubIO can't write attributes

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1673: - Assignee: Bin Chen (was: Jean-Baptiste Onofré) > PubSubIO can't write attributes > --

[jira] [Resolved] (BEAM-1673) PubSubIO can't write attributes

2017-03-30 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1673. --- Resolution: Fixed Fix Version/s: First stable release > PubSubIO can't write attributes

[jira] [Assigned] (BEAM-1848) GroupByKey stuck with more than one worker on Dataflow

2017-03-31 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1848: - Assignee: Kenneth Knowles (was: Davor Bonaci) > GroupByKey stuck with more than one worke

[jira] [Commented] (BEAM-1848) GroupByKey stuck with more than one worker on Dataflow

2017-03-31 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15951419#comment-15951419 ] Daniel Halperin commented on BEAM-1848: --- Suspect Kenn should take a look at this one

[jira] [Created] (BEAM-1863) Allow users to override the base container image but still choose image type

2017-04-03 Thread Daniel Halperin (JIRA)
Daniel Halperin created BEAM-1863: - Summary: Allow users to override the base container image but still choose image type Key: BEAM-1863 URL: https://issues.apache.org/jira/browse/BEAM-1863 Project: B

[jira] [Resolved] (BEAM-1848) GroupByKey stuck with more than one worker on Dataflow

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1848. --- Resolution: Fixed Fix Version/s: Not applicable > GroupByKey stuck with more than one wo

[jira] [Assigned] (BEAM-1197) Slowly-changing external data as a side input

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1197: - Assignee: (was: Frances Perry) > Slowly-changing external data as a side input > -

[jira] [Commented] (BEAM-653) Refine specification for WindowFn.isCompatible()

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-653?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15953781#comment-15953781 ] Daniel Halperin commented on BEAM-653: -- Is it important to resolve this before first st

[jira] [Updated] (BEAM-1287) Give new DoFn the ability to output to a particular window

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1287?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1287: -- Component/s: sdk-py > Give new DoFn the ability to output to a particular window > --

[jira] [Resolved] (BEAM-1471) Make IterableCoder binary compatible across SDKs

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin resolved BEAM-1471. --- Resolution: Fixed Fix Version/s: 0.6.0 > Make IterableCoder binary compatible across SDK

[jira] [Updated] (BEAM-1264) Python ChannelFactory Raise Inconsistent Error for Local FS and GCS

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1264?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1264: -- Component/s: (was: beam-model) > Python ChannelFactory Raise Inconsistent Error for Local FS

[jira] [Commented] (BEAM-197) Incremental join

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15953795#comment-15953795 ] Daniel Halperin commented on BEAM-197: -- Should this issue be closed now that the state

[jira] [Commented] (BEAM-1264) Python ChannelFactory Raise Inconsistent Error for Local FS and GCS

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1264?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15953801#comment-15953801 ] Daniel Halperin commented on BEAM-1264: --- [~markflyhigh] [~sb2nov] Should this issue b

[jira] [Assigned] (BEAM-1616) Gauge Metric type

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1616: - Assignee: (was: Ben Chambers) > Gauge Metric type > - > >

[jira] [Assigned] (BEAM-1613) Meter metric type

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1613: - Assignee: (was: Ben Chambers) > Meter metric type > - > >

[jira] [Commented] (BEAM-644) Primitive to shift the watermark while assigning timestamps

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-644?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15953812#comment-15953812 ] Daniel Halperin commented on BEAM-644: -- [~jkff] any update here w.r.t. {{SplittableDoFn

[jira] [Updated] (BEAM-1811) Extract common class for WithTimestamps.AddTimestampsDoFn and Create.TimestampedValues.ConvertTimestamps

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1811: -- Component/s: (was: beam-model) sdk-java-core > Extract common class for With

[jira] [Updated] (BEAM-1811) Extract common class for WithTimestamps.AddTimestampsDoFn and Create.TimestampedValues.ConvertTimestamps

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-1811: -- Labels: newbie starter (was: ) > Extract common class for WithTimestamps.AddTimestampsDoFn and

[jira] [Assigned] (BEAM-1811) Extract common class for WithTimestamps.AddTimestampsDoFn and Create.TimestampedValues.ConvertTimestamps

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-1811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin reassigned BEAM-1811: - Assignee: (was: Frances Perry) > Extract common class for WithTimestamps.AddTimestamps

[jira] [Updated] (BEAM-26) Model for validation of user state upon pipeline update

2017-04-03 Thread Daniel Halperin (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-26?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Halperin updated BEAM-26: Component/s: (was: beam-model-runner-api) (was: beam-model) ru

<    1   2   3   4   5   6   7   >