[jira] [Commented] (BEAM-3612) Make it easy to generate type-specialized Go SDK reflectx.Funcs

2018-10-19 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16657601#comment-16657601 ] Robert Burke commented on BEAM-3612: The various registration functions need to be resilient to

[jira] [Commented] (BEAM-4124) Support elements larger than 4 MB

2018-10-31 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16670326#comment-16670326 ] Robert Burke commented on BEAM-4124: [~dfbrowne] I was chatting with [~wcn3] and he expressed interest

[jira] [Commented] (BEAM-4124) Support elements larger than 4 MB

2018-10-30 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669181#comment-16669181 ] Robert Burke commented on BEAM-4124: This needs to be better documented somewhere, but for now this

[jira] [Comment Edited] (BEAM-4124) Support elements larger than 4 MB

2018-10-30 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669181#comment-16669181 ] Robert Burke edited comment on BEAM-4124 at 10/30/18 6:46 PM: -- This needs to

[jira] [Comment Edited] (BEAM-4124) Support elements larger than 4 MB

2018-10-30 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669181#comment-16669181 ] Robert Burke edited comment on BEAM-4124 at 10/30/18 6:47 PM: -- This needs to

[jira] [Commented] (BEAM-4124) Support elements larger than 4 MB

2018-10-30 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16669379#comment-16669379 ] Robert Burke commented on BEAM-4124: You are correct, and this is on the Sending direction, rather

[jira] [Commented] (BEAM-5379) Go Modules versioning support

2018-11-08 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679089#comment-16679089 ] Robert Burke commented on BEAM-5379: Poked this for a bit.  The current beam approach of "all the

[jira] [Comment Edited] (BEAM-5379) Go Modules versioning support

2018-11-08 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16679089#comment-16679089 ] Robert Burke edited comment on BEAM-5379 at 11/8/18 12:12 AM: -- Poked this for

[jira] [Assigned] (BEAM-5729) Create ability to read/write database implementing database/sql contract

2018-11-13 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-5729: -- Assignee: (was: Robert Burke) > Create ability to read/write database implementing

[jira] [Assigned] (BEAM-5729) Create ability to read/write database implementing database/sql contract

2018-11-13 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-5729: -- Assignee: Robert Burke > Create ability to read/write database implementing database/sql

[jira] [Created] (BEAM-6073) Go PostCommit Broken -> gogradle needs "github.com/stretchr/testify/assert" dep.

2018-11-15 Thread Robert Burke (JIRA)
Robert Burke created BEAM-6073: -- Summary: Go PostCommit Broken -> gogradle needs "github.com/stretchr/testify/assert" dep. Key: BEAM-6073 URL: https://issues.apache.org/jira/browse/BEAM-6073 Project:

[jira] [Updated] (BEAM-6073) Go PostCommit Broken -> gogradle needs "github.com/stretchr/testify/assert" dep.

2018-11-15 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke updated BEAM-6073: --- Description: [https://builds.apache.org/job/beam_PostCommit_Go_GradleBuild/1676/] 16:41:13 ok

[jira] [Resolved] (BEAM-5729) Create ability to read/write database implementing database/sql contract

2018-11-15 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke resolved BEAM-5729. Resolution: Fixed Fix Version/s: Not applicable > Create ability to read/write database

[jira] [Created] (BEAM-5977) Benchmark buffer use in the Go SDK Harness

2018-11-05 Thread Robert Burke (JIRA)
Robert Burke created BEAM-5977: -- Summary: Benchmark buffer use in the Go SDK Harness Key: BEAM-5977 URL: https://issues.apache.org/jira/browse/BEAM-5977 Project: Beam Issue Type: Improvement

[jira] [Commented] (BEAM-3296) Combine semantics for empty bundle for min, max is wrong

2018-11-13 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16685607#comment-16685607 ] Robert Burke commented on BEAM-3296: My guess is that the is due to probably CombinerLifting? I can't

[jira] [Commented] (BEAM-6255) Support emit func output in the Go SDK's CombineFn ExtractOutput

2018-12-29 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16730897#comment-16730897 ] Robert Burke commented on BEAM-6255: Combined with a change to use *FullValues through the Unit

[jira] [Commented] (BEAM-6255) Support emit func output in the Go SDK's CombineFn ExtractOutput

2019-01-04 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734702#comment-16734702 ] Robert Burke commented on BEAM-6255: Might be better to generate a dedicated struct with appropriate

[jira] [Commented] (BEAM-3580) Do not use Go BytesCoder to encode string

2019-01-18 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16746571#comment-16746571 ] Robert Burke commented on BEAM-3580: There may be one or two no longer necessary []byte -> string

[jira] [Resolved] (BEAM-3580) Do not use Go BytesCoder to encode string

2019-01-18 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke resolved BEAM-3580. Resolution: Fixed Fix Version/s: Not applicable > Do not use Go BytesCoder to encode string

[jira] [Commented] (BEAM-5298) Determine what painpoints exist for the Go SDK WRT the Go Generics Draft Design

2019-01-18 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16746566#comment-16746566 ] Robert Burke commented on BEAM-5298: I'm finally in a place where it's worth putting thought into

[jira] [Commented] (BEAM-3580) Do not use Go BytesCoder to encode string

2019-01-15 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16743367#comment-16743367 ] Robert Burke commented on BEAM-3580: I'm in the process of fixing Top, and I ran into this, so I'm

[jira] [Assigned] (BEAM-4472) Go SDK - Rewrite top.go accumulator to be encodable.

2019-01-15 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-4472: -- Assignee: Robert Burke > Go SDK - Rewrite top.go accumulator to be encodable. >

[jira] [Assigned] (BEAM-3580) Do not use Go BytesCoder to encode string

2019-01-15 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-3580: -- Assignee: Robert Burke > Do not use Go BytesCoder to encode string >

[jira] [Assigned] (BEAM-6373) Make Go SDK on Dataflow multi-threaded

2019-01-22 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-6373: -- Assignee: Robert Burke (was: Tyler Akidau) > Make Go SDK on Dataflow multi-threaded >

[jira] [Resolved] (BEAM-4726) Reduce ParDo per element Invoke overhead

2019-01-23 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke resolved BEAM-4726. Resolution: Fixed Fix Version/s: Not applicable I'm reasonably confident we've gone as far

[jira] [Created] (BEAM-6498) Consider using sync/atomic for Go SDK metrics.

2019-01-23 Thread Robert Burke (JIRA)
Robert Burke created BEAM-6498: -- Summary: Consider using sync/atomic for Go SDK metrics. Key: BEAM-6498 URL: https://issues.apache.org/jira/browse/BEAM-6498 Project: Beam Issue Type: Sub-task

[jira] [Commented] (BEAM-6155) Migrate the Go SDK to the modern GCS library

2018-12-12 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16719112#comment-16719112 ] Robert Burke commented on BEAM-6155: With PR [#7182|https://github.com/apache/beam/pull/7182] this is

[jira] [Assigned] (BEAM-6155) Migrate the Go SDK to the modern GCS library

2018-12-13 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6155?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-6155: -- Assignee: (was: Robert Burke) > Migrate the Go SDK to the modern GCS library >

[jira] [Assigned] (BEAM-5381) Dataflow runner creates duplicate CoGBK step IDs

2018-12-13 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-5381: -- Assignee: (was: Robert Burke) > Dataflow runner creates duplicate CoGBK step IDs >

[jira] [Resolved] (BEAM-4765) Use explicit receivers for method invocations.

2018-12-13 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke resolved BEAM-4765. Resolution: Fixed Fix Version/s: Not applicable > Use explicit receivers for method

[jira] [Commented] (BEAM-4765) Use explicit receivers for method invocations.

2018-12-13 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16720682#comment-16720682 ] Robert Burke commented on BEAM-4765: [https://github.com/apache/beam/pull/7161] Opted to generate

[jira] [Created] (BEAM-6255) Support emit func output in the Go SDK's CombineFn ExtractOutput

2018-12-17 Thread Robert Burke (JIRA)
Robert Burke created BEAM-6255: -- Summary: Support emit func output in the Go SDK's CombineFn ExtractOutput Key: BEAM-6255 URL: https://issues.apache.org/jira/browse/BEAM-6255 Project: Beam

[jira] [Commented] (BEAM-6281) Jenkins failure in Go SDK PostCommit

2018-12-20 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16726035#comment-16726035 ] Robert Burke commented on BEAM-6281: I agree. It looks like the machine got too busy and then the

[jira] [Resolved] (BEAM-6281) Jenkins failure in Go SDK PostCommit

2018-12-20 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke resolved BEAM-6281. Resolution: Information Provided Fix Version/s: Not applicable > Jenkins failure in Go SDK

[jira] [Commented] (BEAM-6155) Migrate the Go SDK to the modern GCS library

2018-12-16 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6155?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16722529#comment-16722529 ] Robert Burke commented on BEAM-6155: Since the SDK is experimental, APIs (in the IOs especially) are

[jira] [Created] (BEAM-6148) Support Go "Unit" tests on arbitrary runners

2018-11-29 Thread Robert Burke (JIRA)
Robert Burke created BEAM-6148: -- Summary: Support Go "Unit" tests on arbitrary runners Key: BEAM-6148 URL: https://issues.apache.org/jira/browse/BEAM-6148 Project: Beam Issue Type: New Feature

[jira] [Commented] (BEAM-6117) Dataflow Slowness

2018-11-22 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6117?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16696309#comment-16696309 ] Robert Burke commented on BEAM-6117: Hi Braden! Just a quick note, since I don't want to leave you

[jira] [Assigned] (BEAM-6373) Make Go SDK on Dataflow multi-threaded

2019-01-07 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-6373: -- Assignee: Tyler Akidau (was: Robert Burke) > Make Go SDK on Dataflow multi-threaded >

[jira] [Commented] (BEAM-6373) Make Go SDK on Dataflow multi-threaded

2019-01-07 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736082#comment-16736082 ] Robert Burke commented on BEAM-6373: Without SplitableDoFn (SDF) , Go SDK jobs are unable to scale and

[jira] [Assigned] (BEAM-6372) Direct Runner should marshal data in a similar way to Dataflow runner

2019-01-07 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-6372: -- Assignee: (was: Robert Burke) > Direct Runner should marshal data in a similar way to

[jira] [Commented] (BEAM-3306) Consider: Go coder registry

2019-01-07 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736154#comment-16736154 ] Robert Burke commented on BEAM-3306: Added proposal doc link to description. 

[jira] [Commented] (BEAM-6375) Walltime seems incorrect with the Go SDK and Dataflow

2019-01-07 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736071#comment-16736071 ] Robert Burke commented on BEAM-6375: I suspect this has to do with that ParDos don't currently

[jira] [Assigned] (BEAM-6373) Make Go SDK on Dataflow multi-threaded

2019-01-07 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-6373: -- Assignee: Robert Burke (was: Tyler Akidau) > Make Go SDK on Dataflow multi-threaded >

[jira] [Commented] (BEAM-6374) "elements added" for input and output collections is always empty

2019-01-07 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6374?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736080#comment-16736080 ] Robert Burke commented on BEAM-6374: As with https://issues.apache.org/jira/browse/BEAM-6375, this is

[jira] [Assigned] (BEAM-6372) Direct Runner should marshal data in a similar way to Dataflow runner

2019-01-07 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-6372: -- Assignee: Robert Burke > Direct Runner should marshal data in a similar way to Dataflow runner

[jira] [Assigned] (BEAM-6374) "elements added" for input and output collections is always empty

2019-01-07 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-6374: -- Assignee: Robert Burke (was: Tyler Akidau) > "elements added" for input and output

[jira] [Commented] (BEAM-6372) Direct Runner should marshal data in a similar way to Dataflow runner

2019-01-07 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16736201#comment-16736201 ] Robert Burke commented on BEAM-6372: Off the top of my head, I think I agree with the assessment, the

[jira] [Updated] (BEAM-3306) Consider: Go coder registry

2019-01-07 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke updated BEAM-3306: --- Description: Add coder registry to allow easier overwrite of default coders. We may also allow

[jira] [Assigned] (BEAM-3306) Consider: Go coder registry

2019-01-07 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-3306: -- Assignee: Robert Burke > Consider: Go coder registry > --- > >

[jira] [Commented] (BEAM-6073) Go PostCommit Broken -> gogradle needs "github.com/stretchr/testify/assert" dep.

2019-01-04 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734378#comment-16734378 ] Robert Burke commented on BEAM-6073: The bug as written was fixed ages ago, but the overall root cause

[jira] [Commented] (BEAM-5954) [Flake][Go PostCommit] Multiple Go Dataflow integration tests flaking.

2019-01-04 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734399#comment-16734399 ] Robert Burke commented on BEAM-5954: As a rule, if it's not tagged with the component go-sdk I will

[jira] [Commented] (BEAM-3580) Do not use Go BytesCoder to encode string

2019-01-04 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16734374#comment-16734374 ] Robert Burke commented on BEAM-3580: You're right though, a dedicated custom coder for strings would

[jira] [Closed] (BEAM-5954) [Flake][Go PostCommit] Multiple Go Dataflow integration tests flaking.

2019-01-04 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke closed BEAM-5954. -- Resolution: Cannot Reproduce Fix Version/s: Not applicable > [Flake][Go PostCommit] Multiple Go

[jira] [Updated] (BEAM-6073) Go PostCommit Broken -> gogradle needs "github.com/stretchr/testify/assert" dep.

2019-01-04 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke updated BEAM-6073: --- Priority: Minor (was: Major) > Go PostCommit Broken -> gogradle needs

[jira] [Resolved] (BEAM-6325) Error message is printed as bytes when failing to cross-compile

2018-12-28 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6325?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke resolved BEAM-6325. Resolution: Fixed Fix Version/s: Not applicable Thanks for the notice. Casting to string

[jira] [Assigned] (BEAM-6255) Support emit func output in the Go SDK's CombineFn ExtractOutput

2018-12-19 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-6255: -- Assignee: (was: Robert Burke) > Support emit func output in the Go SDK's CombineFn

[jira] [Assigned] (BEAM-6260) Implement a Kafka IO for Golang SDK

2018-12-19 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-6260: -- Assignee: (was: Robert Burke) > Implement a Kafka IO for Golang SDK >

[jira] [Commented] (BEAM-6260) Implement a Kafka IO for Golang SDK

2018-12-19 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16725326#comment-16725326 ] Robert Burke commented on BEAM-6260: Currently no explicit plans. IOs are mostly at contributor

[jira] [Assigned] (BEAM-5977) Benchmark buffer use in the Go SDK Harness

2019-01-24 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-5977: -- Assignee: Robert Burke > Benchmark buffer use in the Go SDK Harness >

[jira] [Closed] (BEAM-5977) Benchmark buffer use in the Go SDK Harness

2019-01-22 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke closed BEAM-5977. -- Resolution: Fixed Fix Version/s: Not applicable Most buffer use is fine. There was some tiny

[jira] [Created] (BEAM-6482) starcgen tool should introspect struct doFns/combineFns for embedded types and lift their methods where applicable.

2019-01-22 Thread Robert Burke (JIRA)
Robert Burke created BEAM-6482: -- Summary: starcgen tool should introspect struct doFns/combineFns for embedded types and lift their methods where applicable. Key: BEAM-6482 URL:

[jira] [Assigned] (BEAM-6374) "elements added" for input and output collections is always empty

2019-01-22 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-6374: -- Assignee: (was: Robert Burke) > "elements added" for input and output collections is

[jira] [Resolved] (BEAM-3612) Make it easy to generate type-specialized Go SDK reflectx.Funcs

2019-01-22 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke resolved BEAM-3612. Resolution: Fixed Fix Version/s: Not applicable > Make it easy to generate type-specialized

[jira] [Commented] (BEAM-3612) Make it easy to generate type-specialized Go SDK reflectx.Funcs

2019-01-22 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3612?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16748967#comment-16748967 ] Robert Burke commented on BEAM-3612: Closing this. The tool is advance enough for most use cases at

[jira] [Assigned] (BEAM-6375) Walltime seems incorrect with the Go SDK and Dataflow

2019-01-22 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-6375: -- Assignee: (was: Robert Burke) > Walltime seems incorrect with the Go SDK and Dataflow >

[jira] [Commented] (BEAM-6903) Go IT fails on quota issues frequently

2019-03-25 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16801223#comment-16801223 ] Robert Burke commented on BEAM-6903: The error: 2019/03/25 06:04:12 Test flatten:flatten failed:

[jira] [Assigned] (BEAM-6903) Go IT fails on quota issues frequently

2019-03-25 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6903?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-6903: -- Assignee: Jason Kuster (was: Robert Burke) > Go IT fails on quota issues frequently >

[jira] [Assigned] (BEAM-5379) Go Modules versioning support

2019-03-26 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-5379: -- Assignee: Robert Burke > Go Modules versioning support > - > >

[jira] [Updated] (BEAM-6838) Improve error messages for unregistered types

2019-03-24 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke updated BEAM-6838: --- Description: When users have a type that can't be serialized (it has a function Field or similar) or

[jira] [Updated] (BEAM-6838) Improve error messages for unregistered types

2019-03-24 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke updated BEAM-6838: --- Summary: Improve error messages for unregistered types (was: Improve error messages for unregistered

[jira] [Updated] (BEAM-6140) Go pipelines hang on completion when run with Universal Runner and ULR

2019-03-25 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke updated BEAM-6140: --- Component/s: sdk-go > Go pipelines hang on completion when run with Universal Runner and ULR >

[jira] [Created] (BEAM-7009) Add Go SDK test for Standard Coders using the yaml data.

2019-04-04 Thread Robert Burke (JIRA)
Robert Burke created BEAM-7009: -- Summary: Add Go SDK test for Standard Coders using the yaml data. Key: BEAM-7009 URL: https://issues.apache.org/jira/browse/BEAM-7009 Project: Beam Issue Type:

[jira] [Updated] (BEAM-6724) Go SDK on Dataflow processing step emits but it doesn't reach framework

2019-04-05 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke updated BEAM-6724: --- Component/s: sdk-go > Go SDK on Dataflow processing step emits but it doesn't reach framework >

[jira] [Assigned] (BEAM-5381) Dataflow runner creates duplicate CoGBK step IDs

2019-04-05 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-5381: -- Assignee: Robert Burke > Dataflow runner creates duplicate CoGBK step IDs >

[jira] [Work started] (BEAM-5381) Dataflow runner creates duplicate CoGBK step IDs

2019-04-05 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-5381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on BEAM-5381 started by Robert Burke. -- > Dataflow runner creates duplicate CoGBK step IDs >

[jira] [Commented] (BEAM-6838) Improve error messages for unregistered types

2019-03-27 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803544#comment-16803544 ] Robert Burke commented on BEAM-6838: Note:With Go SDK being experimental doesn't meaningfully track

[jira] [Created] (BEAM-6960) Run Go PostCommit tests against a ULR

2019-04-01 Thread Robert Burke (JIRA)
Robert Burke created BEAM-6960: -- Summary: Run Go PostCommit tests against a ULR Key: BEAM-6960 URL: https://issues.apache.org/jira/browse/BEAM-6960 Project: Beam Issue Type: Sub-task

[jira] [Created] (BEAM-6959) Run Go SDK Post Commit tests against the Flink Runner.

2019-04-01 Thread Robert Burke (JIRA)
Robert Burke created BEAM-6959: -- Summary: Run Go SDK Post Commit tests against the Flink Runner. Key: BEAM-6959 URL: https://issues.apache.org/jira/browse/BEAM-6959 Project: Beam Issue Type:

[jira] [Updated] (BEAM-6960) Run Go PostCommit tests against a ULR

2019-04-01 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6960?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke updated BEAM-6960: --- Description: See parent task :https://issues.apache.org/jira/browse/BEAM-6958   [Instructions on

[jira] [Resolved] (BEAM-6738) Reduce Combine overhead

2019-04-01 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6738?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke resolved BEAM-6738. Resolution: Fixed Fix Version/s: Not applicable > Reduce Combine overhead >

[jira] [Comment Edited] (BEAM-6745) Cannot run pipeline on Dataflow (GO SDK)

2019-04-01 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779662#comment-16779662 ] Robert Burke edited comment on BEAM-6745 at 4/1/19 6:10 PM: There's no

[jira] [Created] (BEAM-6958) Split Go PostCommit Test results by Runner

2019-04-01 Thread Robert Burke (JIRA)
Robert Burke created BEAM-6958: -- Summary: Split Go PostCommit Test results by Runner Key: BEAM-6958 URL: https://issues.apache.org/jira/browse/BEAM-6958 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-6961) Run Go SDK Postcommits Dataflow as their own jenkins target

2019-04-01 Thread Robert Burke (JIRA)
Robert Burke created BEAM-6961: -- Summary: Run Go SDK Postcommits Dataflow as their own jenkins target Key: BEAM-6961 URL: https://issues.apache.org/jira/browse/BEAM-6961 Project: Beam Issue

[jira] [Created] (BEAM-6744) Go SDK Dataflow Runner should support implicit authentication

2019-02-25 Thread Robert Burke (JIRA)
Robert Burke created BEAM-6744: -- Summary: Go SDK Dataflow Runner should support implicit authentication Key: BEAM-6744 URL: https://issues.apache.org/jira/browse/BEAM-6744 Project: Beam Issue

[jira] [Commented] (BEAM-6745) Cannot run pipeline on Dataflow (GO SDK)

2019-02-25 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16777333#comment-16777333 ] Robert Burke commented on BEAM-6745: Obligatory reminder that Dataflow doesn't support the Go SDK at

[jira] [Commented] (BEAM-6745) Cannot run pipeline on Dataflow (GO SDK)

2019-02-27 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779662#comment-16779662 ] Robert Burke commented on BEAM-6745: There's no *dataflow side* documentation of the SDK, or any

[jira] [Comment Edited] (BEAM-6745) Cannot run pipeline on Dataflow (GO SDK)

2019-02-27 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6745?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16779662#comment-16779662 ] Robert Burke edited comment on BEAM-6745 at 2/27/19 10:15 PM: -- There's no

[jira] [Assigned] (BEAM-4468) Go SDK-Tune in memory pre-combine caching for Lifted Combines.

2019-02-22 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-4468: -- Assignee: Robert Burke > Go SDK-Tune in memory pre-combine caching for Lifted Combines. >

[jira] [Commented] (BEAM-4468) Go SDK-Tune in memory pre-combine caching for Lifted Combines.

2019-02-22 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-4468?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16775352#comment-16775352 ] Robert Burke commented on BEAM-4468: I've finally hit the point in my performance work where large and

[jira] [Created] (BEAM-6738) Reduce Combine overhead

2019-02-22 Thread Robert Burke (JIRA)
Robert Burke created BEAM-6738: -- Summary: Reduce Combine overhead Key: BEAM-6738 URL: https://issues.apache.org/jira/browse/BEAM-6738 Project: Beam Issue Type: Sub-task Components:

[jira] [Commented] (BEAM-3300) Portable flattens in Go SDK Harness

2019-03-19 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796584#comment-16796584 ] Robert Burke commented on BEAM-3300: It does indeed handle flattens coming the other way on the

[jira] [Assigned] (BEAM-3300) Portable flattens in Go SDK Harness

2019-03-19 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-3300: -- Assignee: Henning Rohde > Portable flattens in Go SDK Harness >

[jira] [Commented] (BEAM-3300) Portable flattens in Go SDK Harness

2019-03-19 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796411#comment-16796411 ] Robert Burke commented on BEAM-3300: Reasonably certain it's done, we translate them into the Flatten

[jira] [Comment Edited] (BEAM-3300) Portable flattens in Go SDK Harness

2019-03-19 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16796584#comment-16796584 ] Robert Burke edited comment on BEAM-3300 at 3/19/19 10:32 PM: -- It does indeed

[jira] [Resolved] (BEAM-3300) Portable flattens in Go SDK Harness

2019-03-19 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke resolved BEAM-3300. Resolution: Fixed Fix Version/s: Not applicable > Portable flattens in Go SDK Harness >

[jira] [Created] (BEAM-6652) Handle map encoding better.

2019-02-11 Thread Robert Burke (JIRA)
Robert Burke created BEAM-6652: -- Summary: Handle map encoding better. Key: BEAM-6652 URL: https://issues.apache.org/jira/browse/BEAM-6652 Project: Beam Issue Type: Improvement

[jira] [Created] (BEAM-6682) [GoSDK] There should be a combineFn unit tester that validates lifting.

2019-02-15 Thread Robert Burke (JIRA)
Robert Burke created BEAM-6682: -- Summary: [GoSDK] There should be a combineFn unit tester that validates lifting. Key: BEAM-6682 URL: https://issues.apache.org/jira/browse/BEAM-6682 Project: Beam

[jira] [Updated] (BEAM-6682) [GoSDK] There should be a combineFn unit tester that validates lifting.

2019-02-15 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke updated BEAM-6682: --- Description: The Go direct runner doesn't handle combiner lifting, which means combiners aren't

[jira] [Assigned] (BEAM-6652) Handle map encoding better.

2019-02-15 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6652?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Robert Burke reassigned BEAM-6652: -- Assignee: Robert Burke > Handle map encoding better. > --- > >

[jira] [Comment Edited] (BEAM-6498) Consider using sync/atomic for Go SDK metrics.

2019-01-29 Thread Robert Burke (JIRA)
[ https://issues.apache.org/jira/browse/BEAM-6498?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16755393#comment-16755393 ] Robert Burke edited comment on BEAM-6498 at 1/29/19 9:24 PM: -

  1   2   3   >