Re: [PROPOSAL] Design Doc template for PTransforms

2023-08-24 Thread Robert Bradshaw via dev
+1 I'd love for this information to be accessible programmatically as well (both directions: extracting parameters from a transform and constructing a transform from parameters). Making this pattern easy could encourage compliance. On Thu, Aug 24, 2023 at 8:54 AM Svetak Sundhar via dev wrote: >

Re: [PROPOSAL] Design Doc template for PTransforms

2023-08-24 Thread Svetak Sundhar via dev
Thanks Kenn! I put up a PR to add this reference to the Beam website. I'm actively using the template now, and one piece of feedback I have is to include a section for prototyped work. Maybe a table that allows the user to post links to Github prototype

Re: [PROPOSAL] Design Doc template for PTransforms

2023-08-24 Thread Kerry Donny-Clark via dev
Thanks Kenn! I think this would be a great community resource. While we don't want to enforce usage, perhaps we could introduce tooling to check basic compliance and raise a warning. Similar to a linter or test suite. Kerry On Thu, Aug 24, 2023 at 10:25 AM Kenneth Knowles wrote: > Hi all, > > Ba

[PROPOSAL] Design Doc template for PTransforms

2023-08-24 Thread Kenneth Knowles
Hi all, Based on some work I've been doing internally, I put together a public version of a design doc template for PTransforms. https://s.apache.org/ptransform-design-doc A major goal is to be explicit about important questions that make a transform robust: - what are "all" the parameters to