Re: The full list of proposals / prototype documents

2019-01-28 Thread Ismaël Mejía
First step probably is to make mandatory to add the document to the design documents page before sending it to the mailing list for discussion. On Mon, Jan 28, 2019 at 6:13 PM Maximilian Michels wrote: > > This is awesome. Thank you for creating this page Alexey! I found some > documents >

Re: The full list of proposals / prototype documents

2019-01-28 Thread Maximilian Michels
This is awesome. Thank you for creating this page Alexey! I found some documents which I missed in the past. I wonder if we could make it easier to maintain the page? If design docs were in the Wiki, it would be trivial to maintain such a list. Obviously the Google Docs are great for

Re: The full list of proposals / prototype documents

2019-01-25 Thread Alexey Romanenko
Hi Alex, Indeed, some of them are not shared with everyone. I asked on Slack channel to fix this. Thank you for the list! > On 18 Jan 2019, at 19:57, Alex Van Boxel wrote: > > typically me... I just click on 2 of the 3 that were not shared. I went over > all of the proposals to see where I

Re: The full list of proposals / prototype documents

2019-01-18 Thread Alex Van Boxel
typically me... I just click on 2 of the 3 that were not shared. I went over all of the proposals to see where I needed to get access, here is the list:SQL / Schema - Pubsub to Beam SQL [doc ] -

Re: The full list of proposals / prototype documents

2019-01-18 Thread Alexey Romanenko
Hi Alex, Hmm, afaik, this is mostly google docs file which shared with anyone who knows the link. Could you send here the names of proposals that required an access approval? Thanks. > On 18 Jan 2019, at 16:58, Alex Van Boxel wrote: > > Hey Alexey, > > I see that a lot (well, I tried 2)

Re: The full list of proposals / prototype documents

2019-01-18 Thread Ismaël Mejía
We should make mandatory to add the document to the design documents page before sending it to the mailing list to avoid missing information. Or even better than we have a more formal improvement proposal so we also know the status of the proposals to know if they are accepted, refused, etc

Re: The full list of proposals / prototype documents

2019-01-18 Thread Alex Van Boxel
Hey Alexey, I see that a lot (well, I tried 2) proposals require access approval. Should that be the case? _/ _/ Alex Van Boxel On Fri, Jan 18, 2019 at 4:51 PM Alexey Romanenko wrote: > I’m sorry but I forgot to mention that the whole list could be found here: >

Re: The full list of proposals / prototype documents

2019-01-18 Thread Alexey Romanenko
I’m sorry but I forgot to mention that the whole list could be found here: https://beam.apache.org/contribute/design-documents/ > On 18 Jan 2019, at 16:49, Alexey Romanenko wrote: > > FYI: I updated the list of design documents to make it

Re: The full list of proposals / prototype documents

2019-01-18 Thread Alexey Romanenko
FYI: I updated the list of design documents to make it up-to-date. PR: https://github.com/apache/beam/pull/7560 Please, feel free to add new ones if I missed something. Also, I’d like to remind that it would be very helpful to add design document to

Re: The full list of proposals / prototype documents

2018-07-11 Thread Alexey Romanenko
Thank you for this link, Etienne. I agree that it doesn’t fit well for design documents page. So, I think it makes sense to add either on wiki or as a part of Nexmark documentation on web site: https://beam.apache.org/documentation/sdks/java/nexmark/

Re: The full list of proposals / prototype documents

2018-07-11 Thread Etienne Chauchot
Alexey, One doc that can be interesting that I forgot to point out is https://docs.google.com/document/d/1VgnGiVu8vSfm7Et-xAtQYv 0PlEpqeyfmhpQUNPmWRJs/edit?usp=sharingIt is the doc I wrote when I submitted Nexmark PR to ease the reading of the code. It is not a design doc, I don't know if it

Re: The full list of proposals / prototype documents

2018-06-06 Thread Alexey Romanenko
FYI: Finally, it was merged and you can find this page here: https://beam.apache.org/contribute/design-documents/ Thank you everybody who helped me to compile this list! I’ll try to do my best to update this with new coming docs. In the

Re: The full list of proposals / prototype documents

2018-05-31 Thread Eugene Kirpichov
Thank you! On Thu, May 31, 2018 at 8:30 AM Alexey Romanenko wrote: > Thank you everybody for provided links. I collected all of them (please, > correct me if I missed something), categorized and created a dedicated page > for Beam website. > > Here is a PR for that (please, review): >

Re: The full list of proposals / prototype documents

2018-05-31 Thread Alexey Romanenko
Thank you everybody for provided links. I collected all of them (please, correct me if I missed something), categorized and created a dedicated page for Beam website. Here is a PR for that (please, review): https://github.com/apache/beam-site/pull/456

Re: The full list of proposals / prototype documents

2018-05-30 Thread Łukasz Gajowy
Hi, I just wanted to add those two (sorry for being kinda late with this): https://docs.google.com/document/d/1dA-5s6OHiP_cz-NRAbwapoKF5MEC1wKps4A5tFbIPKE/edit?usp=sharing https://docs.google.com/document/d/1Cb7XVmqe__nA_WCrriAifL-3WCzbZzV4Am5W_SkQLeA/edit?usp=sharing Thanks, Łukasz 2018-05-29

Re: The full list of proposals / prototype documents

2018-05-29 Thread Lukasz Cwik
Providing ownership to the PMC account allows others to take over ownership of the document once a contributor stops being active. This allows docs to be updated (even if just to point to a newer doc). On Tue, May 29, 2018 at 1:20 PM Kenneth Knowles wrote: > My position on ownership is design

Re: The full list of proposals / prototype documents

2018-05-29 Thread Kenneth Knowles
My position on ownership is design docs are really documents "of the moment" and authored by a particular individual or group. Experience shows that even if you try, keeping it fresh is not likely to happen. Anything that needs freshness (like end-user docs) should be in a different medium. I

Re: The full list of proposals / prototype documents

2018-05-29 Thread Lukasz Cwik
I transferred ownership of the docs that I owned to the apacheb...@gmail.com PMC account and put the ones that I owned into the drive folder. Would it be a good idea for others to follow suit? Instructions on how to transfer ownership are here:

Re: The full list of proposals / prototype documents

2018-05-29 Thread Lukasz Cwik
I created a PR for the beam-site to link to the design docs and template from the contribution guide: https://github.com/apache/beam-site/pull/454 On Fri, May 25, 2018 at 10:23 AM Lukasz Cwik wrote: > Here are some more links related to portability efforts: > > >

Re: The full list of proposals / prototype documents

2018-05-25 Thread Lukasz Cwik
Here are some more links related to portability efforts: https://s.apache.org/beam-fn-api https://s.apache.org/beam-fn-api-processing-a-bundle https://s.apache.org/beam-fn-api-send-and-receive-data https://s.apache.org/beam-fn-state-api-and-bundle-processing

Re: The full list of proposals / prototype documents

2018-05-24 Thread Scott Wegner
Thanks for sharing these. I also put together a design doc template based on common styling / sections I saw in the docs listed above. Others are free to use it as they'd like. https://docs.google.com/document/d/1kVePqjt2daZd0bQHGUwghlcLbhvrny7VpflAzk9sjUg/edit?usp=sharing On Thu, May 24, 2018

Re: The full list of proposals / prototype documents

2018-05-24 Thread Kenneth Knowles
OK, I will also put a list here of those I know off the top of my head. Some are redundant with Etienne's but short links that I can think of: https://s.apache.org/a-new-dofn https://s.apache.org/beam-triggers https://s.apache.org/beam-sink-triggers https://s.apache.org/beam-runner-composites

Re: The full list of proposals / prototype documents

2018-05-24 Thread Etienne Chauchot
Great that you take this action Alexey !Here are the links I have, there is duplicates with the ones you already received and maybe old docs as well: https://docs.google.com/document/d/1MtBZYV7NAcfbwyy9Op8STeFNBxtljxgy69FkHMvhTMA/edithttps://docs.google.com/document/d/1

Re: The full list of proposals / prototype documents

2018-05-24 Thread Alexey Romanenko
Thank you everybody for positive feedback and sending me links to design docs. I’m going to complete the full list and create PR for review. Griselda Perhaps, it was a bit of misunderstanding here, let me explain what I assume under creating of such page. Actually, for now I’m going to

Re: The full list of proposals / prototype documents

2018-05-23 Thread Griselda Cuevas
Hi Everyone, @Alexey, I think this is a great idea, I'd like to understand more of the motivation behind having all the designs doc under a single page. In my opinion it could become a challenge to maintain a page, so knowing what you want to accomplish could help us think of alternative

Re: The full list of proposals / prototype documents

2018-05-23 Thread Daniel Oliveira
+1 to web site page (not Google Doc). Definitely agree that a common entry point would be excellent. I don't like the idea of the Google Doc so much because it's not very good for having changes reviewed and keeping track of who added what, unlike Github. Adding an entry to the list in the

Re: The full list of proposals / prototype documents

2018-05-23 Thread Lukasz Cwik
+1, Thanks for picking this up Alexey On Wed, May 23, 2018 at 10:41 AM Huygaa Batsaikhan wrote: > +1. That is great, Alexey. Robin and I are working on documenting some > missing pieces of Java SDK. We will let you know when we create polished > documents. > > On Wed, May 23,

Re: The full list of proposals / prototype documents

2018-05-23 Thread Huygaa Batsaikhan
+1. That is great, Alexey. Robin and I are working on documenting some missing pieces of Java SDK. We will let you know when we create polished documents. On Wed, May 23, 2018 at 9:28 AM Ismaël Mejía wrote: > +1 and thanks for volunteering for this Alexey. > We really need to

Re: The full list of proposals / prototype documents

2018-05-23 Thread Ismaël Mejía
+1 and thanks for volunteering for this Alexey. We really need to make this more accesible. On Wed, May 23, 2018 at 6:00 PM Alexey Romanenko wrote: > Joseph, Eugene - thank you very much for the links! > All, regarding one common entry point for all design documents.

Re: The full list of proposals / prototype documents

2018-05-23 Thread Alexey Romanenko
Joseph, Eugene - thank you very much for the links! All, regarding one common entry point for all design documents. Could we just have a dedicated page on Beam web site with a list of links to every proposed document? Every entry (optionally) might contain, in addition, short abstract and list

Re: The full list of proposals / prototype documents

2018-05-22 Thread Eugene Kirpichov
Making it easier to manage indeed would be good. Could someone from PMC please add the following documents of mine to it? SDF related documents: http://s.apache.org/splittable-do-fn http://s.apache.org/sdf-via-source http://s.apache.org/textio-sdf

Re: The full list of proposals / prototype documents

2018-05-22 Thread Kenneth Knowles
It is owned by the Beam PMC collectively. Any PMC member can add things to it. Ideas for making it easy to manage are welcome. Probably easier to have a markdown file somewhere with a list of docs so we can issue and review PRs. Not sure the web site is the right place for it - we have a history

Re: The full list of proposals / prototype documents

2018-05-22 Thread Scott Wegner
Thanks for the links. Any details on that Google drive folder? Who maintains it? Is it possible for any contributor to add their design doc? On Mon, May 21, 2018 at 8:15 AM Joseph PENG wrote: > Alexey, > > I do not know where you can find all design docs, but I know a

Re: The full list of proposals / prototype documents

2018-05-21 Thread Joseph PENG
Alexey, I do not know where you can find all design docs, but I know a blog that has collected some of the major design docs. Hope it helps. https://wtanaka.com/beam/design-doc https://drive.google.com/drive/folders/0B-IhJZh9Ab52OFBVZHpsNjc4eXc On Mon, May 21, 2018 at 9:28 AM Alexey Romanenko