[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16814126#comment-16814126 ] Bertrand Delacretaz commented on INCUBATOR-231: --- Very cool - maybe just ask on incubator@ and/or the Whimsy team if anyone's aware of this data being used elsewhere. And if you have info on where data is used it'd be good to document that along the way. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz, > clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt, > gitbox.clutch.data.txt, gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16813948#comment-16813948 ] Dave Fisher commented on INCUBATOR-231: --- Bertrand, I'm moving to the next step of improving podling lifecycle by eliminating the hand editing and the whole podling status page as it is in SVN. Based on how this plays out I may move the clutch files. Let's see how that goes. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz, > clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt, > gitbox.clutch.data.txt, gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809682#comment-16809682 ] Bertrand Delacretaz commented on INCUBATOR-231: --- Thanks Dave, your changes work for me. +1 for a CLUTCH.md, and we might just keep a warning about clutch and a link to that page in the README. How about moving the clutch data links to http://incubator.apache.org/clutch/ and adding a link to CLUTCH.md there? That URL then becomes the "all you need to know about clutch" one. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz, > clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt, > gitbox.clutch.data.txt, gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16809371#comment-16809371 ] Dave Fisher commented on INCUBATOR-231: --- You are welcome Bertrand! Thanks for your updates to the README. I made some more let me know what you think. Perhaps we need a CLUTCH.md. I would rather discuss the podling status pages with dev@whimsical and general@incubator to perfect how we want to maintain and store the status information. I think it may be time to resolve this JIRA. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz, > clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt, > gitbox.clutch.data.txt, gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808487#comment-16808487 ] Bertrand Delacretaz commented on INCUBATOR-231: --- Thank you very much for this Dave! I have updated the https://github.com/apache/incubator README accordingly, please cross-check. Giving that URL to someone should provide all the info they need to edit and publish the website. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz, > clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt, > gitbox.clutch.data.txt, gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808168#comment-16808168 ] Dave Fisher commented on INCUBATOR-231: --- Bertrand I had to follow your plan. There is now a reserve folder in the asf-site branch. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz, > clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt, > gitbox.clutch.data.txt, gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[
https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16808065#comment-16808065
]
Dave Fisher commented on INCUBATOR-231:
---
{quote}I'm not sure if you can push to the master branch from a Jenkins build.
But if not it's probably possible to push to raw clutch data to asf-site so it
appears (unlinked) under incubator.apache.org/data and can be pulled from there
by the main build.
{quote}
You can't and your suggestion is as bad as doing the clutch every time. I guess
I'll talk to builds, but frankly I feel like I've wasted a lot of time. - days
in fact.
> Cleanup Git-generated Incubator website
> ---
>
> Key: INCUBATOR-231
> URL: https://issues.apache.org/jira/browse/INCUBATOR-231
> Project: Incubator
> Issue Type: Task
>Reporter: Bertrand Delacretaz
>Priority: Major
> Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz,
> clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt,
> gitbox.clutch.data.txt, gitbox.svn.diff.txt
>
>
> [http://incubator.apache.org/] is generated from
> [https://github.com/apache/incubator] but a few things (clutch, project
> pages) are still maintained under
> [http://svn.apache.org/repos/asf/incubator/public/trunk/]
> We should cleanup and unify for consistency, and there's a number of folders
> in svn that are not used anymore. Everything should move to Git to avoid
> confusion.
> Also, a lot of the projects information in the XML files found under
> [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is
> duplicated in other places, LDAP, podlings websites etc - it would be good to
> clean that up and simplify those pages to adapt to our current workflows,
> while preserving history where it makes sense.
> There are also YAML files with yet more duplicated information at
> [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] ,
> not sure if that's used or useful.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807853#comment-16807853 ] Dave Fisher commented on INCUBATOR-231: --- I think that the concern is that the automatic build is triggered by changes to the master. So, if you changed master in the automatic build you would have an infinite loop. The plan is to turn off the automatic build. Make another daily SVN/Clutch job where its commit changes master. Once that works the now simple automatic build is turned back on and tested by a manual clutch change ... > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz, > clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt, > gitbox.clutch.data.txt, gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807662#comment-16807662 ] Bertrand Delacretaz commented on INCUBATOR-231: --- I'm not sure if you can push to the master branch from a Jenkins build. But if not it's probably possible to push to raw clutch data to asf-site so it appears (unlinked) under incubator.apache.org/data and can be pulled from there by the main build. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz, > clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt, > gitbox.clutch.data.txt, gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16807414#comment-16807414 ] Dave Fisher commented on INCUBATOR-231: --- I've split up the process as so and plan to put it into production tomorrow. # build_clutch.sh will do the svn repository old style page build and the clutch analysis. It then copies these into the git trunk. # build_site.sh does a simple bake and then does the git pull, replace content and push on the ash-site branch. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz, > clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt, > gitbox.clutch.data.txt, gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802896#comment-16802896 ] Dave Fisher commented on INCUBATOR-231: --- A few suggestions / questions. # technical - add a hash link so that it is easy to link to specific sections of the cookbook. I have an idea of how to do that. # Release Distribution Policy is an important part to discuss within releases. Not only does a pooling need to follow Legal Policy for an Apache Release, but there must be a Release on Apache Distribution. This needs to be clear. # How should exceptions to the normal course be handled in the cookbook? Should we use a footnote, glossary, or "info box" > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz, > clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt, > gitbox.clutch.data.txt, gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16801946#comment-16801946 ] Dave Fisher commented on INCUBATOR-231: --- Bertrand, I think that the clutch related stuff is in two parts. # source material which remains in the current svn repository. We should create a new JIRA about how we update this. # results should be checked into the main incubator.git as normal pages when they are it will trigger a rebuild which then reduces to only the changed pages. We can use the idea of .adoc to differentiate the generated files from the hand edited .ad files. Once this change is made then I think we resolve this JIRA and have new ones for additional steps. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz, > clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt, > gitbox.clutch.data.txt, gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16801934#comment-16801934 ] Bertrand Delacretaz commented on INCUBATOR-231: --- bq. The clutch2.py scripting should be scheduled once a day instead of the git build The cleanest way to do that is probably to move the clutch-related content to its own repository? That would naturally decouple the build cycles of the main and clutch content. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz, > clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt, > gitbox.clutch.data.txt, gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[
https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800945#comment-16800945
]
Dave Fisher commented on INCUBATOR-231:
---
Regarding the history pages. I've deleted these as the main page at
[https://projects.apache.org/] has a better version of it. So, one less thing
for the IPMC to maintain. BTW - the source is {{podlings.xml}}.
> Cleanup Git-generated Incubator website
> ---
>
> Key: INCUBATOR-231
> URL: https://issues.apache.org/jira/browse/INCUBATOR-231
> Project: Incubator
> Issue Type: Task
>Reporter: Bertrand Delacretaz
>Priority: Major
> Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz,
> clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt,
> gitbox.clutch.data.txt, gitbox.svn.diff.txt
>
>
> [http://incubator.apache.org/] is generated from
> [https://github.com/apache/incubator] but a few things (clutch, project
> pages) are still maintained under
> [http://svn.apache.org/repos/asf/incubator/public/trunk/]
> We should cleanup and unify for consistency, and there's a number of folders
> in svn that are not used anymore. Everything should move to Git to avoid
> confusion.
> Also, a lot of the projects information in the XML files found under
> [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is
> duplicated in other places, LDAP, podlings websites etc - it would be good to
> clean that up and simplify those pages to adapt to our current workflows,
> while preserving history where it makes sense.
> There are also YAML files with yet more duplicated information at
> [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] ,
> not sure if that's used or useful.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16800940#comment-16800940 ] Dave Fisher commented on INCUBATOR-231: --- [~s...@apache.org] I've been thinking similarly over the weekend. The clutch2.py scripting should be scheduled once a day prior to the scheduled incubator.git build. The generated files are then committed to the incubator.git/trunk/pages/clutch/ directory. Clutch takes time due to svn log on the status page content and svn ls on the incubator's list areas and once a day is often enough. If you recommend the git commands I'll give it a try. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz, > clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt, > gitbox.clutch.data.txt, gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16798287#comment-16798287 ] Sebb commented on INCUBATOR-231: When building locally, the process creates a lot of files under pages/clutch It would be useful to exclude these using something like the following: # Generated by clutch2.py: /pages/clutch/_includes/*.ad /pages/clutch/*.ad # This page is maintained in Git !/pages/clutch/index.ad Alternatively, perhaps create the pages with a different suffix (but still processed as asciidoc, e.g. .adoc) This would require changes to the includes, but would make clear which ones are temporary. Yet another approach might be to commit the files to the repo. As it is currently, clutch takes quite a long time to run. Having copies in the repo would allow builds to occur without running clutch every time. [Ideally clutch would only run if there was a change, but detecting that may be just as much effort.] > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz, > clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt, > gitbox.clutch.data.txt, gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16798281#comment-16798281 ] Dave Fisher commented on INCUBATOR-231: --- Projects page has been updated. Slight mis-sorting is due to manual edits in podlings.xml. We will need a discussion about the podling status pages on general@ > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz, > clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt, > gitbox.clutch.data.txt, gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16797692#comment-16797692 ] Dave Fisher commented on INCUBATOR-231: --- I pretty much have the projects index page done, but I am having trouble with the sort and have asked help from Apache Groovy on their slack. I wouldn't need it if people who maintained podlings.xml knew how to collate latin text within names that start with C, G, and H. I'm reluctant to hand sort podlings.xml. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz, > clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt, > gitbox.clutch.data.txt, gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795639#comment-16795639 ] David Fisher commented on INCUBATOR-231: I got access and I put the new clutch pages with an updated build into incubator-git master. After a few iterations everything is good. I have a couple of loose ends to fix before I announce the update on general@. There are actually three more sections to move to asciidoctor/jbake with or without gsp to read xml files. # projects index and pages. # ip-clearance index and pages. # history page. I'm still thinking through the approach, but I'm getting ahead. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz, > clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt, > gitbox.clutch.data.txt, gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16795642#comment-16795642 ] David Fisher commented on INCUBATOR-231: Try https://incubator.apache.org/clutch/ > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz, > clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt, > gitbox.clutch.data.txt, gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794821#comment-16794821 ] Bertrand Delacretaz commented on INCUBATOR-231: --- If you need more Jenkins rights, a PMC chair needs to add you to https://whimsy.apache.org/roster/group/hudson-jobadmin - I canot do that myself. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz, > clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt, > gitbox.clutch.data.txt, gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16794669#comment-16794669 ] David Fisher commented on INCUBATOR-231: Mostly finished with the clutch page along with the new podling clutch analysis pages. I will be attempting to put these into production tomorrow. I probably need Jenkins access to test the new site build. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz, > clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt, > gitbox.clutch.data.txt, gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[
https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16793173#comment-16793173
]
David Fisher commented on INCUBATOR-231:
The podling analysis pages are just about ready to integrate with jBake. I've
attached these. If you get a chance then please review.
Also you can download the svn repos and try out {{clutch2.py}},
{{clutch2data.py}}, and {{clutch2status.py}}
> Cleanup Git-generated Incubator website
> ---
>
> Key: INCUBATOR-231
> URL: https://issues.apache.org/jira/browse/INCUBATOR-231
> Project: Incubator
> Issue Type: Task
>Reporter: Bertrand Delacretaz
>Priority: Major
> Attachments: clutch-analysis.tar.gz, clutch-pages.tar.gz,
> clutch.py.diff.txt, clutch2data.txt, clutch2data.txt, clutch2status.txt,
> gitbox.clutch.data.txt, gitbox.svn.diff.txt
>
>
> [http://incubator.apache.org/] is generated from
> [https://github.com/apache/incubator] but a few things (clutch, project
> pages) are still maintained under
> [http://svn.apache.org/repos/asf/incubator/public/trunk/]
> We should cleanup and unify for consistency, and there's a number of folders
> in svn that are not used anymore. Everything should move to Git to avoid
> confusion.
> Also, a lot of the projects information in the XML files found under
> [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is
> duplicated in other places, LDAP, podlings websites etc - it would be good to
> clean that up and simplify those pages to adapt to our current workflows,
> while preserving history where it makes sense.
> There are also YAML files with yet more duplicated information at
> [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] ,
> not sure if that's used or useful.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[
https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790123#comment-16790123
]
David Fisher commented on INCUBATOR-231:
{{build_site.sh}} will need to build the svn bits before the git bits. The
program will need to abort if there are any issues with the clutch process
and/or with {{content/podlings.xml}}
[~bdelacretaz] would you please grant me enough karma to assign, resolve issues
in the INCUBATOR JIRA?
> Cleanup Git-generated Incubator website
> ---
>
> Key: INCUBATOR-231
> URL: https://issues.apache.org/jira/browse/INCUBATOR-231
> Project: Incubator
> Issue Type: Task
>Reporter: Bertrand Delacretaz
>Priority: Major
> Attachments: clutch-pages.tar.gz, clutch.py.diff.txt,
> clutch2data.txt, clutch2data.txt, clutch2status.txt, gitbox.clutch.data.txt,
> gitbox.svn.diff.txt
>
>
> [http://incubator.apache.org/] is generated from
> [https://github.com/apache/incubator] but a few things (clutch, project
> pages) are still maintained under
> [http://svn.apache.org/repos/asf/incubator/public/trunk/]
> We should cleanup and unify for consistency, and there's a number of folders
> in svn that are not used anymore. Everything should move to Git to avoid
> confusion.
> Also, a lot of the projects information in the XML files found under
> [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is
> duplicated in other places, LDAP, podlings websites etc - it would be good to
> clean that up and simplify those pages to adapt to our current workflows,
> while preserving history where it makes sense.
> There are also YAML files with yet more duplicated information at
> [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] ,
> not sure if that's used or useful.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[
https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790111#comment-16790111
]
David Fisher commented on INCUBATOR-231:
To replace {{projects/index.html}} generation we can follow the template of the
homepage which simply reads {{content/podlings.xml}}
This leaves the question about how to generate {{clutch/index.html}}. I think
we can make {clutch2.py}} generate xml wrapped versions of the current output.
For {{content/projects/*project*.html}} we can use the current xml. We can see
from the clutch2.py how to get the content and ...
Still a few questions.
> Cleanup Git-generated Incubator website
> ---
>
> Key: INCUBATOR-231
> URL: https://issues.apache.org/jira/browse/INCUBATOR-231
> Project: Incubator
> Issue Type: Task
>Reporter: Bertrand Delacretaz
>Priority: Major
> Attachments: clutch-pages.tar.gz, clutch.py.diff.txt,
> clutch2data.txt, clutch2data.txt, clutch2status.txt, gitbox.clutch.data.txt,
> gitbox.svn.diff.txt
>
>
> [http://incubator.apache.org/] is generated from
> [https://github.com/apache/incubator] but a few things (clutch, project
> pages) are still maintained under
> [http://svn.apache.org/repos/asf/incubator/public/trunk/]
> We should cleanup and unify for consistency, and there's a number of folders
> in svn that are not used anymore. Everything should move to Git to avoid
> confusion.
> Also, a lot of the projects information in the XML files found under
> [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is
> duplicated in other places, LDAP, podlings websites etc - it would be good to
> clean that up and simplify those pages to adapt to our current workflows,
> while preserving history where it makes sense.
> There are also YAML files with yet more duplicated information at
> [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] ,
> not sure if that's used or useful.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[
https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790039#comment-16790039
]
David Fisher commented on INCUBATOR-231:
In r1855267
# {{clutch2.py}} the replacement for {{clutch.py}} is nearly completed. I will
return the current clutch page to the same form as now. Just need to restore
the newCommitter tracking.
# {{clutch2status.py}} now produces an ad file in {{content/clutch}} for each
podling. I am attaching the results which I would like to have someone review
before proceeding (or take the next step.)
# Attached {{clutch-pages.tar.gz}}. Please see how these bake. If you fix one
mark it up and I'll compare and update the python program.
We can discuss if these new pages should replace the current podling's project
html page while the current xml file is still the source of record.
> Cleanup Git-generated Incubator website
> ---
>
> Key: INCUBATOR-231
> URL: https://issues.apache.org/jira/browse/INCUBATOR-231
> Project: Incubator
> Issue Type: Task
>Reporter: Bertrand Delacretaz
>Priority: Major
> Attachments: clutch-pages.tar.gz, clutch.py.diff.txt,
> clutch2data.txt, clutch2data.txt, clutch2status.txt, gitbox.clutch.data.txt,
> gitbox.svn.diff.txt
>
>
> [http://incubator.apache.org/] is generated from
> [https://github.com/apache/incubator] but a few things (clutch, project
> pages) are still maintained under
> [http://svn.apache.org/repos/asf/incubator/public/trunk/]
> We should cleanup and unify for consistency, and there's a number of folders
> in svn that are not used anymore. Everything should move to Git to avoid
> confusion.
> Also, a lot of the projects information in the XML files found under
> [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is
> duplicated in other places, LDAP, podlings websites etc - it would be good to
> clean that up and simplify those pages to adapt to our current workflows,
> while preserving history where it makes sense.
> There are also YAML files with yet more duplicated information at
> [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] ,
> not sure if that's used or useful.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[
https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789079#comment-16789079
]
David Fisher commented on INCUBATOR-231:
In r1855192 I commit three python3 programs.
# {{clutch2.py}} is a replacement for {{clutch.py}} which does so much more
checking. It will interfere so if you do run it be aware that
{{content/clutch/*}} and {{clutch.pkl}} will be modified. Rerun {{clutch.py}}
to fix.
# {{clutch2status.py}} currently produces a single report to stdout for all
podlings. I'll attach the current output. I plan to convert this to AD with a
page for each podling.
# {{clutch2json.py}} produces a JSON version of {{clutch.pkl}}
I'm not done and I still need to document and produce some sanity tests.
[~jmclean] It seems like nearly half the podlings are in group 3.
> Cleanup Git-generated Incubator website
> ---
>
> Key: INCUBATOR-231
> URL: https://issues.apache.org/jira/browse/INCUBATOR-231
> Project: Incubator
> Issue Type: Task
>Reporter: Bertrand Delacretaz
>Priority: Major
> Attachments: clutch2data.txt, clutch2status.txt,
> gitbox.clutch.data.txt, gitbox.svn.diff.txt
>
>
> [http://incubator.apache.org/] is generated from
> [https://github.com/apache/incubator] but a few things (clutch, project
> pages) are still maintained under
> [http://svn.apache.org/repos/asf/incubator/public/trunk/]
> We should cleanup and unify for consistency, and there's a number of folders
> in svn that are not used anymore. Everything should move to Git to avoid
> confusion.
> Also, a lot of the projects information in the XML files found under
> [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is
> duplicated in other places, LDAP, podlings websites etc - it would be good to
> clean that up and simplify those pages to adapt to our current workflows,
> while preserving history where it makes sense.
> There are also YAML files with yet more duplicated information at
> [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] ,
> not sure if that's used or useful.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16788396#comment-16788396 ] Sebb commented on INCUBATOR-231: [~wave] AIUI the entry in the DTD means that the value must be 1 or 2 or 3, so I think the DTD is correct. See [1] for sample failed job. I saw the Comdev thread. [~jmclean] Does your editor support the DTD? But I agree that it would be better to use an app to update the data. It could do other useful stuff like try and keep the group numbers roughly even. [1] [https://lists.apache.org/thread.html/bf1dbeed097eb07be02f77daab7bba956b0610030b73bd7e9f86a690@%3Cnotifications.whimsical.apache.org%3E] > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch2data.txt, gitbox.clutch.data.txt, > gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16788384#comment-16788384 ] Justin Mclean commented on INCUBATOR-231: - I need to edit the file every month to fix up podlings that need to report monthly, and new puddings edit it to add them selves - both of these tasks wouldn't be too hard to generate rather than hand editing. I use an editor that understand and validates the XML so that reduces the risk of making errors. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch2data.txt, gitbox.clutch.data.txt, > gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[
https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16788383#comment-16788383
]
David Fisher commented on INCUBATOR-231:
[~s...@apache.org] Which whimsy job?
There is a podlings.dtd which has {{}}
Do you have an edit?
FYI on comdev there is a discussion about DOAP, security and other metadata.
Perhaps a $financed job.
I completely agree that somehow we need to allow whimsy to edit the
podlings.xml and then we generate the podling status files.
> Cleanup Git-generated Incubator website
> ---
>
> Key: INCUBATOR-231
> URL: https://issues.apache.org/jira/browse/INCUBATOR-231
> Project: Incubator
> Issue Type: Task
>Reporter: Bertrand Delacretaz
>Priority: Major
> Attachments: clutch2data.txt, gitbox.clutch.data.txt,
> gitbox.svn.diff.txt
>
>
> [http://incubator.apache.org/] is generated from
> [https://github.com/apache/incubator] but a few things (clutch, project
> pages) are still maintained under
> [http://svn.apache.org/repos/asf/incubator/public/trunk/]
> We should cleanup and unify for consistency, and there's a number of folders
> in svn that are not used anymore. Everything should move to Git to avoid
> confusion.
> Also, a lot of the projects information in the XML files found under
> [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is
> duplicated in other places, LDAP, podlings websites etc - it would be good to
> clean that up and simplify those pages to adapt to our current workflows,
> while preserving history where it makes sense.
> There are also YAML files with yet more duplicated information at
> [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] ,
> not sure if that's used or useful.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16788371#comment-16788371 ] Sebb commented on INCUBATOR-231: One of the Whimsy jobs that creates the public JSON files failed, because reporting group must be a single digit. I think there needs to be a way to test changes to the file before it is committed. A basic test would be to check for well-formed XML. It may be hard to check for errors in the data itself, although I think the DTD might have caught this particular error. Maybe there should be an app to do the editting? Similarly for other data files that need to be maintained. Might be a good GSOC task? Just a thought (I'm not volunteering as a mentor) > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch2data.txt, gitbox.clutch.data.txt, > gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16788249#comment-16788249 ] David Fisher commented on INCUBATOR-231: Interesting event just now as someone added a new podling - TVM and messed up the XML. I fixed it and Whimsy is working. I did find some debug cases with the new project ldap and gitbox repos processing. Two new error messages :-) > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch2data.txt, gitbox.clutch.data.txt, > gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16788005#comment-16788005 ] David Fisher commented on INCUBATOR-231: I may decide to move this work to new scripts, clutch directory and reporting so that: # Others can help # The current method is not disrupted # Reporting will need to be reworked for Confluence Wiki > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch2data.txt, gitbox.clutch.data.txt, > gitbox.svn.diff.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[
https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787985#comment-16787985
]
David Fisher commented on INCUBATOR-231:
We could, but it will need to be more than the pickle that needs checking.
{{clutch.pkl}} is input to the reporter functions.
In {{content/clutch/}} these html website sections are also generated:
{{clutchm.ent, clutchmy.ent, clutcho1.ent, clutcho2.ent, clutchr1.ent,
clutchr2.ent, clutcht.ent}}. Plus these text files: {{clutch.txt,
report_due_1.txt, report_due_2.txt, report_due_3.txt}}
Whimsy and Gitbox provide good LDAP and Git repository information.
{{PROJECT_LDAP = "https://whimsy.apache.org/public/public_ldap_projects.json"}}
{{GITBOX_DIR = "https://gitbox.apache.org/repositories.json"}}
I see that real improvements in workflow and reporting based on finding out
what is actually happening.
The clutch can do more to help identify the real status of all of the podlings.
I've added the following key to each podling's dictionary in the pickle:
{{'fixMeList': ['INFO: training: Does not yet have a website','INFO: training:
Does not yet have a distribution area']}}
I'm working on the language. I feel that we can generate a strong self
documenting status page that can both generate each podling's report to be
enhanced by the podling and help podling's self serve.
> Cleanup Git-generated Incubator website
> ---
>
> Key: INCUBATOR-231
> URL: https://issues.apache.org/jira/browse/INCUBATOR-231
> Project: Incubator
> Issue Type: Task
>Reporter: Bertrand Delacretaz
>Priority: Major
> Attachments: clutch2data.txt, gitbox.clutch.data.txt,
> gitbox.svn.diff.txt
>
>
> [http://incubator.apache.org/] is generated from
> [https://github.com/apache/incubator] but a few things (clutch, project
> pages) are still maintained under
> [http://svn.apache.org/repos/asf/incubator/public/trunk/]
> We should cleanup and unify for consistency, and there's a number of folders
> in svn that are not used anymore. Everything should move to Git to avoid
> confusion.
> Also, a lot of the projects information in the XML files found under
> [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is
> duplicated in other places, LDAP, podlings websites etc - it would be good to
> clean that up and simplify those pages to adapt to our current workflows,
> while preserving history where it makes sense.
> There are also YAML files with yet more duplicated information at
> [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] ,
> not sure if that's used or useful.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[
https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787734#comment-16787734
]
Bertrand Delacretaz commented on INCUBATOR-231:
---
Could we include some form of automated tests for the Clutch output? Maybe run
another script after {{clutch.py}} that checks a few well-known values from
{{clutch.pkl}} which IIUC is what drives other tools.
> Cleanup Git-generated Incubator website
> ---
>
> Key: INCUBATOR-231
> URL: https://issues.apache.org/jira/browse/INCUBATOR-231
> Project: Incubator
> Issue Type: Task
>Reporter: Bertrand Delacretaz
>Priority: Major
> Attachments: clutch2data.txt, gitbox.clutch.data.txt,
> gitbox.svn.diff.txt
>
>
> [http://incubator.apache.org/] is generated from
> [https://github.com/apache/incubator] but a few things (clutch, project
> pages) are still maintained under
> [http://svn.apache.org/repos/asf/incubator/public/trunk/]
> We should cleanup and unify for consistency, and there's a number of folders
> in svn that are not used anymore. Everything should move to Git to avoid
> confusion.
> Also, a lot of the projects information in the XML files found under
> [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is
> duplicated in other places, LDAP, podlings websites etc - it would be good to
> clean that up and simplify those pages to adapt to our current workflows,
> while preserving history where it makes sense.
> There are also YAML files with yet more duplicated information at
> [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] ,
> not sure if that's used or useful.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org
For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787155#comment-16787155 ] David Fisher commented on INCUBATOR-231: I have an svn update for clutch.py and content/clutch/index.xml # Queries gitbox.apache.org/repositories.json to get the dictionary of all ASF git repos. # Reads Git tags out of status files, but prefers gitbox information to status file. # Changes hasSvn column in clutch to a hasRepo column. # Stores the selected/computes gitUrl to the pickle file. # Stores the project's sorted gitbox repositories to the pickle file. I will attach a diff including to the generated clutch files. I will wait until tomorrow to commit my changes. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch2data.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16785794#comment-16785794 ] David Fisher commented on INCUBATOR-231: The attachment clutch2data.txt is the output of `python3 clutch2data.py` It may be appropriate for the current clutch report, but will need to be redone for a future report. Some things that could be better: # Mentor list should include ids (is this easy?) # Should add urlGitBox checks to clutch.py and create. # Improve the urlDist? [~s...@apache.org] what are your thoughts? # Add 'status': 'Current' # Add 'urlWhimsy' For retired podlings # Add endDate # urlDist points to archives? # Add 'status': 'Retired' For graduated podlings # Add endDate # urlDist is blank if the release list area has been moved. # Add 'status': 'Graduated' # Add 'urlWhimsy' Do you think that this will be enough information to create all of the following: # Simple status page # Lists of podlings for the incubator site # Clutch / status report # Incubator report preparation > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > Attachments: clutch2data.txt > > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16785507#comment-16785507 ] Sebb commented on INCUBATOR-231: The status pages are also used for current and graduated podlings. Before a podling creates its website, the status page is the place where details can be found by the public. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16785411#comment-16785411 ] Bertrand Delacretaz commented on INCUBATOR-231: --- bq. I am not sure if I agree on moving everything to git Ok, I agree that's the wrong focus, what I'm really after is streamlining the Incubator processes, cleaning up stale and irrelevant content and later streamline the website itself. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16785410#comment-16785410 ] Bertrand Delacretaz commented on INCUBATOR-231: --- Taking alois as an example as Sebb mentioned it, it's good to have http://incubator.apache.org/projects/alois.html for historical purposes, but if you look at that page about 99.98% (ok, maybe a bit less) of it irrelevant, empty or out of date. I think the only information we need about past podlings is that they existed, what their description was, when they entered and exited the Incubator, and the URL where their code lives if we have it. Anything else can be found in our email archives if needed, as facts instead of stale copies of out of date information. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784815#comment-16784815 ] Sebb commented on INCUBATOR-231: It's been a while since I worked on clutch, but I don't think it extracts all the information from the podling.xml files. Some of the content is free-format embedded HTML. It may not be possible to recreate the status html files from the pickled data, if that is the intention. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784747#comment-16784747 ] David Fisher commented on INCUBATOR-231: All of the .xml files are processed by the clutch.py program and among other outputs it creates a pickle file - clutch.pkl which includes all of the extracted metadata. This file can be used by a new python program to create new metadata. The new metadata can be used in the website gsp files to create pages at the original location - /project/alois.html > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784683#comment-16784683 ] Sebb commented on INCUBATOR-231: Note that content/projects/.xml is used to generate the web page incubator.a.o/project/.html The web page is referenced in many places; in particular if a podling retires it becomes the web page for the podling. e.g. http://incubator.apache.org/alois and gearpump.apache.org both redirect to their status pages. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784653#comment-16784653 ] David Fisher commented on INCUBATOR-231: I am not sure if I agree on moving everything to git. I think that the parts that are foundation records should remain in SVN. Records would be: # /content/podlings.xml (or whatever the successor to that would be.) # /content/(podlings or projects)/(project).(xml or yml) (or whatever we determine is the source of record for podling status.) # /content/ip-clearance/ I think that we should reach out to Whimsy team to help with UI for updating these records once we determine the final format. Processes should certainly move: # Clutch update scripts which do the following. ** Build pickle file of podling status ** Create data for various pages in the Incubator Site. ** Create data for emailed status and reporting process. # Reporting scripts ** Email reminders. ** Monthly Report Template updated for Confluence. ** New: Email podling dev sites their "Clutch view monthly" # New pages ** Podling status page (includes a version for retired and graduated podlings.) ** Podling listing page with current, graduated and retired podlings. ** Clutch page with status of current podlings. Status should reflect the steps on podling has accomplished on their way towards graduation. Perhaps code is shared with Whimsy. ** IP Clearance page. # New scripts ** Create podling status files and clutch entry. ** Retire podling to update status and clutch. ** Graduate podling to update status and clutch. ** Memorialize podling LDAP and Mentors in status when graduating or retiring. Before we proceed in a small incremental way with this large undertaking we need to determine what format we wish to use for podling status. Choices include: # XML. # YML. # Doap / RDF. Goals for these changes should be to: # Better serve podlings by making status and expectations part of the workflow. # Better serve mentors by easing their tasks to limit the amount of Incubator redcap and semisecret records they need to learn. # Better streamline the process so that a podling's transition to TLP is eased. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
[jira] [Commented] (INCUBATOR-231) Cleanup Git-generated Incubator website
[ https://issues.apache.org/jira/browse/INCUBATOR-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16784552#comment-16784552 ] John D. Ament commented on INCUBATOR-231: - The YAML files were created as an eventual replacement for the content in the XML files since it was already noticed that much of the data is duplicated in other locations. The YAML were meant to be a minimal representation of the data not found in other sources, and is currently used to display information in whimsy for the podling whenever it is filled out. > Cleanup Git-generated Incubator website > --- > > Key: INCUBATOR-231 > URL: https://issues.apache.org/jira/browse/INCUBATOR-231 > Project: Incubator > Issue Type: Task >Reporter: Bertrand Delacretaz >Priority: Major > > [http://incubator.apache.org/] is generated from > [https://github.com/apache/incubator] but a few things (clutch, project > pages) are still maintained under > [http://svn.apache.org/repos/asf/incubator/public/trunk/] > We should cleanup and unify for consistency, and there's a number of folders > in svn that are not used anymore. Everything should move to Git to avoid > confusion. > Also, a lot of the projects information in the XML files found under > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/projects/] is > duplicated in other places, LDAP, podlings websites etc - it would be good to > clean that up and simplify those pages to adapt to our current workflows, > while preserving history where it makes sense. > There are also YAML files with yet more duplicated information at > [http://svn.apache.org/repos/asf/incubator/public/trunk/content/podlings/] , > not sure if that's used or useful. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: general-unsubscr...@incubator.apache.org For additional commands, e-mail: general-h...@incubator.apache.org
