Author: sebb
Date: Sat Sep 19 14:22:55 2015
New Revision: 1704041
URL: http://svn.apache.org/viewvc?rev=1704041&view=rev
Log:
Docs
Modified:
comdev/projects.apache.org/scripts/README.txt
Modified: comdev/projects.apache.org/scripts/README.txt
URL:
http://svn.apache.org/viewvc/comdev/projects.apache.org/scripts/README.txt?rev=1704041&r1=1704040&r2=1704041&view=diff
==============================================================================
--- comdev/projects.apache.org/scripts/README.txt (original)
+++ comdev/projects.apache.org/scripts/README.txt Sat Sep 19 14:22:55 2015
@@ -4,16 +4,17 @@ various sources:
1. updating data (cronjobs)
- countaccounts.py: Extract from LDAP monthly statistics on Unix accounts
created
- in: site/json/foundation/accounts-evolution.json + ldapsearch
- out: site/json/foundation/accounts-evolution.json
+ in: site/json/foundation/accounts-evolution.json + ldapsearch
+ out: site/json/foundation/accounts-evolution.json (updated)
- parsecommitters.py: Fetches and parses the committer (LDAP) list via
people.apache.org.
in: http://people.apache.org/committer-index.html
- out: site/json/foundation/people.json
- + site/json/foundation/groups.json
- List of committers with reference to groups (people.json) and groups with
corresponding committers (groups.json)
-
+ out: site/json/foundation/people.json - committers with reference to groups
+ + site/json/foundation/people_name.json - converts availid to Public Name
+ + site/json/foundation/groups.json - groups with corresponding committers
+ TODO get this from LDAP, asf-authorization-template and Whimsy
(committee-info.json) instead
+
- podlings.py: Reads podlings.xml from the incubator site and creates a JSON
with history data, as well as current podling projects information.
in: http://incubator.apache.org/podlings.xml
@@ -42,11 +43,13 @@ various sources:
- parseprojects.py: Parses existing projects RDF(DOAP) files and turns them
into JSON objects.
in: data/projects.xml + projects' DOAP files
- out: site/json/projects/*.json
- + site/json/foundation/projects.json
- + site/doap/{committeeId}/{project}.rdf - these are exact copies of the
RDFs listed in data/projects.xml
+ out: site/json/projects/*.json - JSON versions of DOAP files
+ + site/json/foundation/projects.json - combined listing of all projects
+ + site/doap/{committeeId}/{project}.rdf - these are exact copies of the
DOAPs listed in data/projects.xml
NOTICE: what prevents import scripts to be added to cron?
1. parse committees.py requires committee-info.txt, which is not available on
project-vm (require authentication)
+ TODO: Whimsy now supplies a JSON version of CI
2. both scripts not only update files but sometimes need to add new files (new
committees or new projects) or move
(projects going to Attic or retired committees)
+ TODO: any reason why scripts should not do this automatically?
