https://bugzilla.wikimedia.org/show_bug.cgi?id=60811
Web browser: ---
Bug ID: 60811
Summary: Provide link to csv file for every table in every
report
Product: Analytics
Version: unspecified
Hardware: All
OS: All
Status: NEW
Severity: normal
Priority: Unprioritized
Component: Wikistats
Assignee: wikibugs-l@lists.wikimedia.org
Reporter: ezac...@wikimedia.org
CC: christ...@quelltextlich.at, dvanli...@gmail.com,
ezac...@wikimedia.org, tneg...@wikimedia.org
Classification: Unclassified
Mobile Platform: ---
This would greatly help reuse of the data.
It is however not a trivial operation, as for most tables underlying data are
on much lower aggregation level (and sometimes multiple Mb in size).
So in many cases these higher aggregated csv files will have to created anew.
This could be done in two ways:
A pre-processing step which builds those csv files separately, followed by the
report generation phase which converts data to html, times 25 for so many
languages.
The alternative is to weave extra lines into the existing code, and write data
to html and csv files in close succession.
However the code is already pretty complicated and would become even harder to
maintain. A pre-processing step would ease debugging, speed up report
generation, although a few hours gained to generate 100k html files (800 wikis,
many reports in 25 languages) is still nothing compared to data collection
phase.
But a pre-processing stage would require major maintenance. As new code is
needed, but on top of top that existing code needs to be rewritten. More work
than adding extra lines between existing code.
--
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
_______________________________________________
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
