Nilesh has uploaded a new change for review. https://gerrit.wikimedia.org/r/77063
Change subject: Added some code docs for the Python scripts ...................................................................... Added some code docs for the Python scripts Change-Id: I8d1c9734b2ecfaba152fff294b3c2534503b3528 --- M wikiparser/createtables.py M wikiparser/wikiparser.py M wikiparser/wikiparser_db.py M wikiparser/wikiparser_r.py 4 files changed, 11 insertions(+), 0 deletions(-) git pull ssh://gerrit.wikimedia.org:29418/mediawiki/extensions/WikidataEntitySuggester refs/changes/63/77063/1 diff --git a/wikiparser/createtables.py b/wikiparser/createtables.py index e0fa1aa..5a31fd4 100644 --- a/wikiparser/createtables.py +++ b/wikiparser/createtables.py @@ -1,4 +1,7 @@ #!/usr/bin/python + +# Creates the DB and tables for wikiparser_db.py to insert into. + import sys import MySQLdb as mdb diff --git a/wikiparser/wikiparser.py b/wikiparser/wikiparser.py index 7fc047f..084b8ab 100644 --- a/wikiparser/wikiparser.py +++ b/wikiparser/wikiparser.py @@ -1,5 +1,7 @@ #!/usr/bin/python +# The mapper script for generating the item-property pairs and item-(property-value) pairs using Hadoop. + from lxml import etree from StringIO import StringIO import json diff --git a/wikiparser/wikiparser_db.py b/wikiparser/wikiparser_db.py index 958e9ab..c77fbb2 100644 --- a/wikiparser/wikiparser_db.py +++ b/wikiparser/wikiparser_db.py @@ -1,5 +1,9 @@ #!/usr/bin/python +# The mapper script for generating the item-property pairs and item-(property-value) pairs using Hadoop +# along with building a database with tables of items and properties and their 'en' labels. +# This is mainly to be used with the demo. + from lxml import etree from StringIO import StringIO import json diff --git a/wikiparser/wikiparser_r.py b/wikiparser/wikiparser_r.py index 4528d22..2a27526 100644 --- a/wikiparser/wikiparser_r.py +++ b/wikiparser/wikiparser_r.py @@ -1,5 +1,7 @@ #!/usr/bin/python +# The reducer script for generating the item-property pairs and item-(property-value) pairs using Hadoop. + import sys def main(): -- To view, visit https://gerrit.wikimedia.org/r/77063 To unsubscribe, visit https://gerrit.wikimedia.org/r/settings Gerrit-MessageType: newchange Gerrit-Change-Id: I8d1c9734b2ecfaba152fff294b3c2534503b3528 Gerrit-PatchSet: 1 Gerrit-Project: mediawiki/extensions/WikidataEntitySuggester Gerrit-Branch: master Gerrit-Owner: Nilesh <[email protected]> _______________________________________________ MediaWiki-commits mailing list [email protected] https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
