Joal has uploaded a new change for review.
https://gerrit.wikimedia.org/r/249698
Change subject: Compress output of pageview legacy files (gzip)
......................................................................
Compress output of pageview legacy files (gzip)
Change-Id: I90ef510d1a9eb03d7b64c3b02112facca8e1b040
---
M oozie/pageview/hourly/transform_pageview_to_legacy_format.hql
1 file changed, 2 insertions(+), 2 deletions(-)
git pull ssh://gerrit.wikimedia.org:29418/analytics/refinery
refs/changes/98/249698/1
diff --git a/oozie/pageview/hourly/transform_pageview_to_legacy_format.hql
b/oozie/pageview/hourly/transform_pageview_to_legacy_format.hql
index 9dd56bf..e21e423 100644
--- a/oozie/pageview/hourly/transform_pageview_to_legacy_format.hql
+++ b/oozie/pageview/hourly/transform_pageview_to_legacy_format.hql
@@ -18,8 +18,8 @@
-- -d hour=1
--
-SET hive.exec.compress.output =false;
-SET mapred.reduce.tasks = 1;
+SET hive.exec.compress.output=true;
+SET
mapreduce.output.fileoutputformat.compress.codec=org.apache.hadoop.io.compress.GzipCodec;
INSERT OVERWRITE DIRECTORY "${destination_directory}"
--
To view, visit https://gerrit.wikimedia.org/r/249698
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: I90ef510d1a9eb03d7b64c3b02112facca8e1b040
Gerrit-PatchSet: 1
Gerrit-Project: analytics/refinery
Gerrit-Branch: master
Gerrit-Owner: Joal <[email protected]>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
