EBernhardson has uploaded a new change for review.
https://gerrit.wikimedia.org/r/268319
Change subject: Include elasticsearch url in coordinator name
......................................................................
Include elasticsearch url in coordinator name
This will make it easier to tell the difference between the
eqiad and codfw jobs when looking at currently running
coordinators and spark jobs.
Change-Id: I2fc7ad8da8c80c0189ecce1daf05306a0c243a32
---
M oozie/transfer_to_es/coordinator.xml
M oozie/transfer_to_es/transferToES.py
2 files changed, 2 insertions(+), 2 deletions(-)
git pull ssh://gerrit.wikimedia.org:29418/wikimedia/discovery/analytics
refs/changes/19/268319/1
diff --git a/oozie/transfer_to_es/coordinator.xml
b/oozie/transfer_to_es/coordinator.xml
index 4a8edfe..230f7f9 100644
--- a/oozie/transfer_to_es/coordinator.xml
+++ b/oozie/transfer_to_es/coordinator.xml
@@ -1,6 +1,6 @@
<?xml version="1.0" encoding="UTF-8"?>
<coordinator-app xmlns="uri:oozie:coordinator:0.4"
- name="transfer_to_es-coord"
+ name="transfer_to_es-${elasticsearch_url}-coord"
frequency="${coord:days(days_aggregated)}"
start="${start_time}"
end="${stop_time}"
diff --git a/oozie/transfer_to_es/transferToES.py
b/oozie/transfer_to_es/transferToES.py
index d3740c7..73b3656 100644
--- a/oozie/transfer_to_es/transferToES.py
+++ b/oozie/transfer_to_es/transferToES.py
@@ -35,7 +35,7 @@
print "Transferring from %s to %s" % (SOURCE, TARGET)
if __name__ == "__main__":
- sc = SparkContext(appName="Send To ES")
+ sc = SparkContext(appName="Send To ES: %s" % (TARGET))
sqlContext = SQLContext(sc)
broardcastMap = sc.broadcast(hostMap)
documentCounter = sc.accumulator(0)
--
To view, visit https://gerrit.wikimedia.org/r/268319
To unsubscribe, visit https://gerrit.wikimedia.org/r/settings
Gerrit-MessageType: newchange
Gerrit-Change-Id: I2fc7ad8da8c80c0189ecce1daf05306a0c243a32
Gerrit-PatchSet: 1
Gerrit-Project: wikimedia/discovery/analytics
Gerrit-Branch: master
Gerrit-Owner: EBernhardson <[email protected]>
_______________________________________________
MediaWiki-commits mailing list
[email protected]
https://lists.wikimedia.org/mailman/listinfo/mediawiki-commits
