This is an automated email from the ASF dual-hosted git repository.
dimuthuupe pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/airavata-docs.git
The following commit(s) were added to refs/heads/master by this push:
new cd751ab Job management description
cd751ab is described below
commit cd751abd574d97a9ad435622c14e37ae308e9bb3
Author: Dimuthu Wannipurage <[email protected]>
AuthorDate: Sat Jul 27 21:06:12 2019 -0400
Job management description
---
docs/img/helix-architecture.png | Bin 0 -> 350606 bytes
docs/img/monitoring-framework.jpg | Bin 0 -> 197321 bytes
.../helix-job-management.md | 23 ++++++++++++++++++++-
3 files changed, 22 insertions(+), 1 deletion(-)
diff --git a/docs/img/helix-architecture.png b/docs/img/helix-architecture.png
new file mode 100644
index 0000000..0f78b39
Binary files /dev/null and b/docs/img/helix-architecture.png differ
diff --git a/docs/img/monitoring-framework.jpg
b/docs/img/monitoring-framework.jpg
new file mode 100644
index 0000000..226b009
Binary files /dev/null and b/docs/img/monitoring-framework.jpg differ
diff --git a/docs/technical-documentation/helix-job-management.md
b/docs/technical-documentation/helix-job-management.md
index 0f52c97..912af58 100644
--- a/docs/technical-documentation/helix-job-management.md
+++ b/docs/technical-documentation/helix-job-management.md
@@ -1 +1,22 @@
-Test commit
+## Job Management
+
+Job Management is a key component of Airavata and we recently upgraded the
GFac based Job Management system to a new
+system which is more efficient and extendible. Job Management system mainly
covers two areas
+
+1. Executing workflows related to job submission and data transfers among
compute and storage resources
+2. Monitoring the status of already executing jobs in the remote compute
resources
+
+For executing workflows, we use Apache Helix as a generic workflow engine.
Workflow managers accept workflow execution
+requests from the orchestrator and job monitors and transfers those requests
into the Helix cluster to execute them. Helix
+cluster is aware of how to decode those requests and execute workflows
reliably and efficiently. Tasks in the Helix cluster
+uses Adaptor Support libraries to talk to external resources according the
relevant protocol and security guidelines.
+
+
+
+For job monitoring, new system supports multiple job monitoring mechanisms.
Email monitoring is the primary method of
+monitoring jobs where it listens to the email alters sent by compute resources
while the jobs' states were changed.
+Realtime monitoring is the new mechanism we added into the monitoring
framework where it gets notified directly from the
+jobs when their states are changed. Using both of these mechanisms, we managed
to achieve both reduced response time and
+better accuracy in job monitoring.
+
+
\ No newline at end of file
