huianyi commented on a change in pull request #238: [LIVY-689] Deliver stage 
process message to the end user using thriftserver
URL: https://github.com/apache/incubator-livy/pull/238#discussion_r334217660
 
 

 ##########
 File path: rsc/src/main/java/org/apache/livy/rsc/driver/RSCDriver.java
 ##########
 @@ -212,6 +215,33 @@ public void onSaslComplete(Rpc client) {
     setupIdleTimeout();
   }
 
+  /**
+   * calculate each stage's process and broadcast message to the end user
+   * @param jobId
+   */
+  void handleProcessMessage(String jobId){
+    SparkStatusTracker sparkStatusTracker;
+    synchronized (jcLock){
+      if (jc == null){
+        return;
+      }
+      sparkStatusTracker = jc.sc().sc().statusTracker();
+    }
+    int[] activeStageIds = sparkStatusTracker.getActiveStageIds();
 
 Review comment:
   > NVM, just remembered that Livy cannot submit one job a time. But there's 
another issue, some queries may split into multiple jobs, then the measurement 
here may not be accurate.
   
   If Livy cannot submit one job a time, stage id in one query is unique, I 
already log stage process message with stage id, so this should not be a 
problem?

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to