jerryshao commented on a change in pull request #238: [LIVY-689] Deliver stage 
process message to the end user using thriftserver
URL: https://github.com/apache/incubator-livy/pull/238#discussion_r333809766
 
 

 ##########
 File path: rsc/src/main/java/org/apache/livy/rsc/driver/RSCDriver.java
 ##########
 @@ -212,6 +215,33 @@ public void onSaslComplete(Rpc client) {
     setupIdleTimeout();
   }
 
+  /**
+   * calculate each stage's process and broadcast message to the end user
+   * @param jobId
+   */
+  void handleProcessMessage(String jobId){
+    SparkStatusTracker sparkStatusTracker;
+    synchronized (jcLock){
+      if (jc == null){
+        return;
+      }
+      sparkStatusTracker = jc.sc().sc().statusTracker();
+    }
+    int[] activeStageIds = sparkStatusTracker.getActiveStageIds();
 
 Review comment:
   I also have the same concern. Beeline can only submit one query a time, but 
what if user submits query programmatically? We can hardly say that all the 
active stages belong to one query, so there should be a way to figure out job 
id -> active stages mapping.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to