[GitHub] [incubator-livy] jerryshao commented on issue #238: [LIVY-689] Deliver stage process message to the end user using thriftserver
jerryshao commented on issue #238: [LIVY-689] Deliver stage process message to the end user using thriftserver URL: https://github.com/apache/incubator-livy/pull/238#issuecomment-548228914 I would like to hear the comments from others. Here what I saw is that: 1. Each job will start a Timer, which is quite cost if the job is a very small job (metadata job). 2. The current way to get progress is using push based way, I was wondering if it is better to change to pull based way, so that we don't need to store such message in server side. Also we don't have to formalize the message in server side. For example, request: client -> server -> driver, and response: driver->server->client. Like what current repl did. @mgaido91 can you please help to review this PR? Thanks. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-livy] jerryshao commented on issue #238: [LIVY-689] Deliver stage process message to the end user using thriftserver
jerryshao commented on issue #238: [LIVY-689] Deliver stage process message to the end user using thriftserver URL: https://github.com/apache/incubator-livy/pull/238#issuecomment-541275053 Sure, I'm fine with it. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
[GitHub] [incubator-livy] jerryshao commented on issue #238: [LIVY-689] Deliver stage process message to the end user using thriftserver
jerryshao commented on issue #238: [LIVY-689] Deliver stage process message to the end user using thriftserver URL: https://github.com/apache/incubator-livy/pull/238#issuecomment-540876001 > Beeline from Hive 2.2 has in-place progress bar hive.server2.in.place.progress > >https://cwiki.apache.org/confluence/display/Hive/Configuration+Properties#ConfigurationProperties-hive.server2.in.place.progress > >(I think it works only with tez - would be nice if this would work with Livy too ) Would be better to support this if it is not a big effort. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org With regards, Apache Git Services
