Re: How to get a spark sql statement implement duration ?

[??????????]

you can find the duration time by wen ui,such as http://xxx:8080  .It depends 
on your setting.

anout the shell, i do not know how to check the time

---Original---
From: "Jacek Laskowski"<ja...@japila.pl>
Date: 2017/2/8 04:14:58
To: "Mars Xu"<xujiao.myc...@gmail.com>;
Cc: "user"<user@spark.apache.org>;
Subject: Re: How to get a spark sql statement implement duration ?


On 7 Feb 2017 4:17 a.m., "Mars Xu" <xujiao.myc...@gmail.com> wrote:
Hello All,
 
 &#xA0; &#xA0; &#xA0; &#xA0; Some spark sqls will produce one or more jobs, I 
have 2 questions,
 
 &#xA0; &#xA0; &#xA0; &#xA0; 1, How the cc.sql(??sql statement??) divided into 
one or more jobs ?





It's an implementation detail. You can have zero or more jobs for a single 
structured query (query DSL or SQL).&#xA0;


 &#xA0; &#xA0; &#xA0; &#xA0; 2, When I execute spark sql query in spark - shell 
client, how to get the execution time (Spark&#xA0; 2.1.0) ?&#xA0; if a sql 
query produced 3 jobs, In my opinion, the execution time is to sum up the 3 
jobs?? duration time.





Yes. What's the question then?


Jacek