[jira] [Updated] (HIVE-15039) A better job monitor console output for HoS

2016-11-02 Thread Rui Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rui Li updated HIVE-15039:
--
   Resolution: Fixed
Fix Version/s: 2.2.0
   Status: Resolved  (was: Patch Available)

Committed to master. Thanks [~xuefuz] and [~Ferd] for the review!

> A better job monitor console output for HoS
> ---
>
> Key: HIVE-15039
> URL: https://issues.apache.org/jira/browse/HIVE-15039
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rui Li
>Assignee: Rui Li
> Fix For: 2.2.0
>
> Attachments: HIVE-15039.1.patch, HIVE-15039.2.patch, example 
> screenshot.png, with patch.png
>
>
> When there're many stages, it's very difficult to read the console output of 
> job progress of HoS. Attached screenshot is an example.
> We may learn from HoT as it does much better than HoS.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-15039) A better job monitor console output for HoS

2016-11-02 Thread Rui Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rui Li updated HIVE-15039:
--
Labels: TODOC2.2  (was: )

> A better job monitor console output for HoS
> ---
>
> Key: HIVE-15039
> URL: https://issues.apache.org/jira/browse/HIVE-15039
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rui Li
>Assignee: Rui Li
>  Labels: TODOC2.2
> Fix For: 2.2.0
>
> Attachments: HIVE-15039.1.patch, HIVE-15039.2.patch, example 
> screenshot.png, with patch.png
>
>
> When there're many stages, it's very difficult to read the console output of 
> job progress of HoS. Attached screenshot is an example.
> We may learn from HoT as it does much better than HoS.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-15039) A better job monitor console output for HoS

2016-11-01 Thread Rui Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rui Li updated HIVE-15039:
--
Attachment: HIVE-15039.2.patch

Thanks [~Ferd] and [~sseth].
Upload the same patch to try again.

> A better job monitor console output for HoS
> ---
>
> Key: HIVE-15039
> URL: https://issues.apache.org/jira/browse/HIVE-15039
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rui Li
>Assignee: Rui Li
> Attachments: HIVE-15039.1.patch, HIVE-15039.2.patch, example 
> screenshot.png, with patch.png
>
>
> When there're many stages, it's very difficult to read the console output of 
> job progress of HoS. Attached screenshot is an example.
> We may learn from HoT as it does much better than HoS.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-15039) A better job monitor console output for HoS

2016-11-01 Thread Rui Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rui Li updated HIVE-15039:
--
Attachment: (was: HIVE-15039.2.patch)

> A better job monitor console output for HoS
> ---
>
> Key: HIVE-15039
> URL: https://issues.apache.org/jira/browse/HIVE-15039
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rui Li
>Assignee: Rui Li
> Attachments: HIVE-15039.1.patch, HIVE-15039.2.patch, example 
> screenshot.png, with patch.png
>
>
> When there're many stages, it's very difficult to read the console output of 
> job progress of HoS. Attached screenshot is an example.
> We may learn from HoT as it does much better than HoS.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-15039) A better job monitor console output for HoS

2016-10-31 Thread Rui Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rui Li updated HIVE-15039:
--
Attachment: (was: HIVE-15039.2.patch)

> A better job monitor console output for HoS
> ---
>
> Key: HIVE-15039
> URL: https://issues.apache.org/jira/browse/HIVE-15039
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rui Li
>Assignee: Rui Li
> Attachments: HIVE-15039.1.patch, HIVE-15039.2.patch, example 
> screenshot.png, with patch.png
>
>
> When there're many stages, it's very difficult to read the console output of 
> job progress of HoS. Attached screenshot is an example.
> We may learn from HoT as it does much better than HoS.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-15039) A better job monitor console output for HoS

2016-10-31 Thread Rui Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rui Li updated HIVE-15039:
--
Attachment: HIVE-15039.2.patch

> A better job monitor console output for HoS
> ---
>
> Key: HIVE-15039
> URL: https://issues.apache.org/jira/browse/HIVE-15039
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rui Li
>Assignee: Rui Li
> Attachments: HIVE-15039.1.patch, HIVE-15039.2.patch, 
> HIVE-15039.2.patch, example screenshot.png, with patch.png
>
>
> When there're many stages, it's very difficult to read the console output of 
> job progress of HoS. Attached screenshot is an example.
> We may learn from HoT as it does much better than HoS.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-15039) A better job monitor console output for HoS

2016-10-27 Thread Rui Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rui Li updated HIVE-15039:
--
Attachment: HIVE-15039.2.patch

Update patch to address [~Ferd]'s comments.
{{InPlaceUpdates}} is general enough to be used by both Tez and Spark. So I 
moved it to the upper level of package. [~ashutoshc], please let me know if you 
think otherwise.

> A better job monitor console output for HoS
> ---
>
> Key: HIVE-15039
> URL: https://issues.apache.org/jira/browse/HIVE-15039
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rui Li
>Assignee: Rui Li
> Attachments: HIVE-15039.1.patch, HIVE-15039.2.patch, example 
> screenshot.png, with patch.png
>
>
> When there're many stages, it's very difficult to read the console output of 
> job progress of HoS. Attached screenshot is an example.
> We may learn from HoT as it does much better than HoS.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-15039) A better job monitor console output for HoS

2016-10-26 Thread Rui Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rui Li updated HIVE-15039:
--
Attachment: HIVE-15039.1.patch

Thanks Xuefu.
None of the failures can be reproduced. Try again.

> A better job monitor console output for HoS
> ---
>
> Key: HIVE-15039
> URL: https://issues.apache.org/jira/browse/HIVE-15039
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rui Li
>Assignee: Rui Li
> Attachments: HIVE-15039.1.patch, example screenshot.png, with 
> patch.png
>
>
> When there're many stages, it's very difficult to read the console output of 
> job progress of HoS. Attached screenshot is an example.
> We may learn from HoT as it does much better than HoS.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-15039) A better job monitor console output for HoS

2016-10-26 Thread Rui Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rui Li updated HIVE-15039:
--
Attachment: (was: HIVE-15039.1.patch)

> A better job monitor console output for HoS
> ---
>
> Key: HIVE-15039
> URL: https://issues.apache.org/jira/browse/HIVE-15039
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rui Li
>Assignee: Rui Li
> Attachments: HIVE-15039.1.patch, example screenshot.png, with 
> patch.png
>
>
> When there're many stages, it's very difficult to read the console output of 
> job progress of HoS. Attached screenshot is an example.
> We may learn from HoT as it does much better than HoS.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-15039) A better job monitor console output for HoS

2016-10-26 Thread Rui Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rui Li updated HIVE-15039:
--
Attachment: HIVE-15039.1.patch

> A better job monitor console output for HoS
> ---
>
> Key: HIVE-15039
> URL: https://issues.apache.org/jira/browse/HIVE-15039
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rui Li
>Assignee: Rui Li
> Attachments: HIVE-15039.1.patch, example screenshot.png, with 
> patch.png
>
>
> When there're many stages, it's very difficult to read the console output of 
> job progress of HoS. Attached screenshot is an example.
> We may learn from HoT as it does much better than HoS.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-15039) A better job monitor console output for HoS

2016-10-26 Thread Rui Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rui Li updated HIVE-15039:
--
Attachment: (was: HIVE-15039.1.patch)

> A better job monitor console output for HoS
> ---
>
> Key: HIVE-15039
> URL: https://issues.apache.org/jira/browse/HIVE-15039
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rui Li
>Assignee: Rui Li
> Attachments: HIVE-15039.1.patch, example screenshot.png, with 
> patch.png
>
>
> When there're many stages, it's very difficult to read the console output of 
> job progress of HoS. Attached screenshot is an example.
> We may learn from HoT as it does much better than HoS.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-15039) A better job monitor console output for HoS

2016-10-26 Thread Rui Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rui Li updated HIVE-15039:
--
Attachment: with patch.png

> A better job monitor console output for HoS
> ---
>
> Key: HIVE-15039
> URL: https://issues.apache.org/jira/browse/HIVE-15039
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rui Li
>Assignee: Rui Li
> Attachments: HIVE-15039.1.patch, example screenshot.png, with 
> patch.png
>
>
> When there're many stages, it's very difficult to read the console output of 
> job progress of HoS. Attached screenshot is an example.
> We may learn from HoT as it does much better than HoS.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-15039) A better job monitor console output for HoS

2016-10-26 Thread Rui Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rui Li updated HIVE-15039:
--
Status: Patch Available  (was: Open)

> A better job monitor console output for HoS
> ---
>
> Key: HIVE-15039
> URL: https://issues.apache.org/jira/browse/HIVE-15039
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rui Li
>Assignee: Rui Li
> Attachments: HIVE-15039.1.patch, example screenshot.png
>
>
> When there're many stages, it's very difficult to read the console output of 
> job progress of HoS. Attached screenshot is an example.
> We may learn from HoT as it does much better than HoS.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-15039) A better job monitor console output for HoS

2016-10-26 Thread Rui Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rui Li updated HIVE-15039:
--
Attachment: HIVE-15039.1.patch

I basically just copied code from {{TezJobMonitor}}. So the output looks quite 
the same as tez, with only minor differences. Also attach an example screenshot 
after the patch.
[~xuefuz], [~chengxiang li], could you help review? Thanks.

> A better job monitor console output for HoS
> ---
>
> Key: HIVE-15039
> URL: https://issues.apache.org/jira/browse/HIVE-15039
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rui Li
>Assignee: Rui Li
> Attachments: HIVE-15039.1.patch, example screenshot.png
>
>
> When there're many stages, it's very difficult to read the console output of 
> job progress of HoS. Attached screenshot is an example.
> We may learn from HoT as it does much better than HoS.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-15039) A better job monitor console output for HoS

2016-10-23 Thread Rui Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rui Li updated HIVE-15039:
--
Attachment: example screenshot.png

> A better job monitor console output for HoS
> ---
>
> Key: HIVE-15039
> URL: https://issues.apache.org/jira/browse/HIVE-15039
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rui Li
>Assignee: Rui Li
> Attachments: example screenshot.png
>
>
> When there're many stages, it's very difficult to read the console output of 
> job progress of HoS. Attached screenshot is an example.
> We may learn from HoT as it does much better than HoS.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Updated] (HIVE-15039) A better job monitor console output for HoS

2016-10-23 Thread Rui Li (JIRA)

 [ 
https://issues.apache.org/jira/browse/HIVE-15039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rui Li updated HIVE-15039:
--
Description: 
When there're many stages, it's very difficult to read the console output of 
job progress of HoS. Attached screenshot is an example.
We may learn from HoT as it does much better than HoS.

  was:
When there're many stages, it's very difficult to read the console output of 
job progress of HoS. Attached screenshot is an example.
We may learn from HoT as it does a much better than HoS.


> A better job monitor console output for HoS
> ---
>
> Key: HIVE-15039
> URL: https://issues.apache.org/jira/browse/HIVE-15039
> Project: Hive
>  Issue Type: Improvement
>Reporter: Rui Li
>Assignee: Rui Li
>
> When there're many stages, it's very difficult to read the console output of 
> job progress of HoS. Attached screenshot is an example.
> We may learn from HoT as it does much better than HoS.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)