[jira] [Commented] (HIVE-16045) Print progress bar along with operation log

2017-08-30 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16147794#comment-16147794
 ] 

ASF GitHub Bot commented on HIVE-16045:
---

Github user anishek closed the pull request at:

https://github.com/apache/hive/pull/153


> Print progress bar along with operation log
> ---
>
> Key: HIVE-16045
> URL: https://issues.apache.org/jira/browse/HIVE-16045
> Project: Hive
>  Issue Type: Improvement
>  Components: HiveServer2
>Affects Versions: 2.2.0
>Reporter: anishek
>Assignee: anishek
> Fix For: 2.3.0
>
> Attachments: HIVE-16045.5.patch, HIVE-16045.6.patch
>
>
> allow printing of the operation logs and progress bar such that,
> allow operations logs to output data once -> block it -> start progress bar 
> -> finish progress bar -> unblock the operations log -> finish operations log 
> -> print query results. 



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Commented] (HIVE-16045) Print progress bar along with operation log

2017-03-01 Thread Thejas M Nair (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15891462#comment-15891462
 ] 

Thejas M Nair commented on HIVE-16045:
--

+1


> Print progress bar along with operation log
> ---
>
> Key: HIVE-16045
> URL: https://issues.apache.org/jira/browse/HIVE-16045
> Project: Hive
>  Issue Type: Improvement
>  Components: HiveServer2
>Affects Versions: 2.2.0
>Reporter: anishek
>Assignee: anishek
> Fix For: 2.2.0
>
> Attachments: HIVE-16045.5.patch, HIVE-16045.6.patch
>
>
> allow printing of the operation logs and progress bar such that,
> allow operations logs to output data once -> block it -> start progress bar 
> -> finish progress bar -> unblock the operations log -> finish operations log 
> -> print query results. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (HIVE-16045) Print progress bar along with operation log

2017-03-01 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15890309#comment-15890309
 ] 

Hive QA commented on HIVE-16045:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12855345/HIVE-16045.6.patch

{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 10323 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[schema_evol_text_vec_table]
 (batchId=147)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query14] 
(batchId=224)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/3869/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/3869/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-3869/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12855345 - PreCommit-HIVE-Build

> Print progress bar along with operation log
> ---
>
> Key: HIVE-16045
> URL: https://issues.apache.org/jira/browse/HIVE-16045
> Project: Hive
>  Issue Type: Improvement
>  Components: HiveServer2
>Affects Versions: 2.2.0
>Reporter: anishek
>Assignee: anishek
> Fix For: 2.2.0
>
> Attachments: HIVE-16045.5.patch, HIVE-16045.6.patch
>
>
> allow printing of the operation logs and progress bar such that,
> allow operations logs to output data once -> block it -> start progress bar 
> -> finish progress bar -> unblock the operations log -> finish operations log 
> -> print query results. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (HIVE-16045) Print progress bar along with operation log

2017-03-01 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889854#comment-15889854
 ] 

Hive QA commented on HIVE-16045:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12855324/HIVE-16045.5.patch

{color:red}ERROR:{color} -1 due to build exiting with an error

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/3863/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/3863/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-3863/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit 
status 1 and output '+ date '+%Y-%m-%d %T.%3N'
2017-03-01 09:38:06.405
+ [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]]
+ export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ export 
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ 
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'MAVEN_OPTS=-Xmx1g '
+ MAVEN_OPTS='-Xmx1g '
+ cd /data/hiveptest/working/
+ tee /data/hiveptest/logs/PreCommit-HIVE-Build-3863/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z master ]]
+ [[ -d apache-github-source-source ]]
+ [[ ! -d apache-github-source-source/.git ]]
+ [[ ! -d apache-github-source-source ]]
+ date '+%Y-%m-%d %T.%3N'
2017-03-01 09:38:06.408
+ cd apache-github-source-source
+ git fetch origin
+ git reset --hard HEAD
HEAD is now at 12b27a3 HIVE-1555: JDBC Storage Handler (Gunther Hagleitner, 
reviewed by Jason Dere)
+ git clean -f -d
+ git checkout master
Already on 'master'
Your branch is up-to-date with 'origin/master'.
+ git reset --hard origin/master
HEAD is now at 12b27a3 HIVE-1555: JDBC Storage Handler (Gunther Hagleitner, 
reviewed by Jason Dere)
+ git merge --ff-only origin/master
Already up-to-date.
+ date '+%Y-%m-%d %T.%3N'
2017-03-01 09:38:07.439
+ patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hiveptest/working/scratch/build.patch
+ [[ -f /data/hiveptest/working/scratch/build.patch ]]
+ chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh
+ /data/hiveptest/working/scratch/smart-apply-patch.sh 
/data/hiveptest/working/scratch/build.patch
error: patch failed: beeline/src/java/org/apache/hive/beeline/Commands.java:64
error: beeline/src/java/org/apache/hive/beeline/Commands.java: patch does not 
apply
The patch does not appear to apply with p0, p1, or p2
+ exit 1
'
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12855324 - PreCommit-HIVE-Build

> Print progress bar along with operation log
> ---
>
> Key: HIVE-16045
> URL: https://issues.apache.org/jira/browse/HIVE-16045
> Project: Hive
>  Issue Type: Improvement
>  Components: HiveServer2
>Affects Versions: 2.2.0
>Reporter: anishek
>Assignee: anishek
> Fix For: 2.2.0
>
> Attachments: HIVE-16045.1.patch, HIVE-16045.2.patch, 
> HIVE-16045.3.patch, HIVE-16045.4.patch, HIVE-16045.5.patch
>
>
> allow printing of the operation logs and progress bar such that,
> allow operations logs to output data once -> block it -> start progress bar 
> -> finish progress bar -> unblock the operations log -> finish operations log 
> -> print query results. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (HIVE-16045) Print progress bar along with operation log

2017-02-28 Thread Thejas M Nair (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889713#comment-15889713
 ] 

Thejas M Nair commented on HIVE-16045:
--

Note that testQueryProgress has been failing in some other jiras, because 
sometimes progress bar gets printed before the rest of the logs.
This change might make that test more reliable.


> Print progress bar along with operation log
> ---
>
> Key: HIVE-16045
> URL: https://issues.apache.org/jira/browse/HIVE-16045
> Project: Hive
>  Issue Type: Improvement
>  Components: HiveServer2
>Affects Versions: 2.2.0
>Reporter: anishek
>Assignee: anishek
> Fix For: 2.2.0
>
> Attachments: HIVE-16045.1.patch, HIVE-16045.2.patch, 
> HIVE-16045.3.patch, HIVE-16045.4.patch
>
>
> allow printing of the operation logs and progress bar such that,
> allow operations logs to output data once -> block it -> start progress bar 
> -> finish progress bar -> unblock the operations log -> finish operations log 
> -> print query results. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (HIVE-16045) Print progress bar along with operation log

2017-02-28 Thread Thejas M Nair (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15889709#comment-15889709
 ] 

Thejas M Nair commented on HIVE-16045:
--

testQueryProgressParallel is failing because the test progress bar didn't get 
printed in that case.
One theory about the failure is that I have is that the log printing in beeline 
happened only after the query was complete. 
Another possibility is that the there is an issue with different ThreadLocal 
SessionState being used for task execution when it is being run in a different 
thread (in case of parallel task execution).
I think we can remove the check for "Elapsed Time" in this test case which I 
added in another recent patch and then have a follow up patch to get beeline 
progress bar reliably work with hive.exec.parallel=true. 
"hive.exec.parallel=true" is not a reliable mode of execution and is not the 
default.


> Print progress bar along with operation log
> ---
>
> Key: HIVE-16045
> URL: https://issues.apache.org/jira/browse/HIVE-16045
> Project: Hive
>  Issue Type: Improvement
>  Components: HiveServer2
>Affects Versions: 2.2.0
>Reporter: anishek
>Assignee: anishek
> Fix For: 2.2.0
>
> Attachments: HIVE-16045.1.patch, HIVE-16045.2.patch, 
> HIVE-16045.3.patch, HIVE-16045.4.patch
>
>
> allow printing of the operation logs and progress bar such that,
> allow operations logs to output data once -> block it -> start progress bar 
> -> finish progress bar -> unblock the operations log -> finish operations log 
> -> print query results. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (HIVE-16045) Print progress bar along with operation log

2017-02-28 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887852#comment-15887852
 ] 

Hive QA commented on HIVE-16045:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12855075/HIVE-16045.4.patch

{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 10274 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[schema_evol_text_vec_table]
 (batchId=147)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query14] 
(batchId=223)
org.apache.hive.beeline.TestBeeLineWithArgs.testQueryProgressParallel 
(batchId=211)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/3836/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/3836/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-3836/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 3 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12855075 - PreCommit-HIVE-Build

> Print progress bar along with operation log
> ---
>
> Key: HIVE-16045
> URL: https://issues.apache.org/jira/browse/HIVE-16045
> Project: Hive
>  Issue Type: Improvement
>  Components: HiveServer2
>Affects Versions: 2.2.0
>Reporter: anishek
>Assignee: anishek
> Fix For: 2.2.0
>
> Attachments: HIVE-16045.1.patch, HIVE-16045.2.patch, 
> HIVE-16045.3.patch, HIVE-16045.4.patch
>
>
> allow printing of the operation logs and progress bar such that,
> allow operations logs to output data once -> block it -> start progress bar 
> -> finish progress bar -> unblock the operations log -> finish operations log 
> -> print query results. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (HIVE-16045) Print progress bar along with operation log

2017-02-27 Thread anishek (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15887446#comment-15887446
 ] 

anishek commented on HIVE-16045:


i was not able to recreate the failure on my local machine for 
TestBeeLineWithArgs.testQueryProgressParallel  i ran it 3 times, works fine.

also another patch uploaded with changes for comments.

> Print progress bar along with operation log
> ---
>
> Key: HIVE-16045
> URL: https://issues.apache.org/jira/browse/HIVE-16045
> Project: Hive
>  Issue Type: Improvement
>  Components: HiveServer2
>Affects Versions: 2.2.0
>Reporter: anishek
>Assignee: anishek
> Fix For: 2.2.0
>
> Attachments: HIVE-16045.1.patch, HIVE-16045.2.patch, 
> HIVE-16045.3.patch, HIVE-16045.4.patch
>
>
> allow printing of the operation logs and progress bar such that,
> allow operations logs to output data once -> block it -> start progress bar 
> -> finish progress bar -> unblock the operations log -> finish operations log 
> -> print query results. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (HIVE-16045) Print progress bar along with operation log

2017-02-27 Thread Thejas M Nair (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886138#comment-15886138
 ] 

Thejas M Nair commented on HIVE-16045:
--

Also added another comment in pull request.

> Print progress bar along with operation log
> ---
>
> Key: HIVE-16045
> URL: https://issues.apache.org/jira/browse/HIVE-16045
> Project: Hive
>  Issue Type: Improvement
>  Components: HiveServer2
>Affects Versions: 2.2.0
>Reporter: anishek
>Assignee: anishek
> Fix For: 2.2.0
>
> Attachments: HIVE-16045.1.patch, HIVE-16045.2.patch, 
> HIVE-16045.3.patch
>
>
> allow printing of the operation logs and progress bar such that,
> allow operations logs to output data once -> block it -> start progress bar 
> -> finish progress bar -> unblock the operations log -> finish operations log 
> -> print query results. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (HIVE-16045) Print progress bar along with operation log

2017-02-27 Thread Thejas M Nair (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15886086#comment-15886086
 ] 

Thejas M Nair commented on HIVE-16045:
--

[~anishek] Looks like the TestBeeLineWithArgs.testQueryProgressParallel failure 
might be related. Can you take a look ?


> Print progress bar along with operation log
> ---
>
> Key: HIVE-16045
> URL: https://issues.apache.org/jira/browse/HIVE-16045
> Project: Hive
>  Issue Type: Improvement
>  Components: HiveServer2
>Affects Versions: 2.2.0
>Reporter: anishek
>Assignee: anishek
> Fix For: 2.2.0
>
> Attachments: HIVE-16045.1.patch, HIVE-16045.2.patch, 
> HIVE-16045.3.patch
>
>
> allow printing of the operation logs and progress bar such that,
> allow operations logs to output data once -> block it -> start progress bar 
> -> finish progress bar -> unblock the operations log -> finish operations log 
> -> print query results. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (HIVE-16045) Print progress bar along with operation log

2017-02-27 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885474#comment-15885474
 ] 

Hive QA commented on HIVE-16045:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12854849/HIVE-16045.3.patch

{color:red}ERROR:{color} -1 due to no test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 10266 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query14] 
(batchId=223)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query23] 
(batchId=223)
org.apache.hive.beeline.TestBeeLineWithArgs.testQueryProgressParallel 
(batchId=211)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/3807/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/3807/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-3807/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 3 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12854849 - PreCommit-HIVE-Build

> Print progress bar along with operation log
> ---
>
> Key: HIVE-16045
> URL: https://issues.apache.org/jira/browse/HIVE-16045
> Project: Hive
>  Issue Type: Improvement
>  Components: HiveServer2
>Affects Versions: 2.2.0
>Reporter: anishek
>Assignee: anishek
> Fix For: 2.2.0
>
> Attachments: HIVE-16045.1.patch, HIVE-16045.2.patch, 
> HIVE-16045.3.patch
>
>
> allow printing of the operation logs and progress bar such that,
> allow operations logs to output data once -> block it -> start progress bar 
> -> finish progress bar -> unblock the operations log -> finish operations log 
> -> print query results. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (HIVE-16045) Print progress bar along with operation log

2017-02-27 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885400#comment-15885400
 ] 

Hive QA commented on HIVE-16045:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12854836/HIVE-16045.2.patch

{color:red}ERROR:{color} -1 due to no test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 3 failed/errored test(s), 10266 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_if_expr]
 (batchId=140)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query14] 
(batchId=223)
org.apache.hive.beeline.TestBeeLineWithArgs.testQueryProgressParallel 
(batchId=211)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/3806/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/3806/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-3806/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 3 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12854836 - PreCommit-HIVE-Build

> Print progress bar along with operation log
> ---
>
> Key: HIVE-16045
> URL: https://issues.apache.org/jira/browse/HIVE-16045
> Project: Hive
>  Issue Type: Improvement
>  Components: HiveServer2
>Affects Versions: 2.2.0
>Reporter: anishek
>Assignee: anishek
> Fix For: 2.2.0
>
> Attachments: HIVE-16045.1.patch, HIVE-16045.2.patch, 
> HIVE-16045.3.patch
>
>
> allow printing of the operation logs and progress bar such that,
> allow operations logs to output data once -> block it -> start progress bar 
> -> finish progress bar -> unblock the operations log -> finish operations log 
> -> print query results. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (HIVE-16045) Print progress bar along with operation log

2017-02-27 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885337#comment-15885337
 ] 

Hive QA commented on HIVE-16045:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12854830/HIVE-16045.1.patch

{color:red}ERROR:{color} -1 due to no test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 10262 tests 
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query14] 
(batchId=223)
org.apache.hadoop.hive.cli.TestSparkNegativeCliDriver.org.apache.hadoop.hive.cli.TestSparkNegativeCliDriver
 (batchId=230)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/3805/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/3805/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-3805/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12854830 - PreCommit-HIVE-Build

> Print progress bar along with operation log
> ---
>
> Key: HIVE-16045
> URL: https://issues.apache.org/jira/browse/HIVE-16045
> Project: Hive
>  Issue Type: Improvement
>  Components: HiveServer2
>Affects Versions: 2.2.0
>Reporter: anishek
>Assignee: anishek
> Fix For: 2.2.0
>
> Attachments: HIVE-16045.1.patch, HIVE-16045.2.patch
>
>
> allow printing of the operation logs and progress bar such that,
> allow operations logs to output data once -> block it -> start progress bar 
> -> finish progress bar -> unblock the operations log -> finish operations log 
> -> print query results. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (HIVE-16045) Print progress bar along with operation log

2017-02-27 Thread anishek (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885312#comment-15885312
 ] 

anishek commented on HIVE-16045:


Thanks [~thejas] for the review

> Print progress bar along with operation log
> ---
>
> Key: HIVE-16045
> URL: https://issues.apache.org/jira/browse/HIVE-16045
> Project: Hive
>  Issue Type: Improvement
>  Components: HiveServer2
>Affects Versions: 2.2.0
>Reporter: anishek
>Assignee: anishek
> Fix For: 2.2.0
>
> Attachments: HIVE-16045.1.patch, HIVE-16045.2.patch
>
>
> allow printing of the operation logs and progress bar such that,
> allow operations logs to output data once -> block it -> start progress bar 
> -> finish progress bar -> unblock the operations log -> finish operations log 
> -> print query results. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (HIVE-16045) Print progress bar along with operation log

2017-02-26 Thread Thejas M Nair (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885282#comment-15885282
 ] 

Thejas M Nair commented on HIVE-16045:
--

+1 to changes in pull request.
Please upload updated patch here as well.


> Print progress bar along with operation log
> ---
>
> Key: HIVE-16045
> URL: https://issues.apache.org/jira/browse/HIVE-16045
> Project: Hive
>  Issue Type: Improvement
>  Components: HiveServer2
>Affects Versions: 2.2.0
>Reporter: anishek
>Assignee: anishek
> Fix For: 2.2.0
>
> Attachments: HIVE-16045.1.patch, HIVE-16045.2.patch
>
>
> allow printing of the operation logs and progress bar such that,
> allow operations logs to output data once -> block it -> start progress bar 
> -> finish progress bar -> unblock the operations log -> finish operations log 
> -> print query results. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

[jira] [Commented] (HIVE-16045) Print progress bar along with operation log

2017-02-26 Thread anishek (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885246#comment-15885246
 ] 

anishek commented on HIVE-16045:


sample output from the beeline after patch

{code}
0: jdbc:hive2://localhost:10007/default> select max(age) from t;
INFO  : Compiling 
command(queryId=root_20170227064051_dab7f2ad-0009-44c2-b59b-e55179bc6eae): 
select max(age) from t
INFO  : We are setting the hadoop caller context from 
HIVE_SSN_ID:5d59ff69-3f21-48af-a688-9855b4052901 to 
root_20170227064051_dab7f2ad-0009-44c2-b59b-e55179bc6eae
INFO  : Semantic Analysis Completed
INFO  : Returning Hive schema: Schema(fieldSchemas:[FieldSchema(name:_c0, 
type:bigint, comment:null)], properties:null)
INFO  : Completed compiling 
command(queryId=root_20170227064051_dab7f2ad-0009-44c2-b59b-e55179bc6eae); Time 
taken: 3.78 seconds
INFO  : We are resetting the hadoop caller context to 
HIVE_SSN_ID:5d59ff69-3f21-48af-a688-9855b4052901
INFO  : Concurrency mode is disabled, not creating a lock manager
INFO  : Setting caller context to query id 
root_20170227064051_dab7f2ad-0009-44c2-b59b-e55179bc6eae
INFO  : Executing 
command(queryId=root_20170227064051_dab7f2ad-0009-44c2-b59b-e55179bc6eae): 
select max(age) from t
INFO  : Query ID = root_20170227064051_dab7f2ad-0009-44c2-b59b-e55179bc6eae
INFO  : Total jobs = 1
INFO  : Launching Job 1 out of 1
INFO  : Starting task [Stage-1:MAPRED] in serial mode
INFO  : Session is already open
INFO  : Dag name: select max(age) from t(Stage-1)
INFO  : Status: Running (Executing on YARN cluster with App id 
application_1486985293385_0274)

INFO  : Map 1: 0/1  Reducer 2: 0/1
--
VERTICES  MODESTATUS  TOTAL  COMPLETED  RUNNING  PENDING  
FAILED  KILLED
--
Map 1 .. container SUCCEEDED  1  100
   0   0
Reducer 2 .. container SUCCEEDED  1  100
   0   0
VERTICES: 02/02  [==>>] 100%  ELAPSED TIME: 3.93 s
--
INFO  : Map 1: 0(+1)/1  Reducer 2: 0/1
INFO  : Map 1: 1/1  Reducer 2: 0/1
INFO  : Map 1: 1/1  Reducer 2: 0(+1)/1
INFO  : Map 1: 1/1  Reducer 2: 1/1
INFO  : Status: DAG finished successfully in 3.83 seconds
INFO  :
INFO  : Query Execution Summary
INFO  : 
--
INFO  : OPERATIONDURATION
INFO  : 
--
INFO  : Compile Query   3.78s
INFO  : Prepare Plan0.70s
INFO  : Submit Plan 0.40s
INFO  : Start DAG   0.59s
INFO  : Run DAG 3.83s
INFO  : 
--
INFO  :
INFO  : Task Execution Summary
INFO  : 

INFO  :   VERTICES  TOTAL_TASKS  FAILED_ATTEMPTS  KILLED_TASKS   DURATION(ms)  
CPU_TIME(ms)  GC_TIME(ms)  INPUT_RECORDS  OUTPUT_RECORDS
INFO  : 

INFO  :  Map 110 01983.00   
  3,670   26  5   1
INFO  :  Reducer 210 0 347.00   
  1,7800  1   0
INFO  : 

INFO  :
INFO  : LLAP IO Summary
INFO  : 
--
INFO  :   VERTICES ROWGROUPS  META_HIT  META_MISS  DATA_HIT  DATA_MISS  
ALLOCATION USED  TOTAL_IO
INFO  : 
--
INFO  :  Map 1 0 0  00B 0B  
0B   0B 0.00s
INFO  : 
--
INFO  :
INFO  : FileSystem Counters Summary
INFO  :
INFO  : Scheme: FILE
INFO  : 
--
INFO  :   VERTICES  BYTES_READ  READ_OPS LARGE_READ_OPS  
BYTES_WRITTEN WRITE_OPS
INFO  :

[jira] [Commented] (HIVE-16045) Print progress bar along with operation log

2017-02-26 Thread ASF GitHub Bot (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-16045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15885244#comment-15885244
 ] 

ASF GitHub Bot commented on HIVE-16045:
---

GitHub user anishek opened a pull request:

https://github.com/apache/hive/pull/153

HIVE-16045: Print progress bar along with operation log



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/anishek/hive HIVE-16045

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/hive/pull/153.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #153


commit 6d83061adc001ea8a7ec76a5b8b10e16d86da400
Author: Anishek Agarwal 
Date:   2017-02-27T06:36:13Z

HIVE-16045: Print progress bar along with operation log




> Print progress bar along with operation log
> ---
>
> Key: HIVE-16045
> URL: https://issues.apache.org/jira/browse/HIVE-16045
> Project: Hive
>  Issue Type: Improvement
>  Components: HiveServer2
>Affects Versions: 2.2.0
>Reporter: anishek
>Assignee: anishek
> Fix For: 2.2.0
>
>
> allow printing of the operation logs and progress bar such that,
> allow operations logs to output data once -> block it -> start progress bar 
> -> finish progress bar -> unblock the operations log -> finish operations log 
> -> print query results. 



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)