[jira] [Commented] (HIVE-15560) clean up out files that do not correspond to any q files

2017-02-06 Thread Sergey Shelukhin (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-15560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15854764#comment-15854764
 ] 

Sergey Shelukhin commented on HIVE-15560:
-

I bet it was done with one command in Emacs that required 24 fingers :)

> clean up out files that do not correspond to any q files
> 
>
> Key: HIVE-15560
> URL: https://issues.apache.org/jira/browse/HIVE-15560
> Project: Hive
>  Issue Type: Bug
>Reporter: Sergey Shelukhin
>Assignee: Gunther Hagleitner
> Fix For: 2.2.0
>
> Attachments: HIVE-15560.1.patch
>
>
> I can see some for schema evolution, there may be others.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (HIVE-15560) clean up out files that do not correspond to any q files

2017-02-06 Thread Gunther Hagleitner (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-15560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15854754#comment-15854754
 ] 

Gunther Hagleitner commented on HIVE-15560:
---

[~vgarg] don't have a script, but didn't do anything fancy. Looked for all the 
".q" files, same with ".q.out", then i stripped them to their base names and 
turned them into unique sorted lists. Finally diff'd the two sets, and "git 
removed" the delta.

> clean up out files that do not correspond to any q files
> 
>
> Key: HIVE-15560
> URL: https://issues.apache.org/jira/browse/HIVE-15560
> Project: Hive
>  Issue Type: Bug
>Reporter: Sergey Shelukhin
>Assignee: Gunther Hagleitner
> Fix For: 2.2.0
>
> Attachments: HIVE-15560.1.patch
>
>
> I can see some for schema evolution, there may be others.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (HIVE-15560) clean up out files that do not correspond to any q files

2017-02-06 Thread Vineet Garg (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-15560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15854732#comment-15854732
 ] 

Vineet Garg commented on HIVE-15560:


[~hagleitn] would you mind sharing the script? Curious how did you find such 
files.

> clean up out files that do not correspond to any q files
> 
>
> Key: HIVE-15560
> URL: https://issues.apache.org/jira/browse/HIVE-15560
> Project: Hive
>  Issue Type: Bug
>Reporter: Sergey Shelukhin
>Assignee: Gunther Hagleitner
> Fix For: 2.2.0
>
> Attachments: HIVE-15560.1.patch
>
>
> I can see some for schema evolution, there may be others.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (HIVE-15560) clean up out files that do not correspond to any q files

2017-02-06 Thread Gunther Hagleitner (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-15560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15854724#comment-15854724
 ] 

Gunther Hagleitner commented on HIVE-15560:
---

Committed to master. Thank you for the review [~sershe].

> clean up out files that do not correspond to any q files
> 
>
> Key: HIVE-15560
> URL: https://issues.apache.org/jira/browse/HIVE-15560
> Project: Hive
>  Issue Type: Bug
>Reporter: Sergey Shelukhin
>Assignee: Gunther Hagleitner
> Fix For: 2.2.0
>
> Attachments: HIVE-15560.1.patch
>
>
> I can see some for schema evolution, there may be others.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (HIVE-15560) clean up out files that do not correspond to any q files

2017-02-06 Thread Sergey Shelukhin (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-15560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15854595#comment-15854595
 ] 

Sergey Shelukhin commented on HIVE-15560:
-

+1

> clean up out files that do not correspond to any q files
> 
>
> Key: HIVE-15560
> URL: https://issues.apache.org/jira/browse/HIVE-15560
> Project: Hive
>  Issue Type: Bug
>Reporter: Sergey Shelukhin
>Assignee: Gunther Hagleitner
> Attachments: HIVE-15560.1.patch
>
>
> I can see some for schema evolution, there may be others.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (HIVE-15560) clean up out files that do not correspond to any q files

2017-02-03 Thread Gunther Hagleitner (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-15560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852576#comment-15852576
 ] 

Gunther Hagleitner commented on HIVE-15560:
---

Test failures are unrelated. [~sershe], could you review please?

> clean up out files that do not correspond to any q files
> 
>
> Key: HIVE-15560
> URL: https://issues.apache.org/jira/browse/HIVE-15560
> Project: Hive
>  Issue Type: Bug
>Reporter: Sergey Shelukhin
>Assignee: Gunther Hagleitner
> Attachments: HIVE-15560.1.patch
>
>
> I can see some for schema evolution, there may be others.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (HIVE-15560) clean up out files that do not correspond to any q files

2017-02-03 Thread Hive QA (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-15560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852554#comment-15852554
 ] 

Hive QA commented on HIVE-15560:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12850901/HIVE-15560.1.patch

{color:red}ERROR:{color} -1 due to no test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 6 failed/errored test(s), 10226 tests 
executed
*Failed tests:*
{noformat}
TestDerbyConnector - did not produce a TEST-*.xml file (likely timed out) 
(batchId=235)
org.apache.hadoop.hive.cli.TestEncryptedHDFSCliDriver.testCliDriver[encryption_join_with_different_encryption_keys]
 (batchId=159)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_char_simple]
 (batchId=147)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query14] 
(batchId=223)
org.apache.hadoop.hive.llap.daemon.impl.TestTaskExecutorService.testWaitQueuePreemption
 (batchId=277)
org.apache.hive.hcatalog.pig.TestTextFileHCatStorer.testWriteDecimalX 
(batchId=173)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/3368/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/3368/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-3368/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 6 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12850901 - PreCommit-HIVE-Build

> clean up out files that do not correspond to any q files
> 
>
> Key: HIVE-15560
> URL: https://issues.apache.org/jira/browse/HIVE-15560
> Project: Hive
>  Issue Type: Bug
>Reporter: Sergey Shelukhin
>Assignee: Gunther Hagleitner
> Attachments: HIVE-15560.1.patch
>
>
> I can see some for schema evolution, there may be others.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)


[jira] [Commented] (HIVE-15560) clean up out files that do not correspond to any q files

2017-02-03 Thread Gunther Hagleitner (JIRA)

[ 
https://issues.apache.org/jira/browse/HIVE-15560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15852193#comment-15852193
 ] 

Gunther Hagleitner commented on HIVE-15560:
---

Let's hope my scripting skills are good enough to identify those.

> clean up out files that do not correspond to any q files
> 
>
> Key: HIVE-15560
> URL: https://issues.apache.org/jira/browse/HIVE-15560
> Project: Hive
>  Issue Type: Bug
>Reporter: Sergey Shelukhin
>Assignee: Gunther Hagleitner
> Attachments: HIVE-15560.1.patch
>
>
> I can see some for schema evolution, there may be others.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)