[jira] [Commented] (HIVE-14643) handle ctas

2016-10-13 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-14643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15574151#comment-15574151
 ] 

Hive QA commented on HIVE-14643:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12833236/HIVE-14643.patch

{color:red}ERROR:{color} -1 due to build exiting with an error

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/1555/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/1555/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-1555/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit 
status 1 and output '+ date '+%Y-%m-%d %T.%3N'
2016-10-14 04:27:54.810
+ [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]]
+ export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ export 
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ 
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost 
-Dhttp.proxyPort=3128'
+ M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost 
-Dhttp.proxyPort=3128'
+ cd /data/hiveptest/working/
+ tee /data/hiveptest/logs/PreCommit-HIVE-Build-1555/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z master ]]
+ [[ -d apache-github-source-source ]]
+ [[ ! -d apache-github-source-source/.git ]]
+ [[ ! -d apache-github-source-source ]]
+ date '+%Y-%m-%d %T.%3N'
2016-10-14 04:27:54.812
+ cd apache-github-source-source
+ git fetch origin
+ git reset --hard HEAD
HEAD is now at 5353161 HIVE-14835: Improve ptest2 build time (Prasanth 
Jayachandran reviewed by Sergio Pena)
+ git clean -f -d
+ git checkout master
Already on 'master'
Your branch is up-to-date with 'origin/master'.
+ git reset --hard origin/master
HEAD is now at 5353161 HIVE-14835: Improve ptest2 build time (Prasanth 
Jayachandran reviewed by Sergio Pena)
+ git merge --ff-only origin/master
Already up-to-date.
+ date '+%Y-%m-%d %T.%3N'
2016-10-14 04:27:55.663
+ patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hiveptest/working/scratch/build.patch
+ [[ -f /data/hiveptest/working/scratch/build.patch ]]
+ chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh
+ /data/hiveptest/working/scratch/smart-apply-patch.sh 
/data/hiveptest/working/scratch/build.patch
error: patch failed: 
ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java:304
error: ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java: patch 
does not apply
error: patch failed: 
ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java:3766
error: ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java: patch does 
not apply
error: patch failed: 
ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java:1514
error: ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java: patch does not 
apply
error: patch failed: 
ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java:1840
error: ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java: 
patch does not apply
error: patch failed: 
ql/src/java/org/apache/hadoop/hive/ql/optimizer/unionproc/UnionProcFactory.java:223
error: 
ql/src/java/org/apache/hadoop/hive/ql/optimizer/unionproc/UnionProcFactory.java:
 patch does not apply
error: patch failed: 
ql/src/java/org/apache/hadoop/hive/ql/parse/GenTezUtils.java:307
error: ql/src/java/org/apache/hadoop/hive/ql/parse/GenTezUtils.java: patch does 
not apply
error: patch failed: 
ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java:6544
error: ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java: patch 
does not apply
error: patch failed: 
ql/src/java/org/apache/hadoop/hive/ql/parse/TaskCompiler.java:205
error: ql/src/java/org/apache/hadoop/hive/ql/parse/TaskCompiler.java: patch 
does not apply
error: patch failed: 
ql/src/java/org/apache/hadoop/hive/ql/plan/FileSinkDesc.java:180
error: ql/src/java/org/apache/hadoop/hive/ql/plan/FileSinkDesc.java: patch does 
not apply
error: patch failed: 
ql/src/java/org/apache/hadoop/hive/ql/plan/LoadFileDesc.java:60
error: ql/src/java/org/apache/hadoop/hive/ql/plan/LoadFileDesc.java: patch does 
not apply
error: patch failed: ql/src/java/org/apache/hadoop/hive/ql/plan/MoveWork.java:70
error: ql/src/java/org/apache/hadoop/hive/ql/plan/MoveWork.java: patch does not 
apply
error: ql/src/test/queries/clientpositive/mm_all.q: No such file or directory
error:

[jira] [Commented] (HIVE-14643) handle ctas

2016-10-13 Thread Hive QA (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-14643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573985#comment-15573985
 ] 

Hive QA commented on HIVE-14643:




Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12833236/HIVE-14643.patch

{color:red}ERROR:{color} -1 due to build exiting with an error

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/1550/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/1550/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-1550/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit 
status 1 and output '+ date '+%Y-%m-%d %T.%3N'
2016-10-14 03:03:51.514
+ [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]]
+ export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ export 
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ 
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'M2_OPTS=-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost 
-Dhttp.proxyPort=3128'
+ M2_OPTS='-Xmx1g -XX:MaxPermSize=256m -Dhttp.proxyHost=localhost 
-Dhttp.proxyPort=3128'
+ cd /data/hiveptest/working/
+ tee /data/hiveptest/logs/PreCommit-HIVE-Build-1550/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z master ]]
+ [[ -d apache-github-source-source ]]
+ [[ ! -d apache-github-source-source/.git ]]
+ [[ ! -d apache-github-source-source ]]
+ date '+%Y-%m-%d %T.%3N'
2016-10-14 03:03:51.517
+ cd apache-github-source-source
+ git fetch origin
+ git reset --hard HEAD
HEAD is now at 5353161 HIVE-14835: Improve ptest2 build time (Prasanth 
Jayachandran reviewed by Sergio Pena)
+ git clean -f -d
+ git checkout master
Already on 'master'
Your branch is up-to-date with 'origin/master'.
+ git reset --hard origin/master
HEAD is now at 5353161 HIVE-14835: Improve ptest2 build time (Prasanth 
Jayachandran reviewed by Sergio Pena)
+ git merge --ff-only origin/master
Already up-to-date.
+ date '+%Y-%m-%d %T.%3N'
2016-10-14 03:03:52.378
+ patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hiveptest/working/scratch/build.patch
+ [[ -f /data/hiveptest/working/scratch/build.patch ]]
+ chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh
+ /data/hiveptest/working/scratch/smart-apply-patch.sh 
/data/hiveptest/working/scratch/build.patch
/data/hiveptest/working/scratch/smart-apply-patch.sh: line 44: patch: command 
not found
/data/hiveptest/working/scratch/smart-apply-patch.sh: line 82: patch: command 
not found
/data/hiveptest/working/scratch/smart-apply-patch.sh: line 84: patch: command 
not found
error: patch failed: 
ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java:304
error: ql/src/java/org/apache/hadoop/hive/ql/exec/FileSinkOperator.java: patch 
does not apply
error: patch failed: 
ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java:3766
error: ql/src/java/org/apache/hadoop/hive/ql/exec/Utilities.java: patch does 
not apply
error: patch failed: 
ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java:1514
error: ql/src/java/org/apache/hadoop/hive/ql/metadata/Hive.java: patch does not 
apply
error: patch failed: 
ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java:1840
error: ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java: 
patch does not apply
error: patch failed: 
ql/src/java/org/apache/hadoop/hive/ql/optimizer/unionproc/UnionProcFactory.java:223
error: 
ql/src/java/org/apache/hadoop/hive/ql/optimizer/unionproc/UnionProcFactory.java:
 patch does not apply
error: patch failed: 
ql/src/java/org/apache/hadoop/hive/ql/parse/GenTezUtils.java:307
error: ql/src/java/org/apache/hadoop/hive/ql/parse/GenTezUtils.java: patch does 
not apply
error: patch failed: 
ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java:6544
error: ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java: patch 
does not apply
error: patch failed: 
ql/src/java/org/apache/hadoop/hive/ql/parse/TaskCompiler.java:205
error: ql/src/java/org/apache/hadoop/hive/ql/parse/TaskCompiler.java: patch 
does not apply
error: patch failed: 
ql/src/java/org/apache/hadoop/hive/ql/plan/FileSinkDesc.java:180
error: ql/src/java/org/apache/hadoop/hive/ql/plan/FileSinkDesc.java: patch does 
not apply
error: patch failed: 
ql/src/java/org/apache/hadoop/hive/ql/plan/LoadFileDesc.java:60
error: ql/src/java/org/apache/hadoop/hive/ql/plan/LoadFileDesc.java: patch does 
not apply

[jira] [Commented] (HIVE-14643) handle ctas

2016-10-13 Thread Sergey Shelukhin (JIRA) 

[ 
https://issues.apache.org/jira/browse/HIVE-14643?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15573516#comment-15573516
 ] 

Sergey Shelukhin commented on HIVE-14643:
-

The patch. This also reworks the union logic which I noticed used the weird 
path structure (table/1/mm_..., creating multiple directories per write) 
instead of proper (table/mm_.../1)

> handle ctas
> ---
>
> Key: HIVE-14643
> URL: https://issues.apache.org/jira/browse/HIVE-14643
> Project: Hive
>  Issue Type: Sub-task
>Reporter: Sergey Shelukhin
>Assignee: Sergey Shelukhin
> Attachments: HIVE-14643.patch
>
>




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)