[
https://issues.apache.org/jira/browse/HIVE-18391?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16315035#comment-16315035
]
Hive QA commented on HIVE-18391:
--------------------------------
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12904960/HIVE-18391.1.patch
{color:red}ERROR:{color} -1 due to build exiting with an error
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/8492/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/8492/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-8492/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Tests exited with: NonZeroExitCodeException
Command 'bash /data/hiveptest/working/scratch/source-prep.sh' failed with exit
status 1 and output '+ date '+%Y-%m-%d %T.%3N'
2018-01-07 02:07:15.893
+ [[ -n /usr/lib/jvm/java-8-openjdk-amd64 ]]
+ export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64
+ export
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+
PATH=/usr/lib/jvm/java-8-openjdk-amd64/bin/:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games
+ export 'ANT_OPTS=-Xmx1g -XX:MaxPermSize=256m '
+ ANT_OPTS='-Xmx1g -XX:MaxPermSize=256m '
+ export 'MAVEN_OPTS=-Xmx1g '
+ MAVEN_OPTS='-Xmx1g '
+ cd /data/hiveptest/working/
+ tee /data/hiveptest/logs/PreCommit-HIVE-Build-8492/source-prep.txt
+ [[ false == \t\r\u\e ]]
+ mkdir -p maven ivy
+ [[ git = \s\v\n ]]
+ [[ git = \g\i\t ]]
+ [[ -z master ]]
+ [[ -d apache-github-source-source ]]
+ [[ ! -d apache-github-source-source/.git ]]
+ [[ ! -d apache-github-source-source ]]
+ date '+%Y-%m-%d %T.%3N'
2018-01-07 02:07:15.896
+ cd apache-github-source-source
+ git fetch origin
+ git reset --hard HEAD
HEAD is now at a6b88d9 HIVE-18096 : add a user-friendly show plan command
(Harish Jaiprakash, reviewed by Sergey Shelukhin)
+ git clean -f -d
Removing ${project.basedir}/
+ git checkout master
Already on 'master'
Your branch is up-to-date with 'origin/master'.
+ git reset --hard origin/master
HEAD is now at a6b88d9 HIVE-18096 : add a user-friendly show plan command
(Harish Jaiprakash, reviewed by Sergey Shelukhin)
+ git merge --ff-only origin/master
Already up-to-date.
+ date '+%Y-%m-%d %T.%3N'
2018-01-07 02:07:19.268
+ rm -rf ../yetus
+ mkdir ../yetus
+ cp -R . ../yetus
+ mkdir /data/hiveptest/logs/PreCommit-HIVE-Build-8492/yetus
+ patchCommandPath=/data/hiveptest/working/scratch/smart-apply-patch.sh
+ patchFilePath=/data/hiveptest/working/scratch/build.patch
+ [[ -f /data/hiveptest/working/scratch/build.patch ]]
+ chmod +x /data/hiveptest/working/scratch/smart-apply-patch.sh
+ /data/hiveptest/working/scratch/smart-apply-patch.sh
/data/hiveptest/working/scratch/build.patch
fatal: git diff header lacks filename information when removing 0 leading
pathname components (line 2080)
error: cannot apply binary patch to 'data/files/smb_rc1/000000_0' without full
index line
Falling back to three-way merge...
error: cannot apply binary patch to 'data/files/smb_rc1/000000_0' without full
index line
error: data/files/smb_rc1/000000_0: patch does not apply
error: cannot apply binary patch to 'data/files/smb_rc1/000001_0' without full
index line
Falling back to three-way merge...
error: cannot apply binary patch to 'data/files/smb_rc1/000001_0' without full
index line
error: data/files/smb_rc1/000001_0: patch does not apply
error: cannot apply binary patch to 'data/files/smb_rc1/000002_0' without full
index line
Falling back to three-way merge...
error: cannot apply binary patch to 'data/files/smb_rc1/000002_0' without full
index line
error: data/files/smb_rc1/000002_0: patch does not apply
error: cannot apply binary patch to 'data/files/smb_rc2/000000_0' without full
index line
Falling back to three-way merge...
error: cannot apply binary patch to 'data/files/smb_rc2/000000_0' without full
index line
error: data/files/smb_rc2/000000_0: patch does not apply
error: cannot apply binary patch to 'data/files/smb_rc3/000000_0' without full
index line
Falling back to three-way merge...
error: cannot apply binary patch to 'data/files/smb_rc3/000000_0' without full
index line
error: data/files/smb_rc3/000000_0: patch does not apply
error: files/smallsrcsortbucket1outof4.txt: does not exist in index
error: files/smallsrcsortbucket2outof4.txt: does not exist in index
error: files/smallsrcsortbucket3outof4.txt: does not exist in index
error: files/smallsrcsortbucket4outof4.txt: does not exist in index
error: cannot apply binary patch to 'files/smb_rc1/000000_0' without full index
line
Falling back to three-way merge...
error: cannot apply binary patch to 'files/smb_rc1/000000_0' without full index
line
error: files/smb_rc1/000000_0: patch does not apply
error: cannot apply binary patch to 'files/smb_rc1/000001_0' without full index
line
Falling back to three-way merge...
error: cannot apply binary patch to 'files/smb_rc1/000001_0' without full index
line
error: files/smb_rc1/000001_0: patch does not apply
error: cannot apply binary patch to 'files/smb_rc1/000002_0' without full index
line
Falling back to three-way merge...
error: cannot apply binary patch to 'files/smb_rc1/000002_0' without full index
line
error: files/smb_rc1/000002_0: patch does not apply
error: cannot apply binary patch to 'files/smb_rc2/000000_0' without full index
line
Falling back to three-way merge...
error: cannot apply binary patch to 'files/smb_rc2/000000_0' without full index
line
error: files/smb_rc2/000000_0: patch does not apply
error: cannot apply binary patch to 'files/smb_rc3/000000_0' without full index
line
Falling back to three-way merge...
error: cannot apply binary patch to 'files/smb_rc3/000000_0' without full index
line
error: files/smb_rc3/000000_0: patch does not apply
error: scripts/q_test_init.sql: does not exist in index
error: src/java/org/apache/hadoop/hive/ql/parse/LoadSemanticAnalyzer.java: does
not exist in index
error: src/test/queries/clientnegative/bucket_mapjoin_mismatch1.q: does not
exist in index
error: src/test/queries/clientnegative/dynamic_partitions_with_whitelist.q:
does not exist in index
error: src/test/queries/clientnegative/insertover_dynapart_ifnotexists.q: does
not exist in index
error: src/test/queries/clientpositive/autoColumnStats_1.q: does not exist in
index
error: src/test/queries/clientpositive/autoColumnStats_2.q: does not exist in
index
error: src/test/queries/clientpositive/auto_sortmerge_join_1.q: does not exist
in index
error: src/test/queries/clientpositive/auto_sortmerge_join_11.q: does not exist
in index
error: src/test/queries/clientpositive/auto_sortmerge_join_12.q: does not exist
in index
error: src/test/queries/clientpositive/auto_sortmerge_join_16.q: does not exist
in index
error: src/test/queries/clientpositive/auto_sortmerge_join_2.q: does not exist
in index
error: src/test/queries/clientpositive/auto_sortmerge_join_3.q: does not exist
in index
error: src/test/queries/clientpositive/auto_sortmerge_join_4.q: does not exist
in index
error: src/test/queries/clientpositive/auto_sortmerge_join_5.q: does not exist
in index
error: src/test/queries/clientpositive/auto_sortmerge_join_7.q: does not exist
in index
error: src/test/queries/clientpositive/auto_sortmerge_join_8.q: does not exist
in index
error: src/test/queries/clientpositive/bucket_map_join_spark1.q: does not exist
in index
error: src/test/queries/clientpositive/bucket_map_join_spark2.q: does not exist
in index
error: src/test/queries/clientpositive/bucket_map_join_spark3.q: does not exist
in index
error: src/test/queries/clientpositive/bucket_map_join_tez1.q: does not exist
in index
error: src/test/queries/clientpositive/bucket_map_join_tez2.q: does not exist
in index
error: src/test/queries/clientpositive/bucketcontext_1.q: does not exist in
index
error: src/test/queries/clientpositive/bucketcontext_2.q: does not exist in
index
error: src/test/queries/clientpositive/bucketcontext_3.q: does not exist in
index
error: src/test/queries/clientpositive/bucketcontext_4.q: does not exist in
index
error: src/test/queries/clientpositive/bucketcontext_5.q: does not exist in
index
error: src/test/queries/clientpositive/bucketcontext_6.q: does not exist in
index
error: src/test/queries/clientpositive/bucketcontext_7.q: does not exist in
index
error: src/test/queries/clientpositive/bucketcontext_8.q: does not exist in
index
error: src/test/queries/clientpositive/bucketizedhiveinputformat_auto.q: does
not exist in index
error: src/test/queries/clientpositive/bucketmapjoin1.q: does not exist in index
error: src/test/queries/clientpositive/bucketmapjoin10.q: does not exist in
index
error: src/test/queries/clientpositive/bucketmapjoin11.q: does not exist in
index
error: src/test/queries/clientpositive/bucketmapjoin12.q: does not exist in
index
error: src/test/queries/clientpositive/bucketmapjoin2.q: does not exist in index
error: src/test/queries/clientpositive/bucketmapjoin3.q: does not exist in index
error: src/test/queries/clientpositive/bucketmapjoin4.q: does not exist in index
error: src/test/queries/clientpositive/bucketmapjoin5.q: does not exist in index
error: src/test/queries/clientpositive/bucketmapjoin7.q: does not exist in index
error: src/test/queries/clientpositive/bucketmapjoin8.q: does not exist in index
error: src/test/queries/clientpositive/bucketmapjoin9.q: does not exist in index
error: src/test/queries/clientpositive/bucketmapjoin_negative.q: does not exist
in index
error: src/test/queries/clientpositive/bucketmapjoin_negative2.q: does not
exist in index
error: src/test/queries/clientpositive/bucketmapjoin_negative3.q: does not
exist in index
error: src/test/queries/clientpositive/cbo_rp_udaf_percentile_approx_23.q: does
not exist in index
error: src/test/queries/clientpositive/dynamic_semijoin_reduction_2.q: does not
exist in index
error: src/test/queries/clientpositive/explainanalyze_2.q: does not exist in
index
error: src/test/queries/clientpositive/explainanalyze_3.q: does not exist in
index
error: src/test/queries/clientpositive/explainuser_2.q: does not exist in index
error: src/test/queries/clientpositive/explainuser_3.q: does not exist in index
error: src/test/queries/clientpositive/mergejoin.q: does not exist in index
error: src/test/queries/clientpositive/optimize_filter_literal.q: does not
exist in index
error: src/test/queries/clientpositive/smb_mapjoin_1.q: does not exist in index
error: src/test/queries/clientpositive/smb_mapjoin_10.q: does not exist in index
error: src/test/queries/clientpositive/smb_mapjoin_2.q: does not exist in index
error: src/test/queries/clientpositive/smb_mapjoin_25.q: does not exist in index
error: src/test/queries/clientpositive/smb_mapjoin_3.q: does not exist in index
error: src/test/queries/clientpositive/smb_mapjoin_4.q: does not exist in index
error: src/test/queries/clientpositive/smb_mapjoin_5.q: does not exist in index
error: src/test/queries/clientpositive/stats11.q: does not exist in index
error: src/test/queries/clientpositive/tez-tag.q: does not exist in index
error: src/test/queries/clientpositive/tez_fsstat.q: does not exist in index
'
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12904960 - PreCommit-HIVE-Build
> load data should rename files consistent with insert statements (bucketed
> tables only)
> --------------------------------------------------------------------------------------
>
> Key: HIVE-18391
> URL: https://issues.apache.org/jira/browse/HIVE-18391
> Project: Hive
> Issue Type: Sub-task
> Reporter: Deepak Jaiswal
> Assignee: Deepak Jaiswal
> Attachments: HIVE-18391.1.patch
>
>
> Insert statements create files of format ending with 0000_0, 0001_0 etc.
> However, the load data uses the input file name. That results in inconsistent
> naming convention which makes SMB joins difficult in some scenarios and may
> cause trouble for other types of queries in future.
> We need consistent naming convention.
> For bucketed table, hive relies on user to name the files matching the bucket
> in non-strict mode. Hive assumes that the data belongs to same bucket in a
> file. In strict mode, loading bucketed table is disabled.
> This will likely affect most of the tests which load data which is pretty
> significant.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
