[jira] [Commented] (HIVE-19731) Change staging tmp directory used by TestHCatLoaderComplexSchema
[
https://issues.apache.org/jira/browse/HIVE-19731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497273#comment-16497273
]
Hive QA commented on HIVE-19731:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12925567/HIVE-19731.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 2 failed/errored test(s), 14427 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.ql.lockmgr.TestDbTxnManager.testExceptions (batchId=304)
org.apache.hive.spark.client.rpc.TestRpc.testServerPort (batchId=307)
{noformat}
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/11395/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/11395/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-11395/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 2 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12925567 - PreCommit-HIVE-Build
> Change staging tmp directory used by TestHCatLoaderComplexSchema
>
>
> Key: HIVE-19731
> URL: https://issues.apache.org/jira/browse/HIVE-19731
> Project: Hive
> Issue Type: Test
> Components: Test
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Fix For: 3.1.0, 4.0.0
>
> Attachments: HIVE-19731.patch
>
>
> Another one that is set to default and hence is flaky.
> https://builds.apache.org/job/PreCommit-HIVE-Build/11321/testReport/org.apache.hive.hcatalog.pig/TestHCatLoaderComplexSchema/testSyntheticComplexSchema_3_/
> {noformat}
> org.apache.hadoop.util.Shell$ExitCodeException: chmod: cannot access
> ‘/tmp/hadoop/mapred/staging/hiveptest985275899/.staging/job_local985275899_0088’:
> No such file or directory
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:1009)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.util.Shell.run(Shell.java:902)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1227)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.util.Shell.execCommand(Shell.java:1321)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.util.Shell.execCommand(Shell.java:1303)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:840)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.fs.ChecksumFileSystem$1.apply(ChecksumFileSystem.java:508)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.fs.ChecksumFileSystem$FsOperation.run(ChecksumFileSystem.java:489)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.fs.ChecksumFileSystem.setPermission(ChecksumFileSystem.java:511)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:727)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobResourceUploader.mkdirs(JobResourceUploader.java:658)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobResourceUploader.uploadResourcesInternal(JobResourceUploader.java:172)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobResourceUploader.uploadResources(JobResourceUploader.java:133)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:102)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:197)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1570)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1567)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at java.security.AccessController.doPrivileged(Native Method)
> ~[?:1.8.0_102]
> at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_102]
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1567)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:336)
>
[jira] [Commented] (HIVE-19731) Change staging tmp directory used by TestHCatLoaderComplexSchema
[
https://issues.apache.org/jira/browse/HIVE-19731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16497221#comment-16497221
]
Hive QA commented on HIVE-19731:
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:red}-1{color} | {color:red} patch {color} | {color:red} 0m 19s{color}
| {color:red}
/data/hiveptest/logs/PreCommit-HIVE-Build-11395/patches/PreCommit-HIVE-Build-11395.patch
does not apply to master. Rebase required? Wrong Branch? See
http://cwiki.apache.org/confluence/display/Hive/HowToContribute for help.
{color} |
\\
\\
|| Subsystem || Report/Notes ||
| Console output |
http://104.198.109.242/logs//PreCommit-HIVE-Build-11395/yetus.txt |
| Powered by | Apache Yetushttp://yetus.apache.org |
This message was automatically generated.
> Change staging tmp directory used by TestHCatLoaderComplexSchema
>
>
> Key: HIVE-19731
> URL: https://issues.apache.org/jira/browse/HIVE-19731
> Project: Hive
> Issue Type: Test
> Components: Test
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Fix For: 3.1.0, 4.0.0
>
> Attachments: HIVE-19731.patch
>
>
> Another one that is set to default and hence is flaky.
> https://builds.apache.org/job/PreCommit-HIVE-Build/11321/testReport/org.apache.hive.hcatalog.pig/TestHCatLoaderComplexSchema/testSyntheticComplexSchema_3_/
> {noformat}
> org.apache.hadoop.util.Shell$ExitCodeException: chmod: cannot access
> ‘/tmp/hadoop/mapred/staging/hiveptest985275899/.staging/job_local985275899_0088’:
> No such file or directory
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:1009)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.util.Shell.run(Shell.java:902)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1227)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.util.Shell.execCommand(Shell.java:1321)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.util.Shell.execCommand(Shell.java:1303)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:840)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.fs.ChecksumFileSystem$1.apply(ChecksumFileSystem.java:508)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.fs.ChecksumFileSystem$FsOperation.run(ChecksumFileSystem.java:489)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.fs.ChecksumFileSystem.setPermission(ChecksumFileSystem.java:511)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:727)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobResourceUploader.mkdirs(JobResourceUploader.java:658)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobResourceUploader.uploadResourcesInternal(JobResourceUploader.java:172)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobResourceUploader.uploadResources(JobResourceUploader.java:133)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:102)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:197)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1570)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1567)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at java.security.AccessController.doPrivileged(Native Method)
> ~[?:1.8.0_102]
> at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_102]
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1567)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:336)
> [hadoop-mapreduce-client-core-3.1.0.jar:?]
> at sun.reflect.GeneratedMethodAccessor36.invoke(Unknown Source) ~[?:?]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_102]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_102]
> at
> org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
> [pig-0.16.0-h2.jar:?]
> at
>
[jira] [Commented] (HIVE-19731) Change staging tmp directory used by TestHCatLoaderComplexSchema
[
https://issues.apache.org/jira/browse/HIVE-19731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493786#comment-16493786
]
Jesus Camacho Rodriguez commented on HIVE-19731:
[~thejas], thanks. I agree... We should have a more comprehensive way of doing
this. We have already identified quite a few conf objects that use default
staging directory... In a follow-up, the code could be refactored so all these
tests call to same method that given the test name, sets the correct value for
the conf properties.
> Change staging tmp directory used by TestHCatLoaderComplexSchema
>
>
> Key: HIVE-19731
> URL: https://issues.apache.org/jira/browse/HIVE-19731
> Project: Hive
> Issue Type: Test
> Components: Test
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Attachments: HIVE-19731.patch
>
>
> Another one that is set to default and hence is flaky.
> https://builds.apache.org/job/PreCommit-HIVE-Build/11321/testReport/org.apache.hive.hcatalog.pig/TestHCatLoaderComplexSchema/testSyntheticComplexSchema_3_/
> {noformat}
> org.apache.hadoop.util.Shell$ExitCodeException: chmod: cannot access
> ‘/tmp/hadoop/mapred/staging/hiveptest985275899/.staging/job_local985275899_0088’:
> No such file or directory
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:1009)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.util.Shell.run(Shell.java:902)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1227)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.util.Shell.execCommand(Shell.java:1321)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.util.Shell.execCommand(Shell.java:1303)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:840)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.fs.ChecksumFileSystem$1.apply(ChecksumFileSystem.java:508)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.fs.ChecksumFileSystem$FsOperation.run(ChecksumFileSystem.java:489)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.fs.ChecksumFileSystem.setPermission(ChecksumFileSystem.java:511)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:727)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobResourceUploader.mkdirs(JobResourceUploader.java:658)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobResourceUploader.uploadResourcesInternal(JobResourceUploader.java:172)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobResourceUploader.uploadResources(JobResourceUploader.java:133)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:102)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:197)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1570)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1567)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at java.security.AccessController.doPrivileged(Native Method)
> ~[?:1.8.0_102]
> at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_102]
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1567)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:336)
> [hadoop-mapreduce-client-core-3.1.0.jar:?]
> at sun.reflect.GeneratedMethodAccessor36.invoke(Unknown Source) ~[?:?]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_102]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_102]
> at
> org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
> [pig-0.16.0-h2.jar:?]
> at
> org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:194)
> [pig-0.16.0-h2.jar:?]
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_102]
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:276)
> [pig-0.16.0-h2.jar:?]
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-19731) Change staging tmp directory used by TestHCatLoaderComplexSchema
[
https://issues.apache.org/jira/browse/HIVE-19731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493776#comment-16493776
]
Thejas M Nair commented on HIVE-19731:
--
+1
It seems like this might be a common issue. Would it be useful to have a common
test utility method for updating these settings ? It doesn't have to be part of
this patch though.
> Change staging tmp directory used by TestHCatLoaderComplexSchema
>
>
> Key: HIVE-19731
> URL: https://issues.apache.org/jira/browse/HIVE-19731
> Project: Hive
> Issue Type: Test
> Components: Test
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Attachments: HIVE-19731.patch
>
>
> Another one that is set to default and hence is flaky.
> https://builds.apache.org/job/PreCommit-HIVE-Build/11321/testReport/org.apache.hive.hcatalog.pig/TestHCatLoaderComplexSchema/testSyntheticComplexSchema_3_/
> {noformat}
> org.apache.hadoop.util.Shell$ExitCodeException: chmod: cannot access
> ‘/tmp/hadoop/mapred/staging/hiveptest985275899/.staging/job_local985275899_0088’:
> No such file or directory
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:1009)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.util.Shell.run(Shell.java:902)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1227)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.util.Shell.execCommand(Shell.java:1321)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.util.Shell.execCommand(Shell.java:1303)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:840)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.fs.ChecksumFileSystem$1.apply(ChecksumFileSystem.java:508)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.fs.ChecksumFileSystem$FsOperation.run(ChecksumFileSystem.java:489)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.fs.ChecksumFileSystem.setPermission(ChecksumFileSystem.java:511)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:727)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobResourceUploader.mkdirs(JobResourceUploader.java:658)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobResourceUploader.uploadResourcesInternal(JobResourceUploader.java:172)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobResourceUploader.uploadResources(JobResourceUploader.java:133)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:102)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:197)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1570)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1567)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at java.security.AccessController.doPrivileged(Native Method)
> ~[?:1.8.0_102]
> at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_102]
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1567)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:336)
> [hadoop-mapreduce-client-core-3.1.0.jar:?]
> at sun.reflect.GeneratedMethodAccessor36.invoke(Unknown Source) ~[?:?]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_102]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_102]
> at
> org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
> [pig-0.16.0-h2.jar:?]
> at
> org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:194)
> [pig-0.16.0-h2.jar:?]
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_102]
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:276)
> [pig-0.16.0-h2.jar:?]
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (HIVE-19731) Change staging tmp directory used by TestHCatLoaderComplexSchema
[
https://issues.apache.org/jira/browse/HIVE-19731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493753#comment-16493753
]
Jesus Camacho Rodriguez commented on HIVE-19731:
[~ashutoshc], could you review? This one fixes a flaky test, no need to wait
for QA to check it in. Thanks
> Change staging tmp directory used by TestHCatLoaderComplexSchema
>
>
> Key: HIVE-19731
> URL: https://issues.apache.org/jira/browse/HIVE-19731
> Project: Hive
> Issue Type: Test
> Components: Test
>Affects Versions: 3.1.0, 4.0.0
>Reporter: Jesus Camacho Rodriguez
>Assignee: Jesus Camacho Rodriguez
>Priority: Major
> Attachments: HIVE-19731.patch
>
>
> Another one that is set to default and hence is flaky.
> https://builds.apache.org/job/PreCommit-HIVE-Build/11321/testReport/org.apache.hive.hcatalog.pig/TestHCatLoaderComplexSchema/testSyntheticComplexSchema_3_/
> {noformat}
> org.apache.hadoop.util.Shell$ExitCodeException: chmod: cannot access
> ‘/tmp/hadoop/mapred/staging/hiveptest985275899/.staging/job_local985275899_0088’:
> No such file or directory
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:1009)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.util.Shell.run(Shell.java:902)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1227)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.util.Shell.execCommand(Shell.java:1321)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.util.Shell.execCommand(Shell.java:1303)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:840)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.fs.ChecksumFileSystem$1.apply(ChecksumFileSystem.java:508)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.fs.ChecksumFileSystem$FsOperation.run(ChecksumFileSystem.java:489)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.fs.ChecksumFileSystem.setPermission(ChecksumFileSystem.java:511)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:727)
> ~[hadoop-common-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobResourceUploader.mkdirs(JobResourceUploader.java:658)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobResourceUploader.uploadResourcesInternal(JobResourceUploader.java:172)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobResourceUploader.uploadResources(JobResourceUploader.java:133)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:102)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:197)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1570)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1567)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at java.security.AccessController.doPrivileged(Native Method)
> ~[?:1.8.0_102]
> at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_102]
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1682)
> ~[hadoop-common-3.1.0.jar:?]
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1567)
> ~[hadoop-mapreduce-client-core-3.1.0.jar:?]
> at
> org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:336)
> [hadoop-mapreduce-client-core-3.1.0.jar:?]
> at sun.reflect.GeneratedMethodAccessor36.invoke(Unknown Source) ~[?:?]
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> ~[?:1.8.0_102]
> at java.lang.reflect.Method.invoke(Method.java:498) ~[?:1.8.0_102]
> at
> org.apache.pig.backend.hadoop23.PigJobControl.submit(PigJobControl.java:128)
> [pig-0.16.0-h2.jar:?]
> at
> org.apache.pig.backend.hadoop23.PigJobControl.run(PigJobControl.java:194)
> [pig-0.16.0-h2.jar:?]
> at java.lang.Thread.run(Thread.java:745) [?:1.8.0_102]
> at
> org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:276)
> [pig-0.16.0-h2.jar:?]
> {noformat}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
