[jira] Subscription: Oozie Patch Available
Issue Subscription Filter: Oozie Patch Available (92 issues) Subscriber: ooziedaily Key Summary OOZIE-3568 Have large amount of log information “WARN messages [main] openjpa.MetaData” in jetty.log need to clean https://issues.apache.org/jira/browse/OOZIE-3568 OOZIE-3567 Oozie ShellAction should support absolute bash file path https://issues.apache.org/jira/browse/OOZIE-3567 OOZIE-3560 IDEA shows have some error in index.jsp https://issues.apache.org/jira/browse/OOZIE-3560 OOZIE-3551 Configure working defaults for Spark action in Oozie https://issues.apache.org/jira/browse/OOZIE-3551 OOZIE-3482 Fix bug in CoordSubmitXCommand#validateCoordinatorJob https://issues.apache.org/jira/browse/OOZIE-3482 OOZIE-3480 Add windowactionstatus metrics in DBLiteWorkflowStoreService https://issues.apache.org/jira/browse/OOZIE-3480 OOZIE-3461 CoordMaterializeTriggerService code cleanup https://issues.apache.org/jira/browse/OOZIE-3461 OOZIE-3449 Make spark-2 as the default profile https://issues.apache.org/jira/browse/OOZIE-3449 OOZIE-3447 Run test case in local : It shows oozie-hsqldb-orm.xml exception https://issues.apache.org/jira/browse/OOZIE-3447 OOZIE-3418 Upgrade to Guava 27 https://issues.apache.org/jira/browse/OOZIE-3418 OOZIE-3404 The env variable of SPARK_HOME needs to be set when running pySpark https://issues.apache.org/jira/browse/OOZIE-3404 OOZIE-3375 Can't use empty in coordinator https://issues.apache.org/jira/browse/OOZIE-3375 OOZIE-3367 Using && in EL expressions in oozie bundle.xml files generates parse errors https://issues.apache.org/jira/browse/OOZIE-3367 OOZIE-3366 Update workflow status and subworkflow status on suspend command https://issues.apache.org/jira/browse/OOZIE-3366 OOZIE-3364 Rerunning Oozie bundle jobs starts the coordinators in indeterminate order https://issues.apache.org/jira/browse/OOZIE-3364 OOZIE-3362 When killed, SSH action should kill the spawned processes on target host https://issues.apache.org/jira/browse/OOZIE-3362 OOZIE-3335 Cleanup parseFilter methods https://issues.apache.org/jira/browse/OOZIE-3335 OOZIE-3328 Create Hive compatibility action executor to run hive actions using beeline https://issues.apache.org/jira/browse/OOZIE-3328 OOZIE-3319 Log SSH action callback error output https://issues.apache.org/jira/browse/OOZIE-3319 OOZIE-3301 Update NOTICE file https://issues.apache.org/jira/browse/OOZIE-3301 OOZIE-3274 Remove slf4j https://issues.apache.org/jira/browse/OOZIE-3274 OOZIE-3266 Coord action rerun support RERUN_SKIP_NODES option https://issues.apache.org/jira/browse/OOZIE-3266 OOZIE-3256 refactor OozieCLI class https://issues.apache.org/jira/browse/OOZIE-3256 OOZIE-3254 [coordinator] LAST_ONLY and NONE execution modes: possible OutOfMemoryError when there are too many coordinator actions to materialize https://issues.apache.org/jira/browse/OOZIE-3254 OOZIE-3199 Let system property restriction configurable https://issues.apache.org/jira/browse/OOZIE-3199 OOZIE-3196 Authorization: restrict world readability by user https://issues.apache.org/jira/browse/OOZIE-3196 OOZIE-3170 Oozie Diagnostic Bundle tool fails with NPE due to missing service class https://issues.apache.org/jira/browse/OOZIE-3170 OOZIE-3137 Add support for log4j2 in HiveMain https://issues.apache.org/jira/browse/OOZIE-3137 OOZIE-3135 Configure log4j2 in SqoopMain https://issues.apache.org/jira/browse/OOZIE-3135 OOZIE-3091 Oozie Sqoop Avro Import fails with "java.lang.NoClassDefFoundError: org/apache/avro/mapred/AvroWrapper" https://issues.apache.org/jira/browse/OOZIE-3091 OOZIE-3071 Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0 https://issues.apache.org/jira/browse/OOZIE-3071 OOZIE-3063 Sanitizing variables that are part of openjpa.ConnectionProperties https://issues.apache.org/jira/browse/OOZIE-3063 OOZIE-3062 Set HADOOP_CONF_DIR for spark action https://issues.apache.org/jira/browse/OOZIE-3062 OOZIE-2952 Fix Findbugs warnings in oozie-sharelib-oozie https://issues.apache.org/jira/browse/OOZIE-2952 OOZIE-2834 ParameterVerifier logging non-useful warning for workflow definition https://issues.apache.org/jira/browse/OOZIE-2834 OOZIE-2812 SparkConfigurationService should support loading configurations from multiple Spark versions https://issues.apache.org/jira/browse/OOZIE-2812 OOZIE-2795 Create lib directory or symlink for Oozie CLI during packaging https://issues.apache.org/jira/browse/OOZIE-2795 OOZIE-2784 Include WEEK as a parameter in the Coordinator Expression
[jira] [Created] (OOZIE-3587) oozie cannot run hive job with nosasl
WenjunXiao created OOZIE-3587:
-
Summary: oozie cannot run hive job with nosasl
Key: OOZIE-3587
URL: https://issues.apache.org/jira/browse/OOZIE-3587
Project: Oozie
Issue Type: Improvement
Components: action
Environment: hadoop: 2.6.4
hbase: 1.2.2
hive: 1.2.2
oozie: 4.3.1
hue: 4.5.0
Reporter: WenjunXiao
hive-site.xml set `hive.server2.authentication=NOSASL`, and submit a workflow
in hue-4.5.0
{code:java}
[${wf:errorMessage(wf:lastErrorNode())}]
${jobTracker}
${nameNode}
jdbc:hive2://172.100.0.11:1/default;auth=noSasl
${wf:appPath()}/hive-e994.sql
{code}
hadoop container stderr log
{code:java}
Connecting to jdbc:hive2://172.100.0.11:1/default;auth=noSasl
Error: Could not open client transport with JDBC Uri:
jdbc:hive2://172.100.0.11:1/default;auth=noSasl: java.net.SocketException:
Connection reset (state=08S01,code=0)
No current connection
Error: Could not open client transport with JDBC Uri:
jdbc:hive2://172.100.0.11:1/default;auth=noSasl: null (state=08S01,code=0)
Intercepting System.exit(2)
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.Hive2Main],
exit code [2]
{code}
container stdout log
{code:java}
...
Beeline command arguments :
-u
jdbc:hive2://172.100.0.11:1/default;auth=noSasl
-n
hue
-p
DUMMY
-d
org.apache.hive.jdbc.HiveDriver
-f
hive-e994.sql
-a
delegationToken
--hiveconf
mapreduce.job.tags=oozie-3f5d6aeb66338cc0dde15e6927f4a2ad
--hiveconf
oozie.action.id=062-200219043903209-oozie-hado-W@hive-e994
--hiveconf
oozie.child.mapreduce.job.tags=oozie-3f5d6aeb66338cc0dde15e6927f4a2ad
--hiveconf
oozie.action.rootlogger.log.level=INFO
--hiveconf
oozie.job.id=062-200219043903209-oozie-hado-W
--hiveconf
oozie.HadoopAccessorService.created=true
Fetching child yarn jobs
tag id : oozie-3f5d6aeb66338cc0dde15e6927f4a2ad
Child yarn jobs are found -
=
>>> Invoking Beeline command line now >>>
0: jdbc:hive2://172.100.0.11:1/default (closed)> USE default;
<<< Invocation of Beeline command completed <<<
No child hadoop job is executed.
Intercepting System.exit(2)
<<< Invocation of Main class completed <<<
...{code}
I tested the command of beeline and found out that the argument `-a
delegationToken` covered `nosasl`
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (OOZIE-3551) Configure working defaults for Spark action in Oozie
[
https://issues.apache.org/jira/browse/OOZIE-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040054#comment-17040054
]
Hadoop QA commented on OOZIE-3551:
--
Testing JIRA OOZIE-3551
Cleaning local git workspace
{color:green}+1 PATCH_APPLIES{color}
{color:green}+1 CLEAN{color}
{color:red}-1 RAW_PATCH_ANALYSIS{color}
.{color:green}+1{color} the patch does not introduce any @author tags
.{color:green}+1{color} the patch does not introduce any tabs
.{color:green}+1{color} the patch does not introduce any trailing spaces
.{color:green}+1{color} the patch does not introduce any star imports
.{color:red}-1{color} the patch contains 1 line(s) longer than 132
characters
.{color:green}+1{color} the patch adds/modifies 1 testcase(s)
{color:green}+1 RAT{color}
.{color:green}+1{color} the patch does not seem to introduce new RAT
warnings
{color:green}+1 JAVADOC{color}
.{color:green}+1{color} Javadoc generation succeeded with the patch
.{color:green}+1{color} the patch does not seem to introduce new Javadoc
warning(s)
{color:green}+1 COMPILE{color}
.{color:green}+1{color} HEAD compiles
.{color:green}+1{color} patch compiles
.{color:green}+1{color} the patch does not seem to introduce new javac
warnings
{color:green}+1{color} There are no new bugs found in total.
.{color:green}+1{color} There are no new bugs found in
[fluent-job/fluent-job-api].
.{color:green}+1{color} There are no new bugs found in [docs].
.{color:green}+1{color} There are no new bugs found in [core].
.{color:green}+1{color} There are no new bugs found in [sharelib/spark].
.{color:green}+1{color} There are no new bugs found in [sharelib/git].
.{color:green}+1{color} There are no new bugs found in [sharelib/sqoop].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive2].
.{color:green}+1{color} There are no new bugs found in [sharelib/streaming].
.{color:green}+1{color} There are no new bugs found in [sharelib/pig].
.{color:green}+1{color} There are no new bugs found in [sharelib/oozie].
.{color:green}+1{color} There are no new bugs found in [sharelib/hive].
.{color:green}+1{color} There are no new bugs found in [sharelib/hcatalog].
.{color:green}+1{color} There are no new bugs found in [sharelib/distcp].
.{color:green}+1{color} There are no new bugs found in [tools].
.{color:green}+1{color} There are no new bugs found in [server].
.{color:green}+1{color} There are no new bugs found in [client].
.{color:green}+1{color} There are no new bugs found in [examples].
.{color:green}+1{color} There are no new bugs found in [webapp].
{color:green}+1 BACKWARDS_COMPATIBILITY{color}
.{color:green}+1{color} the patch does not change any JPA
Entity/Colum/Basic/Lob/Transient annotations
.{color:green}+1{color} the patch does not modify JPA files
{color:green}+1 TESTS{color}
.Tests run: 3208
.{color:orange}Tests failed at first run:{color}
TestBlockingInputStream#testFastWritingBlockingInputStream
TestBlockingInputStream#testLimitedWritingBlockingInputStream
.For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
{color:green}+1 DISTRO{color}
.{color:green}+1{color} distro tarball builds with the patch
{color:green}+1 MODERNIZER{color}
{color:red}*-1 Overall result, please check the reported -1(s)*{color}
The full output of the test-patch run is available at
. https://builds.apache.org/job/PreCommit-OOZIE-Build/1301/
> Configure working defaults for Spark action in Oozie
>
>
> Key: OOZIE-3551
> URL: https://issues.apache.org/jira/browse/OOZIE-3551
> Project: Oozie
> Issue Type: Bug
>Reporter: Liz Szilagyi
>Assignee: Liz Szilagyi
>Priority: Major
> Attachments: OOZIE-3551-1.patch
>
>
> Task:
> Add the following to the spark opts section of the spark action
> --conf spark.yarn.security.tokens.hiveserver2.enabled=false --conf
> spark.yarn.security.tokens.hivestreaming.enabled=false
> Issue:
> If Spark is launched form Oozie then we need to turn these 2 and some others
> off:
> [http://spark.apache.org/docs/latest/running-on-yarn.html#launching-your-application-with-apache-oozie]
> and let Oozie obtain the tokens.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
Failed: OOZIE-3551 PreCommit Build #1301
Jira: https://issues.apache.org/jira/browse/OOZIE-3551
Build: https://builds.apache.org/job/PreCommit-OOZIE-Build/1301/
###
## LAST 100 LINES OF THE CONSOLE
###
[...truncated 2.16 MB...]
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [examples].
[TRACE] New XMLLib present, calling 'xmllint --xpath' to get bug instance counts
[DEBUG] There are no new bugs found in [webapp].
[INFO] There are no new bugs found totally].
[TRACE] SpotBugs diffs checked and reports created
[TRACE] Summary file size is 2533 bytes
[TRACE] Full summary file size is 1525 bytes
[TRACE] File
[/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/SPOTBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar]
removed
[TRACE] File
[/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/tmp/SPOTBUGS_DIFF/diff/findbugs-diff-0.1.0-all.jar.md5]
removed
Running test-patch task BACKWARDS_COMPATIBILITY
Running test-patch task TESTS
Running test-patch task DISTRO
Running test-patch task MODERNIZER
Running modernizer op=report
[TRACE] grep -c '.*ERROR.*Prefer'
/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/reports/MODERNIZER-clean.txt
[TRACE] Modernizer errors before patch: 52
[TRACE] grep -c '.*ERROR.*Prefer'
/home/jenkins/jenkins-slave/workspace/PreCommit-OOZIE-Build/test-patch/reports/MODERNIZER-patch.txt
[TRACE] Modernizer errors after patch: 52
Testing JIRA OOZIE-3551
Cleaning local git workspace
+1 PATCH_APPLIES
+1 CLEAN
-1 RAW_PATCH_ANALYSIS
+1 the patch does not introduce any @author tags
+1 the patch does not introduce any tabs
+1 the patch does not introduce any trailing spaces
+1 the patch does not introduce any star imports
-1 the patch contains 1 line(s) longer than 132 characters
+1 the patch adds/modifies 1 testcase(s)
+1 RAT
+1 the patch does not seem to introduce new RAT warnings
+1 JAVADOC
+1 Javadoc generation succeeded with the patch
+1 the patch does not seem to introduce new Javadoc warning(s)
+1 COMPILE
+1 HEAD compiles
+1 patch compiles
+1 the patch does not seem to introduce new javac warnings
+1 There are no new bugs found in total.
+1 There are no new bugs found in [fluent-job/fluent-job-api].
+1 There are no new bugs found in [docs].
+1 There are no new bugs found in [core].
+1 There are no new bugs found in [sharelib/spark].
+1 There are no new bugs found in [sharelib/git].
+1 There are no new bugs found in [sharelib/sqoop].
+1 There are no new bugs found in [sharelib/hive2].
+1 There are no new bugs found in [sharelib/streaming].
+1 There are no new bugs found in [sharelib/pig].
+1 There are no new bugs found in [sharelib/oozie].
+1 There are no new bugs found in [sharelib/hive].
+1 There are no new bugs found in [sharelib/hcatalog].
+1 There are no new bugs found in [sharelib/distcp].
+1 There are no new bugs found in [tools].
+1 There are no new bugs found in [server].
+1 There are no new bugs found in [client].
+1 There are no new bugs found in [examples].
+1 There are no new bugs found in [webapp].
+1 BACKWARDS_COMPATIBILITY
+1 the patch does not change any JPA Entity/Colum/Basic/Lob/Transient
annotations
+1 the patch does not modify JPA files
+1 TESTS
Tests run: 3208
Tests failed at first run:
TestBlockingInputStream#testFastWritingBlockingInputStream
TestBlockingInputStream#testLimitedWritingBlockingInputStream
For the complete list of flaky tests, see TEST-SUMMARY-FULL files.
+1 DISTRO
+1 distro tarball builds with the patch
+1 MODERNIZER
-1 Overall result, please check the reported -1(s)
The full output of the test-patch run is available at
https://builds.apache.org/job/PreCommit-OOZIE-Build/1301/
Adding comment to JIRA
% Total% Received % Xferd Average Speed TimeTime Time Current
Dload Upload Total SpentLeft Speed
0 00 00 0 0 0 --:--:-- --:--:-- --:--:--
0100 34730 0 100 3473 0 2290 0:00:01 0:00:01 --:--:--
2290{"self":"https://issues.apache.org/jira/rest/api/2/issue/13263146/comment/17040054","id":"17040054","author":{"self":"https://issues.apache.org/jira/rest/api/2/user?username=hadoopqa","name":"hadoopqa","key":"hadoopqa","avatarUrls":{"48x48":"https://issues.apache.org/jira/secure/useravatar?ownerId=hadoopqa=10393","24x24":"https://issues.apache.org/jira/secure/useravatar?size=small=hadoopqa=10393","16x16":"https://issues.apache.org/jira/secure/useravatar?size=xsmall=hadoopqa=10393","32x32":"https://issues.apache.org/jira/secure/useravatar?size=medium=hadoopqa=10393"},"displayName":"Hadoop
[jira] [Commented] (OOZIE-3551) Configure working defaults for Spark action in Oozie
[ https://issues.apache.org/jira/browse/OOZIE-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17039941#comment-17039941 ] Hadoop QA commented on OOZIE-3551: -- PreCommit-OOZIE-Build started > Configure working defaults for Spark action in Oozie > > > Key: OOZIE-3551 > URL: https://issues.apache.org/jira/browse/OOZIE-3551 > Project: Oozie > Issue Type: Bug >Reporter: Liz Szilagyi >Assignee: Liz Szilagyi >Priority: Major > Attachments: OOZIE-3551-1.patch > > > Task: > Add the following to the spark opts section of the spark action > --conf spark.yarn.security.tokens.hiveserver2.enabled=false --conf > spark.yarn.security.tokens.hivestreaming.enabled=false > Issue: > If Spark is launched form Oozie then we need to turn these 2 and some others > off: > [http://spark.apache.org/docs/latest/running-on-yarn.html#launching-your-application-with-apache-oozie] > and let Oozie obtain the tokens. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (OOZIE-3551) Configure working defaults for Spark action in Oozie
[ https://issues.apache.org/jira/browse/OOZIE-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liz Szilagyi updated OOZIE-3551: Attachment: OOZIE-3551-1.patch > Configure working defaults for Spark action in Oozie > > > Key: OOZIE-3551 > URL: https://issues.apache.org/jira/browse/OOZIE-3551 > Project: Oozie > Issue Type: Bug >Reporter: Liz Szilagyi >Assignee: Liz Szilagyi >Priority: Major > Attachments: OOZIE-3551-1.patch > > > Task: > Add the following to the spark opts section of the spark action > --conf spark.yarn.security.tokens.hiveserver2.enabled=false --conf > spark.yarn.security.tokens.hivestreaming.enabled=false > Issue: > If Spark is launched form Oozie then we need to turn these 2 and some others > off: > [http://spark.apache.org/docs/latest/running-on-yarn.html#launching-your-application-with-apache-oozie] > and let Oozie obtain the tokens. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Updated] (OOZIE-3551) Configure working defaults for Spark action in Oozie
[ https://issues.apache.org/jira/browse/OOZIE-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Liz Szilagyi updated OOZIE-3551: Attachment: (was: OOZIE-3551-1.diff) > Configure working defaults for Spark action in Oozie > > > Key: OOZIE-3551 > URL: https://issues.apache.org/jira/browse/OOZIE-3551 > Project: Oozie > Issue Type: Bug >Reporter: Liz Szilagyi >Assignee: Liz Szilagyi >Priority: Major > > Task: > Add the following to the spark opts section of the spark action > --conf spark.yarn.security.tokens.hiveserver2.enabled=false --conf > spark.yarn.security.tokens.hivestreaming.enabled=false > Issue: > If Spark is launched form Oozie then we need to turn these 2 and some others > off: > [http://spark.apache.org/docs/latest/running-on-yarn.html#launching-your-application-with-apache-oozie] > and let Oozie obtain the tokens. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (OOZIE-3551) Configure working defaults for Spark action in Oozie
[ https://issues.apache.org/jira/browse/OOZIE-3551?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17039935#comment-17039935 ] Liz Szilagyi commented on OOZIE-3551: - Hi [~gezapeti], When this issue was found, we only identified these two confs which were missing. I've just uploaded a patch covering these two, with unit test modifications. Manual tests confirmed that these work, but it would be nice if you could check it out. Thank you, Liz > Configure working defaults for Spark action in Oozie > > > Key: OOZIE-3551 > URL: https://issues.apache.org/jira/browse/OOZIE-3551 > Project: Oozie > Issue Type: Bug >Reporter: Liz Szilagyi >Assignee: Liz Szilagyi >Priority: Major > Attachments: OOZIE-3551-1.diff > > > Task: > Add the following to the spark opts section of the spark action > --conf spark.yarn.security.tokens.hiveserver2.enabled=false --conf > spark.yarn.security.tokens.hivestreaming.enabled=false > Issue: > If Spark is launched form Oozie then we need to turn these 2 and some others > off: > [http://spark.apache.org/docs/latest/running-on-yarn.html#launching-your-application-with-apache-oozie] > and let Oozie obtain the tokens. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (OOZIE-3363) Hadoop's cleanup of local directory in uber mode causing failures for sqoop actions
[
https://issues.apache.org/jira/browse/OOZIE-3363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Liz Szilagyi reassigned OOZIE-3363:
---
Assignee: (was: Liz Szilagyi)
> Hadoop's cleanup of local directory in uber mode causing failures for sqoop
> actions
> ---
>
> Key: OOZIE-3363
> URL: https://issues.apache.org/jira/browse/OOZIE-3363
> Project: Oozie
> Issue Type: Bug
>Affects Versions: 4.3.0, 5.0.0
>Reporter: Clemens Valiente
>Priority: Blocker
>
> See related task OOZIE-2536 and discussion
> https://issues.apache.org/jira/browse/OOZIE-2536?focusedCommentId=16617206=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16617206
> the same issue cleaning up local directories also affects sqoop jobs that
> create the sqoop.xml file inbetween.
> {code:java}
> 2018-09-15 00:31:09,416 [AsyncDispatcher event handler] INFO
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl - Num completed Tasks: 1
> 2018-09-15 00:31:09,417 [AsyncDispatcher event handler] INFO
> org.apache.hadoop.mapreduce.v2.app.job.impl.JobImpl -
> job_1535972033593_259806Job Transitioned from RUNNING to COMMITTING
> 2018-09-15 00:31:09,419 [CommitterEvent Processor #1] INFO
> org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler - Processing
> the event EventType: JOB_COMMIT
> 2018-09-15 00:31:09,455 [uber-SubtaskRunner] WARN
> org.apache.hadoop.mapred.LocalContainerLauncher - Unable to delete
> unexpected local file/dir .action.xml.crc: insufficient permissions?
> 2018-09-15 00:31:09,455 [uber-SubtaskRunner] WARN
> org.apache.hadoop.mapred.LocalContainerLauncher - Unable to delete
> unexpected local file/dir .action.xml.crc: insufficient permissions?
> 2018-09-15 00:31:09,459 [CommitterEvent Processor #1] FATAL
> org.apache.hadoop.conf.Configuration - error parsing conf sqoop-site.xml
> java.io.FileNotFoundException:
> /appdata/hdfs/v7/yarn/nm/usercache/SEM/appcache/application_1535972033593_259806/container_e100_1535972033593_259806_01_01/sqoop-site.xml
> (No such file or directory)
> at java.io.FileInputStream.open(Native Method)
> at java.io.FileInputStream.(FileInputStream.java:146)
> at java.io.FileInputStream.(FileInputStream.java:101)
> at
> sun.net.www.protocol.file.FileURLConnection.connect(FileURLConnection.java:90)
> at
> sun.net.www.protocol.file.FileURLConnection.getInputStream(FileURLConnection.java:188)
> at org.apache.hadoop.conf.Configuration.parse(Configuration.java:2483)
> at
> org.apache.hadoop.conf.Configuration.loadResource(Configuration.java:2554)
> at
> org.apache.hadoop.conf.Configuration.loadResources(Configuration.java:2507)
> at
> org.apache.hadoop.conf.Configuration.getProps(Configuration.java:2413)
> at org.apache.hadoop.conf.Configuration.get(Configuration.java:984)
> at
> org.apache.hadoop.conf.Configuration.getTrimmed(Configuration.java:1034)
> at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:1254)
> at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:804)
> at
> org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.touchz(CommitterEventHandler.java:268)
> at
> org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.handleJobCommit(CommitterEventHandler.java:282)
> at
> org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler$EventProcessor.run(CommitterEventHandler.java:237)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745){code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
