OOZIE-119: relative path in coord dataset include should throw exception if
given
---------------------------------------------------------------------------------
Key: OOZIE-536
URL: https://issues.apache.org/jira/browse/OOZIE-536
Project: Oozie
Issue Type: Bug
Reporter: Angelo K. Huang
Assignee: Angelo K. Huang
the <include> in datasets definition should use full path, e.g., hdfs://NN/....
when a
relative path is applied, the error is confusing that it referrs to the job
definition rather than dataset, and tries
to get the file relative to user home dir rather than coord app path.
coordinator.xml:
<datasets>
<include>${include_ds_files1}</include>
where include_ds_files1=datasets1.xml.
in 3.0.1
$ oozie job -run -config job.properties
Error: E1001 : E1001: Could not read the coordinator job definition, File does
not exist: /user/strat_ci/datasets1.xml
yoozie-3.0.2.1307495311.N55771
$ oozie job -run -config job.properties
Error: E1001 : E1001: Could not read the coordinator job definition, File does
not exist:
/user/strat_ci/datasets1.xml/coordinator.xml
java.io.FileNotFoundException: File does not exist:
/user/strat_ci/datasets1.xml/coordinator.xml
at
org.apache.hadoop.hdfs.DFSClient$DFSInputStream.openInfo(DFSClient.java:1583)
at
org.apache.hadoop.hdfs.DFSClient$DFSInputStream.<init>(DFSClient.java:1574)
at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:423)
at
org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:187)
at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:400)
at
org.apache.oozie.command.coord.CoordSubmitXCommand.readDefinition(CoordSubmitXCommand.java:880)
at
org.apache.oozie.command.coord.CoordSubmitXCommand.includeOneDSFile(CoordSubmitXCommand.java:807)
at
org.apache.oozie.command.coord.CoordSubmitXCommand.includeDataSets(CoordSubmitXCommand.java:775)
at
org.apache.oozie.command.coord.CoordSubmitXCommand.basicResolveAndIncludeDS(CoordSubmitXCommand.java:398)
at
org.apache.oozie.command.coord.CoordSubmitXCommand.submit(CoordSubmitXCommand.java:209)
at
org.apache.oozie.command.SubmitTransitionXCommand.execute(SubmitTransitionXCommand.java:78)
at
org.apache.oozie.command.SubmitTransitionXCommand.execute(SubmitTransitionXCommand.java:26)
at org.apache.oozie.command.XCommand.call(XCommand.java:257)
at
org.apache.oozie.CoordinatorEngine.submitJob(CoordinatorEngine.java:311)
at
org.apache.oozie.servlet.V1JobsServlet.submitCoordinatorJob(V1JobsServlet.java:197)
at
org.apache.oozie.servlet.V1JobsServlet.submitJob(V1JobsServlet.java:77)
at
org.apache.oozie.servlet.BaseJobsServlet.doPost(BaseJobsServlet.java:92)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:637)
at
org.apache.oozie.servlet.JsonRestServlet.service(JsonRestServlet.java:281)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:717)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at
com.yahoo.oozie.filter.OozieAuthFilter.doFilter(OozieAuthFilter.java:40)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at
org.apache.hadoop.http.authentication.web.AuthenticationProcessingFilter.doFilter(AuthenticationProcessingFilter.java:75)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at yjava.cookie.CookieDataFilter.doFilter(CookieDataFilter.java:371)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at yjava.remote.ip.RemoteIPFilter.doFilter(RemoteIPFilter.java:154)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at
yjava.security.yiv.servlet.InputValidationFilter.doFilter(InputValidationFilter.java:193)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at
yjava.tomcat.valves.YahooConnectionValve.invoke(YahooConnectionValve.java:165)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:298)
at
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:857)
at
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:588)
at
org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
at java.lang.Thread.run(Thread.java:662)
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
