[
https://issues.apache.org/jira/browse/OOZIE-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Christoph Körner updated OOZIE-2772:
------------------------------------
Description:
Running a simple Oozie Job with a Hive 2 action and a missing init script will
cause an error in beeline. However, the Oozie job is not picking up the error
and reporting status SUCCEEDED in the web UI. Interestingly the launcher MR job
creates a log file in the local appcache directory; however this error log is
not visible in the yarn logs neither and gets deleted with the appcache
automatically.
I tested it with the following statement (the complete workflow can be found on
Github:
https://github.com/chaosmail/oozie-bugs/tree/master/simple-hive-init/simple-hive-init-wf).
Init Script:
{code:title=init.hive|borderStyle=solid}
CREATE TEMPORARY MACRO ADD_NUMBERS(a INT, b INT)
a + b;
{code}
Query Script:
{code:title=query.hive|borderStyle=solid}
SELECT ADD_NUMBERS(1,2) FROM tbl LIMIT 1;
{code}
The hive error log in the local appcache directory.
{code:borderStyle=solid}
$ more
appcache/application_1480609892100_0276/container_e55_1480609892100_0276_01_000002/hive2-oozie-job_1480609892100_0276.log
Connecting to jdbc:hive2://localhost:10000/default
Connected to: Apache Hive (version 1.2.1000.2.4.0.0-169)
Driver: Hive JDBC (version 1.2.1000.2.4.0.0-169)
Transaction isolation: TRANSACTION_REPEATABLE_READ
Running init script init.hive
init.hive (No such file or directory)
Closing: 0: jdbc:hive2://localhost:10000/default
{code}
Oozie reports job succedded.
{code:borderStyle=solid}
$ oozie job -oozie http://localhost:11000/oozie -info
0000039-170111125800146-oozie-oozi-W
Job ID : 0000039-170111125800146-oozie-oozi-W
------------------------------------------------------------------------------------------------------------------------------------
Workflow Name : test-wf
App Path : /user/koernerc/apps/simple-hive-init-wf
Status : SUCCEEDED
Run : 0
User : root
Group : -
Created : 2017-01-13 09:56 GMT
Started : 2017-01-13 09:56 GMT
Last Modified : 2017-01-13 09:56 GMT
Ended : 2017-01-13 09:56 GMT
CoordAction ID: -
Actions
------------------------------------------------------------------------------------------------------------------------------------
ID
Status Ext ID Ext Status Err Code
------------------------------------------------------------------------------------------------------------------------------------
0000039-170111125800146-oozie-oozi-W@:start:
OK - OK -
------------------------------------------------------------------------------------------------------------------------------------
0000039-170111125800146-oozie-oozi-W@test-action
OK job_1480609892100_0276 SUCCEEDED -
------------------------------------------------------------------------------------------------------------------------------------
0000039-170111125800146-oozie-oozi-W@end
OK - OK -
------------------------------------------------------------------------------------------------------------------------------------
{code}
was:
Running a simple Oozie Job with a Hive 2 action and a missing init script will
cause an error in beeline. However, the Oozie job is not picking up the error
and reporting status SUCCEEDED in the web UI. Interestingly the launcher MR job
creates a log file in the local appcache directory; however this error log is
not visible in the yarn logs neither and gets deleted with the appcache
automatically.
I tested it with the following statement (the complete workflow can be found on
Github:
https://github.com/chaosmail/oozie-bugs/tree/master/simple-hive-init/simple-hive-init-wf).
Init Script:
{code:title=init.hive|borderStyle=solid}
CREATE TEMPORARY MACRO ADD_NUMBERS(a INT, b INT) a + b;
{code}
Query Script:
{code:title=query.hive|borderStyle=solid}
SELECT ADD_NUMBERS(1,2) FROM tbl LIMIT 1;
{code}
The hive error log in the local appcache directory.
{code:borderStyle=solid}
$ more
appcache/application_1480609892100_0276/container_e55_1480609892100_0276_01_000002/hive2-oozie-job_1480609892100_0276.log
Connecting to jdbc:hive2://localhost:10000/default
Connected to: Apache Hive (version 1.2.1000.2.4.0.0-169)
Driver: Hive JDBC (version 1.2.1000.2.4.0.0-169)
Transaction isolation: TRANSACTION_REPEATABLE_READ
Running init script init.hive
init.hive (No such file or directory)
Closing: 0: jdbc:hive2://localhost:10000/default
{code}
Oozie reports job succedded.
{code:borderStyle=solid}
$ oozie job -oozie http://localhost:11000/oozie -info
0000039-170111125800146-oozie-oozi-W
Job ID : 0000039-170111125800146-oozie-oozi-W
------------------------------------------------------------------------------------------------------------------------------------
Workflow Name : test-wf
App Path : /user/koernerc/apps/simple-hive-init-wf
Status : SUCCEEDED
Run : 0
User : root
Group : -
Created : 2017-01-13 09:56 GMT
Started : 2017-01-13 09:56 GMT
Last Modified : 2017-01-13 09:56 GMT
Ended : 2017-01-13 09:56 GMT
CoordAction ID: -
Actions
------------------------------------------------------------------------------------------------------------------------------------
ID
Status Ext ID Ext Status Err Code
------------------------------------------------------------------------------------------------------------------------------------
0000039-170111125800146-oozie-oozi-W@:start:
OK - OK -
------------------------------------------------------------------------------------------------------------------------------------
0000039-170111125800146-oozie-oozi-W@test-action
OK job_1480609892100_0276 SUCCEEDED -
------------------------------------------------------------------------------------------------------------------------------------
0000039-170111125800146-oozie-oozi-W@end
OK - OK -
------------------------------------------------------------------------------------------------------------------------------------
{code}
> Oozie job with Hive 2 action finishes with SUCCEEDED despite beeline error
> --------------------------------------------------------------------------
>
> Key: OOZIE-2772
> URL: https://issues.apache.org/jira/browse/OOZIE-2772
> Project: Oozie
> Issue Type: Bug
> Components: action
> Affects Versions: 4.2.0, 4.3.0
> Environment: HDP 2.4, Beeline version 1.2.1000.2.4.0.0-169
> Reporter: Christoph Körner
>
> Running a simple Oozie Job with a Hive 2 action and a missing init script
> will cause an error in beeline. However, the Oozie job is not picking up the
> error and reporting status SUCCEEDED in the web UI. Interestingly the
> launcher MR job creates a log file in the local appcache directory; however
> this error log is not visible in the yarn logs neither and gets deleted with
> the appcache automatically.
> I tested it with the following statement (the complete workflow can be found
> on Github:
> https://github.com/chaosmail/oozie-bugs/tree/master/simple-hive-init/simple-hive-init-wf).
> Init Script:
> {code:title=init.hive|borderStyle=solid}
> CREATE TEMPORARY MACRO ADD_NUMBERS(a INT, b INT)
> a + b;
> {code}
> Query Script:
> {code:title=query.hive|borderStyle=solid}
> SELECT ADD_NUMBERS(1,2) FROM tbl LIMIT 1;
> {code}
> The hive error log in the local appcache directory.
> {code:borderStyle=solid}
> $ more
> appcache/application_1480609892100_0276/container_e55_1480609892100_0276_01_000002/hive2-oozie-job_1480609892100_0276.log
> Connecting to jdbc:hive2://localhost:10000/default
> Connected to: Apache Hive (version 1.2.1000.2.4.0.0-169)
> Driver: Hive JDBC (version 1.2.1000.2.4.0.0-169)
> Transaction isolation: TRANSACTION_REPEATABLE_READ
> Running init script init.hive
> init.hive (No such file or directory)
> Closing: 0: jdbc:hive2://localhost:10000/default
> {code}
> Oozie reports job succedded.
> {code:borderStyle=solid}
> $ oozie job -oozie http://localhost:11000/oozie -info
> 0000039-170111125800146-oozie-oozi-W
> Job ID : 0000039-170111125800146-oozie-oozi-W
> ------------------------------------------------------------------------------------------------------------------------------------
> Workflow Name : test-wf
> App Path : /user/koernerc/apps/simple-hive-init-wf
> Status : SUCCEEDED
> Run : 0
> User : root
> Group : -
> Created : 2017-01-13 09:56 GMT
> Started : 2017-01-13 09:56 GMT
> Last Modified : 2017-01-13 09:56 GMT
> Ended : 2017-01-13 09:56 GMT
> CoordAction ID: -
> Actions
> ------------------------------------------------------------------------------------------------------------------------------------
> ID
> Status Ext ID Ext Status Err Code
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000039-170111125800146-oozie-oozi-W@:start:
> OK - OK -
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000039-170111125800146-oozie-oozi-W@test-action
> OK job_1480609892100_0276 SUCCEEDED -
> ------------------------------------------------------------------------------------------------------------------------------------
> 0000039-170111125800146-oozie-oozi-W@end
> OK - OK -
> ------------------------------------------------------------------------------------------------------------------------------------
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
