[jira] [Commented] (OOZIE-3187) coordinator: EL function to get coordinator information: last successful run, last run status, ...

2018-03-02 Thread Ruben Van Wanzeele (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-3187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16383575#comment-16383575
 ] 

Ruben Van Wanzeele commented on OOZIE-3187:
---

Hi [~andras.piros],

Thanks for your quick reply.

The job I'm currently scheduling with the coordinator runs our daily batch job 
on our big data environment.

This is an incremental process, but whenever if fails we have the option to 
rerun it as from a certain date.

It would be great if the default parameters we could pass the last successful 
run date as a default parameter for this job.

 

Lets say for some reason the oozie coordinator didn't function properly on a 
certain day, that it picks up those changes on the next day.

If I could send that information as a parameter, we can actually do things like 
this.

 

I hope this scenario is clear to you.

> coordinator: EL function to get coordinator information: last successful run, 
> last run status, ...
> --
>
> Key: OOZIE-3187
> URL: https://issues.apache.org/jira/browse/OOZIE-3187
> Project: Oozie
>  Issue Type: New Feature
>  Components: coordinator
>Affects Versions: 4.2.0
>Reporter: Ruben Van Wanzeele
>Priority: Major
>
> It would be handy if I could retrieve the last successful run of my 
> coordinator job and pass that as a property to my workflow.
> I tried to manage this, but there is no such function. Currently, you cannot 
> retrieve any information about the coordinator job. I could think of other 
> useful info such as:
>  * status last run
>  * errorcode last run
>  * amount of running instances
>  * ...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (OOZIE-3187) coordinator: EL function to get coordinator information: last successful run, last run status, ...

2018-03-01 Thread Andras Piros (JIRA)

[ 
https://issues.apache.org/jira/browse/OOZIE-3187?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16382389#comment-16382389
 ] 

Andras Piros commented on OOZIE-3187:
-

[~rubenvw] thanks for the idea! Can you please elaborate more on the use case 
where a workflow job would need information about properties of the last 
successful *coordinator* job details?

I could see more value in knowing in a workflow job that was triggered by the 
coordinator the status / error message of the previous / last *workflow* job 
triggered by the same coordinator, as:
* coordinator jobs / applications lifecycle is totally different from workflow 
jobs / applications lifecycle
* by design, workflows shouldn't know about parent coordinators (if any), as 
coordinators shouldn't know about parent bundles (if any)

> coordinator: EL function to get coordinator information: last successful run, 
> last run status, ...
> --
>
> Key: OOZIE-3187
> URL: https://issues.apache.org/jira/browse/OOZIE-3187
> Project: Oozie
>  Issue Type: New Feature
>  Components: coordinator
>Affects Versions: 4.2.0
>Reporter: Ruben Van Wanzeele
>Priority: Major
>
> It would be handy if I could retrieve the last successful run of my 
> coordinator job and pass that as a property to my workflow.
> I tried to manage this, but there is no such function. Currently, you cannot 
> retrieve any information about the coordinator job. I could think of other 
> useful info such as:
>  * status last run
>  * errorcode last run
>  * amount of running instances
>  * ...



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)