[jira] [Resolved] (GOBBLIN-267) HiveSource creates workunit even when update time is before maxLookBackDays

[Hung Tran (JIRA)]

 [ 
https://issues.apache.org/jira/browse/GOBBLIN-267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hung Tran resolved GOBBLIN-267.
---
Resolution: Fixed

Issue resolved by pull request #2119
[https://github.com/apache/incubator-gobblin/pull/2119]

> HiveSource creates workunit even when update time is before maxLookBackDays
> ---
>
> Key: GOBBLIN-267
> URL: https://issues.apache.org/jira/browse/GOBBLIN-267
> Project: Apache Gobblin
>  Issue Type: Bug
>  Components: misc
>Reporter: Aditya Sharma
>Assignee: Aditya Sharma
>
> org.apache.gobblin.data.management.conversion.hive.source.HiveSource creates 
> workunit if:
> 1) Create time is after maxLookBackDays
> 2) Update time is greater than watermark
> Since there are multiple policies to decide update time, it can happen that 
> create time is greater than update time and hence maxLookBackDays will be 
> redundant.
> HiveSource should check for maxLookBackDays corresponding to update time



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (GOBBLIN-267) HiveSource creates workunit even when update time is before maxLookBackDays

[Aditya Sharma (JIRA)]

Aditya Sharma created GOBBLIN-267:
-

 Summary: HiveSource creates workunit even when update time is 
before maxLookBackDays
 Key: GOBBLIN-267
 URL: https://issues.apache.org/jira/browse/GOBBLIN-267
 Project: Apache Gobblin
  Issue Type: Bug
  Components: misc
Reporter: Aditya Sharma
Assignee: Aditya Sharma


org.apache.gobblin.data.management.conversion.hive.source.HiveSource creates 
workunit if:
1) Create time is after maxLookBackDays
2) Update time is greater than watermark

Since there are multiple policies to decide update time, it can happen that 
create time is greater than update time and hence maxLookBackDays will be 
redundant.

HiveSource should check for maxLookBackDays corresponding to update time



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Re: Podling Report Reminder - October 2017

[Abhishek Tiwari]

Thanks Olivier and Jean.

Regards,
Abhishek


On Mon, Sep 25, 2017 at 11:44 PM, Jean-Baptiste Onofré 
wrote:

> I will try to do it later today.
>
> Regards
> JB
>
> On Sep 26, 2017, 08:41, at 08:41, Olivier Lamy  wrote:
> >Hi
> >I will be off from tomorrow until 7 Oct with very limited (even none)
> >network.
> >I won't be able to send the report neither signed it before the 7th
> >Oct.
> >So if someone can take it I will appreciate :-)
> >
> >Cheers
> >Olivier
> >
> >On 23 September 2017 at 23:11,  wrote:
> >
> >> Dear podling,
> >>
> >> This email was sent by an automated system on behalf of the Apache
> >> Incubator PMC. It is an initial reminder to give you plenty of time
> >to
> >> prepare your quarterly board report.
> >>
> >> The board meeting is scheduled for Wed, 18 October 2017, 10:30 am
> >PDT.
> >> The report for your podling will form a part of the Incubator PMC
> >> report. The Incubator PMC requires your report to be submitted 2
> >weeks
> >> before the board meeting, to allow sufficient time for review and
> >> submission (Wed, October 04).
> >>
> >> Please submit your report with sufficient time to allow the Incubator
> >> PMC, and subsequently board members to review and digest. Again, the
> >> very latest you should submit your report is 2 weeks prior to the
> >board
> >> meeting.
> >>
> >> Thanks,
> >>
> >> The Apache Incubator PMC
> >>
> >> Submitting your Report
> >>
> >> --
> >>
> >> Your report should contain the following:
> >>
> >> *   Your project name
> >> *   A brief description of your project, which assumes no knowledge
> >of
> >> the project or necessarily of its field
> >> *   A list of the three most important issues to address in the move
> >> towards graduation.
> >> *   Any issues that the Incubator PMC or ASF Board might wish/need to
> >be
> >> aware of
> >> *   How has the community developed since the last report
> >> *   How has the project developed since the last report.
> >> *   How does the podling rate their own maturity.
> >>
> >> This should be appended to the Incubator Wiki page at:
> >>
> >> https://wiki.apache.org/incubator/October2017
> >>
> >> Note: This is manually populated. You may need to wait a little
> >before
> >> this page is created from a template.
> >>
> >> Mentors
> >> ---
> >>
> >> Mentors should review reports for their project(s) and sign them off
> >on
> >> the Incubator wiki page. Signing off reports shows that you are
> >> following the project - projects that are not signed may raise alarms
> >> for the Incubator PMC.
> >>
> >> Incubator PMC
> >>
> >
> >
> >
> >--
> >Olivier Lamy
> >http://twitter.com/olamy | http://linkedin.com/in/olamy
>

Re: Podling Report Reminder - October 2017

[Abhishek Tiwari]

Thanks Olivier and Jean.

Regards,
Abhishek

On Mon, Sep 25, 2017 at 11:44 PM, Jean-Baptiste Onofré 
wrote:

> I will try to do it later today.
>
> Regards
> JB
>
> On Sep 26, 2017, 08:41, at 08:41, Olivier Lamy  wrote:
> >Hi
> >I will be off from tomorrow until 7 Oct with very limited (even none)
> >network.
> >I won't be able to send the report neither signed it before the 7th
> >Oct.
> >So if someone can take it I will appreciate :-)
> >
> >Cheers
> >Olivier
> >
> >On 23 September 2017 at 23:11,  wrote:
> >
> >> Dear podling,
> >>
> >> This email was sent by an automated system on behalf of the Apache
> >> Incubator PMC. It is an initial reminder to give you plenty of time
> >to
> >> prepare your quarterly board report.
> >>
> >> The board meeting is scheduled for Wed, 18 October 2017, 10:30 am
> >PDT.
> >> The report for your podling will form a part of the Incubator PMC
> >> report. The Incubator PMC requires your report to be submitted 2
> >weeks
> >> before the board meeting, to allow sufficient time for review and
> >> submission (Wed, October 04).
> >>
> >> Please submit your report with sufficient time to allow the Incubator
> >> PMC, and subsequently board members to review and digest. Again, the
> >> very latest you should submit your report is 2 weeks prior to the
> >board
> >> meeting.
> >>
> >> Thanks,
> >>
> >> The Apache Incubator PMC
> >>
> >> Submitting your Report
> >>
> >> --
> >>
> >> Your report should contain the following:
> >>
> >> *   Your project name
> >> *   A brief description of your project, which assumes no knowledge
> >of
> >> the project or necessarily of its field
> >> *   A list of the three most important issues to address in the move
> >> towards graduation.
> >> *   Any issues that the Incubator PMC or ASF Board might wish/need to
> >be
> >> aware of
> >> *   How has the community developed since the last report
> >> *   How has the project developed since the last report.
> >> *   How does the podling rate their own maturity.
> >>
> >> This should be appended to the Incubator Wiki page at:
> >>
> >> https://wiki.apache.org/incubator/October2017
> >>
> >> Note: This is manually populated. You may need to wait a little
> >before
> >> this page is created from a template.
> >>
> >> Mentors
> >> ---
> >>
> >> Mentors should review reports for their project(s) and sign them off
> >on
> >> the Incubator wiki page. Signing off reports shows that you are
> >> following the project - projects that are not signed may raise alarms
> >> for the Incubator PMC.
> >>
> >> Incubator PMC
> >>
> >
> >
> >
> >--
> >Olivier Lamy
> >http://twitter.com/olamy | http://linkedin.com/in/olamy
>

Re: Podling Report Reminder - October 2017

[Jean-Baptiste Onofré]

I will try to do it later today.

Regards
JB

On Sep 26, 2017, 08:41, at 08:41, Olivier Lamy  wrote:
>Hi
>I will be off from tomorrow until 7 Oct with very limited (even none)
>network.
>I won't be able to send the report neither signed it before the 7th
>Oct.
>So if someone can take it I will appreciate :-)
>
>Cheers
>Olivier
>
>On 23 September 2017 at 23:11,  wrote:
>
>> Dear podling,
>>
>> This email was sent by an automated system on behalf of the Apache
>> Incubator PMC. It is an initial reminder to give you plenty of time
>to
>> prepare your quarterly board report.
>>
>> The board meeting is scheduled for Wed, 18 October 2017, 10:30 am
>PDT.
>> The report for your podling will form a part of the Incubator PMC
>> report. The Incubator PMC requires your report to be submitted 2
>weeks
>> before the board meeting, to allow sufficient time for review and
>> submission (Wed, October 04).
>>
>> Please submit your report with sufficient time to allow the Incubator
>> PMC, and subsequently board members to review and digest. Again, the
>> very latest you should submit your report is 2 weeks prior to the
>board
>> meeting.
>>
>> Thanks,
>>
>> The Apache Incubator PMC
>>
>> Submitting your Report
>>
>> --
>>
>> Your report should contain the following:
>>
>> *   Your project name
>> *   A brief description of your project, which assumes no knowledge
>of
>> the project or necessarily of its field
>> *   A list of the three most important issues to address in the move
>> towards graduation.
>> *   Any issues that the Incubator PMC or ASF Board might wish/need to
>be
>> aware of
>> *   How has the community developed since the last report
>> *   How has the project developed since the last report.
>> *   How does the podling rate their own maturity.
>>
>> This should be appended to the Incubator Wiki page at:
>>
>> https://wiki.apache.org/incubator/October2017
>>
>> Note: This is manually populated. You may need to wait a little
>before
>> this page is created from a template.
>>
>> Mentors
>> ---
>>
>> Mentors should review reports for their project(s) and sign them off
>on
>> the Incubator wiki page. Signing off reports shows that you are
>> following the project - projects that are not signed may raise alarms
>> for the Incubator PMC.
>>
>> Incubator PMC
>>
>
>
>
>--
>Olivier Lamy
>http://twitter.com/olamy | http://linkedin.com/in/olamy