[jira] [Resolved] (GOBBLIN-447) Always mark custom tasks as complete even if they throw exception in run()

2018-03-26 Thread Hung Tran (JIRA)

 [ 
https://issues.apache.org/jira/browse/GOBBLIN-447?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Hung Tran resolved GOBBLIN-447.
---
   Resolution: Fixed
Fix Version/s: 0.13.0

Issue resolved by pull request #2313
[https://github.com/apache/incubator-gobblin/pull/2313]

> Always mark custom tasks as complete even if they throw exception in run()
> --
>
> Key: GOBBLIN-447
> URL: https://issues.apache.org/jira/browse/GOBBLIN-447
> Project: Apache Gobblin
>  Issue Type: Bug
>Reporter: Hung Tran
>Priority: Major
> Fix For: 0.13.0
>
>
> If a custom task throws an exception in the run() method, it was not getting 
> marked as complete which would result in the job hanging. Change the task 
> wrapper to mark tasks complete in a finally block.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (GOBBLIN-447) Always mark custom tasks as complete even if they throw exception in run()

2018-03-26 Thread Hung Tran (JIRA)
Hung Tran created GOBBLIN-447:
-

 Summary: Always mark custom tasks as complete even if they throw 
exception in run()
 Key: GOBBLIN-447
 URL: https://issues.apache.org/jira/browse/GOBBLIN-447
 Project: Apache Gobblin
  Issue Type: Bug
Reporter: Hung Tran


If a custom task throws an exception in the run() method, it was not getting 
marked as complete which would result in the job hanging. Change the task 
wrapper to mark tasks complete in a finally block.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Created] (GOBBLIN-445) Add task output directory for staging compaction result

2018-03-26 Thread Kuai Yu (JIRA)
Kuai Yu created GOBBLIN-445:
---

 Summary: Add task output directory for staging compaction result
 Key: GOBBLIN-445
 URL: https://issues.apache.org/jira/browse/GOBBLIN-445
 Project: Apache Gobblin
  Issue Type: Improvement
Reporter: Kuai Yu
Assignee: Kuai Yu






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[jira] [Commented] (GOBBLIN-385) Add Spark execution mode for Gobblin

2018-03-26 Thread Vinoth Chandar (JIRA)

[ 
https://issues.apache.org/jira/browse/GOBBLIN-385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16413933#comment-16413933
 ] 

Vinoth Chandar commented on GOBBLIN-385:


gtk :)  

I have started scoping. Will get something to you by EoW

> Add Spark execution mode for Gobblin
> 
>
> Key: GOBBLIN-385
> URL: https://issues.apache.org/jira/browse/GOBBLIN-385
> Project: Apache Gobblin
>  Issue Type: New Feature
>  Components: gobblin-cluster
>Reporter: Vinoth Chandar
>Assignee: Hung Tran
>Priority: Major
>
> If there is interest, happy to contribute spark execution mode and eventually 
> add support for ingesting data into [https://github.com/uber/hudi] format..
> Please provide some guidance



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


Re: [VOTE] Apache Gobblin 0.12.0 release RC2

2018-03-26 Thread Abhishek Tiwari
Thanks everyone.

The vote has passed with five +1 binding votes, and no -1s or 0s.

Binding +1s: Issac Buenrostro, Hung Tran, Shirshanka Das, Olivier Lamy,
Abhishek Tiwari

I will now call for vote on Incubator general mailing list.

Regards,
Abhishek

PS: Hung's vote does'nt show in this trail, but he also voted:
https://www.mail-archive.com/dev@gobblin.incubator.apache.org/msg01769.html

On Mon, Mar 26, 2018 at 3:47 AM, Olivier Lamy  wrote:

> +1
>
>
>
> On Fri, 23 Mar 2018 at 21:05, Abhishek Tiwari  wrote:
>
> > Hi all,
> >
> > I'd like to call a vote to release Apache Gobblin 0.12.0 (Incubating).
> >
> > The feedback from previous release candidates has been addressed:
> > RC0 thread: https://www.mail-archive.com/general@incubator.apache.org/
> > msg62151.html
> >  >
> > RC0 resolution: LICENSE and NOTICE files have been updated (tracked by
> > GOBBLIN-431 )
> > RC1 thread:
> > https://www.mail-archive.com/dev@gobblin.incubator.apache.or
> g/msg01733.html
> > RC1 resolution: gradlew scripts have been included in the source
> > distribution, and the steps for building the distribution has been added
> to
> > README (including the way to obtain gradlew jar)
> >
> > The new source release candidate RC2 has been created. It can be
> downloaded
> > here:
> >
> > https://dist.apache.org/repos/dist/dev/incubator/gobblin/apa
> che-gobblin-incubating-0.12.0-rc2/
> >
> > The artifacts (i.e. JARs) corresponding to this release candidate can be
> > found here:
> >
> > https://repository.apache.org/content/repositories/orgapachegobblin-1002
> >
> > This has been signed with PGP key 234E3FE3, corresponding to
> > a...@apache.org, which is included in the repository's KEYS file.  This
> > key can be found on keyservers, such as:
> >
> > *http://pgp.mit.edu/pks/lookup?op=get=0x234E3FE3
> > *
> >
> > It is also listed here:
> >
> > https://people.apache.org/keys/committer/abti.asc
> >
> > The release candidate has been tagged with release-0.12.0-rc2.
> > I've also created a branch 0.12.0.
> >
> > For reference, here is a list of all closed JIRAs tagged with 0.12.0:
> >
> > https://issues.apache.org/jira/issues/?jql=project%20%3D%
> > 20GOBBLIN%20AND%20fixVersion%20%3D%200.12.0%20AND%20status%
> > 20in%20(Closed%2C%20Resolved)%20ORDER%20BY%20updatedDate%
> > 20DESC%2C%20createdDate%20DESC%2C%20status%20DESC%2C%20priority%20DESC
> >
> > For a summary of the changes in this release, see:
> >
> > https://github.com/apache/incubator-gobblin/blob/0.12.0/CHANGELOG.md
> >
> > Please review and vote.  The vote will be open for 72 hours (ends on
> > Monday, 26 March 2018, 0:00 AM PST).
> >
> > [ ] +1 approve
> > [ ] +0 no opinion
> > [ ] -1 disapprove (and reason why)
> >
> > My vote: +1
> >
> > Thanks,
> > Abhishek
> >
>
>
> --
> Olivier Lamy
> http://twitter.com/olamy | http://linkedin.com/in/olamy
>


Re: [VOTE] Apache Gobblin 0.12.0 release RC2

2018-03-26 Thread Olivier Lamy
+1



On Fri, 23 Mar 2018 at 21:05, Abhishek Tiwari  wrote:

> Hi all,
>
> I'd like to call a vote to release Apache Gobblin 0.12.0 (Incubating).
>
> The feedback from previous release candidates has been addressed:
> RC0 thread: https://www.mail-archive.com/general@incubator.apache.org/
> msg62151.html
> 
> RC0 resolution: LICENSE and NOTICE files have been updated (tracked by
> GOBBLIN-431 )
> RC1 thread:
> https://www.mail-archive.com/dev@gobblin.incubator.apache.org/msg01733.html
> RC1 resolution: gradlew scripts have been included in the source
> distribution, and the steps for building the distribution has been added to
> README (including the way to obtain gradlew jar)
>
> The new source release candidate RC2 has been created. It can be downloaded
> here:
>
> https://dist.apache.org/repos/dist/dev/incubator/gobblin/apache-gobblin-incubating-0.12.0-rc2/
>
> The artifacts (i.e. JARs) corresponding to this release candidate can be
> found here:
>
> https://repository.apache.org/content/repositories/orgapachegobblin-1002
>
> This has been signed with PGP key 234E3FE3, corresponding to
> a...@apache.org, which is included in the repository's KEYS file.  This
> key can be found on keyservers, such as:
>
> *http://pgp.mit.edu/pks/lookup?op=get=0x234E3FE3
> *
>
> It is also listed here:
>
> https://people.apache.org/keys/committer/abti.asc
>
> The release candidate has been tagged with release-0.12.0-rc2.
> I've also created a branch 0.12.0.
>
> For reference, here is a list of all closed JIRAs tagged with 0.12.0:
>
> https://issues.apache.org/jira/issues/?jql=project%20%3D%
> 20GOBBLIN%20AND%20fixVersion%20%3D%200.12.0%20AND%20status%
> 20in%20(Closed%2C%20Resolved)%20ORDER%20BY%20updatedDate%
> 20DESC%2C%20createdDate%20DESC%2C%20status%20DESC%2C%20priority%20DESC
>
> For a summary of the changes in this release, see:
>
> https://github.com/apache/incubator-gobblin/blob/0.12.0/CHANGELOG.md
>
> Please review and vote.  The vote will be open for 72 hours (ends on
> Monday, 26 March 2018, 0:00 AM PST).
>
> [ ] +1 approve
> [ ] +0 no opinion
> [ ] -1 disapprove (and reason why)
>
> My vote: +1
>
> Thanks,
> Abhishek
>


-- 
Olivier Lamy
http://twitter.com/olamy | http://linkedin.com/in/olamy