Gobblin Slide

Hi Gobblin Team, is there a presentation that talk about the production deployment of Gobblin at some organizations? Also would you be able to share any deployment details of Gobblin @ LinkedIn and the use-cases it is currently handling at which scale ? Thanks Jayesh

Re: Gobblin on Yarn ?

Hi All, What would be the most stable mode in gobblin to run on production ? cluster ( master + worker ) or standalone or any other ? what is the mode you are running on prod ? can u guys pls share ? Thanks Jay On Wed, Feb 27, 2019 at 6:16 PM Jay Sen wrote: > Hi, > > anybody runnin

Re: Gobblin on Yarn ?

int you in > the right direction. > > Best, > Sudarshan > -- > *From:* Jay Sen > *Sent:* Sunday, March 31, 2019 7:07 PM > *To:* dev@gobblin.incubator.apache.org > *Subject:* Re: Gobblin on Yarn ? > > Hi All, > > What would be the most stable m

Re: Gobblin on Yarn ?

to SUCCESSFUL. > > Thanks, > Sudarshan > > > -- > *From:* Jay Sen > *Sent:* Tuesday, April 2, 2019 8:02 PM > *To:* Sudarshan Vasudevan; dev@gobblin.incubator.apache.org > *Subject:* Re: Gobblin on Yarn ? > > Thanks Sudarshan for sha

Job Management

Hi, I see gobblin creates jobs and tasks and put into zookeeper for worker nodes to pickup and process. ( not sure if this only applies to cluster mode or all modes ) In case of job failures, how one suppose to restart, ignore or skip the rest of the job or even disable it? is there an API for

writer and publisher

Hi Sudarshan, had couple of questions, thought you might help me figure it out. 1. How gobblin can integrate with schema registry and how it support schema evolution ? 2. based on class info, is there a way to remove or mask the column ? 3. how about encryption, is that something, connector has

one gobblin cluster to another gobblin cluster movement

Hi Gobblin Devs, is there a way to do data movement between Gobblin clusters to support read/write of data across data centers or security zones? so that firewall/encryption and other tight measures only requires between Gobblin clusters and not from/to all source/targets ? Thanks Jay

Gobblin at ApacheCon ?

Hi Guys, Lets present Apache Gobblin at the ApacheCon. I would be interested in presenting/co-presenting PayPal's use-case. @PMCs, Please share your thoughts. Thanks Jay

Fwd: JobConfigurationManager ?

-- Forwarded message - From: Jay Sen Date: Thu, Feb 28, 2019 at 12:06 AM Subject: JobConfigurationManager ? To: Hi Dev Team, just wanted to confirm that there is no scheduled local job file configuration manager that will periodically check the job conf path for file updates/addition. I only

Gobblin on Yarn ?

Hi, anybody running Gobblin on yarn mode in production or even in dev environment ? can u share pls the experience? looking for some data points on how it would be beneficial over standalone. Thanks Jay

JobConfigurationManager ?

Hi Dev Team, just wanted to confirm that there is no scheduled local job file configuration manager that will periodically check the job conf path for file updates/addition. I only see scheduled and streaming job config manager for kafka only. does LinkedIn store the job config in kafka from

Re: fs.uri config not working with hadoop installed locally

> you > would need to add the scheme. > > Hung. > > On Fri, Apr 12, 2019 at 5:39 PM Jay Sen wrote: > Hi Dev Team, > > I am seeing that even though fs.uri="file:///" it gets the hdfs > FileSystem probably because i have HADOOP_HOME is set and hadoop config is

Re: Undelivered Mail Returned to Sender

Tiwari wrote: > Did you have to send it twice? because your email did go through. > > Regards, > Abhishek > > On Tue, Apr 16, 2019 at 8:18 PM Jay Sen wrote: > > > just FYI, today I got following msg while posting msg to dev channel, > > > > -- For

Fwd: Undelivered Mail Returned to Sender

. The mail system (expanded from ): unable to look up host spamc1-us-west.apache.org: Name or service not known -- Forwarded message -- From: Jay Sen To: dev@gobblin.incubator.apache.org, Abhishek Tiwari Cc: Bcc: Date: Tue, 16 Apr 2019 19:50:03 -0700 Subject: Re: Gobblin

GOBBLIN-707 Review

Hi Issac, Lei & Dev Team, GOBBLIN-707 is all about refactoring the gobblin scripts to make it better. I have added detailed description in the jira ticket. Here is the Git PR: https://github.com/apache/incubator-gobblin/pull/2578 where we had

fs.uri config not working with hadoop installed locally

Hi Dev Team, I am seeing that even though fs.uri="file:///" it gets the hdfs FileSystem probably because i have HADOOP_HOME is set and hadoop config is getting picked up. is that right or I m missing something here ? for ex: this line this.jobConfDirFileSystem =

Fwd: ApacheCon North America 2019: Proposal accepted!

accepted! To: Jay Sen Dear Jay Sen, Congratulations! We are pleased to tell you that your talk, "Data Movement & Integration at PayPal & LinkedIn using Apache Gobblin” has been accepted for ApacheCon North America 2019. (If you submitted additional proposals, you will receive separate

Re: ApacheCon North America 2019: Proposal accepted!

; > > > Wow, awesome, congrats! > > > > > > On 2019. Jun 6., Thu at 19:08, Abhishek Tiwari > wrote: > > > > > > > Congrats! Thats fabulous news. > > > > > > > > Abhishek > > > > > > > > On Thu, Jun 6,

proposal: GIP 2: Gobblin module re-arrange

Hi Guys, Please take a look at the proposal and please share your thoughts and comments. https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=119547565 Thanks Jay

Gobblin properties

Hi Guys, I noticed that the property usage and definition is bit confusing, Ex; property to define path where all job configurations (.pull files) are placed. following are all ways for the same: "job.config.path" "jobconf.dir" "jobconf.fullyQualifiedPath"

Re: GOBBLIN-707 Review

bumping this up again On Thu, May 2, 2019 at 4:02 PM Jay Sen wrote: > Hi Issac, > > do you have sometime to continue reviewing this PR? If not, can u pls > suggest who can help me here? > It has grown bigger PR and hard to manage to keep in sync with other > changes

Hive source is file based extractor ?

Hi Gobblin Team, I notice that to run hive to hive copy, even when job config mentions source and target hive metastore details, it does not work until you explicitly specify source.filebased.fs.uri ( for source) and writer.fs.uri (for target ) to point to hdfs:// the above are File Extractor

Re: Gobblin for Google Season of Docs 2019

did anybody get chance to look at this? do anybody think we might have capacity to leverage this opportunity? - Jay On Thu, Apr 18, 2019 at 4:26 PM Jay Sen wrote: > Hello Everyone > > Google Season of Docs is here and Apache Gobblin can greatly benefit from > this progra

Gobblin for Google Season of Docs 2019

Hello Everyone Google Season of Docs is here and Apache Gobblin can greatly benefit from this program. https://developers.google.com/season-of-docs/docs/get-started/ It is the program that brings open source projects and technical writers together. It is similar to Google Summer of Code but for

Re: Gobblin at ApacheCon ?

oth. > > Abhishek > > On Wed, Apr 17, 2019 at 6:00 PM Jay Sen wrote: > >> Hi Abhishek and LinkedIn Team, >> >> The login is working now and have added the draft proposal, >> can u please send me information on the presenter from LinkedIn side and >&

Re: GOBBLIN-707 Review

Hi, Did anybody got chance to look at this? Should we do online session to go over the PR changes, to make it bit easier, since its long PR. Thanks Jay On Fri, Apr 12, 2019 at 5:29 PM Jay Sen wrote: > Hi Issac, Lei & Dev Team, > > GOBBLIN-707 <https://issues.apache.org/jira/br

MR mode wikipedia example fails

Hi Dev Team, The PullFromWikipedia example fails on Gobblin MR mode. the issue I have found so far is that even after the MR job completes successfully and sseen by gobblin, its explicitly marking it as FAILED due to missing "workunit.working.state" in WorkUnitState ( at SafeDatasetCommit #

Gobblin config work.dir or workDir ?

Hi, I see there are 2 config that sounds similar, but one is parent and other represent the sub directory. is that right? should that be only one config and other can be derived? *gobblin.cluster.work.dir* - represent working directory for Gobblin - there are lot of derived directories from this

StreamSources

while launching the job we check if the source is streaming source or regular(batch). if (source instanceof WorkUnitStreamSource) { workUnitStream = ((WorkUnitStreamSource) source).getWorkunitStream(jobState); } else { workUnitStream = new

Re: Gobblin at ApacheCon ?

Hi Sudarshan, Hung, just FYI, The deadline for submission ends in 19 days. sooner would be better. pls feel free to email me outside of this thread for "bio" and ideas on submission. Thanks Jay On Thu, Apr 18, 2019 at 7:56 PM Jay Sen wrote: > Sure, > Hung, Sudarshan, Can you

Data Lineage in Gobblin

Hi, I see there is a concept of gathering and storing lineage info into WorkStates, but i cant find how one can use the lineage info from the stored state. Can someone please shade more light on the overall lineage feature? Thanks Jay

Re: proposal: GIP 2: Gobblin module re-arrange

Hi Guys, Tanks for some comments. can we target this for 0.15 ? 0.15 release can have some major changes, with this and GOBBLIN-707. what do you guys think ? Thanks Jay On Wed, Jun 19, 2019 at 11:19 PM Jay Sen wrote: > Hi Guys, > > Please take a look at the proposal and please s

dev channel email reply issue

Hi Dev Team, I just wanted to check if anybody has experienced issues receiving email reply on dev channel. some of my email sent to dev channel, does not receive reply in some cases, this is not an issue over other apache project emails. for example: this email ( subject: Read locality on

Re: dev channel email reply issue

Hi Hung, would you pls share what was the issue ? btw, i didnt got following reply but grabbed it from markmail. Hi Jay, I got Kuai's reply. I have had this issue too with my messages not being received. Hung. Thanks Jay On Tue, Aug 13, 2019 at 11:29 AM Jay Sen

Re: Read locality on gobblin jobs

at 5:25 PM Jay Sen wrote: > Hi Dev Team, > > when gobblin runs on cluster mode or MR mode, if the job requires to reads > data from the hadoop filesystem which is local, i.e on the same gobblin > cluster, does gobblin or Helix figures out the data locality automatically > ( as

Read locality on gobblin jobs

Hi Dev Team, when gobblin runs on cluster mode or MR mode, if the job requires to reads data from the hadoop filesystem which is local, i.e on the same gobblin cluster, does gobblin or Helix figures out the data locality automatically ( as in typical MR job ) ? I doubt if this is the case, but

Re: MR mode wikipedia example fails

missed to mention that i used Hadoop 2.7.7 for this, wonder what version LinkedIn is using. THanks On Sun, Jul 14, 2019 at 6:09 PM Jay Sen wrote: > Hi Dev Team, > > The PullFromWikipedia example fails on Gobblin MR mode. > > the issue I have found so far is that even after the M

Re: data encryption while in transit

Ping On Mon, Nov 18, 2019 at 3:08 PM Jay Sen wrote: > Hi Gobblin dev team, > > I am looking at a way to encrypt the data traffic or secure the overall > connection while reading data from hadoop for the Gobblin distcp job. > > I see currently Gobblin only support encryp

data encryption while in transit

Hi Gobblin dev team, I am looking at a way to encrypt the data traffic or secure the overall connection while reading data from hadoop for the Gobblin distcp job. I see currently Gobblin only support encryption while writing, do anybody has idea on how can this be achieved with Gobblin or a

regarding GOBBLIN-926

Hi Dev Team, I face many issues because of inconsistencies between how Gobblin treats the configurations. so I have created this issue to use HOCON consistently, and I want to know if this make sense before i go ahead and make all changes. please take a look. (GOBBLIN-926

Fwd: Call for presentations for ApacheCon North America 2020 now open

Hello Dev Team, The call for presentation is open, pls check it out. Its good to see "*Gobblin/Big Data Integration*" track in ApacheCon because of our last year presentation ! folks from PayPal are planning to present prod ready data pipeline that we are working on this year. besides this, I

Re: [GSoC] Google Summer of code

Here is the official GSoC page: https://summerofcode.withgoogle.com On Thu, Jan 16, 2020 at 10:48 AM Jay Sen wrote: > Hello Gobblin community, > > The GSoC ( Google Summer of Code ) has been announced for this year > already and we can provide opportunities for students and in

[GSoC] Google Summer of code

Hello Gobblin community, The GSoC ( Google Summer of Code ) has been announced for this year already and we can provide opportunities for students and interns to get engaged in Gobblin development. we would need committers and mentors to start thinking about what project/task the new developer

Re: [ANNOUNCE] New committer: Kuai Yu

Congrats Kuai ! On Thu, Jan 9, 2020 at 5:53 PM Zhixiong Chen wrote: > Congrats Kuai! > > Zhixiong > -- > *From:* Abhishek Tiwari > *Sent:* Thursday, January 9, 2020 5:50 PM > *To:* u...@gobblin.incubator.apache.org > > *Cc:* dev@gobblin.incubator.apache.org ; >

open PRs & GIP

Hi Dev Team, There are several open PR that might run into merge conflict, so while its easy and reviewed, can we pls merge them? Also there are some GIP proposals I have open over the wiki, it would be good to get some review on those. Happy WFH, Stay Healthy ! - Jay

Hadoop 3 support

Hi Dev Team, What do you guys think about support for Hadoop 3 to run the Gobblin on ? Thanks Jay

Re: Hadoop 3 support

gt; > Thanks, > Tamas > > On Tue, 24 Mar 2020 at 20:28, Jay Sen wrote: > > > Hi Dev Team, > > > > What do you guys think about support for Hadoop 3 to run the Gobblin on ? > > > > Thanks > > Jay > > >

Open PRs

Hi Gobblin Dev Team, There are many open PRs ( about 80+), can someone help merge those? many of them are reviewed and waiting to be merged. I think it would be nice to include those in next 0.15 release. Thanks Jay

Re: [DISCUSS] Apache Gobblin 0.15.0 release

+1 ( Non-Binding ) On Fri, Jun 12, 2020 at 10:00 AM Owen O'Malley wrote: > +1 > > On Thu, Jun 11, 2020 at 11:29 PM Tamás Németh wrote: > > > +1 > > > > Tamas > > > > On Fri, 12 Jun 2020 at 07:45, Hung Tran > > wrote: > > > > > +1. > > > > > > Hung. > > > > > >

[jira] [Updated] (GOBBLIN-719) gobblin-docs has invalid git links

[ https://issues.apache.org/jira/browse/GOBBLIN-719?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-719: Description: gobblin docs had some invalid links pointing not only LinkedIn repo but also old location

[jira] [Created] (GOBBLIN-719) gobblin-docs has invalid git links

Jay Sen created GOBBLIN-719: --- Summary: gobblin-docs has invalid git links Key: GOBBLIN-719 URL: https://issues.apache.org/jira/browse/GOBBLIN-719 Project: Apache Gobblin Issue Type: Bug

[jira] [Updated] (GOBBLIN-711) stopping the master in cluster mode fails the job

[ https://issues.apache.org/jira/browse/GOBBLIN-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-711: Description: stopping the master process in cluster mode has some issues # graceful shutdown takes more

[jira] [Updated] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-707: Summary: combine & standardize all gobblin scripts into one master script & restructure

[jira] [Created] (GOBBLIN-714) job marked as completed but never ran successfully

Jay Sen created GOBBLIN-714: --- Summary: job marked as completed but never ran successfully Key: GOBBLIN-714 URL: https://issues.apache.org/jira/browse/GOBBLIN-714 Project: Apache Gobblin Issue Type

[jira] [Updated] (GOBBLIN-711) stopping the master in cluster mode fails the job

[ https://issues.apache.org/jira/browse/GOBBLIN-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-711: Attachment: master-stop-2.log > stopping the master in cluster mode fails the

[jira] [Updated] (GOBBLIN-711) stopping the master in cluster mode fails the job

[ https://issues.apache.org/jira/browse/GOBBLIN-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-711: Attachment: (was: master-stop.log) > stopping the master in cluster mode fails the

[jira] [Updated] (GOBBLIN-711) stopping the master in cluster mode fails the job

[ https://issues.apache.org/jira/browse/GOBBLIN-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-711: Description: stopping the master process in cluster mode has some issues # graceful shutdown takes more

[jira] [Updated] (GOBBLIN-711) stopping the master in cluster mode fails the job

[ https://issues.apache.org/jira/browse/GOBBLIN-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-711: Attachment: running job_PullFromWikipedia_1553650384618.png failed

[jira] [Updated] (GOBBLIN-711) stopping the master in cluster mode fails the job

[ https://issues.apache.org/jira/browse/GOBBLIN-711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-711: Description: stopping the master process in cluster mode has some issues # graceful shutdown takes more

[jira] [Updated] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-707: Description: gobblin supports multiple modes of executions ( CLI, Standalone, cluster-master, cluster

[jira] [Created] (GOBBLIN-710) provide a way to configure job id to be small number instead of sys millisecond

Jay Sen created GOBBLIN-710: --- Summary: provide a way to configure job id to be small number instead of sys millisecond Key: GOBBLIN-710 URL: https://issues.apache.org/jira/browse/GOBBLIN-710 Project

[jira] [Created] (GOBBLIN-694) improve gobblin-cluster-[master/worker].sh script

Jay Sen created GOBBLIN-694: --- Summary: improve gobblin-cluster-[master/worker].sh script Key: GOBBLIN-694 URL: https://issues.apache.org/jira/browse/GOBBLIN-694 Project: Apache Gobblin Issue Type

[jira] [Updated] (GOBBLIN-694) improve gobblin-cluster-[master/worker].sh script

[ https://issues.apache.org/jira/browse/GOBBLIN-694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-694: Description: gobblin cluster script for master and worker is separate and can be combined. it also needs

[jira] [Created] (GOBBLIN-707) combine all gobblin scripts into one master script & restructure configs accordingly

Jay Sen created GOBBLIN-707: --- Summary: combine all gobblin scripts into one master script & restructure configs accordingly Key: GOBBLIN-707 URL: https://issues.apache.org/jira/browse/GOBBLIN-707 Pro

[jira] [Updated] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-707: Description: gobblin supports multiple modes of executions ( CLI, Standalone, cluster-master, cluster

[jira] [Updated] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-707: Description: gobblin supports multiple modes of executions ( CLI, Standalone, cluster-master, cluster

[jira] [Updated] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-707: Description: gobblin supports multiple modes of executions ( CLI, Standalone, cluster-master, cluster

[jira] [Updated] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-707: Description: gobblin supports multiple modes of executions ( CLI, Standalone, cluster-master, cluster

[jira] [Updated] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-707: Description: gobblin supports multiple modes of executions ( CLI, Standalone, cluster-master, cluster

[jira] [Updated] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-707: Description: gobblin supports multiple modes of executions ( CLI, Standalone, cluster-master, cluster

[jira] [Updated] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-707: Description: gobblin supports multiple modes of executions ( CLI, Standalone, cluster-master, cluster

[jira] [Commented] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16840878#comment-16840878 ] Jay Sen commented on GOBBLIN-707: - Hi [~ibuenros], can you pls take a look, and I will push the commit

[jira] [Created] (GOBBLIN-785) remove wrapper isPartition function, use table.isPartitioned instead

Jay Sen created GOBBLIN-785: --- Summary: remove wrapper isPartition function, use table.isPartitioned instead Key: GOBBLIN-785 URL: https://issues.apache.org/jira/browse/GOBBLIN-785 Project: Apache Gobblin

[jira] [Updated] (GOBBLIN-785) remove wrapper isPartition function, use table.isPartitioned instead

[ https://issues.apache.org/jira/browse/GOBBLIN-785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-785: Description: some places use {{HiveUtils.isPartitioned()}} which is un-necessary wrapper function

[jira] [Updated] (GOBBLIN-788) job specific log files

[ https://issues.apache.org/jira/browse/GOBBLIN-788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-788: Description: Each job or task running on individual node should create separate log file (with some

[jira] [Created] (GOBBLIN-788) job specific log files

Jay Sen created GOBBLIN-788: --- Summary: job specific log files Key: GOBBLIN-788 URL: https://issues.apache.org/jira/browse/GOBBLIN-788 Project: Apache Gobblin Issue Type: New Feature

[jira] [Created] (GOBBLIN-811) non gobblin job files should not throw exception

Jay Sen created GOBBLIN-811: --- Summary: non gobblin job files should not throw exception Key: GOBBLIN-811 URL: https://issues.apache.org/jira/browse/GOBBLIN-811 Project: Apache Gobblin Issue Type

[jira] [Created] (GOBBLIN-812) take worker id from command line if specified

Jay Sen created GOBBLIN-812: --- Summary: take worker id from command line if specified Key: GOBBLIN-812 URL: https://issues.apache.org/jira/browse/GOBBLIN-812 Project: Apache Gobblin Issue Type: New

[jira] [Commented] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16836792#comment-16836792 ] Jay Sen commented on GOBBLIN-707: - Hi [~ibuenros], any comment here? > combine & standard

[jira] [Commented] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16843281#comment-16843281 ] Jay Sen commented on GOBBLIN-707: - updated to the following: {code} ➜ gobblin-dist ./bin/gobblin

[jira] [Updated] (GOBBLIN-740) influxDB failes to write due to invalid retentionPolicy

[ https://issues.apache.org/jira/browse/GOBBLIN-740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-740: Description: Gobblin tried to set {{retentionPolicy}} while pushing a {{Point}} in {{InfluxDBPusher

[jira] [Updated] (GOBBLIN-740) influxDB failes to write due to invalid retentionPolicy

[ https://issues.apache.org/jira/browse/GOBBLIN-740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-740: Description: was: Gobblin tried to set {retentionPolicy} while pushing a {Point

[jira] [Created] (GOBBLIN-740) influxDB failes to write due to invalid retentionPolicy

Jay Sen created GOBBLIN-740: --- Summary: influxDB failes to write due to invalid retentionPolicy Key: GOBBLIN-740 URL: https://issues.apache.org/jira/browse/GOBBLIN-740 Project: Apache Gobblin Issue

[jira] [Updated] (GOBBLIN-740) influxDB failes to write due to invalid retentionPolicy

[ https://issues.apache.org/jira/browse/GOBBLIN-740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-740: Description: Gobblin tried to set {{retentionPolicy }}while pushing a {{Point}} in {{InfluxDBPusher

[jira] [Updated] (GOBBLIN-740) influxDB failes to write due to invalid retentionPolicy

[ https://issues.apache.org/jira/browse/GOBBLIN-740?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-740: Priority: Minor (was: Major) > influxDB failes to write due to invalid retentionPol

[jira] [Comment Edited] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16832968#comment-16832968 ] Jay Sen edited comment on GOBBLIN-707 at 5/4/19 2:17 AM: - with everything

[jira] [Comment Edited] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16832957#comment-16832957 ] Jay Sen edited comment on GOBBLIN-707 at 5/4/19 2:02 AM: - + comment from the git

[jira] [Commented] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16832957#comment-16832957 ] Jay Sen commented on GOBBLIN-707: - + comment from the git, for more clarity on what you are suggesting

[jira] [Comment Edited] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16832957#comment-16832957 ] Jay Sen edited comment on GOBBLIN-707 at 5/4/19 1:23 AM: - + comment from the git

[jira] [Commented] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16832968#comment-16832968 ] Jay Sen commented on GOBBLIN-707: - with everything in gobblin.sh, I have added following ways, please

[jira] [Commented] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16832130#comment-16832130 ] Jay Sen commented on GOBBLIN-707: - Sure, that would be even better but that will required even further

[jira] [Updated] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-707: Description: gobblin supports multiple modes of executions ( CLI, Standalone, cluster-master, cluster

[jira] [Updated] (GOBBLIN-788) job specific log files

[ https://issues.apache.org/jira/browse/GOBBLIN-788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-788: Affects Version/s: 0.14.0 > job specific log files > -- > >

[jira] [Updated] (GOBBLIN-788) job specific log files

[ https://issues.apache.org/jira/browse/GOBBLIN-788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-788: Fix Version/s: 0.15.0 > job specific log files > -- > >

[jira] [Created] (GOBBLIN-822) update log4j to log4j2

Jay Sen created GOBBLIN-822: --- Summary: update log4j to log4j2 Key: GOBBLIN-822 URL: https://issues.apache.org/jira/browse/GOBBLIN-822 Project: Apache Gobblin Issue Type: Sub-task Affects

[jira] [Created] (GOBBLIN-823) upgrade or remove lombok usage

Jay Sen created GOBBLIN-823: --- Summary: upgrade or remove lombok usage Key: GOBBLIN-823 URL: https://issues.apache.org/jira/browse/GOBBLIN-823 Project: Apache Gobblin Issue Type: Improvement

[jira] [Updated] (GOBBLIN-822) update log4j to log4j2

[ https://issues.apache.org/jira/browse/GOBBLIN-822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-822: Description: log4j2 has routing appender that would be super useful and probably only way to achieve

[jira] [Updated] (GOBBLIN-822) upgrade log4j to log4j2

[ https://issues.apache.org/jira/browse/GOBBLIN-822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Sen updated GOBBLIN-822: Summary: upgrade log4j to log4j2 (was: update log4j to log4j2) > upgrade log4j to log

[jira] [Created] (GOBBLIN-824) upgrade libs versions in Gobblin

Jay Sen created GOBBLIN-824: --- Summary: upgrade libs versions in Gobblin Key: GOBBLIN-824 URL: https://issues.apache.org/jira/browse/GOBBLIN-824 Project: Apache Gobblin Issue Type: Improvement

[jira] [Commented] (GOBBLIN-707) combine & standardize all gobblin scripts into one master script & restructure configs accordingly

[ https://issues.apache.org/jira/browse/GOBBLIN-707?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16878203#comment-16878203 ] Jay Sen commented on GOBBLIN-707: - [~ibuenros], pls take a look. > combine & standardize all

  1   2   >