[jira] [Created] (GOBBLIN-443) Avro to CSV Converter

2018-03-23 Thread Abhishek Tiwari (JIRA)
Abhishek Tiwari created GOBBLIN-443: --- Summary: Avro to CSV Converter Key: GOBBLIN-443 URL: https://issues.apache.org/jira/browse/GOBBLIN-443 Project: Apache Gobblin Issue Type: Test

[jira] [Resolved] (GOBBLIN-440) SQLServer source uses "source.querybased.schema" as database name

2018-03-23 Thread Hung Tran (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hung Tran resolved GOBBLIN-440. --- Resolution: Fixed Fix Version/s: 0.13.0 Issue resolved by pull request #2315

[jira] [Created] (GOBBLIN-441) GitterRoomContent source in Gobblin

2018-03-23 Thread Abhishek Tiwari (JIRA)
Abhishek Tiwari created GOBBLIN-441: --- Summary: GitterRoomContent source in Gobblin Key: GOBBLIN-441 URL: https://issues.apache.org/jira/browse/GOBBLIN-441 Project: Apache Gobblin Issue

[jira] [Assigned] (GOBBLIN-441) GitterRoomContent source in Gobblin

2018-03-23 Thread Abhishek Tiwari (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Tiwari reassigned GOBBLIN-441: --- Assignee: Abhishek Tiwari > GitterRoomContent source in Gobblin >

[jira] [Created] (GOBBLIN-440) SQLServer source uses "source.querybased.schema" as database name

2018-03-23 Thread Issac Buenrostro (JIRA)
Issac Buenrostro created GOBBLIN-440: Summary: SQLServer source uses "source.querybased.schema" as database name Key: GOBBLIN-440 URL: https://issues.apache.org/jira/browse/GOBBLIN-440 Project:

[jira] [Commented] (GOBBLIN-385) Add Spark execution mode for Gobblin

2018-03-23 Thread Abhishek Tiwari (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16411898#comment-16411898 ] Abhishek Tiwari commented on GOBBLIN-385: - This popped up twice again in conversations last week

Re: compaction feature

2018-03-23 Thread Abhishek Tiwari
Hi Ethan, Did you modify it already? If so, please feel free to send a PR. Abhishek On Mon, Dec 18, 2017 at 7:28 PM, Zhang, Xiuzhu(AWF) wrote: > Hi guys, > > > > The compaction feature currently can handle datasets between > ‘compaction.timebase.max.time.ago’ and

Re: S3 to Hive

2018-03-23 Thread Abhishek Tiwari
+ user@gobblin On Fri, Mar 23, 2018 at 11:19 AM, Abhishek Tiwari wrote: > (moved conversation from Gitter) > >> Tilak Patidar @tilakpatidar 02:21 >> Hi all, I have a use case about which I wanted a general idea to solve it >> using gobblin. >> We are getting the data from our

gobblin-standalone.sh vs gobblin-mapreduce.sh

2018-03-23 Thread Abhishek Tiwari
(moved from Gitter) bryancjacobs @bryancjacobs Mar 16 21:38 > Could someone offer some guidance on when to choose: > ./bin/gobblin-standalone.sh > VS > ./bin/gobblin-mapreduce.sh Shirshanka Das @shirshanka Mar 19 13:33 > @bryancjacobs : gobblin-standalone runs the gobblin job in a single >

S3 to Hive

2018-03-23 Thread Abhishek Tiwari
(moved conversation from Gitter) > Tilak Patidar @tilakpatidar 02:21 > Hi all, I have a use case about which I wanted a general idea to solve it > using gobblin. > We are getting the data from our client in form of CSV dumps in s3 buckets > periodically. These dumps could be deltas or full dumps

Re: [VOTE] Apache Gobblin 0.12.0 release RC2

2018-03-23 Thread Issac Buenrostro
+1 Thanks Abhishek! On Fri, Mar 23, 2018 at 4:05 AM Abhishek Tiwari wrote: > Hi all, > > I'd like to call a vote to release Apache Gobblin 0.12.0 (Incubating). > > The feedback from previous release candidates has been addressed: > RC0 thread:

Re: Dynamic Allocation of Containers in Gobblin on YARN

2018-03-23 Thread Abhishek Tiwari
Hi Prateek, Hung would be documenting what we have on Streaming, but that would happen over the next month. Regarding Yarn, please refer to this document: https://gobblin. readthedocs.io/en/latest/user-guide/Gobblin-on-Yarn/ This talks about the architectural overview, and role of different

[jira] [Updated] (GOBBLIN-437) Fix flaky tests

2018-03-23 Thread Abhishek Tiwari (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Tiwari updated GOBBLIN-437: Description: Flaky tests should be fixed. They were earlier disabled for Travis, but have

[jira] [Resolved] (GOBBLIN-438) Update rat excludes to exclude log files, avro files, test archives, etc.

2018-03-23 Thread Abhishek Tiwari (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Tiwari resolved GOBBLIN-438. - Resolution: Fixed > Update rat excludes to exclude log files, avro files, test archives,

[jira] [Resolved] (GOBBLIN-439) Cleanup mock-couchbase after test suite

2018-03-23 Thread Abhishek Tiwari (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Tiwari resolved GOBBLIN-439. - Resolution: Fixed > Cleanup mock-couchbase after test suite >

[jira] [Commented] (GOBBLIN-439) Cleanup mock-couchbase after test suite

2018-03-23 Thread Abhishek Tiwari (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16411237#comment-16411237 ] Abhishek Tiwari commented on GOBBLIN-439: - Relevant changes:

[VOTE] Apache Gobblin 0.12.0 release RC2

2018-03-23 Thread Abhishek Tiwari
Hi all, I'd like to call a vote to release Apache Gobblin 0.12.0 (Incubating). The feedback from previous release candidates has been addressed: RC0 thread: https://www.mail-archive.com/general@incubator.apache.org/ msg62151.html RC0 resolution: LICENSE and NOTICE files have been updated

[jira] [Commented] (GOBBLIN-355) Apache 0.12.0 Release

2018-03-23 Thread Abhishek Tiwari (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-355?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16411163#comment-16411163 ] Abhishek Tiwari commented on GOBBLIN-355: - Call for vote for RC1:

[jira] [Created] (GOBBLIN-439) Cleanup mock-couchbase after test suite

2018-03-23 Thread Abhishek Tiwari (JIRA)
Abhishek Tiwari created GOBBLIN-439: --- Summary: Cleanup mock-couchbase after test suite Key: GOBBLIN-439 URL: https://issues.apache.org/jira/browse/GOBBLIN-439 Project: Apache Gobblin Issue

[jira] [Created] (GOBBLIN-438) Update rat excludes to exclude log files, avro files, test archives, etc.

2018-03-23 Thread Abhishek Tiwari (JIRA)
Abhishek Tiwari created GOBBLIN-438: --- Summary: Update rat excludes to exclude log files, avro files, test archives, etc. Key: GOBBLIN-438 URL: https://issues.apache.org/jira/browse/GOBBLIN-438

[jira] [Updated] (GOBBLIN-437) Fix flaky tests

2018-03-23 Thread Abhishek Tiwari (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Tiwari updated GOBBLIN-437: Description: Flaky tests should be fixed. They were earlier disabled for Travis, but have

[jira] [Updated] (GOBBLIN-437) Fix flaky tests

2018-03-23 Thread Abhishek Tiwari (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Tiwari updated GOBBLIN-437: Description: Flaky tests should be fixed. They were earlier disabled for Travis, but have

[jira] [Updated] (GOBBLIN-437) Fix flaky tests

2018-03-23 Thread Abhishek Tiwari (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Tiwari updated GOBBLIN-437: Description: Fix flaky tests that were disabled on Travis, but are not also being

[jira] [Created] (GOBBLIN-437) Fix flaky tests

2018-03-23 Thread Abhishek Tiwari (JIRA)
Abhishek Tiwari created GOBBLIN-437: --- Summary: Fix flaky tests Key: GOBBLIN-437 URL: https://issues.apache.org/jira/browse/GOBBLIN-437 Project: Apache Gobblin Issue Type: Test