[jira] [Created] (GOBBLIN-277) Add a lock to make multihop thread safe

2017-10-05 Thread Kuai Yu (JIRA)
Kuai Yu created GOBBLIN-277: --- Summary: Add a lock to make multihop thread safe Key: GOBBLIN-277 URL: https://issues.apache.org/jira/browse/GOBBLIN-277 Project: Apache Gobblin Issue Type: Bug

[jira] [Resolved] (GOBBLIN-276) Change setActive order to prevent flow spec loss

2017-10-05 Thread Hung Tran (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hung Tran resolved GOBBLIN-276. --- Resolution: Fixed Issue resolved by pull request #2129

Re: Problem scaling Extractors with data volume

2017-10-05 Thread Zhixiong Chen
Hi Gurjinder, The `Limiter` used in for an `Extractor` limits the number records to be extracted. It doesn't limit the number of extractor instances. In our main task execution engine, an `Extractor` is created per `Task` and A `Task` will be created per `WorkUnit`, meaning the number of

[jira] [Resolved] (GOBBLIN-255) ParquetHdfsDataWriter

2017-10-05 Thread Abhishek Tiwari (JIRA)
[ https://issues.apache.org/jira/browse/GOBBLIN-255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Abhishek Tiwari resolved GOBBLIN-255. - Resolution: Fixed Issue resolved by pull request #2106

Re: Problem scaling Extractors with data volume

2017-10-05 Thread Abhishek Tiwari
Issac, Do you have suggestions on this. I see you were engaged in conversation on the referred PR. Regards, Abhishek On Thu, Sep 28, 2017 at 5:26 PM, Gurjinder Singh Rathore < gurjinder.rath...@gmail.com> wrote: > Hi, > > I'm using gobblin (embedded) in my project to transfer loads of over 10