incubator-gobblin git commit: [GOBBLIN-183] Gobblin data management copy empty directories

2017-08-09 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master 3ab02b3f2 -> 42677dc8c [GOBBLIN-183] Gobblin data management copy empty directories Closes #2036 from zxcware/empty Project: http://git-wip-us.apache.org/repos/asf/incubator-gobblin/repo Commit:

incubator-gobblin git commit: [GOBBLIN-48] Update documentation with new extract limiting keys like extract.limit.timeLimit

2017-08-11 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master c111fa131 -> ee91502e6 [GOBBLIN-48] Update documentation with new extract limiting keys like extract.limit.timeLimit Closes #2052 from arjun4084346/docUpdate Project:

incubator-gobblin git commit: [GOBBLIN-199] API for listing the contents of a state store

2017-08-14 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master ee91502e6 -> 998fe200d [GOBBLIN-199] API for listing the contents of a state store Closes #2051 from ibuenros/state-store-listapi Project: http://git-wip-us.apache.org/repos/asf/incubator-gobblin/repo Commit: http://git-

incubator-gobblin git commit: [GOBBLIN-241] Allow lineage event to aggregate on task states based on lineage.dataset.urn

2017-09-13 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master 1507b6055 -> 520bcf5df [GOBBLIN-241] Allow lineage event to aggregate on task states based on lineage.dataset.urn Closes #2092 from yukuai518/kafkalineage Project:

[1/2] incubator-gobblin git commit: [GOBBLIN-253] Enhance Hive materializer.

2017-09-21 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master 30990f485 -> 5fa983268 http://git-wip-us.apache.org/repos/asf/incubator-gobblin/blob/5fa98326/gobblin-data-management/src/main/java/org/apache/gobblin/data/management/conversion/hive/task/HiveConverterUtils.java

incubator-gobblin git commit: [GOBBLIN-270] Statestore Migration Script

2017-10-04 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master 9795cd58d -> 8af87cb78 [GOBBLIN-270] Statestore Migration Script Closes #2122 from autumnust/statestoremigration Project: http://git-wip-us.apache.org/repos/asf/incubator-gobblin/repo Commit:

incubator-gobblin git commit: [GOBBLIN-240] Added three more Azkaban Tags

2017-09-11 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master adc669fee -> afdba01f9 [GOBBLIN-240] Added three more Azkaban Tags Closes #2091 from jinhyukchang/master Project: http://git-wip-us.apache.org/repos/asf/incubator-gobblin/repo Commit:

incubator-gobblin git commit: [GOBBLIN-181] Create HiveTask using customized Gobblin Task

2017-09-05 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master a5fe06210 -> 8a374f207 [GOBBLIN-181] Create HiveTask using customized Gobblin Task Closes #2062 from arjun4084346/materializer Project: http://git-wip-us.apache.org/repos/asf/incubator-gobblin/repo Commit:

incubator-gobblin git commit: [GOBBLIN-266] Improve Hive Task setup

2017-09-29 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master 8284bb76b -> e67799948 [GOBBLIN-266] Improve Hive Task setup Closes #2117 from ibuenros/hive-materializer-2 Project: http://git-wip-us.apache.org/repos/asf/incubator-gobblin/repo Commit: http://git-wip-us.apache.org/repos/

incubator-gobblin git commit: [GOBBLIN-182] Add lineage event for query based source

2017-08-17 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master da382dbf1 -> 280b1d35e [GOBBLIN-182] Add lineage event for query based source Closes #2034 from yukuai518/lineage2 Project: http://git-wip-us.apache.org/repos/asf/incubator-gobblin/repo Commit:

incubator-gobblin git commit: [GOBBLIN-205] Fix bug in pushmode copyRoute generation Add some docs to help understand and maintain the code

2017-08-29 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master d8b1a6609 -> b67fd71b1 [GOBBLIN-205] Fix bug in pushmode copyRoute generation Add some docs to help understand and maintain the code Closes #2057 from autumnust/replication-push Project:

incubator-gobblin git commit: [GOBBLIN-275] Use listStatus instead of globStatus for finding persisted files

2017-10-10 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master c65010a8e -> 7d970606b [GOBBLIN-275] Use listStatus instead of globStatus for finding persisted files Closes #2128 from jack-moseley/distcp_glob Project: http://git-wip-us.apache.org/repos/asf/incubator-gobblin/repo Commit:

incubator-gobblin git commit: [GOBBLIN-285] Kafka extractor computes avgMillisPerRecord even when a partition pull is interrupted

2017-10-12 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master c5e83a331 -> 07c86f2a7 [GOBBLIN-285] Kafka extractor computes avgMillisPerRecord even when a partition pull is interrupted Closes #2138 from ibuenros/avgpulltime-fix Project: http://git-wip-us.apache.org/repos/asf/incuba

incubator-gobblin git commit: [GOBBLIN-294] Change logging level for reflection utilities

2017-11-15 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master f3472d30c -> c8707eded [GOBBLIN-294] Change logging level for reflection utilities Closes #2145 from autumnust/reflectionlogging Project: http://git-wip-us.apache.org/repos/asf/incubator-gobblin/repo Commit:

incubator-gobblin git commit: [GOBBLIN-314] Validate filesize when copying in writer

2017-11-15 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master e9ad289c4 -> f3472d30c [GOBBLIN-314] Validate filesize when copying in writer Closes #2168 from jack-moseley/filesize_check Project: http://git-wip-us.apache.org/repos/asf/incubator-gobblin/repo Commit:

incubator-gobblin git commit: [GOBBLIN-330] make the generation of kerberos principal dynamic

2017-12-04 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master 462ea8cf2 -> 3be46244c [GOBBLIN-330] make the generation of kerberos principal dynamic Closes #2182 from autumnust/keberosprincipaldynamic Project: http://git-wip-us.apache.org/repos/asf/incubator-gobblin/repo Commit:

incubator-gobblin git commit: [GOBBLIN-341] getLogger() method bug fix

2017-12-12 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master 4b19fedb2 -> f7a89fb12 [GOBBLIN-341] getLogger() method bug fix Closes #2196 from autumnust/loggingClassFix Project: http://git-wip-us.apache.org/repos/asf/incubator-gobblin/repo Commit:

incubator-gobblin git commit: [GOBBLIN-273] Add job failure monitoring

2017-11-07 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master c385f1ddd -> 6198120e3 [GOBBLIN-273] Add job failure monitoring Closes #2125 from zxcware/msg Project: http://git-wip-us.apache.org/repos/asf/incubator-gobblin/repo Commit:

incubator-gobblin git commit: [GOBBLIN-287] Adding a service name to the resource name for multiple throttling quotas

2017-11-07 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master b6e88fd06 -> 0e5561519 [GOBBLIN-287] Adding a service name to the resource name for multiple throttling quotas Closes #2142 from jdintruff/gobblin-287 Project: http://git-wip-us.apache.org/repos/asf/incubator-gobblin/repo

incubator-gobblin git commit: [GOBBLIN-367] Adding mrJob object as a field in MRTask so that inherited Task could read jobUrl from it

2018-01-16 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master 4bdd0482e -> 4e9c8d5ed [GOBBLIN-367] Adding mrJob object as a field in MRTask so that inherited Task could read jobUrl from it Closes #2240 from autumnust/jobfieldinmrtask Project:

incubator-gobblin git commit: [GOBBLIN-381][GOBBLIN-368] Add ability to filter hidden directories for ConfigBasedDatasets

2018-01-24 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master f2f6e4685 -> 11abf9f5f [GOBBLIN-381][GOBBLIN-368] Add ability to filter hidden directories for ConfigBasedDatasets Closes #2260 from sv2000/gobblin-381 Project: http://git-wip-us.apache.org/repos/asf/incubator-gobblin/repo

incubator-gobblin git commit: [GOBBLIN-365] Add lookback days config property for CopyableGlobDatasetFinder

2018-01-11 Thread ibuenros
Repository: incubator-gobblin Updated Branches: refs/heads/master 55dafd67e -> ece2858ec [GOBBLIN-365] Add lookback days config property for CopyableGlobDatasetFinder Closes #2238 from sv2000/master Project: http://git-wip-us.apache.org/repos/asf/incubator-gobblin/repo Commit:

[incubator-gobblin] branch master updated: [GOBBLIN-724] Upgrade throttling server so waiting until tokens can be used is done…

2019-04-15 Thread ibuenros
This is an automated email from the ASF dual-hosted git repository. ibuenros pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-gobblin.git The following commit(s) were added to refs/heads/master by this push: new a68e1eb [GOBBLIN-724] Upgrade

[incubator-gobblin] branch master updated: [GOBBLIN-784] Allow setting replication factor in distcp

2019-05-28 Thread ibuenros
This is an automated email from the ASF dual-hosted git repository. ibuenros pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-gobblin.git The following commit(s) were added to refs/heads/master by this push: new 93855f6 [GOBBLIN-784] Allow

[incubator-gobblin] branch master updated: [GOBBLIN-772][GOBBLIN-724] Implement Schema Comparison Strategy during Disctp

2019-05-28 Thread ibuenros
This is an automated email from the ASF dual-hosted git repository. ibuenros pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-gobblin.git The following commit(s) were added to refs/heads/master by this push: new 6df5743 [GOBBLIN-772][GOBBLIN-724

[incubator-gobblin] branch master updated: [GOBBLIN-809] Fix RateBasedLimitter factory to get double instead of long rate for initialization

2019-06-19 Thread ibuenros
This is an automated email from the ASF dual-hosted git repository. ibuenros pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-gobblin.git The following commit(s) were added to refs/heads/master by this push: new 691d3cd [GOBBLIN-809] Fix

[incubator-gobblin] branch master updated: [GOBBLIN-778][GOBBLIN-551] Moving config creation to a separate method

2019-05-22 Thread ibuenros
This is an automated email from the ASF dual-hosted git repository. ibuenros pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-gobblin.git The following commit(s) were added to refs/heads/master by this push: new 2f82a64 [GOBBLIN-778][GOBBLIN-551

[incubator-gobblin] branch master updated: [GOBBLIN-760] Improve retrying behavior of throttling client, add more informative …

2019-05-01 Thread ibuenros
This is an automated email from the ASF dual-hosted git repository. ibuenros pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-gobblin.git The following commit(s) were added to refs/heads/master by this push: new c185cad [GOBBLIN-760] Improve

[incubator-gobblin] branch master updated: [GOBBLIN-752] Fix a bug in QPS throttling policy where it was incorrectly indicating permits were impossible to satisfy.

2019-04-23 Thread ibuenros
This is an automated email from the ASF dual-hosted git repository. ibuenros pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-gobblin.git The following commit(s) were added to refs/heads/master by this push: new 19eab6a [GOBBLIN-752] Fix a bug

[incubator-gobblin] branch master updated: [GOBBLIN-807] TimingEvent is now closeable, extends GobblinEventBuilder

2019-06-28 Thread ibuenros
This is an automated email from the ASF dual-hosted git repository. ibuenros pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/incubator-gobblin.git The following commit(s) were added to refs/heads/master by this push: new 2c81c25 [GOBBLIN-807] TimingEvent