This is an automated email from the ASF dual-hosted git repository.
suvasude pushed a change to annotated tag release-0.15.0-rc1
in repository https://gitbox.apache.org/repos/asf/incubator-gobblin.git.
*** WARNING: tag release-0.15.0-rc1 was modified! ***
from 4dd609b (tag)
to 3ef2e84 (tag)
tagging 52cefe6339182e3f78e93e3913ebd946c7a57512 (commit)
replaces release-0.14.0
by suvasude
on Thu Oct 8 11:30:08 2020 -0700
- Log -----------------------------------------------------------------
Apache Gobblin (incubating) 0.15.0 RC1
-----BEGIN PGP SIGNATURE-----
iQEzBAABCAAdFiEET+bMOG68JgL2irpyU+KO+n9PxNAFAl9/WrAACgkQU+KO+n9P
xNBl3Af/UhbqwrhirSqPZ+kSpHvkbZDs8Uq6P6s+jwubm1TV0ci2Wm8NXLnnGtQW
3iZ7kb0XtCYySK/jxCXK2ejuQV0k0RlXJrUX8OZh41pwbDvAPdI+fua7shVvWrCu
HA+Sms9/onCi1pL/d8/+9+FWGGXNmHY+2LOAUNvUwVszbOUtGlCMVuhgdb29JIoW
7Ol03ZeSLUWSsbymWw4lZm7CDsnjmF5bgqOwq3CGeY5YToUlT8dXYf2ZdJXDVCMu
RYaNAX6HPqFBxXv+R18lO+l1y65bndVRO+d5R3HczkYzaToCtFMI+0cbq0JsUWA8
4dZWhgV8PDzxfEgFs7ialWnfo4rBDg==
=rRaL
-----END PGP SIGNATURE-----
-----------------------------------------------------------------------
from dca0f60 [GOBBLIN-1247] Disable flaky unit tests causing intermittent
build failures[]
add 58666e4 [GOBBLIN-1235] Migrate Log4J to SLF4J to provide a clean log
environment for downstream users
add f47f8df [GOBBLIN-1251] Propagate exception in TaskStateTracker for
caller to trigger Helix retry
add b2f9cab [GOBBLIN-1248][GOBBLIN-1223] Fix discrepancy between table
schema and file schema
add 93584ea [GOBBLIN-1249] More failure info when MRTask wrapped up
add 05f5640 [GOBBLIN-1252] Provide a default flow SLA for Gobblin Service
flows[]
add d1eca1a [GOBBLIN-1253] Update running jobs counter on Gobblin service
restart[]
add 67a060f [GOBBLIN-1254] Skip undecodeable message in
KafkaAvroJobStatusMonitor
add 03911c6 [GOBBLIN-1255] Wait for compiler to be healthy before
scheduling flows on startup
add 778a863 [GOBBLIN-1257] Fix the handling of collection field types
during ORC schema up-conversion in compaction[]
add 956d384 [GOBBLIN-1250] Open Sourcing ORC writer
add 88780bc [GOBBLIN-1258] Add error message in status for unauthorized
flows
add e49c068 [GOBBLIN-1263] Dataset specific Database name for registration
add baebccd [GOBBLIN-1262] Update flow execution as failed if it was
skipped due to concurrently running flow
add 4ebb37e [GOBBLIN-1260] add some logs in GobblinHelixTask
add f82cb13 [GOBBLIN-1264] Add gobblin-orc as publishing module
add 4dad872 [GOBBLIN-1261] Migrate .pdsc schemas to .pdl
add b3002c5 [GOBBLIN-1256] Exclude log4j related jars in compile but
include those in test
add 4d92192 [GOBBLIN-1230] add option to add spec executor configs to
gaas job
add d112ac6 [GOBBLIN-1265] Switch the dependency of gobblin-orc with the
shadow jar instead
add 06b9159 [GOBBLIN-1267] Gobblin cli: Add a quickApp called oneShot to
run a single command in standalone and MR mode
add 39690d2 [GOBBLIN-1269] add metrics field in JobStatus schema
add cdd33cd [GOBBLIN-1270] Fix reference to
determineSchemaOrReturnErrorSchema which is backward incompatible
add 7c2a402 [GOBBLIN-1268] track WORK_UNITS_PREPARATION timer event also
in gaas
add 083ad2f [GOBBLIN-1266] Refactor dataset lineage code to allow Lineage
event emission in streaming mode[]
add 37e08eb [GOBBLIN-1271] add MultiEventMetadataGenerator
add 6e9bb2a [GOBBLIN-1274] fix import
add 3cc50cd [GOBBLIN-1272] Fixing bug in loading config-store when the
entry is empty
add 885b9ab [GOBBLIN-1275] Changing gitter link to slack invite link
add 3863601 [GOBBLIN-1276] Emit additional logs from Gobblin task
execution for improved debuggability[]
add 1cf79ef [GOBBLIN-1277] Added travis_retry function to deploy phase
add 8110e88 [GOBBLIN-1279] Fix flaky unit tests involving REST.li calls
to FlowConfig endpoint in Gobblin-as-a-Service[]
add c69a758 [GOBBLIN-1280] Update CHANGELOG in preparation for 0.15.0
rc1[]
add 52cefe6 [GOBBLIN-1281] Update rat exclusion list to include pdl
files[]
No new revisions were added by this update.
Summary of changes:
.travis.yml | 2 +-
CHANGELOG.md | 51 ++-
README.md | 4 +-
bin/gobblin.sh | 8 +-
build.gradle | 2 +
gobblin-admin/build.gradle | 1 +
gobblin-all/build.gradle | 1 +
gobblin-api/build.gradle | 1 +
.../apache/gobblin/service/ServiceConfigKeys.java | 4 +
gobblin-aws/build.gradle | 1 +
gobblin-binary-management/build.gradle | 1 +
gobblin-cluster/build.gradle | 1 -
.../apache/gobblin/cluster/GobblinHelixTask.java | 13 +-
.../cluster/GobblinHelixTaskStateTracker.java | 35 +-
.../gobblin/cluster/GobblinHelixTaskTest.java | 6 +-
gobblin-compaction/build.gradle | 12 +-
.../gobblin/compaction/mapreduce/orc/OrcUtils.java | 13 +-
.../test/TestCompactionOrcJobConfigurator.java | 45 +++
.../mapreduce/test/TestCompactionTaskUtils.java | 59 +++
.../mapreduce/test/TestOrcCompactionTask.java | 142 +++++++
.../main/resources/orcCompactionTest/data1.json | 1 +
.../main/resources/orcCompactionTest/data1.schema | 1 +
.../mapreduce/AvroCompactionTaskTest.java | 46 +--
.../mapreduce/OrcCompactionTaskTest.java | 49 +--
.../compaction/mapreduce/orc/OrcUtilsTest.java | 184 +++++----
.../gobblin-config-client/build.gradle | 1 -
.../gobblin-config-core/build.gradle | 1 -
gobblin-core/build.gradle | 1 -
.../gobblin/publisher/BaseDataPublisher.java | 2 +-
.../gobblin/writer/PartitionedDataWriter.java | 6 +-
gobblin-data-management/build.gradle | 1 -
gobblin-docs/user-guide/Gobblin-CLI.md | 41 ++-
.../gobblin/example/generic/OneShotRunner.java | 99 +++++
.../apache/gobblin/example/TestOneShotRunner.java | 43 +++
gobblin-example/src/test/resources/appConf.conf | 1 +
gobblin-example/src/test/resources/baseConf.conf | 2 +
gobblin-hive-registration/build.gradle | 1 -
.../hive/metastore/HiveMetaStoreBasedRegister.java | 71 +++-
.../hive/policy/HiveRegistrationPolicyBase.java | 14 +-
.../metastore/HiveMetaStoreBasedRegisterTest.java | 133 +++++++
.../policy/HiveRegistrationPolicyBaseTest.java | 39 +-
gobblin-metastore/build.gradle | 1 +
.../gobblin/metrics/event/lineage/LineageInfo.java | 51 ++-
gobblin-modules/gobblin-azkaban/build.gradle | 1 -
.../runtime/KafkaAvroJobStatusMonitorTest.java | 10 +
gobblin-modules/gobblin-kafka-common/build.gradle | 1 +
.../extractor/extract/kafka/ConfigStoreUtils.java | 15 +-
.../extract/kafka/ConfigStoreUtilsTest.java | 7 +-
.../gobblin-orc}/build.gradle | 35 +-
.../gobblin/writer/AvroOrcSchemaConverter.java | 137 +++++++
.../gobblin/writer/CloseBeforeFlushException.java | 26 +-
.../writer/GenericRecordToOrcValueWriter.java | 410 +++++++++++++++++++++
.../apache/gobblin/writer/GobblinOrcWriter.java | 265 +++++++++++++
.../gobblin/writer/GobblinOrcWriterBuilder.java | 50 +++
.../org/apache/gobblin/writer/OrcValueWriter.java | 34 +-
.../gobblin/writer/AvroOrcSchemaConverterTest.java | 203 ++++++++++
.../writer/GenericRecordToOrcValueWriterTest.java | 183 +++++++++
.../gobblin/writer/GobblinOrcWriterTest.java | 171 +++++++++
.../src/test/resources/list_map_test/data.json | 66 ++++
.../src/test/resources/list_map_test/schema.avsc | 21 ++
.../test/resources/orc_writer_list_test/data.json | 61 +++
.../resources/orc_writer_list_test/schema.avsc | 18 +
.../src/test/resources/orc_writer_test/data.json | 8 +
.../src/test/resources/orc_writer_test/schema.avsc | 15 +
.../src/test/resources/union_test/data.json | 26 ++
.../src/test/resources/union_test/schema.avsc | 15 +
gobblin-rest-service/gobblin-rest-api/build.gradle | 3 +
.../org/apache/gobblin/rest/JobExecutionInfo.pdl | 84 +++++
.../org/apache/gobblin/rest/JobExecutionInfo.pdsc | 99 -----
.../org/apache/gobblin/rest/JobExecutionQuery.pdl | 69 ++++
.../org/apache/gobblin/rest/JobExecutionQuery.pdsc | 84 -----
.../gobblin/rest/JobExecutionQueryResult.pdl | 12 +
.../gobblin/rest/JobExecutionQueryResult.pdsc | 16 -
.../pegasus/org/apache/gobblin/rest/Metric.pdl | 31 ++
.../pegasus/org/apache/gobblin/rest/Metric.pdsc | 32 --
.../main/pegasus/org/apache/gobblin/rest/Table.pdl | 26 ++
.../pegasus/org/apache/gobblin/rest/Table.pdsc | 29 --
.../org/apache/gobblin/rest/TaskExecutionInfo.pdl | 74 ++++
.../org/apache/gobblin/rest/TaskExecutionInfo.pdsc | 87 -----
.../pegasus/org/apache/gobblin/rest/TimeRange.pdl | 22 ++
.../pegasus/org/apache/gobblin/rest/TimeRange.pdsc | 25 --
.../gobblin-rest-server/build.gradle | 3 +
.../org/apache/gobblin/service/ExecutionStatus.pdl | 47 +++
.../apache/gobblin/service/ExecutionStatus.pdsc | 17 -
.../org/apache/gobblin/service/FlowConfig.pdl | 33 ++
.../org/apache/gobblin/service/FlowConfig.pdsc | 37 --
.../org/apache/gobblin/service/FlowExecution.pdl | 32 ++
.../org/apache/gobblin/service/FlowExecution.pdsc | 33 --
.../pegasus/org/apache/gobblin/service/FlowId.pdl | 25 ++
.../pegasus/org/apache/gobblin/service/FlowId.pdsc | 29 --
.../org/apache/gobblin/service/FlowStatistics.pdl | 17 +
.../org/apache/gobblin/service/FlowStatistics.pdsc | 18 -
.../org/apache/gobblin/service/FlowStatus.pdl | 33 ++
.../org/apache/gobblin/service/FlowStatus.pdsc | 34 --
.../org/apache/gobblin/service/FlowStatusId.pdl | 22 ++
.../org/apache/gobblin/service/FlowStatusId.pdsc | 23 --
.../pegasus/org/apache/gobblin/service/JobId.pdl | 25 ++
.../pegasus/org/apache/gobblin/service/JobId.pdsc | 29 --
.../org/apache/gobblin/service/JobState.pdl | 17 +
.../org/apache/gobblin/service/JobState.pdsc | 18 -
.../org/apache/gobblin/service/JobStatistics.pdl | 22 ++
.../org/apache/gobblin/service/JobStatistics.pdsc | 23 --
.../org/apache/gobblin/service/JobStatus.pdl | 47 +++
.../org/apache/gobblin/service/JobStatus.pdsc | 44 ---
.../org/apache/gobblin/service/Schedule.pdl | 18 +
.../org/apache/gobblin/service/Schedule.pdsc | 22 --
.../apache/gobblin/service/FlowConfigClient.java | 7 +-
.../apache/gobblin/service/FlowConfigV2Client.java | 4 +
.../org/apache/gobblin/service/FlowConfigTest.java | 7 +-
.../apache/gobblin/service/FlowConfigV2Test.java | 7 +-
.../service/FlowConfigV2ResourceLocalHandler.java | 4 +-
.../gobblin/service/FlowExecutionResource.java | 6 +-
.../gobblin/restli/throttling/PermitAllocation.pdl | 32 ++
.../restli/throttling/PermitAllocation.pdsc | 13 -
.../gobblin/restli/throttling/PermitRequest.pdl | 32 ++
.../gobblin/restli/throttling/PermitRequest.pdsc | 13 -
.../apache/gobblin/restli/throttling/Policy.pdl | 32 ++
.../apache/gobblin/restli/throttling/Policy.pdsc | 13 -
gobblin-runtime/build.gradle | 1 -
.../gobblin/runtime/AbstractJobLauncher.java | 44 +--
.../gobblin/runtime/GobblinMultiTaskAttempt.java | 16 +-
.../apache/gobblin/runtime/SafeDatasetCommit.java | 34 +-
.../runtime/api/MultiEventMetadataGenerator.java | 59 +++
.../gobblin/runtime/embedded/EmbeddedGobblin.java | 28 +-
.../java/org/apache/gobblin/runtime/fork/Fork.java | 7 +-
.../runtime/mapreduce/CliMRJobLauncher.java | 8 +-
.../gobblin/runtime/mapreduce/MRJobLauncher.java | 6 +
.../apache/gobblin/runtime/mapreduce/MRTask.java | 6 +-
.../gobblin/service/monitoring/JobStatus.java | 6 +-
.../runtime/GobblinMultiTaskAttemptTest.java | 80 +++-
.../gobblin/runtime/JobLauncherTestHelper.java | 22 +-
.../runtime/MultiEventMetadataGeneratorTest.java | 65 ++++
.../runtime/mapreduce/MRJobLauncherTest.java | 25 ++
.../java/org/apache/gobblin/test/TestSource.java | 8 +
gobblin-service/build.gradle | 1 -
.../service/modules/flow/MultiHopFlowCompiler.java | 6 +-
.../service/modules/orchestration/DagManager.java | 4 +-
.../modules/orchestration/DagManagerUtils.java | 6 +-
.../modules/orchestration/Orchestrator.java | 18 +-
.../scheduler/GobblinServiceJobScheduler.java | 6 +
.../service/modules/spec/JobExecutionPlan.java | 31 +-
.../monitoring/KafkaAvroJobStatusMonitor.java | 3 +-
.../gobblin/service/GobblinServiceManagerTest.java | 8 +-
.../service/modules/core/GobblinServiceHATest.java | 10 +-
.../modules/orchestration/DagManagerFlowTest.java | 44 +--
.../scheduler/GobblinServiceJobSchedulerTest.java | 19 +-
.../spec/JobExecutionPlanDagFactoryTest.java | 2 +-
.../org/apache/gobblin/runtime/cli/GobblinCli.java | 5 +-
.../org/apache/gobblin/util/PropertiesUtils.java | 25 ++
.../apache/gobblin/util/PropertiesUtilsTest.java | 11 +
gobblin-yarn/build.gradle | 2 +-
gradle/scripts/bintrayPublishing.gradle | 3 +-
gradle/scripts/defaultBuildProperties.gradle | 2 +-
gradle/scripts/dependencyDefinitions.gradle | 13 +-
gradle/scripts/globalDependencies.gradle | 29 +-
gradle/scripts/repositories.gradle | 3 +
travis/bintrayDeploy.sh | 2 +-
157 files changed, 4008 insertions(+), 1160 deletions(-)
create mode 100644
gobblin-compaction/src/main/java/org/apache/gobblin/compaction/mapreduce/test/TestCompactionOrcJobConfigurator.java
create mode 100644
gobblin-compaction/src/main/java/org/apache/gobblin/compaction/mapreduce/test/TestCompactionTaskUtils.java
create mode 100644
gobblin-compaction/src/main/java/org/apache/gobblin/compaction/mapreduce/test/TestOrcCompactionTask.java
create mode 100644
gobblin-compaction/src/main/resources/orcCompactionTest/data1.json
create mode 100644
gobblin-compaction/src/main/resources/orcCompactionTest/data1.schema
create mode 100644
gobblin-example/src/main/java/org/apache/gobblin/example/generic/OneShotRunner.java
create mode 100644
gobblin-example/src/test/java/org/apache/gobblin/example/TestOneShotRunner.java
create mode 100644 gobblin-example/src/test/resources/appConf.conf
create mode 100644 gobblin-example/src/test/resources/baseConf.conf
create mode 100644
gobblin-hive-registration/src/test/java/org/apache/gobblin/hive/metastore/HiveMetaStoreBasedRegisterTest.java
copy {gobblin-binary-management => gobblin-modules/gobblin-orc}/build.gradle
(56%)
create mode 100644
gobblin-modules/gobblin-orc/src/main/java/org/apache/gobblin/writer/AvroOrcSchemaConverter.java
copy gradle/scripts/repositories.gradle =>
gobblin-modules/gobblin-orc/src/main/java/org/apache/gobblin/writer/CloseBeforeFlushException.java
(61%)
create mode 100644
gobblin-modules/gobblin-orc/src/main/java/org/apache/gobblin/writer/GenericRecordToOrcValueWriter.java
create mode 100644
gobblin-modules/gobblin-orc/src/main/java/org/apache/gobblin/writer/GobblinOrcWriter.java
create mode 100644
gobblin-modules/gobblin-orc/src/main/java/org/apache/gobblin/writer/GobblinOrcWriterBuilder.java
copy gobblin-admin/build.gradle =>
gobblin-modules/gobblin-orc/src/main/java/org/apache/gobblin/writer/OrcValueWriter.java
(56%)
create mode 100644
gobblin-modules/gobblin-orc/src/test/java/org/apache/gobblin/writer/AvroOrcSchemaConverterTest.java
create mode 100644
gobblin-modules/gobblin-orc/src/test/java/org/apache/gobblin/writer/GenericRecordToOrcValueWriterTest.java
create mode 100644
gobblin-modules/gobblin-orc/src/test/java/org/apache/gobblin/writer/GobblinOrcWriterTest.java
create mode 100644
gobblin-modules/gobblin-orc/src/test/resources/list_map_test/data.json
create mode 100644
gobblin-modules/gobblin-orc/src/test/resources/list_map_test/schema.avsc
create mode 100644
gobblin-modules/gobblin-orc/src/test/resources/orc_writer_list_test/data.json
create mode 100644
gobblin-modules/gobblin-orc/src/test/resources/orc_writer_list_test/schema.avsc
create mode 100644
gobblin-modules/gobblin-orc/src/test/resources/orc_writer_test/data.json
create mode 100644
gobblin-modules/gobblin-orc/src/test/resources/orc_writer_test/schema.avsc
create mode 100644
gobblin-modules/gobblin-orc/src/test/resources/union_test/data.json
create mode 100644
gobblin-modules/gobblin-orc/src/test/resources/union_test/schema.avsc
create mode 100644
gobblin-rest-service/gobblin-rest-api/src/main/pegasus/org/apache/gobblin/rest/JobExecutionInfo.pdl
delete mode 100644
gobblin-rest-service/gobblin-rest-api/src/main/pegasus/org/apache/gobblin/rest/JobExecutionInfo.pdsc
create mode 100644
gobblin-rest-service/gobblin-rest-api/src/main/pegasus/org/apache/gobblin/rest/JobExecutionQuery.pdl
delete mode 100644
gobblin-rest-service/gobblin-rest-api/src/main/pegasus/org/apache/gobblin/rest/JobExecutionQuery.pdsc
create mode 100644
gobblin-rest-service/gobblin-rest-api/src/main/pegasus/org/apache/gobblin/rest/JobExecutionQueryResult.pdl
delete mode 100644
gobblin-rest-service/gobblin-rest-api/src/main/pegasus/org/apache/gobblin/rest/JobExecutionQueryResult.pdsc
create mode 100644
gobblin-rest-service/gobblin-rest-api/src/main/pegasus/org/apache/gobblin/rest/Metric.pdl
delete mode 100644
gobblin-rest-service/gobblin-rest-api/src/main/pegasus/org/apache/gobblin/rest/Metric.pdsc
create mode 100644
gobblin-rest-service/gobblin-rest-api/src/main/pegasus/org/apache/gobblin/rest/Table.pdl
delete mode 100644
gobblin-rest-service/gobblin-rest-api/src/main/pegasus/org/apache/gobblin/rest/Table.pdsc
create mode 100644
gobblin-rest-service/gobblin-rest-api/src/main/pegasus/org/apache/gobblin/rest/TaskExecutionInfo.pdl
delete mode 100644
gobblin-rest-service/gobblin-rest-api/src/main/pegasus/org/apache/gobblin/rest/TaskExecutionInfo.pdsc
create mode 100644
gobblin-rest-service/gobblin-rest-api/src/main/pegasus/org/apache/gobblin/rest/TimeRange.pdl
delete mode 100644
gobblin-rest-service/gobblin-rest-api/src/main/pegasus/org/apache/gobblin/rest/TimeRange.pdsc
create mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/ExecutionStatus.pdl
delete mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/ExecutionStatus.pdsc
create mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/FlowConfig.pdl
delete mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/FlowConfig.pdsc
create mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/FlowExecution.pdl
delete mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/FlowExecution.pdsc
create mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/FlowId.pdl
delete mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/FlowId.pdsc
create mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/FlowStatistics.pdl
delete mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/FlowStatistics.pdsc
create mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/FlowStatus.pdl
delete mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/FlowStatus.pdsc
create mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/FlowStatusId.pdl
delete mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/FlowStatusId.pdsc
create mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/JobId.pdl
delete mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/JobId.pdsc
create mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/JobState.pdl
delete mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/JobState.pdsc
create mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/JobStatistics.pdl
delete mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/JobStatistics.pdsc
create mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/JobStatus.pdl
delete mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/JobStatus.pdsc
create mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/Schedule.pdl
delete mode 100644
gobblin-restli/gobblin-flow-config-service/gobblin-flow-config-service-api/src/main/pegasus/org/apache/gobblin/service/Schedule.pdsc
create mode 100644
gobblin-restli/gobblin-throttling-service/gobblin-throttling-service-api/src/main/pegasus/org/apache/gobblin/restli/throttling/PermitAllocation.pdl
delete mode 100644
gobblin-restli/gobblin-throttling-service/gobblin-throttling-service-api/src/main/pegasus/org/apache/gobblin/restli/throttling/PermitAllocation.pdsc
create mode 100644
gobblin-restli/gobblin-throttling-service/gobblin-throttling-service-api/src/main/pegasus/org/apache/gobblin/restli/throttling/PermitRequest.pdl
delete mode 100644
gobblin-restli/gobblin-throttling-service/gobblin-throttling-service-api/src/main/pegasus/org/apache/gobblin/restli/throttling/PermitRequest.pdsc
create mode 100644
gobblin-restli/gobblin-throttling-service/gobblin-throttling-service-api/src/main/pegasus/org/apache/gobblin/restli/throttling/Policy.pdl
delete mode 100644
gobblin-restli/gobblin-throttling-service/gobblin-throttling-service-api/src/main/pegasus/org/apache/gobblin/restli/throttling/Policy.pdsc
create mode 100644
gobblin-runtime/src/main/java/org/apache/gobblin/runtime/api/MultiEventMetadataGenerator.java
create mode 100644
gobblin-runtime/src/test/java/org/apache/gobblin/runtime/MultiEventMetadataGeneratorTest.java
