This is an automated email from the ASF dual-hosted git repository.
suvasude pushed a change to branch 0.15.0
in repository https://gitbox.apache.org/repos/asf/incubator-gobblin.git.
discard 195dac1 Updated CHANGELOG.md with the change log for 0.15 release.
add a9bd984 [GOBBLIN-1227][GOBBLIN-1277] Treat AccessDeniedException in
RenameRecursively as an existence indicator
add 28ea2a5 [GOBBLIN-1228] Do not localize token file on new TaskRunner
launch
add 025655f [GOBBLIN-1229] Make topic specific state available to Kafka
workunit packer[]
add abd71db [GOBBLIN-1222] Create right abstraction to assemble dataset
staging dir for Hive dataset finder
add 21dd436 [GOBBLIN-1233][GOBBLIN-831] Add case-aware support in
WhitelistBlacklist and other small fixes
add c98226c [GOBBLIN-1234] Fix unit tests that fail on local build after
MySQL v8 bump up[]
add c179ca2 [GOBBLIN-1213] add common job properties to jobProps using
putAll
add 099e9db [GOBBLIN-1231][GOBBLIN-1217][GOBBLIN-1223] Make re-compaction
be able to write to a new folder based on the executCount
add 678a34b [GOBBLIN-1226] remove lombok from runtime classpath
add f0904f3 [GOBBLIN-1241] Allow nodes/edges in HOCON format and delay
resolution to allow overriding
add d29dd87 [GOBBLIN-1232] One liner: Enable verbose mode for
waitForCompletion call
add f86e813 [GOBBLIN-1244] Add new file patterns to rat exclusion list[]
add cb3e51f [GOBBLIN-1246] Modify build scripts to fix failures in Nexus
artifact …
add 1d8a8f3 [GOBBLIN-1245] Update CHANGELOG and NOTICE files in
preparation for 0.…
add dca0f60 [GOBBLIN-1247] Disable flaky unit tests causing intermittent
build failures[]
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (195dac1)
\
N -- N -- N refs/heads/0.15.0 (dca0f60)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
CHANGELOG.md | 18 ++---
NOTICE | 2 +-
build.gradle | 9 +++
gobblin-api/build.gradle | 1 -
.../gobblin/configuration/ConfigurationKeys.java | 9 ++-
gobblin-audit/build.gradle | 1 -
gobblin-binary-management/build.gradle | 1 -
gobblin-cluster/build.gradle | 27 +++++++
.../gobblin/cluster/GobblinHelixJobScheduler.java | 3 +-
.../gobblin/cluster/ClusterIntegrationTest.java | 2 +-
.../cluster/GobblinHelixJobLauncherTest.java | 1 +
.../CompactionCompleteFileOperationAction.java | 59 +++++++++-------
.../action/CompactionHiveRegistrationAction.java | 15 +++-
.../mapreduce/AvroCompactionTaskTest.java | 36 +++++++++-
.../gobblin-config-client/build.gradle | 1 -
.../gobblin-config-core/build.gradle | 1 -
gobblin-core-base/build.gradle | 1 -
gobblin-core/build.gradle | 1 -
.../partitioner/TimeBasedWriterPartitioner.java | 3 +
gobblin-data-management/build.gradle | 1 -
.../gobblin/data/management/copy/CopySource.java | 7 ++
.../data/management/copy/hive/HiveDataset.java | 8 +++
.../management/copy/hive/HiveDatasetFinder.java | 2 +
.../writer/FileAwareInputStreamDataWriter.java | 15 +++-
.../runtime/retention/DatasetCleanerTask.java | 11 +++
.../copy/hive/WhitelistBlacklistTest.java | 24 ++++++-
gobblin-example/build.gradle | 1 -
gobblin-hive-registration/build.gradle | 1 -
gobblin-metastore/build.gradle | 1 -
.../testing/TestMetastoreDatabaseServer.java | 5 +-
.../gobblin-metrics-base/build.gradle | 1 -
gobblin-metrics-libs/gobblin-metrics/build.gradle | 1 -
gobblin-modules/gobblin-azkaban/build.gradle | 1 -
gobblin-modules/gobblin-codecs/build.gradle | 1 +
gobblin-modules/gobblin-couchbase/build.gradle | 1 -
gobblin-modules/gobblin-elasticsearch/build.gradle | 1 -
gobblin-modules/gobblin-eventhub/build.gradle | 3 +-
gobblin-modules/gobblin-helix/build.gradle | 3 +-
.../org/apache/gobblin/writer/AsyncHttpWriter.java | 2 +-
.../apache/gobblin/writer/AsyncHttpWriterTest.java | 2 +-
gobblin-modules/gobblin-kafka-08/build.gradle | 1 -
gobblin-modules/gobblin-kafka-09/build.gradle | 1 -
gobblin-modules/gobblin-kafka-common/build.gradle | 1 -
.../extractor/extract/kafka/KafkaSource.java | 17 +++--
.../packer/KafkaBiLevelWorkUnitPacker.java | 4 ++
.../packer/KafkaSingleLevelWorkUnitPacker.java | 4 ++
.../kafka/workunit/packer/KafkaWorkUnitPacker.java | 10 +--
.../workunit/packer/KafkaWorkUnitPackerTest.java | 16 +++++
.../gobblin-metrics-hadoop/build.gradle | 1 -
gobblin-modules/gobblin-service-kafka/build.gradle | 1 -
gobblin-modules/gobblin-zuora/build.gradle | 1 -
gobblin-restli/client.gradle | 2 -
gobblin-restli/server.gradle | 1 -
gobblin-runtime/build.gradle | 23 ++++--
.../apache/gobblin/runtime/mapreduce/MRTask.java | 2 +-
gobblin-salesforce/build.gradle | 1 -
gobblin-service/build.gradle | 22 ++++--
.../service/modules/core/GitFlowGraphMonitor.java | 8 +--
.../service/modules/core/GitMonitoringService.java | 5 +-
.../service/modules/flowgraph/BaseDataNode.java | 13 ++--
.../flowgraph/datanodes/fs/FileSystemDataNode.java | 2 +-
.../template/HOCONInputStreamFlowTemplate.java | 6 +-
.../apache/gobblin/TaskErrorIntegrationTest.java | 23 +++---
gobblin-test-utils/build.gradle | 1 -
gobblin-utility/build.gradle | 1 -
.../management/copy/hive/WhitelistBlacklist.java | 56 ++++++++++-----
.../java/org/apache/gobblin/util/HadoopUtils.java | 19 +++--
.../org/apache/gobblin/util/PullFileLoader.java | 14 +++-
.../org/apache/gobblin/util/HadoopUtilsTest.java | 30 ++++++++
gobblin-yarn/build.gradle | 1 -
.../gobblin/yarn/GobblinApplicationMaster.java | 27 +++----
.../apache/gobblin/yarn/GobblinYarnTaskRunner.java | 3 -
.../org/apache/gobblin/yarn/YarnHelixUtils.java | 28 ++++----
.../apache/gobblin/yarn/GobblinYarnTestUtils.java | 78 +++++++++++++++++++++
.../apache/gobblin/yarn/YarnHelixUtilsTest.java | 54 ++++++++++++++
gobblin-yarn/src/test/resources/..token.crc | Bin 0 -> 12 bytes
gobblin-yarn/src/test/resources/.token | Bin 0 -> 40 bytes
gradle/scripts/globalDependencies.gradle | 5 ++
gradle/scripts/nexusPublishing.gradle | 21 ++++++
79 files changed, 609 insertions(+), 177 deletions(-)
create mode 100644
gobblin-yarn/src/test/java/org/apache/gobblin/yarn/GobblinYarnTestUtils.java
create mode 100644
gobblin-yarn/src/test/java/org/apache/gobblin/yarn/YarnHelixUtilsTest.java
create mode 100644 gobblin-yarn/src/test/resources/..token.crc
create mode 100644 gobblin-yarn/src/test/resources/.token