commits  

Messages by Thread

• [gobblin] branch master updated: [GOBBLIN-1624] Refactor quota management, fix various bugs in accounting of running … (#3481) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1613] Add metadata writers field to GMCE schema (#3490) zihanli58
• [gobblin] branch master updated: Update README.md zihanli58
• [gobblin] branch master updated (3f22465 -> b26bd92) zihanli58
• [gobblin] branch master updated: Add/fix some fields of MetadataWriterFailureEvent (#3485) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1627] provide option to convert datanodes names (#3484) zihanli58
• [gobblin] branch master updated (ef76820 -> d3a21c0) zihanli58
• [gobblin] branch master updated (8c9c8a8 -> ef76820) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1621] Make HelixRetriggeringJobCallable emit job skip event when job is dropped due to previous job is running (#3478) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1623] Fix NPE when try to close RestApiConnector (#3480) zihanli58
• [gobblin] branch master updated: Clear bad mysql packages from cache in CI/CD machines (#3479) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1617] pass configurations to some HadoopUtils APIs (#3475) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1616] Make RestApiConnector be able to close the connection finally (#3474) zihanli58
• [gobblin] branch master updated: add config to set log level for any class (#3473) zihanli58
• [gobblin] branch master updated: Fix bug where partitioned tables would always return the wrong equality in paths (#3472) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1602] Change hive table location and partition check to validate using FS r… (#3459) zihanli58
• [gobblin] branch avro_1_9 updated: Use helper-all v0.2.74 to solve issues around default values. (#3469) suvasude
• [gobblin] branch avro_1_9 updated: Changes for upgrade Avro 1.9.2 and leverges hive with avro changes from https://linkedin.jfrog.io/artifactory/gobblin-hive (#3458) suvasude
• [gobblin] branch master updated: Don't flush on change_property operation (#3467) zihanli58
• [gobblin] branch master updated: Fix case where error GTE is incorrectly sent from MCE writer (#3466) zihanli58
• [gobblin] branch master updated: partial rollback of PR 3464 (#3465) suvasude
• [gobblin] branch master updated: [GOBBLIN-1604] Throw exception if there are no allocated requests due to lack of res… (#3461) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1603] Throws error if configured when encountering an IO exception while co… (#3460) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1606] change DEFAULT_GOBBLIN_COPY_CHECK_FILESIZE value (#3464) zihanli58
• [gobblin] branch master updated: Upgraded dropwizard metrics library version from 3.2.3 -> 4.1.2 and added a new wrapper class on dropwizard Timer.Context class to handle the code compatibility as the newer version of this class implements AutoClosable instead of Closable. (#3463) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1605] Fix mysql ubuntu download 404 not found for Github Actions CI/CD (#3462) zihanli58
• [gobblin-site] branch asf-site updated: Updated .asf.yaml to enabled website publish per INFRA-22829 abti
• [gobblin-site] branch master updated (a933790 -> 85e23b3) abti
• [gobblin-site] branch asf-site updated (321a61d -> a933790) abti
• [gobblin-site] branch master updated: Changing .asf.yaml to link site publish per INFRA-22822 abti
• [gobblin-site] branch asf-site updated (9880f47 -> 321a61d) abti
• [gobblin-site] branch master updated: Apache Gobblin 0.16.0 release update abti
• [gobblin] branch master updated: [GOBBLIN-1601] implement ChangePermissionCommitStep (#3457) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1598]Fix metrics already exist issue in dag manager (#3454) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1597] Add error handling in dagmanager to continue if dag fails to process,… (#3452) zihanli58
• [gobblin] branch master updated: GOBBLIN-1579 Fail job on hive existing target table location mismatch (#3433) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1596] Ignore already exists exception if the table has already been created… (#3451) zihanli58
• [gobblin] branch master updated: [GOBBLIn-1595]Fix the dead lock during hive registration (#3450) zihanli58
• [gobblin] branch master updated: Add guard in DagManager for improperly formed SLA (#3449) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1588] Send failure events for write failures when watermark is advanced in MCE writer (#3441) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1593] Fix bugs in dag manager about metric reporting and job status monitor (#3448) zihanli58
• [gobblin] branch master updated: Fix bug in `JobSpecSerializer` of inadequately preventing access errors (within `MysqlJobCatalog`) (#3447) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1583] Add System level job start SLA (#3437) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1592] Make hive copy be able to apply filter on directory (#3446) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1585]GaaS (DagManager) keep retrying a failed job beyond max attempt number (#3439) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1590] Add low/high watermark information in event emitted by Gobblin cluster (#3443) zihanli58
• [gobblin] branch master updated: [HotFix]Try to fix the mysql dependency issue in Github action (#3445) zihanli58
• [gobblin] branch master updated: Lazily initialize FileContext and do not store a handle of it so it can be GC'ed when required (#3444) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1584] Add replace record logic for Mysql writer (#3438) zihanli58
• svn commit: r51261 - /dev/gobblin/apache-gobblin-0.16.0-rc0/ /release/gobblin/apache-gobblin-0.16.0/ abti
• [gobblin] branch master updated: Bump up code cov version (#3440) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1581] Iterate over Sql ResultSet in Only the Forward Direction (#3435) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1575] use reference count in helix manager, so that connect/disconnect are called once and at the right time (#3427) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1582] Fill low/high watermark info in SourceState for QueryBasedSource (#3436) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1576] skip appending record count to staging file if present… (#3429) suvasude
• [gobblin] branch master updated: [GOBBLIN-1573]Fix the ClassNotFoundException in streaming test pipeline (#3425) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1580] Check table exists instead of call create table directly to make sure table exists (#3432) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1577] change the multiplier used in ExponentialWaitStrategy to a reasonable… (#3430) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1574] Added whitelist for iceberg tables to add new partitio… (#3426) zihanli58
• [gobblin] branch master updated: do not delete data while dropping a hive table because data is deleted, if needed, separately (#3431) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1564] codestyle changes, typo corrections, improved javadoc and fix a sync… (#3415) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1552] determine flow status correctly when dag manager is disabled (#3403) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1565]Make GMCEWriter fault tolerant so that one topic failure will not affect other topics in the same container (#3419) suvasude
• [gobblin] branch master updated: remove use of deprecated helix class (#3424) zihanli58
• [gobblin] branch master updated: Tag metrics with proxy url if available (#3423) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1569] Add RDBMS-backed `MysqlJobCatalog`, as alternative to file system storage (#3421) zihanli58
• [gobblin] branch master updated: set RETENTION_DATASET_ROOT in CleanableIcebergDataset so that any retention job can use this information (#3422) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1568] Exponential backoff for Salesforce bulk api polling (#3420) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1567] do not set a custom maxConnLifetime for sql connection (#3418) zihanli58
• [gobblin] branch master updated (255bdc1 -> b4feeb6) zihanli58
• [gobblin] branch master updated: Refactor `MysqlSpecStore` into a generalization, `MysqlNonFlowSpecStore` (not limited to `FlowSpec`s), also useable for `TopologySpec`s (#3414) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1563]Collect more information to analyze the RC for some job cannot emit kafka events to update job status (#3416) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1521] Create local mode of streaming kafka job to help user quickly onboard (#3372) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1559] Support wildcard for input paths (#3410) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1561]Improve error message when flow compilation fails (#3412) zihanli58
• [gobblin] branch master updated: [GOBBLIN-1556]Add shutdown logic in FsJobConfigurationManager (#3407) suvasude
• [gobblin] branch master updated: [GOBBLIN-1542] Integrate with Helix API to add/remove task from a running helix job (#3393) lesun
• [gobblin] branch master updated: [GOBBLIN-1554] Fix `MysqlJobStatusRetriever` to return each latest flow execution ID exactly once (#3406) aplex
• [gobblin] branch master updated: [GOBBLIN-1553] Catch exception when iceberg does not support get metrics for non-optional union type (#3405) lesun
• [gobblin] branch master updated: [GOBBLIN-1457] Lazy-load issues to improve performance (#3404) aplex
• [gobblin] branch master updated: [GOBBLIN-1551] Refactoring of Avro-hive type conversion utils (#3401) lesun
• [gobblin] branch master updated: [GOBBLIN-1549] Add retries to KafkaJobStatusMonitor for transient JobStatus state store failure. (#3399) aplex
• [gobblin] branch master updated: [GOBBLIN-1550] Add dataset.root in ConfigurableCleanableDataset (#3400) lesun
• [gobblin] branch master updated: [GOBBLIN-1546] Don't contact schema registry for every record read by job status monitor (#3397) aplex
• [gobblin] branch master updated: [GOBBLIN-1547] Set completion watermark to end of hour instead of beg… (#3398) lesun
• [gobblin] branch master updated: [GOBBLIN-1545] Wrap RestLiServiceException inside a CreateKVResponse (#3395) aplex
• [gobblin] branch master updated: [GOBBLIN-1543] Set default for work unit size (#3394) aplex
• [gobblin] branch master updated: [GOBBLIN-1533] Add completeness watermark to iceberg tables (#3385) suvasude
• [gobblin] branch master updated: [GOBBLIN-1532] Additional logging for memory-manager and partition-writer to help with writer-memory understanding lesun
• [gobblin] branch master updated (316f8bf -> d811a52) aplex
• [gobblin] branch master updated: [GOBBLIN-1527] Add finder `latestFlowGroupExecutions` to `FlowExecutions` endpoint. (#3382) aplex
• [gobblin] branch master updated: [GOBBLIN-1539] Fix community Slack link in README lesun
• [gobblin] branch master updated: Log json response for connector request failure (#3390) lesun
• [gobblin] branch master updated (601312d -> f99384f) aplex
• [gobblin] branch master updated (84fb899 -> 601312d) aplex
• [gobblin] branch master updated: [GOBBLIN-1536] Fix issue code generation (#3388) aplex
• [gobblin] branch master updated: [GOBBLIN-1534] Allow kafka metrics/events reporting to be disabled individually (#3386) aplex
• [gobblin] branch master updated: [GOBBLIN-1531] ad-hoc fix for NPE in hive registration (#3383) suvasude
• [gobblin] branch master updated: [GOBBLIN-1529] Clear all jobs quickly when demoting a leader node (#3380) aplex
• [gobblin] branch master updated: [GOBBLIN-1527] Refactor flowexecutions endpoint job status state retrieval aplex
• [gobblin] branch master updated: GOBBLIN-1528: Reduce overshoot of Yarn containers in Gobblin-on-Yarn mode (#3379) suvasude
• [gobblin] branch master updated (4e22647 -> 2b36f27) aplex
• [gobblin] branch master updated: [GOBBLIN-1526] Fix bug with binding local commit property (#3377) aplex
• [gobblin] branch master updated: GOBBLIN-1524: Limit the number of container launch threads used by YarnService (#3375) suvasude
• [gobblin] branch master updated: GOBBLIN-1523: Change logging of live instances in Gobblin cluster to debug level (#3374) suvasude
• [gobblin] branch master updated: [GOBBLIN-1522] Use FlowConfigsV2ResourceHandler when forwarding specs to master instances (#3373) aplex
• [gobblin] branch master updated: [GOBBLIN-1520] Standardize FsSpec's protocol in file name lesun
• [gobblin] branch master updated: [GOBBLIN-1519] Simplify InstrumentedSpecStore implementation (#3369) aplex
• [gobblin] branch master updated: [GOBBLIN-1457] Fix service DB initialization when DB is not empty (#3371) aplex
• [gobblin] branch master updated: [GOBBLIN-1515]Fix hive schema not updated issue in streaming and GMIP (#3364) lesun
• [gobblin] branch avro_1_9 updated: Avro 1.9 upgrade compatible change - upgraded jackson mapper to 2.x and kept jackson mapper 1.x for modules with hive, helix library dependency. (#3368) lesun
• [gobblin] branch master updated: [GOBBLIN-1516] Only schedule TaskMetricsUpdateder when metric-reporting is enabled by config (#3365) lesun
• [gobblin] branch master updated: [GOBBLIN-1517] Improve error message during recursive renaming (#3366) aplex
• [gobblin] branch master updated: [GOBBLIN-1518] create getSize api for spec store which is faster than doing getAll (#3367) aplex
• [gobblin] branch master updated (ba89b2b -> d44c12b) aplex
• [gobblin] branch master updated: [GOBBLIN-1514] Throw more useful error from already cancelled tasks (#3362) aplex
• [gobblin] branch master updated: [GOBBLIN-1509] Announce flow failure on DagManager::addDag error (#3357) aplex
• [gobblin] branch master updated (de3a694 -> b9a7158) aplex
• [gobblin] branch avro_1_9 updated: [Branch avro_1_9] Avro 1.9 upgrade compatible change - replaced deprecated public APIs with the compatible APIs (#3349) lesun
• [gobblin] annotated tag release-0.16.0-rc0 created (now 9ab7651) abti
• svn commit: r49469 - in /dev/gobblin/apache-gobblin-0.16.0-rc0: apache-gobblin-incubating-sources-0.16.0.tgz apache-gobblin-incubating-sources-0.16.0.tgz.asc apache-gobblin-incubating-sources-0.16.0.tgz.sha512 abti
• svn commit: r49468 - /dev/gobblin/apache-gobblin-0.16.0-rc0/ abti
• [gobblin] branch master updated: Reserving 0.17.0 version for next release abti
• [gobblin] branch 0.16.0 created (now b400089) abti
• [gobblin] branch master updated: Update Changelog for 0.16.0 release abti
• [gobblin] branch master updated: [GOBBLIN-1513] fixed the construction of regex filters (#3361) aplex
• [gobblin] branch master updated (557ea54 -> 1d7671a) aplex
• [gobblin] branch master updated (45f70c7 -> 557ea54) aplex
• [gobblin] branch master updated: [GOBBLIN-1511] Fix issue where tests would modify the same table (#3359) aplex
• [gobblin] branch master updated: [GOBBLIN-1507] Prevent orchestrator removals when unscheduling flows (#3353) aplex
• [gobblin] branch master updated: [GOBBLIN-1503] Modify mysql validation query to fail if db is in read-only mode aplex
• [gobblin] branch master updated: Disable CleanableMysqlDatasetStoreDatasetTest unit tests, already dropped from Continuous Ingetration. (#3355) lesun
• [gobblin] branch master updated: [GOBBLIN-1502] dont add a partition if it already exists but the getPartition fails … (#3344) suvasude
• [gobblin] branch master updated (d96b2d2 -> dd20515) lesun
• [gobblin] branch master updated: [GOBBLIN-1500]Support gobblin on yarn to be able to run on clusters with federated Yarn cluster enabled (#3345) suvasude
• [gobblin] branch avro_1_9 created (now f468bb0) lesun
• [gobblin] branch master updated: [GOBBLIN-1499] fix the bug that compaction job hang when there is no fix the bug that compaction job hang when there is no path match the datasets patten (#3343) suvasude
• [gobblin] branch master updated: add a few metrics in GaaS to help debug point of failure (#3342) suvasude
• [gobblin] branch master updated (1367614 -> 5ab79b0) suvasude
• [gobblin] branch master updated (9a9e239 -> 1367614) suvasude
• [gobblin] branch master updated: [GOBBLIN-1496] Initialize arrays and maps related to gobblin as a service with an in… (#3339) suvasude
• [gobblin] branch master updated (c65e5d0 -> e9b7eac) suvasude
• [gobblin] branch master updated: [GOBBLIN-1491] Add option to mark up/down D2 servers for gobblin service on leadership change (#3333) aplex
• [gobblin] branch master updated: [GOBBLIN-1494]Fix flaky test on HiveSource (#3338) aplex
• [gobblin] branch master updated: [GOBBLIN-1490] Make metadata pipeline to support consume GMCE emitted from different cluster (#3331) lesun
• [gobblin] branch master updated: [GOBBLIN-1488] Added option to set perm group at table level (#3334) aplex
• [gobblin] branch master updated: [GOBBLIN-1484] Fix typo in HiveMetadataWriter (#3332) aplex
• [gobblin] branch master updated: [GOBBLIN-1458] Add endpoint to trigger a flow in GaaS (#3297) aplex
• [gobblin] branch master updated: [GOBBLIN-1486] Documentation improvement for Gobblin Metadata Ingestion pipeline (#3325) aplex
• [gobblin] branch master updated: [GOBBLIN-1363] Fix minor mistakes in the Getting-Started guide (#3204) aplex
• [gobblin] branch master updated (954cccb -> e5b6461) suvasude
• [gobblin] branch master updated: [GOBBLIN-1364] Update the "Gobblin Modules" document (#3205) aplex
• [gobblin] branch master updated: [GOBBLIN-931] Update Hive-Avro-To-ORC-Converter.md: Typos (#2783) aplex
• [gobblin] branch master updated: [GOBBLIN-1457] Add automatic troubleshooter to Gobblin service (#3299) aplex
• [gobblin] branch master updated: Define a new config GOBBLIN_NON_TRANSIENT_ERRORS to set a comma separated list of probable error messages (#3330) lesun
• [gobblin] branch master updated: throw failure with iteratorexecutor when allocating files (#3321) lesun
• [gobblin] branch master updated (7bbd722 -> 8f5718a) lesun
• [gobblin] branch master updated: [GOBBLIN-1487] Add gridfs datanode gaas (#3326) lesun
• [gobblin] branch master updated (d5a85e3 -> 7ec59fa) lesun
• [gobblin] branch master updated (4b1d57f -> d5a85e3) lesun
• [gobblin] branch master updated: [GOBBLIN-1485]Enable feature to get schema from writer schema when do hive registration (#3324) lesun
• [gobblin] branch master updated: [GOBBLIN-1483] Handle null valued ConsumerRecords in Kafka Streaming Extractor[] suvasude
• [gobblin] branch master updated: [GOBBLIN-1459] correct column length in MysqlSpecStore, MysqlDagStore, MysqlJobStatu… suvasude
• [gobblin] branch master updated: [GOBBLIN-1479] Add support to convert zeroDateTime to null when configured (#3319) lesun
• [gobblin] branch master updated: [GOBBLIN-1482] Move verify dependencies test to after build step to fix pegasus error (#3322) lesun
• [gobblin] branch master updated: [GOBBLIN-1451] Log better error messages from mappers suvasude
• [gobblin] branch master updated: [GOBBLIN-1478] Fix concurrency issue when iterating failedDagIds suvasude
• [gobblin] branch master updated: [GOBBLIN-1477] Add code coverage, security checks and fix bug with static tests for Github Actions (#3316) lesun
• [gobblin] branch master updated (1e03329 -> 5f39339) lesun
• [gobblin] branch master updated: [GOBBLIN-1468] reset currentAttempt counter on resume flow suvasude
• [gobblin] branch master updated: [GOBBLIN-1474] Use jfrog for pegasus repository location as bintray was deactivated suvasude
• [gobblin] branch master updated: [GOBBLIN-1469]Fix Issue that hive registration cannot process when schema.literal is not set (#3309) lesun
• [gobblin] branch master updated: [GOBBLIN-1472] toggle to control compaction MR output dir suvasude
• [gobblin] branch master updated: [GOBBLIN-1470] Commit watermarks to state store for quiet topics with no data[] suvasude
• [gobblin] branch master updated: [GOBBLIN-1465] Refactor the GobblinOrcWriter to support using a different OrcValueWriter hutran
• [gobblin] branch master updated: [GOBBLIN-1466] Make meters shared between DagManagerThreads suvasude
• [gobblin] branch master updated: [GOBBLIN-1462] Ensure FsSpecConsumer handles config keys which are prefixes of other keys suvasude
• [gobblin] branch master updated (4fa4891 -> faa8e00) lesun
  • [gobblin] 01/02: Remove pentaho dependency lesun
  • [gobblin] 02/02: Exclude transitive dependency lesun
• [gobblin] branch master updated (bf37c76 -> 4fa4891) lesun
  • [gobblin] 01/02: Remove travis files and update build status badge lesun
  • [gobblin] 02/02: bump version for gobblin lesun
• [gobblin] branch master updated: [GOBBLIN-1444] Use Guice as DI framework in Gobblin service suvasude
• [gobblin] branch master updated: [GOBBLIN-1454] Fix NPE when trying to fetch delegation tokens for multiple remote namenodes suvasude
• [gobblin] branch master updated: [GOBBLIN-1460] Fix NPE in DagManager cleanup suvasude
• [gobblin] branch master updated: [GOBBLIN-1456] do not remove spec on update suvasude
• [gobblin] branch master updated: [GOBBLIN-1453] Improve error reporting on failed flow compilations and fix bugs wher… suvasude
• [gobblin] branch master updated: [GOBBLIN-1450] Update test framework version for latest IntelliJ lesun
• [gobblin] branch master updated: [GOBBLIN-1452] Add meters for successful/failed dags in total and by flowGroup suvasude
• [gobblin] branch master updated (d936c25 -> ea522eb) lesun
  • [gobblin] 02/02: Fix ORC dependency version to use the release version lesun
  • [gobblin] 01/02: GOBBLIN-1455: Limit gobblin.kafka.minContainersForTopic config to the number of partitions of the topic lesun
• [gobblin] branch master updated: Send failed timer instead of success timer when job is cancelled lesun
• [gobblin] branch website-collab created (now 2488c3f) shirshanka
• [gobblin] branch master updated: [GOBBLIN-1449] Correctly parse topic name from topic partition string if topic name has hyphens suvasude
• [gobblin] branch master updated: Update Docker-Integration.md lesun
• [gobblin] branch master updated: [GOBBLIN-1447] Fix url for linkedin jfrog, add pentaho dependency link suvasude
• [gobblin] branch master updated: [GOBBLIN-1443] Make iceberg metadata root location include db name suvasude
• [gobblin] branch master updated (ae62d77 -> 569cdb7) lesun

• Earlier messages
• Later messages