commits  

Messages by Thread

• (celeborn) branch main updated: [CELEBORN-1752] Migration guide for unexpected shuffle RESTful api change since 0.5.0 nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1530][FOLLOWUP] Exclude web modules by default ethanfeng
• (celeborn) branch branch-0.5 updated: [CELEBORN-1752] Migration guide for unexpected shuffle RESTful api change since 0.5.0 nicholasjiang
• (celeborn-website) branch main updated: Add Weijie Guo to committer (#91) rexxiong
• (celeborn) branch main updated: [CELEBORN-1621][FOLLOWUP] Support enabling worker tags via config ethanfeng
• (celeborn) branch main updated: [CELEBORN-1751][CIP-14] Add celebornException utils to cppClient ethanfeng
• (celeborn) branch main updated: [CELEBORN-1745] Remove application top disk usage code ethanfeng
• (celeborn) branch branch-0.5 updated: [CELEBORN-1725] Optimize performance of handling `MapperEnd` RPC in `LifecycleManager` feiwang
• (celeborn) branch branch-0.4 updated: [CELEBORN-1725] Optimize performance of handling `MapperEnd` RPC in `LifecycleManager` feiwang
• (celeborn) branch main updated: [CELEBORN-1725] Optimize performance of handling `MapperEnd` RPC in `LifecycleManager` feiwang
• (celeborn) branch main updated (e642197b5 -> 1aefd8f42) ethanfeng
• (celeborn) branch main updated: [CELEBORN-1749] Fix incorrect application diskBytesWritten metrics nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1621][CIP-11] Predefined worker tags expr via dynamic configs ethanfeng
• (celeborn-website) branch main updated: Release 0.5.2 (#90) rexxiong
• (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
  • (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
• (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
  • (celeborn-website) 11/11: .asf.yaml github-bot
• (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
  • (celeborn-website) 01/11: gitignore github-bot
• (celeborn) tag v0.5.2 created (now 513bd5995) nicholasjiang
• svn commit: r73253 - /dev/celeborn/v0.5.2-rc6/ /release/celeborn/celeborn-0.5.2/ nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1747] Fix flaky test - HybridShuffleWordCountTest nicholasjiang
• (celeborn) branch main updated: [MINOR] Update DingTalk group link nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1741][CIP-14] Add processBase utils to cppClient ethanfeng
• (celeborn) branch main updated: [CELEBORN-1713] RpcTimeoutException should include RPC address in message ethanfeng
• (celeborn) branch main updated: [CELEBORN-1543][FOLLOWUP] License check adds flink-1.20 profile ethanfeng
• (celeborn) branch main updated: [CELEBORN-1634][FOLLOWUP] Simplify the logic of the `RpcSource.addTimer` and `RpcSource.updateTimer` fchen
• svn commit: r73210 - /dev/celeborn/v0.5.2-rc6/ nicholasjiang
• (celeborn) tag v0.5.2-rc6 created (now 513bd5995) nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1724][CIP-14] Add environment setup tools for CppClient development ethanfeng
• (celeborn) branch main updated: [CELEBORN-1545] Add Tez plugin skeleton and dag app master ethanfeng
• (celeborn) branch branch-0.5 updated: [CELEBORN-1727][FOLLOWUP] Fix CelebornHashCheckDiskSuite flaky test rexxiong
• (celeborn) branch main updated: [CELEBORN-1727][FOLLOWUP] Fix CelebornHashCheckDiskSuite flaky test rexxiong
• (celeborn) branch branch-0.5 updated: [CELEBORN-1726][FOLLOWUP] Avoid NPE when transition worker state nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1726][FOLLOWUP] Avoid NPE when transition worker state nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1530] support MPU for S3 ethanfeng
• (celeborn) branch main updated (99a34f36b -> 317cb973d) ethanfeng
• (celeborn) branch main updated: [CELEBORN-1618][CIP-11] Supporting tags via DB Config Service ethanfeng
• (celeborn) branch branch-0.5 updated: [CELEBORN-1728] Fix NPE when failing to connect to celeborn worker ethanfeng
• (celeborn) branch main updated: [CELEBORN-1728] Fix NPE when failing to connect to celeborn worker ethanfeng
• (celeborn) branch branch-0.5 updated: [CELEBORN-1727] Correct the calculation of worker diskInfo actualUsableSpace ethanfeng
• (celeborn) branch main updated: [CELEBORN-1727] Correct the calculation of worker diskInfo actualUsableSpace ethanfeng
• (celeborn) branch branch-0.4 updated: [CELEBORN-1485][0.4] Refactor addCounter, addGauge and addTimer of AbstractSource to reduce CPU utilization fchen
• (celeborn) branch branch-0.5 updated: [CELEBORN-1726] Update WorkerInfo when transition worker state rexxiong
• (celeborn) branch main updated: [CELEBORN-1726] Update WorkerInfo when transition worker state rexxiong
• (celeborn) branch main updated: [CELEBORN-1719] Introduce celeborn.client.spark.stageRerun.enabled with alternative celeborn.client.spark.fetch.throwsFetchFailure to enable spark stage rerun nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1631][FOLLOWUP] Add latest snapshot index in message of HandleResponse for /snapshot/create nicholasjiang
• (celeborn) branch branch-0.4 updated (45f404d51 -> 959b771fb) fchen
• (celeborn) branch main updated: [CELEBORN-1715] RemoteShuffleMaster should check celeborn.client.push.replicate.enabled in constructor nicholasjiang
• (celeborn-website) branch main updated: add user kcbebank (#89) nicholasjiang
• svn commit: r73143 - /dev/celeborn/v0.5.2-rc5/ nicholasjiang
• (celeborn) tag v0.5.2-rc5 created (now c057e960f) nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1686][FOLLOWUP] Avoid NPE when clean up data pusher nicholasjiang
• (celeborn) branch branch-0.5 updated: [CELEBORN-1686][FOLLOWUP] Avoid NPE when clean up data pusher nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1619][CELEBORN-474][FOLLOWUP] TagsManager uses JavaUtils#newConcurrentHashMap to speed up ConcurrentHashMap#computeIfAbsent nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1634] Support queue time/processing time metrics for rpc framework rexxiong
• (celeborn) branch main updated: [CELEBORN-1707] Audit all RESTful api calls and use separate restAuditFile nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1714] Optimize handleApplicationLost nicholasjiang
• (celeborn) branch branch-0.5 updated: [CELEBORN-1717] Fix ReusedExchangedSuit UT bug nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1717] Fix ReusedExchangedSuit UT bug nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1718] Fix memory storage file won't hard split when memory file is full and worker has no disks nicholasjiang
• (celeborn) branch branch-0.5 updated: [CELEBORN-1718] Fix memory storage file won't hard split when memory file is full and worker has no disks nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1490][FOLLOWUP] Polish CelebornTierProducerAgent nicholasjiang
• svn commit: r73091 - /dev/celeborn/v0.5.2-rc4/ nicholasjiang
• (celeborn) tag v0.5.2-rc4 created (now 7fd96fdde) nicholasjiang
• (celeborn) branch branch-0.5 updated (28b2f56e1 -> 5c6a2c85f) feiwang
  • (celeborn) 01/01: [CELEBORN-1705] Fix disk buffer size is negative issue feiwang
• (celeborn) branch branch-0.5 updated: [CELEBORN-1705] Fix disk buffer size is negative issue ethanfeng
• (celeborn) branch main updated: [CELEBORN-1705] Fix disk buffer size is negative issue ethanfeng
• (celeborn) branch main updated: [CELEBORN-1660] Cache available workers and only count the available workers device free capacity rexxiong
• (celeborn) branch main updated (def5254ec -> 7fbf0e2fa) chengpan
• (celeborn) branch main updated: [CELEBORN-1504][FOLLOWUP] Document adds Flink 1.16 support ethanfeng
• (celeborn) branch main updated: [CELEBORN-1685][FOLLOWUP] CelebornShuffleFallbackPolicyRunner should compute shuffleFallbackCounts via class name of ShuffleFallbackPolicy implementation rexxiong
• (celeborn) branch main updated: [CELEBORN-1711][TEST] Fix '65535' port is invalid feiwang
• svn commit: r72999 - /dev/celeborn/v0.5.2-rc3/ nicholasjiang
• (celeborn) tag v0.5.2-rc3 created (now 8ac06dfe6) nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1601][FOLLOWUP] Refine the RESTful apis for revise lost shuffles rexxiong
• (celeborn) branch branch-0.5 updated: [CELEBORN-1071] Support stage rerun for shuffle data lost rexxiong
• (celeborn) branch main updated: [CELEBORN-1071] Support stage rerun for shuffle data lost rexxiong
• (celeborn) branch main updated: [CELEBORN-1702] Bump Ratis version from 3.1.1 to 3.1.2 ethanfeng
• (celeborn) branch main updated: [CELEBORN-1708] Bump protobuf version from 3.21.7 to 3.25.5 ethanfeng
• (celeborn) branch main updated: [CELEBORN-1709] Bump jetty version from 9.4.52.v20230823 to 9.4.56.v20240826 ethanfeng
• (celeborn) branch main updated (8b54ed8c3 -> 6d2b9f6d9) ethanfeng
• (celeborn) branch main updated: [CELEBORN-1504][FOLLOWUP] Start test nodes in random ports to allow multiple builds run in the same ci server ethanfeng
• (celeborn) branch branch-0.4 updated: [CELEBORN-1686] Avoid return the same pushTaskQueue rexxiong
• (celeborn) branch main updated: [CELEBORN-1685] ShuffleFallbackPolicy supports ShuffleFallbackCount metric rexxiong
• (celeborn) branch branch-0.5 updated: [CELEBORN-1686] Avoid return the same pushTaskQueue rexxiong
• (celeborn) branch main updated: [CELEBORN-1686] Avoid return the same pushTaskQueue rexxiong
• (celeborn) branch main updated (164c66349 -> 4545cdc40) nicholasjiang
• (celeborn) branch main updated: [MINOR] Fix docs typo ethanfeng
• (celeborn) branch branch-0.5 updated: [CELEBORN-1696] StorageManager#cleanFile should remove file info rexxiong
• (celeborn) branch main updated: [CELEBORN-1696] StorageManager#cleanFile should remove file info rexxiong
• (celeborn) branch branch-0.5 updated: [CELEBORN-1691] Fix the issue that upstream tasks don't rerun and the current task still retry when failed to decompress in flink rexxiong
• (celeborn) branch main updated: [CELEBORN-1691] Fix the issue that upstream tasks don't rerun and the current task still retry when failed to decompress in flink rexxiong
• (celeborn) branch main updated: [CELEBORN-1697] Improve ThreadStackTrace for thread dump ethanfeng
• (celeborn) branch branch-0.5 updated: [CELEBORN-1692] Set mount point in fromPbFileInfoMap nicholasjiang
• (celeborn) branch main updated (4e7df13af -> 4b8b125a1) nicholasjiang
• (celeborn) branch branch-0.5 updated: [CELEBORN-1693] Fix storageFetcherPool concurrent problem nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1693] Fix storageFetcherPool concurrent problem nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1680] Introduce ShuffleFallbackCount metrics ethanfeng
• (celeborn) branch main updated: [MINOR] Remove unused TODO comments in CelebornTierProducerAgent#processBuffer rexxiong
• (celeborn) branch branch-0.5 updated: [CELEBORN-1671] CelebornShuffleReader will try replica if create client failed rexxiong
• (celeborn) branch main updated: [CELEBORN-1671] CelebornShuffleReader will try replica if create client failed rexxiong
• (celeborn) branch main updated (64f201dd8 -> f2e904302) ethanfeng
• (celeborn) branch main updated: [CELEBORN-1636][FOLLOWUP] Dynamic resources will only be utilized in case of candidates shortages rexxiong
• (celeborn) branch main updated: [CELEBORN-1678][FOLLOWUP] Improve Celeborn CLI user guide ethanfeng
• (celeborn) branch main updated: [CELEBORN-1684] Fix ambiguous client jar expression of document nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1531][FOLLOWUP] Assign the scheduled check task rexxiong
• (celeborn) branch main updated: [CELEBORN-1490][CIP-6] Support process large buffer in flink hybrid shuffle rexxiong
• (celeborn) branch branch-0.5 updated: [CELEBORN-1682] Add java tools.jar into classpath for JVM quake nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1682] Add java tools.jar into classpath for JVM quake nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1490][CIP-6] Add Flink Hybrid Shuffle IT test cases nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1660] Using map for workers to find worker fast ethanfeng
• (celeborn) branch main updated: [CELEBORN-1564][FOLLOWUP] Remove unused variables ethanfeng
• (celeborn) branch main updated (41fdb8ade -> 7dc72b35e) ethanfeng
• (celeborn) branch main updated: [CELEBORN-1490][CIP-6] Add Flink hybrid shuffle doc nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1672] Bump Spark from 3.4.3 to 3.4.4 rexxiong
• (celeborn) branch main updated: [CELEBORN-1673] Support retry create client nicholasjiang
• (celeborn) branch branch-0.5 updated: [CELEBORN-1673] Support retry create client nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1678] Add Celeborn CLI User guide in README ethanfeng
• (celeborn) branch main updated: [CELEBORN-1674] Fix reader thread name of MapPartitionData rexxiong
• (celeborn) branch branch-0.5 updated: [CELEBORN-1674] Fix reader thread name of MapPartitionData rexxiong
• (celeborn) branch branch-0.5 updated: [CELEBORN-1516][FOLLOWUP] Support reset method for DynamicConfigServiceFactory rexxiong
• (celeborn) branch main updated: [CELEBORN-1516][FOLLOWUP] Support reset method for DynamicConfigServiceFactory rexxiong
• (celeborn) branch main updated: [CELEBORN-1577][PHASE1] Storage quota should support interrupt shuffle rexxiong
• (celeborn) branch main updated: [CELEBORN-1444][FOLLOWUP] Add IsDecommissioningWorker to celeborn dashboard rexxiong
• (celeborn) branch main updated: [CELEBORN-1490][CIP-6] Impl worker read process in Flink Hybrid Shuffle rexxiong
• (celeborn) branch branch-0.4 updated: [CELEBORN-1677][BUILD] Update SCM information for SBT build configuration fchen
• (celeborn) branch main updated: [CELEBORN-1677][BUILD] Update SCM information for SBT build configuration fchen
• (celeborn) branch branch-0.5 updated: [CELEBORN-1677][BUILD] Update SCM information for SBT build configuration fchen
• (celeborn) tag v0.5.2-rc2 created (now 6f1c1d347) nicholasjiang
• svn commit: r72656 - /dev/celeborn/v0.5.2-rc2/ nicholasjiang
• (celeborn) branch main updated: [CELEBORN-1642][CIP-11] Support multiple worker tags ethanfeng
• (celeborn) branch main updated: [CELEBORN-1636] Client supports dynamic update of Worker resources on the server rexxiong
• (celeborn) branch main updated: [CELEBORN-1649] Bumping up maven to 3.9.9 rexxiong
• (celeborn) branch branch-0.5 updated: [CELEBORN-1667] Fix NPE & LEAK occurring prior to worker registration rexxiong
• (celeborn) branch main updated: [CELEBORN-1666] Bump scala-protoc from 1.0.6 to 1.0.7 fchen
• (celeborn) branch main updated: [CELEBORN-1667] Fix NPE & LEAK occurring prior to worker registration rexxiong
• (celeborn) branch main updated: [CELEBORN-1668] Fix NPE when handle closed file writers rexxiong
• (celeborn) branch branch-0.5 updated: [CELEBORN-1668] Fix NPE when handle closed file writers rexxiong
• (celeborn) branch branch-0.5 updated: [CELEBORN-1669] Fix NullPointerException for PartitionFilesSorter#updateSortedShuffleFiles after cleaning up expired shuffle key ethanfeng
• (celeborn) branch main updated: [CELEBORN-1669] Fix NullPointerException for PartitionFilesSorter#updateSortedShuffleFiles after cleaning up expired shuffle key ethanfeng
• (celeborn) branch main updated: [CELEBORN-1632] Support to apply ratis local raft_meta_conf command with RESTful api rexxiong
• (celeborn) branch main updated (3b9c2f04e -> 464a7c71a) ethanfeng
• (celeborn) branch branch-0.4 updated: [CELEBORN-1666] Bump scala-protoc from 1.0.6 to 1.0.7 fchen
• (celeborn) branch branch-0.5 updated: [CELEBORN-1666] Bump scala-protoc from 1.0.6 to 1.0.7 fchen
• (celeborn) branch branch-0.5 updated: [CELEBORN-1664][0.5] Fix secret fetch failures after LEADER master failover rexxiong
• (celeborn) branch main updated: [MINOR] Fix typo in ExceptionUtils ethanfeng
• (celeborn) branch branch-0.5 updated: [MINOR] Fix typo in ExceptionUtils ethanfeng
• (celeborn) branch main updated: [CELEBORN-1664] Fix secret fetch failures after LEADER master failover mridulm80
• (celeborn) branch branch-0.5 updated: [RELEASE] Bump 0.5.3-SNAPSHOT nicholasjiang
  • (celeborn) branch branch-0.5 updated: [RELEASE] Bump 0.5.3-SNAPSHOT nicholasjiang
  • (celeborn) branch branch-0.5 updated: [RELEASE] Bump 0.5.3-SNAPSHOT nicholasjiang
  • (celeborn) branch branch-0.5 updated: [RELEASE] Bump 0.5.3-SNAPSHOT nicholasjiang
  • (celeborn) branch branch-0.5 updated: [RELEASE] Bump 0.5.3-SNAPSHOT nicholasjiang
  • (celeborn) branch branch-0.5 updated: [RELEASE] Bump 0.5.3-SNAPSHOT nicholasjiang
• svn commit: r72562 - /dev/celeborn/v0.5.2-rc1/ nicholasjiang
• (celeborn) tag v0.5.2-rc1 created (now 8b2cdf485) nicholasjiang
• (celeborn) branch branch-0.5 updated: [RELEASE] Bump 0.5.2 nicholasjiang
  • (celeborn) branch branch-0.5 updated: [RELEASE] Bump 0.5.2 nicholasjiang

• Earlier messages
• Later messages