commits  

Messages by Date

• 2024/12/01 (celeborn) branch main updated: [CELEBORN-1756] Only gauge hdfs metrics if HDFS storage enabled to reduce metrics ethanfeng
• 2024/12/01 (celeborn) branch branch-0.4 updated: [CELEBORN-1686][FOLLOWUP] Avoid NPE when clean up data pusher chengpan
• 2024/12/01 (celeborn) branch main updated: [CELEBORN-1750] Return struct worker resource consumption information with RESTful api feiwang
• 2024/12/01 (celeborn) branch main updated: [CELEBORN-1755] Update doc to include S3 as one of storage layers ethanfeng
• 2024/12/01 (celeborn-website) 01/11: gitignore github-bot
• 2024/12/01 (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
• 2024/12/01 (celeborn-website) 11/11: .asf.yaml github-bot
• 2024/11/30 (celeborn-website) 11/11: .asf.yaml github-bot
• 2024/11/30 (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
• 2024/11/30 (celeborn-website) 01/11: gitignore github-bot
• 2024/11/29 (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
• 2024/11/29 (celeborn-website) 11/11: .asf.yaml github-bot
• 2024/11/29 (celeborn-website) 01/11: gitignore github-bot
• 2024/11/29 (celeborn) branch branch-0.4 updated: [CELEBORN-1725][FOLLOWUP] Optimize `isAllMapTasksEnd` performance rexxiong
• 2024/11/29 (celeborn) branch branch-0.5 updated: [CELEBORN-1725][FOLLOWUP] Optimize `isAllMapTasksEnd` performance rexxiong
• 2024/11/29 (celeborn) branch main updated: [CELEBORN-1725][FOLLOWUP] Optimize `isAllMapTasksEnd` performance rexxiong
• 2024/11/28 (celeborn-website) 11/11: .asf.yaml github-bot
• 2024/11/28 (celeborn-website) 01/11: gitignore github-bot
• 2024/11/28 (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
• 2024/11/28 (celeborn) branch main updated: [CELEBORN-1746] Reduce the size of aws dependencies ethanfeng
• 2024/11/28 (celeborn) branch main updated: [CELEBORN-1752] Migration guide for unexpected shuffle RESTful api change since 0.5.0 nicholasjiang
• 2024/11/28 (celeborn) branch main updated: [CELEBORN-1530][FOLLOWUP] Exclude web modules by default ethanfeng
• 2024/11/28 (celeborn) branch branch-0.5 updated: [CELEBORN-1752] Migration guide for unexpected shuffle RESTful api change since 0.5.0 nicholasjiang
• 2024/11/27 (celeborn-website) 11/11: .asf.yaml github-bot
• 2024/11/27 (celeborn-website) 01/11: gitignore github-bot
• 2024/11/27 (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
• 2024/11/27 (celeborn-website) branch main updated: Add Weijie Guo to committer (#91) rexxiong
• 2024/11/27 (celeborn) branch main updated: [CELEBORN-1621][FOLLOWUP] Support enabling worker tags via config ethanfeng
• 2024/11/27 (celeborn) branch main updated: [CELEBORN-1751][CIP-14] Add celebornException utils to cppClient ethanfeng
• 2024/11/27 (celeborn) branch main updated: [CELEBORN-1745] Remove application top disk usage code ethanfeng
• 2024/11/27 (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
• 2024/11/27 (celeborn-website) 11/11: .asf.yaml github-bot
• 2024/11/27 (celeborn-website) 01/11: gitignore github-bot
• 2024/11/27 (celeborn) branch branch-0.5 updated: [CELEBORN-1725] Optimize performance of handling `MapperEnd` RPC in `LifecycleManager` feiwang
• 2024/11/27 (celeborn) branch branch-0.4 updated: [CELEBORN-1725] Optimize performance of handling `MapperEnd` RPC in `LifecycleManager` feiwang
• 2024/11/27 (celeborn) branch main updated: [CELEBORN-1725] Optimize performance of handling `MapperEnd` RPC in `LifecycleManager` feiwang
• 2024/11/26 (celeborn) branch main updated (e642197b5 -> 1aefd8f42) ethanfeng
• 2024/11/26 (celeborn-website) 11/11: .asf.yaml github-bot
• 2024/11/26 (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
• 2024/11/26 (celeborn-website) 01/11: gitignore github-bot
• 2024/11/26 (celeborn) branch main updated: [CELEBORN-1749] Fix incorrect application diskBytesWritten metrics nicholasjiang
• 2024/11/26 (celeborn) branch main updated: [CELEBORN-1621][CIP-11] Predefined worker tags expr via dynamic configs ethanfeng
• 2024/11/26 (celeborn-website) branch main updated: Release 0.5.2 (#90) rexxiong
• 2024/11/26 (celeborn-website) 02/11: .github/bin/build_docs.sh github-bot
• 2024/11/26 (celeborn-website) 11/11: .asf.yaml github-bot
• 2024/11/26 (celeborn-website) 01/11: gitignore github-bot
• 2024/11/26 (celeborn) tag v0.5.2 created (now 513bd5995) nicholasjiang
• 2024/11/25 svn commit: r73253 - /dev/celeborn/v0.5.2-rc6/ /release/celeborn/celeborn-0.5.2/ nicholasjiang
• 2024/11/25 (celeborn) branch main updated: [CELEBORN-1747] Fix flaky test - HybridShuffleWordCountTest nicholasjiang
• 2024/11/25 (celeborn) branch main updated: [MINOR] Update DingTalk group link nicholasjiang
• 2024/11/25 (celeborn) branch main updated: [CELEBORN-1741][CIP-14] Add processBase utils to cppClient ethanfeng
• 2024/11/25 (celeborn) branch main updated: [CELEBORN-1713] RpcTimeoutException should include RPC address in message ethanfeng
• 2024/11/25 (celeborn-website) 01/10: gitignore github-bot
• 2024/11/25 (celeborn-website) 02/10: .github/bin/build_docs.sh github-bot
• 2024/11/25 (celeborn-website) 10/10: .asf.yaml github-bot
• 2024/11/25 (celeborn) branch main updated: [CELEBORN-1543][FOLLOWUP] License check adds flink-1.20 profile ethanfeng
• 2024/11/24 (celeborn-website) 10/10: .asf.yaml github-bot
• 2024/11/24 (celeborn-website) 01/10: gitignore github-bot
• 2024/11/24 (celeborn-website) 02/10: .github/bin/build_docs.sh github-bot
• 2024/11/23 (celeborn-website) 02/10: .github/bin/build_docs.sh github-bot
• 2024/11/23 (celeborn-website) 10/10: .asf.yaml github-bot
• 2024/11/23 (celeborn-website) 01/10: gitignore github-bot
• 2024/11/22 (celeborn) branch main updated: [CELEBORN-1634][FOLLOWUP] Simplify the logic of the `RpcSource.addTimer` and `RpcSource.updateTimer` fchen
• 2024/11/22 (celeborn-website) 10/10: .asf.yaml github-bot
• 2024/11/22 (celeborn-website) 01/10: gitignore github-bot
• 2024/11/22 (celeborn-website) 02/10: .github/bin/build_docs.sh github-bot
• 2024/11/22 (celeborn) branch branch-0.5 updated: [RELEASE] Bump 0.5.3-SNAPSHOT nicholasjiang
• 2024/11/22 svn commit: r73210 - /dev/celeborn/v0.5.2-rc6/ nicholasjiang
• 2024/11/22 (celeborn) branch branch-0.5 updated: [RELEASE] Bump 0.5.2 nicholasjiang
• 2024/11/22 (celeborn) tag v0.5.2-rc6 created (now 513bd5995) nicholasjiang
• 2024/11/22 (celeborn) branch main updated: [CELEBORN-1724][CIP-14] Add environment setup tools for CppClient development ethanfeng
• 2024/11/22 (celeborn) branch main updated: [CELEBORN-1545] Add Tez plugin skeleton and dag app master ethanfeng
• 2024/11/22 (celeborn) branch branch-0.5 updated: [CELEBORN-1727][FOLLOWUP] Fix CelebornHashCheckDiskSuite flaky test rexxiong
• 2024/11/22 (celeborn) branch main updated: [CELEBORN-1727][FOLLOWUP] Fix CelebornHashCheckDiskSuite flaky test rexxiong
• 2024/11/21 (celeborn) branch branch-0.5 updated: [CELEBORN-1726][FOLLOWUP] Avoid NPE when transition worker state nicholasjiang
• 2024/11/21 (celeborn) branch main updated: [CELEBORN-1726][FOLLOWUP] Avoid NPE when transition worker state nicholasjiang
• 2024/11/21 (celeborn) branch main updated: [CELEBORN-1530] support MPU for S3 ethanfeng
• 2024/11/21 (celeborn) branch main updated (99a34f36b -> 317cb973d) ethanfeng
• 2024/11/21 (celeborn) branch main updated: [CELEBORN-1618][CIP-11] Supporting tags via DB Config Service ethanfeng
• 2024/11/21 (celeborn-website) 02/10: .github/bin/build_docs.sh github-bot
• 2024/11/21 (celeborn-website) 10/10: .asf.yaml github-bot
• 2024/11/21 (celeborn-website) 01/10: gitignore github-bot
• 2024/11/21 (celeborn) branch branch-0.5 updated: [CELEBORN-1728] Fix NPE when failing to connect to celeborn worker ethanfeng
• 2024/11/21 (celeborn) branch main updated: [CELEBORN-1728] Fix NPE when failing to connect to celeborn worker ethanfeng
• 2024/11/21 (celeborn) branch branch-0.5 updated: [CELEBORN-1727] Correct the calculation of worker diskInfo actualUsableSpace ethanfeng
• 2024/11/21 (celeborn) branch main updated: [CELEBORN-1727] Correct the calculation of worker diskInfo actualUsableSpace ethanfeng
• 2024/11/20 (celeborn-website) 01/10: gitignore github-bot
• 2024/11/20 (celeborn-website) 02/10: .github/bin/build_docs.sh github-bot
• 2024/11/20 (celeborn-website) 10/10: .asf.yaml github-bot
• 2024/11/20 (celeborn) branch branch-0.4 updated: [CELEBORN-1485][0.4] Refactor addCounter, addGauge and addTimer of AbstractSource to reduce CPU utilization fchen
• 2024/11/20 (celeborn) branch branch-0.5 updated: [CELEBORN-1726] Update WorkerInfo when transition worker state rexxiong
• 2024/11/20 (celeborn) branch main updated: [CELEBORN-1726] Update WorkerInfo when transition worker state rexxiong
• 2024/11/20 (celeborn) branch main updated: [CELEBORN-1719] Introduce celeborn.client.spark.stageRerun.enabled with alternative celeborn.client.spark.fetch.throwsFetchFailure to enable spark stage rerun nicholasjiang
• 2024/11/20 (celeborn) branch main updated: [CELEBORN-1631][FOLLOWUP] Add latest snapshot index in message of HandleResponse for /snapshot/create nicholasjiang
• 2024/11/20 (celeborn) branch branch-0.4 updated (45f404d51 -> 959b771fb) fchen
• 2024/11/19 (celeborn) branch main updated: [CELEBORN-1715] RemoteShuffleMaster should check celeborn.client.push.replicate.enabled in constructor nicholasjiang
• 2024/11/19 (celeborn-website) 02/10: .github/bin/build_docs.sh github-bot
• 2024/11/19 (celeborn-website) 01/10: gitignore github-bot
• 2024/11/19 (celeborn-website) 10/10: .asf.yaml github-bot
• 2024/11/19 (celeborn-website) 01/10: gitignore github-bot
• 2024/11/19 (celeborn-website) branch main updated: add user kcbebank (#89) nicholasjiang
• 2024/11/19 (celeborn-website) 02/10: .github/bin/build_docs.sh github-bot
• 2024/11/19 (celeborn-website) 10/10: .asf.yaml github-bot
• 2024/11/18 (celeborn) branch branch-0.5 updated: [RELEASE] Bump 0.5.3-SNAPSHOT nicholasjiang
• 2024/11/18 svn commit: r73143 - /dev/celeborn/v0.5.2-rc5/ nicholasjiang
• 2024/11/18 (celeborn) tag v0.5.2-rc5 created (now c057e960f) nicholasjiang
• 2024/11/18 (celeborn) branch main updated: [CELEBORN-1686][FOLLOWUP] Avoid NPE when clean up data pusher nicholasjiang
• 2024/11/18 (celeborn) branch branch-0.5 updated: [RELEASE] Bump 0.5.2 nicholasjiang
• 2024/11/18 (celeborn) branch branch-0.5 updated: [CELEBORN-1686][FOLLOWUP] Avoid NPE when clean up data pusher nicholasjiang
• 2024/11/18 (celeborn-website) 01/10: gitignore github-bot
• 2024/11/18 (celeborn-website) 02/10: .github/bin/build_docs.sh github-bot
• 2024/11/18 (celeborn-website) 10/10: .asf.yaml github-bot
• 2024/11/18 (celeborn-website) 01/10: gitignore github-bot
• 2024/11/18 (celeborn) branch main updated: [CELEBORN-1619][CELEBORN-474][FOLLOWUP] TagsManager uses JavaUtils#newConcurrentHashMap to speed up ConcurrentHashMap#computeIfAbsent nicholasjiang
• 2024/11/17 (celeborn) branch main updated: [CELEBORN-1634] Support queue time/processing time metrics for rpc framework rexxiong
• 2024/11/17 (celeborn-website) 10/10: .asf.yaml github-bot
• 2024/11/17 (celeborn-website) 02/10: .github/bin/build_docs.sh github-bot
• 2024/11/17 (celeborn-website) 10/10: .asf.yaml github-bot
• 2024/11/16 (celeborn-website) 01/10: gitignore github-bot
• 2024/11/16 (celeborn-website) 02/10: .github/bin/build_docs.sh github-bot
• 2024/11/16 (celeborn-website) 10/10: .asf.yaml github-bot
• 2024/11/15 (celeborn-website) 01/10: gitignore github-bot
• 2024/11/15 (celeborn-website) 02/10: .github/bin/build_docs.sh github-bot
• 2024/11/15 (celeborn) branch main updated: [CELEBORN-1707] Audit all RESTful api calls and use separate restAuditFile nicholasjiang
• 2024/11/15 (celeborn) branch main updated: [CELEBORN-1714] Optimize handleApplicationLost nicholasjiang
• 2024/11/15 (celeborn) branch branch-0.5 updated: [CELEBORN-1717] Fix ReusedExchangedSuit UT bug nicholasjiang
• 2024/11/15 (celeborn) branch main updated: [CELEBORN-1717] Fix ReusedExchangedSuit UT bug nicholasjiang
• 2024/11/15 (celeborn) branch main updated: [CELEBORN-1718] Fix memory storage file won't hard split when memory file is full and worker has no disks nicholasjiang
• 2024/11/15 (celeborn) branch branch-0.5 updated: [CELEBORN-1718] Fix memory storage file won't hard split when memory file is full and worker has no disks nicholasjiang
• 2024/11/15 (celeborn) branch main updated: [CELEBORN-1490][FOLLOWUP] Polish CelebornTierProducerAgent nicholasjiang
• 2024/11/14 (celeborn-website) 10/10: .asf.yaml github-bot
• 2024/11/14 (celeborn-website) 02/10: .github/bin/build_docs.sh github-bot
• 2024/11/14 (celeborn-website) 01/10: gitignore github-bot
• 2024/11/14 (celeborn) branch branch-0.5 updated: [RELEASE] Bump 0.5.2 nicholasjiang
• 2024/11/14 (celeborn) branch branch-0.5 updated: [RELEASE] Bump 0.5.3-SNAPSHOT nicholasjiang
• 2024/11/14 svn commit: r73091 - /dev/celeborn/v0.5.2-rc4/ nicholasjiang
• 2024/11/14 (celeborn) tag v0.5.2-rc4 created (now 7fd96fdde) nicholasjiang
• 2024/11/13 (celeborn) 01/01: [CELEBORN-1705] Fix disk buffer size is negative issue feiwang
• 2024/11/13 (celeborn) branch branch-0.5 updated (28b2f56e1 -> 5c6a2c85f) feiwang
• 2024/11/13 (celeborn) branch branch-0.5 updated: [CELEBORN-1705] Fix disk buffer size is negative issue ethanfeng
• 2024/11/13 (celeborn) branch main updated: [CELEBORN-1705] Fix disk buffer size is negative issue ethanfeng
• 2024/11/13 (celeborn) branch main updated: [CELEBORN-1660] Cache available workers and only count the available workers device free capacity rexxiong
• 2024/11/13 (celeborn) branch main updated (def5254ec -> 7fbf0e2fa) chengpan
• 2024/11/13 (celeborn-website) 01/10: gitignore github-bot
• 2024/11/13 (celeborn-website) 10/10: .asf.yaml github-bot
• 2024/11/13 (celeborn-website) 02/10: .github/bin/build_docs.sh github-bot
• 2024/11/13 (celeborn) branch main updated: [CELEBORN-1504][FOLLOWUP] Document adds Flink 1.16 support ethanfeng
• 2024/11/12 (celeborn-website) 01/10: gitignore github-bot
• 2024/11/12 (celeborn-website) 02/10: .github/bin/build_docs.sh github-bot
• 2024/11/12 (celeborn-website) 10/10: .asf.yaml github-bot
• 2024/11/12 (celeborn) branch main updated: [CELEBORN-1685][FOLLOWUP] CelebornShuffleFallbackPolicyRunner should compute shuffleFallbackCounts via class name of ShuffleFallbackPolicy implementation rexxiong
• 2024/11/11 (celeborn) branch main updated: [CELEBORN-1711][TEST] Fix '65535' port is invalid feiwang
• 2024/11/11 (celeborn) branch branch-0.5 updated: [RELEASE] Bump 0.5.3-SNAPSHOT nicholasjiang
• 2024/11/11 svn commit: r72999 - /dev/celeborn/v0.5.2-rc3/ nicholasjiang
• 2024/11/11 (celeborn) tag v0.5.2-rc3 created (now 8ac06dfe6) nicholasjiang
• 2024/11/11 (celeborn) branch branch-0.5 updated: [RELEASE] Bump 0.5.2 nicholasjiang
• 2024/11/11 (celeborn) branch main updated: [CELEBORN-1601][FOLLOWUP] Refine the RESTful apis for revise lost shuffles rexxiong
• 2024/11/11 (celeborn) branch branch-0.5 updated: [CELEBORN-1071] Support stage rerun for shuffle data lost rexxiong
• 2024/11/11 (celeborn) branch main updated: [CELEBORN-1071] Support stage rerun for shuffle data lost rexxiong
• 2024/11/11 (celeborn-website) 02/10: .github/bin/build_docs.sh github-bot
• 2024/11/11 (celeborn-website) 01/10: gitignore github-bot
• 2024/11/11 (celeborn-website) 10/10: .asf.yaml github-bot
• 2024/11/11 (celeborn) branch main updated: [CELEBORN-1702] Bump Ratis version from 3.1.1 to 3.1.2 ethanfeng
• 2024/11/11 (celeborn) branch main updated: [CELEBORN-1708] Bump protobuf version from 3.21.7 to 3.25.5 ethanfeng
• 2024/11/11 (celeborn) branch main updated: [CELEBORN-1709] Bump jetty version from 9.4.52.v20230823 to 9.4.56.v20240826 ethanfeng
• 2024/11/11 (celeborn) branch main updated (8b54ed8c3 -> 6d2b9f6d9) ethanfeng
• 2024/11/11 (celeborn) branch main updated: [CELEBORN-1504][FOLLOWUP] Start test nodes in random ports to allow multiple builds run in the same ci server ethanfeng
• 2024/11/10 (celeborn) branch branch-0.4 updated: [CELEBORN-1686] Avoid return the same pushTaskQueue rexxiong
• 2024/11/10 (celeborn) branch main updated: [CELEBORN-1685] ShuffleFallbackPolicy supports ShuffleFallbackCount metric rexxiong
• 2024/11/10 (celeborn) branch branch-0.5 updated: [CELEBORN-1686] Avoid return the same pushTaskQueue rexxiong
• 2024/11/10 (celeborn) branch main updated: [CELEBORN-1686] Avoid return the same pushTaskQueue rexxiong
• 2024/11/10 (celeborn-website) 10/10: .asf.yaml github-bot
• 2024/11/10 (celeborn-website) 01/10: gitignore github-bot
• 2024/11/10 (celeborn-website) 02/10: .github/bin/build_docs.sh github-bot
• 2024/11/09 (celeborn-website) 10/10: .asf.yaml github-bot
• 2024/11/09 (celeborn-website) 01/10: gitignore github-bot
• 2024/11/09 (celeborn-website) 02/10: .github/bin/build_docs.sh github-bot
• 2024/11/08 (celeborn-website) 02/10: .github/bin/build_docs.sh github-bot
• 2024/11/08 (celeborn-website) 10/10: .asf.yaml github-bot
• 2024/11/08 (celeborn-website) 01/10: gitignore github-bot
• 2024/11/07 (celeborn) branch main updated (164c66349 -> 4545cdc40) nicholasjiang
• 2024/11/07 (celeborn-website) 10/10: .asf.yaml github-bot
• 2024/11/07 (celeborn-website) 02/10: .github/bin/build_docs.sh github-bot
• 2024/11/07 (celeborn-website) 01/10: gitignore github-bot
• 2024/11/07 (celeborn) branch main updated: [MINOR] Fix docs typo ethanfeng
• 2024/11/07 (celeborn) branch branch-0.5 updated: [CELEBORN-1696] StorageManager#cleanFile should remove file info rexxiong
• 2024/11/07 (celeborn) branch main updated: [CELEBORN-1696] StorageManager#cleanFile should remove file info rexxiong
• 2024/11/07 (celeborn) branch branch-0.5 updated: [CELEBORN-1691] Fix the issue that upstream tasks don't rerun and the current task still retry when failed to decompress in flink rexxiong
• 2024/11/07 (celeborn) branch main updated: [CELEBORN-1691] Fix the issue that upstream tasks don't rerun and the current task still retry when failed to decompress in flink rexxiong
• 2024/11/07 (celeborn) branch main updated: [CELEBORN-1697] Improve ThreadStackTrace for thread dump ethanfeng
• 2024/11/06 (celeborn) branch branch-0.5 updated: [CELEBORN-1692] Set mount point in fromPbFileInfoMap nicholasjiang
• 2024/11/06 (celeborn) branch main updated (4e7df13af -> 4b8b125a1) nicholasjiang
• 2024/11/06 (celeborn) branch branch-0.5 updated: [CELEBORN-1693] Fix storageFetcherPool concurrent problem nicholasjiang
• 2024/11/06 (celeborn) branch main updated: [CELEBORN-1693] Fix storageFetcherPool concurrent problem nicholasjiang
• 2024/11/06 (celeborn) branch main updated: [CELEBORN-1680] Introduce ShuffleFallbackCount metrics ethanfeng
• 2024/11/06 (celeborn) branch main updated: [MINOR] Remove unused TODO comments in CelebornTierProducerAgent#processBuffer rexxiong
• 2024/11/06 (celeborn-website) 01/10: gitignore github-bot
• 2024/11/06 (celeborn-website) 10/10: .asf.yaml github-bot
• 2024/11/06 (celeborn-website) 02/10: .github/bin/build_docs.sh github-bot
• 2024/11/05 (celeborn) branch branch-0.5 updated: [CELEBORN-1671] CelebornShuffleReader will try replica if create client failed rexxiong

• Earlier messages
• Later messages