commits  

Messages by Thread

• (paimon) branch master updated: [core] Improve parameter naming in HadoopSecuredFileSystem.create method (#6072) lzljs3620320
• (paimon) branch master updated: [core] Support Kerberos authentication (#6059) lzljs3620320
• (paimon) branch master updated: [core] optimize validate fields functions (#6061) lzljs3620320
• (paimon) branch master updated: [fs] Set credentials provider in JindoFileIO (#6064) lzljs3620320
• (paimon) branch master updated: [python] Introduce TableScan.with_shard (#6068) lzljs3620320
• (paimon) branch master updated: [hotfix] Add hadoopConf in RESTTokenFileIO lzljs3620320
• (paimon) branch master updated: [flink] Refactor WriterRefresher to better abstraction (#6070) lzljs3620320
• (paimon) branch master updated (ace9a5972c -> bbfe5ee28d) lzljs3620320
• (paimon) branch master updated (2c73863f47 -> ace9a5972c) lzljs3620320
• (paimon-website) branch asf-site updated (7db449520 -> 2eb2ef9bb) github-bot
• (paimon) branch master updated (469b49e485 -> 2c73863f47) lzljs3620320
• (paimon) branch master updated (fa85554089 -> 469b49e485) lzljs3620320
• (paimon) branch master updated (7615188e04 -> fa85554089) lzljs3620320
• (paimon) branch master updated: [spark] Allow automatic casting in the where condiction of compact procedure (#6056) lzljs3620320
• (paimon-website) branch asf-site updated (e58b806cf -> 7db449520) github-bot
• (paimon) branch master updated: [core] Add support for IN predicate pushdown in ORC format (#6047) lzljs3620320
• (paimon) branch master updated: [core] Fix that partition filter wasn't transformed by field mapping when scan (#6054) lzljs3620320
• (paimon) branch master updated: [python] Fix bytes bug and isort (#6052) lzljs3620320
• (paimon) branch master updated: [core] Fix default value not work for primary key table with bucket -1 (#6050) junhao
• (paimon) branch master updated: [core] Refactor and add tests for data evolution union read (#6053) junhao
• (paimon) branch master updated: [spark] Optimize the config reading for load table in SparkSource (#6049) lzljs3620320
• (paimon) branch master updated: [test][spark] Add more row lineage test cases (#6051) lzljs3620320
• (paimon) branch master updated: [core] Introduce Tests for OffPeakHours and FullCompactTrigger (#6044) lzljs3620320
• (paimon-website) branch asf-site updated (e05b44a3b -> e58b806cf) github-bot
• (paimon) branch master updated: [spark] Support MERGE for row lineage (#6045) lzljs3620320
• (paimon) branch master updated (7565adabda -> a70a6507fc) lzljs3620320
• (paimon) branch master updated: [doc] Modify aliases of row-tracking lzljs3620320
• (paimon-website) branch asf-site updated (1aca0b479 -> e05b44a3b) github-bot
• (paimon) branch master updated: [core] Code Refactor for Data Evolution lzljs3620320
• (paimon-website) branch asf-site updated (1fd8d8639 -> 1aca0b479) github-bot
• (paimon) branch master updated: [doc] Fix branch name (#6042) lzljs3620320
• (paimon) branch master updated (52eed0ae64 -> 39cc7a2afb) lzljs3620320
• (paimon) branch master updated: [hotfix] Remove incorrect message in DataFileMeta lzljs3620320
• (paimon) branch master updated: [spark] Fix insert with write.merge-schema (#6041) lzljs3620320
• (paimon-website) branch asf-site updated (8f321a811 -> 1fd8d8639) github-bot
• (paimon) branch master updated: [spark] Unify config extraction for maxPartitionBytes and openCostInBytes between paimon and spark (#6037) lzljs3620320
• (paimon) branch master updated: [python] fix ecs role loader (#6035) lzljs3620320
• (paimon) branch master updated: [iceberg] fix exception message. (#6036) lzljs3620320
• (paimon) branch master updated: [python] Enrich dependencies to README lzljs3620320
• (paimon) branch master updated: [python] Add dependencies to README lzljs3620320
• (paimon) branch master updated: [Python] Support write table for RESTCatalog (#6030) lzljs3620320
• (paimon) branch master updated: [test][spark] Add partition expiration test (#6034) junhao
• (paimon-website) branch asf-site updated (ca870c32f -> 8f321a811) github-bot
• (paimon) branch master updated: [common] Minor fix for range-bitmap (#6033) lzljs3620320
• (paimon-website) branch asf-site updated (e190b2006 -> ca870c32f) github-bot
• (paimon) branch master updated (53a5b03461 -> b5cda85cde) lzljs3620320
• (paimon) branch master updated (926c381024 -> 53a5b03461) lzljs3620320
• (paimon) branch master updated: [cdc] Support computed column referring to each other while sync_table (#5972) yuzelin
• (paimon-website) branch asf-site updated (4265c12ec -> e190b2006) github-bot
• (paimon) branch master updated (5b19b57c6c -> c0f1ffbcce) lzljs3620320
• (paimon) branch master updated: [core] Introduce PrimaryKeyTableUtils.validatePKUpsertDeletable to reuse codes lzljs3620320
• (paimon) branch master updated: [spark] fix audit_log streaming read for rowkind delete (#6021) lzljs3620320
• (paimon) branch master updated (a2b23dcf08 -> 52838bdb8c) lzljs3620320
• (paimon) branch master updated (185b2e57c9 -> a2b23dcf08) lzljs3620320
• (paimon) branch master updated (05cc2a20c5 -> 185b2e57c9) junhao
• (paimon) branch master updated (96bdae4068 -> 05cc2a20c5) lzljs3620320
• (paimon) branch master updated (9793945b06 -> 96bdae4068) junhao
• (paimon-website) branch asf-site updated (7964ffab6 -> 4265c12ec) github-bot
• (paimon-website) branch asf-site updated (a18002f65 -> 7964ffab6) github-bot
• (paimon) branch master updated: [flink][util] MultipleParameterToolAdapter supports merging other parameters (#6016) lzljs3620320
• (paimon-website) branch asf-site updated (a3171ff08 -> a18002f65) github-bot
• (paimon) branch master updated: [core] Introduce expireForEmptyCommit to InnerTableCommit (#6013) yuzelin
• (paimon) branch master updated (007b317655 -> 1faed06496) yuzelin
• (paimon) branch master updated (ca7e1ccbe8 -> 007b317655) lzljs3620320
• (paimon) branch master updated: [python] Fix schema api bug (#6010) lzljs3620320
• (paimon) branch master updated: [pvfs] Support define endpoint in path (#6008) lzljs3620320
• (paimon) branch master updated: [flink] Predicate add is true and is false (#6005) lzljs3620320
• (paimon) branch master updated: [Core] Custom commit callback support to be initialized with table (#6004) lzljs3620320
• (paimon) branch master updated: [python] Support mutual conversion between paimon DataField and pyarrow Field (#6000) lzljs3620320
• (paimon) branch master updated: [core] delete branch external file when drop table (#5871) lzljs3620320
• (paimon) branch master updated: [spark] Add log for creating default database when not exist (#5999) lzljs3620320
• (paimon) branch master updated: [core][spark] Support reading row lineage metadata column (#5985) lzljs3620320
• (paimon) branch master updated: [python] Support table write for PyPaimon (#6001) lzljs3620320
• (paimon) branch master updated: [pvfs] Support inline endpoint in pvfs uri, like pvfs://catalog.endpoint/ (#6003) lzljs3620320
• (paimon) branch master updated: Site/nit: Replace PPMC with PMC (#6006) lzljs3620320
• (paimon-website) branch asf-site updated (81d99e996 -> a3171ff08) github-bot
• (paimon) branch master updated: [Python] Support data writer for PyPaimon (#5997) lzljs3620320
• (paimon) branch master updated: [Python] Support scan and plan for PyPaimon (#5996) lzljs3620320
• (paimon) branch master updated: [flink-cdc] Provide option to disable use of source primary keys if primary keys in action command are not specified for CDC ingestion. (#5793) lzljs3620320
• (paimon) branch master updated: Revert "[core] Add compaction.force-wait to support force waiting compaction finish when preparing commit (#5994)" (#5995) lzljs3620320
• (paimon) branch master updated (811a9d319c -> 33f5fb9d2e) lzljs3620320
• (paimon) branch master updated (e2eff2f9d1 -> 811a9d319c) lzljs3620320
• (paimon) branch master updated: [core] fix column rename when columns referenced by table options. (#5964) lzljs3620320
• (paimon) branch master updated: [core] Log a warning for invalid partition values instead of throwing an exception when enable partition mark done. (#5978) lzljs3620320
• (paimon) branch master updated: [core] Row-tracking row should keep their row_id and sequence_number in compaction (#5991) lzljs3620320
• (paimon) branch master updated: [core] Add compaction.force-wait to support force waiting compaction finish when preparing commit (#5994) lzljs3620320
• (paimon) branch master updated: [format] Introduce 'write.batch-memory' to control memory in arrow (#5988) lzljs3620320
• (paimon) branch master updated (f324d9b262 -> be3703ce71) lzljs3620320
• (paimon) branch master updated (df372d1fd3 -> f324d9b262) lzljs3620320
• (paimon) branch master updated (56585c0bee -> df372d1fd3) lzljs3620320
• (paimon) branch master updated: [Python] Support snapshot and manifest for PyPaimon (#5987) lzljs3620320
• (paimon) branch master updated: [python] Change Schema to TableSchema in Class GetTableResponse. (#5990) lzljs3620320
• (paimon) branch master updated: [core] Introduce 'compaction.total-size-threshold' to do full compaction (#5973) yuzelin
• (paimon-website) branch asf-site updated (25f4d9b8c -> 81d99e996) github-bot
• (paimon) branch master updated: [Python] Support filesystem catalog for PyPaimon (#5986) lzljs3620320
• (paimon) branch master updated: [core] Add lance table type for rest catalog (#5977) biyan
• (paimon-website) branch asf-site updated (667419276 -> 25f4d9b8c) github-bot
• (paimon) branch master updated: [VFS] Fix PVFS trash behavior for Hadoop TrashPolicy (#5975) lzljs3620320
• (paimon) branch master updated: [common] Correct the range-bitmap's dictionary return results (#5980) lzljs3620320
• (paimon) branch master updated: [hotfix] Minor improve for FileStoreCommitImpl lzljs3620320
• (paimon) branch master updated: [python] Support schema manager for PyPaimon (#5974) lzljs3620320
• (paimon) branch master updated: [core] Optimize FileDeletionBase.cleanUnusedIndexManifests to less file io (#5979) lzljs3620320
• (paimon) branch master updated: [python] pvfs: support table cache (#5965) lzljs3620320
• (paimon) branch master updated (798378fa22 -> bb39b744c2) lzljs3620320
• (paimon) branch master updated: [doc][hotfix] Correct Doris's URL link (#5970) lzljs3620320
• (paimon) branch master updated: [format] fix parquet visitOr error comment (#5969) lzljs3620320
• (paimon-website) branch asf-site updated (c7a0daa26 -> 667419276) github-bot
• (paimon) branch master updated: [core] Row lineage core support. (#5935) lzljs3620320
• (paimon) branch master updated: [flink] Introduce 'sink.writer-coordinator.page-size' to control RPC size (#5960) junhao
• (paimon) branch master updated: [python] Support get_table method of python RestCatalog (#5962) lzljs3620320
• (paimon) branch master updated: [hotfix] Fix Java SPI for RangeBitmapFileIndexFactory lzljs3620320
• (paimon) branch master updated (bd2618b611 -> 248cd586b2) lzljs3620320
• (paimon-website) branch asf-site updated (a988be9cd -> c7a0daa26) github-bot
• (paimon-website) branch asf-site updated (76ab1c250 -> a988be9cd) github-bot
• (paimon-website) branch asf-site updated (e69efa087 -> 76ab1c250) github-bot
• (paimon) branch master updated: [core] Batch tag supports custom time zone (#5954) lzljs3620320
• (paimon) branch master updated: [flink] SqlPredicate add not in (#5957) lzljs3620320
• (paimon) branch master updated: [VFS] Enable table cache in PVFS (#5958) lzljs3620320
• (paimon) branch master updated: [python] Support database query function of python rest catalog (#5961) lzljs3620320
• (paimon) branch master updated: [spark][infra] run spark integration tests in CI. (#5590) lzljs3620320
• (paimon-website) branch asf-site updated (1121ef06f -> e69efa087) github-bot
• (paimon) branch master updated: [python] Independent triggering of Python workflows (#5953) lzljs3620320
• (paimon) branch master updated: [python] Support pfvs in python (#5930) lzljs3620320
• (paimon) branch master updated: [core] Introduce HttpClientUtils to reuse methods lzljs3620320
• (paimon) branch master updated (8664282004 -> 5cc7b9886a) lzljs3620320
• (paimon) branch master updated: [core] fix that branch can't be streamingly read if setting fallback branch (#5952) lzljs3620320
• (paimon) branch master updated: [hotfix] Fix npe when init TagManager with empty branch (#5948) yuzelin
• (paimon) branch master updated (f1b91c4d9e -> b94633fb31) lzljs3620320
• (paimon) branch master updated: [spark] Enable v2 dynamic partition overwrite (#5947) lzljs3620320
• (paimon) branch master updated: [core] make ignoreEmptyCommit configurable (#5941) lzljs3620320
• (paimon) branch master updated: [vfs] Support Mkdir & Create in non-existing table (#5942) lzljs3620320
• (paimon) branch master updated: [vfs] Clean VFSIdentifier classes to remove unuse codes lzljs3620320
• (paimon) branch master updated: [rest] Refactory RESTTokenFileIO to let it reused in vfs (#5939) lzljs3620320
• (paimon) branch master updated: [vfs] Implement Paimon Virtual Filesystem (#5916) lzljs3620320
• (paimon) branch master updated: [flink] FlinkCatalog#listTables returns both tables and views (#5910) lzljs3620320
• (paimon-website) branch asf-site updated (c4a11172b -> 1121ef06f) github-bot
• (paimon) branch master updated (af0d4162e8 -> 9a41976fd2) lzljs3620320
• (paimon) branch master updated: [core] Refactory evolved and not evolved filters in file store scan (#5934) lzljs3620320
• (paimon) branch master updated: [core] Use latestSnapshotIdFromFileSystem in NextSnapshotFetcher lzljs3620320
• (paimon) branch master updated (2aef438c28 -> 6c52df7bad) lzljs3620320
• (paimon) branch master updated (7ae6448377 -> 2aef438c28) lzljs3620320
• (paimon) branch master updated: [core] process-time TagTimeExtractor supports custom zone (#5927) lzljs3620320
• (paimon) branch master updated (2a70b56982 -> ee278954e0) lzljs3620320
• (paimon) branch master updated: [core] Fix stats filter by pushdown after schema evolution (#5825) lzljs3620320
• (paimon) branch master updated: [core] Optimize beforeSnapshot to LazyField in SnapshotReaderImpl lzljs3620320
• (paimon) branch master updated: [core] Optimize shouldDelaySnapshot in DataTableStreamScan lzljs3620320
• (paimon) branch master updated: [core] Optimize getNextSnapshot in NextSnapshotFetcher to return fast lzljs3620320
• (paimon-trino) branch old_version_master updated: [388] Cherry-pick incremental read from https://github.com/apache/paimon-trino/commit/5697da8de19a60e52842fd86d612c99e35aa0877\#diff-e62f488a14d012b280ffd60b07e6a3915757e393f68103b42fd3262adc0b9d61, make it suitable for trino-388 junhao
• (paimon-website) branch asf-site updated (8027ecc20 -> c4a11172b) github-bot
• (paimon) branch master updated: [core] Support off-peak hours in universal compaction (#5928) lzljs3620320
• (paimon) branch master updated: [rest] Create external table path if not exist (#5925) lzljs3620320
• (paimon) branch master updated: [hotfix] Document difference between CommitListener and CommitCallback lzljs3620320
• (paimon) branch master updated (3abee4d3c7 -> d0961e0eaa) lzljs3620320
• (paimon) branch master updated: [python] api: support ecs role auth (#5913) lzljs3620320
• (paimon) branch release-1.2 updated: [doc] Update overview architecture png lzljs3620320
• (paimon) branch master updated: [flink] Support parallelismConfigured in Non-DynamicBucket cases (#5924) lzljs3620320
• (paimon-website) branch asf-site updated (493b492f9 -> 8027ecc20) github-bot
• (paimon-website) branch master updated: Fix the mistakes (#18) yuzelin
• (paimon) branch fixxx deleted (was 32f1b63374) yuzelin
• (paimon) branch try-fix-website deleted (was e198e0c831) yuzelin
• (paimon) branch master updated (5310ee15fa -> 7b8d1a33a4) yuzelin
• (paimon) branch master updated (9d80ffec50 -> 5310ee15fa) lzljs3620320
• (paimon) branch master updated (9b0c90c476 -> 9d80ffec50) lzljs3620320
• (paimon-website) branch master updated: hotfix: fix javadoc building (#22) lzljs3620320
• (paimon) branch try-fix-website updated: [doc] Keep old javadoc plugin for paimon website building (#5926) lzljs3620320
• (paimon) branch try-fix-website created (now d374e7c4f3) yuzelin
  • (paimon) 01/01: try-fix-website yuzelin
• (paimon-website) branch master updated (a22411f01 -> d7a9e5886) yuzelin
  • (paimon-website) 01/01: feat: add release 1.2.0 doc yuzelin
• (paimon-website) branch master updated (63e051d48 -> a22411f01) yuzelin
  • (paimon-website) 02/02: feat(optional): message yuzelin
  • (paimon-website) 01/02: [temp] yuzelin
• (paimon) branch master updated: [flink] Add clone from Paimon tables in clone action (#5911) lzljs3620320
• (paimon) branch master updated: [python] Auto check code style (#5917) lzljs3620320
• (paimon) branch master updated: [flink] Refactor code in RewritePostponeBucketCommittableOperator (#5923) lzljs3620320
• (paimon) branch master updated: [spark] Support create auto tag syntax (#5909) yuzelin
• (paimon) branch master updated: [arrow] Fix map type conversion from paimon type to arrow type (#5922) yuzelin
• (paimon) branch fixxx created (now 32f1b63374) junhao
  • (paimon) 01/01: [arrow] Fix map type conversion from paimon type to arrow type junhao
• (paimon-website) branch master updated: feat: add release 1.2.0 doc (#21) lzljs3620320
• (paimon-website) branch release-1.2-doc updated (72ab7455b -> 2f068d0cd) yuzelin
• (paimon) branch master updated: [iceberg] support partition predicate for clone-iceberg (#5912) lzljs3620320
• (paimon) branch master updated: [python] Add ci and build to the python project (#5914) lzljs3620320
• (paimon) branch master updated: [core][flink] Streaming first plan refactor level0 filtering to avoid that full mode wrong (#5866) lzljs3620320
• (paimon-website) branch release-1.2-doc created (now 72ab7455b) yuzelin
  • (paimon-website) 01/01: feat: add release 1.2.0 doc yuzelin
• (paimon) branch release-1.1 updated: [ci] show maven & paimon version (#5899) lzljs3620320
• (paimon) branch master updated: [deploy] Suppress doc generation error when using JDK17 (#5904) lzljs3620320
• (paimon-website) branch asf-site updated (360cc021f -> 493b492f9) github-bot
• (paimon) branch master updated: [hive] respect hive split.minsize/maxsize configs (#5903) zouxxyy
• (paimon) branch master updated (b9f188e36c -> 0cdd85c712) yuzelin
• (paimon) branch master updated: [python] add test for data type (#5900) lzljs3620320
• (paimon) branch master updated (aa5c7c27ac -> 07a6f23c07) lzljs3620320
• (paimon) branch master updated: [core] Normalize changelog file format (#5908) lzljs3620320
• (paimon-website) branch asf-site updated (95969a7a2 -> 360cc021f) github-bot
• (paimon) branch master updated: [spark] Spark write supports 'clustering.columns' (#5902) junhao
• (paimon) branch master updated: [variant] Add shredding function (#5901) lzljs3620320
• (paimon) branch master updated: [variant] Port changes of variant from spark (#5895) lzljs3620320
• (paimon) branch master updated: [flink] fix that AppendBypassCoordinateOperator does not generate compaction tasks. (#5897) lzljs3620320
• (paimon) branch master updated: [clone][iceberg] support clone iceberg tables in hive to paimon (#5888) lzljs3620320

• Earlier messages