commits
Thread
Date
Later messages
Messages by Date
2024/12/19
(paimon) branch master updated: [dependency] Upgrade paimon shade version (#4740)
lzljs3620320
2024/12/18
(paimon) branch master updated: [doc] Add doc for spark drop column with hive catalog
lzljs3620320
2024/12/18
(paimon) branch master updated: [hive] Batch list tables and skip checking table exists in filesystem with hive catalog (#4737)
lzljs3620320
2024/12/18
(paimon) branch master updated: [core] Skip case checking in catalog (#4730)
lzljs3620320
2024/12/17
(paimon) branch master updated (0b684ca6cc -> 99f0b23e3a)
lzljs3620320
2024/12/17
(paimon) branch master updated: [core] Fix predicate literals cast in filter pushdown after schema evolution (#4705)
lzljs3620320
2024/12/17
(paimon) branch master updated: [cdc] add exception message for CdcRecordStoreMultiWriteOperator (#4734)
lzljs3620320
2024/12/17
(paimon) branch master updated: [cdc] Correct equalsIgnoreFieldId in UpdatedDataFieldsProcessFunctionBase
lzljs3620320
2024/12/17
(paimon) branch master updated: [core] Minor refactor for cache metrics
lzljs3620320
2024/12/17
(paimon) branch master updated: [core] Introduce CacheStats and expose ScanStats (#4678)
lzljs3620320
2024/12/17
(paimon) branch master updated: [flink] kafka_sync_database supports db whitelist and blacklist (#4732)
lzljs3620320
2024/12/17
(paimon) branch master updated (0fb6076328 -> 3a9e1e83fa)
biyan
2024/12/16
(paimon) branch master updated (659cf39957 -> 0fb6076328)
lzljs3620320
2024/12/16
(paimon) branch master updated: [core] Refactor MetastoreClient methods to simplify catalog (#4726)
lzljs3620320
2024/12/16
(paimon) branch master updated (cdd5bb72f7 -> 76a2f46a0a)
lzljs3620320
2024/12/16
(paimon-trino) branch main updated: prefer central repo for releases; limit apache-snapshots to snapshots (#94)
lzljs3620320
2024/12/16
(paimon) branch master updated: [core] Clean constants, caseSensitive, loader in Catalog (#4721)
lzljs3620320
2024/12/16
(paimon) branch master updated: [orc] Optimize configuration creating in orc file format (#4716)
lzljs3620320
2024/12/16
(paimon) branch master updated (77670204c9 -> c9eafb6121)
lzljs3620320
2024/12/16
(paimon) branch master updated: [core] Remove Catalog.getTableLocation interface (#4718)
lzljs3620320
2024/12/16
(paimon) branch master updated: [core] Introduce PurgeFilesProcedure to purge table (#4717)
lzljs3620320
2024/12/16
(paimon) branch master updated (9c2f6d15e5 -> 0ccdf251f8)
lzljs3620320
2024/12/15
(paimon) branch master updated: [doc] Specific true column names for manifest files
lzljs3620320
2024/12/15
(paimon) branch master updated: [flink] Enable limit pushdown and count optimization for dv table (#4712)
lzljs3620320
2024/12/15
(paimon) branch master updated: [flink] avoid using 'newHashMapWithExpectedSize' which is internal in flink (#4713)
lzljs3620320
2024/12/15
(paimon-presto) branch main updated: (feat) Support partition pushdown with complex predicate (#45)
lzljs3620320
2024/12/15
(paimon) branch master updated (d61f3d2659 -> 72e7150339)
lzljs3620320
2024/12/14
(paimon) branch master updated: [flink] kafka_sync_database supports different prefix and suffix for different db (#4704)
lzljs3620320
2024/12/13
(paimon) branch master updated: [core] Store `cardinality` in the deletion vector meta (#4699)
lzljs3620320
2024/12/12
(paimon) branch master updated: [core] fix the issue where streaming reading of overwrite data would fail when retract type data appeared. (#4697)
lzljs3620320
2024/12/12
(paimon) branch master updated: [doc] update totalRecordCount and deltaRecordCount in understand-files.md (#4694)
lzljs3620320
2024/12/12
(paimon) branch master updated: [core] Update drop Database API and remove api in URL (#4691)
lzljs3620320
2024/12/11
(paimon) branch master updated (841539755b -> 5a5628ecf0)
lzljs3620320
2024/12/11
(paimon) branch master updated (30dcfb50da -> 841539755b)
lzljs3620320
2024/12/11
(paimon) branch master updated: [core] Remove useless codes in CachingCatalog
lzljs3620320
2024/12/11
(paimon) branch master updated: [core] Clean up invalid branch cache and not cache system table in caching catalog (#4681)
lzljs3620320
2024/12/11
(paimon) branch master updated: [spark] Fix the build of read type in binlog table (#4689)
lzljs3620320
2024/12/11
(paimon) branch master updated: [core] Add database API implementation in RESTCatalog (#4676)
lzljs3620320
2024/12/11
(paimon) branch master updated: [core] Introduce RollbackToWatermarkProcedure for rollback (#4687)
lzljs3620320
2024/12/11
(paimon-python) branch main updated: Add license checker (#34)
lzljs3620320
2024/12/11
(paimon) branch master updated: [doc] Fix links in sql-write
lzljs3620320
2024/12/10
(paimon) branch master updated: [core] Check file size after write bundle of records (#4685)
lzljs3620320
2024/12/10
(paimon) branch master updated: [hotfix] CloneAction throw more clear exception when no table in source catalog (#4682)
lzljs3620320
2024/12/10
(paimon) branch master updated: [doc] updated url links in documentation (#4679)
lzljs3620320
2024/12/10
(paimon) branch master updated (84eadce2b9 -> 90a37c8b81)
lzljs3620320
2024/12/10
(paimon) branch master updated: [docs] add glue metastore repo for iceberg compability (#4674)
lzljs3620320
2024/12/10
(paimon) branch master updated (f8c33c5d72 -> 7400979e0a)
lzljs3620320
2024/12/09
(paimon) branch master updated (c6387a669d -> f8c33c5d72)
lzljs3620320
2024/12/09
(paimon) branch master updated: [hive][spark] Support creating external table without schema when the table already exists (#4638)
lzljs3620320
2024/12/09
(paimon) branch master updated (b6fb471502 -> 3691419635)
czweng
2024/12/09
(paimon) branch master updated: [core] Introduce timeout for commit retry avoid long time loop (#4668)
lzljs3620320
2024/12/09
(paimon) branch master updated (8b4a77a1e1 -> b6fb471502)
zouxxyy
2024/12/09
(paimon) branch master updated: [minor] Fix RESTCatalog.close should close client and refreshExecutor
lzljs3620320
2024/12/09
(paimon) branch master updated: [flink-cdc] kafka_sync_database supports table name mapping when prefix and postfix could not fit the need. (#4660)
lzljs3620320
2024/12/09
(paimon) branch master updated: [core] Support auth in REST Catalog (#4648)
lzljs3620320
2024/12/09
(paimon) branch master updated: [hive] Make HiveMetastoreClient.addPartition thread safe (#4669)
lzljs3620320
2024/12/09
(paimon) branch master updated: [core] Optimize drop partitions to avoid stack overflow (#4663)
czweng
2024/12/08
(paimon) branch master updated: [core] Optimize overwrite commit to use CommitResult to retry (#4661)
czweng
2024/12/08
(paimon) branch master updated: [spark] Paimon parser only resolve own supported procedures (#4662)
lzljs3620320
2024/12/08
(paimon) branch master updated: [core] Optimize memory usage for expiring snapshots and tags (#4655)
czweng
2024/12/08
(paimon) branch master updated: [parquet] Fix minor format codes in parquet readers
lzljs3620320
2024/12/08
(paimon) branch master updated: [flink] support flink sourceIdleTime metric in ReadOperator (#4644)
lzljs3620320
2024/12/06
(paimon) branch master updated: [test][spark] Add insert with column list test case (#4654)
lzljs3620320
2024/12/06
(paimon) branch master updated: [flink] Optimizing parallelism for fixed bucekt and non-partitioned table (#4643)
lzljs3620320
2024/12/06
(paimon) branch master updated: [core] Expire partiitons add default delete num (#4652)
lzljs3620320
2024/12/05
(paimon) branch master updated: [spark] Support show create and describe view (#4645)
lzljs3620320
2024/12/05
(paimon) branch master updated: [flink] Fix that 'values-time' partition expire might throw NPE (#4646)
lzljs3620320
2024/12/04
(paimon) branch master updated: [core] Add parquet write page limit parameter (#4632)
lzljs3620320
2024/12/04
(paimon) branch master updated: [core] Make commit.max-retries behave as it means (#4641)
lzljs3620320
2024/12/04
(paimon) branch master updated: [core] Introduce manifest.delete-file-drop-stats (#4640)
lzljs3620320
2024/12/04
(paimon) branch master updated (05e3e6281e -> 1b694d5333)
lzljs3620320
2024/12/04
(paimon) branch master updated: [core] Fix parquet nextRowPosition bug (#4636)
junhao
2024/12/04
(paimon) branch master updated: [e2e] Try to fix e2e tests timeout by updating kafka docker version (#4637)
lzljs3620320
2024/12/04
(paimon) branch master updated: [core] Drop stats for deleted data files to reduce memory (#4629)
lzljs3620320
2024/12/03
(paimon) branch master updated (749535769a -> 9d641706e8)
lzljs3620320
2024/12/03
(paimon) branch master updated: [tests] Fix @Timeout annotation not working in PrimaryKeyFileStoreTableITCase (#4634)
lzljs3620320
2024/12/03
(paimon) branch master updated: [doc] Minor refactor Python API doc (#4635)
lzljs3620320
2024/12/03
(paimon) branch master updated: [avro] Fix compression not work in writer (#4628)
czweng
2024/12/03
(paimon-python) branch release-0.2 updated (2a31b1c -> 0cbbc84)
yuzelin
2024/12/03
(paimon-python) annotated tag release-0.2.0-rc2 updated (84a67c9 -> 8fa82af)
yuzelin
2024/12/03
svn commit: r73468 - in /dev/paimon/pypaimon-0.2.0-rc2: ./ pypaimon-0.2.0.tar.gz pypaimon-0.2.0.tar.gz.asc pypaimon-0.2.0.tar.gz.sha512
yuzelin
2024/12/03
(paimon) branch master updated: [doc] fix url positioning in documents (#4630)
lzljs3620320
2024/12/03
(paimon-python) 02/02: Don't import duckdb and ray if not used (#33)
yuzelin
2024/12/03
(paimon-python) 01/02: [tool] Shell tool for building source distribution package (#32)
yuzelin
2024/12/03
(paimon) branch master updated: [hive] Add metastore.client.class option to hive catalog configuration document. (#4627)
lzljs3620320
2024/12/03
(paimon) branch master updated: [doc] Add data types in concept (#4625)
lzljs3620320
2024/12/03
(paimon-python) branch main updated: Don't import duckdb and ray if not used (#33)
lzljs3620320
2024/12/02
(paimon) branch master updated: [core] Optimization of Parquet Predicate Pushdown Capability (#4608)
junhao
2024/12/02
(paimon) branch master updated: [spark] show table extended (#4603)
xuzifu666
2024/12/02
(paimon) branch master updated: [core] Extract decompressBlock method in SortLookupStoreReader
lzljs3620320
2024/12/02
(paimon) branch master updated: [core] Make default of 'lookup.local-file-type' to sort (#4622)
lzljs3620320
2024/12/02
(paimon) branch master updated: [flink] Avoid deprecated usage on TableSchema, DataType and DescriptorProperties (#4611)
lzljs3620320
2024/12/02
(paimon) branch master updated: [iceberg] Introduce integration for AWS Glue (#4624)
lzljs3620320
2024/12/02
(paimon-python) branch main updated: [tool] Shell tool for building source distribution package (#32)
lzljs3620320
2024/12/02
(paimon) branch master updated (512e2ce05c -> a5cb687755)
lzljs3620320
2024/12/02
(paimon) branch master updated: [iceberg] Introduce metadata.iceberg.manifest-legacy-version (#4621)
lzljs3620320
2024/12/02
(paimon) branch master updated: [iceberg] Use gzip by default to iceberg avro writer (#4620)
lzljs3620320
2024/12/02
(paimon-python) annotated tag release-0.2.0-rc1 updated (f3a9440 -> d759970)
yuzelin
2024/12/02
svn commit: r73407 - in /dev/paimon/pypaimon-0.2.0-rc1: ./ pypaimon-0.2.0.tar.gz pypaimon-0.2.0.tar.gz.asc pypaimon-0.2.0.tar.gz.sha512
yuzelin
2024/12/02
svn commit: r73408 - in /dev/paimon: paimon-python-0.1.1-rc4/ paimon-python-0.1.1-rc5/ paimon-python-0.1.1-rc6/
yuzelin
2024/12/02
(paimon-python) branch release-0.2 created (now 2a31b1c)
yuzelin
2024/12/02
(paimon-python) branch main updated: [release] Update version to 0.3.dev0
yuzelin
2024/12/02
(paimon) branch master updated: [docs] Add document for nested column evolution (#4619)
lzljs3620320
2024/12/01
(paimon-python) branch main updated: [Build] Refactor project structure and refactor release tools (#31)
lzljs3620320
2024/12/01
(paimon) branch master updated (6f967b4db5 -> 39b82ec160)
lzljs3620320
2024/12/01
(paimon) branch master updated: [core] Make metadata.stats-dense-store default value is true (#4617)
lzljs3620320
2024/12/01
(paimon) branch master updated: [spark] Support changing column types in array<struct> or map<?,struct> (#4618)
lzljs3620320
2024/12/01
(paimon) branch master updated: [rest] change JsonProperty import path (#4609)
lzljs3620320
2024/11/29
(paimon) branch master updated: [core] Remove all lineage implementation (#4607)
liming
2024/11/28
(paimon) branch master updated: [pom] Add name to paimon-open-api
lzljs3620320
2024/11/28
(paimon) branch master updated: [cdc] Add the latest_schema state at schema evolution operator to reduce the latest schema access frequency (#4535)
lzljs3620320
2024/11/28
(paimon) branch master updated: [core] Avoid extract from file footer when stats mode is none (#4604)
lzljs3620320
2024/11/28
(paimon) branch master updated: [doc] fix the ‘primary-key-table’ link (#4606)
lzljs3620320
2024/11/28
(paimon) branch master updated: [core] Add basic implementation to support REST Catalog (#4553)
lzljs3620320
2024/11/27
(paimon) branch master updated: [core] Improve the performance of show tables with hive metastore (#4605)
lzljs3620320
2024/11/27
(paimon) branch master updated: [flink] Support minor compact strategy for dedicated compaction action. (#4589)
lzljs3620320
2024/11/27
(paimon) branch master updated: [flink] Avoids miscellaneous deprecated APIs for 2.0 Preview (#4590)
lzljs3620320
2024/11/27
(paimon) branch master updated: [test] Fix build Spark utit workflow on jdk11 (#4596)
lzljs3620320
2024/11/26
(paimon) branch master updated: [core] Add tests for drop stats for overwrite commit (#4600)
lzljs3620320
2024/11/26
(paimon-trino) branch main updated: Flatten paimon-trino-440 to top level (#92)
lzljs3620320
2024/11/26
(paimon) branch master updated (7a39013561 -> 0185f7c19b)
lzljs3620320
2024/11/26
(paimon) branch master updated: [doc] Add changelog merging into changelog-producer
lzljs3620320
2024/11/26
svn commit: r73280 - /dev/paimon/paimon-python-0.1.1-rc6/
yuzelin
2024/11/26
(paimon-python) annotated tag release-0.1.1-rc6 updated (4a81de9 -> eb3575e)
yuzelin
2024/11/26
(paimon-python) 01/01: [Rename] Rename module and package to pypaimon (#29)
yuzelin
2024/11/26
(paimon-python) branch release-0.1 updated (e8e5694 -> b180329)
yuzelin
2024/11/26
(paimon-python) branch main updated: [Rename] Rename module and package to pypaimon (#29)
yuzelin
2024/11/26
(paimon) branch master updated (6d0897f2d4 -> 01d2bb21b2)
lzljs3620320
2024/11/26
(paimon) branch master updated: 1
zouxxyy
2024/11/26
(paimon) branch master updated: [spark] define spark properties globally (#4593)
lzljs3620320
2024/11/26
(paimon) branch master updated: [core] Improve the performance of show tables (#4592)
lzljs3620320
2024/11/25
(paimon) branch master updated (a8a3751ab9 -> f822bec3b1)
lzljs3620320
2024/11/25
(paimon-trino) branch main updated: Remove useless tree file
lzljs3620320
2024/11/25
(paimon-trino) branch main updated: Fix checkstyle in TrinoCatalog
lzljs3620320
2024/11/25
(paimon-trino) branch main updated: Update Paimon core to 1.0-SNAPSHOT
lzljs3620320
2024/11/25
(paimon-trino) branch release-0.8 updated (a176d9d -> 6925f02)
lzljs3620320
2024/11/25
(paimon) branch master updated: [doc] Fix doc with trino engine
lzljs3620320
2024/11/25
(paimon-trino) branch main updated: Remove shuffle for unaware append table write (#90)
lzljs3620320
2024/11/25
(paimon-trino) branch main updated: Avoid using the same Projection object in different threads (#91)
lzljs3620320
2024/11/25
(paimon) branch master updated: [flink] Avoid deprecated usages about Configuration (#4584)
lzljs3620320
2024/11/25
(paimon-python) annotated tag release-0.1.1-rc5 updated (716ec90 -> 56be4f5)
yuzelin
2024/11/25
svn commit: r73251 - /dev/paimon/paimon-python-0.1.1-rc5/
yuzelin
2024/11/25
(paimon-trino) branch main updated: Support insert operations for append table and append queue (#89)
lzljs3620320
2024/11/25
(paimon-trino) branch main updated: Avoid deleting directories including data during expired snapshots (#88)
lzljs3620320
2024/11/25
(paimon-python) branch main updated: Add read API to convert result to DuckDB and Ray (#28)
lzljs3620320
2024/11/25
(paimon) branch master updated: [core] CleanOrphanFilesResult.deletedFilesPath should be nullable
lzljs3620320
2024/11/25
(paimon) branch master updated: [core] add deletedFileTotalSizeInBytes in result of OrphanFilesClean (#4545)
lzljs3620320
2024/11/25
(paimon-python) branch main updated: Refactor ReadBuilder#with_projection to accept field names for better using (#27)
lzljs3620320
2024/11/25
(paimon) branch master updated: [flink] Adopt getTaskInfo() when acquiring parallelism info (#4583)
lzljs3620320
2024/11/25
(paimon) branch master updated: [flink] Adopt open(OpenContext) in RichFunction (#4581)
lzljs3620320
2024/11/24
(paimon) branch master updated: [doc] Document changelog producer to use lookup
lzljs3620320
2024/11/24
(paimon) branch master updated: [doc] Move Catalog API together with Java API
lzljs3620320
2024/11/24
(paimon) branch master updated: [hive] Improve paimon format table conversion hive table in hive catalog. (#4522)
lzljs3620320
2024/11/24
(paimon) branch master updated: [flink][cdc] Update flink dependency to 1.20 (#4580)
lzljs3620320
2024/11/24
(paimon) branch master updated: [flink][hotfix] Wait for consumer reset before job close (#4578)
lzljs3620320
2024/11/24
(paimon) branch master updated: [spark] Support spark to create external table sql statements. (#4576)
lzljs3620320
2024/11/24
(paimon) branch master updated: [hive] Make HiveCatalog alterTable works for Hive 1.x
lzljs3620320
2024/11/24
(paimon) branch master updated: [Hive] Avoid excessive HMS memory usage when executing AlterTable for a Paimon table containing a large number of fields (#4549)
lzljs3620320
2024/11/22
(paimon) branch master updated: [core] Improve object table for fileIO, Privileged and parent_path (#4575)
lzljs3620320
2024/11/22
(paimon) branch master updated: [core] Add cache for snapshots in CachingCatalog (#4565)
lzljs3620320
2024/11/22
(paimon) branch master updated: [core] Ensure triggerCompaction in RecordWriter.isCompacting (#4574)
lzljs3620320
2024/11/22
svn commit: r73208 - /dev/paimon/paimon-python-0.1.1-rc4/
yuzelin
2024/11/22
svn commit: r73207 - /dev/paimon/paimon-python--rc4/
yuzelin
2024/11/22
svn commit: r73206 - /dev/paimon/paimon-python--rc4/
yuzelin
2024/11/22
(paimon-python) annotated tag release-0.1.1-rc4 updated (c69760a -> 13e56df)
yuzelin
2024/11/22
(paimon-python) annotated tag release-0.1.1-rc4 deleted (was f8e36b1)
yuzelin
2024/11/22
(paimon-python) annotated tag release-0.1.1-rc4 updated (53757b4 -> f8e36b1)
yuzelin
2024/11/22
(paimon-python) annotated tag release-0.1.0-rc4 deleted (was f0ada6a)
yuzelin
2024/11/22
svn commit: r73205 - /dev/paimon/paimon-python-0.1.1-rc3/
yuzelin
2024/11/22
svn commit: r73204 - /dev/paimon/paimon-python-0.1.0-rc4/
yuzelin
2024/11/22
svn commit: r73203 - /dev/paimon/paimon-python-0.1.0-rc4/
yuzelin
2024/11/22
(paimon) branch master updated: [doc] Improve doc for delete syntax (#4560)
lzljs3620320
2024/11/22
(paimon-python) annotated tag release-0.1.0-rc4 updated (de9646c -> f0ada6a)
yuzelin
2024/11/21
(paimon) branch master updated: [flink] Refactor compactorSink to support extended compact type. (#4569)
lzljs3620320
2024/11/21
(paimon) branch master updated: [Hive] Fix Hive DDL and paimon schema mismatched bug (#4561)
lzljs3620320
2024/11/21
(paimon) branch master updated: [hive] Determine timestamp ltz type based on hive runtime version (#4571)
lzljs3620320
2024/11/21
(paimon) branch master updated: [cdc] support aliyun-json when sinking data from kafka with paimon-flink-action (#4570)
lzljs3620320
2024/11/20
(paimon) branch master updated: [hive] Rename hive external table should not change table path (#4562)
lzljs3620320
2024/11/20
(paimon) branch master updated: [test] Avoid table name duplication in HiveWriteITCase (#4563)
lzljs3620320
2024/11/20
(paimon) branch master updated: [flink] Fix that dim table cannot refresh overwrite changes (#4558)
lzljs3620320
2024/11/20
(paimon) branch master updated (d381e12d0 -> 187825a6a)
lzljs3620320
2024/11/20
(paimon) branch master updated: [comments] fix error comments in FileSystemCatalogTest (#4557)
lzljs3620320
2024/11/20
(paimon) branch master updated: [flink] change env.fromData to fromElements for compatibility with flink 1.18 and lower versions (#4541)
lzljs3620320
2024/11/20
(paimon) branch master updated: [core] all catalogs use 'allow-upper-case' to control case-sensitive (#4555)
lzljs3620320
2024/11/19
(paimon-trino) branch main updated: Supports insert operations (#86)
lzljs3620320
2024/11/19
(paimon) branch master updated: [core] Remove FileStoreScan.withManifestList and fix unstable test (#4552)
junhao
2024/11/19
(paimon) branch master updated: [orc] Add type id to orc files (#4523)
lzljs3620320
2024/11/18
(paimon) branch master updated: [core] Drop stats in manifest file reading (#4534)
junhao
2024/11/18
(paimon) branch master updated: [avro] Writer throw more clear exception when NPE with aggregation merge function (#4547)
lzljs3620320
2024/11/18
(paimon) branch master updated: [doc] Simplify chapter name in iceberg compatibility
lzljs3620320
2024/11/18
svn commit: r73142 - /dev/paimon/paimon-python-0.1.1-rc3/
yuzelin
2024/11/18
svn commit: r73141 - /dev/paimon/paimon-python-0.1.1-rc2/
yuzelin
2024/11/18
(paimon-python) annotated tag release-0.1.1-rc3 updated (95f2648 -> 192beb9)
yuzelin
2024/11/18
(paimon-python) 02/02: [release-tool] Minor fix create_binary_release.sh (#25)
yuzelin
2024/11/18
(paimon-python) branch release-0.1 updated (cbb81bb -> e8e5694)
yuzelin
2024/11/18
(paimon-python) 01/02: Fix that field nullability affects write (#24)
yuzelin
2024/11/18
(paimon) branch master updated: [spark] Introduce View Support to SparkCatalog (#4538)
lzljs3620320
2024/11/18
(paimon) branch master updated: [doc] Move system tables to concepts
lzljs3620320
2024/11/18
(paimon) branch master updated: [hive] Sync db owner prop to hms when creating the db (#4544)
lzljs3620320
2024/11/17
(paimon) branch master updated (203db415d -> 220789d5a)
lzljs3620320
Later messages