hekaifei commented on issue #2471:
URL:
https://github.com/apache/incubator-paimon/issues/2471#issuecomment-1846771025
@Zouxxyy
1. create table , I use the hive client
` CREATE TABLE dynamic_bucket_tests (
`id` BIGINT,
`job_group` BIGINT,
`job_id` BIGINT ,
`ums_ts_` BIGINT)
COMMENT ''
STORED BY 'org.apache.paimon.hive.PaimonStorageHandler'
TBLPROPERTIES(
'bucket' = '-1',
'consumer.expiration-time' = '1h',
'file.format' = 'parquet',
'metastore.partitioned-table' = 'true',
'primary-key' = 'id',
'sequence.field' = 'ums_ts_');`
2. insert data , I use spark sql
`spark.read.json("dynamic_bucket_tests.json").repartition(10).createOrReplaceTempView("t1")
spark.sql("""insert into dynamic_bucket_tests select * from t1""")`
3. try to delete
`spark-sql> delete from dynamic_bucket_tests where id =55233981;
Time taken: 11.076 seconds
spark-sql>
> select * from dynamic_bucket_tests where id =55233981;
Time taken: 3.362 seconds
spark-sql> delete from dynamic_bucket_tests where id =55235391;
Time taken: 7.803 seconds
spark-sql> select * from dynamic_bucket_tests where id =55235391;
55235391 65 59662 16995456000000
Time taken: 2.226 seconds, Fetched 1 row(s)`
[dynamic_bucket_tests.json](https://github.com/apache/incubator-paimon/files/13611385/dynamic_bucket_tests.json)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]