Re: Secondary Indexes - Pluggable File Filter interface for Apache Iceberg

Hi Guy, I will read the doc in the weekend. Thanks! Miao From: Guy Khazma Reply-To: "dev@iceberg.apache.org" Date: Friday, February 19, 2021 at 8:49 AM To: "dev@iceberg.apache.org" Subject: Secondary Indexes - Pluggable File Filter interface for Apache Iceberg Hi All, Following up on our

Re: Timestamp / Date filtering

Created a PR with the fix, but not entirely comfortable with the changes in GenericRecord.java https://github.com/apache/iceberg/pull/2254 If you have time and more knowledge around the expected behavior of the GenericRecord, please review.

Secondary Indexes - Pluggable File Filter interface for Apache Iceberg

Hi All, Following up on our discussion from Wednesday sync here attached is a proposal to enhance iceberg with a pluggable interface for data skipping indexes to enable use of existing indexes in job planning.

Secondary Indexes - Pluggable File Filter interface for Apache Iceberg

Hi All, Following up on our discussion from Wednesday sync attached is a proposal to enhance Iceberg with a pluggable interface for data skipping indexes to enable use of existing indexes in job planning. https://docs.google.com/document/d/11o3T7XQVITY_5F9Vbri9lF9oJjDZKjHIso7K8tEaFfY/edit# We

Timestamp / Date filtering

Hi Team, Running tests against Iceberg backed Hive tables I was trying to run this query: SELECT * from date_test WHERE d_date='1998-02-19' The query fails with the Exception below. Basically complains that when filtering the Date field it expects an Integer in the Record, but finds a

Re: RewriteDataFiles & DataStream streaming read error when row level delete by equal

hi,ryan: Flink will automatically infer the data type. If it cannot be inferred, it will use kryo to do de/serialized. https://ci.apache.org/projects/flink/flink-docs-stable/dev/types_serialization.html#general-class-types I tested this problem and it does exist. I guess that a certain