[I] [Bug] DV Table + Tag Query Issue [paimon]

[via GitHub]

MonsterChenzhuo opened a new issue, #4120:
URL: https://github.com/apache/paimon/issues/4120

   ### Search before asking
   
   - [X] I searched in the [issues](https://github.com/apache/paimon/issues) 
and found nothing similar.
   
   
   ### Paimon version
   
   master
   
   ### Compute Engine
   
   flink 1.18
   
   ### Minimal reproduce step
   
   Steps to Reproduce the Issue：
   1.Table Properties：
   protected static Map<String, String> getBasicTableConfig() {
           Map<String, String> config = new HashMap<>();
           config.put("bucket", "4");
           config.put("sink.parallelism", "2");
           config.put("tag.automatic-creation", "process-time");
           config.put("tag.creation-period", "hourly");
           config.put("tag.creation-delay", "5m");
           config.put("tag.num-retained-max", "2");
           config.put("deletion-vectors.enabled", "true");
           config.put("merge-engine", "deduplicate");
           config.put("file.format", "parquet");
           config.put("write-only", "true");
           config.put("scan.infer-parallelism", "false");
           return config;
       }
   2.start mysql cdc Ingestion:
   MySqlSyncTableAction action =
           new MySqlSyncTableAction(warehouse, database, 
"test",basicCatalogConfig ,mysqlConfig);
   3.Start a compaction job
   CompactAction action =
           new CompactAction(warehouse, database, "test",basicCatalogConfig, 
tableConfig);
   4.Check the current metadata after the program has been running for a while
   
![image](https://github.com/user-attachments/assets/db52f66a-f1dc-40bd-a45b-ed7f70cec376)
   5.查询
   
![image](https://github.com/user-attachments/assets/aaa89d83-5ffe-49ed-a402-22f080d6dbe6)
   6.Tag-based Query.
   
![image](https://github.com/user-attachments/assets/cb0403cb-3888-4d7c-b1bd-72aa27a4aabe)
   7.Debug Breakpoint Debugging
   public class SqlTest2 {
       public static void main(String[] args) {
           Configuration configuration = new Configuration();
           configuration.set(ExecutionOptions.RUNTIME_MODE, 
RuntimeExecutionMode.BATCH);
           StreamExecutionEnvironment env = 
StreamExecutionEnvironment.getExecutionEnvironment(configuration);
           StreamTableEnvironment tableEnv = StreamTableEnvironment.create(env);
           tableEnv.executeSql("CREATE CATALOG my_catalog WITH(\n" +
                   "'type'='paimon',\n" +
                   
"'warehouse'='file:/Users/zhuoyuchen/Documents/GitHub/incubator-paimon/data'\n" 
+
                   ");");
           TableResult tableResult = tableEnv.executeSql("SELECT * FROM 
my_catalog.saaa1969977.test /*+ OPTIONS('scan.tag-name' = '2024-09-03 18') 
*/;");
   //        TableResult tableResult = tableEnv.executeSql("SELECT * FROM 
my_catalog.saaa1969977.test;");
           tableResult.print();
       }
   }
   
![image](https://github.com/user-attachments/assets/44901dc6-4e9c-49c9-9b4d-163d699edc0e)
   8.Call Stack
   
![image](https://github.com/user-attachments/assets/e6f712ae-32aa-4584-ac69-4885403acebb)
   
   
   ### What doesn't meet your expectations?
   
   Tag-based Query.
   
![image](https://github.com/user-attachments/assets/cb0403cb-3888-4d7c-b1bd-72aa27a4aabe)
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: issues-unsubscr...@paimon.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org