Stefanietry opened a new issue, #8087:
URL: https://github.com/apache/paimon/issues/8087

   ### Search before asking
   
   - [x] I searched in the [issues](https://github.com/apache/paimon/issues) 
and found nothing similar.
   
   
   ### Paimon version
   
   708ea8fc
   
   ### Compute Engine
   
   spark version: 3.2
   
   ### Minimal reproduce step
   
   1. create vector table
     `CREATE  TABLE test_db.test_table(gid BIGINT, sid STRING, embs 
ARRAY<FLOAT>) PARTITIONED BY (`date` STRING COMMENT 'date')
   ROW      FORMAT SERDE 'org.apache.paimon.hive.PaimonSerDe' WITH 
SERDEPROPERTIES ('serialization.format'='1')
   STORED AS INPUTFORMAT 'org.apache.paimon.hive.mapred.PaimonInputFormat' 
OUTPUTFORMAT 'org.apache.paimon.hive.mapred.PaimonOutputFormat'
   TBLPROPERTIES (
       'file.format' = 'parquet',
       'vector.file.format'='lance',
       'vector-field'='embs',
       'field.embs.vector-dim'='4',
       'row-tracking.enabled'='true',
       'data-evolution.enabled'='true',
       'global-index.enabled' = 'true'
   );`
   2. load data
   `insert overwrite table test_db.test_table VALUES (1, '1', array(cast(1.0 as 
float), cast(2.0 as float), cast(3.0 as float), cast(4.0 as float)) 
'20260420');`
   3. proceess a query 
   select gid, sid, embs  from test_db.test_table where date = '20260422' limit 
10
   4. fail build paimon scan 
   
   <img width="2170" height="664" alt="Image" 
src="https://github.com/user-attachments/assets/bd266c73-9705-4194-a33d-acd87493f92a";
 />
   
   ### What doesn't meet your expectations?
   
   Process vector search with spark3.2
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [x] I'm willing to submit a PR!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to