MaxGekk opened a new pull request #30449:
URL: https://github.com/apache/spark/pull/30449


   ### What changes were proposed in this pull request?
   1. Add a hook method to `addPartitionKey()` of `InMemoryTable` which is 
called per every row.
   2. Override `addPartitionKey()` in `InMemoryPartitionTable`, and partition 
key every time when new row is inserted to the table.
   
   ### Why are the changes needed?
   To be able to write unified tests for datasources V1 and V2. Currently, 
INSERT INTO a V1 table creates partitions but the same doesn't work for the 
custom catalog `InMemoryPartitionTableCatalog` used in DSv2 tests. 
   
   ### Does this PR introduce _any_ user-facing change?
   No
   
   ### How was this patch tested?
   By running the affected test suite `DataSourceV2SQLSuite`.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
[email protected]



---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to