Hi,
In case of structured streaming StateStore, if I plug-in an embedded store like, RocksDB to maintain per partition aggregation state inside my executors and state will be maintained per partitionId and operatorId. How do I reuse/map to the old state for the cases of executor failures or driver failures? I would like to keep this state as local to executors and not fetch remotely.
