Github user jinxing64 commented on the issue:
https://github.com/apache/spark/pull/21289
@cloud-fan @adrian-ionescu
Thanks for looking into this !
The issue is that when I append into a table with sql below:
```
insert into X select ....
```
It always refresh the file index of table X in memory, though I don't query
X after this job. From this point, the refresh is not necessary and costs much
time and memory.
In this pr, I proposes to mark the file index as 'outdated', and postpone
the refresh until next query of the file index.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
