Peter Ebert created IMPALA-10824:
------------------------------------

             Summary: Persist Remote Read Cache when Restarting Impala Executors
                 Key: IMPALA-10824
                 URL: https://issues.apache.org/jira/browse/IMPALA-10824
             Project: IMPALA
          Issue Type: Improvement
            Reporter: Peter Ebert


Currently impala executors will delete the remote read cache at startup.  For 
users dependent on a warm cache for good performance, a restart might be needed 
to change a setting or fix an issue, which would then clear the cache, make 
queries slower, and hit the network.  If Impala instead wrote out the cache 
metadata on shutdown, and loaded on startup, this would keep the cache warm and 
not slow down subsequent queries.

 

I would envision this just for intentional shutdown/restarts, not unexpected 
failures/stops where consistency of the metadata would be difficult or 
impossible to maintain.  When loading on startup if any inconsistencies were 
found aborting and deleting the cache would be understandable.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to