keith-turner commented on PR #3796:
URL: https://github.com/apache/accumulo/pull/3796#issuecomment-1745520104

   > Would this be another task type for 
https://github.com/apache/accumulo/pull/3801 ?
   
   Yeah, I think it may.  It will be similar to computing splits.  Wondering 
how all of these should return data.   If the manager stores results in memory 
then it has to store the data until the FATE operation runs again and is ready 
to consume it.  Thinking it could write the result to the metadata table 
instead of storing it in manager memory, maybe something like the following.
   
    1. Fate op needs computation done for tablet and queues a task and then 
exits (fate will run it later)
    2. The task eventually runs on a worker, computes the result, and then 
writes the result to the tablets row in the metadata table.
    3. Fate step runs again and sees the result of the computation in the 
metadata table and uses it
   
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to