I think the BuffeCache is the core issue, the recovery process may just run into the same spin trap where it was stopped. And I create another issue that we should be able to Abort the task so that we don’t need to restart the server.
> On May 16, 2016, at 7:24 AM, Michael Blow <mblow.apa...@gmail.com> wrote: > > This might be related: (ASTERIXDB-1438) BufferCache spins indefinitely when > cache is exceeded. > > https://issues.apache.org/jira/browse/ASTERIXDB-1438 > > Thanks, > > -MDB > > On Mon, May 16, 2016 at 1:52 AM Mike Carey <dtab...@gmail.com> wrote: > >> Glad it worked out - can someone also capture the core issue in JIRA? Thx! >> On May 15, 2016 11:40 PM, "Jianfeng Jia" <jianfeng....@gmail.com> wrote: >> >>> Great! The server is back now. Thanks a lot! >>>> On May 15, 2016, at 2:26 PM, Murtadha Hubail <hubail...@gmail.com> >>> wrote: >>>> >>>> You can delete the existing log files and create new empty ones with >>> incremented log file number, but it is very important that you don't >>> delete the checkpoint file. >>>> Of course any data in the old log files will be lost, but the data >>> already on disk will be available. >>>> >>>>> On May 15, 2016, at 1:23 PM, Jianfeng Jia <jianfeng....@gmail.com> >>> wrote: >>>>> >>>>> Hi, >>>>> We submitted a long running join+insert query and stop the cluster to >>> stop running it. However, when it restarted it ran the recovery forever, >>>>> the logs shows that it is creating a lot of buffer cache. >>>>> >>>>> In order to bring the cluster back to answer the query, is there any >>> hacking solutions? such as remove the recovery txnlogs? I’m worried that >> it >>> will ruin the cluster somehow. >>>>> We are in a contest so any early helps are really appreciated! Thanks! >>>>> >>>>> >>>>> Best, >>>>> >>>>> Jianfeng Jia >>>>> PhD Candidate of Computer Science >>>>> University of California, Irvine >>>>> >>> >>> >>> >>> Best, >>> >>> Jianfeng Jia >>> PhD Candidate of Computer Science >>> University of California, Irvine >>> >>> >> Best, Jianfeng Jia PhD Candidate of Computer Science University of California, Irvine