[
https://issues.apache.org/jira/browse/PHOENIX-7792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Himanshu Gwalani updated PHOENIX-7792:
--------------------------------------
Description:
If the file timestamp is closer to round end time, replay would start
processing it before it's closed, because replay waits till 1 round + some
buffer time from previous round end time (not the file timestamp).
DOD - Ensure while processing NEW files, replay should delay the processing for
files based on it's timestamp, i.e. atleast 1 round of time should have passed
from the file creation time, before the file is processed.
was:
The replay service can get stuck in an infinite loop if there is a persistent
issue while processing older files in the in-progress directory.
{code:java}
files = replicationLogTracker.getOlderInProgressFiles(oldestTimestampToProcess);
while (!files.isEmpty()) {
processOneRandomFile(files);
files =
replicationLogTracker.getOlderInProgressFiles(oldestTimestampToProcess);
} {code}
> Add wait time before processing NEW files to minimize the possibility of
> files being open during replay
> -------------------------------------------------------------------------------------------------------
>
> Key: PHOENIX-7792
> URL: https://issues.apache.org/jira/browse/PHOENIX-7792
> Project: Phoenix
> Issue Type: Sub-task
> Reporter: Himanshu Gwalani
> Assignee: Himanshu Gwalani
> Priority: Major
>
> If the file timestamp is closer to round end time, replay would start
> processing it before it's closed, because replay waits till 1 round + some
> buffer time from previous round end time (not the file timestamp).
> DOD - Ensure while processing NEW files, replay should delay the processing
> for files based on it's timestamp, i.e. atleast 1 round of time should have
> passed from the file creation time, before the file is processed.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
