[
https://issues.apache.org/jira/browse/PHOENIX-5527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16958993#comment-16958993
]
Lars Hofhansl commented on PHOENIX-5527:
----------------------------------------
After a bit more reflection it seems fine to "muck with history" as long as it
falls within the uncertainty implied by the algorithm anyway. Specifically if
an index row is marked as UNVERIFIED it should be OK to play with the
timestamps, as far as Phoenix is concerned the write is not complete, so within
that range we backdate TSs without much concern.
Also when discussed with [~kozdemir] yesterday I remembered there's a table
option to store nulls called (not surprisingly) STORE_NULLS, with that Phoenix
will not place delete markers on the main table, but simple write a new version
of a column with NULL as the value. Not sure that helps here, and we also
cannot simply change all tables to have this, but I thought I'd mention it here.
> Unverified index rows should not be deleted due to replication lag
> -------------------------------------------------------------------
>
> Key: PHOENIX-5527
> URL: https://issues.apache.org/jira/browse/PHOENIX-5527
> Project: Phoenix
> Issue Type: Improvement
> Affects Versions: 5.0.0, 4.14.3
> Reporter: Kadir OZDEMIR
> Assignee: Kadir OZDEMIR
> Priority: Major
> Fix For: 4.15.0, 5.1.0
>
> Attachments: PHOENIX-5527.master.001.patch,
> PHOENIX-5527.master.002.patch, PHOENIX-5527.master.003.patch
>
>
> The current default delete time for unverified index rows is 10 minutes. If
> an index table row is replicated before its data table row and the
> replication row is unverified at the time of replication, it can be deleted
> when it is scanned on the destination cluster. To prevent these deletes due
> to replication lag issues, we should increase the default time to 7 days.
> This value is configurable using the configuration parameter,
> phoenix.global.index.row.age.threshold.to.delete.ms.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
