[jira] [Commented] (CAMEL-12331) camel-sql - JdbcMessageIdRepository should have a background task to delete old entries
[ https://issues.apache.org/jira/browse/CAMEL-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16493213#comment-16493213 ] Önder Sezgin commented on CAMEL-12331: -- IMHO, clean up at the application level would not be a good practice.Instead, partitioning the table by some of group of key and dropping those partitions may be easier as a DB task. > camel-sql - JdbcMessageIdRepository should have a background task to delete > old entries > --- > > Key: CAMEL-12331 > URL: https://issues.apache.org/jira/browse/CAMEL-12331 > Project: Camel > Issue Type: New Feature > Components: camel-sql >Reporter: Claus Ibsen >Priority: Major > Fix For: 2.22.0 > > > You may want to cleanup the database table automatically by Camel so it does > not contain old data of previous processed files. > For example to say that entries that are > 24h can be deleted etc. > This works under the notion that you only use the idempoten check for > clustering where they may race for processing the same files, or that files > tomorrow are okay to process with the same name as yesterday etc. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
[jira] [Commented] (CAMEL-12331) camel-sql - JdbcMessageIdRepository should have a background task to delete old entries
[
https://issues.apache.org/jira/browse/CAMEL-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16399785#comment-16399785
]
Neo Xu commented on CAMEL-12331:
Can it compare Unix time? for example
{{{code}}}
{{SELECT UNIX_TIMESTAMP(cdate) AS unixDate, * FROM mytable where unixDate <
9008xx}}
{{{code}}}
> camel-sql - JdbcMessageIdRepository should have a background task to delete
> old entries
> ---
>
> Key: CAMEL-12331
> URL: https://issues.apache.org/jira/browse/CAMEL-12331
> Project: Camel
> Issue Type: New Feature
> Components: camel-sql
>Reporter: Claus Ibsen
>Priority: Major
> Fix For: 2.22.0
>
>
> You may want to cleanup the database table automatically by Camel so it does
> not contain old data of previous processed files.
> For example to say that entries that are > 24h can be deleted etc.
> This works under the notion that you only use the idempoten check for
> clustering where they may race for processing the same files, or that files
> tomorrow are okay to process with the same name as yesterday etc.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
[jira] [Commented] (CAMEL-12331) camel-sql - JdbcMessageIdRepository should have a background task to delete old entries
[ https://issues.apache.org/jira/browse/CAMEL-12331?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16390909#comment-16390909 ] Claus Ibsen commented on CAMEL-12331: - The trick is that how to compare with timestamp in a standard SQL syntax that works across databases. > camel-sql - JdbcMessageIdRepository should have a background task to delete > old entries > --- > > Key: CAMEL-12331 > URL: https://issues.apache.org/jira/browse/CAMEL-12331 > Project: Camel > Issue Type: New Feature > Components: camel-sql >Reporter: Claus Ibsen >Priority: Major > > You may want to cleanup the database table automatically by Camel so it does > not contain old data of previous processed files. > For example to say that entries that are > 24h can be deleted etc. > This works under the notion that you only use the idempoten check for > clustering where they may race for processing the same files, or that files > tomorrow are okay to process with the same name as yesterday etc. -- This message was sent by Atlassian JIRA (v7.6.3#76005)
