[
https://issues.apache.org/jira/browse/NIFI-4457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16190937#comment-16190937
]
Koji Kawamura commented on NIFI-4457:
-------------------------------------
[~mehrdad22] I just wonder how are those rows inserted into the original table?
Using twitter API? Does 'tweet_id' guarantee ordering when you insert those
rows to the original table? When I sorted the data set in the attached
'subquery.csv', I found following rows. By looking at these rows, I'm not sure
if it's a good idea to use 'tweet_id' as 'Maximum-value column' for
QueryDatabase table, especially if the 'date' column represents when a row is
inserted.:
{code}
915459071205093382,10/4/2017 9:41:46 AM
915459072178163714,10/4/2017 9:41:01 AM
915459072908038144,10/4/2017 9:41:46 AM
915459073721630720,10/4/2017 9:41:01 AM
915459075462311936,10/4/2017 9:41:46 AM
915459076183687168,10/4/2017 9:41:01 AM
{code}
'tweet_id' is a unique identifier and have timestamp in it, but I'm not sure if
it is globally in consistent order when you get these data set because it also
has worker number in it.
https://developer.twitter.com/en/docs/basics/twitter-ids
> "Maximum-value" not increasing when "initial.maxvalue" is set and
> "Maximum-value column" name is different from "id"
> ---------------------------------------------------------------------------------------------------------------------
>
> Key: NIFI-4457
> URL: https://issues.apache.org/jira/browse/NIFI-4457
> Project: Apache NiFi
> Issue Type: Bug
> Components: Core Framework
> Affects Versions: 1.3.0
> Environment: windows 10
> Reporter: meh
> Attachments: Picture1.png, Picture2.png, subquery.csv
>
> Original Estimate: 24h
> Remaining Estimate: 24h
>
> when "Maximum-value column" name is "id" there is no problem, when i add
> "initial.maxvalue.id" property in "QueryDatabaseTable" processor, it works
> well and maxvalue is increasing by every running.
> !Picture1.png|thumbnail!
> but...
> when the "Maximum-value column" name is different from "id" (such as
> "tweet_id"), after initial processor working, only given
> "initial.maxvalue.id" is saves and that repeating just same value for every
> run.
> !Picture2.png|thumbnail!
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
