Philipp Zehnder created STREAMPIPES-582:
-------------------------------------------

             Summary: Redesign the remove duplicates function for adapters
                 Key: STREAMPIPES-582
                 URL: https://issues.apache.org/jira/browse/STREAMPIPES-582
             Project: StreamPipes
          Issue Type: Improvement
          Components: Connect
            Reporter: Philipp Zehnder
             Fix For: 0.90.0


h2. Current functionality

A user can select the *remove duplicate* option in the start adapter tab and 
select the *time interval* how long events are stored in cache (class: 
{{{}org.apache.streampipes.connect.adapter.preprocessing.transform.stream.DuplicateFilterPipelineElement{}}})
h3. Problems
 * The state is not persisted when an adapter is restarted
 * No option to ignore the timestamp field

h3. New functionality
 * A user should be able to add the remove duplicate rule with the option to 
ignore the timestamp field.
 * A user should be able to restart an adapter without loosing the state of the 
remove duplicate rule

h3. Info
 * To do that we need to extend the API of adapters and add the functionality 
to execute code when an adapter is stopped
 * An API to load data (on startup) and persist (on shutdown) for elements is 
required



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to