Ive been introduced to a new situation, thought someone might have some advice.
Imagine a system in which live data is stored in a sql lite database. The name of the sql lite file changes every hour. The schema is always the same, but the files roll over every 60 minutes. Now imagine I have the need to query for 6-96 hours worth of data into a single file via nifi. Since the sqllite file name changes every hour, the jdbc connection string is constantly changing. The two options I've come up with are 1. Have one constant name for the db file, and use that as my connection string and then always connect to that string. Unfortunately, this means I can only process one flow file at a time, thus one hour of data at a time 2. I found some python scripts online which can "glue together" multiple sql lite databases. I could have nifi run the script to first glue together the hours I need into one single file, and then use the technique above. Anybody have any other thoughts? How can I parameterize the jdbc connection string? Geoff Greene The Boeing Company
