I looked into the feasibility of doing a direct integration and found it to not be a really good fit because the other "integrations" I found with Delta involved running Spark locally in the background IIRC. Maybe that's changed, but the impression I got was that Delta is more or less tied to how Spark works and doesn't fit in well with different systems like NiFi (or Hive, as I think Hive was their first "integration" attempt).
On Wed, Jun 15, 2022 at 12:42 PM scott <[email protected]> wrote: > > Hi community, > I was wondering if there is an official effort to add delta table format ( > delta.io ) into NiFi? I saw there were some discussions a few years back, but > not sure what came of that. Not looking for a workaround where I have to use > spark to do the actual read/write into the delta table, just pure NiFi( Java > ) solution. > > Thanks, > Scott
