Hi Frank, NiFi does not currently have native support for Cobol formats, such as copybook or EBCDIC. However, NiFi is built to be very extensible/pluggable, and as such, support can be added for any type of data conversion that you can imagine. For example, a new conversion processor from EBCDIC would probably either go into a CSV format or directly into NiFi's Record format[1]. From there, conversion to other forms and egress to systems like Hive would be relatively easy to do.
I have a small hobby-level interest in Cobol, from my early days in tech. I would be happy to help guide you, if you decide to create a custom NiFi processor to do this conversion. Many other NiFi community members will likewise be happy to guide you as well. It's possible even that it would be considered for inclusion in the NiFi distribution directly, but likewise, your custom NiFi extensions can live on strictly as an add-on component in your control. You don't necessarily need it to be included into the main NiFi distribution for you to leverage NiFi's extensibility. Do you know of any Java-based libraries that already do the conversion that you need? If so, that would be the starting place for the custom component. /Adam [1] https://blogs.apache.org/nifi/entry/record-oriented-data-with-nifi On Fri, Jan 6, 2023 at 7:06 AM DiMartini, Frank L < frank.dimart...@navient.com> wrote: > Hello, > > > > Does or will Apache Nifi support cobol copybook and EBCDIC file formats as > a source? If not, Is there a way to build a custom source to support this? > We are looking for ETL tools that have this functionality and can load to > an Apache Hive DB. > > > > Thanks, > > > > > > > *Frank DiMartini *Principal, Enterprise Data Warehouse > > Navient > Pennsylvania Home Office > > 570.706.6085 (m) > frank.dimart...@navient.com > * Navient.com* > > >
