Re: Cobol/EBCDIC Source

[Adam Taft]

Hi Frank,

NiFi does not currently have native support for Cobol formats, such as
copybook or EBCDIC. However, NiFi is built to be very extensible/pluggable,
and as such, support can be added for any type of data conversion that you
can imagine. For example, a new conversion processor from EBCDIC would
probably either go into a CSV format or directly into NiFi's Record
format[1]. From there, conversion to other forms and egress to systems like
Hive would be relatively easy to do.

I have a small hobby-level interest in Cobol, from my early days in tech. I
would be happy to help guide you, if you decide to create a custom NiFi
processor to do this conversion. Many other NiFi community members will
likewise be happy to guide you as well. It's possible even that it would be
considered for inclusion in the NiFi distribution directly, but likewise,
your custom NiFi extensions can live on strictly as an add-on component in
your control. You don't necessarily need it to be included into the main
NiFi distribution for you to leverage NiFi's extensibility.

Do you know of any Java-based libraries that already do the conversion that
you need? If so, that would be the starting place for the custom component.

/Adam

[1] https://blogs.apache.org/nifi/entry/record-oriented-data-with-nifi

On Fri, Jan 6, 2023 at 7:06 AM DiMartini, Frank L <
frank.dimart...@navient.com> wrote:

> Hello,
>
>
>
> Does or will Apache Nifi support cobol copybook and EBCDIC file formats as
> a source? If not, Is there a way to build a custom source to support this?
> We are looking for ETL tools that have this functionality and can load to
> an Apache Hive DB.
>
>
>
> Thanks,
>
>
>
>
>
>
> *Frank DiMartini *Principal, Enterprise Data Warehouse
>
> Navient
> Pennsylvania Home Office
>
> 570.706.6085 (m)
> frank.dimart...@navient.com
> * Navient.com*
>
>
>

Cobol/EBCDIC Source

[DiMartini, Frank L]

Hello,

Does or will Apache Nifi support cobol copybook and EBCDIC file formats as a 
source? If not, Is there a way to build a custom source to support this? We are 
looking for ETL tools that have this functionality and can load to an Apache 
Hive DB.

Thanks,

[cid:image001.png@01D921AC.F783ECD0]

Frank DiMartini
Principal, Enterprise Data Warehouse
Navient
Pennsylvania Home Office
570.706.6085 (m)
frank.dimart...@navient.com
Navient.com