Github user ijokarumawak commented on the issue:
https://github.com/apache/nifi/pull/2686
Hi @mans2singh sorry for the slow progress. I've been swamped with other
urgent tasks. Will come back to continue reviewing this once those get done.
BTW, do you have any suggestion to convert string values into nominal
numeric values, things like categories such as log level (ERR, INFO, WARN ...
etc).
I found this web page useful to think about data types for machine learning
and deep learning.
https://towardsdatascience.com/7-data-types-a-better-way-to-think-about-data-types-for-machine-learning-939fae99a689
I wonder how we can implement such conversions at NiFi. I still think NiFi
needs the capability to convert general data into numeric vector so that DL4J
can be applied. Without that these processors are hard to use.
I briefly took a look at datavec project, but it seems it depends on Spark
to execute such transformation. I envision NiFi doing such task within its data
flow so that it can use DeepLearning model directly against incoming streaming
data.
https://deeplearning4j.org/datavec
Anyone can join this review, please do so.
---
