Mark Payne created NIFI-1280:
--------------------------------
Summary: Create FilterCSVColumns Processor
Key: NIFI-1280
URL: https://issues.apache.org/jira/browse/NIFI-1280
Project: Apache NiFi
Issue Type: Task
Components: Extensions
Reporter: Mark Payne
We should have a Processor that allows users to easily filter out specific
columns from CSV data. For instance, a user would configure two different
properties: "Columns of Interest" (a comma-separated list of column indexes)
and "Filtering Strategy" (Keep Only These Columns, Remove Only These Columns).
We can do this today with ReplaceText, but it is far more difficult than it
would be with this Processor, as the user has to use Regular Expressions, etc.
with ReplaceText.
Eventually a Custom UI could even be built that allows a user to upload a
Sample CSV and choose which columns from there, similar to the way that Excel
works when importing CSV by dragging and selecting the desired columns? That
would certainly be a larger undertaking and would not need to be done for an
initial implementation.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)