Also, I think there will be a high likelihood of format-specific
processors like ValidateCSV going away in NiFi 2.0. I wouldn't start
any new data engineering work using these processors.
On Wed, Jan 18, 2023 at 4:02 PM Pierre Villard
wrote:
>
> Hi,
>
> ValidateCSV was relea
Hi,
ValidateCSV was released before and is using a specific library that is
allowing you to define specific rules on what the CSV should contain (like
for a given column that should contain numerical values, confirm the values
are in a specific range, etc) [1]. ValidateRecord would only check
I am trying to wrap my head around why there is a ValidateCsv processor
when there is a ValidateRecord processor which can do I believe everything
ValidateCsv can do and more. What is the community stance on this? Should
only ValidateRecord be used or is there still a use case for using
eply.
>
> could you please help me in giving one example.
>
> how to provide schema for validation in schema property of ValidateCsv.
> That helps me to parse my files
>
> Meanwhile i will raise jira ticket to include to validate header and footer
> in validateCSV.
>
&
Hi Pierre,
Thanks for the reply.
could you please help me in giving one example.
how to provide schema for validation in schema property of ValidateCsv.
That helps me to parse my files
Meanwhile i will raise jira ticket to include to validate header and footer
in validateCSV.
Thanks very
Hi Shashi,
As James pointed it out, the ValidateCSV processor does have a property
"Header" that says "my CSV data contains a header line, please ignore it
while validating data". That's all. There is nothing to validate the header
itself. And there is nothing about foot
Hi James,
Thanks for the reply.
In validateCSV processor ,header property has two options like true and
false.
True - header is considered
False- header is ignored
I am going with "true" option to validate my file header by providing
schema in schema property.
Usecase:
F
Shashi,
The ValidateCsv processor's "Header" property allows the header to be
ignored in validation, but it does not have a special feature to validate
the header itself. I do not believe there is a similar feature for
ignoring a footer.
Can you expand a bit more on your use cas
Hi Team,
i have a file with header , footer and delimited with '|'.
Assit me on how to provide schema in ValidateCSV processor to validate my
header and footer.
Regards,
Shashi.
--
View this message in context:
http://apache-nifi-developer-list.39713.n7.nabble.com/ValidateC
